Install hook fails in air gapped environment

Bug #1914730 reported by Frode Nordahl
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
charm-advanced-routing
Won't Fix
Medium
Unassigned

Bug Description

$ juju --version
2.8.7-focal-amd64

$ juju status
...
public-policy-routing error 47 advanced-routing jujucharms 4 ubuntu

Downgrading the charm to version 3 resolves the issue.

Log excerpt:
2021-02-05 06:26:48 WARNING install ERROR: Command errored out with exit status 1:
2021-02-05 06:26:48 WARNING install command: /var/lib/juju/agents/unit-public-policy-routing-1/.venv/bin/python -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-vwtzklu8/charmhelpers/setup.py'"'"'; __file__='"'"'/tmp/pip-install-vwtzklu8/charmhelpers/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base /tmp/pip-install-vwtzklu8/charmhelpers/pip-egg-info
2021-02-05 06:26:48 WARNING install cwd: /tmp/pip-install-vwtzklu8/charmhelpers/
2021-02-05 06:26:48 WARNING install Complete output (116 lines):
2021-02-05 06:26:48 WARNING install WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f8ed48a5640>: Failed to establish a new connection: [Errno 101] Network is unreachable')': /packages/fb/48/69046506f6ac61c1eaa9a0d42d22d54673b69e176d30ca98e3f61513e980/pbr-5.5.1-py2.py3-none-any.whl
2021-02-05 06:26:48 WARNING install WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f8ed48a5790>: Failed to establish a new connection: [Errno 101] Network is unreachable')': /packages/fb/48/69046506f6ac61c1eaa9a0d42d22d54673b69e176d30ca98e3f61513e980/pbr-5.5.1-py2.py3-none-any.whl
2021-02-05 06:26:48 WARNING install WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f8ed48a58e0>: Failed to establish a new connection: [Errno 101] Network is unreachable')': /packages/fb/48/69046506f6ac61c1eaa9a0d42d22d54673b69e176d30ca98e3f61513e980/pbr-5.5.1-py2.py3-none-any.whl
2021-02-05 06:26:48 WARNING install WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f8ed48a5a30>: Failed to establish a new connection: [Errno 101] Network is unreachable')': /packages/fb/48/69046506f6ac61c1eaa9a0d42d22d54673b69e176d30ca98e3f61513e980/pbr-5.5.1-py2.py3-none-any.whl
2021-02-05 06:26:48 WARNING install WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f8ed48a5bb0>: Failed to establish a new connection: [Errno 101] Network is unreachable')': /packages/fb/48/69046506f6ac61c1eaa9a0d42d22d54673b69e176d30ca98e3f61513e980/pbr-5.5.1-py2.py3-none-any.whl
2021-02-05 06:26:48 WARNING install ERROR: Exception:
2021-02-05 06:26:48 WARNING install Traceback (most recent call last):
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/urllib3/connection.py", line 159, in _new_conn
2021-02-05 06:26:48 WARNING install conn = connection.create_connection(
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/urllib3/util/connection.py", line 84, in create_connection
2021-02-05 06:26:48 WARNING install raise err
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/urllib3/util/connection.py", line 74, in create_connection
2021-02-05 06:26:48 WARNING install sock.connect(sa)
2021-02-05 06:26:48 WARNING install OSError: [Errno 101] Network is unreachable
2021-02-05 06:26:48 WARNING install
2021-02-05 06:26:48 WARNING install During handling of the above exception, another exception occurred:
2021-02-05 06:26:48 WARNING install
2021-02-05 06:26:48 WARNING install Traceback (most recent call last):
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 665, in urlopen
2021-02-05 06:26:48 WARNING install httplib_response = self._make_request(
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 376, in _make_request
2021-02-05 06:26:48 WARNING install self._validate_conn(conn)
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 996, in _validate_conn
2021-02-05 06:26:48 WARNING install conn.connect()
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/urllib3/connection.py", line 314, in connect
2021-02-05 06:26:48 WARNING install conn = self._new_conn()
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/urllib3/connection.py", line 171, in _new_conn
2021-02-05 06:26:48 WARNING install raise NewConnectionError(
2021-02-05 06:26:48 WARNING install urllib3.exceptions.NewConnectionError: <urllib3.connection.VerifiedHTTPSConnection object at 0x7f8ed48a5d00>: Failed to establish a new connection: [Errno 101] Network is unreachable
2021-02-05 06:26:48 WARNING install
2021-02-05 06:26:48 WARNING install During handling of the above exception, another exception occurred:
2021-02-05 06:26:48 WARNING install
2021-02-05 06:26:48 WARNING install Traceback (most recent call last):
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/requests/adapters.py", line 439, in send
2021-02-05 06:26:48 WARNING install resp = conn.urlopen(
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 747, in urlopen
2021-02-05 06:26:48 WARNING install return self.urlopen(
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 747, in urlopen
2021-02-05 06:26:48 WARNING install return self.urlopen(
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 747, in urlopen
2021-02-05 06:26:48 WARNING install return self.urlopen(
2021-02-05 06:26:48 WARNING install [Previous line repeated 2 more times]
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 719, in urlopen
2021-02-05 06:26:48 WARNING install retries = retries.increment(
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/urllib3/util/retry.py", line 436, in increment
2021-02-05 06:26:48 WARNING install raise MaxRetryError(_pool, url, error or ResponseError(cause))
2021-02-05 06:26:48 WARNING install urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='files.pythonhosted.org', port=443): Max retries exceeded with url: /packages/fb/48/69046506f6ac61c1eaa9a0d42d22d54673b69e176d30ca98e3f61513e980/pbr-5.5.1-py2.py3-none-any.whl (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f8ed48a5d00>: Failed to establish a new connection: [Errno 101] Network is unreachable'))
2021-02-05 06:26:48 WARNING install
2021-02-05 06:26:48 WARNING install During handling of the above exception, another exception occurred:
2021-02-05 06:26:48 WARNING install
2021-02-05 06:26:48 WARNING install Traceback (most recent call last):
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/pip/_internal/cli/base_command.py", line 186, in _main
2021-02-05 06:26:48 WARNING install status = self.run(options, args)
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/pip/_internal/commands/wheel.py", line 161, in run
2021-02-05 06:26:48 WARNING install resolver.resolve(requirement_set)
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/pip/_internal/legacy_resolve.py", line 177, in resolve
2021-02-05 06:26:48 WARNING install discovered_reqs.extend(self._resolve_one(requirement_set, req))
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/pip/_internal/legacy_resolve.py", line 333, in _resolve_one
2021-02-05 06:26:48 WARNING install abstract_dist = self._get_abstract_dist_for(req_to_install)
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/pip/_internal/legacy_resolve.py", line 282, in _get_abstract_dist_for
2021-02-05 06:26:48 WARNING install abstract_dist = self.preparer.prepare_linked_requirement(req)
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/pip/_internal/operations/prepare.py", line 480, in prepare_linked_requirement
2021-02-05 06:26:48 WARNING install local_path = unpack_url(
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/pip/_internal/operations/prepare.py", line 282, in unpack_url
2021-02-05 06:26:48 WARNING install return unpack_http_url(
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/pip/_internal/operations/prepare.py", line 158, in unpack_http_url
2021-02-05 06:26:48 WARNING install from_path, content_type = _download_http_url(
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/pip/_internal/operations/prepare.py", line 299, in _download_http_url
2021-02-05 06:26:48 WARNING install download = downloader(link)
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/pip/_internal/network/download.py", line 189, in __call__
2021-02-05 06:26:48 WARNING install resp = _http_get_download(self._session, link)
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/pip/_internal/network/download.py", line 135, in _http_get_download
2021-02-05 06:26:48 WARNING install resp = session.get(
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/requests/sessions.py", line 546, in get
2021-02-05 06:26:48 WARNING install return self.request('GET', url, **kwargs)
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/pip/_internal/network/session.py", line 405, in request
2021-02-05 06:26:48 WARNING install return super(PipSession, self).request(method, url, *args, **kwargs)
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/requests/sessions.py", line 533, in request
2021-02-05 06:26:48 WARNING install resp = self.send(prep, **send_kwargs)
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/requests/sessions.py", line 646, in send
2021-02-05 06:26:48 WARNING install r = adapter.send(request, **kwargs)
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/cachecontrol/adapter.py", line 53, in send
2021-02-05 06:26:48 WARNING install resp = super(CacheControlAdapter, self).send(request, **kw)
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/requests/adapters.py", line 516, in send
2021-02-05 06:26:48 WARNING install raise ConnectionError(e, request=request)
2021-02-05 06:26:48 WARNING install requests.exceptions.ConnectionError: HTTPSConnectionPool(host='files.pythonhosted.org', port=443): Max retries exceeded with url: /packages/fb/48/69046506f6ac61c1eaa9a0d42d22d54673b69e176d30ca98e3f61513e980/pbr-5.5.1-py2.py3-none-any.whl (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f8ed48a5d00>: Failed to establish a new connection: [Errno 101] Network is unreachable'))
2021-02-05 06:26:48 WARNING install Traceback (most recent call last):
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/setuptools/installer.py", line 128, in fetch_build_egg
2021-02-05 06:26:48 WARNING install subprocess.check_call(cmd)
2021-02-05 06:26:48 WARNING install File "/usr/lib/python3.8/subprocess.py", line 364, in check_call
2021-02-05 06:26:48 WARNING install raise CalledProcessError(retcode, cmd)
2021-02-05 06:26:48 WARNING install subprocess.CalledProcessError: Command '['/var/lib/juju/agents/unit-public-policy-routing-1/.venv/bin/python', '-m', 'pip', '--disable-pip-version-check', 'wheel', '--no-deps', '-w', '/tmp/tmpc3vebqa9', '--quiet', '--find-links', 'file:///var/lib/juju/agents/unit-public-policy-routing-1/charm/wheelhouse/', 'pbr>=2.0.0']' returned non-zero exit status 2.
2021-02-05 06:26:48 WARNING install
2021-02-05 06:26:48 WARNING install During handling of the above exception, another exception occurred:
2021-02-05 06:26:48 WARNING install
2021-02-05 06:26:48 WARNING install Traceback (most recent call last):
2021-02-05 06:26:48 WARNING install File "<string>", line 1, in <module>
2021-02-05 06:26:48 WARNING install File "/tmp/pip-install-vwtzklu8/charmhelpers/setup.py", line 25, in <module>
2021-02-05 06:26:48 WARNING install setuptools.setup(
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/setuptools/__init__.py", line 144, in setup
2021-02-05 06:26:48 WARNING install _install_setup_requires(attrs)
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/setuptools/__init__.py", line 139, in _install_setup_requires
2021-02-05 06:26:48 WARNING install dist.fetch_build_eggs(dist.setup_requires)
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/setuptools/dist.py", line 718, in fetch_build_eggs
2021-02-05 06:26:48 WARNING install resolved_dists = pkg_resources.working_set.resolve(
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/pkg_resources/__init__.py", line 780, in resolve
2021-02-05 06:26:48 WARNING install dist = best[req.key] = env.best_match(
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/pkg_resources/__init__.py", line 1065, in best_match
2021-02-05 06:26:48 WARNING install return self.obtain(req, installer)
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/pkg_resources/__init__.py", line 1077, in obtain
2021-02-05 06:26:48 WARNING install return installer(requirement)
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/setuptools/dist.py", line 777, in fetch_build_egg
2021-02-05 06:26:48 WARNING install return fetch_build_egg(self, req)
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/.venv/lib/python3.8/site-packages/setuptools/installer.py", line 130, in fetch_build_egg
2021-02-05 06:26:48 WARNING install raise DistutilsError(str(e))
2021-02-05 06:26:48 WARNING install distutils.errors.DistutilsError: Command '['/var/lib/juju/agents/unit-public-policy-routing-1/.venv/bin/python', '-m', 'pip', '--disable-pip-version-check', 'wheel', '--no-deps', '-w', '/tmp/tmpc3vebqa9', '--quiet', '--find-links', 'file:///var/lib/juju/agents/unit-public-policy-routing-1/charm/wheelhouse/', 'pbr>=2.0.0']' returned non-zero exit status 2.
2021-02-05 06:26:48 WARNING install ----------------------------------------
2021-02-05 06:26:48 WARNING install ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.
2021-02-05 06:26:48 WARNING install Traceback (most recent call last):
2021-02-05 06:26:48 WARNING install File "/var/lib/juju/agents/unit-public-policy-routing-1/charm/hooks/install", line 8, in <module>
2021-02-05 06:26:48 WARNING install basic.bootstrap_charm_deps()
2021-02-05 06:26:48 WARNING install File "lib/charms/layer/basic.py", line 203, in bootstrap_charm_deps
2021-02-05 06:26:48 WARNING install check_call([pip, 'install', '-U', reinstall_flag, '--no-index',
2021-02-05 06:26:48 WARNING install File "/usr/lib/python3.8/subprocess.py", line 364, in check_call
2021-02-05 06:26:48 WARNING install raise CalledProcessError(retcode, cmd)
2021-02-05 06:26:48 WARNING install subprocess.CalledProcessError: Command '['/var/lib/juju/agents/unit-public-policy-routing-1/.venv/bin/pip', 'install', '-U', '--force-reinstall', '--no-index', '--no-cache-dir', '-f', 'wheelhouse', 'pbr', 'netifaces', 'PyYAML', 'Tempita', 'Jinja2', 'charms.reactive', 'pyaml', 'charmhelpers', 'six', 'MarkupSafe', 'netaddr', 'wheel']' returned non-zero exit status 1.
2021-02-05 06:26:48 ERROR juju.worker.uniter.operation runhook.go:136 hook "install" (via explicit, bespoke hook script) failed: exit status 1
2021-02-05 06:26:48 INFO juju.worker.uniter resolver.go:143 awaiting error resolution for "install" hook

Tags: ps5
Xav Paice (xavpaice)
Changed in charm-advanced-routing:
importance: Undecided → High
Eric Chen (eric-chen)
Changed in charm-advanced-routing:
importance: High → Medium
Revision history for this message
Eric Chen (eric-chen) wrote :
Changed in charm-advanced-routing:
status: New → Fix Committed
status: Fix Committed → Won't Fix
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.