install hook fails with psycopg2 ImportError

[Ryan Beisner]

Deploying a rebuild of the vault charm results in an install hook failure (psycopg2 ImportError):

https://openstack-ci-reports.ubuntu.com/artifacts/test_charm_pipeline_func_smoke/openstack/charm-vault/676805/2/11680/index.html

https://openstack-ci-reports.ubuntu.com/artifacts/test_charm_pipeline_func_smoke/openstack/charm-vault/676805/2/11680/test_charm_func_smoke_14168/juju-status-zaza-5fda22a6ed50.txt

https://openstack-ci-reports.ubuntu.com/artifacts/test_charm_pipeline_func_smoke/openstack/charm-vault/676805/2/11680/test_charm_func_smoke_14168/juju-crashdump-25468b5a-df4d-4596-b4bd-40634787fc9b.tar.xz

2019-08-19 18:50:08 DEBUG install Traceback (most recent call last):
2019-08-19 18:50:08 DEBUG install File "/var/lib/juju/agents/unit-vault-0/charm/hooks/install", line 22, in <module>
2019-08-19 18:50:08 DEBUG install main()
2019-08-19 18:50:08 DEBUG install File "/var/lib/juju/agents/unit-vault-0/.venv/lib/python3.5/site-packages/charms/reactive/__init__.py", line 70, in main
2019-08-19 18:50:08 DEBUG install bus.discover()
2019-08-19 18:50:08 DEBUG install File "/var/lib/juju/agents/unit-vault-0/.venv/lib/python3.5/site-packages/charms/reactive/bus.py", line 424, in discover
2019-08-19 18:50:08 DEBUG install _register_handlers_from_file(search_path, filepath)
2019-08-19 18:50:08 DEBUG install File "/var/lib/juju/agents/unit-vault-0/.venv/lib/python3.5/site-packages/charms/reactive/bus.py", line 454, in _register_handlers_from_file
2019-08-19 18:50:08 DEBUG install _load_module(root, filepath)
2019-08-19 18:50:08 DEBUG install File "/var/lib/juju/agents/unit-vault-0/.venv/lib/python3.5/site-packages/charms/reactive/bus.py", line 442, in _load_module
2019-08-19 18:50:08 DEBUG install return importlib.import_module(package + module)
2019-08-19 18:50:08 DEBUG install File "/var/lib/juju/agents/unit-vault-0/.venv/lib/python3.5/importlib/__init__.py", line 126, in import_module
2019-08-19 18:50:08 DEBUG install return _bootstrap._gcd_import(name[level:], package, level)
2019-08-19 18:50:08 DEBUG install File "<frozen importlib._bootstrap>", line 986, in _gcd_import
2019-08-19 18:50:08 DEBUG install File "<frozen importlib._bootstrap>", line 969, in _find_and_load
2019-08-19 18:50:08 DEBUG install File "<frozen importlib._bootstrap>", line 958, in _find_and_load_unlocked
2019-08-19 18:50:08 DEBUG install File "<frozen importlib._bootstrap>", line 673, in _load_unlocked
2019-08-19 18:50:08 DEBUG install File "<frozen importlib._bootstrap_external>", line 665, in exec_module
2019-08-19 18:50:08 DEBUG install File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
2019-08-19 18:50:08 DEBUG install File "/var/lib/juju/agents/unit-vault-0/charm/reactive/vault_handlers.py", line 2, in <module>
2019-08-19 18:50:08 DEBUG install import psycopg2
2019-08-19 18:50:08 DEBUG install ImportError: No module named 'psycopg2'
2019-08-19 18:50:08 ERROR juju.worker.uniter.operation runhook.go:132 hook "install" failed: exit status 1

[Ryan Beisner (1chb1n)]

The barbican-vault charm is also similarly affected:

https://openstack-ci-reports.ubuntu.com/artifacts/test_charm_pipeline_func_smoke/openstack/charm-barbican-vault/676809/2/11691/index.html

https://openstack-ci-reports.ubuntu.com/artifacts/test_charm_pipeline_func_smoke/openstack/charm-barbican-vault/676809/2/11691/test_charm_func_smoke_14177/juju-status-zaza-2db4f643169f.txt

https://openstack-ci-reports.ubuntu.com/artifacts/test_charm_pipeline_func_smoke/openstack/charm-barbican-vault/676809/2/11691/test_charm_func_smoke_14177/juju-crashdump-5c65973c-b60e-47ce-9ef7-da7c5c99e9e6.tar.xz

2019-08-19 20:11:36 DEBUG install Traceback (most recent call last):
2019-08-19 20:11:36 DEBUG install File "/var/lib/juju/agents/unit-barbican-vault-0/.venv/lib/python3.6/site-packages/pip/_vendor/pep517/_in_process.py", line 207, in <module>
2019-08-19 20:11:36 DEBUG install main()
2019-08-19 20:11:36 DEBUG install File "/var/lib/juju/agents/unit-barbican-vault-0/.venv/lib/python3.6/site-packages/pip/_vendor/pep517/_in_process.py", line 197, in main
2019-08-19 20:11:36 DEBUG install json_out['return_val'] = hook(**hook_input['kwargs'])
2019-08-19 20:11:36 DEBUG install File "/var/lib/juju/agents/unit-barbican-vault-0/.venv/lib/python3.6/site-packages/pip/_vendor/pep517/_in_process.py", line 69, in prepare_metadata_for_build_wheel
2019-08-19 20:11:36 DEBUG install return hook(metadata_directory, config_settings)
2019-08-19 20:11:36 DEBUG install File "/usr/lib/python3/dist-packages/setuptools/build_meta.py", line 140, in prepare_metadata_for_build_wheel
2019-08-19 20:11:36 DEBUG install self.run_setup()
2019-08-19 20:11:36 DEBUG install File "/usr/lib/python3/dist-packages/setuptools/build_meta.py", line 211, in run_setup
2019-08-19 20:11:36 DEBUG install self).run_setup(setup_script=setup_script)
2019-08-19 20:11:36 DEBUG install File "/usr/lib/python3/dist-packages/setuptools/build_meta.py", line 126, in run_setup
2019-08-19 20:11:36 DEBUG install exec(compile(code, __file__, 'exec'), locals())
2019-08-19 20:11:36 DEBUG install File "setup.py", line 82, in <module>
2019-08-19 20:11:36 DEBUG install python_requires='>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*',
2019-08-19 20:11:36 DEBUG install File "/usr/lib/python3/dist-packages/setuptools/__init__.py", line 145, in setup
2019-08-19 20:11:36 DEBUG install return distutils.core.setup(**attrs)
2019-08-19 20:11:36 DEBUG install File "/usr/lib/python3.6/distutils/core.py", line 148, in setup
2019-08-19 20:11:36 DEBUG install dist.run_commands()
2019-08-19 20:11:36 DEBUG install File "/usr/lib/python3.6/distutils/dist.py", line 955, in run_commands
2019-08-19 20:11:36 DEBUG install self.run_command(cmd)
2019-08-19 20:11:36 DEBUG install File "/usr/lib/python3.6/distutils/dist.py", line 974, in run_command
2019-08-19 20:11:36 DEBUG install cmd_obj.run()
2019-08-19 20:11:36 DEBUG install File "/usr/lib/python3/dist-packages/setuptools/command/dist_info.py", line 36, in run
2019-08-19 20:11:36 DEBUG install bdist_wheel.egg2dist(egg_info.egg_info, ...

[Ryan Beisner (1chb1n)]

https://review.opendev.org/#/q/topic:bug/1840706+(status:open+OR+status:merged)

[Frode Nordahl (fnordahl)]

From cursory view it appears these log outputs stem from charms without the required changes to operate in a non-system-package world. Are the changes based off of tip of master and do they include https://review.opendev.org/#/q/topic:dist-charm-deps+(status:open+OR+status:merged) ?

[Liam Young (gnuoy)]

Since the referenced reviews have landed it looks like the issue has been fixed. If that is not the case please reopen this bug.