Gnocchi charm does not install in s390x

[Sean Feole]

On arch=s390x in Xenial, gnocchi fails to install, it appears to be a depends issue, with gnocchi-common, which of course breaks the openstack-base-telemetry-queens bundle.

glance/0* active idle 2/lxd/1 10.13.3.221 9292/tcp Unit is ready
gnocchi/0* maintenance executing 1/lxd/1 10.13.3.235 (install) Installing packages
keystone/0* active idle 3/lxd/0 10.13.3.217 5000/tcp Unit is ready

2018-03-13 15:26:20 DEBUG install Traceback (most recent call last):
2018-03-13 15:26:20 DEBUG install File "/var/lib/juju/agents/unit-gnocchi-0/charm/hooks/install", line 19, in <module>
2018-03-13 15:26:20 DEBUG install main()
2018-03-13 15:26:20 DEBUG install File "/var/lib/juju/agents/unit-gnocchi-0/.venv/lib/python3.5/site-packages/charms/reactive/__init__.py", line 72, in main
2018-03-13 15:26:20 DEBUG install bus.dispatch(restricted=restricted_mode)
2018-03-13 15:26:20 DEBUG install File "/var/lib/juju/agents/unit-gnocchi-0/.venv/lib/python3.5/site-packages/charms/reactive/bus.py", line 375, in dispatch
2018-03-13 15:26:20 DEBUG install _invoke(other_handlers)
2018-03-13 15:26:20 DEBUG install File "/var/lib/juju/agents/unit-gnocchi-0/.venv/lib/python3.5/site-packages/charms/reactive/bus.py", line 351, in _invoke
2018-03-13 15:26:20 DEBUG install handler.invoke()
2018-03-13 15:26:20 DEBUG install File "/var/lib/juju/agents/unit-gnocchi-0/.venv/lib/python3.5/site-packages/charms/reactive/bus.py", line 173, in invoke
2018-03-13 15:26:20 DEBUG install self._action(*args)
2018-03-13 15:26:20 DEBUG install File "/var/lib/juju/agents/unit-gnocchi-0/charm/reactive/layer_openstack.py", line 21, in default_install
2018-03-13 15:26:20 DEBUG install instance.install()
2018-03-13 15:26:20 DEBUG install File "lib/charm/openstack/gnocchi.py", line 237, in install
2018-03-13 15:26:20 DEBUG install super(GnocchiCharm, self).install()
2018-03-13 15:26:20 DEBUG install File "/var/lib/juju/agents/unit-gnocchi-0/.venv/lib/python3.5/site-packages/charms_openstack/charm/classes.py", line 205, in install
2018-03-13 15:26:20 DEBUG install super().install()
2018-03-13 15:26:20 DEBUG install File "/var/lib/juju/agents/unit-gnocchi-0/.venv/lib/python3.5/site-packages/charms_openstack/charm/core.py", line 605, in install
2018-03-13 15:26:20 DEBUG install fetch.apt_install(packages, fatal=True)
2018-03-13 15:26:20 DEBUG install File "/var/lib/juju/agents/unit-gnocchi-0/.venv/lib/python3.5/site-packages/charmhelpers/fetch/ubuntu.py", line 207, in apt_install
2018-03-13 15:26:20 DEBUG install _run_apt_command(cmd, fatal)
2018-03-13 15:26:20 DEBUG install File "/var/lib/juju/agents/unit-gnocchi-0/.venv/lib/python3.5/site-packages/charmhelpers/fetch/ubuntu.py", line 559, in _run_apt_command
2018-03-13 15:26:20 DEBUG install retry_message="Couldn't acquire DPKG lock")
2018-03-13 15:26:20 DEBUG install File "/var/lib/juju/agents/unit-gnocchi-0/.venv/lib/python3.5/site-packages/charmhelpers/fetch/ubuntu.py", line 535, in _run_with_retries
2018-03-13 15:26:20 DEBUG install result = subprocess.check_call(cmd, **kwargs)
2018-03-13 15:26:20 DEBUG install File "/usr/lib/python3.5/subprocess.py", line 581, in check_call
2018-03-13 15:26:20 DEBUG install raise CalledProcessError(retcode, cmd)
2018-03-13 15:26:20 DEBUG install subprocess.CalledProcessError: Command '['apt-get', '--assume-yes', '--option=Dpkg::Options::=--force-confold', 'install', 'gnocchi-api', 'gnocchi-metricd', 'python-apt', 'ceph-common', 'python-rados', 'python-keystonemiddleware', 'apache2', 'libapache2-mod-wsgi', 'memcached', 'python-memcache', 'haproxy']' returned non-zero exit status 100

[Dimitri John Ledkov (xnox)]

gnocchi, eventually, depends on pandas, which FTBFS on s390x in xenial, but is provided in artful and up.

To resolve this, one needs a backport of pandas for s390x somewhere. Or we need to cherry-pick SRU s390x fixes for pandas.

Pandas in xenial is 0.17.1-3ubuntu2 and in artful it is 0.19.2-5.1ubuntu4

[Dimitri John Ledkov (xnox)]

statsmodels is also not available for s390x on xenial.

[Dimitri John Ledkov (xnox)]

Statsmodels should be easy enough to fix, by including patches up to https://launchpad.net/ubuntu/+source/statsmodels/0.6.1-8 which basically resolve compatibility with old pandas / fix tests for s390x.

And with that in, maybe pandas will manage to build on s390x.

[Ryan Beisner (1chb1n)]

Let's re-validate with the Queens cloud archive enabled. Thank you.

[Sean Feole (sfeole)]

After re-validating with the Queens clod archive enabled, gnocchi-common successfully installed on s390x.

gnocchi-common:
  Installed: 4.2.0-0ubuntu2~cloud0
  Candidate: 4.2.0-0ubuntu2~cloud0
  Version table:
 *** 4.2.0-0ubuntu2~cloud0 500
        500 http://ubuntu-cloud.archive.canonical.com/ubuntu xenial-proposed/queens/main s390x Packages
        100 /var/lib/dpkg/status
     2.0.2-4 500
        500 http://ports.ubuntu.com/ubuntu-ports xenial/universe s390x Packages

updating the telemetry bundle to reflect the correct configuration

[Rebecca Palmer (rebecca-palmer)]

pandas and statsmodels are now available on s390x. (Also, the gnocchi packages no longer depend on them.)

('Fix released' means 'fixed in current development'. If you are requesting a fix in Xenial, https://wiki.ubuntu.com/UbuntuBackports but be aware the pandas API changes often enough that a pandas backport may break other software.)