[trusty-mitaka] next_designate_ha mojo: apache2 not running after deployment

[Aurelien Lourot]

This happened twice on the CI system:

http://10.245.162.58:8080/view/MojoMatrix/job/mojo_runner/22432/
http://10.245.162.58:8080/view/MojoMatrix/job/mojo_runner/22520/

juju status:
18:22:34 keystone/2 blocked idle 29 172.17.113.20 5000/tcp Services not running that should be: apache2; Ports which should be open, but are not: 4990, 35347

/var/log/juju/unit-keystone-2.log:
2020-05-18 18:19:44 DEBUG update-status * apache2 is not running

/var/log/apache2/error.log:
[Mon May 18 17:26:35.437388 2020] [mpm_event:notice] [pid 25810:tid 140328736749440] AH00491: caught SIGTERM, shutting down

I couldn't find any useful hint in the logs so far.

[Alex Kavanagh (ajkavanagh)]

A new version of it from the logs:

2020-08-17 04:06:50 INFO juju-log Unit is ready
2020-08-17 04:06:51 INFO juju-log cluster:15: Registered config file: /etc/keystone/keystone.conf
2020-08-17 04:06:51 INFO juju-log cluster:15: Registered config file: /etc/keystone/logging.conf
2020-08-17 04:06:51 INFO juju-log cluster:15: Registered config file: /etc/haproxy/haproxy.cfg
2020-08-17 04:06:51 INFO juju-log cluster:15: Registered config file: /etc/apache2/sites-available/openstack_https_frontend.conf
2020-08-17 04:06:51 INFO juju-log cluster:15: Registered config file: /etc/keystone/policy.json
2020-08-17 04:06:51 INFO juju-log cluster:15: Registered config file: /etc/cron.d/keystone-token-flush
2020-08-17 04:06:51 INFO juju-log cluster:15: Registered config file: /etc/cron.d/keystone-fernet-rotate-sync
2020-08-17 04:06:51 INFO juju-log cluster:15: Registered config file: /etc/apache2/ports.conf
2020-08-17 04:06:52 INFO juju-log cluster:15: Registered config file: /etc/apache2/sites-enabled/wsgi-openstack-api.conf
2020-08-17 04:06:52 INFO juju-log cluster:15: Registered config file: /etc/memcached.conf
2020-08-17 04:06:58 DEBUG juju-log cluster:15: Peer echo whitelist: ['_passwd', 'identity-service:']
2020-08-17 04:06:59 DEBUG juju-log cluster:15: Checking for maintenance notifications
2020-08-17 04:06:59 DEBUG juju-log cluster:15: This unit (keystone/1) is in allowed unit list from mysql/0
2020-08-17 04:06:59 DEBUG juju-log cluster:15: Database initialised: True
2020-08-17 04:07:00 DEBUG juju-log cluster:15: Checking scale of shared-db,ha relations
2020-08-17 04:07:00 DEBUG juju-log cluster:15: All checks have passed, unit is at expected scale
2020-08-17 04:07:00 DEBUG juju-log cluster:15: Unit is ready
2020-08-17 04:07:00 DEBUG juju-log cluster:15: cluster peers are in the following states: dict_values(['READY', 'READY'])
2020-08-17 04:07:00 DEBUG juju-log cluster:15: Application Ready
2020-08-17 04:07:00 INFO juju-log cluster:15: Firing identity_changed hook for all related services.
2020-08-17 04:07:01 INFO juju-log cluster:15: Deferring identity_changed() to service leader.
2020-08-17 04:07:01 INFO juju-log cluster:15: Deferring identity_changed() to service leader.
2020-08-17 04:07:01 INFO juju-log cluster:15: Deferring identity_changed() to service leader.
2020-08-17 04:07:01 INFO juju-log cluster:15: Deferring identity_changed() to service leader.
2020-08-17 04:07:01 INFO juju-log cluster:15: Deferring identity_changed() to service leader.
2020-08-17 04:07:01 INFO juju-log cluster:15: Deferring identity_changed() to service leader.
2020-08-17 04:07:02 INFO juju-log cluster:15: Deferring identity_changed() to service leader.
2020-08-17 04:07:02 INFO juju-log cluster:15: Deferring identity_changed() to service leader.
2020-08-17 04:07:02 INFO juju-log cluster:15: Deferring identity_changed() to service leader.
2020-08-17 04:07:02 INFO juju-log cluster:15: Deferring identity_changed() to service leader.
2020-08-17 04:07:02 INFO juju-log cluster:15: Deferring identity_changed() to service leader.
2020-08-17 04:07:02 INFO juju-log cluster:15: Deferring identity_changed() to service leader.
2020-08-17 04:07:03 INFO juju-log cluster:15: Deferri...

[Alex Kavanagh (ajkavanagh)]

Logs from run to try to determine what went wrong.

[Alex Kavanagh (ajkavanagh)]

Setting to invalid; I think this may be overtaken by events. This bug hasn't been updated in 3 years. However, if it is still an issue then please re-open the bug with additional supporting information.