Intermittent functional test failure: pidof -x "aodh-listener: EventAlarmEvaluationService worker(0)"

Bug #1842424 reported by Frode Nordahl on 2019-09-03

This bug report will be marked for expiration in 44 days if no further activity occurs. (find out why)

10
This bug affects 2 people
Affects Status Importance Assigned to Milestone
OpenStack AODH Charm
Undecided
Unassigned
OpenStack Charm Test Infra
Undecided
Unassigned

Bug Description

DEBUG:runner:2019-09-03 09:08:23,657 test_900_restart_on_config_change DEBUG: Making config change on aodh...
DEBUG:runner:2019-09-03 09:08:26,140 test_900_restart_on_config_change DEBUG: Checking that service restarted: aodh-listener: EventAlarmEvaluationService worker(0)
DEBUG:runner:2019-09-03 09:08:26,141 service_restarted_since DEBUG: Checking that aodh-listener: EventAlarmEvaluationService worker(0) service restarted since 1567501705.0 on aodh/0
DEBUG:runner:2019-09-03 09:09:08,512 _get_proc_start_time DEBUG: Pid for aodh-listener: EventAlarmEvaluationService worker(0) on aodh/0: 24415
DEBUG:runner:2019-09-03 09:09:10,228 service_restarted_since DEBUG: Attempt 0 to get aodh-listener: EventAlarmEvaluationService worker(0) proc start time on aodh/0 OK
DEBUG:runner:2019-09-03 09:09:10,229 service_restarted_since DEBUG: Proc start time is newer than provided mtime(1567501747.43 >= 1567501705.0) on aodh/0 (OK)
DEBUG:runner:2019-09-03 09:09:10,230 config_updated_since DEBUG: Checking that /etc/aodh/aodh.conf updated since 1567501705.0 on aodh/0
DEBUG:runner:2019-09-03 09:09:51,909 config_updated_since DEBUG: Attempt 0 to get /etc/aodh/aodh.conf file mtime on aodh/0 OK
DEBUG:runner:2019-09-03 09:09:51,911 config_updated_since DEBUG: File mtime is newer than provided mtime (1567501717.58 >= 1567501705.0) on aodh/0 (OK)
DEBUG:runner:2019-09-03 09:09:51,911 test_900_restart_on_config_change DEBUG: Checking that service restarted: aodh-notifier: AlarmNotifierService worker(0)
DEBUG:runner:2019-09-03 09:09:51,912 service_restarted_since DEBUG: Checking that aodh-notifier: AlarmNotifierService worker(0) service restarted since 1567501705.0 on aodh/0
DEBUG:runner:2019-09-03 09:09:56,186 _get_proc_start_time DEBUG: Pid for aodh-notifier: AlarmNotifierService worker(0) on aodh/0: 24419
DEBUG:runner:2019-09-03 09:09:57,837 service_restarted_since DEBUG: Attempt 0 to get aodh-notifier: AlarmNotifierService worker(0) proc start time on aodh/0 OK
DEBUG:runner:2019-09-03 09:09:57,839 service_restarted_since DEBUG: Proc start time is newer than provided mtime(1567501747.43 >= 1567501705.0) on aodh/0 (OK)
DEBUG:runner:2019-09-03 09:09:57,840 config_updated_since DEBUG: Checking that /etc/aodh/aodh.conf updated since 1567501705.0 on aodh/0
DEBUG:runner:2019-09-03 09:09:59,565 config_updated_since DEBUG: Attempt 0 to get /etc/aodh/aodh.conf file mtime on aodh/0 OK
DEBUG:runner:2019-09-03 09:09:59,565 config_updated_since DEBUG: File mtime is newer than provided mtime (1567501717.58 >= 1567501705.0) on aodh/0 (OK)
DEBUG:runner:2019-09-03 09:09:59,565 test_900_restart_on_config_change DEBUG: Checking that service restarted: aodh-evaluator: AlarmEvaluationService worker(0)
DEBUG:runner:2019-09-03 09:09:59,565 service_restarted_since DEBUG: Checking that aodh-evaluator: AlarmEvaluationService worker(0) service restarted since 1567501705.0 on aodh/0
DEBUG:runner:2019-09-03 09:10:01,818 _get_proc_start_time DEBUG: Pid for aodh-evaluator: AlarmEvaluationService worker(0) on aodh/0: 24414
DEBUG:runner:2019-09-03 09:10:03,289 service_restarted_since DEBUG: Attempt 0 to get aodh-evaluator: AlarmEvaluationService worker(0) proc start time on aodh/0 OK
DEBUG:runner:2019-09-03 09:10:03,289 service_restarted_since DEBUG: Proc start time is newer than provided mtime(1567501747.43 >= 1567501705.0) on aodh/0 (OK)
DEBUG:runner:2019-09-03 09:10:03,289 config_updated_since DEBUG: Checking that /etc/aodh/aodh.conf updated since 1567501705.0 on aodh/0
DEBUG:runner:2019-09-03 09:10:04,962 config_updated_since DEBUG: Attempt 0 to get /etc/aodh/aodh.conf file mtime on aodh/0 OK
DEBUG:runner:2019-09-03 09:10:04,962 config_updated_since DEBUG: File mtime is newer than provided mtime (1567501717.58 >= 1567501705.0) on aodh/0 (OK)
DEBUG:runner:2019-09-03 09:10:04,963 test_900_restart_on_config_change DEBUG: Checking that service restarted: apache2
DEBUG:runner:2019-09-03 09:10:04,963 service_restarted_since DEBUG: Checking that apache2 service restarted since 1567501705.0 on aodh/0
DEBUG:runner:2019-09-03 09:10:06,212 _get_proc_start_time DEBUG: Pid for apache2 on aodh/0: 24228
DEBUG:runner:2019-09-03 09:10:07,981 service_restarted_since DEBUG: Attempt 0 to get apache2 proc start time on aodh/0 OK
DEBUG:runner:2019-09-03 09:10:07,981 service_restarted_since DEBUG: Proc start time is newer than provided mtime(1567501747.43 >= 1567501705.0) on aodh/0 (OK)
DEBUG:runner:2019-09-03 09:10:07,981 config_updated_since DEBUG: Checking that /etc/aodh/aodh.conf updated since 1567501705.0 on aodh/0
DEBUG:runner:2019-09-03 09:10:09,905 config_updated_since DEBUG: Attempt 0 to get /etc/aodh/aodh.conf file mtime on aodh/0 OK
DEBUG:runner:2019-09-03 09:10:09,905 config_updated_since DEBUG: File mtime is newer than provided mtime (1567501717.58 >= 1567501705.0) on aodh/0 (OK)
DEBUG:runner:2019-09-03 09:10:10,156 test_900_restart_on_config_change DEBUG: OK
DEBUG:runner:aodh/0 `pidof -x "aodh-notifier: AlarmNotifierService worker(0)"` returned 1
DEBUG:runner:Exit Code: 1

https://openstack-ci-reports.ubuntu.com/artifacts/test_charm_pipeline_func_smoke/openstack/charm-aodh/679716/1/12061/index.html

Alex Kavanagh (ajkavanagh) wrote :

Setting to incomplete to allow this bug to time out if the problem is no longer an issue. However, if it presents itself again then please reset to new.

Changed in charm-test-infra:
status: New → Incomplete
Changed in charm-aodh:
status: New → Incomplete
Liam Young (gnuoy) wrote :

The testing framework used has moved to zaza too which does not share code with the old amulet framwork for service checking

To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers