contrail status/alarm checks need to be wrapped around retry and time limit avoid timing error

Bug #1735880 reported by wenqing liang
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
R4.0
Fix Committed
High
Senthilnathan Murugappan
R4.1
Fix Committed
High
Senthilnathan Murugappan
Trunk
Fix Committed
High
Senthilnathan Murugappan

Bug Description

Tests such as test_analytics_node_process_status_alarms gave false alarms, e.g. status-check immediately after service restart when some services take a few seconds to become active.

2017-12-01 20:50:57,991 - INFO - start contrail-collector.service on server4
2017-12-01 20:51:08,317 - INFO - Executing 'contrail-status' on host 10.87.118.194

2017-12-01 20:51:33,089 - INFO - Failed services are :
 Host: 10.87.118.193 Container: analytics Role: analytics Service: contrail-collector: State: initializing

2017-12-01 20:51:33,089 - ERROR - All the contrail services are not up

tags: added: sanityblocker
Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/38088
Submitter: Senthilnathan Murugappan (<email address hidden>)

wenqing liang (wliang)
summary: - contrail status/alarm check needs to be wrapped around retry and time
+ contrail status/alarm checks need to be wrapped around retry and time
limit avoid timing error
Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/38088
Committed: http://github.com/Juniper/contrail-test-ci/commit/6d8c38eb32368bae6eac1ee197ae3cb8613a7489
Submitter: Zuul (<email address hidden>)
Branch: master

commit 6d8c38eb32368bae6eac1ee197ae3cb8613a7489
Author: Senthilnathan Murugappan <email address hidden>
Date: Fri Dec 1 22:26:43 2017 -0800

Add retries while checking for contrail-status

Change-Id: Ibf9e6ff3155bc0d9c12c0915ae24d1ed72d00776
Closes-Bug: 1735880

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R4.1

Review in progress for https://review.opencontrail.org/38151
Submitter: Senthilnathan Murugappan (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R4.0

Review in progress for https://review.opencontrail.org/38152
Submitter: Senthilnathan Murugappan (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/38152
Committed: http://github.com/Juniper/contrail-test-ci/commit/d88b176f494e69bdc7294e2a71ffcf2633074dd2
Submitter: Zuul (<email address hidden>)
Branch: R4.0

commit d88b176f494e69bdc7294e2a71ffcf2633074dd2
Author: Senthilnathan Murugappan <email address hidden>
Date: Fri Dec 1 22:26:43 2017 -0800

Add retries while checking for contrail-status

Change-Id: Ibf9e6ff3155bc0d9c12c0915ae24d1ed72d00776
Closes-Bug: 1735880
(cherry picked from commit 6d8c38eb32368bae6eac1ee197ae3cb8613a7489)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/38151
Committed: http://github.com/Juniper/contrail-test-ci/commit/cfe7831f83f64a1756ad470f38dd65a987e8bfdd
Submitter: Zuul (<email address hidden>)
Branch: R4.1

commit cfe7831f83f64a1756ad470f38dd65a987e8bfdd
Author: Senthilnathan Murugappan <email address hidden>
Date: Fri Dec 1 22:26:43 2017 -0800

Add retries while checking for contrail-status

Change-Id: Ibf9e6ff3155bc0d9c12c0915ae24d1ed72d00776
Closes-Bug: 1735880
(cherry picked from commit 6d8c38eb32368bae6eac1ee197ae3cb8613a7489)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/40095
Submitter: Ankit Jain (<email address hidden>)

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.