Tempest reports 'missing Worker 1!'

Bug #1733983 reported by Ronelle Landy on 2017-11-22
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
os-testr
Undecided
Unassigned
tripleo
Medium
Unassigned

Bug Description

Both fully passing and failing Tempest runs show the following at the of the logs:

2017-11-22 16:27:34 | ==============
2017-11-22 16:27:34 | Worker Balance
2017-11-22 16:27:34 | ==============
2017-11-22 16:27:34 | - Worker 0 (286 tests) => 0:38:55.123405
2017-11-22 16:27:34 | - WARNING: missing Worker 1! Race in testr accounting.
2017-11-22 16:27:34 | - Worker 2 (759 tests) => 0:45:58.265308
2017-11-22 16:27:34 | - Worker 3 (308 tests) => 0:27:03.71602

Worker 1 goes missing.

See a full log:
https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-pike/f33faa6/undercloud/home/jenkins/tempest_output.log.txt.gz

Ronelle Landy (rlandy) on 2017-11-22
Changed in tripleo:
milestone: none → queens-2
importance: Undecided → High
Alex Schultz (alex-schultz) wrote :

I've added os-testr for their visibility. I'm dropping this to a medium since it doesn't appear to fail anything.

Changed in tripleo:
status: New → Triaged
importance: High → Medium
milestone: queens-2 → queens-3
Matthew Treinish (treinish) wrote :

I haven't seen that warning message in a very long time. That is a feature in subunit-trace to warn about a bug we used to see quite frequently in testr: http://git.openstack.org/cgit/openstack/os-testr/tree/os_testr/subunit_trace.py#n303

What version of testr and os-testr are you running with. The most recent release of stestr should be immune from this because it doesn't actually use testr internally anymore (it switched to use stestr). But even if you were using os-testr < 1.0.0 if you're using a new enough version of testr that bug should have been fixed.

chandan kumar (chkumar246) wrote :

python-os-testr-0.8.2-0.20170811225902.e84d062.el7.centos.noarch and python-testrepository-0.0.18-2.el7.noarch version used https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-pike/f33faa6/rpm-qa.txt.gz grepped from here

Changed in tripleo:
milestone: queens-3 → queens-rc1
Changed in tripleo:
milestone: queens-rc1 → rocky-1
Changed in tripleo:
milestone: rocky-1 → rocky-2
Changed in tripleo:
milestone: rocky-2 → rocky-3
Changed in tripleo:
milestone: rocky-3 → rocky-rc1
Changed in tripleo:
milestone: rocky-rc1 → stein-1
Changed in tripleo:
milestone: stein-1 → stein-2
Changed in tripleo:
milestone: stein-2 → stein-3
Changed in tripleo:
status: Triaged → Invalid
To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers