test_stamp_pattern failing cells v1 job

Bug #1664607 reported by Matt Riedemann on 2017-02-14
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
Critical
Matt Riedemann
Mitaka
Critical
Matt Riedemann
Newton
Critical
Matt Riedemann
Ocata
Critical
Matt Riedemann

Bug Description

https://review.openstack.org/#/c/431800/ merged yesterday which unskips test_stamp_pattern which uses cells v1. The test uses security groups which cells v1 doesn't support, so it breaks the cells v1 job and blocks nova's gate.

http://logs.openstack.org/57/433257/2/check/gate-tempest-dsvm-cells-ubuntu-xenial/1732de2/logs/screen-n-cell-child.txt.gz#_2017-02-13_22_55_18_192

2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler [req-d4aaa51d-7595-4881-9fa4-2e52425fec26 tempest-TestStampPattern-1688631461 tempest-TestStampPattern-1688631461] Couldn't communicate with cell 'child'
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler Traceback (most recent call last):
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/opt/stack/new/nova/nova/cells/scheduler.py", line 178, in _build_instances
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler image, security_groups, block_device_mapping)
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/opt/stack/new/nova/nova/cells/scheduler.py", line 109, in _create_instances_here
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler num_instances, i)
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/opt/stack/new/nova/nova/compute/api.py", line 1539, in create_db_entry_for_new_instance
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler instance.create()
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/usr/local/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler return fn(self, *args, **kwargs)
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/opt/stack/new/nova/nova/objects/instance.py", line 550, in create
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler db_inst = db.instance_create(self._context, updates)
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/opt/stack/new/nova/nova/db/api.py", line 715, in instance_create
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler return IMPL.instance_create(context, values)
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/opt/stack/new/nova/nova/db/sqlalchemy/api.py", line 180, in wrapper
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler return f(*args, **kwargs)
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 151, in wrapper
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler ectxt.value = e.inner_exc
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler self.force_reraise()
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler six.reraise(self.type_, self.value, self.tb)
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 139, in wrapper
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler return f(*args, **kwargs)
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/opt/stack/new/nova/nova/db/sqlalchemy/api.py", line 251, in wrapped
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler return f(context, *args, **kwargs)
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/opt/stack/new/nova/nova/db/sqlalchemy/api.py", line 1815, in instance_create
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler instance_ref.security_groups = _get_sec_group_models(security_groups)
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/opt/stack/new/nova/nova/db/sqlalchemy/api.py", line 1810, in _get_sec_group_models
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler context, security_groups))
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/opt/stack/new/nova/nova/db/sqlalchemy/api.py", line 4364, in _security_group_get_by_names
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler project_id=context.project_id, security_group_id=group_name)
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler SecurityGroupNotFoundForProject: Security group tempest-TestStampPattern-662835790 not found for project eda710d52d7140dc9bc1081995cb1315.
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler [req-d4aaa51d-7595-4881-9fa4-2e52425fec26 tempest-TestStampPattern-1688631461 tempest-TestStampPattern-1688631461] Couldn't communicate with any cells
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler [req-d4aaa51d-7595-4881-9fa4-2e52425fec26 tempest-TestStampPattern-1688631461 tempest-TestStampPattern-1688631461] Error scheduling instances ['8cd170c4-17bc-48e1-ab38-6195803ea270']
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler Traceback (most recent call last):
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/opt/stack/new/nova/nova/cells/scheduler.py", line 226, in _schedule_build_to_cells
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler method_kwargs)
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/opt/stack/new/nova/nova/cells/scheduler.py", line 195, in _build_instances
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler raise exception.NoCellsAvailable()
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler NoCellsAvailable: No cells available matching scheduling criteria.
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler

Fix proposed to branch: master
Review: https://review.openstack.org/433707

Changed in nova:
assignee: nobody → Matt Riedemann (mriedem)
status: Triaged → In Progress

Reviewed: https://review.openstack.org/433815
Committed: https://git.openstack.org/cgit/openstack/nova/commit/?id=18fb0a17298dce2b361cc47f16d0d1500484f0d1
Submitter: Jenkins
Branch: stable/ocata

commit 18fb0a17298dce2b361cc47f16d0d1500484f0d1
Author: Matt Riedemann <email address hidden>
Date: Tue Feb 14 10:25:24 2017 -0500

    Skip test_stamp_pattern in cells v1 job

    test_stamp_pattern was recently unskipped:

    I2c13099595d8ee8099e02e3f06096078c7d27c34

    It uses security groups which cells v1 does
    not support, so we have to skip this test in
    the cells v1 job.

    Change-Id: Id7e8351026ca86694fc9814002b96260f6ba10f9
    Closes-Bug: #1664607
    (cherry picked from commit d12535839817c4385986ccaffe52b5903d3088ca)

Reviewed: https://review.openstack.org/433816
Committed: https://git.openstack.org/cgit/openstack/nova/commit/?id=db075faf2a767cf3f62768e85a79c3cff200d3cb
Submitter: Jenkins
Branch: stable/newton

commit db075faf2a767cf3f62768e85a79c3cff200d3cb
Author: Matt Riedemann <email address hidden>
Date: Tue Feb 14 10:25:24 2017 -0500

    Skip test_stamp_pattern in cells v1 job

    test_stamp_pattern was recently unskipped:

    I2c13099595d8ee8099e02e3f06096078c7d27c34

    It uses security groups which cells v1 does
    not support, so we have to skip this test in
    the cells v1 job.

    Change-Id: Id7e8351026ca86694fc9814002b96260f6ba10f9
    Closes-Bug: #1664607
    (cherry picked from commit d12535839817c4385986ccaffe52b5903d3088ca)
    (cherry picked from commit 18fb0a17298dce2b361cc47f16d0d1500484f0d1)

Reviewed: https://review.openstack.org/433707
Committed: https://git.openstack.org/cgit/openstack/nova/commit/?id=d12535839817c4385986ccaffe52b5903d3088ca
Submitter: Jenkins
Branch: master

commit d12535839817c4385986ccaffe52b5903d3088ca
Author: Matt Riedemann <email address hidden>
Date: Tue Feb 14 10:25:24 2017 -0500

    Skip test_stamp_pattern in cells v1 job

    test_stamp_pattern was recently unskipped:

    I2c13099595d8ee8099e02e3f06096078c7d27c34

    It uses security groups which cells v1 does
    not support, so we have to skip this test in
    the cells v1 job.

    Change-Id: Id7e8351026ca86694fc9814002b96260f6ba10f9
    Closes-Bug: #1664607

Changed in nova:
status: In Progress → Fix Released

This issue was fixed in the openstack/nova 15.0.0.0rc2 release candidate.

Reviewed: https://review.openstack.org/433825
Committed: https://git.openstack.org/cgit/openstack/nova/commit/?id=fb1b9f224d6f05674667a7ddf7c8ba77f4f257aa
Submitter: Jenkins
Branch: stable/mitaka

commit fb1b9f224d6f05674667a7ddf7c8ba77f4f257aa
Author: Matt Riedemann <email address hidden>
Date: Tue Feb 14 10:25:24 2017 -0500

    Skip test_stamp_pattern in cells v1 job

    test_stamp_pattern was recently unskipped:

    I2c13099595d8ee8099e02e3f06096078c7d27c34

    It uses security groups which cells v1 does
    not support, so we have to skip this test in
    the cells v1 job.

    Conflicts:
            devstack/tempest-dsvm-cells-rc

    NOTE(mriedem): The conflict is due to not having
    b113cb13e95b4d9305f093342ad4d34378aee8bb in mitaka.

    Change-Id: Id7e8351026ca86694fc9814002b96260f6ba10f9
    Closes-Bug: #1664607
    (cherry picked from commit d12535839817c4385986ccaffe52b5903d3088ca)
    (cherry picked from commit 18fb0a17298dce2b361cc47f16d0d1500484f0d1)
    (cherry picked from commit db075faf2a767cf3f62768e85a79c3cff200d3cb)

This issue was fixed in the openstack/nova 14.0.4 release.

This issue was fixed in the openstack/nova 13.1.3 release.

This issue was fixed in the openstack/nova 16.0.0.0b1 development milestone.

To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers