test_stamp_pattern failing cells v1 job

Bug #1664607 reported by Matt Riedemann
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
Fix Released
Critical
Matt Riedemann
Mitaka
Fix Released
Critical
Matt Riedemann
Newton
Fix Committed
Critical
Matt Riedemann
Ocata
Fix Committed
Critical
Matt Riedemann

Bug Description

https://review.openstack.org/#/c/431800/ merged yesterday which unskips test_stamp_pattern which uses cells v1. The test uses security groups which cells v1 doesn't support, so it breaks the cells v1 job and blocks nova's gate.

http://logs.openstack.org/57/433257/2/check/gate-tempest-dsvm-cells-ubuntu-xenial/1732de2/logs/screen-n-cell-child.txt.gz#_2017-02-13_22_55_18_192

2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler [req-d4aaa51d-7595-4881-9fa4-2e52425fec26 tempest-TestStampPattern-1688631461 tempest-TestStampPattern-1688631461] Couldn't communicate with cell 'child'
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler Traceback (most recent call last):
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/opt/stack/new/nova/nova/cells/scheduler.py", line 178, in _build_instances
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler image, security_groups, block_device_mapping)
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/opt/stack/new/nova/nova/cells/scheduler.py", line 109, in _create_instances_here
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler num_instances, i)
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/opt/stack/new/nova/nova/compute/api.py", line 1539, in create_db_entry_for_new_instance
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler instance.create()
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/usr/local/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler return fn(self, *args, **kwargs)
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/opt/stack/new/nova/nova/objects/instance.py", line 550, in create
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler db_inst = db.instance_create(self._context, updates)
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/opt/stack/new/nova/nova/db/api.py", line 715, in instance_create
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler return IMPL.instance_create(context, values)
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/opt/stack/new/nova/nova/db/sqlalchemy/api.py", line 180, in wrapper
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler return f(*args, **kwargs)
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 151, in wrapper
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler ectxt.value = e.inner_exc
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler self.force_reraise()
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler six.reraise(self.type_, self.value, self.tb)
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 139, in wrapper
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler return f(*args, **kwargs)
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/opt/stack/new/nova/nova/db/sqlalchemy/api.py", line 251, in wrapped
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler return f(context, *args, **kwargs)
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/opt/stack/new/nova/nova/db/sqlalchemy/api.py", line 1815, in instance_create
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler instance_ref.security_groups = _get_sec_group_models(security_groups)
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/opt/stack/new/nova/nova/db/sqlalchemy/api.py", line 1810, in _get_sec_group_models
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler context, security_groups))
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/opt/stack/new/nova/nova/db/sqlalchemy/api.py", line 4364, in _security_group_get_by_names
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler project_id=context.project_id, security_group_id=group_name)
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler SecurityGroupNotFoundForProject: Security group tempest-TestStampPattern-662835790 not found for project eda710d52d7140dc9bc1081995cb1315.
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler [req-d4aaa51d-7595-4881-9fa4-2e52425fec26 tempest-TestStampPattern-1688631461 tempest-TestStampPattern-1688631461] Couldn't communicate with any cells
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler [req-d4aaa51d-7595-4881-9fa4-2e52425fec26 tempest-TestStampPattern-1688631461 tempest-TestStampPattern-1688631461] Error scheduling instances ['8cd170c4-17bc-48e1-ab38-6195803ea270']
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler Traceback (most recent call last):
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/opt/stack/new/nova/nova/cells/scheduler.py", line 226, in _schedule_build_to_cells
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler method_kwargs)
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler File "/opt/stack/new/nova/nova/cells/scheduler.py", line 195, in _build_instances
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler raise exception.NoCellsAvailable()
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler NoCellsAvailable: No cells available matching scheduling criteria.
2017-02-13 22:55:18.192 25510 ERROR nova.cells.scheduler

Tags: cellsv1
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to nova (master)

Fix proposed to branch: master
Review: https://review.openstack.org/433707

Changed in nova:
assignee: nobody → Matt Riedemann (mriedem)
status: Triaged → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to nova (stable/ocata)

Fix proposed to branch: stable/ocata
Review: https://review.openstack.org/433815

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to nova (stable/newton)

Fix proposed to branch: stable/newton
Review: https://review.openstack.org/433816

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to nova (stable/mitaka)

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/433825

Revision history for this message
Matt Riedemann (mriedem) wrote :
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to nova (stable/ocata)

Reviewed: https://review.openstack.org/433815
Committed: https://git.openstack.org/cgit/openstack/nova/commit/?id=18fb0a17298dce2b361cc47f16d0d1500484f0d1
Submitter: Jenkins
Branch: stable/ocata

commit 18fb0a17298dce2b361cc47f16d0d1500484f0d1
Author: Matt Riedemann <email address hidden>
Date: Tue Feb 14 10:25:24 2017 -0500

    Skip test_stamp_pattern in cells v1 job

    test_stamp_pattern was recently unskipped:

    I2c13099595d8ee8099e02e3f06096078c7d27c34

    It uses security groups which cells v1 does
    not support, so we have to skip this test in
    the cells v1 job.

    Change-Id: Id7e8351026ca86694fc9814002b96260f6ba10f9
    Closes-Bug: #1664607
    (cherry picked from commit d12535839817c4385986ccaffe52b5903d3088ca)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to nova (stable/newton)

Reviewed: https://review.openstack.org/433816
Committed: https://git.openstack.org/cgit/openstack/nova/commit/?id=db075faf2a767cf3f62768e85a79c3cff200d3cb
Submitter: Jenkins
Branch: stable/newton

commit db075faf2a767cf3f62768e85a79c3cff200d3cb
Author: Matt Riedemann <email address hidden>
Date: Tue Feb 14 10:25:24 2017 -0500

    Skip test_stamp_pattern in cells v1 job

    test_stamp_pattern was recently unskipped:

    I2c13099595d8ee8099e02e3f06096078c7d27c34

    It uses security groups which cells v1 does
    not support, so we have to skip this test in
    the cells v1 job.

    Change-Id: Id7e8351026ca86694fc9814002b96260f6ba10f9
    Closes-Bug: #1664607
    (cherry picked from commit d12535839817c4385986ccaffe52b5903d3088ca)
    (cherry picked from commit 18fb0a17298dce2b361cc47f16d0d1500484f0d1)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to nova (master)

Reviewed: https://review.openstack.org/433707
Committed: https://git.openstack.org/cgit/openstack/nova/commit/?id=d12535839817c4385986ccaffe52b5903d3088ca
Submitter: Jenkins
Branch: master

commit d12535839817c4385986ccaffe52b5903d3088ca
Author: Matt Riedemann <email address hidden>
Date: Tue Feb 14 10:25:24 2017 -0500

    Skip test_stamp_pattern in cells v1 job

    test_stamp_pattern was recently unskipped:

    I2c13099595d8ee8099e02e3f06096078c7d27c34

    It uses security groups which cells v1 does
    not support, so we have to skip this test in
    the cells v1 job.

    Change-Id: Id7e8351026ca86694fc9814002b96260f6ba10f9
    Closes-Bug: #1664607

Changed in nova:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/nova 15.0.0.0rc2

This issue was fixed in the openstack/nova 15.0.0.0rc2 release candidate.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to nova (stable/mitaka)

Reviewed: https://review.openstack.org/433825
Committed: https://git.openstack.org/cgit/openstack/nova/commit/?id=fb1b9f224d6f05674667a7ddf7c8ba77f4f257aa
Submitter: Jenkins
Branch: stable/mitaka

commit fb1b9f224d6f05674667a7ddf7c8ba77f4f257aa
Author: Matt Riedemann <email address hidden>
Date: Tue Feb 14 10:25:24 2017 -0500

    Skip test_stamp_pattern in cells v1 job

    test_stamp_pattern was recently unskipped:

    I2c13099595d8ee8099e02e3f06096078c7d27c34

    It uses security groups which cells v1 does
    not support, so we have to skip this test in
    the cells v1 job.

    Conflicts:
            devstack/tempest-dsvm-cells-rc

    NOTE(mriedem): The conflict is due to not having
    b113cb13e95b4d9305f093342ad4d34378aee8bb in mitaka.

    Change-Id: Id7e8351026ca86694fc9814002b96260f6ba10f9
    Closes-Bug: #1664607
    (cherry picked from commit d12535839817c4385986ccaffe52b5903d3088ca)
    (cherry picked from commit 18fb0a17298dce2b361cc47f16d0d1500484f0d1)
    (cherry picked from commit db075faf2a767cf3f62768e85a79c3cff200d3cb)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/nova 14.0.4

This issue was fixed in the openstack/nova 14.0.4 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/nova 13.1.3

This issue was fixed in the openstack/nova 13.1.3 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/nova 16.0.0.0b1

This issue was fixed in the openstack/nova 16.0.0.0b1 development milestone.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.