Ugly oslo.concurrency DEBUG output when running nova-manage cell_v2 discover_hosts

Bug #1707001 reported by Matt Riedemann
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
Fix Released
Medium
Matt Riedemann
Newton
Confirmed
Medium
Unassigned
Ocata
Fix Committed
Medium
Matt Riedemann

Bug Description

Seen here:

http://logs.openstack.org/46/487246/2/experimental/gate-tempest-dsvm-neutron-dvr-ha-multinode-full-ubuntu-xenial-nv/6cd2a5b/logs/devstack-gate-discover-hosts.txt.gz

localhost | SUCCESS | rc=0 >>
Found 2 cell mappings.
Skipping cell0 since it does not contain hosts.
Getting compute nodes from cell 'cell1': a7345ef4-6c48-4c4a-912f-4c1f93b7f880
DEBUG oslo_concurrency.lockutils [None req-510b4930-f0e6-4e15-b8a3-0b7064249e68 None None] Lock "a7345ef4-6c48-4c4a-912f-4c1f93b7f880" acquired by "nova.context.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=11111) inner /usr/local/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py:270}}
DEBUG oslo_concurrency.lockutils [None req-510b4930-f0e6-4e15-b8a3-0b7064249e68 None None] Lock "a7345ef4-6c48-4c4a-912f-4c1f93b7f880" released by "nova.context.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=11111) inner /usr/local/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py:282}}
Found 2 unmapped computes in cell: a7345ef4-6c48-4c4a-912f-4c1f93b7f880
Checking host mapping for compute host 'ubuntu-xenial-3-node-rax-dfw-10092052-748716': 0adb5bd3-18f2-47d5-9806-8f10e83ff7eb
Creating host mapping for compute host 'ubuntu-xenial-3-node-rax-dfw-10092052-748716': 0adb5bd3-18f2-47d5-9806-8f10e83ff7eb
Checking host mapping for compute host 'ubuntu-xenial-3-node-rax-dfw-10092052-748717': cd5c029b-c513-499e-baf3-d7fa47d72ba7
Creating host mapping for compute host 'ubuntu-xenial-3-node-rax-dfw-10092052-748717': cd5c029b-c513-499e-baf3-d7fa47d72ba7

This is due to caching the DB/MQ connections in the request context and locking on them:

https://github.com/openstack/nova/commit/f4159d17552603b90912dba6fe5c604e8d0b8aa7

Tags: nova-manage
Revision history for this message
Matt Riedemann (mriedem) wrote :
tags: added: nova-manage
Changed in nova:
assignee: nobody → Matt Riedemann (mriedem)
status: New → In Progress
Matt Riedemann (mriedem)
Changed in nova:
importance: Undecided → Medium
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to nova (master)

Reviewed: https://review.openstack.org/487179
Committed: https://git.openstack.org/cgit/openstack/nova/commit/?id=bc4f842caccec7641da910bb615cc64cff80d861
Submitter: Jenkins
Branch: master

commit bc4f842caccec7641da910bb615cc64cff80d861
Author: Matt Riedemann <email address hidden>
Date: Tue Jul 25 15:05:44 2017 -0400

    Add oslo_concurrency=INFO to default log levels for nova-manage

    We currently get oslo_concurrency logging at DEBUG level which
    is gratuitous, so this changes the default to INFO.

    Closes-Bug: #1707001

    Change-Id: Iacf0a94296dbd44d0f30650003b732baccd3728b

Changed in nova:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/nova 16.0.0.0rc1

This issue was fixed in the openstack/nova 16.0.0.0rc1 release candidate.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to nova (stable/ocata)

Reviewed: https://review.openstack.org/490234
Committed: https://git.openstack.org/cgit/openstack/nova/commit/?id=b0cdac7e3cfa604badf03a9d2239536e47439e34
Submitter: Jenkins
Branch: stable/ocata

commit b0cdac7e3cfa604badf03a9d2239536e47439e34
Author: Matt Riedemann <email address hidden>
Date: Tue Jul 25 15:05:44 2017 -0400

    Add oslo_concurrency=INFO to default log levels for nova-manage

    We currently get oslo_concurrency logging at DEBUG level which
    is gratuitous, so this changes the default to INFO.

    Closes-Bug: #1707001

    Change-Id: Iacf0a94296dbd44d0f30650003b732baccd3728b
    (cherry picked from commit bc4f842caccec7641da910bb615cc64cff80d861)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/nova 15.0.7

This issue was fixed in the openstack/nova 15.0.7 release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.