list instance details caused host CPU overload if each one instance had lots of instance faults

Bug #1495400 reported by Rui Chen on 2015-09-14
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
Medium
Unassigned

Bug Description

1. code base

$ git log -1
commit e70ff282f8ed92133942f4d878c2b5f8564f83a8
Merge: 9e0e7a3 222085d
Author: Jenkins <email address hidden>
Date: Mon Sep 14 05:44:39 2015 +0000

    Merge "Invalidate AZ cache when the instance AZ information is different"

2. Reproduce steps:

* background data: 1000 instances, 10000 faults record in each instance
* list all instance details

Expected result:
* nova-api Host CPU load in a reasonable range, like: 85%

Actual result:
* nova-api Host CPU load persist 100%

NOTE: we collect all faults of each instance in db api (all results loop), and only return the latest one in InstanceList object(all results loop), I think we should return the latest fault of each instance in db api, that can avoid an all results loop in InstanceList object.

Rui Chen (kiwik-chenrui) on 2015-09-14
Changed in nova:
assignee: nobody → Rui Chen (kiwik-chenrui)

Fix proposed to branch: master
Review: https://review.openstack.org/223392

Changed in nova:
status: New → In Progress

Change abandoned by Michael Still (<email address hidden>) on branch: master
Review: https://review.openstack.org/223392
Reason: This patch has been sitting unchanged for more than 12 weeks. I am therefore going to abandon it to keep the nova review queue sane. Please feel free to restore the change if you're still working on it.

Maciej Szankin (mszankin) wrote :

This bug report has an assignee for a while now but there is no patch
for that. It looks like that the chance of getting a patch is low.
I'm going to remove the assignee to signal to others that they can take
over if they like.
If you want to work on this, please:
* add yourself as assignee AND
* set the status to "In Progress" AND
* provide a (WIP) patch within the next 2 weeks after that.
If you need assistance, reach out on the IRC channel #openstack-nova or
use the mailing list.

Changed in nova:
status: In Progress → New
assignee: Rui Chen (kiwik-chenrui) → nobody
Sean Dague (sdague) on 2017-06-28
Changed in nova:
status: New → Confirmed
importance: Undecided → Medium
tags: added: performance
tags: added: db
Matt Riedemann (mriedem) wrote :

Looks like this was fixed in Ocata:

https://review.openstack.org/#/c/409943/

To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers