over time, horizon's admin -> overview page becomes very slow ....

Bug #1573288 reported by Kambiz Aghaiepour
34
This bug affects 7 people
Affects Status Importance Assigned to Milestone
OpenStack Dashboard (Horizon)
Incomplete
Medium
Sudheer Kalla

Bug Description

I've noticed that when logging into the admin account after a bunch of activity against the RDO installation, it takes a very long time (many minutes) before horizon loads (I think the issue is the overview admin page which is also the main landing page for logging in).

The list includes overall activity including deleted projects. If you orchestrate lots of testing against the installation using "rally" you will see lots of projects get created and later deleted. As such I have an overview page which lists at the bottom:

"Displaying 2035 items"

Is it possible to do something about the Overview page either by displaying only the first 20 items, or changing the type of information being displayed? Logging into admin is very painful currently. Non-admin accounts login quickly.

Version-Release number of selected component (if applicable):

Liberty

How reproducible:

Always.

Steps to Reproduce:

Run rally against openstack in an endless loop. After a few days (or hours depending on what you do and how you do it) you will find horizon getting slower and slower.

Originally reported against RDO here: https://bugzilla.redhat.com/show_bug.cgi?id=1329414

though this is likely a general issue.

Itxaka Serrano (itxaka)
Changed in horizon:
status: New → Confirmed
Revision history for this message
Itxaka Serrano (itxaka) wrote :

This is present since Juno at least.

The issue seems to be that in Admin -> overview we ask nova for _all_ instances, even deleted ones, thus on a big deployment with instances coming and going everyday, this gets as slow as possible.

Mixed with the range that takes since the start of the month to display items, this gets worse the later in the month (as is displaying more and more days)

There is a patch (https://review.openstack.org/#/c/238204/) to make the overview ranges configurable so this would alleviate the issue, but it does not fix the real problem. Asking for all instances is very costly.

This should be discussed in a meeting to see what direction to take with the overview page.

Changed in horizon:
importance: Undecided → Medium
Revision history for this message
Michael Gale (gale-michael) wrote :

If you can't apply the patch for whatever reason, the following helped me.

Attempt to go to another page, like https://<your_fqdn>/admin/hypervisors/ and you should get the login page. However after authenticating you will be redirect to our original requested page.

This has the effect of bypassing the Overview page.

Revision history for this message
Matthias Runge (mrunge) wrote :

iirc, the main reason here is, that nova api becomes slow. Horizon is using the SimpleTenantUsage API in nova, which seems to be problematic.

Revision history for this message
Sudheer Kalla (sudheer-kalla) wrote :

Hello All,

I think the problem here is that horizon is trying to load a lot of data from nova API when user firsts logs in.

I suggest if we can make horizon to get only the data for today that will the narrow down data fetching a lot and user will be logged in less time. If user wants to check the overview data he can use the form present in the overview panel after logging in.

So the basic problem of slow logging will be eliminated.

Changed in horizon:
assignee: nobody → Sudheer Kalla (sudheer-kalla)
Revision history for this message
Rob Cresswell (robcresswell-deactivatedaccount) wrote :
Changed in horizon:
status: Confirmed → Incomplete
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.