Mirantis OpenStack

[ceilometer] resource-list is very slow

  1. Series 5.1.x
  2. Bug #1430740
Bug #1430740 reported by Ivan Berezovskiy
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Mirantis OpenStack
Fix Released
Medium
Ilya Tyaptin
Mirantis OpenStack 6.1
5.1.x
Fix Committed
Medium
Ilya Tyaptin
Mirantis OpenStack 5.1.1-updates
6.0.x
Won't Fix
Medium
Ilya Tyaptin
Mirantis OpenStack 6.0-updates

Bug Description

{"build_id": "2015-03-02_14-00-04", "ostf_sha": "103d6cf6badd57b791cfaf4310ec8bd81c7a8a46", "build_number": "154", "release_versions": {"2014.2-6.1": {"VERSION": {"build_id": "2015-03-02_14-00-04", "ostf_sha": "103d6cf6badd57b791cfaf4310ec8bd81c7a8a46", "build_number": "154", "api": "1.0", "nailgun_sha": "f034fbb4b68be963e4dc5b5d680061b54efbf605", "production": "docker", "python-fuelclient_sha": "3ebfa9c14a192d0298ff787526bf990055a23694", "astute_sha": "1be5b9b827f512d740fe907c7ff72486d4030938", "feature_groups": ["mirantis"], "release": "6.1", "fuelmain_sha": "baf24424a4e056c6753913de5f8c94851903f718", "fuellib_sha": "b17e3810dbca407fca2a231c26f553a46e166343"}}}, "auth_required": true, "api": "1.0", "nailgun_sha": "f034fbb4b68be963e4dc5b5d680061b54efbf605", "production": "docker", "python-fuelclient_sha": "3ebfa9c14a192d0298ff787526bf990055a23694", "astute_sha": "1be5b9b827f512d740fe907c7ff72486d4030938", "feature_groups": ["mirantis"], "release": "6.1", "fuelmain_sha": "baf24424a4e056c6753913de5f8c94851903f718", "fuellib_sha": "b17e3810dbca407fca2a231c26f553a46e166343"}

Deploy cluster:
HA, Centos
3 controllers+mongo
1 compute

Deploy is successful, run ostf tests: List ceilometer availability test is failed because of request for resource list.
Run from cli:
$ ceilometer resource-list
Gateway Timeout (HTTP 504)

The problem is in upstream bug https://bugs.launchpad.net/ceilometer/+bug/1048728. For every resource from resource list we ask its meters. It slows common request for resources (https://github.com/openstack/ceilometer/blob/stable/juno/ceilometer/api/controllers/v2.py#L1568). I think we don't need to slow ceilometer work in that way. So, we can revert change which importance is marked as wishlist.

Tags: ceilometer
Ivan Berezovskiy (iberezovskiy)
Changed in mos:
importance: Undecided → Medium
Revision history for this message
OSCI Robot (oscirobot) wrote :

package ceilometer has been built for project openstack/ceilometer
Package version == 2014.2.2, package release == fuel6.1.mira3.git.55e6463.7305890

Changeset: https://review.fuel-infra.org/4584
project: openstack/ceilometer
branch: openstack-ci/fuel-6.1/2014.2
author: Ilya Tyaptin
committer: Ilya Tyaptin
subject: Disable adding meters link to resource in api
status: patchset-created

Files placed on repository:

NOTE: Changeset is not merged, created temporary package repository.
 repository URL: /centos-fuel-6.1-stable-4584/

Revision history for this message
OSCI Robot (oscirobot) wrote :

package ceilometer has been built for project openstack/ceilometer
Package version == 2014.2.2, package release == fuel6.1~mira2+git.55e6463.7305890

Changeset: https://review.fuel-infra.org/4584
project: openstack/ceilometer
branch: openstack-ci/fuel-6.1/2014.2
author: Ilya Tyaptin
committer: Ilya Tyaptin
subject: Disable adding meters link to resource in api
status: patchset-created

Files placed on repository:

NOTE: Changeset is not merged, created temporary package repository.
 repository URL: /trusty-fuel-6.1-stable-4584/

Revision history for this message
OSCI Robot (oscirobot) wrote :

package ceilometer has been built for project openstack/ceilometer
Package version == 2014.2.2, package release == fuel6.1.mira3.git.0bcedf8.7305890

Changeset: https://review.fuel-infra.org/4584
project: openstack/ceilometer
branch: openstack-ci/fuel-6.1/2014.2
author: Ilya Tyaptin
committer: Ilya Tyaptin
subject: Disable adding meters link to resource in api
status: patchset-created

Files placed on repository:

NOTE: Changeset is not merged, created temporary package repository.
 repository URL: /centos-fuel-6.1-stable-4584/

Revision history for this message
OSCI Robot (oscirobot) wrote :

package ceilometer has been built for project openstack/ceilometer
Package version == 2014.2.2, package release == fuel6.1~mira2+git.0bcedf8.7305890

Changeset: https://review.fuel-infra.org/4584
project: openstack/ceilometer
branch: openstack-ci/fuel-6.1/2014.2
author: Ilya Tyaptin
committer: Ilya Tyaptin
subject: Disable adding meters link to resource in api
status: patchset-created

Files placed on repository:

NOTE: Changeset is not merged, created temporary package repository.
 repository URL: /trusty-fuel-6.1-stable-4584/

Revision history for this message
OSCI Robot (oscirobot) wrote :

package ceilometer has been built for project openstack/ceilometer
Package version == 2014.2.2, package release == fuel6.1.mira3.git.7d62ffc.7305890

Changeset: https://review.fuel-infra.org/4584
project: openstack/ceilometer
branch: openstack-ci/fuel-6.1/2014.2
author: Ilya Tyaptin
committer: Ilya Tyaptin
subject: Disable adding meters link to resource in api
status: patchset-created

Files placed on repository:

NOTE: Changeset is not merged, created temporary package repository.
 repository URL: /centos-fuel-6.1-stable-4584/

Revision history for this message
OSCI Robot (oscirobot) wrote :

package ceilometer has been built for project openstack/ceilometer
Package version == 2014.2.2, package release == fuel6.1~mira2+git.7d62ffc.7305890

Changeset: https://review.fuel-infra.org/4584
project: openstack/ceilometer
branch: openstack-ci/fuel-6.1/2014.2
author: Ilya Tyaptin
committer: Ilya Tyaptin
subject: Disable adding meters link to resource in api
status: patchset-created

Files placed on repository:

NOTE: Changeset is not merged, created temporary package repository.
 repository URL: /trusty-fuel-6.1-stable-4584/

Revision history for this message
OSCI Robot (oscirobot) wrote :

package ceilometer has been built for project openstack/ceilometer
Package version == 2014.2.2, package release == fuel6.1.mira3.git.38bdf71.7305890

Changeset: https://review.fuel-infra.org/4584
project: openstack/ceilometer
branch: openstack-ci/fuel-6.1/2014.2
author: Ilya Tyaptin
committer: Ilya Tyaptin
subject: Disable adding meters link to resource in api
status: patchset-created

Files placed on repository:

NOTE: Changeset is not merged, created temporary package repository.
 repository URL: /centos-fuel-6.1-stable-4584/

Revision history for this message
OSCI Robot (oscirobot) wrote :

package ceilometer has been built for project openstack/ceilometer
Package version == 2014.2.2, package release == fuel6.1~mira2+git.38bdf71.7305890

Changeset: https://review.fuel-infra.org/4584
project: openstack/ceilometer
branch: openstack-ci/fuel-6.1/2014.2
author: Ilya Tyaptin
committer: Ilya Tyaptin
subject: Disable adding meters link to resource in api
status: patchset-created

Files placed on repository:

NOTE: Changeset is not merged, created temporary package repository.
 repository URL: /trusty-fuel-6.1-stable-4584/

Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package ceilometer has been built for project openstack/ceilometer
Package version == 2014.1.3, package release == fuel5.1.2.mira6.git.bab1ebf.bca223d

Changeset: https://review.fuel-infra.org/4629
project: openstack/ceilometer
branch: openstack-ci/fuel-5.1.2/2014.1.1
author: Ilya Tyaptin
committer: Ilya Tyaptin
subject: Disable adding meters link to resource in api
status: patchset-created

Files placed on repository:
openstack-ceilometer-alarm-2014.1.3-fuel5.1.2.mira6.git.bab1ebf.bca223d.noarch.rpm
openstack-ceilometer-api-2014.1.3-fuel5.1.2.mira6.git.bab1ebf.bca223d.noarch.rpm
openstack-ceilometer-central-2014.1.3-fuel5.1.2.mira6.git.bab1ebf.bca223d.noarch.rpm
openstack-ceilometer-collector-2014.1.3-fuel5.1.2.mira6.git.bab1ebf.bca223d.noarch.rpm
openstack-ceilometer-common-2014.1.3-fuel5.1.2.mira6.git.bab1ebf.bca223d.noarch.rpm
openstack-ceilometer-compute-2014.1.3-fuel5.1.2.mira6.git.bab1ebf.bca223d.noarch.rpm
openstack-ceilometer-notification-2014.1.3-fuel5.1.2.mira6.git.bab1ebf.bca223d.noarch.rpm
python-ceilometer-2014.1.3-fuel5.1.2.mira6.git.bab1ebf.bca223d.noarch.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-5.1.2-stable-4629/centos

Revision history for this message
OSCI Robot (oscirobot) wrote :

DEB package ceilometer has been built for project openstack/ceilometer
Package version == 2014.1.3, package release == fuel5.1.2~mira6+git.bab1ebf.bca223d

Changeset: https://review.fuel-infra.org/4629
project: openstack/ceilometer
branch: openstack-ci/fuel-5.1.2/2014.1.1
author: Ilya Tyaptin
committer: Ilya Tyaptin
subject: Disable adding meters link to resource in api
status: patchset-created

Files placed on repository:
ceilometer-agent-central_2014.1.3-fuel5.1.2~mira6+git.bab1ebf.bca223d_all.deb
ceilometer-agent-compute_2014.1.3-fuel5.1.2~mira6+git.bab1ebf.bca223d_all.deb
ceilometer-agent-notification_2014.1.3-fuel5.1.2~mira6+git.bab1ebf.bca223d_all.deb
ceilometer-alarm-evaluator_2014.1.3-fuel5.1.2~mira6+git.bab1ebf.bca223d_all.deb
ceilometer-alarm-notifier_2014.1.3-fuel5.1.2~mira6+git.bab1ebf.bca223d_all.deb
ceilometer-api_2014.1.3-fuel5.1.2~mira6+git.bab1ebf.bca223d_all.deb
ceilometer-collector_2014.1.3-fuel5.1.2~mira6+git.bab1ebf.bca223d_all.deb
ceilometer-common_2014.1.3-fuel5.1.2~mira6+git.bab1ebf.bca223d_all.deb
python-ceilometer_2014.1.3-fuel5.1.2~mira6+git.bab1ebf.bca223d_all.deb

NOTE: Changeset is not merged, created temporary package repository.
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-5.1.2-stable-4629/ubuntu

Ivan Berezovskiy (iberezovskiy)
Changed in mos:
status: Confirmed → In Progress
Ivan Berezovskiy (iberezovskiy)
Changed in mos:
status: In Progress → Fix Committed
Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package ceilometer has been built for project openstack/ceilometer
Package version == 2014.1.3, package release == fuel5.1.2.mira7.git.538f8d4.bca223d

Changeset: https://review.fuel-infra.org/4828
project: openstack/ceilometer
branch: openstack-ci/fuel-5.1.2/2014.1.1
author: Ilya Tyaptin
committer: Ilya Tyaptin
subject: Disable adding meters link to resource in api
status: patchset-created

Files placed on repository:
openstack-ceilometer-alarm-2014.1.3-fuel5.1.2.mira7.git.538f8d4.bca223d.noarch.rpm
openstack-ceilometer-api-2014.1.3-fuel5.1.2.mira7.git.538f8d4.bca223d.noarch.rpm
openstack-ceilometer-central-2014.1.3-fuel5.1.2.mira7.git.538f8d4.bca223d.noarch.rpm
openstack-ceilometer-collector-2014.1.3-fuel5.1.2.mira7.git.538f8d4.bca223d.noarch.rpm
openstack-ceilometer-common-2014.1.3-fuel5.1.2.mira7.git.538f8d4.bca223d.noarch.rpm
openstack-ceilometer-compute-2014.1.3-fuel5.1.2.mira7.git.538f8d4.bca223d.noarch.rpm
openstack-ceilometer-notification-2014.1.3-fuel5.1.2.mira7.git.538f8d4.bca223d.noarch.rpm
python-ceilometer-2014.1.3-fuel5.1.2.mira7.git.538f8d4.bca223d.noarch.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-5.1.2-stable-4828/centos

Revision history for this message
OSCI Robot (oscirobot) wrote :

DEB package ceilometer has been built for project openstack/ceilometer
Package version == 2014.1.3, package release == fuel5.1.2~mira7+git.538f8d4.bca223d

Changeset: https://review.fuel-infra.org/4828
project: openstack/ceilometer
branch: openstack-ci/fuel-5.1.2/2014.1.1
author: Ilya Tyaptin
committer: Ilya Tyaptin
subject: Disable adding meters link to resource in api
status: patchset-created

Files placed on repository:
ceilometer-agent-central_2014.1.3-fuel5.1.2~mira7+git.538f8d4.bca223d_all.deb
ceilometer-agent-compute_2014.1.3-fuel5.1.2~mira7+git.538f8d4.bca223d_all.deb
ceilometer-agent-notification_2014.1.3-fuel5.1.2~mira7+git.538f8d4.bca223d_all.deb
ceilometer-alarm-evaluator_2014.1.3-fuel5.1.2~mira7+git.538f8d4.bca223d_all.deb
ceilometer-alarm-notifier_2014.1.3-fuel5.1.2~mira7+git.538f8d4.bca223d_all.deb
ceilometer-api_2014.1.3-fuel5.1.2~mira7+git.538f8d4.bca223d_all.deb
ceilometer-collector_2014.1.3-fuel5.1.2~mira7+git.538f8d4.bca223d_all.deb
ceilometer-common_2014.1.3-fuel5.1.2~mira7+git.538f8d4.bca223d_all.deb
python-ceilometer_2014.1.3-fuel5.1.2~mira7+git.538f8d4.bca223d_all.deb

NOTE: Changeset is not merged, created temporary package repository.
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-5.1.2-stable-4828/ubuntu

Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package ceilometer has been built for project openstack/ceilometer
Package version == 2014.1.3, package release == fuel5.1.2.mira7

Changeset: https://review.fuel-infra.org/4828
project: openstack/ceilometer
branch: openstack-ci/fuel-5.1.2/2014.1.1
author: Ilya Tyaptin
committer: Ilya Tyaptin
subject: Disable adding meters link to resource in api
status: change-merged

Files placed on repository:
openstack-ceilometer-alarm-2014.1.3-fuel5.1.2.mira7.noarch.rpm
openstack-ceilometer-api-2014.1.3-fuel5.1.2.mira7.noarch.rpm
openstack-ceilometer-central-2014.1.3-fuel5.1.2.mira7.noarch.rpm
openstack-ceilometer-collector-2014.1.3-fuel5.1.2.mira7.noarch.rpm
openstack-ceilometer-common-2014.1.3-fuel5.1.2.mira7.noarch.rpm
openstack-ceilometer-compute-2014.1.3-fuel5.1.2.mira7.noarch.rpm
openstack-ceilometer-notification-2014.1.3-fuel5.1.2.mira7.noarch.rpm
python-ceilometer-2014.1.3-fuel5.1.2.mira7.noarch.rpm

Changeset merged. Package placed on primary repository
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-5.1.2-stable/centos

Revision history for this message
OSCI Robot (oscirobot) wrote :

DEB package ceilometer has been built for project openstack/ceilometer
Package version == 2014.1.3, package release == fuel5.1.2~mira7

Changeset: https://review.fuel-infra.org/4828
project: openstack/ceilometer
branch: openstack-ci/fuel-5.1.2/2014.1.1
author: Ilya Tyaptin
committer: Ilya Tyaptin
subject: Disable adding meters link to resource in api
status: change-merged

Files placed on repository:
ceilometer-agent-central_2014.1.3-fuel5.1.2~mira7_all.deb
ceilometer-agent-compute_2014.1.3-fuel5.1.2~mira7_all.deb
ceilometer-agent-notification_2014.1.3-fuel5.1.2~mira7_all.deb
ceilometer-alarm-evaluator_2014.1.3-fuel5.1.2~mira7_all.deb
ceilometer-alarm-notifier_2014.1.3-fuel5.1.2~mira7_all.deb
ceilometer-api_2014.1.3-fuel5.1.2~mira7_all.deb
ceilometer-collector_2014.1.3-fuel5.1.2~mira7_all.deb
ceilometer-common_2014.1.3-fuel5.1.2~mira7_all.deb
python-ceilometer_2014.1.3-fuel5.1.2~mira7_all.deb

Changeset merged. Package placed on primary repository
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-5.1.2-stable/ubuntu

Revision history for this message
Vitaly Gusev (vgusev) wrote :

Verified on ISO:
VERSION:
  feature_groups:
    - mirantis
  production: "docker"
  release: "6.1"
  api: "1.0"
  build_number: "260"
  build_id: "2015-03-31_22-54-44"
  nailgun_sha: "51ddbe0a2e379e82af531b1c6d45fd386d2f894e"
  python-fuelclient_sha: "9b0b6ab2f09ff75445550b7210104e21df5d8cd6"
  astute_sha: "7292fc2a673cb1c32a688a46fd4836ca0500a957"
  fuellib_sha: "27459a89cdac078ec4046a442a11d750c5eccc2e"
  ostf_sha: "1c7f799cb0e159737d1f910b13e4073b16d1eb8c"
  fuelmain_sha: "178812b1971a900c49a8afc1688afd7475a6ffbb"

Changed in mos:
status: Fix Committed → Fix Released
Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix proposed to openstack/ceilometer (openstack-ci/fuel-7.0/2015.1.0)

Fix proposed to branch: openstack-ci/fuel-7.0/2015.1.0
Change author: Ilya Tyaptin <email address hidden>
Review: https://review.fuel-infra.org/8069

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix merged to openstack/ceilometer (openstack-ci/fuel-7.0/2015.1.0)

Reviewed: https://review.fuel-infra.org/8069
Submitter: mos-infra-ci <>
Branch: openstack-ci/fuel-7.0/2015.1.0

Commit: 305ef291d919bbfc9c306ce64ee86aba1bb9eaec
Author: Ilya Tyaptin <email address hidden>
Date: Fri Jul 17 12:19:48 2015

Disable adding meters link to resource in api

With finding meter links for every resource, resource-list request
becomes very slow. This patch disable meters link finding by default

Change-Id: Ied90fc9fdd529d788af1bc13777fd4c3eb76e3da
Closes-bug:1430740

Revision history for this message
Vitaly Sedelnik (vsedelnik) wrote :

Won't Fix for 6.0-updates because of Medium importance

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix proposed to openstack/ceilometer (openstack-ci/fuel-8.0/liberty)

Fix proposed to branch: openstack-ci/fuel-8.0/liberty
Change author: Ilya Tyaptin <email address hidden>
Review: https://review.fuel-infra.org/13441

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix merged to openstack/ceilometer (openstack-ci/fuel-8.0/liberty)

Reviewed: https://review.fuel-infra.org/13441
Submitter: Pkgs Jenkins <email address hidden>
Branch: openstack-ci/fuel-8.0/liberty

Commit: 422e56f276f860f2d9b8c297ef62e561cb60c4b6
Author: Ilya Tyaptin <email address hidden>
Date: Tue Nov 10 09:20:43 2015

Disable adding meters link to resource in api

With finding meter links for every resource, resource-list request
becomes very slow. This patch disable meters link finding by default

Change-Id: Ied90fc9fdd529d788af1bc13777fd4c3eb76e3da
Closes-bug:1430740

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix proposed to openstack/ceilometer (9.0/mitaka)

Fix proposed to branch: 9.0/mitaka
Change author: Ilya Tyaptin <email address hidden>
Review: https://review.fuel-infra.org/18548

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix merged to openstack/ceilometer (9.0/mitaka)

Reviewed: https://review.fuel-infra.org/18548
Submitter: Pkgs Jenkins <email address hidden>
Branch: 9.0/mitaka

Commit: 6e085ff2a7e84003cbad01d00a4a98f66976f60c
Author: Ilya Tyaptin <email address hidden>
Date: Thu Mar 31 09:30:29 2016

Disable adding meters link to resource in api

With finding meter links for every resource, resource-list request
becomes very slow. This patch disable meters link finding by default

Change-Id: Ied90fc9fdd529d788af1bc13777fd4c3eb76e3da
Closes-bug:1430740

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix proposed to openstack/ceilometer (mcp/newton)

Fix proposed to branch: mcp/newton
Change author: Ilya Tyaptin <email address hidden>
Review: https://review.fuel-infra.org/33183

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix proposed to openstack/ceilometer (11.0/ocata)

Fix proposed to branch: 11.0/ocata
Change author: Ilya Tyaptin <email address hidden>
Review: https://review.fuel-infra.org/33762

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix proposed to openstack/ceilometer (mcp/ocata)

Fix proposed to branch: mcp/ocata
Change author: Ilya Tyaptin <email address hidden>
Review: https://review.fuel-infra.org/34483

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Change abandoned on openstack/ceilometer (mcp/ocata)

Change abandoned by Ilya Tyaptin <email address hidden> on branch: mcp/ocata
Review: https://review.fuel-infra.org/34483

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Change abandoned on openstack/ceilometer (11.0/ocata)

Change abandoned by Roman Podoliaka <email address hidden> on branch: 11.0/ocata
Review: https://review.fuel-infra.org/33762
Reason: we don't use 11.0/ocata anymore - mcp/ocata is the correct branch name

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Change abandoned on openstack/ceilometer (mcp/newton)

Change abandoned by Ilya Tyaptin <email address hidden> on branch: mcp/newton
Review: https://review.fuel-infra.org/33183

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.