tripleo

ovb-updates job fails with gnocchi upgrade command timeout

Bug #1693830 reported by Alex Schultz
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Triaged
Critical
Emilien Macchi
tripleo pike-2 "pike-2"

Bug Description

The ovb-upgrade job is consistently failing with the following error:

[1;31mError: /Stage[main]/Tripleo::Profile::Base::Gnocchi::Api/Exec[run gnocchi upgrade with storage]/returns: change from notrun to 0 failed: Command exceeded timeout

http://logs.openstack.org/31/468031/3/check-tripleo/gate-tripleo-ci-centos-7-ovb-updates/25cb669/console.html#_2017-05-26_01_48_12_363772

Might be related to Bug 1693621

Tags: ci
Emilien Macchi (emilienm)
summary: - ovb-upgrade job fails with gnocchi upgrade command timeout
+ ovb-updates job fails with gnocchi upgrade command timeout
Revision history for this message
Emilien Macchi (emilienm) wrote :

I'm disable Telemetry on ovb-updates: https://review.openstack.org/#/c/468820/

Changed in tripleo:
assignee: nobody → Emilien Macchi (emilienm)
Emilien Macchi (emilienm)
tags: removed: alert
Revision history for this message
Alfredo Moralejo (amoralej) wrote :

It seems we are still hitting this in periodic-tripleo-ci-centos-7-ovb-nonha jobs:

http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-nonha/4c49235/console.html#_2017-06-05_07_51_58_538175

I'd say it's a problem with ceph OSD:

http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-nonha/4c49235/logs/overcloud-cephstorage-0/var/log/ceph/ceph-osd.0.txt.gz

Apparently, some io operations are totally hang:

slow request 480.037398 seconds old

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.