CI: Error: /Stage[main]/Gnocchi::Db::Sync/Exec[gnocchi-db-sync]: gnocchi-upgrade --config-file /etc/gnocchi/gnocchi.conf --skip-storage --create-legacy-resource-types returned 1 instead of one of [0]\u001b[0m\n",

Bug #1604624 reported by James Slagle
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Fix Released
Critical
James Slagle

Bug Description

Seeing a fair amount of CI jobs failing with this error:

2016-07-19 22:17:03.000 | "deploy_stderr": "exception: connect failed\nCould not retrieve fact='mongodb_is_master', resolution='<anonymous>': 757: unexpected token at '2016-07-19T22:06:54.925+0000 warning: Failed to connect to 127.0.0.1:27017, reason: errno:111 Connection refused\n2016-07-19T22:06:54.926+0000 Error: couldn't connect to server 127.0.0.1:27017 (127.0.0.1), connection attempt failed at src/mongo/shell/mongo.js:146'\nexception: connect failed\nCould not retrieve fact='mongodb_is_master', resolution='<anonymous>': 757: unexpected token at '2016-07-19T22:06:55.000+0000 warning: Failed to connect to 127.0.0.1:27017, reason: errno:111 Connection refused\n2016-07-19T22:06:55.001+0000 Error: couldn't connect to server 127.0.0.1:27017 (127.0.0.1), connection attempt failed at src/mongo/shell/mongo.js:146'\n\u001b[1;31mWarning: Variable access via 'notification_email_to' is deprecated. Use '@notification_email_to' instead. template[/etc/puppet/modules/keepalived/templates/global_config.erb]:3\n (at /etc/puppet/modules/keepalived/templates/global_config.erb:3:in `block in result')\u001b[0m\n\u001b[1;31mWarning: notify is a metaparam; this value will inherit to all contained resources in the keepalived::instance definition\u001b[0m\n\u001b[1;31mWarning: Scope(Class[Nova]): Could not look up qualified variable '::nova::scheduler::filter::cpu_allocation_ratio'; class ::nova::scheduler::filter has not been evaluated\u001b[0m\n\u001b[1;31mWarning: Scope(Class[Nova]): Could not look up qualified variable '::nova::scheduler::filter::ram_allocation_ratio'; class ::nova::scheduler::filter has not been evaluated\u001b[0m\n\u001b[1;31mWarning: Scope(Class[Nova]): Could not look up qualified variable '::nova::scheduler::filter::disk_allocation_ratio'; class ::nova::scheduler::filter has not been evaluated\u001b[0m\n\u001b[1;31mWarning: Scope(Class[Tripleo::Profile::Base::Nova]): Overriding memcached_servers from puppet-tripleo until 325983 lands.\u001b[0m\n\u001b[1;31mWarning: Scope(Class[Mongodb::Server]): Replset specified, but no replset_members or replset_config provided.\u001b[0m\n\u001b[1;31mWarning: Scope(Class[Ceilometer]): metering_secret has been renamed to telemetry_secret. metering_secret will continue to work until Ocata.\u001b[0m\n\u001b[1;31mWarning: Scope(Haproxy::Config[haproxy]): haproxy: The $merge_options parameter will default to true in the next major release. Please review the documentation regarding the implications.\u001b[0m\n\u001b[1;31mWarning: Unexpected line: Ring file /etc/swift/container.ring.gz not found, probably it hasn't been written yet\u001b[0m\n\u001b[1;31mWarning: Unexpected line: Ring file /etc/swift/object.ring.gz not found, probably it hasn't been written yet\u001b[0m\n\u001b[1;31mWarning: Unexpected line: Ring file /etc/swift/account.ring.gz not found, probably it hasn't been written yet\u001b[0m\n\u001b[1;31mError: /Stage[main]/Gnocchi::Db::Sync/Exec[gnocchi-db-sync]: Failed to call refresh: gnocchi-upgrade --config-file /etc/gnocchi/gnocchi.conf --skip-storage --create-legacy-resource-types returned 1 instead of one of [0]\u001b[0m\n\u001b[1;31mError: /Stage[main]/Gnocchi::Db::Sync/Exec[gnocchi-db-sync]: gnocchi-upgrade --config-file /etc/gnocchi/gnocchi.conf --skip-storage --create-legacy-resource-types returned 1 instead of one of [0]\u001b[0m\n",

Revision history for this message
James Slagle (james-slagle) wrote :
Revision history for this message
James Slagle (james-slagle) wrote :
Changed in tripleo:
status: New → Triaged
importance: Undecided → Critical
Revision history for this message
James Slagle (james-slagle) wrote :

earlier up in the puppet output you can see:

ERROR gnocchi DBError: (pymysql.err.InternalError) (1050, u\"Table 'resource_history' already exists\")

could be possibly we are running the gnocchi upgrade command from all nodes, and not just the bootstrap node

Revision history for this message
James Slagle (james-slagle) wrote :
tags: added: alert
Changed in tripleo:
assignee: nobody → James Slagle (james-slagle)
milestone: none → newton-3
Steven Hardy (shardy)
Changed in tripleo:
status: Triaged → In Progress
Steven Hardy (shardy)
Changed in tripleo:
status: In Progress → Fix Committed
tags: removed: alert
Changed in tripleo:
status: Fix Committed → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/puppet-tripleo 5.0.0.0b3

This issue was fixed in the openstack/puppet-tripleo 5.0.0.0b3 development milestone.

Revision history for this message
Amer Hwitat (amer.hwitat) wrote :

I have this on installation --allinone, I added ironic, heat , sahara to answer-file earlier

ERROR : Error appeared during Puppet run: 192.168.43.110_controller.pp
Error: /Stage[main]/Gnocchi::Db::Sync/Exec[gnocchi-db-sync]: Failed to call refresh: gnocchi-upgrade --config-file /etc/gnocchi/gnocchi.conf returned 1 instead of one of [0]

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.