Fuel for OpenStack

Dbus exceptions in anaconda lead to failed provisioning

Bug #1250873 reported by Anastasia Palkina
38
This bug affects 5 people
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Won't Fix
Low
Matthew Mosesohn
Fuel for OpenStack 6.1
Declined for 4.1.x by Vladimir Sharshov
5.1.x
Won't Fix
Low
Alexander Gordeev
Fuel for OpenStack 5.1.1-updates
6.0.x
Won't Fix
Undecided
Unassigned
Fuel for OpenStack 6.0-updates

Bug Description

ISO 4.0 #30

1. Create new environment
2. Choose CentOS, simple, nova-network
3. Add controller, compute, cinder
4. Provisioning for cinder has failed (see screen)

I can't reproduced it again

See original description
Revision history for this message
Anastasia Palkina (apalkina) wrote :
description: updated
Anastasia Palkina (apalkina)
summary: - dbus.exceptions
+ provisioning fails due anaconda barfed his tail
Vladimir Kuklin (vkuklin)
Changed in fuel:
assignee: Vladimir Kuklin (vkuklin) → Matthew Mosesohn (mmosesoh)
milestone: none → 3.2.1
importance: Undecided → Medium
Matthew Mosesohn (mmosesoh-deactivatedaccount)
Changed in fuel:
assignee: Matthew Mosesohn (mmosesoh) → nobody
Matthew Mosesohn (raytrac3r)
Changed in fuel:
assignee: nobody → Matthew Mosesohn (raytrac3r)
Revision history for this message
Mike Scherbakov (mihgen) wrote : Re: provisioning fails due anaconda barfed his tail

As it is rarely reproduced and looks like we don't know the cause, moving it to 4.0

Changed in fuel:
milestone: 3.2.1 → 4.0
Mike Scherbakov (mihgen)
Changed in fuel:
status: New → Incomplete
Revision history for this message
Vladimir Kuklin (vkuklin) wrote :

It is really hard to reproduce. Appears at about 0.1% of cases.

Anaconda exception is:

013-12-24T22:55:29.469343+00:00 crit: anaconda 13.21.195 exception report
2013-12-24T22:55:29.469687+00:00 info: Traceback (most recent call first):
2013-12-24T22:55:29.470011+00:00 info: File "/usr/lib/python2.6/site-packages/dbus/connection.py", line 630, in call_blocking
2013-12-24T22:55:29.470443+00:00 info: message, timeout)
2013-12-24T22:55:29.470591+00:00 info: File "/usr/lib/python2.6/site-packages/dbus/proxies.py", line 140, in __call__
2013-12-24T22:55:29.470908+00:00 info: **keywords)
2013-12-24T22:55:29.471207+00:00 info: File "/usr/lib/python2.6/site-packages/dbus/proxies.py", line 68, in __call__
2013-12-24T22:55:29.471474+00:00 info: return self._proxy_method(*args, **keywords)
2013-12-24T22:55:29.471942+00:00 info: File "/usr/lib/anaconda/network.py", line 174, in getActiveNetDevs
2013-12-24T22:55:29.472287+00:00 info: devices = active_connection_props_iface.Get(isys.NM_ACTIVE_CONNECTION_IFACE, 'Devices')
2013-12-24T22:55:29.472560+00:00 info: File "/usr/lib/anaconda/network.py", line 636, in hasActiveIPoIBDevice
2013-12-24T22:55:29.472892+00:00 info: active_devs = getActiveNetDevs()
2013-12-24T22:55:29.473308+00:00 info: File "/usr/lib/anaconda/instdata.py", line 185, in write
2013-12-24T22:55:29.473557+00:00 info: if self.network.hasActiveIPoIBDevice():
2013-12-24T22:55:29.473930+00:00 info: File "/usr/lib/anaconda/backend.py", line 256, in writeConfiguration
2013-12-24T22:55:29.474288+00:00 info: anaconda.id.write()
2013-12-24T22:55:29.474681+00:00 info: File "/usr/lib/anaconda/dispatch.py", line 210, in moveStep
2013-12-24T22:55:29.475058+00:00 info: rc = stepFunc(self.anaconda)
2013-12-24T22:55:29.475504+00:00 info: File "/usr/lib/anaconda/dispatch.py", line 126, in gotoNext
2013-12-24T22:55:29.475993+00:00 info: self.moveStep()
2013-12-24T22:55:29.476329+00:00 info: File "/usr/lib/anaconda/text.py", line 666, in run
2013-12-24T22:55:29.476654+00:00 info: anaconda.dispatch.gotoNext()
2013-12-24T22:55:29.476907+00:00 info: File "/usr/bin/anaconda", line 1132, in <module>
2013-12-24T22:55:29.477288+00:00 info: anaconda.intf.run(anaconda)
2013-12-24T22:55:29.477436+00:00 info: DBusException: org.freedesktop.DBus.Error.UnknownMethod: Method "Get" with signature "ss" on interface "org.freedesktop.DBus.Properties" doesn't exist
2013-12-24T22:55:29.477589+00:00 info:
2013-12-24T22:55:29.477888+00:00 info:

summary: - provisioning fails due anaconda barfed his tail
+ Dbus exceptions in anaconda lead to failed provisioning
Changed in fuel:
importance: Medium → Low
milestone: 4.0 → 4.1
Revision history for this message
Vladimir Kuklin (vkuklin) wrote :
Dmitry Borodaenko (angdraug)
Changed in fuel:
status: Incomplete → Invalid
Revision history for this message
Tatyanka (tatyana-leontovich) wrote :

reproduced on 6.0 system tests:
VERSION:
  feature_groups:
    - mirantis
  production: "docker"
  release: "6.0"
  api: "1.0"
  build_number: "540"
  build_id: "2014-10-02_00-00-10"
  astute_sha: "a3e5da62af91b99f958ab958161d3dcec09c657b"
  fuellib_sha: "df3377534acd70389b551025539152039e260f5c"
  ostf_sha: "f238ecaef0cad7d31aca7e6af2f2523d8fcdc9e7"
  nailgun_sha: "e691dcfbb6cdf1164a70f389ec854185b7c73f32"
  fuelmain_sha: "0a7cfb07241741dba3ecbd14210512b9eb1d88ae"

http://jenkins-product.srt.mirantis.net:8080/view/0_master_swarm/job/master_fuelmain.system_test.centos.thread_3/166/consoleFull

http://paste.openstack.org/show/117763/ (node-4 in attached snapshot)

Changed in fuel:
status: Invalid → Confirmed
milestone: 4.1 → 6.0
Revision history for this message
Tatyanka (tatyana-leontovich) wrote :
Matthew Mosesohn (raytrac3r)
Changed in fuel:
milestone: 6.0 → 6.1
Revision history for this message
Tatyanka (tatyana-leontovich) wrote :

http://jenkins-product.srt.mirantis.net:8080/view/6.0/job/6.0.centos.bvt_1/132/

Revision history for this message
Tatyanka (tatyana-leontovich) wrote :
Revision history for this message
Tatyanka (tatyana-leontovich) wrote :

reproduced here http://172.18.66.221:8080/view/6.0_swarm/job/6.0_fuelmain.system_test.ubuntu.plugins/21/testReport/junit/%28root%29/deploy_neutron_example_ha_add_node/deploy_neutron_example_ha_add_node/

Revision history for this message
Tatyanka (tatyana-leontovich) wrote :

http://paste.openstack.org/show/155732/

Revision history for this message
Tatyanka (tatyana-leontovich) wrote :

http://jenkins-product.srt.mirantis.net:8080/job/6.0.1.centos.bvt_1/13/

Revision history for this message
Alexander Ignatov (aignatov) wrote :

See the same here:
http://jenkins-product.srt.mirantis.net:8080/job/6.1.staging.centos.bvt_1/98/

Revision history for this message
Vladimir Kuklin (vkuklin) wrote :

We will not fix anaconda issues as we are moving to Image based provisioning. There is no upstream bugs and fix is not available, we will try to think of a workaround for 6.0.1, but bug is really low-priority.

Revision history for this message
Matthew Mosesohn (raytrac3r) wrote :

We can work around this issue by letting it time out and try to "deploy changes" again and let astute attempt a reboot of the failed node to retry provisioning.

Mike Scherbakov (mihgen)
no longer affects: fuel/6.1.x
Changed in fuel:
status: Confirmed → Won't Fix
Revision history for this message
Alexander Gordeev (a-gordeev) wrote :

The same thing happened with:
1) https://old-stable-ci.infra.mirantis.net/job/5.1.2.staging.centos.bvt_1/257/
2) https://old-stable-ci.infra.mirantis.net/job/5.1.2.staging.centos.bvt_1/260/

info: *** FINISHED INSTALLING PACKAGES ***
info: Running kickstart %%traceback script(s)
info: All kickstart %%traceback script(s) have been run
crit: anaconda 13.21.215 exception report
info: Traceback (most recent call first):
info: File "/usr/lib/python2.6/site-packages/dbus/connection.py", line 630, in call_blocking
info: message, timeout)
info: File "/usr/lib/python2.6/site-packages/dbus/proxies.py", line 140, in __call__
info: **keywords)
info: File "/usr/lib/python2.6/site-packages/dbus/proxies.py", line 68, in __call__
info: return self._proxy_method(*args, **keywords)
info: File "/usr/lib/anaconda/network.py", line 174, in getActiveNetDevs
info: devices = active_connection_props_iface.Get(isys.NM_ACTIVE_CONNECTION_IFACE, 'Devices')
info: File "/usr/lib/anaconda/network.py", line 658, in hasActiveIPoIBDevice
info: active_devs = getActiveNetDevs()
info: File "/usr/lib/anaconda/instdata.py", line 185, in write
info: if self.network.hasActiveIPoIBDevice():
info: File "/usr/lib/anaconda/backend.py", line 244, in writeConfiguration
info: anaconda.id.write()
info: File "/usr/lib/anaconda/dispatch.py", line 210, in moveStep
info: rc = stepFunc(self.anaconda)
info: File "/usr/lib/anaconda/dispatch.py", line 126, in gotoNext
info: self.moveStep()
info: File "/usr/lib/anaconda/text.py", line 666, in run
info: anaconda.dispatch.gotoNext()
info: File "/usr/bin/anaconda", line 1131, in <module>
info: anaconda.intf.run(anaconda)
info: DBusException: org.freedesktop.DBus.Error.UnknownMethod: Method "Get" with signature "ss" on interface "org.freedesktop.DBus.Properties" doesn't exist
info:

Revision history for this message
Nastya Urlapova (aurlapova) wrote :

The same for https://old-stable-ci.infra.mirantis.net/job/6.0.1.staging.centos.bvt_1/292/
2015-10-27T20:35:51.623744+00:00 info: Traceback (most recent call first):
2015-10-27T20:35:51.623906+00:00 info: File "/usr/lib/python2.6/site-packages/dbus/connection.py", line 630, in call_blocking
2015-10-27T20:35:51.624064+00:00 info: message, timeout)
2015-10-27T20:35:51.624249+00:00 info: File "/usr/lib/python2.6/site-packages/dbus/proxies.py", line 140, in __call__
2015-10-27T20:35:51.624403+00:00 info: **keywords)
2015-10-27T20:35:51.624565+00:00 info: File "/usr/lib/python2.6/site-packages/dbus/proxies.py", line 68, in __call__
2015-10-27T20:35:51.624700+00:00 info: return self._proxy_method(*args, **keywords)
2015-10-27T20:35:51.624873+00:00 info: File "/usr/lib/anaconda/network.py", line 174, in getActiveNetDevs
2015-10-27T20:35:51.625025+00:00 info: devices = active_connection_props_iface.Get(isys.NM_ACTIVE_CONNECTION_IFACE, 'Devices')
2015-10-27T20:35:51.625197+00:00 info: File "/usr/lib/anaconda/network.py", line 670, in hasActiveIPoIBDevice
2015-10-27T20:35:51.625361+00:00 info: active_devs = getActiveNetDevs()
2015-10-27T20:35:51.625505+00:00 info: File "/usr/lib/anaconda/instdata.py", line 185, in write
2015-10-27T20:35:51.625654+00:00 info: if self.network.hasActiveIPoIBDevice():
2015-10-27T20:35:51.625807+00:00 info: File "/usr/lib/anaconda/backend.py", line 246, in writeConfiguration
2015-10-27T20:35:51.625949+00:00 info: anaconda.id.write()
2015-10-27T20:35:51.626119+00:00 info: File "/usr/lib/anaconda/dispatch.py", line 210, in moveStep
2015-10-27T20:35:51.626301+00:00 info: rc = stepFunc(self.anaconda)
2015-10-27T20:35:51.626445+00:00 info: File "/usr/lib/anaconda/dispatch.py", line 126, in gotoNext
2015-10-27T20:35:51.626580+00:00 info: self.moveStep()
2015-10-27T20:35:51.626718+00:00 info: File "/usr/lib/anaconda/text.py", line 666, in run
2015-10-27T20:35:51.626854+00:00 info: anaconda.dispatch.gotoNext()
2015-10-27T20:35:51.626993+00:00 info: File "/usr/bin/anaconda", line 1131, in <module>
2015-10-27T20:35:51.627119+00:00 info: anaconda.intf.run(anaconda)
2015-10-27T20:35:51.627291+00:00 info: DBusException: org.freedesktop.DBus.Error.UnknownMethod: Method "Get" with signature "ss" on interface "org.freedesktop.DBus.Properties" doesn't exist
2015-10-27T20:35:51.627435+00:00 info:
2015-10-27T20:35:51.627590+00:00 info:

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.