Comment 3 for bug 1640814

Revision history for this message
Alexei Sheplyakov (asheplyakov) wrote : Re: deployment fails: Failed tasks: Task[fuel_pkgs/1], Task[fuel_pkgs/3], Task[fuel_pkgs/5], ...

2016-11-10 13:04:56 +0000 Puppet (debug): Executing '/usr/bin/dpkg-query -W --showformat '${Status} ${Package} ${Version}\n' fuel-ha-utils'
2016-11-10 13:04:56 +0000 Package[fuel-ha-utils](provider=apt_fuel) (debug): Call: install
2016-11-10 13:04:56 +0000 Package[fuel-ha-utils](provider=apt_fuel) (debug): Call: wait_for_lock
apt was trying to download fuel-ha-utils package from mirror.fuel-infra.org, and it took longer than 10 minutes. Apparently astute considers that a fatal error. Moreover there are no log messages with appropriate level (error, critical). This is very confusing and should be fixed. Also, assumping that 10 minutes is enough to download any package (along with its dependencies) is very naive (to put it extremely mildly)

/var/log/remote/10.20.0.4/puppet-apply.log:

2016-11-10T13:03:39.607812+00:00 info: (Class[Osnailyfacter::Fuel_pkgs::Fuel_pkgs]) Starting to evaluate the resource
2016-11-10T13:03:39.608077+00:00 info: (Class[Osnailyfacter::Fuel_pkgs::Fuel_pkgs]) Evaluated in 0.00 seconds
2016-11-10T13:03:39.608290+00:00 debug: Prefetching apt_fuel resources for package
2016-11-10T13:03:39.608439+00:00 debug: Executing '/usr/bin/dpkg-query -W --showformat '${Status} ${Package} ${Version}\n''
2016-11-10T13:03:39.621425+00:00 info: (/Package[fuel-misc]) Starting to evaluate the resource
2016-11-10T13:03:39.621882+00:00 debug: Executing '/usr/bin/dpkg-query -W --showformat '${Status} ${Package} ${Version}\n' fuel-misc'
2016-11-10T13:03:39.645406+00:00 debug: (Package[fuel-misc](provider=apt_fuel)) Call: install
2016-11-10T13:03:39.645528+00:00 debug: (Package[fuel-misc](provider=apt_fuel)) Call: wait_for_lock
2016-11-10T13:03:39.645859+00:00 debug: (Package[fuel-misc](provider=apt_fuel)) Call: locked?
2016-11-10T13:03:39.646185+00:00 debug: Executing '/usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold install fuel-misc'
2016-11-10T13:04:56.511800+00:00 notice: (/Stage[main]/Osnailyfacter::Fuel_pkgs::Fuel_pkgs/Package[fuel-misc]/ensure) ensure changed 'purged' to 'present'
2016-11-10T13:04:56.511800+00:00 debug: (/Package[fuel-misc]) The container Class[Osnailyfacter::Fuel_pkgs::Fuel_pkgs] will propagate my refresh event
2016-11-10T13:04:56.511820+00:00 info: (/Package[fuel-misc]) Evaluated in 76.88 seconds
2016-11-10T13:04:56.511820+00:00 info: (/Package[fuel-ha-utils]) Starting to evaluate the resource
2016-11-10T13:04:56.511825+00:00 debug: Executing '/usr/bin/dpkg-query -W --showformat '${Status} ${Package} ${Version}\n' fuel-ha-utils'
2016-11-10T13:04:56.519760+00:00 debug: (Package[fuel-ha-utils](provider=apt_fuel)) Call: install
2016-11-10T13:04:56.608103+00:00 debug: (Package[fuel-ha-utils](provider=apt_fuel)) Call: wait_for_lock
2016-11-10T13:04:56.608103+00:00 debug: (Package[fuel-ha-utils](provider=apt_fuel)) Call: locked?
2016-11-10T13:04:56.608122+00:00 debug: Executing '/usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold install fuel-ha-utils'
2016-11-10T13:13:53.043323+00:00 notice: (/Stage[main]/Osnailyfacter::Fuel_pkgs::Fuel_pkgs/Package[fuel-ha-utils]/ensure) ensure changed 'purged' to 'present'
2016-11-10T13:13:53.043323+00:00 debug: (/Package[fuel-ha-utils]) The container Class[Osnailyfacter::Fuel_pkgs::Fuel_pkgs] will propagate my refresh event
2016-11-10T13:13:53.043360+00:00 info: (/Package[fuel-ha-utils]) Evaluated in 536.54 seconds

/var/log/astute/astute.log:

2016-11-10 13:13:37 DEBUG [9997] Node[3]: Node 3: task fuel_pkgs, task status running
2016-11-10 13:13:37 WARNING [9997] Puppet agent 3 didn't respond within the allotted time
2016-11-10 13:13:37 DEBUG [9997] Task time summary: fuel_pkgs with status failed on node 3 took 00:10:00