2016-11-10 13:04:56 +0000 Puppet (debug): Executing '/usr/bin/dpkg-query -W --showformat '${Status} ${Package} ${Version}\n' fuel-ha-utils'
2016-11-10 13:04:56 +0000 Package[fuel-ha-utils](provider=apt_fuel) (debug): Call: install
2016-11-10 13:04:56 +0000 Package[fuel-ha-utils](provider=apt_fuel) (debug): Call: wait_for_lock
apt was trying to download fuel-ha-utils package from mirror.fuel-infra.org, and it took longer than 10 minutes. Apparently astute considers that a fatal error. Moreover there are no log messages with appropriate level (error, critical). This is very confusing and should be fixed. Also, assumping that 10 minutes is enough to download any package (along with its dependencies) is very naive (to put it extremely mildly)
/var/log/remote/10.20.0.4/puppet-apply.log:
2016-11-10T13:03:39.607812+00:00 info: (Class[Osnailyfacter::Fuel_pkgs::Fuel_pkgs]) Starting to evaluate the resource
2016-11-10T13:03:39.608077+00:00 info: (Class[Osnailyfacter::Fuel_pkgs::Fuel_pkgs]) Evaluated in 0.00 seconds
2016-11-10T13:03:39.608290+00:00 debug: Prefetching apt_fuel resources for package
2016-11-10T13:03:39.608439+00:00 debug: Executing '/usr/bin/dpkg-query -W --showformat '${Status} ${Package} ${Version}\n''
2016-11-10T13:03:39.621425+00:00 info: (/Package[fuel-misc]) Starting to evaluate the resource
2016-11-10T13:03:39.621882+00:00 debug: Executing '/usr/bin/dpkg-query -W --showformat '${Status} ${Package} ${Version}\n' fuel-misc'
2016-11-10T13:03:39.645406+00:00 debug: (Package[fuel-misc](provider=apt_fuel)) Call: install
2016-11-10T13:03:39.645528+00:00 debug: (Package[fuel-misc](provider=apt_fuel)) Call: wait_for_lock
2016-11-10T13:03:39.645859+00:00 debug: (Package[fuel-misc](provider=apt_fuel)) Call: locked?
2016-11-10T13:03:39.646185+00:00 debug: Executing '/usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold install fuel-misc'
2016-11-10T13:04:56.511800+00:00 notice: (/Stage[main]/Osnailyfacter::Fuel_pkgs::Fuel_pkgs/Package[fuel-misc]/ensure) ensure changed 'purged' to 'present'
2016-11-10T13:04:56.511800+00:00 debug: (/Package[fuel-misc]) The container Class[Osnailyfacter::Fuel_pkgs::Fuel_pkgs] will propagate my refresh event
2016-11-10T13:04:56.511820+00:00 info: (/Package[fuel-misc]) Evaluated in 76.88 seconds
2016-11-10T13:04:56.511820+00:00 info: (/Package[fuel-ha-utils]) Starting to evaluate the resource
2016-11-10T13:04:56.511825+00:00 debug: Executing '/usr/bin/dpkg-query -W --showformat '${Status} ${Package} ${Version}\n' fuel-ha-utils'
2016-11-10T13:04:56.519760+00:00 debug: (Package[fuel-ha-utils](provider=apt_fuel)) Call: install
2016-11-10T13:04:56.608103+00:00 debug: (Package[fuel-ha-utils](provider=apt_fuel)) Call: wait_for_lock
2016-11-10T13:04:56.608103+00:00 debug: (Package[fuel-ha-utils](provider=apt_fuel)) Call: locked?
2016-11-10T13:04:56.608122+00:00 debug: Executing '/usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold install fuel-ha-utils'
2016-11-10T13:13:53.043323+00:00 notice: (/Stage[main]/Osnailyfacter::Fuel_pkgs::Fuel_pkgs/Package[fuel-ha-utils]/ensure) ensure changed 'purged' to 'present'
2016-11-10T13:13:53.043323+00:00 debug: (/Package[fuel-ha-utils]) The container Class[Osnailyfacter::Fuel_pkgs::Fuel_pkgs] will propagate my refresh event
2016-11-10T13:13:53.043360+00:00 info: (/Package[fuel-ha-utils]) Evaluated in 536.54 seconds
/var/log/astute/astute.log:
2016-11-10 13:13:37 DEBUG [9997] Node[3]: Node 3: task fuel_pkgs, task status running
2016-11-10 13:13:37 WARNING [9997] Puppet agent 3 didn't respond within the allotted time
2016-11-10 13:13:37 DEBUG [9997] Task time summary: fuel_pkgs with status failed on node 3 took 00:10:00
2016-11-10 13:04:56 +0000 Puppet (debug): Executing '/usr/bin/ dpkg-query -W --showformat '${Status} ${Package} ${Version}\n' fuel-ha-utils' fuel-ha- utils]( provider= apt_fuel) (debug): Call: install fuel-ha- utils]( provider= apt_fuel) (debug): Call: wait_for_lock fuel-infra. org, and it took longer than 10 minutes. Apparently astute considers that a fatal error. Moreover there are no log messages with appropriate level (error, critical). This is very confusing and should be fixed. Also, assumping that 10 minutes is enough to download any package (along with its dependencies) is very naive (to put it extremely mildly)
2016-11-10 13:04:56 +0000 Package[
2016-11-10 13:04:56 +0000 Package[
apt was trying to download fuel-ha-utils package from mirror.
/var/log/ remote/ 10.20.0. 4/puppet- apply.log:
2016-11- 10T13:03: 39.607812+ 00:00 info: (Class[ Osnailyfacter: :Fuel_pkgs: :Fuel_pkgs] ) Starting to evaluate the resource 10T13:03: 39.608077+ 00:00 info: (Class[ Osnailyfacter: :Fuel_pkgs: :Fuel_pkgs] ) Evaluated in 0.00 seconds 10T13:03: 39.608290+ 00:00 debug: Prefetching apt_fuel resources for package 10T13:03: 39.608439+ 00:00 debug: Executing '/usr/bin/ dpkg-query -W --showformat '${Status} ${Package} ${Version}\n'' 10T13:03: 39.621425+ 00:00 info: (/Package[ fuel-misc] ) Starting to evaluate the resource 10T13:03: 39.621882+ 00:00 debug: Executing '/usr/bin/ dpkg-query -W --showformat '${Status} ${Package} ${Version}\n' fuel-misc' 10T13:03: 39.645406+ 00:00 debug: (Package[ fuel-misc] (provider= apt_fuel) ) Call: install 10T13:03: 39.645528+ 00:00 debug: (Package[ fuel-misc] (provider= apt_fuel) ) Call: wait_for_lock 10T13:03: 39.645859+ 00:00 debug: (Package[ fuel-misc] (provider= apt_fuel) ) Call: locked? 10T13:03: 39.646185+ 00:00 debug: Executing '/usr/bin/apt-get -q -y -o DPkg::Options: :=--force- confold install fuel-misc' 10T13:04: 56.511800+ 00:00 notice: (/Stage[ main]/Osnailyfa cter::Fuel_ pkgs::Fuel_ pkgs/Package[ fuel-misc] /ensure) ensure changed 'purged' to 'present' 10T13:04: 56.511800+ 00:00 debug: (/Package[ fuel-misc] ) The container Class[Osnailyfa cter::Fuel_ pkgs::Fuel_ pkgs] will propagate my refresh event 10T13:04: 56.511820+ 00:00 info: (/Package[ fuel-misc] ) Evaluated in 76.88 seconds 10T13:04: 56.511820+ 00:00 info: (/Package[ fuel-ha- utils]) Starting to evaluate the resource 10T13:04: 56.511825+ 00:00 debug: Executing '/usr/bin/ dpkg-query -W --showformat '${Status} ${Package} ${Version}\n' fuel-ha-utils' 10T13:04: 56.519760+ 00:00 debug: (Package[ fuel-ha- utils]( provider= apt_fuel) ) Call: install 10T13:04: 56.608103+ 00:00 debug: (Package[ fuel-ha- utils]( provider= apt_fuel) ) Call: wait_for_lock 10T13:04: 56.608103+ 00:00 debug: (Package[ fuel-ha- utils]( provider= apt_fuel) ) Call: locked? 10T13:04: 56.608122+ 00:00 debug: Executing '/usr/bin/apt-get -q -y -o DPkg::Options: :=--force- confold install fuel-ha-utils' 10T13:13: 53.043323+ 00:00 notice: (/Stage[ main]/Osnailyfa cter::Fuel_ pkgs::Fuel_ pkgs/Package[ fuel-ha- utils]/ ensure) ensure changed 'purged' to 'present' 10T13:13: 53.043323+ 00:00 debug: (/Package[ fuel-ha- utils]) The container Class[Osnailyfa cter::Fuel_ pkgs::Fuel_ pkgs] will propagate my refresh event 10T13:13: 53.043360+ 00:00 info: (/Package[ fuel-ha- utils]) Evaluated in 536.54 seconds
2016-11-
2016-11-
2016-11-
2016-11-
2016-11-
2016-11-
2016-11-
2016-11-
2016-11-
2016-11-
2016-11-
2016-11-
2016-11-
2016-11-
2016-11-
2016-11-
2016-11-
2016-11-
2016-11-
2016-11-
2016-11-
/var/log/ astute/ astute. log:
2016-11-10 13:13:37 DEBUG [9997] Node[3]: Node 3: task fuel_pkgs, task status running
2016-11-10 13:13:37 WARNING [9997] Puppet agent 3 didn't respond within the allotted time
2016-11-10 13:13:37 DEBUG [9997] Task time summary: fuel_pkgs with status failed on node 3 took 00:10:00