docker exceeded timeout

Bug #1317513 reported by Alexandr Notchenko
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Released
Critical
Sergii Golovatiuk

Bug Description

Version info:

api: '1.0'
astute_sha: 9c83d3ecec69df03cd94620e2df92249ba4ec786
build_id: 2014-05-07_01-00-26
build_number: '184'
fuellib_sha: 616a164132a6a195b756236923bc2f4345bc93f0
fuelmain_sha: cb99264a1d5c5cd949f95a835f86ea1eb00c766f
mirantis: 'yes'
nailgun_sha: 6b5e2797dae6a3b803b3ac7102ae3d9164a013cf
ostf_sha: fe718434f88f2ab167779770828a195f06eb29f8
production: docker
release: '5.0'

"dockerctl build all" timeouts when executed by puppet

In "/var/log/puppet/bootstrap_admin_node.log":

Debug: Exec[build docker containers](provider=posix): Executing 'dockerctl build all'
Debug: Executing 'dockerctl build all'
Error: Command exceeded timeout
Error: /Stage[main]/Docker/Exec[build docker containers]/returns: change from notrun to 0 failed: Command exceeded timeout
Debug: Class[Docker]: The container Stage[main] will propagate my refresh event
Notice: /Stage[main]/Nailgun::Supervisor/File[/etc/supervisord.conf]: Dependency Exec[build docker containers] has failures: true
Warning: /Stage[main]/Nailgun::Supervisor/File[/etc/supervisord.conf]: Skipping because of failed dependencies
Notice: /Stage[main]/Nailgun::Supervisor/File[/etc/sysconfig/supervisord]: Dependency Exec[build docker containers] has failures: true
Warning: /Stage[main]/Nailgun::Supervisor/File[/etc/sysconfig/supervisord]: Skipping because of failed dependencies
Notice: /Stage[main]/Nailgun::Supervisor/File[/etc/rc.d/init.d/supervisord]: Dependency Exec[build docker containers] has failures: true
Warning: /Stage[main]/Nailgun::Supervisor/File[/etc/rc.d/init.d/supervisord]: Skipping because of failed dependencies
Notice: /Stage[main]/Nailgun::Supervisor/Service[supervisord]: Dependency Exec[build docker containers] has failures: true
Warning: /Stage[main]/Nailgun::Supervisor/Service[supervisord]: Skipping because of failed dependencies
Debug: Executing '/sbin/service supervisord status'

Replication conditions:
Host OS: Mac OS X 10.9.2
VirtualBox: 4.3.2 r90405
Fuel-main repo hash: 013578cd17d28f3745d225ea2867edfc41b134fb
no alterations to config.sh or launch.sh

Revision history for this message
Alexandr Notchenko (anotchenko) wrote :
Changed in fuel:
status: New → Confirmed
importance: Undecided → Critical
assignee: nobody → Fuel Library Team (fuel-library)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to fuel-main (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/92821

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (master)

Fix proposed to branch: master
Review: https://review.openstack.org/92825

Changed in fuel:
assignee: Fuel Library Team (fuel-library) → Vladimir Kuklin (vkuklin)
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (master)

Reviewed: https://review.openstack.org/92825
Committed: https://git.openstack.org/cgit/stackforge/fuel-library/commit/?id=d21914af1042c8942e4e32eb0d609600d782ade0
Submitter: Jenkins
Branch: master

commit d21914af1042c8942e4e32eb0d609600d782ade0
Author: Vladimir Kuklin <email address hidden>
Date: Thu May 8 17:29:39 2014 +0400

    Increase docker timeout and log build output

    Change-Id: I91157e10dba6927fc5c3b20b1ef7cfbd9419f18a
    Closes-Bug: #1317513

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
Artem Panchenko (apanchenko-8) wrote :

This issue was reproduced during Fuel CI tests:

VERSION:
  mirantis: "yes"
  production: "docker"
  release: "5.0"
  api: "1.0"
  build_number: "205"
  build_id: "2014-05-15_01-10-31"
  astute_sha: "2b19f9cda281a4e53fb4a2e241d882e29ab9724b"
  fuellib_sha: "1c7d598a65309f8bda1391360f0b94bfb5015180"
  ostf_sha: "69bdb9729cbf16d2c8ba927e946d64a8898909af"
  nailgun_sha: "0c88805f28d658be82b305eaeafc5466b563569d"
  fuelmain_sha: "fc249cd1fe62d5303f531cf00d9e31ee2ab642d2"

Debug: Executing 'dockerctl build all'
Error: Command exceeded timeout
Error: /Stage[main]/Docker/Exec[build docker containers]/returns: change from notrun to 0 failed: Command exceeded timeout

Changed in fuel:
status: Fix Committed → New
Mike Scherbakov (mihgen)
Changed in fuel:
assignee: Vladimir Kuklin (vkuklin) → Alexander Didenko (adidenko)
Changed in fuel:
assignee: Alexander Didenko (adidenko) → Sergii Golovatiuk (sgolovatiuk)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (master)

Fix proposed to branch: master
Review: https://review.openstack.org/93738

Changed in fuel:
status: New → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (master)

Reviewed: https://review.openstack.org/93738
Committed: https://git.openstack.org/cgit/stackforge/fuel-library/commit/?id=01b9ee847901b63a23b7c010fade3303e2d29be9
Submitter: Jenkins
Branch: master

commit 01b9ee847901b63a23b7c010fade3303e2d29be9
Author: Sergii Golovatiuk <email address hidden>
Date: Thu May 15 14:43:17 2014 +0000

    Increase build timeout, use builtin functions, debug mode for dockerctl

    * Increase timeout to give more time for build process on weak
    environments
    * Remove dockerctl shell invocation from function, as shell_container
    does the same
    * Enable debug mode for docker as docker -D

    Change-Id: Ice1914db7697debc4d4975180e3e89be7be084fb
    Closes-Bug: 1317513

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
Andrey Sledzinskiy (asledzinskiy) wrote :

Issue is fixed now

Changed in fuel:
status: Fix Committed → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on fuel-main (master)

Change abandoned by Vladimir Kuklin (<email address hidden>) on branch: master
Review: https://review.openstack.org/92821

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.