Error: error creating container storage: that ID is already in use

Bug #1863366 reported by wes hayutin
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Expired
Wishlist
Unassigned

Bug Description

https://d6153e47f52a29e2f6d9-debdb626e783b29f3d902a17e0b12b11.ssl.cf5.rackcdn.com/706572/26/check/tripleo-ci-centos-7-scenario001-standalone/d8d4ee9/logs/undercloud/home/zuul/standalone_deploy.log

020-02-14 16:55:57 | Did not find container with "['podman', 'ps', '-a', '--filter', 'label=container_name=heat_engine_db_sync', '--filter', 'label=config_id=tripleo_step3', '--format', '{{.Names}}']" - retrying without config_id
2020-02-14 16:55:57 | $ podman ps -a --filter label=container_name=heat_engine_db_sync --format {{.Names}}
2020-02-14 16:55:57 |
2020-02-14 16:55:57 |
2020-02-14 16:55:57 | Did not find container with "['podman', 'ps', '-a', '--filter', 'label=container_name=heat_engine_db_sync', '--format', '{{.Names}}']"
2020-02-14 16:55:57 | Start container heat_engine_db_sync as heat_engine_db_sync.
2020-02-14 16:55:57 | $ podman run --name heat_engine_db_sync --label config_id=tripleo_step3 --label container_name=heat_engine_db_sync --label managed_by=tripleo-Standalone --label config_data={"image": "192.168.24.1:8787/tripleomaster/centos-binary-heat-engine:67f299a819cfdde7898ce7fd0d25fba25c8a5853_10e135ca-updated-20200214155856", "environment": {"TRIPLEO_CONFIG_HASH": "9a66cf193b5bf2863b067feb2ba18bc6-9a66cf193b5bf2863b067feb2ba18bc6", "TRIPLEO_DEPLOY_IDENTIFIER": "1581696292"}, "command": "/usr/bin/bootstrap_host_exec heat_engine su heat -s /bin/bash -c 'heat-manage db_sync'", "user": "root", "volumes": ["/etc/hosts:/etc/hosts:ro", "/etc/localtime:/etc/localtime:ro", "/etc/pki/ca-trust/extracted:/etc/pki/ca-trust/extracted:ro", "/etc/pki/ca-trust/source/anchors:/etc/pki/ca-trust/source/anchors:ro", "/etc/pki/tls/certs/ca-bundle.crt:/etc/pki/tls/certs/ca-bundle.crt:ro", "/etc/pki/tls/certs/ca-bundle.trust.crt:/etc/pki/tls/certs/ca-bundle.trust.crt:ro", "/etc/pki/tls/cert.pem:/etc/pki/tls/cert.pem:ro", "/dev/log:/dev/log", "/etc/ssh/ssh_known_hosts:/etc/ssh/ssh_known_hosts:ro", "/etc/puppet:/etc/puppet:ro", "/var/log/containers/heat:/var/log/heat:z", "/var/lib/config-data/heat/etc/my.cnf.d/tripleo.cnf:/etc/my.cnf.d/tripleo.cnf:ro", "/var/lib/config-data/heat/etc/heat/:/etc/heat/:ro"], "net": "host", "detach": false, "privileged": false} --conmon-pidfile=/var/run/heat_engine_db_sync.pid --log-driver k8s-file --log-opt path=/var/log/containers/stdouts/heat_engine_db_sync.log --env=TRIPLEO_CONFIG_HASH=9a66cf193b5bf2863b067feb2ba18bc6-9a66cf193b5bf2863b067feb2ba18bc6 --env=TRIPLEO_DEPLOY_IDENTIFIER=1581696292 --net=host --privileged=false --user=root --volume=/etc/hosts:/etc/hosts:ro --volume=/etc/localtime:/etc/localtime:ro --volume=/etc/pki/ca-trust/extracted:/etc/pki/ca-trust/extracted:ro --volume=/etc/pki/ca-trust/source/anchors:/etc/pki/ca-trust/source/anchors:ro --volume=/etc/pki/tls/certs/ca-bundle.crt:/etc/pki/tls/certs/ca-bundle.crt:ro --volume=/etc/pki/tls/certs/ca-bundle.trust.crt:/etc/pki/tls/certs/ca-bundle.trust.crt:ro --volume=/etc/pki/tls/cert.pem:/etc/pki/tls/cert.pem:ro --volume=/dev/log:/dev/log --volume=/etc/ssh/ssh_known_hosts:/etc/ssh/ssh_known_hosts:ro --volume=/etc/puppet:/etc/puppet:ro --volume=/var/log/containers/heat:/var/log/heat:z --volume=/var/lib/config-data/heat/etc/my.cnf.d/tripleo.cnf:/etc/my.cnf.d/tripleo.cnf:ro --volume=/var/lib/config-data/heat/etc/heat/:/etc/heat/:ro --cpuset-cpus=0,1,2,3,4,5,6,7 192.168.24.1:8787/tripleomaster/centos-binary-heat-engine:67f299a819cfdde7898ce7fd0d25fba25c8a5853_10e135ca-updated-20200214155856 /usr/bin/bootstrap_host_exec heat_engine su heat -s /bin/bash -c 'heat-manage db_sync'
2020-02-14 16:55:57 |
2020-02-14 16:55:57 | Error: error creating container storage: that ID is already in use
2020-02-14 16:55:57 |
2020-02-14 16:55:57 | Error running ['podman', 'run', '--name', 'heat_engine_db_sync', '--label', 'config_id=tripleo_step3', '--label', 'container_name=heat_engine_db_sync', '--label', 'managed_by=tripleo-Standalone', '--label', 'config_data={"image": "192.168.24.1:8787/tripleomaster/centos-binary-heat-engine:67f299a819cfdde7898ce7fd0d25fba25c8a5853_10e135ca-updated-20200214155856", "environment": {"TRIPLEO_CONFIG_HASH": "9a66cf193b5bf2863b067feb2ba18bc6-9a66cf193b5bf2863b067feb2ba18bc6", "TRIPLEO_DEPLOY_IDENTIFIER": "1581696292"}, "command": "/usr/bin/bootstrap_host_exec heat_engine su heat -s /bin/bash -c \'heat-manage db_sync\'", "user": "root", "volumes": ["/etc/hosts:/etc/hosts:ro", "/etc/localtime:/etc/localtime:ro", "/etc/pki/ca-trust/extracted:/etc/pki/ca-trust/extracted:ro", "/etc/pki/ca-trust/source/anchors:/etc/pki/ca-trust/source/anchors:ro", "/etc/pki/tls/certs/ca-bundle.crt:/etc/pki/tls/certs/ca-bundle.crt:ro", "/etc/pki/tls/certs/ca-bundle.trust.crt:/etc/pki/tls/certs/ca-bundle.trust.crt:ro", "/etc/pki/tls/cert.pem:/etc/pki/tls/cert.pem:ro", "/dev/log:/dev/log", "/etc/ssh/ssh_known_hosts:/etc/ssh/ssh_known_hosts:ro", "/etc/puppet:/etc/puppet:ro", "/var/log/containers/heat:/var/log/heat:z", "/var/lib/config-data/heat/etc/my.cnf.d/tripleo.cnf:/etc/my.cnf.d/tripleo.cnf:ro", "/var/lib/config-data/heat/etc/heat/:/etc/heat/:ro"], "net": "host", "detach": false, "privileged": false}', '--conmon-pidfile=/var/run/heat_engine_db_sync.pid', '--log-driver', 'k8s-file', '--log-opt', 'path=/var/log/containers/stdouts/heat_engine_db_sync.log', '--env=TRIPLEO_CONFIG_HASH=9a66cf193b5bf2863b067feb2ba18bc6-9a66cf193b5bf2863b067feb2ba18bc6', '--env=TRIPLEO_DEPLOY_IDENTIFIER=1581696292', '--net=host', '--privileged=false', '--user=root', '--volume=/etc/hosts:/etc/hosts:ro', '--volume=/etc/localtime:/etc/localtime:ro', '--volume=/etc/pki/ca-trust/extracted:/etc/pki/ca-trust/extracted:ro', '--volume=/etc/pki/ca-trust/source/anchors:/etc/pki/ca-trust/source/anchors:ro', '--volume=/etc/pki/tls/certs/ca-bundle.crt:/etc/pki/tls/certs/ca-bundle.crt:ro', '--volume=/etc/pki/tls/certs/ca-bundle.trust.crt:/etc/pki/tls/certs/ca-bundle.trust.crt:ro', '--volume=/etc/pki/tls/cert.pem:/etc/pki/tls/cert.pem:ro', '--volume=/dev/log:/dev/log', '--volume=/etc/ssh/ssh_known_hosts:/etc/ssh/ssh_known_hosts:ro', '--volume=/etc/puppet:/etc/puppet:ro', '--volume=/var/log/containers/heat:/var/log/heat:z', '--volume=/var/lib/config-data/heat/etc/my.cnf.d/tripleo.cnf:/etc/my.cnf.d/tripleo.cnf:ro', '--volume=/var/lib/config-data/heat/etc/heat/:/etc/heat/:ro', '--cpuset-cpus=0,1,2,3,4,5,6,7', '192.168.24.1:8787/tripleomaster/centos-binary-heat-engine:67f299a819cfdde7898ce7fd0d25fba25c8a5853_10e135ca-updated-20200214155856', '/usr/bin/bootstrap_host_exec', 'heat_engine', 'su', 'heat', '-s', '/bin/bash', '-c', "'heat-manage", "db_sync'"]. [125]
2020-02-14 16:55:57 |
2020-02-14 16:55:57 | stdout:
2020-02-14 16:55:57 | stderr: Error: error creating container storage: that ID is already in use
2020-02-14 16:55:57 |
2020-02-14 16:55:57 | Running container: placement_api_db_extract_data_from_nova_api
2020-02-14 16:55:57 | $ podman ps -a --filter label=container_name=placement_api_db_extract_data_from_nova_api --filter label=config_id=tripleo_step3 --format {{.Names}}
2020-02-14 16:55:57 |
2020-02-14 16:55:57 |
2020-02-14 16:55:57 | Did not find container with "['podman', 'ps', '-a', '--filter', 'label=container_name=placement_api_db_extract_data_from_nova_api', '--filter', 'label=config_id=tripleo_step3', '--format', '{{.Names}}']" - retrying without config_id
2020-02-14 16:55:57 | $ podman ps -a --filter label=container_name=placement_api_db_extract_data_from_nova_api --format {{.Names}}
2020-02-14 16:55:57 |
2020-02-14 16:55:57 |
2020-02-14 16:55:57 | Did not find container with "['podman', 'ps', '-a', '--filter', 'label=container_name=placement_api_db_extract_data_from_nova_api', '--format', '{{.Names}}']"

Tags: alert
Revision history for this message
Bogdan Dobrelya (bogdando) wrote :

This error does not belong to paunch, it comes from podman container runtime subsystem. But there is no errors in journal neither any logs captured for the affected container create/run steps elsewhere. Hard to debug, should be reproduced.

wes hayutin (weshayutin)
Changed in tripleo:
status: Triaged → Incomplete
wes hayutin (weshayutin)
Changed in tripleo:
milestone: ussuri-3 → ussuri-rc3
wes hayutin (weshayutin)
Changed in tripleo:
milestone: ussuri-rc3 → victoria-1
Changed in tripleo:
milestone: victoria-1 → victoria-3
Revision history for this message
Kevin Carter (kevin-carter) wrote :

moved to wishlist, please change priority should this ever be reproduced.

Changed in tripleo:
importance: Critical → Wishlist
Changed in tripleo:
milestone: victoria-3 → wallaby-1
Changed in tripleo:
milestone: wallaby-1 → wallaby-2
Changed in tripleo:
milestone: wallaby-2 → wallaby-3
Revision history for this message
Marios Andreou (marios-b) wrote :

Bug status has been set to 'Incomplete' and target milestone has been removed due to inactivity. If you disagree please re-set these values and reach out to us on freenode #tripleo

Changed in tripleo:
milestone: wallaby-3 → none
Revision history for this message
Launchpad Janitor (janitor) wrote :

[Expired for tripleo because there has been no activity for 60 days.]

Changed in tripleo:
status: Incomplete → Expired
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.