Activity log for bug #2013330

Date Who What changed Old value New value Message
2023-03-30 11:06:25 Ananya Banerjee bug added bug
2023-03-30 11:06:32 Ananya Banerjee tripleo: status New Triaged
2023-03-30 11:06:54 Ananya Banerjee tripleo: milestone zed-1
2023-03-30 11:06:58 Ananya Banerjee tripleo: importance Undecided Critical
2023-03-30 11:07:08 Ananya Banerjee tags ci promotion-blocker
2023-03-30 11:18:54 Ananya Banerjee summary OVB jobs in master (fs64 and fs39) are failing task Manage container systemd services and cleanup old systemd healthchecks in overcloud deploy OVB jobs in master (fs64 and fs39) are failing after task Manage container systemd services and cleanup old systemd healthchecks in overcloud deploy
2023-03-30 11:19:08 Ananya Banerjee description periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset039-master and periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset064-master are failing overcloud deploy at task: Manage container systemd services and cleanup old systemd healthchecks 2023-03-30 09:27:47 | 2023-03-30 09:27:47.524678 | fa163e3c-8b9e-52ed-4a66-00000000c6f7 | TIMING | tripleo_container_manage : Manage container systemd services and cleanup old systemd healthchecks for /var/lib/tripleo-config/container-startup-config/step_1 | overcloud1-controller-1 | 0:26:11.791374 | 3.04s 2023-03-30 09:27:47 | 2023-03-30 09:27:47.577259 | fa163e3c-8b9e-52ed-4a66-00000000c120 | TASK | Clean container_puppet_tasks for overcloud1-controller-1 step 1 2023-03-30 09:27:47 | 2023-03-30 09:27:47.871437 | fa163e3c-8b9e-52ed-4a66-00000000c120 | OK | Clean container_puppet_tasks for overcloud1-controller-1 step 1 | overcloud1-controller-1 2023-03-30 09:27:47 | 2023-03-30 09:27:47.871913 | fa163e3c-8b9e-52ed-4a66-00000000c120 | TIMING | Clean container_puppet_tasks for overcloud1-controller-1 step 1 | overcloud1-controller-1 | 0:26:12.138618 | 0.29s 2023-03-30 09:27:47 | 2023-03-30 09:27:47.903527 | fa163e3c-8b9e-52ed-4a66-00000000c121 | TASK | Calculate container_puppet_tasks for overcloud1-controller-1 step 1 2023-03-30 09:27:47 | 2023-03-30 09:27:47.944675 | fa163e3c-8b9e-52ed-4a66-00000000c121 | TIMING | Calculate container_puppet_tasks for overcloud1-controller-1 step 1 | overcloud1-controller-1 | 0:26:12.211366 | 0.04s 2023-03-30 09:27:47 | 2023-03-30 09:27:47.964093 | fa163e3c-8b9e-52ed-4a66-00000000c122 | TASK | Include container-puppet tasks for step 1 2023-03-30 09:27:48 | 2023-03-30 09:27:48.010462 | fa163e3c-8b9e-52ed-4a66-00000000c122 | TIMING | Include container-puppet tasks for step 1 | overcloud1-controller-1 | 0:26:12.277155 | 0.05s 2023-03-30 09:27:48 | 2023-03-30 09:27:48.030539 | ec3343ad-53ec-444f-8139-33a9b9f3a27b | INCLUDED | /home/zuul/overcloud-deploy/overcloud1/config-download/overcloud1/host-container-puppet-tasks.yaml | overcloud1-controller-1 2023-03-30 09:27:48 | 2023-03-30 09:27:48.056605 | fa163e3c-8b9e-52ed-4a66-00000000c79c | TASK | Write container-puppet-tasks json file for overcloud1-controller-1 step 1 2023-03-30 09:27:48 | 2023-03-30 09:27:48.914943 | fa163e3c-8b9e-52ed-4a66-00000000c79c | CHANGED | Write container-puppet-tasks json file for overcloud1-controller-1 step 1 | overcloud1-controller-1 2023-03-30 09:27:48 | 2023-03-30 09:27:48.915421 | fa163e3c-8b9e-52ed-4a66-00000000c79c | TIMING | Write container-puppet-tasks json file for overcloud1-controller-1 step 1 | overcloud1-controller-1 | 0:26:13.182126 | 0.86s 2023-03-30 09:27:48 | 2023-03-30 09:27:48.932337 | fa163e3c-8b9e-52ed-4a66-00000000c79e | TASK | Generate container puppet configs for step 1 2023-03-30 09:27:49 | 2023-03-30 09:27:49.234251 | fa163e3c-8b9e-52ed-4a66-00000000c79e | OK | Generate container puppet configs for step 1 | overcloud1-controller-1 2023-03-30 09:27:49 | 2023-03-30 09:27:49.235999 | fa163e3c-8b9e-52ed-4a66-00000000c79e | TIMING | Generate container puppet configs for step 1 | overcloud1-controller-1 | 0:26:13.502697 | 0.30s 2023-03-30 09:27:49 | 2023-03-30 09:27:49.255954 | fa163e3c-8b9e-52ed-4a66-00000000c79f | TASK | Manage Puppet containers (bootstrap tasks) for step 1 2023-03-30 09:27:49 | 2023-03-30 09:27:49.592888 | fa163e3c-8b9e-52ed-4a66-00000000c79f | CHANGED | Manage Puppet containers (bootstrap tasks) for step 1 | overcloud1-controller-1 2023-03-30 09:27:49 | 2023-03-30 09:27:49.594754 | fa163e3c-8b9e-52ed-4a66-00000000c79f | TIMING | Manage Puppet containers (bootstrap tasks) for step 1 | overcloud1-controller-1 | 0:26:13.861459 | 0.34s Logs: https://logserver.rdoproject.org/74/47974/6/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset039-master/704feb8/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz https://logserver.rdoproject.org/74/47974/6/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset064-master/beba158/logs/undercloud/home/zuul/overcloud1_deploy.log.txt.gz We aee seeing this from 2023-03-29 03:57:24 periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset039-master and periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset064-master are failing overcloud deploy after task: Manage container systemd services and cleanup old systemd healthchecks 2023-03-30 09:27:47 | 2023-03-30 09:27:47.524678 | fa163e3c-8b9e-52ed-4a66-00000000c6f7 | TIMING | tripleo_container_manage : Manage container systemd services and cleanup old systemd healthchecks for /var/lib/tripleo-config/container-startup-config/step_1 | overcloud1-controller-1 | 0:26:11.791374 | 3.04s 2023-03-30 09:27:47 | 2023-03-30 09:27:47.577259 | fa163e3c-8b9e-52ed-4a66-00000000c120 | TASK | Clean container_puppet_tasks for overcloud1-controller-1 step 1 2023-03-30 09:27:47 | 2023-03-30 09:27:47.871437 | fa163e3c-8b9e-52ed-4a66-00000000c120 | OK | Clean container_puppet_tasks for overcloud1-controller-1 step 1 | overcloud1-controller-1 2023-03-30 09:27:47 | 2023-03-30 09:27:47.871913 | fa163e3c-8b9e-52ed-4a66-00000000c120 | TIMING | Clean container_puppet_tasks for overcloud1-controller-1 step 1 | overcloud1-controller-1 | 0:26:12.138618 | 0.29s 2023-03-30 09:27:47 | 2023-03-30 09:27:47.903527 | fa163e3c-8b9e-52ed-4a66-00000000c121 | TASK | Calculate container_puppet_tasks for overcloud1-controller-1 step 1 2023-03-30 09:27:47 | 2023-03-30 09:27:47.944675 | fa163e3c-8b9e-52ed-4a66-00000000c121 | TIMING | Calculate container_puppet_tasks for overcloud1-controller-1 step 1 | overcloud1-controller-1 | 0:26:12.211366 | 0.04s 2023-03-30 09:27:47 | 2023-03-30 09:27:47.964093 | fa163e3c-8b9e-52ed-4a66-00000000c122 | TASK | Include container-puppet tasks for step 1 2023-03-30 09:27:48 | 2023-03-30 09:27:48.010462 | fa163e3c-8b9e-52ed-4a66-00000000c122 | TIMING | Include container-puppet tasks for step 1 | overcloud1-controller-1 | 0:26:12.277155 | 0.05s 2023-03-30 09:27:48 | 2023-03-30 09:27:48.030539 | ec3343ad-53ec-444f-8139-33a9b9f3a27b | INCLUDED | /home/zuul/overcloud-deploy/overcloud1/config-download/overcloud1/host-container-puppet-tasks.yaml | overcloud1-controller-1 2023-03-30 09:27:48 | 2023-03-30 09:27:48.056605 | fa163e3c-8b9e-52ed-4a66-00000000c79c | TASK | Write container-puppet-tasks json file for overcloud1-controller-1 step 1 2023-03-30 09:27:48 | 2023-03-30 09:27:48.914943 | fa163e3c-8b9e-52ed-4a66-00000000c79c | CHANGED | Write container-puppet-tasks json file for overcloud1-controller-1 step 1 | overcloud1-controller-1 2023-03-30 09:27:48 | 2023-03-30 09:27:48.915421 | fa163e3c-8b9e-52ed-4a66-00000000c79c | TIMING | Write container-puppet-tasks json file for overcloud1-controller-1 step 1 | overcloud1-controller-1 | 0:26:13.182126 | 0.86s 2023-03-30 09:27:48 | 2023-03-30 09:27:48.932337 | fa163e3c-8b9e-52ed-4a66-00000000c79e | TASK | Generate container puppet configs for step 1 2023-03-30 09:27:49 | 2023-03-30 09:27:49.234251 | fa163e3c-8b9e-52ed-4a66-00000000c79e | OK | Generate container puppet configs for step 1 | overcloud1-controller-1 2023-03-30 09:27:49 | 2023-03-30 09:27:49.235999 | fa163e3c-8b9e-52ed-4a66-00000000c79e | TIMING | Generate container puppet configs for step 1 | overcloud1-controller-1 | 0:26:13.502697 | 0.30s 2023-03-30 09:27:49 | 2023-03-30 09:27:49.255954 | fa163e3c-8b9e-52ed-4a66-00000000c79f | TASK | Manage Puppet containers (bootstrap tasks) for step 1 2023-03-30 09:27:49 | 2023-03-30 09:27:49.592888 | fa163e3c-8b9e-52ed-4a66-00000000c79f | CHANGED | Manage Puppet containers (bootstrap tasks) for step 1 | overcloud1-controller-1 2023-03-30 09:27:49 | 2023-03-30 09:27:49.594754 | fa163e3c-8b9e-52ed-4a66-00000000c79f | TIMING | Manage Puppet containers (bootstrap tasks) for step 1 | overcloud1-controller-1 | 0:26:13.861459 | 0.34s Logs: https://logserver.rdoproject.org/74/47974/6/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset039-master/704feb8/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz https://logserver.rdoproject.org/74/47974/6/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset064-master/beba158/logs/undercloud/home/zuul/overcloud1_deploy.log.txt.gz We aee seeing this from 2023-03-29 03:57:24
2023-03-30 12:31:17 Ananya Banerjee summary OVB jobs in master (fs64 and fs39) are failing after task Manage container systemd services and cleanup old systemd healthchecks in overcloud deploy No such file or directory @ rb_sysopen - /etc/systemd/system/virtproxyd-tls.socket in container-puppet-nova_libvirt
2023-03-30 12:32:35 Ananya Banerjee description periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset039-master and periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset064-master are failing overcloud deploy after task: Manage container systemd services and cleanup old systemd healthchecks 2023-03-30 09:27:47 | 2023-03-30 09:27:47.524678 | fa163e3c-8b9e-52ed-4a66-00000000c6f7 | TIMING | tripleo_container_manage : Manage container systemd services and cleanup old systemd healthchecks for /var/lib/tripleo-config/container-startup-config/step_1 | overcloud1-controller-1 | 0:26:11.791374 | 3.04s 2023-03-30 09:27:47 | 2023-03-30 09:27:47.577259 | fa163e3c-8b9e-52ed-4a66-00000000c120 | TASK | Clean container_puppet_tasks for overcloud1-controller-1 step 1 2023-03-30 09:27:47 | 2023-03-30 09:27:47.871437 | fa163e3c-8b9e-52ed-4a66-00000000c120 | OK | Clean container_puppet_tasks for overcloud1-controller-1 step 1 | overcloud1-controller-1 2023-03-30 09:27:47 | 2023-03-30 09:27:47.871913 | fa163e3c-8b9e-52ed-4a66-00000000c120 | TIMING | Clean container_puppet_tasks for overcloud1-controller-1 step 1 | overcloud1-controller-1 | 0:26:12.138618 | 0.29s 2023-03-30 09:27:47 | 2023-03-30 09:27:47.903527 | fa163e3c-8b9e-52ed-4a66-00000000c121 | TASK | Calculate container_puppet_tasks for overcloud1-controller-1 step 1 2023-03-30 09:27:47 | 2023-03-30 09:27:47.944675 | fa163e3c-8b9e-52ed-4a66-00000000c121 | TIMING | Calculate container_puppet_tasks for overcloud1-controller-1 step 1 | overcloud1-controller-1 | 0:26:12.211366 | 0.04s 2023-03-30 09:27:47 | 2023-03-30 09:27:47.964093 | fa163e3c-8b9e-52ed-4a66-00000000c122 | TASK | Include container-puppet tasks for step 1 2023-03-30 09:27:48 | 2023-03-30 09:27:48.010462 | fa163e3c-8b9e-52ed-4a66-00000000c122 | TIMING | Include container-puppet tasks for step 1 | overcloud1-controller-1 | 0:26:12.277155 | 0.05s 2023-03-30 09:27:48 | 2023-03-30 09:27:48.030539 | ec3343ad-53ec-444f-8139-33a9b9f3a27b | INCLUDED | /home/zuul/overcloud-deploy/overcloud1/config-download/overcloud1/host-container-puppet-tasks.yaml | overcloud1-controller-1 2023-03-30 09:27:48 | 2023-03-30 09:27:48.056605 | fa163e3c-8b9e-52ed-4a66-00000000c79c | TASK | Write container-puppet-tasks json file for overcloud1-controller-1 step 1 2023-03-30 09:27:48 | 2023-03-30 09:27:48.914943 | fa163e3c-8b9e-52ed-4a66-00000000c79c | CHANGED | Write container-puppet-tasks json file for overcloud1-controller-1 step 1 | overcloud1-controller-1 2023-03-30 09:27:48 | 2023-03-30 09:27:48.915421 | fa163e3c-8b9e-52ed-4a66-00000000c79c | TIMING | Write container-puppet-tasks json file for overcloud1-controller-1 step 1 | overcloud1-controller-1 | 0:26:13.182126 | 0.86s 2023-03-30 09:27:48 | 2023-03-30 09:27:48.932337 | fa163e3c-8b9e-52ed-4a66-00000000c79e | TASK | Generate container puppet configs for step 1 2023-03-30 09:27:49 | 2023-03-30 09:27:49.234251 | fa163e3c-8b9e-52ed-4a66-00000000c79e | OK | Generate container puppet configs for step 1 | overcloud1-controller-1 2023-03-30 09:27:49 | 2023-03-30 09:27:49.235999 | fa163e3c-8b9e-52ed-4a66-00000000c79e | TIMING | Generate container puppet configs for step 1 | overcloud1-controller-1 | 0:26:13.502697 | 0.30s 2023-03-30 09:27:49 | 2023-03-30 09:27:49.255954 | fa163e3c-8b9e-52ed-4a66-00000000c79f | TASK | Manage Puppet containers (bootstrap tasks) for step 1 2023-03-30 09:27:49 | 2023-03-30 09:27:49.592888 | fa163e3c-8b9e-52ed-4a66-00000000c79f | CHANGED | Manage Puppet containers (bootstrap tasks) for step 1 | overcloud1-controller-1 2023-03-30 09:27:49 | 2023-03-30 09:27:49.594754 | fa163e3c-8b9e-52ed-4a66-00000000c79f | TIMING | Manage Puppet containers (bootstrap tasks) for step 1 | overcloud1-controller-1 | 0:26:13.861459 | 0.34s Logs: https://logserver.rdoproject.org/74/47974/6/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset039-master/704feb8/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz https://logserver.rdoproject.org/74/47974/6/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset064-master/beba158/logs/undercloud/home/zuul/overcloud1_deploy.log.txt.gz We aee seeing this from 2023-03-29 03:57:24 periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset039-master and periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset064-master are failing overcloud deploy FATAL | Manage Puppet containers (generate config) for step 1 | overcloud-novacompute-0 | error={"changed": false, "msg": "Failed containers: container-puppet-nova_libvirt"} https://logserver.rdoproject.org/74/47974/5/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset039-master/8fbba80/logs/overcloud-novacompute-0/var/log/containers/stdouts/container-puppet-nova_libvirt.log.txt.gz https://logserver.rdoproject.org/74/47974/6/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset039-master/704feb8/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz We are seeing this from 2023-03-29 03:57:24
2023-04-03 08:23:31 Marios Andreou tripleo: status Triaged Won't Fix