Activity log for bug #1917422

Date Who What changed Old value New value Message
2021-03-02 07:12:16 Bhagyashri Shewale bug added bug
2021-03-02 07:20:37 Michele Baldessari summary [train][c7] [Errno 2] No such file or directory: '/var/log/validations/fa163e29-b18f-086b-31fc- 000000000008_deploy_steps_playbook_2021-03-01T11:47:52.384960Z.json' isfailing on c7 train sc004 [train][c7] AttributeError: 'module' object has no attribute 'run' isfailing on c7 train sc004
2021-03-02 07:20:44 Michele Baldessari summary [train][c7] AttributeError: 'module' object has no attribute 'run' isfailing on c7 train sc004 [train][c7] AttributeError: 'module' object has no attribute 'run' is failing on c7 train sc004
2021-03-02 07:51:32 Bhagyashri Shewale tags alert ci alert ci promotion-blocker
2021-03-02 08:03:15 yatin tripleo: importance High Critical
2021-03-02 10:07:05 Bhagyashri Shewale description [WARNING]: Failure using method (v2_runner_on_failed) in callback plugin (<ansible.plugins.callback.tripleo_dense.CallbackModule object at 0x7fac445cce90>): 'module' object has no attribute 'dumps' 2021-03-01 12:26:37.068770 | fa163e29-b18f-086b-31fc-00000000205b | TIMING | tripleo_ha_wrapper : Run pacemaker restart if the config file for the service changed | standalone | 0:38:44.683905 | 0.58s PLAY RECAP ********************************************************************* standalone : ok=265 changed=164 unreachable=0 failed=1 skipped=103 rescued=0 ignored=0 undercloud : ok=101 changed=34 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 2021-03-01 12:26:37.477563 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Summary Information ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2021-03-01 12:26:37.477909 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Total Tasks: 524 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2021-03-01 12:26:37.478116 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Elapsed Time: 0:38:45.093313 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2021-03-01 12:26:37.478342 | UUID | Info | Host | Task Name | Run Time 2021-03-01 12:26:37.478651 | fa163e29-b18f-086b-31fc-000000001eb3 | SUMMARY | undercloud | tripleo-ceph-run-ansible : run ceph-ansible | 726.85s 2021-03-01 12:26:37.478916 | fa163e29-b18f-086b-31fc-000000000ccf | SUMMARY | undercloud | Run tripleo-container-image-prepare logged to: /var/log/tripleo-container-image-prepare.log | 544.17s 2021-03-01 12:26:37.479275 | fa163e29-b18f-086b-31fc-000000001327 | SUMMARY | standalone | Pre-fetch all the containers | 234.16s 2021-03-01 12:26:37.480659 | fa163e29-b18f-086b-31fc-000000000510 | SUMMARY | standalone | Initialize aide database | 180.92s 2021-03-01 12:26:37.480969 | fa163e29-b18f-086b-31fc-000000001557 | SUMMARY | standalone | Wait for puppet host configuration to finish | 115.01s 2021-03-01 12:26:37.481289 | fa163e29-b18f-086b-31fc-000000000094 | SUMMARY | standalone | Run puppet on the host to apply IPtables rules | 67.56s 2021-03-01 12:26:37.481599 | fa163e29-b18f-086b-31fc-0000000015bb | SUMMARY | standalone | Wait for container-puppet tasks (generate config) to finish | 63.52s 2021-03-01 12:26:37.481800 | fa163e29-b18f-086b-31fc-00000000205a | SUMMARY | standalone | tripleo_ha_wrapper : Run init bundle puppet on the host for haproxy | 43.09s 2021-03-01 12:26:37.482024 | fa163e29-b18f-086b-31fc-00000000137b | SUMMARY | standalone | Pre-fetch all the containers | 35.50s 2021-03-01 12:26:37.482293 | fa163e29-b18f-086b-31fc-000000001566 | SUMMARY | standalone | Wait for containers to start for step 1 using paunch | 16.06s 2021-03-01 12:26:37.482591 | fa163e29-b18f-086b-31fc-00000000058f | SUMMARY | standalone | container-registry : Pause while Docker restarts | 10.21s 2021-03-01 12:26:37.482784 | fa163e29-b18f-086b-31fc-000000001335 | SUMMARY | standalone | tripleo-container-tag : Pull 192.168.24.1:8787/tripleotrain/centos-binary-haproxy:0ad7cb7c5c6a7f32f0ba2f33a944bd98f9104761_7395ccfc-updated-20210301113639 image | 8.53s 2021-03-01 12:26:37.482957 | fa163e29-b18f-086b-31fc-0000000006c2 | SUMMARY | standalone | tripleo-image-serve : ensure apache is installed | 7.98s 2021-03-01 12:26:37.483173 | fa163e29-b18f-086b-31fc-00000000004a | SUMMARY | standalone | tripleo-network-config : Run NetworkConfig script | 7.06s 2021-03-01 12:26:37.483436 | fa163e29-b18f-086b-31fc-00000000013d | SUMMARY | standalone | Gathering Facts | 6.26s 2021-03-01 12:26:37.483709 | fa163e29-b18f-086b-31fc-00000000013d | SUMMARY | undercloud | Gathering Facts | 6.10s 2021-03-01 12:26:37.483881 | fa163e29-b18f-086b-31fc-000000000160 | SUMMARY | standalone | Gathering Facts | 5.62s 2021-03-01 12:26:37.484111 | fa163e29-b18f-086b-31fc-000000000150 | SUMMARY | undercloud | Gathering Facts | 5.27s 2021-03-01 12:26:37.484377 | fa163e29-b18f-086b-31fc-000000000c15 | SUMMARY | standalone | Install tuned | 5.25s 2021-03-01 12:26:37.484826 | fa163e29-b18f-086b-31fc-000000000220 | SUMMARY | standalone | tripleo-bootstrap : Deploy required packages to bootstrap TripleO | 4.83s 2021-03-01 12:26:37.485025 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ End Summary Information ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2021-03-01 12:26:37.485238 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ State Information ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2021-03-01 12:26:37.485537 | ~~~~~~~~~~~~~~~~~~ Number of nodes which did not deploy successfully: 1 ~~~~~~~~~~~~~~~~~ 2021-03-01 12:26:37.485733 | The following node(s) had failures: standalone 2021-03-01 12:26:37.485894 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ [WARNING]: Failure using method (v2_playbook_on_stats) in callback plugin (<ansible.plugins.callback.validation_json.CallbackModule object at 0x7fac43df88d0>): [Errno 2] No such file or directory: '/var/log/validations/fa163e29-b18f-086b-31fc- 000000000008_deploy_steps_playbook_2021-03-01T11:47:52.384960Z.json' Exception: Deployment failed Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/tripleoclient/v1/tripleo_deploy.py", line 1341, in _standalone_deploy raise exceptions.DeploymentError('Deployment failed') DeploymentError: Deployment failed None ** Found ansible errors for standalone deployment! ** [ [ "Run pacemaker restart if the config file for the service changed", { "invocation": { "module_args": { "environment": { "TRIPLEO_MINOR_UPDATE": "" }, "state_file": "/var/lib/config-data/puppet-generated/haproxy.md5sum", "command": "/var/lib/container-config-scripts/pacemaker_restart_bundle.sh haproxy haproxy-bundle haproxy-bundle Started", "state_file_suffix": ".previous_run", "return_codes": [ 0 ] } }, "msg": "Unhandled exception: 'module' object has no attribute 'run'", "changed": false, "_ansible_no_log": false, "error": "Traceback (most recent call last):\n File \"/tmp/ansible_tripleo_diff_exec_payload_KaVNY7/ansible_tripleo_diff_exec_payload.zip/ansible/modules/tripleo_diff_exec.py\", line 114, in run\nAttributeError: 'module' object has no attribute 'run'\n" } ] ] Not cleaning working directory /home/zuul/tripleo-heat-installer-templates Not cleaning ansible directory /home/zuul/standalone-ansible-WEBT3Z Install artifact is located at /home/zuul/standalone-install-20210301122637.tar.bzip2 !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Deployment Failed! ERROR: Heat log files: /var/log/heat-launcher/undercloud_deploy-YGrhnY !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Deployment failed. Affected jobs: periodic-tripleo-ci-centos-7-scenario004-standalone-train Links: [1]: https://logserver.rdoproject.org/openstack-periodic-integration-stable3-centos7/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-scenario004-standalone-train/31864c0/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz [2]: https://logserver.rdoproject.org/openstack-periodic-integration-stable3-centos7/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-scenario004-standalone-train/31864c0/job-output.txt [3]: https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-integration-stable3-centos7&job_name=periodic-tripleo-ci-centos-7-scenario004-standalone-train [WARNING]: Failure using method (v2_runner_on_failed) in callback plugin (<ansible.plugins.callback.tripleo_dense.CallbackModule object at 0x7fac445cce90>): 'module' object has no attribute 'dumps' 2021-03-01 12:26:37.068770 | fa163e29-b18f-086b-31fc-00000000205b | TIMING | tripleo_ha_wrapper : Run pacemaker restart if the config file for the service changed | standalone | 0:38:44.683905 | 0.58s PLAY RECAP ********************************************************************* standalone : ok=265 changed=164 unreachable=0 failed=1 skipped=103 rescued=0 ignored=0 undercloud : ok=101 changed=34 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 2021-03-01 12:26:37.477563 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Summary Information ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2021-03-01 12:26:37.477909 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Total Tasks: 524 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2021-03-01 12:26:37.478116 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Elapsed Time: 0:38:45.093313 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2021-03-01 12:26:37.478342 | UUID | Info | Host | Task Name | Run Time 2021-03-01 12:26:37.478651 | fa163e29-b18f-086b-31fc-000000001eb3 | SUMMARY | undercloud | tripleo-ceph-run-ansible : run ceph-ansible | 726.85s 2021-03-01 12:26:37.478916 | fa163e29-b18f-086b-31fc-000000000ccf | SUMMARY | undercloud | Run tripleo-container-image-prepare logged to: /var/log/tripleo-container-image-prepare.log | 544.17s 2021-03-01 12:26:37.479275 | fa163e29-b18f-086b-31fc-000000001327 | SUMMARY | standalone | Pre-fetch all the containers | 234.16s 2021-03-01 12:26:37.480659 | fa163e29-b18f-086b-31fc-000000000510 | SUMMARY | standalone | Initialize aide database | 180.92s 2021-03-01 12:26:37.480969 | fa163e29-b18f-086b-31fc-000000001557 | SUMMARY | standalone | Wait for puppet host configuration to finish | 115.01s 2021-03-01 12:26:37.481289 | fa163e29-b18f-086b-31fc-000000000094 | SUMMARY | standalone | Run puppet on the host to apply IPtables rules | 67.56s 2021-03-01 12:26:37.481599 | fa163e29-b18f-086b-31fc-0000000015bb | SUMMARY | standalone | Wait for container-puppet tasks (generate config) to finish | 63.52s 2021-03-01 12:26:37.481800 | fa163e29-b18f-086b-31fc-00000000205a | SUMMARY | standalone | tripleo_ha_wrapper : Run init bundle puppet on the host for haproxy | 43.09s 2021-03-01 12:26:37.482024 | fa163e29-b18f-086b-31fc-00000000137b | SUMMARY | standalone | Pre-fetch all the containers | 35.50s 2021-03-01 12:26:37.482293 | fa163e29-b18f-086b-31fc-000000001566 | SUMMARY | standalone | Wait for containers to start for step 1 using paunch | 16.06s 2021-03-01 12:26:37.482591 | fa163e29-b18f-086b-31fc-00000000058f | SUMMARY | standalone | container-registry : Pause while Docker restarts | 10.21s 2021-03-01 12:26:37.482784 | fa163e29-b18f-086b-31fc-000000001335 | SUMMARY | standalone | tripleo-container-tag : Pull 192.168.24.1:8787/tripleotrain/centos-binary-haproxy:0ad7cb7c5c6a7f32f0ba2f33a944bd98f9104761_7395ccfc-updated-20210301113639 image | 8.53s 2021-03-01 12:26:37.482957 | fa163e29-b18f-086b-31fc-0000000006c2 | SUMMARY | standalone | tripleo-image-serve : ensure apache is installed | 7.98s 2021-03-01 12:26:37.483173 | fa163e29-b18f-086b-31fc-00000000004a | SUMMARY | standalone | tripleo-network-config : Run NetworkConfig script | 7.06s 2021-03-01 12:26:37.483436 | fa163e29-b18f-086b-31fc-00000000013d | SUMMARY | standalone | Gathering Facts | 6.26s 2021-03-01 12:26:37.483709 | fa163e29-b18f-086b-31fc-00000000013d | SUMMARY | undercloud | Gathering Facts | 6.10s 2021-03-01 12:26:37.483881 | fa163e29-b18f-086b-31fc-000000000160 | SUMMARY | standalone | Gathering Facts | 5.62s 2021-03-01 12:26:37.484111 | fa163e29-b18f-086b-31fc-000000000150 | SUMMARY | undercloud | Gathering Facts | 5.27s 2021-03-01 12:26:37.484377 | fa163e29-b18f-086b-31fc-000000000c15 | SUMMARY | standalone | Install tuned | 5.25s 2021-03-01 12:26:37.484826 | fa163e29-b18f-086b-31fc-000000000220 | SUMMARY | standalone | tripleo-bootstrap : Deploy required packages to bootstrap TripleO | 4.83s 2021-03-01 12:26:37.485025 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ End Summary Information ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2021-03-01 12:26:37.485238 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ State Information ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2021-03-01 12:26:37.485537 | ~~~~~~~~~~~~~~~~~~ Number of nodes which did not deploy successfully: 1 ~~~~~~~~~~~~~~~~~ 2021-03-01 12:26:37.485733 | The following node(s) had failures: standalone 2021-03-01 12:26:37.485894 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ [WARNING]: Failure using method (v2_playbook_on_stats) in callback plugin (<ansible.plugins.callback.validation_json.CallbackModule object at 0x7fac43df88d0>): [Errno 2] No such file or directory: '/var/log/validations/fa163e29-b18f-086b-31fc- 000000000008_deploy_steps_playbook_2021-03-01T11:47:52.384960Z.json' Exception: Deployment failed Traceback (most recent call last):   File "/usr/lib/python2.7/site-packages/tripleoclient/v1/tripleo_deploy.py", line 1341, in _standalone_deploy     raise exceptions.DeploymentError('Deployment failed') DeploymentError: Deployment failed None ** Found ansible errors for standalone deployment! ** [  [   "Run pacemaker restart if the config file for the service changed",   {    "invocation": {     "module_args": {      "environment": {       "TRIPLEO_MINOR_UPDATE": ""      },      "state_file": "/var/lib/config-data/puppet-generated/haproxy.md5sum",      "command": "/var/lib/container-config-scripts/pacemaker_restart_bundle.sh haproxy haproxy-bundle haproxy-bundle Started",      "state_file_suffix": ".previous_run",      "return_codes": [       0      ]     }    },    "msg": "Unhandled exception: 'module' object has no attribute 'run'",    "changed": false,    "_ansible_no_log": false,    "error": "Traceback (most recent call last):\n File \"/tmp/ansible_tripleo_diff_exec_payload_KaVNY7/ansible_tripleo_diff_exec_payload.zip/ansible/modules/tripleo_diff_exec.py\", line 114, in run\nAttributeError: 'module' object has no attribute 'run'\n"   }  ] ] Not cleaning working directory /home/zuul/tripleo-heat-installer-templates Not cleaning ansible directory /home/zuul/standalone-ansible-WEBT3Z Install artifact is located at /home/zuul/standalone-install-20210301122637.tar.bzip2 !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Deployment Failed! ERROR: Heat log files: /var/log/heat-launcher/undercloud_deploy-YGrhnY !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Deployment failed. Affected jobs: 1. periodic-tripleo-ci-centos-7-scenario004-standalone-train https://review.rdoproject.org/zuul/build/532a3ce83f194a6596e8f0413c05dcd4 : FAILURE in 1h 04m 11s 2. periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-train https://review.rdoproject.org/zuul/build/b14a97edb767428c8c55529f46d1e293 : FAILURE in 2h 51m 23s 3. periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset030-train https://review.rdoproject.org/zuul/build/2c7d6938789a4ae6bf755896f3c1919b : FAILURE in 1h 30m 24s 4. periodic-tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset020-train https://review.rdoproject.org/zuul/build/5011c74a01e64df2a95dc1dbc5f81241 : FAILURE in 2h 55m 23s 5. periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-train https://review.rdoproject.org/zuul/build/55c4b2247b40474e851243d655445897 : FAILURE in 2h 53m 00s Links: [1]: https://logserver.rdoproject.org/openstack-periodic-integration-stable3-centos7/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-scenario004-standalone-train/31864c0/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz [2]: https://logserver.rdoproject.org/openstack-periodic-integration-stable3-centos7/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-scenario004-standalone-train/31864c0/job-output.txt [3]: https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-integration-stable3-centos7&job_name=periodic-tripleo-ci-centos-7-scenario004-standalone-train
2021-03-02 10:07:14 Bhagyashri Shewale summary [train][c7] AttributeError: 'module' object has no attribute 'run' is failing on c7 train sc004 [train][c7] AttributeError: 'module' object has no attribute 'run' is failing on c7 train
2021-03-04 04:10:33 Bhagyashri Shewale tripleo: assignee Michele Baldessari (michele)
2021-03-04 04:10:39 Bhagyashri Shewale tripleo: status Triaged Fix Released