Activity log for bug #1796764

Date Who What changed Old value New value Message
2018-10-08 21:50:49 wes hayutin bug added bug
2018-10-09 10:51:05 Marios Andreou tags alert promotion-blocker
2018-10-09 12:17:47 Marios Andreou tags alert ci promotion-blocker
2018-10-09 12:22:33 Marios Andreou description INFO:tripleo_common.image.image_uploader:Playbook: - hosts: localhost tasks: - import_role: name: tripleo-modify-image name: Import role tripleo-modify-image vars: container_build_tool: docker modified_append_tag: -updated-20181008200808 source_image: docker.io/tripleomaster/centos-binary-mariadb:current-tripleo target_image: 192.168.24.1:8787/tripleomaster/centos-binary-mariadb:current-tripleo tasks_from: yum_update.yml update_repo: gating-repo,delorean-current yum_repos_dir_path: /etc/yum.repos.d INFO:tripleo_common.actions.ansible:Running ansible-playbook command: ['ansible-playbook', '-vvv', '/tmp/tripleo-modify-image-playbook-BNg2Jf/playbook.yaml'] INFO:tripleo_common.image.image_uploader:Pulling docker.io/tripleomaster/centos-binary-mistral-api ERROR:tripleo_common.image.image_uploader:ansible-playbook 2.5.2 config file = /tmp/tripleo-modify-image-playbook-BNg2Jf/ansible.cfg configured module search path = [u'/usr/lib/python2.7/site-packages/ara/plugins/modules'] ansible python module location = /usr/lib/python2.7/site-packages/ansible executable location = /bin/ansible-playbook python version = 2.7.5 (default, Jul 13 2018, 13:06:57) [GCC 4.8.5 20150623 (Red Hat 4.8.5-28)] Using /tmp/tripleo-modify-image-playbook-BNg2Jf/ansible.cfg as config file Parsed /etc/ansible/hosts inventory source with ini plugin statically imported: /usr/share/ansible/roles/tripleo-modify-image/tasks/precheck.yml statically imported: /usr/share/ansible/roles/tripleo-modify-image/tasks/yum_update.yml statically imported: /usr/share/ansible/roles/tripleo-modify-image/tasks/precheck.yml statically imported: /usr/share/ansible/roles/tripleo-modify-image/tasks/get_original_user.yml the full traceback was: Traceback (most recent call last): File "/bin/ansible-playbook", line 118, in <module> exit_code = cli.run() File "/usr/lib/python2.7/site-packages/ansible/cli/playbook.py", line 122, in run results = pbex.run() File "/usr/lib/python2.7/site-packages/ansible/executor/playbook_executor.py", line 89, in run self._tqm.load_callbacks() File "/usr/lib/python2.7/site-packages/ansible/executor/task_queue_manager.py", line 190, in load_callbacks for callback_plugin in callback_loader.all(class_only=True): File "/usr/lib/python2.7/site-packages/ansible/plugins/loader.py", line 435, in all module = self._load_module_source(name, path) File "/usr/lib/python2.7/site-packages/ansible/plugins/loader.py", line 345, in _load_module_source module = imp.load_source(full_name, path, module_file) File "/usr/lib/python2.7/site-packages/ara/plugins/callbacks/log_ara.py", line 41, in <module> app = create_app() File "/usr/lib/python2.7/site-packages/ara/webapp.py", line 68, in create_app configure_db(app) File "/usr/lib/python2.7/site-packages/ara/webapp.py", line 264, in configure_db if len(inspector.get_table_names()) == 0: File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/reflection.py", line 201, in get_table_names self.bind, schema, info_cache=self.info_cache) File "<string>", line 2, in get_table_names File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/reflection.py", line 54, in cache ret = fn(self, con, *args, **kw) File "/usr/lib64/python2.7/site-packages/sqlalchemy/dialects/sqlite/base.py", line 1160, in get_table_names rs = connection.execute(s) File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 2075, in execute return connection.execute(statement, *multiparams, **params) File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 942, in execute return self._execute_text(object, multiparams, params) File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1104, in _execute_text statement, parameters File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1200, in _execute_context context) File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1413, in _handle_dbapi_exception exc_info File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause reraise(type(exception), exception, tb=exc_tb, cause=cause) File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1193, in _execute_context context) File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/default.py", line 507, in do_execute cursor.execute(statement, parameters) OperationalError: (sqlite3.OperationalError) database is locked [SQL: "SELECT name FROM sqlite_master WHERE type='table' ORDER BY name"] (Background on this error at: http://sqlalche.me/e/e3q8) Error running playbook in directory: /tmp/tripleo-modify-image-playbook-BNg2Jf http://logs.openstack.org/64/604664/1/gate/tripleo-ci-centos-7-containers-multinode/3f8c81e/logs/undercloud/home/zuul/install-undercloud.log.txt.gz The undercloud install is failing with a trace like 2018-10-09 10:05:53.031 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] [WARNING]: Consider using 'become', 'become_method', and 'become_user' rather 2018-10-09 10:05:53.032 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] than running sudo 2018-10-09 10:05:53.032 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] fatal: [undercloud]: FAILED! => {"changed": true, "cmd": "sudo /usr/bin/tripleo-container-image-prepare --roles-file /tmp/ansible.omzIHE-role-data --environment-file /tmp/ansible.0wn0Wj-prepare-param --cleanup partial 2> ../install-undercloud.log", "delta": "0:09:05.581756", "end": "2018-10-09 10:05:52.989193", "msg": "non-zero return code", "rc": 1, "start": "2018-10-09 09:56:47.407437", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2018-10-09 10:05:53.102 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] 2018-10-09 10:05:53.102 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] NO MORE HOSTS LEFT ************************************************************* 2018-10-09 10:05:53.104 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] 2018-10-09 10:05:53.104 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] PLAY RECAP ********************************************************************* 2018-10-09 10:05:53.104 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] undercloud : ok=201 changed=100 unreachable=0 failed=1 2018-10-09 10:05:53.104 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] 2018-10-09 10:05:54.471 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] Not cleaning working directory /home/zuul/tripleo-heat-installer-templates 2018-10-09 10:05:54.505 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] Not cleaning ansible directory /home/zuul/undercloud-ansible-KT0LgE 2018-10-09 10:05:54.525 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] Install artifact is located at /home/zuul/undercloud-install-20181009100553.tar.bzip2 2018-10-09 10:05:54.526 19140 ERROR tripleoclient.v1.tripleo_deploy.Deploy [ ] !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Deployment Failed! ERROR: Heat log files: /var/log/heat-launcher/undercloud_deploy-C7bRh1 ... Traceback (most recent call last): File "/bin/ansible-playbook", line 118, in <module> exit_code = cli.run() File "/usr/lib/python2.7/site-packages/ansible/cli/playbook.py", line 122, in run results = pbex.run() ... File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause reraise(type(exception), exception, tb=exc_tb, cause=cause) File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1193, in _execute_context context) File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/default.py", line 507, in do_execute cursor.execute(statement, parameters) OperationalError: (sqlite3.OperationalError) database is locked [SQL: "SELECT name FROM sqlite_master WHERE type='table' ORDER BY name"] (Background on this error at: http://sqlalche.me/e/e3q8) Error running playbook in directory: /tmp/tripleo-modify-image-playbook-BNg2Jf many examples like * http://logs.openstack.org/50/604750/3/gate/tripleo-ci-centos-7-containers-multinode/4405b2b/logs/undercloud/home/zuul/install-undercloud.log.txt.gz#_2018-10-09_10_05_53_032 * http://logs.openstack.org/64/604664/1/gate/tripleo-ci-centos-7-containers-multinode/3f8c81e/logs/undercloud/home/zuul/install-undercloud.log.txt.gz#_2018-10-08_20_46_55_914
2018-10-09 12:23:52 Marios Andreou summary OperationalError: (sqlite3.OperationalError) database is locked [SQL: "SELECT name FROM sqlite_master WHERE type='table' ORDER BY name"] (Background on this error at: http://sqlalche.me/e/e3q8) undercloud install failing for containers-multinode in the gate "OperationalError: (sqlite3.OperationalError) database is locked "
2018-10-09 12:39:43 Marios Andreou description The undercloud install is failing with a trace like 2018-10-09 10:05:53.031 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] [WARNING]: Consider using 'become', 'become_method', and 'become_user' rather 2018-10-09 10:05:53.032 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] than running sudo 2018-10-09 10:05:53.032 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] fatal: [undercloud]: FAILED! => {"changed": true, "cmd": "sudo /usr/bin/tripleo-container-image-prepare --roles-file /tmp/ansible.omzIHE-role-data --environment-file /tmp/ansible.0wn0Wj-prepare-param --cleanup partial 2> ../install-undercloud.log", "delta": "0:09:05.581756", "end": "2018-10-09 10:05:52.989193", "msg": "non-zero return code", "rc": 1, "start": "2018-10-09 09:56:47.407437", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2018-10-09 10:05:53.102 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] 2018-10-09 10:05:53.102 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] NO MORE HOSTS LEFT ************************************************************* 2018-10-09 10:05:53.104 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] 2018-10-09 10:05:53.104 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] PLAY RECAP ********************************************************************* 2018-10-09 10:05:53.104 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] undercloud : ok=201 changed=100 unreachable=0 failed=1 2018-10-09 10:05:53.104 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] 2018-10-09 10:05:54.471 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] Not cleaning working directory /home/zuul/tripleo-heat-installer-templates 2018-10-09 10:05:54.505 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] Not cleaning ansible directory /home/zuul/undercloud-ansible-KT0LgE 2018-10-09 10:05:54.525 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] Install artifact is located at /home/zuul/undercloud-install-20181009100553.tar.bzip2 2018-10-09 10:05:54.526 19140 ERROR tripleoclient.v1.tripleo_deploy.Deploy [ ] !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Deployment Failed! ERROR: Heat log files: /var/log/heat-launcher/undercloud_deploy-C7bRh1 ... Traceback (most recent call last): File "/bin/ansible-playbook", line 118, in <module> exit_code = cli.run() File "/usr/lib/python2.7/site-packages/ansible/cli/playbook.py", line 122, in run results = pbex.run() ... File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause reraise(type(exception), exception, tb=exc_tb, cause=cause) File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1193, in _execute_context context) File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/default.py", line 507, in do_execute cursor.execute(statement, parameters) OperationalError: (sqlite3.OperationalError) database is locked [SQL: "SELECT name FROM sqlite_master WHERE type='table' ORDER BY name"] (Background on this error at: http://sqlalche.me/e/e3q8) Error running playbook in directory: /tmp/tripleo-modify-image-playbook-BNg2Jf many examples like * http://logs.openstack.org/50/604750/3/gate/tripleo-ci-centos-7-containers-multinode/4405b2b/logs/undercloud/home/zuul/install-undercloud.log.txt.gz#_2018-10-09_10_05_53_032 * http://logs.openstack.org/64/604664/1/gate/tripleo-ci-centos-7-containers-multinode/3f8c81e/logs/undercloud/home/zuul/install-undercloud.log.txt.gz#_2018-10-08_20_46_55_914 The undercloud install is failing with a trace like   2018-10-09 10:05:53.031 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] [WARNING]: Consider using 'become', 'become_method', and 'become_user' rather   2018-10-09 10:05:53.032 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] than running sudo   2018-10-09 10:05:53.032 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] fatal: [undercloud]: FAILED! => {"changed": true, "cmd": "sudo /usr/bin/tripleo-container-image-prepare --roles-file /tmp/ansible.omzIHE-role-data --environment-file /tmp/ansible.0wn0Wj-prepare-param --cleanup partial 2> ../install-undercloud.log", "delta": "0:09:05.581756", "end": "2018-10-09 10:05:52.989193", "msg": "non-zero return code", "rc": 1, "start": "2018-10-09 09:56:47.407437", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []}   2018-10-09 10:05:53.102 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ]   2018-10-09 10:05:53.102 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] NO MORE HOSTS LEFT *************************************************************   2018-10-09 10:05:53.104 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ]   2018-10-09 10:05:53.104 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] PLAY RECAP *********************************************************************   2018-10-09 10:05:53.104 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] undercloud : ok=201 changed=100 unreachable=0 failed=1   2018-10-09 10:05:53.104 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ]   2018-10-09 10:05:54.471 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] Not cleaning working directory /home/zuul/tripleo-heat-installer-templates   2018-10-09 10:05:54.505 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] Not cleaning ansible directory /home/zuul/undercloud-ansible-KT0LgE   2018-10-09 10:05:54.525 19140 WARNING tripleoclient.v1.tripleo_deploy.Deploy [ ] Install artifact is located at /home/zuul/undercloud-install-20181009100553.tar.bzip2   2018-10-09 10:05:54.526 19140 ERROR tripleoclient.v1.tripleo_deploy.Deploy [ ]   !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!   Deployment Failed!   ERROR: Heat log files: /var/log/heat-launcher/undercloud_deploy-C7bRh1 ...   Traceback (most recent call last):     File "/bin/ansible-playbook", line 118, in <module>       exit_code = cli.run()     File "/usr/lib/python2.7/site-packages/ansible/cli/playbook.py", line 122, in run       results = pbex.run() ...     File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause       reraise(type(exception), exception, tb=exc_tb, cause=cause)     File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1193, in _execute_context       context)     File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/default.py", line 507, in do_execute       cursor.execute(statement, parameters)   OperationalError: (sqlite3.OperationalError) database is locked [SQL: "SELECT name FROM sqlite_master WHERE type='table' ORDER BY name"] (Background on this error at: http://sqlalche.me/e/e3q8)   Error running playbook in directory: /tmp/tripleo-modify-image-playbook-BNg2Jf many examples like * http://logs.openstack.org/50/604750/3/gate/tripleo-ci-centos-7-containers-multinode/4405b2b/logs/undercloud/home/zuul/install-undercloud.log.txt.gz#_2018-10-09_10_05_53_032 * http://logs.openstack.org/64/604664/1/gate/tripleo-ci-centos-7-containers-multinode/3f8c81e/logs/undercloud/home/zuul/install-undercloud.log.txt.gz#_2018-10-08_20_46_55_914 * http://logs.openstack.org/98/604298/29/check/tripleo-ci-centos-7-containers-multinode/8804f81/logs/undercloud/home/zuul/install-undercloud.log.txt.gz#_2018-10-09_08_56_31_872
2018-10-09 20:11:16 Alex Schultz tripleo: status Triaged Fix Released