Activity log for bug #1699515

Date Who What changed Old value New value Message
2017-06-21 14:07:24 Simon Wright bug added bug
2017-06-21 14:14:20 Simon Wright description I successfully deployed undercloud and then overcloud on a fresh install of Centos 7.3 using latest Stable Newton repo's, https://trunk.rdoproject.org/centos7- when I try to upgrade the undercloud to Stable Ocata release https://trunk.rdoproject.org/centos7- sudo rm /etc/yum.repos.d/delo* sudo curl -L -o /etc/yum.repos.d/delorean-ocata.repo https://trunk.rdoproject.org/centos7-ocata/current/delorean.repo sudo curl -L -o /etc/yum.repos.d/delorean-deps-ocata.repo https://trunk.rdoproject.org/centos7-ocata/delorean-deps.repo sudo yum -y install --enablerepo=extras centos-release-ceph-jewel sudo sed -i -e 's%gpgcheck=.*%gpgcheck=0%' /etc/yum.repos.d/CentOS-Ceph-Jewel.repo sudo yum clean all sudo systemctl stop openstack-* sudo systemctl stop neutron-* sudo systemctl stop openvswitch sudo systemctl stop httpd sudo yum -y update python-tripleoclient openstack undercloud upgrade I get the following error 2017-06-21 13:16:48,817 DEBUG: POST call to compute for http://10.13.13.1:8774/v2.1/flavors used request id req-484aa2da-f620-4bd8-846b-56626a3ecc39 2017-06-21 13:16:48,817 INFO: Not creating flavor "swift-storage" because it already exists. 2017-06-21 13:16:48,819 DEBUG: found extension EntryPoint.parse('keystone = mistralclient.auth.keystone:KeystoneAuthHandler') 2017-06-21 13:16:48,819 DEBUG: found extension EntryPoint.parse('keycloak-oidc = mistralclient.auth.keycloak:KeycloakAuthHandler') 2017-06-21 13:16:48,820 DEBUG: Making authentication request to http://10.13.13.1:5000/v2.0/tokens 2017-06-21 13:16:48,822 INFO: Starting new HTTP connection (1): 10.13.13.1 2017-06-21 13:16:49,059 DEBUG: "POST /v2.0/tokens HTTP/1.1" 200 1259 2017-06-21 13:16:49,062 INFO: Starting new HTTP connection (1): 10.13.13.1 2017-06-21 13:16:49,301 DEBUG: "GET /v2/environments/tripleo.undercloud-config HTTP/1.1" 200 286 2017-06-21 13:16:49,304 DEBUG: HTTP GET http://10.13.13.1:8989/v2/environments/tripleo.undercloud-config 200 2017-06-21 13:16:49,306 INFO: Starting new HTTP connection (1): 10.13.13.1 2017-06-21 13:16:49,322 DEBUG: "GET /v2/environments HTTP/1.1" 200 7148 2017-06-21 13:16:49,323 DEBUG: HTTP GET http://10.13.13.1:8989/v2/environments 200 2017-06-21 13:16:49,324 INFO: Not creating default plan "overcloud" because it already exists. 2017-06-21 13:16:49,325 INFO: Starting new HTTP connection (1): 10.13.13.1 2017-06-21 13:16:49,911 DEBUG: "POST /v2/executions HTTP/1.1" 400 2037 2017-06-21 13:16:49,912 DEBUG: HTTP POST http://10.13.13.1:8989/v2/executions 400 2017-06-21 13:16:49,913 ERROR: ############################################################################# Undercloud upgrade failed. Reason: Failed when querying database, error type: DBError, error message: (pymysql.err.InternalError) (1054, u"Unknown column 'task_executions_v2.type' in 'field list'") [SQL: u'SELECT task_executions_v2.scope AS task_executions_v2_scope, task_executions_v2.project_id AS task_executions_v2_project_id, task_executions_v2.created_at AS task_executions_v2_created_at, task_executions_v2.updated_at AS task_executions_v2_updated_at, task_executions_v2.id AS task_executions_v2_id, task_executions_v2.name AS task_executions_v2_name, task_executions_v2.description AS task_executions_v2_description, task_executions_v2.workflow_name AS task_executions_v2_workflow_name, task_executions_v2.workflow_id AS task_executions_v2_workflow_id, task_executions_v2.spec AS task_executions_v2_spec, task_executions_v2.state AS task_executions_v2_state, task_executions_v2.state_info AS task_executions_v2_state_info, task_executions_v2.tags AS task_executions_v2_tags, task_executions_v2.runtime_context AS task_executions_v2_runtime_context, task_executions_v2.action_spec AS task_executions_v2_action_spec, task_executions_v2.unique_key AS task_executions_v2_unique_key, task_executions_v2.type AS task_executions_v2_type, task_executions_v2.processed AS task_executions_v2_processed, task_executions_v2.in_context AS task_executions_v2_in_context, task_executions_v2.published AS task_executions_v2_published, task_executions_v2.workflow_execution_id AS task_executions_v2_workflow_execution_id \nFROM task_executions_v2 \nWHERE (task_executions_v2.project_id = %(project_id_1)s OR task_executions_v2.scope = %(scope_1)s) AND task_executions_v2.workflow_execution_id = %(workflow_execution_id_1)s AND task_executions_v2.state = %(state_1)s ORDER BY task_executions_v2.created_at ASC, task_executions_v2.id ASC'] [parameters: {u'state_1': 'IDLE', u'project_id_1': u'14cdab35471444148ed4bc826ce33fbd', u'workflow_execution_id_1': '728ba3f5-8f2e-4528-ad40-9a367670f797', u'scope_1': 'public'}] tail /var/log/mistral/engine.log at http://paste.openstack.org/show/613290/ This error is consistent - this upgrade sucessfully completed on 19-Jun-17@10:25+01:00. Since then I have rebuilt the Newton undercloud/overcloud and tried the upgrade 4 times, and received the same error 4 times. Expected result - successfully upgraded undercloud Actual result - undercloud upgrade failed Following the tripleo instructions http://tripleo.org/installation/installation.html#installing-the-undercloud I successfully deployed undercloud and then overcloud on a fresh install of Centos 7.3 using latest RDO Newton Delorean repo's, https://trunk.rdoproject.org/centos7-newton/current/delorean.repo when I try to upgrade the undercloud to Stable Ocata release https://trunk.rdoproject.org/centos7-ocata/current/delorean.repo sudo rm /etc/yum.repos.d/delo* sudo curl -L -o /etc/yum.repos.d/delorean-ocata.repo https://trunk.rdoproject.org/centos7-ocata/current/delorean.repo sudo curl -L -o /etc/yum.repos.d/delorean-deps-ocata.repo https://trunk.rdoproject.org/centos7-ocata/delorean-deps.repo sudo yum -y install --enablerepo=extras centos-release-ceph-jewel sudo sed -i -e 's%gpgcheck=.*%gpgcheck=0%' /etc/yum.repos.d/CentOS-Ceph-Jewel.repo sudo yum clean all sudo systemctl stop openstack-* sudo systemctl stop neutron-* sudo systemctl stop openvswitch sudo systemctl stop httpd sudo yum -y update python-tripleoclient openstack undercloud upgrade I get the following error 2017-06-21 13:16:48,817 DEBUG: POST call to compute for http://10.13.13.1:8774/v2.1/flavors used request id req-484aa2da-f620-4bd8-846b-56626a3ecc39 2017-06-21 13:16:48,817 INFO: Not creating flavor "swift-storage" because it already exists. 2017-06-21 13:16:48,819 DEBUG: found extension EntryPoint.parse('keystone = mistralclient.auth.keystone:KeystoneAuthHandler') 2017-06-21 13:16:48,819 DEBUG: found extension EntryPoint.parse('keycloak-oidc = mistralclient.auth.keycloak:KeycloakAuthHandler') 2017-06-21 13:16:48,820 DEBUG: Making authentication request to http://10.13.13.1:5000/v2.0/tokens 2017-06-21 13:16:48,822 INFO: Starting new HTTP connection (1): 10.13.13.1 2017-06-21 13:16:49,059 DEBUG: "POST /v2.0/tokens HTTP/1.1" 200 1259 2017-06-21 13:16:49,062 INFO: Starting new HTTP connection (1): 10.13.13.1 2017-06-21 13:16:49,301 DEBUG: "GET /v2/environments/tripleo.undercloud-config HTTP/1.1" 200 286 2017-06-21 13:16:49,304 DEBUG: HTTP GET http://10.13.13.1:8989/v2/environments/tripleo.undercloud-config 200 2017-06-21 13:16:49,306 INFO: Starting new HTTP connection (1): 10.13.13.1 2017-06-21 13:16:49,322 DEBUG: "GET /v2/environments HTTP/1.1" 200 7148 2017-06-21 13:16:49,323 DEBUG: HTTP GET http://10.13.13.1:8989/v2/environments 200 2017-06-21 13:16:49,324 INFO: Not creating default plan "overcloud" because it already exists. 2017-06-21 13:16:49,325 INFO: Starting new HTTP connection (1): 10.13.13.1 2017-06-21 13:16:49,911 DEBUG: "POST /v2/executions HTTP/1.1" 400 2037 2017-06-21 13:16:49,912 DEBUG: HTTP POST http://10.13.13.1:8989/v2/executions 400 2017-06-21 13:16:49,913 ERROR: ############################################################################# Undercloud upgrade failed. Reason: Failed when querying database, error type: DBError, error message: (pymysql.err.InternalError) (1054, u"Unknown column 'task_executions_v2.type' in 'field list'") [SQL: u'SELECT task_executions_v2.scope AS task_executions_v2_scope, task_executions_v2.project_id AS task_executions_v2_project_id, task_executions_v2.created_at AS task_executions_v2_created_at, task_executions_v2.updated_at AS task_executions_v2_updated_at, task_executions_v2.id AS task_executions_v2_id, task_executions_v2.name AS task_executions_v2_name, task_executions_v2.description AS task_executions_v2_description, task_executions_v2.workflow_name AS task_executions_v2_workflow_name, task_executions_v2.workflow_id AS task_executions_v2_workflow_id, task_executions_v2.spec AS task_executions_v2_spec, task_executions_v2.state AS task_executions_v2_state, task_executions_v2.state_info AS task_executions_v2_state_info, task_executions_v2.tags AS task_executions_v2_tags, task_executions_v2.runtime_context AS task_executions_v2_runtime_context, task_executions_v2.action_spec AS task_executions_v2_action_spec, task_executions_v2.unique_key AS task_executions_v2_unique_key, task_executions_v2.type AS task_executions_v2_type, task_executions_v2.processed AS task_executions_v2_processed, task_executions_v2.in_context AS task_executions_v2_in_context, task_executions_v2.published AS task_executions_v2_published, task_executions_v2.workflow_execution_id AS task_executions_v2_workflow_execution_id \nFROM task_executions_v2 \nWHERE (task_executions_v2.project_id = %(project_id_1)s OR task_executions_v2.scope = %(scope_1)s) AND task_executions_v2.workflow_execution_id = %(workflow_execution_id_1)s AND task_executions_v2.state = %(state_1)s ORDER BY task_executions_v2.created_at ASC, task_executions_v2.id ASC'] [parameters: {u'state_1': 'IDLE', u'project_id_1': u'14cdab35471444148ed4bc826ce33fbd', u'workflow_execution_id_1': '728ba3f5-8f2e-4528-ad40-9a367670f797', u'scope_1': 'public'}] tail /var/log/mistral/engine.log at http://paste.openstack.org/show/613290/ This error is consistent - this upgrade sucessfully completed on 19-Jun-17@10:25+01:00. Since then I have rebuilt the Newton undercloud/overcloud and tried the upgrade 4 times, and received the same error 4 times. Expected result - successfully upgraded undercloud Actual result - undercloud upgrade failed
2017-06-21 15:17:18 Simon Wright description Following the tripleo instructions http://tripleo.org/installation/installation.html#installing-the-undercloud I successfully deployed undercloud and then overcloud on a fresh install of Centos 7.3 using latest RDO Newton Delorean repo's, https://trunk.rdoproject.org/centos7-newton/current/delorean.repo when I try to upgrade the undercloud to Stable Ocata release https://trunk.rdoproject.org/centos7-ocata/current/delorean.repo sudo rm /etc/yum.repos.d/delo* sudo curl -L -o /etc/yum.repos.d/delorean-ocata.repo https://trunk.rdoproject.org/centos7-ocata/current/delorean.repo sudo curl -L -o /etc/yum.repos.d/delorean-deps-ocata.repo https://trunk.rdoproject.org/centos7-ocata/delorean-deps.repo sudo yum -y install --enablerepo=extras centos-release-ceph-jewel sudo sed -i -e 's%gpgcheck=.*%gpgcheck=0%' /etc/yum.repos.d/CentOS-Ceph-Jewel.repo sudo yum clean all sudo systemctl stop openstack-* sudo systemctl stop neutron-* sudo systemctl stop openvswitch sudo systemctl stop httpd sudo yum -y update python-tripleoclient openstack undercloud upgrade I get the following error 2017-06-21 13:16:48,817 DEBUG: POST call to compute for http://10.13.13.1:8774/v2.1/flavors used request id req-484aa2da-f620-4bd8-846b-56626a3ecc39 2017-06-21 13:16:48,817 INFO: Not creating flavor "swift-storage" because it already exists. 2017-06-21 13:16:48,819 DEBUG: found extension EntryPoint.parse('keystone = mistralclient.auth.keystone:KeystoneAuthHandler') 2017-06-21 13:16:48,819 DEBUG: found extension EntryPoint.parse('keycloak-oidc = mistralclient.auth.keycloak:KeycloakAuthHandler') 2017-06-21 13:16:48,820 DEBUG: Making authentication request to http://10.13.13.1:5000/v2.0/tokens 2017-06-21 13:16:48,822 INFO: Starting new HTTP connection (1): 10.13.13.1 2017-06-21 13:16:49,059 DEBUG: "POST /v2.0/tokens HTTP/1.1" 200 1259 2017-06-21 13:16:49,062 INFO: Starting new HTTP connection (1): 10.13.13.1 2017-06-21 13:16:49,301 DEBUG: "GET /v2/environments/tripleo.undercloud-config HTTP/1.1" 200 286 2017-06-21 13:16:49,304 DEBUG: HTTP GET http://10.13.13.1:8989/v2/environments/tripleo.undercloud-config 200 2017-06-21 13:16:49,306 INFO: Starting new HTTP connection (1): 10.13.13.1 2017-06-21 13:16:49,322 DEBUG: "GET /v2/environments HTTP/1.1" 200 7148 2017-06-21 13:16:49,323 DEBUG: HTTP GET http://10.13.13.1:8989/v2/environments 200 2017-06-21 13:16:49,324 INFO: Not creating default plan "overcloud" because it already exists. 2017-06-21 13:16:49,325 INFO: Starting new HTTP connection (1): 10.13.13.1 2017-06-21 13:16:49,911 DEBUG: "POST /v2/executions HTTP/1.1" 400 2037 2017-06-21 13:16:49,912 DEBUG: HTTP POST http://10.13.13.1:8989/v2/executions 400 2017-06-21 13:16:49,913 ERROR: ############################################################################# Undercloud upgrade failed. Reason: Failed when querying database, error type: DBError, error message: (pymysql.err.InternalError) (1054, u"Unknown column 'task_executions_v2.type' in 'field list'") [SQL: u'SELECT task_executions_v2.scope AS task_executions_v2_scope, task_executions_v2.project_id AS task_executions_v2_project_id, task_executions_v2.created_at AS task_executions_v2_created_at, task_executions_v2.updated_at AS task_executions_v2_updated_at, task_executions_v2.id AS task_executions_v2_id, task_executions_v2.name AS task_executions_v2_name, task_executions_v2.description AS task_executions_v2_description, task_executions_v2.workflow_name AS task_executions_v2_workflow_name, task_executions_v2.workflow_id AS task_executions_v2_workflow_id, task_executions_v2.spec AS task_executions_v2_spec, task_executions_v2.state AS task_executions_v2_state, task_executions_v2.state_info AS task_executions_v2_state_info, task_executions_v2.tags AS task_executions_v2_tags, task_executions_v2.runtime_context AS task_executions_v2_runtime_context, task_executions_v2.action_spec AS task_executions_v2_action_spec, task_executions_v2.unique_key AS task_executions_v2_unique_key, task_executions_v2.type AS task_executions_v2_type, task_executions_v2.processed AS task_executions_v2_processed, task_executions_v2.in_context AS task_executions_v2_in_context, task_executions_v2.published AS task_executions_v2_published, task_executions_v2.workflow_execution_id AS task_executions_v2_workflow_execution_id \nFROM task_executions_v2 \nWHERE (task_executions_v2.project_id = %(project_id_1)s OR task_executions_v2.scope = %(scope_1)s) AND task_executions_v2.workflow_execution_id = %(workflow_execution_id_1)s AND task_executions_v2.state = %(state_1)s ORDER BY task_executions_v2.created_at ASC, task_executions_v2.id ASC'] [parameters: {u'state_1': 'IDLE', u'project_id_1': u'14cdab35471444148ed4bc826ce33fbd', u'workflow_execution_id_1': '728ba3f5-8f2e-4528-ad40-9a367670f797', u'scope_1': 'public'}] tail /var/log/mistral/engine.log at http://paste.openstack.org/show/613290/ This error is consistent - this upgrade sucessfully completed on 19-Jun-17@10:25+01:00. Since then I have rebuilt the Newton undercloud/overcloud and tried the upgrade 4 times, and received the same error 4 times. Expected result - successfully upgraded undercloud Actual result - undercloud upgrade failed Following the tripleo instructions http://tripleo.org/installation/installation.html#installing-the-undercloud I successfully deployed undercloud and then overcloud on a fresh install of Centos 7.3 using latest RDO Newton Delorean repo's, https://trunk.rdoproject.org/centos7-newton/current/delorean.repo when I try to upgrade the undercloud to the Ocata release https://trunk.rdoproject.org/centos7-ocata/current/delorean.repo sudo rm /etc/yum.repos.d/delo* sudo curl -L -o /etc/yum.repos.d/delorean-ocata.repo https://trunk.rdoproject.org/centos7-ocata/current/delorean.repo sudo curl -L -o /etc/yum.repos.d/delorean-deps-ocata.repo https://trunk.rdoproject.org/centos7-ocata/delorean-deps.repo sudo yum -y install --enablerepo=extras centos-release-ceph-jewel sudo sed -i -e 's%gpgcheck=.*%gpgcheck=0%' /etc/yum.repos.d/CentOS-Ceph-Jewel.repo sudo yum clean all sudo systemctl stop openstack-* sudo systemctl stop neutron-* sudo systemctl stop openvswitch sudo systemctl stop httpd sudo yum -y update python-tripleoclient openstack undercloud upgrade I get the following error 2017-06-21 13:16:48,817 DEBUG: POST call to compute for http://10.13.13.1:8774/v2.1/flavors used request id req-484aa2da-f620-4bd8-846b-56626a3ecc39 2017-06-21 13:16:48,817 INFO: Not creating flavor "swift-storage" because it already exists. 2017-06-21 13:16:48,819 DEBUG: found extension EntryPoint.parse('keystone = mistralclient.auth.keystone:KeystoneAuthHandler') 2017-06-21 13:16:48,819 DEBUG: found extension EntryPoint.parse('keycloak-oidc = mistralclient.auth.keycloak:KeycloakAuthHandler') 2017-06-21 13:16:48,820 DEBUG: Making authentication request to http://10.13.13.1:5000/v2.0/tokens 2017-06-21 13:16:48,822 INFO: Starting new HTTP connection (1): 10.13.13.1 2017-06-21 13:16:49,059 DEBUG: "POST /v2.0/tokens HTTP/1.1" 200 1259 2017-06-21 13:16:49,062 INFO: Starting new HTTP connection (1): 10.13.13.1 2017-06-21 13:16:49,301 DEBUG: "GET /v2/environments/tripleo.undercloud-config HTTP/1.1" 200 286 2017-06-21 13:16:49,304 DEBUG: HTTP GET http://10.13.13.1:8989/v2/environments/tripleo.undercloud-config 200 2017-06-21 13:16:49,306 INFO: Starting new HTTP connection (1): 10.13.13.1 2017-06-21 13:16:49,322 DEBUG: "GET /v2/environments HTTP/1.1" 200 7148 2017-06-21 13:16:49,323 DEBUG: HTTP GET http://10.13.13.1:8989/v2/environments 200 2017-06-21 13:16:49,324 INFO: Not creating default plan "overcloud" because it already exists. 2017-06-21 13:16:49,325 INFO: Starting new HTTP connection (1): 10.13.13.1 2017-06-21 13:16:49,911 DEBUG: "POST /v2/executions HTTP/1.1" 400 2037 2017-06-21 13:16:49,912 DEBUG: HTTP POST http://10.13.13.1:8989/v2/executions 400 2017-06-21 13:16:49,913 ERROR: ############################################################################# Undercloud upgrade failed. Reason: Failed when querying database, error type: DBError, error message: (pymysql.err.InternalError) (1054, u"Unknown column 'task_executions_v2.type' in 'field list'") [SQL: u'SELECT task_executions_v2.scope AS task_executions_v2_scope, task_executions_v2.project_id AS task_executions_v2_project_id, task_executions_v2.created_at AS task_executions_v2_created_at, task_executions_v2.updated_at AS task_executions_v2_updated_at, task_executions_v2.id AS task_executions_v2_id, task_executions_v2.name AS task_executions_v2_name, task_executions_v2.description AS task_executions_v2_description, task_executions_v2.workflow_name AS task_executions_v2_workflow_name, task_executions_v2.workflow_id AS task_executions_v2_workflow_id, task_executions_v2.spec AS task_executions_v2_spec, task_executions_v2.state AS task_executions_v2_state, task_executions_v2.state_info AS task_executions_v2_state_info, task_executions_v2.tags AS task_executions_v2_tags, task_executions_v2.runtime_context AS task_executions_v2_runtime_context, task_executions_v2.action_spec AS task_executions_v2_action_spec, task_executions_v2.unique_key AS task_executions_v2_unique_key, task_executions_v2.type AS task_executions_v2_type, task_executions_v2.processed AS task_executions_v2_processed, task_executions_v2.in_context AS task_executions_v2_in_context, task_executions_v2.published AS task_executions_v2_published, task_executions_v2.workflow_execution_id AS task_executions_v2_workflow_execution_id \nFROM task_executions_v2 \nWHERE (task_executions_v2.project_id = %(project_id_1)s OR task_executions_v2.scope = %(scope_1)s) AND task_executions_v2.workflow_execution_id = %(workflow_execution_id_1)s AND task_executions_v2.state = %(state_1)s ORDER BY task_executions_v2.created_at ASC, task_executions_v2.id ASC'] [parameters: {u'state_1': 'IDLE', u'project_id_1': u'14cdab35471444148ed4bc826ce33fbd', u'workflow_execution_id_1': '728ba3f5-8f2e-4528-ad40-9a367670f797', u'scope_1': 'public'}] tail /var/log/mistral/engine.log at http://paste.openstack.org/show/613290/ This error is consistent - this upgrade sucessfully completed on 19-Jun-17@10:25+01:00. Since then I have rebuilt the Newton undercloud/overcloud and tried the upgrade 4 times, and received the same error 4 times. Expected result - successfully upgraded undercloud Actual result - undercloud upgrade failed
2017-06-22 15:20:18 Emilien Macchi tripleo: status New Triaged
2017-06-22 15:20:41 Emilien Macchi tripleo: importance Undecided High
2017-06-22 15:20:43 Emilien Macchi tripleo: milestone pike-3
2017-06-22 15:20:49 Emilien Macchi tags upgrade
2017-06-28 13:52:06 Carlos Camacho tripleo: importance High Critical
2017-06-28 16:01:14 Brad P. Crochet tripleo: assignee Brad P. Crochet (brad-9)
2017-06-29 12:05:22 Brad P. Crochet tripleo: status Triaged Fix Committed
2017-06-29 14:13:50 Carlos Camacho tripleo: status Fix Committed Fix Released