Standalone upgrade job failing in task [Extra migration for nova tripleo/+bug/1656791]

[Jose Luis Franco]

standalone-upgrade job is failing with the following error:

2019-02-18 06:31:25 | 2019-02-18 06:31:25.665 140820 WARNING tripleoclient.v1.tripleo_upgrade.Upgrade [-] TASK [Check if httpd is running] ***********************************************
2019-02-18 06:31:25 | 2019-02-18 06:31:25.914 140820 WARNING tripleoclient.v1.tripleo_upgrade.Upgrade [-] fatal: [standalone]: FAILED! => {"changed": true, "cmd": ["systemctl", "is-active", "--quiet", "httpd"], "delta": "0:00:00.021252", "end": "2019-02-18 06:31:25.885606", "msg": "non-zero return code", "rc": 3, "start": "2019-02-18 06:31:25.864354", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []}
2019-02-18 06:31:25 | 2019-02-18 06:31:25.914 140820 WARNING tripleoclient.v1.tripleo_upgrade.Upgrade [-] ...ignoring
2019-02-18 06:31:26 | 2019-02-18 06:31:26.002 140820 WARNING tripleoclient.v1.tripleo_upgrade.Upgrade [-] 
2019-02-18 06:31:26 | 2019-02-18 06:31:26.002 140820 WARNING tripleoclient.v1.tripleo_upgrade.Upgrade [-] TASK [Set fact httpd_running] **************************************************
2019-02-18 06:31:26 | 2019-02-18 06:31:26.053 140820 WARNING tripleoclient.v1.tripleo_upgrade.Upgrade [-] ok: [standalone]
2019-02-18 06:31:26 | 2019-02-18 06:31:26.124 140820 WARNING tripleoclient.v1.tripleo_upgrade.Upgrade [-] 
2019-02-18 06:31:26 | 2019-02-18 06:31:26.124 140820 WARNING tripleoclient.v1.tripleo_upgrade.Upgrade [-] TASK [Extra migration for nova tripleo/+bug/1656791] ***************************
2019-02-18 06:31:26 | 2019-02-18 06:31:26.376 140820 WARNING tripleoclient.v1.tripleo_upgrade.Upgrade [-] fatal: [standalone]: FAILED! => {"changed": false, "cmd": "nova-manage db online_data_migrations", "msg": "[Errno 2] No such file or directory", "rc": 2}
2019-02-18 06:31:26 | 2019-02-18 06:31:26.377 140820 WARNING tripleoclient.v1.tripleo_upgrade.Upgrade [-] 
2019-02-18 06:31:26 | 2019-02-18 06:31:26.378 140820 WARNING tripleoclient.v1.tripleo_upgrade.Upgrade [-] NO MORE HOSTS LEFT *************************************************************
2019-02-18 06:31:26 | 2019-02-18 06:31:26.379 140820 WARNING tripleoclient.v1.tripleo_upgrade.Upgrade [-] 
2019-02-18 06:31:26 | 2019-02-18 06:31:26.379 140820 WARNING tripleoclient.v1.tripleo_upgrade.Upgrade [-] PLAY RECAP *********************************************************************
2019-02-18 06:31:26 | 2019-02-18 06:31:26.380 140820 WARNING tripleoclient.v1.tripleo_upgrade.Upgrade [-] standalone : ok=18 changed=6 unreachable=0 failed=1
2019-02-18 06:31:26 | 2019-02-18 06:31:26.380 140820 WARNING tripleoclient.v1.tripleo_upgrade.Upgrade [-] 
2019-02-18 06:31:26 | 2019-02-18 06:31:26.483 140820 ERROR tripleoclient.v1.tripleo_upgrade.Upgrade [-] Exception: Upgrade failed: DeploymentError: Upgrade failed
2019-02-18 06:31:26 | Traceback (most recent call last):
2019-02-18 06:31:26 | File "/usr/lib/python2.7/site-packages/tripleoclient/v1/tripleo_deploy.py", line 1281, in _standalone_deploy
2019-02-18 06:31:26 | raise exceptions.DeploymentError('Upgrade failed')
2019-02-18 06:31:26 | DeploymentError: Upgrade failed
2019-02-18 06:31:26 | 2019-02-18 06:31:26.486 140820 ERROR tripleoclient.v1.tripleo_upgrade.Upgrade [-] None: DeploymentError: Upgrade failed
2019-02-18 06:31:28 | 2019-02-18 06:31:28.970 140820 ERROR tripleoclient.v1.tripleo_upgrade.Upgrade [-] ** Found ansible errors for standalone deployment! **: DeploymentError: Upgrade failed

http://logs.openstack.org/08/635208/17/check/tripleo-ci-centos-7-standalone-upgrade/eaabe5e/logs/undercloud/home/zuul/standalone_upgrade.log.txt.gz

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/637925

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/637925
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=3a86fc57d78d352ff143599a96f4bdcec9df4b89
Submitter: Zuul
Branch: master

commit 3a86fc57d78d352ff143599a96f4bdcec9df4b89
Author: Jose Luis Franco Arza <email address hidden>
Date: Tue Feb 19 17:18:46 2019 +0100

    Remove upgrade_tasks added during nova services flattening.

    During some of the nova service flattening it was included some of the
    baremetal upgrade_tasks into the containerized services. This patch removes
    them.

    Change-Id: I4a569195deeadb34180561c778dabe77be4f6466
    Closes-Bug: #1816453

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/tripleo-heat-templates 10.4.0 release.