branch-override jobs are failing Generate Ceph Spec step

Bug #1978956 reported by Ronelle Landy
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Fix Released
Critical
Ronelle Landy

Bug Description

branch-override jobs are failing Generate Ceph Spec step - on both upstream and downstream with the following error:

2022-06-16 06:14:42.228317 | primary | Thursday 16 June 2022 06:14:42 -0400 (0:00:01.563) 0:06:12.399 *********
2022-06-16 06:14:55.735477 | primary | fatal: [undercloud]: FAILED! => {"ansible_job_id": "388543349271.76105", "changed": false, "cmd": "openstack overcloud ceph spec --standalone --mon-ip $CEPH_MON_IP --yes --output $CEPH_SPEC --stack $DEPLOY_STACK --osd-spec $CEPH_OSD_SPEC ", "delta": "0:00:02.359999", "end": "2022-06-16 06:14:46.109521", "finished": 1, "msg": "non-zero return code", "rc": 2, "start": "2022-06-16 06:14:43.749522", "stderr": "/usr/lib/python3.9/site-packages/ansible/_vendor/__init__.py:42: UserWarning: One or more Python packages bundled by this ansible-core distribution were already loaded (pyparsing). This may result in undefined behavior.\n warnings.warn('One or more Python packages bundled by this ansible-core distribution were already '", "stderr_lines": ["/usr/lib/python3.9/site-packages/ansible/_vendor/__init__.py:42: UserWarning: One or more Python packages bundled by this ansible-core distribution were already loaded (pyparsing). This may result in undefined behavior.", " warnings.warn('One or more Python packages bundled by this ansible-core distribution were already '"], "stdout": "openstack: 'overcloud ceph spec --standalone --mon-ip 192.168.42.1 --yes --output /home/zuul/ceph_spec.yaml --stack standalone --osd-spec /home/zuul/osd_spec.yaml' is not an openstack command. See 'openstack --help'.\nDid you mean one of these?\n overcloud admin authorize\n overcloud backup\n overcloud cell export\n overcloud ceph deploy\n overcloud ceph user disable\n overcloud ceph user enable\n overcloud config download\n overcloud container image build\n overcloud container image prepare\n overcloud container image tag discover\n overcloud container image upload\n overcloud credentials\n overcloud delete\n overcloud deploy\n overcloud export\n overcloud export ceph\n overcloud external-update run\n overcloud external-upgrade run\n overcloud generate fencing\n overcloud image build\n overcloud image upload\n overcloud netenv validate\n overcloud network extract\n overcloud network provision\n overcloud network unprovision\n overcloud network vip extract\n overcloud network vip provision\n overcloud node bios configure\n overcloud node bios reset\n overcloud node clean\n overcloud node configure\n overcloud node delete\n overcloud node discover\n overcloud node extract provisioned\n overcloud node import\n overcloud node introspect\n overcloud node provide\n overcloud node provision\n overcloud node unprovision\n overcloud profiles list\n overcloud profiles match\n overcloud raid create\n overcloud restore\n overcloud role list\n overcloud role show\n overcloud roles generate\n overcloud status\n overcloud support report collect\n overcloud update prepare\n overcloud update run\n overcloud upgrade converge\n overcloud upgrade prepare\n overcloud upgrade run\n undercloud backup\n undercloud install\n undercloud upgrade", "stdout_lines": ["openstack: 'overcloud ceph spec --standalone --mon-ip 192.168.42.1 --yes --output /home/zuul/ceph_spec.yaml --stack standalone --osd-spec /home/zuul/osd_spec.yaml' is not an openstack command. See 'openstack --help'.", "Did you mean one of these?", " overcloud admin authorize", " overcloud backup", " overcloud cell export", " overcloud ceph deploy", " overcloud ceph user disable", " overcloud ceph user enable", " overcloud config download", " overcloud container image build", " overcloud container image prepare", " overcloud container image tag discover", " overcloud container image upload", " overcloud credentials", " overcloud delete", " overcloud deploy", " overcloud export", " overcloud export ceph", " overcloud external-update run", " overcloud external-upgrade run", " overcloud generate fencing", " overcloud image build", " overcloud image upload", " overcloud netenv validate", " overcloud network extract", " overcloud network provision", " overcloud network unprovision", " overcloud network vip extract", " overcloud network vip provision", " overcloud node bios configure", " overcloud node bios reset", " overcloud node clean", " overcloud node configure", " overcloud node delete", " overcloud node discover", " overcloud node extract provisioned", " overcloud node import", " overcloud node introspect", " overcloud node provide", " overcloud node provision", " overcloud node unprovision", " overcloud profiles list", " overcloud profiles match", " overcloud raid create", " overcloud restore", " overcloud role list", " overcloud role show", " overcloud roles generate", " overcloud status", " overcloud support report collect", " overcloud update prepare", " overcloud update run", " overcloud upgrade converge", " overcloud upgrade prepare", " overcloud upgrade run", " undercloud backup", " undercloud install", " undercloud upgrade"]}
2022-06-16 06:14:55.737657 | primary |

https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/834352 had this condition:

  - zuul.branch is defined and zuul.branch in ['master']

which means branch_override jobs were also including the task.

Revision history for this message
Ronelle Landy (rlandy) wrote :
Changed in tripleo:
milestone: none → zed-1
importance: Undecided → Critical
status: New → Triaged
assignee: nobody → Ronelle Landy (rlandy)
tags: added: promotion-blocker
Changed in tripleo:
status: Triaged → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on tripleo-quickstart-extras (master)

Change abandoned by "Ronelle Landy <email address hidden>" on branch: master
Review: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/846159

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tripleo-quickstart-extras (master)

Reviewed: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/846159
Committed: https://opendev.org/openstack/tripleo-quickstart-extras/commit/d2008175420e839925bf0856272cdfeb3d280032
Submitter: "Zuul (22348)"
Branch: master

commit d2008175420e839925bf0856272cdfeb3d280032
Author: Ronelle Landy <email address hidden>
Date: Thu Jun 16 08:27:31 2022 -0400

    Only deploy ceph before the overcloud in master

    I982dedb53582fbd76391165c3ca72954c129b84a added
    the ceph deploy task before the overcloud.
    This action was also happening on stable branch
    jobs in non-branched repos.

    This review adds a condition to skip the task
    for current branch_override jobs.

    Depends-On: https://review.opendev.org/c/openstack/tripleo-common/+/846287
    Closes-Bug: #1978956
    Change-Id: If2c9fc02c62a0cf060a73938ca8f8b4101d8c640

Changed in tripleo:
status: In Progress → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.