invalid argument: disk vda does not have an active block job

Bug #1996264 reported by Amol Kahat
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Invalid
Low
Unassigned

Bug Description

Decription:
Tripleo CI jobs are failing on the tempest tests.

Tempest test failure:
```
Traceback (most recent call last):
  File "/usr/lib/python3.9/site-packages/cinder_tempest_plugin/api/volume/test_create_from_image.py", line 101, in test_create_from_image_with_volume_type_image_property
    volume = self.create_volume(**kwargs)
  File "/usr/lib/python3.9/site-packages/cinder_tempest_plugin/api/volume/base.py", line 97, in create_volume
    waiters.wait_for_volume_resource_status(cls.volumes_client,
  File "/usr/lib/python3.9/site-packages/tempest/common/waiters.py", line 305, in wait_for_volume_resource_status
    raise exceptions.VolumeResourceBuildErrorException(
tempest.exceptions.VolumeResourceBuildErrorException: volume 776f3a4a-5d7f-4cb7-bc04-111e0a41f2f3 failed to build and is in ERROR status

```

Libvirt logs
```
2022-11-11 05:09:20.479+0000: 20824: error : qemuDomainBlockJobAbort:14528 : invalid argument: disk vda does not have an active block job
```

Logs
- https://logserver.rdoproject.org/65/41465/16/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-network-master/64f0680/logs/overcloud-novacompute-0/var/log/containers/libvirt/virtqemud.log.1.gz
- https://logserver.rdoproject.org/65/41465/16/check/periodic-tripleo-ci-centos-9-standalone-full-tempest-api-tempest-master/7304f01/logs/undercloud/var/log/containers/libvirt/virtqemud.log.txt.gz
- https://logserver.rdoproject.org/65/41465/16/check/periodic-tripleo-ci-centos-9-standalone-full-tempest-api-wallaby/4537f90/logs/undercloud/var/log/containers/libvirt/virtqemud.log.1.gz

Revision history for this message
Amol Kahat (amolkahat) wrote :

Observed same issue in https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-train&result=FAILURE&skip=0

Error:

```
2022-11-10 09:40:56.723+0000: 30675: error : qemuDomainBlockJobAbort:14401 : invalid argument: disk vda does not have an active block job
2022-11-10 09:40:57.175+0000: 30677: error : qemuMonitorJSONCheckErrorFull:402 : internal error: unable to execute QEMU command 'blockdev-del': Failed to find node with node-name='libvirt-4-format'
2022-11-10 09:40:57.175+0000: 30677: error : qemuMonitorJSONCheckErrorFull:402 : internal error: unable to execute QEMU command 'blockdev-del': Failed to find node with node-name='libvirt-4-storage'
2022-11-10 09:40:59.059+0000: 30673: error : qemuDomainBlockJobAbort:14401 : invalid argument: disk vda does not have an active block job
```

Amol Kahat (amolkahat)
Changed in tripleo:
milestone: zed-1 → antelope-1
status: New → Triaged
Revision history for this message
Marios Andreou (marios-b) wrote :

Looking at job history for fs1-network as an example [1]

we have one instance of this bug @

periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-network-master openstack/tripleo-ci master openstack-component-network 3 hrs 11 mins 44 secs 2022-11-10 12:19:14 FAILURE

akahat|ruck needs to verify if this is still an issue (latest builds are hitting earlier issue, not reaching tempest).

[1] https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-network-master

Revision history for this message
Amol Kahat (amolkahat) wrote :

Not seen this error in recent run of CI. Closing this bug.

Changed in tripleo:
status: Triaged → Invalid
importance: Critical → Low
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.