[SRU] tripleo-ci-centos-8-scenario001-standalone tempest-conf fails 500 PUT http://192.168.24.1:9292/v2/images/ RADOS invalid argument
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Ceph RBD Mirror Charm |
In Progress
|
Medium
|
Aurelien Lourot | ||
Ubuntu Cloud Archive |
Fix Released
|
Undecided
|
Unassigned | ||
Ussuri |
Fix Released
|
Critical
|
Unassigned | ||
Victoria |
Fix Released
|
Undecided
|
Unassigned | ||
os-brick |
Fix Released
|
Undecided
|
Unassigned | ||
tripleo |
Fix Released
|
Critical
|
Unassigned | ||
python-os-brick (Ubuntu) |
Fix Released
|
Critical
|
Unassigned | ||
Focal |
Fix Released
|
Critical
|
Unassigned | ||
Groovy |
Fix Released
|
Critical
|
Unassigned |
Bug Description
[Impact]
Os-brick is unusable with Ceph Octopus because of a tightening of config formatting requirements in Ceph.
[Test Case]
Validate cinder-backup with Ceph on Ubuntu Focal, in addition to testing with Ceph on Xenial (OpenStack Mitaka) with Cinder (and cinder-backup) on Focal (OpenStack Ussuri)
[Regression Potential]
The risk should be fairly low as the new confiig line being generated is supported since Ceph Hammer, which shipped in 2015. I would expect any potential regressions to occur with the combination of a current os-brick with an older (Hammer timeframe) Ceph, as that is when this feature was introduced.
the only potential regression I see in the previously mentioned timeframe would be with connecting to the older Ceph.
-------
2020-03-02 18:07:56.142233 | primary | 2020-03-02 18:07:52.442 135023 WARNING urllib3.
2020-03-02 18:07:56.142265 | primary | 2020-03-02 18:07:55.915 135023 INFO tempest.
2020-03-02 18:07:56.142297 | primary | 2020-03-02 18:07:55.917 135023 CRITICAL tempest [-] Unhandled error: tempest.
2020-03-02 18:07:56.142328 | primary | Details: b'500 Internal Server Error\n\nThe server has either erred or is incapable of performing the requested operation.\n\n '
2020-03-02 18:07:56.142377 | primary | 2020-03-02 18:07:55.917 135023 ERROR tempest Traceback (most recent call last):
2020-03-02 18:07:56.142411 | primary | 2020-03-02 18:07:55.917 135023 ERROR tempest File "/bin/discover-
2020-03-02 18:07:56.142442 | primary | 2020-03-02 18:07:55.917 135023 ERROR tempest sys.exit(main())
2020-03-02 18:07:56.142473 | primary | 2020-03-02 18:07:55.917 135023 ERROR tempest File "/usr/lib/
2020-03-02 18:07:56.142505 | primary | 2020-03-02 18:07:55.917 135023 ERROR tempest verbose=
2020-03-02 18:07:56.142549 | primary | 2020-03-02 18:07:55.917 135023 ERROR tempest File "/usr/lib/
2020-03-02 18:07:56.142582 | primary | 2020-03-02 18:07:55.917 135023 ERROR tempest image.create_
2020-03-02 18:07:56.142612 | primary | 2020-03-02 18:07:55.917 135023 ERROR tempest File "/usr/lib/
2020-03-02 18:07:56.142644 | primary | 2020-03-02 18:07:55.917 135023 ERROR tempest image_dest=
2020-03-02 18:07:56.142675 | primary | 2020-03-02 18:07:55.917 135023 ERROR tempest File "/usr/lib/
2020-03-02 18:07:56.142706 | primary | 2020-03-02 18:07:55.917 135023 ERROR tempest image = self._upload_
2020-03-02 18:07:56.142737 | primary | 2020-03-02 18:07:55.917 135023 ERROR tempest File "/usr/lib/
2020-03-02 18:07:56.142769 | primary | 2020-03-02 18:07:55.917 135023 ERROR tempest self.client.
2020-03-02 18:07:56.142801 | primary | 2020-03-02 18:07:55.917 135023 ERROR tempest File "/usr/lib/
2020-03-02 18:07:56.142832 | primary | 2020-03-02 18:07:55.917 135023 ERROR tempest body=data, chunked=True)
2020-03-02 18:07:56.142863 | primary | 2020-03-02 18:07:55.917 135023 ERROR tempest File "/usr/lib/
2020-03-02 18:07:56.142894 | primary | 2020-03-02 18:07:55.917 135023 ERROR tempest self._error_
2020-03-02 18:07:56.142926 | primary | 2020-03-02 18:07:55.917 135023 ERROR tempest File "/usr/lib/
2020-03-02 18:07:56.142965 | primary | 2020-03-02 18:07:55.917 135023 ERROR tempest message=message)
2020-03-02 18:07:56.142996 | primary | 2020-03-02 18:07:55.917 135023 ERROR tempest tempest.
2020-03-02 18:07:56.143049 | primary | 2020-03-02 18:07:55.917 135023 ERROR tempest Details: b'500 Internal Server Error\n\nThe server has either erred or is incapable of performing the requested operation.\n\n '
2020-03-02 18:07:56.143083 | primary | 2020-03-02 18:07:55.917 135023 ERROR tempest [00m
2020-03-02 18:07:56.143113 | primary |
2020-03-02 18:07:56.143144 | primary |
2020-03-02 18:07:56.143192 | primary | STDERR:
2020-03-02 18:07:56.143225 | primary |
2020-03-02 18:07:56.143256 | primary | /usr/lib/
2020-03-02 18:07:56.143286 | primary | return yaml.load(stream)
=======
Actual error: is here:
InvalidArgument
2020-03-02 18:07:51.999 40 ERROR glance_
2020-03-02 18:07:51.999 40 ERROR glance_
2020-03-02 18:07:51.999 40 ERROR glance_
2020-03-02 18:07:51.999 40 ERROR glance_
2020-03-02 18:07:51.999 40 ERROR glance_
2020-03-02 18:07:51.999 40 ERROR glance_
2020-03-02 18:07:51.999 40 ERROR glance_
2020-03-02 18:07:51.999 40 ERROR glance_
2020-03-02 18:07:51.999 40 ERROR glance_
2020-03-02 18:07:51.999 40 ERROR glance_
2020-03-02 18:07:51.999 40 ERROR glance_
2020-03-02 18:07:51.999 40 ERROR glance_
2020-03-02 18:07:51.999 40 ERROR glance_
2020-03-02 18:07:51.999 40 ERROR glance_
2020-03-02 18:07:51.999 40 ERROR glance_
2020-03-02 18:07:51.999 40 ERROR glance_
2020-03-02 18:07:51.999 40 ERROR glance_
2020-03-02 18:07:51.999 40 ERROR glance_
2020-03-02 18:07:51.999 40 ERROR glance_
2020-03-02 18:07:51.999 40 ERROR glance_
2020-03-02 18:07:51.999 40 ERROR glance_
2020-03-02 18:07:52.296 40 ERROR glance_
2020-03-02 18:07:52.386 40 ERROR glance.
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi [req-5076b6b5-
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi Traceback (most recent call last):
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "/usr/lib/
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi request, **action_args)
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "/usr/lib/
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi return method(*args, **kwargs)
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "/usr/lib/
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi return func(self, req, *args, **kwargs)
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "/usr/lib/
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi self._restore(
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "/usr/lib/
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi self.force_
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "/usr/lib/
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi six.reraise(
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "/usr/lib/
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi raise value
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "/usr/lib/
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi image.set_
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "/usr/lib/
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi self.base.
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "/usr/lib/
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi _send_notificat
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "/usr/lib/
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi self.force_
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "/usr/lib/
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi six.reraise(
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "/usr/lib/
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi raise value
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "/usr/lib/
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi set_active=
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "/usr/lib/
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi return self.image.
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "/usr/lib/
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi set_active=
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "/usr/lib/
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi self._upload_
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "/usr/lib/
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi verifier=verifier)
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "/usr/lib/
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi image_id, data, size, hashing_algo, store, context, verifier)
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "/usr/lib/
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi image_id, data, size, hashing_algo, context=context, verifier=verifier)
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "/usr/lib/
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi metadata_dict) = store_add_
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "/usr/lib/
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi return store_op_fun(store, *args, **kwargs)
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "/usr/lib/
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi with self._open_
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "/usr/lib64/
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi return next(self.gen)
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "/usr/lib/
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi device = conn.connect_
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "/usr/lib/
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi result = f(*args, **kwargs)
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "/usr/lib/
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi rbd_handle = self._get_
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "/usr/lib/
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi rbd_cluster_
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "/usr/lib/
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi self.client, self.ioctx = self.connect()
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "/usr/lib/
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi conffile=
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "rados.pyx", line 692, in rados.Rados.
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "rados.pyx", line 578, in rados.requires.
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "rados.pyx", line 743, in rados.Rados.__setup
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "rados.pyx", line 578, in rados.requires.
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi File "rados.pyx", line 826, in rados.Rados.
2020-03-02 18:07:52.438 40 ERROR glance.common.wsgi rados.InvalidAr
Related branches
- Corey Bryant: Approve
-
Diff: 103 lines (+82/-0)3 files modifieddebian/changelog (+7/-0)
debian/patches/lp1865754-fix-rbd-connector-for-octopus.patch (+74/-0)
debian/patches/series (+1/-0)
tags: | added: alert tempest |
Changed in tripleo: | |
status: | Triaged → Fix Released |
Changed in python-os-brick (Ubuntu): | |
status: | New → Triaged |
importance: | Undecided → Critical |
Changed in python-os-brick (Ubuntu Focal): | |
status: | New → Triaged |
importance: | Undecided → Critical |
Changed in python-os-brick (Ubuntu Groovy): | |
status: | Triaged → Fix Released |
summary: |
- tripleo-ci-centos-8-scenario001-standalone tempest-conf fails 500 PUT - http://192.168.24.1:9292/v2/images/ RADOS invalid argument + [SRU] tripleo-ci-centos-8-scenario001-standalone tempest-conf fails 500 + PUT http://192.168.24.1:9292/v2/images/ RADOS invalid argument |
description: | updated |
tags: |
added: verification-done-focal removed: verification-needed-focal |
tags: |
added: verification-done removed: verification-needed |
Changed in charm-ceph-rbd-mirror: | |
status: | New → In Progress |
importance: | Undecided → Medium |
Changed in charm-ceph-rbd-mirror: | |
assignee: | nobody → Aurelien Lourot (aurelien-lourot) |
default default] Failed to upload image data due to internal error: rados.InvalidAr gumentError: [errno 22] RADOS invalid argument (error calling conf_read_file)