| 2022-08-25 13:29:14 |
Mauricio Faria de Oliveira |
bug |
|
|
added bug |
| 2022-08-25 13:29:23 |
Mauricio Faria de Oliveira |
cinder (Ubuntu): status |
New |
In Progress |
|
| 2022-08-25 13:29:26 |
Mauricio Faria de Oliveira |
cinder (Ubuntu): importance |
Undecided |
Medium |
|
| 2022-08-25 13:29:28 |
Mauricio Faria de Oliveira |
cinder (Ubuntu): assignee |
|
Mauricio Faria de Oliveira (mfo) |
|
| 2022-08-25 13:41:46 |
Mauricio Faria de Oliveira |
bug watch added |
|
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1018084 |
|
| 2022-08-25 13:41:46 |
Mauricio Faria de Oliveira |
bug task added |
|
cinder (Debian) |
|
| 2022-08-25 13:52:25 |
Mauricio Faria de Oliveira |
description |
[mfo: working on debian bug and merge request on salsa.]
Problem:
The cinder-volume.service unit is _not_ ordered after the tgt.service unit,
and thus might fail to run 'tgtadm' commands because tgtd is not yet ready,
on service start up / boot:
INFO cinder.service [-] Starting cinder-volume node (version 12.0.9)
...
ERROR cinder.volume.manager [req-UUID - - - - -] Failed to re-export volume, setting to ERROR.: ProcessExecutionError: Unexpected error while running command.
Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf tgtadm --lld iscsi --op show --mode target
Exit code: 107
Stdout: u''
Stderr: u'tgtadm: failed to send request hdr to tgt daemon, Transport endpoint is not connected\n'
Approach:
It should be OK to order `cinder-volume.service` (generated from `cinder-volume.init.in` template) with `After=tgt.service`,
as the `cinder-volume` package has a `Depends: tgt` dependency, and actually restarts `tgt` on its install/remove scripts,
thus it is already strongly bound to `tgt` at the packaging level, even if its runtime usage is optional (eg, other drivers).
# dpkg -s cinder-volume | grep Depends:
Depends: ..., tgt, ...
Real-world example:
1) Unit `ovs-vswitchd.service` took 2 minutes to start up.
2) That delayed `network.target` (`ovs-vswitchd.service` has `Before=network.target`).
3) That delayed `tgt.service` too (it has `After=network.target`).
4) BUT that did _not_ delay `cinder-volume.service` (it does _not_ have `After=tgt.service`)
5) So it failed to talk to tgtd with tgtadm, and volume re-export failed.
$ cat sos_commands/logs/journalctl_--no-pager_--catalog_--boot \
| grep -E -B1 'Subject: Unit (cinder-volume.service|tgt.service|ovs-vswitchd.service|network.target)'
Aug 10 06:23:15 <HOST> systemd[1]: Started OpenStack Cinder Volume.
-- Subject: Unit cinder-volume.service has finished start-up
--
<<< ERROR in cinder-volume.log >>>
Aug 10 06:23:16 <HOST> systemd[1]: Starting Open vSwitch Forwarding Unit...
-- Subject: Unit ovs-vswitchd.service has begun start-up
--
<<< DELAY of 2 minutes >>>
Aug 10 06:25:17 <HOST> systemd[1]: Started Open vSwitch Forwarding Unit.
-- Subject: Unit ovs-vswitchd.service has finished start-up
--
Aug 10 06:25:17 <HOST> systemd[1]: Reached target Network.
-- Subject: Unit network.target has finished start-up
--
Aug 10 06:25:17 <HOST> systemd[1]: Starting (i)SCSI target daemon...
-- Subject: Unit tgt.service has begun start-up
--
Aug 10 06:25:19 <HOST> systemd[1]: Started (i)SCSI target daemon.
-- Subject: Unit tgt.service has finished start-up
<<< NOW tgtd is running >>>
@ var/log/cinder/cinder-volume.log
9901 2022-08-10 06:23:21.515 3939 INFO cinder.service [-] Starting cinder-volume node (version 12.0.9)
...
9932 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager [req-e67a852a-6cce-4073-a2de-d3487c85d586 - - - - -] Failed to re-export volume, setting to ERROR.: ProcessExecutionError: Unexpected error while running command.
9933 Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf tgtadm --lld iscsi --op show --mode target
9934 Exit code: 107
9935 Stdout: u''
9936 Stderr: u'tgtadm: failed to send request hdr to tgt daemon, Transport endpoint is not connected\n'
9937 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager Traceback (most recent call last):
9938 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/cinder/volume/manager.py", line 486, in init_host
9939 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager self.driver.ensure_export(ctxt, volume)
9940 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 826, in ensure_export
9941 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager self.target_driver.ensure_export(context, volume, volume_path)
9942 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/cinder/volume/targets/iscsi.py", line 261, in ensure_export
9943 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager old_name=None, **portals_config)
9944 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/cinder/utils.py", line 818, in _wrapper
9945 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager return r.call(f, *args, **kwargs)
9946 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/retrying.py", line 206, in call
9947 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager return attempt.get(self._wrap_exception)
9948 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/retrying.py", line 247, in get
9949 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager six.reraise(self.value[0], self.value[1], self.value[2])
9950 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/retrying.py", line 200, in call
9951 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
9952 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/cinder/volume/targets/tgt.py", line 141, in create_iscsi_target
9953 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager run_as_root=True)
9954 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/cinder/utils.py", line 126, in execute
9955 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager return processutils.execute(*cmd, **kwargs)
9956 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/oslo_concurrency/processutils.py", line 424, in execute
9957 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager cmd=sanitized_cmd)
9958 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager ProcessExecutionError: Unexpected error while running command.
9959 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf tgtadm --lld iscsi --op show --mode target
9960 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager Exit code: 107
9961 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager Stdout: u''
9962 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager Stderr: u'tgtadm: failed to send request hdr to tgt daemon, Transport endpoint is not connected\n' |
Debian bug #1018084 [1]
Debian MR on Salsa: [2]
[1] https://bugs.debian.org/1018084
[2] https://salsa.debian.org/openstack-team/services/cinder/-/merge_requests/2
Problem:
The cinder-volume.service unit is _not_ ordered after the tgt.service unit,
and thus might fail to run 'tgtadm' commands because tgtd is not yet ready,
on service start up / boot:
INFO cinder.service [-] Starting cinder-volume node (version 12.0.9)
...
ERROR cinder.volume.manager [req-UUID - - - - -] Failed to re-export volume, setting to ERROR.: ProcessExecutionError: Unexpected error while running command.
Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf tgtadm --lld iscsi --op show --mode target
Exit code: 107
Stdout: u''
Stderr: u'tgtadm: failed to send request hdr to tgt daemon, Transport endpoint is not connected\n'
Approach:
It should be OK to order `cinder-volume.service` (generated from `cinder-volume.init.in` template) with `After=tgt.service`,
as the `cinder-volume` package has a `Depends: tgt` dependency, and actually restarts `tgt` on its install/remove scripts,
thus it is already strongly bound to `tgt` at the packaging level, even if its runtime usage is optional (eg, other drivers).
# dpkg -s cinder-volume | grep Depends:
Depends: ..., tgt, ...
Real-world example:
1) Unit `ovs-vswitchd.service` took 2 minutes to start up.
2) That delayed `network.target` (`ovs-vswitchd.service` has `Before=network.target`).
3) That delayed `tgt.service` too (it has `After=network.target`).
4) BUT that did _not_ delay `cinder-volume.service` (it does _not_ have `After=tgt.service`)
5) So it failed to talk to tgtd with tgtadm, and volume re-export failed.
$ cat sos_commands/logs/journalctl_--no-pager_--catalog_--boot \
| grep -E -B1 'Subject: Unit (cinder-volume.service|tgt.service|ovs-vswitchd.service|network.target)'
Aug 10 06:23:15 <HOST> systemd[1]: Started OpenStack Cinder Volume.
-- Subject: Unit cinder-volume.service has finished start-up
--
<<< ERROR in cinder-volume.log >>>
Aug 10 06:23:16 <HOST> systemd[1]: Starting Open vSwitch Forwarding Unit...
-- Subject: Unit ovs-vswitchd.service has begun start-up
--
<<< DELAY of 2 minutes >>>
Aug 10 06:25:17 <HOST> systemd[1]: Started Open vSwitch Forwarding Unit.
-- Subject: Unit ovs-vswitchd.service has finished start-up
--
Aug 10 06:25:17 <HOST> systemd[1]: Reached target Network.
-- Subject: Unit network.target has finished start-up
--
Aug 10 06:25:17 <HOST> systemd[1]: Starting (i)SCSI target daemon...
-- Subject: Unit tgt.service has begun start-up
--
Aug 10 06:25:19 <HOST> systemd[1]: Started (i)SCSI target daemon.
-- Subject: Unit tgt.service has finished start-up
<<< NOW tgtd is running >>>
@ var/log/cinder/cinder-volume.log
9901 2022-08-10 06:23:21.515 3939 INFO cinder.service [-] Starting cinder-volume node (version 12.0.9)
...
9932 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager [req-e67a852a-6cce-4073-a2de-d3487c85d586 - - - - -] Failed to re-export volume, setting to ERROR.: ProcessExecutionError: Unexpected error while running command.
9933 Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf tgtadm --lld iscsi --op show --mode target
9934 Exit code: 107
9935 Stdout: u''
9936 Stderr: u'tgtadm: failed to send request hdr to tgt daemon, Transport endpoint is not connected\n'
9937 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager Traceback (most recent call last):
9938 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/cinder/volume/manager.py", line 486, in init_host
9939 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager self.driver.ensure_export(ctxt, volume)
9940 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 826, in ensure_export
9941 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager self.target_driver.ensure_export(context, volume, volume_path)
9942 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/cinder/volume/targets/iscsi.py", line 261, in ensure_export
9943 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager old_name=None, **portals_config)
9944 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/cinder/utils.py", line 818, in _wrapper
9945 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager return r.call(f, *args, **kwargs)
9946 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/retrying.py", line 206, in call
9947 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager return attempt.get(self._wrap_exception)
9948 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/retrying.py", line 247, in get
9949 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager six.reraise(self.value[0], self.value[1], self.value[2])
9950 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/retrying.py", line 200, in call
9951 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
9952 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/cinder/volume/targets/tgt.py", line 141, in create_iscsi_target
9953 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager run_as_root=True)
9954 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/cinder/utils.py", line 126, in execute
9955 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager return processutils.execute(*cmd, **kwargs)
9956 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/oslo_concurrency/processutils.py", line 424, in execute
9957 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager cmd=sanitized_cmd)
9958 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager ProcessExecutionError: Unexpected error while running command.
9959 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf tgtadm --lld iscsi --op show --mode target
9960 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager Exit code: 107
9961 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager Stdout: u''
9962 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager Stderr: u'tgtadm: failed to send request hdr to tgt daemon, Transport endpoint is not connected\n' |
|
| 2022-09-02 02:41:03 |
Bug Watch Updater |
cinder (Debian): status |
Unknown |
Fix Released |
|
| 2023-10-18 16:49:50 |
Mauricio Faria de Oliveira |
summary |
"Failed to re-export volume, setting to ERROR" with "tgtadm: failed to send request hdr to tgt daemon, Transport endpoint is not connected" on cinder-volume service start |
cinder-volume: "Failed to re-export volume, setting to ERROR" with "tgtadm: failed to send request hdr to tgt daemon, Transport endpoint is not connected" on service startup |
|
| 2023-10-18 17:54:29 |
Mauricio Faria de Oliveira |
description |
Debian bug #1018084 [1]
Debian MR on Salsa: [2]
[1] https://bugs.debian.org/1018084
[2] https://salsa.debian.org/openstack-team/services/cinder/-/merge_requests/2
Problem:
The cinder-volume.service unit is _not_ ordered after the tgt.service unit,
and thus might fail to run 'tgtadm' commands because tgtd is not yet ready,
on service start up / boot:
INFO cinder.service [-] Starting cinder-volume node (version 12.0.9)
...
ERROR cinder.volume.manager [req-UUID - - - - -] Failed to re-export volume, setting to ERROR.: ProcessExecutionError: Unexpected error while running command.
Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf tgtadm --lld iscsi --op show --mode target
Exit code: 107
Stdout: u''
Stderr: u'tgtadm: failed to send request hdr to tgt daemon, Transport endpoint is not connected\n'
Approach:
It should be OK to order `cinder-volume.service` (generated from `cinder-volume.init.in` template) with `After=tgt.service`,
as the `cinder-volume` package has a `Depends: tgt` dependency, and actually restarts `tgt` on its install/remove scripts,
thus it is already strongly bound to `tgt` at the packaging level, even if its runtime usage is optional (eg, other drivers).
# dpkg -s cinder-volume | grep Depends:
Depends: ..., tgt, ...
Real-world example:
1) Unit `ovs-vswitchd.service` took 2 minutes to start up.
2) That delayed `network.target` (`ovs-vswitchd.service` has `Before=network.target`).
3) That delayed `tgt.service` too (it has `After=network.target`).
4) BUT that did _not_ delay `cinder-volume.service` (it does _not_ have `After=tgt.service`)
5) So it failed to talk to tgtd with tgtadm, and volume re-export failed.
$ cat sos_commands/logs/journalctl_--no-pager_--catalog_--boot \
| grep -E -B1 'Subject: Unit (cinder-volume.service|tgt.service|ovs-vswitchd.service|network.target)'
Aug 10 06:23:15 <HOST> systemd[1]: Started OpenStack Cinder Volume.
-- Subject: Unit cinder-volume.service has finished start-up
--
<<< ERROR in cinder-volume.log >>>
Aug 10 06:23:16 <HOST> systemd[1]: Starting Open vSwitch Forwarding Unit...
-- Subject: Unit ovs-vswitchd.service has begun start-up
--
<<< DELAY of 2 minutes >>>
Aug 10 06:25:17 <HOST> systemd[1]: Started Open vSwitch Forwarding Unit.
-- Subject: Unit ovs-vswitchd.service has finished start-up
--
Aug 10 06:25:17 <HOST> systemd[1]: Reached target Network.
-- Subject: Unit network.target has finished start-up
--
Aug 10 06:25:17 <HOST> systemd[1]: Starting (i)SCSI target daemon...
-- Subject: Unit tgt.service has begun start-up
--
Aug 10 06:25:19 <HOST> systemd[1]: Started (i)SCSI target daemon.
-- Subject: Unit tgt.service has finished start-up
<<< NOW tgtd is running >>>
@ var/log/cinder/cinder-volume.log
9901 2022-08-10 06:23:21.515 3939 INFO cinder.service [-] Starting cinder-volume node (version 12.0.9)
...
9932 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager [req-e67a852a-6cce-4073-a2de-d3487c85d586 - - - - -] Failed to re-export volume, setting to ERROR.: ProcessExecutionError: Unexpected error while running command.
9933 Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf tgtadm --lld iscsi --op show --mode target
9934 Exit code: 107
9935 Stdout: u''
9936 Stderr: u'tgtadm: failed to send request hdr to tgt daemon, Transport endpoint is not connected\n'
9937 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager Traceback (most recent call last):
9938 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/cinder/volume/manager.py", line 486, in init_host
9939 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager self.driver.ensure_export(ctxt, volume)
9940 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 826, in ensure_export
9941 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager self.target_driver.ensure_export(context, volume, volume_path)
9942 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/cinder/volume/targets/iscsi.py", line 261, in ensure_export
9943 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager old_name=None, **portals_config)
9944 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/cinder/utils.py", line 818, in _wrapper
9945 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager return r.call(f, *args, **kwargs)
9946 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/retrying.py", line 206, in call
9947 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager return attempt.get(self._wrap_exception)
9948 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/retrying.py", line 247, in get
9949 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager six.reraise(self.value[0], self.value[1], self.value[2])
9950 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/retrying.py", line 200, in call
9951 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
9952 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/cinder/volume/targets/tgt.py", line 141, in create_iscsi_target
9953 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager run_as_root=True)
9954 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/cinder/utils.py", line 126, in execute
9955 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager return processutils.execute(*cmd, **kwargs)
9956 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/oslo_concurrency/processutils.py", line 424, in execute
9957 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager cmd=sanitized_cmd)
9958 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager ProcessExecutionError: Unexpected error while running command.
9959 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf tgtadm --lld iscsi --op show --mode target
9960 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager Exit code: 107
9961 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager Stdout: u''
9962 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager Stderr: u'tgtadm: failed to send request hdr to tgt daemon, Transport endpoint is not connected\n' |
[Impact]
* The cinder-volume service might fail to re-export volumes
in-use on startup if tgt.service isn't fully started yet.
* This affects the 'lvm' driver with 'tgtadm' target helper
(which runs 'tgtadm' commands that need the service ready).
* Snippets from /var/log/cinder/cinder-volume.log:
Failed to re-export volume, setting to ERROR.
...
Command: tgtadm --lld iscsi --op show --mode target
...
Stderr: 'tgtadm: failed to send request hdr to tgt daemon,
Transport endpoint is not connected\n'
* This issue is more common in openstack compute nodes
with networking (ovs/ovn) that takes long to startup,
which might delay the startup of tgt.service _after_
cinder-volume.service.
[Test Steps]
* Steps to reproduce are detailed in comment #2.
Summary:
* Install mysql, rabbitmq-server, keystone, and cinder
(controller and storage nodes; backup node unneeded).
* Configure cinder-volume (storage node) for LVM backend
and tgtadm iSCSI helper (tgt.service).
* Create a cinder volume, and configure it as 'in-use'.
* Simulate a start delay on tgt.service with a drop-in.
* Restart services: cinder-volume.service tgt.service
* Check sequence of service startup.
* Check status of the cinder volume:
'in-use' (expected) or 'error' (bug).
* Check log file /var/log/cinder/cinder-volume.log for
'tgtadm: failed to send request hdr to tgt daemon'.
[Regression Potential]
* The fix introduces systemd unit 'After=' and 'Wants='
properties for tgt.service in cinder-volume.service,
thus might delay the boot process (multi-user.target).
$ systemctl show cinder-volume.service | grep WantedBy=
WantedBy=multi-user.target
* However, the boot process already waits on tgt.service
anyway, thus the difference (if any) should not be big,
and would provide more correct behavior.
$ systemctl show tgt.service | grep WantedBy=
WantedBy=multi-user.target
* If tgt.service is not present (tgt package not installed)
_no errors_ occur, as both 'After=' and 'Wants=' are weak
ordering/dependency properties (man 5 systemd.unit).
[Other Info]
* The fix uses a systemd service drop-in snippet because
the service unit is generated by openstack-pkg-tools
(pkgos-gen-systemd-unit) based on the 'init' service,
and it only emits 'Wants=' for network-online.target.
* Changing that in openstack-pkg-tools changes behavior
in stable releases, and only manifest at build time,
for many openstack packages that have no issues now.
* We'll continue to pursue the general improvement in
Debian, so it comes into Ubuntu development release,
but for the Ubuntu stable releases, this should do.
[Original Bug Description]
Real-world example:
1) Unit `ovs-vswitchd.service` took 2 minutes to start up.
2) That delayed `network.target` (`ovs-vswitchd.service` has `Before=network.target`).
3) That delayed `tgt.service` too (it has `After=network.target`).
4) BUT that did _not_ delay `cinder-volume.service` (it does _not_ have `After=tgt.service`)
5) So it failed to talk to tgtd with tgtadm, and volume re-export failed.
$ cat sos_commands/logs/journalctl_--no-pager_--catalog_--boot \
| grep -E -B1 'Subject: Unit (cinder-volume.service|tgt.service|ovs-vswitchd.service|network.target)'
Aug 10 06:23:15 <HOST> systemd[1]: Started OpenStack Cinder Volume.
-- Subject: Unit cinder-volume.service has finished start-up
--
<<< ERROR in cinder-volume.log >>>
Aug 10 06:23:16 <HOST> systemd[1]: Starting Open vSwitch Forwarding Unit...
-- Subject: Unit ovs-vswitchd.service has begun start-up
--
<<< DELAY of 2 minutes >>>
Aug 10 06:25:17 <HOST> systemd[1]: Started Open vSwitch Forwarding Unit.
-- Subject: Unit ovs-vswitchd.service has finished start-up
--
Aug 10 06:25:17 <HOST> systemd[1]: Reached target Network.
-- Subject: Unit network.target has finished start-up
--
Aug 10 06:25:17 <HOST> systemd[1]: Starting (i)SCSI target daemon...
-- Subject: Unit tgt.service has begun start-up
--
Aug 10 06:25:19 <HOST> systemd[1]: Started (i)SCSI target daemon.
-- Subject: Unit tgt.service has finished start-up
<<< NOW tgtd is running >>>
@ var/log/cinder/cinder-volume.log
9901 2022-08-10 06:23:21.515 3939 INFO cinder.service [-] Starting cinder-volume node (version 12.0.9)
...
9932 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager [req-e67a852a-6cce-4073-a2de-d3487c85d586 - - - - -] Failed to re-export volume, setting to ERROR.: ProcessExecutionError: Unexpected error while running command.
9933 Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf tgtadm --lld iscsi --op show --mode target
9934 Exit code: 107
9935 Stdout: u''
9936 Stderr: u'tgtadm: failed to send request hdr to tgt daemon, Transport endpoint is not connected\n'
9937 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager Traceback (most recent call last):
9938 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/cinder/volume/manager.py", line 486, in init_host
9939 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager self.driver.ensure_export(ctxt, volume)
9940 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 826, in ensure_export
9941 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager self.target_driver.ensure_export(context, volume, volume_path)
9942 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/cinder/volume/targets/iscsi.py", line 261, in ensure_export
9943 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager old_name=None, **portals_config)
9944 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/cinder/utils.py", line 818, in _wrapper
9945 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager return r.call(f, *args, **kwargs)
9946 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/retrying.py", line 206, in call
9947 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager return attempt.get(self._wrap_exception)
9948 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/retrying.py", line 247, in get
9949 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager six.reraise(self.value[0], self.value[1], self.value[2])
9950 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/retrying.py", line 200, in call
9951 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
9952 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/cinder/volume/targets/tgt.py", line 141, in create_iscsi_target
9953 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager run_as_root=True)
9954 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/cinder/utils.py", line 126, in execute
9955 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager return processutils.execute(*cmd, **kwargs)
9956 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/oslo_concurrency/processutils.py", line 424, in execute
9957 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager cmd=sanitized_cmd)
9958 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager ProcessExecutionError: Unexpected error while running command.
9959 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf tgtadm --lld iscsi --op show --mode target
9960 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager Exit code: 107
9961 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager Stdout: u''
9962 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager Stderr: u'tgtadm: failed to send request hdr to tgt daemon, Transport endpoint is not connected\n' |
|
| 2023-10-18 18:03:35 |
Mauricio Faria de Oliveira |
description |
[Impact]
* The cinder-volume service might fail to re-export volumes
in-use on startup if tgt.service isn't fully started yet.
* This affects the 'lvm' driver with 'tgtadm' target helper
(which runs 'tgtadm' commands that need the service ready).
* Snippets from /var/log/cinder/cinder-volume.log:
Failed to re-export volume, setting to ERROR.
...
Command: tgtadm --lld iscsi --op show --mode target
...
Stderr: 'tgtadm: failed to send request hdr to tgt daemon,
Transport endpoint is not connected\n'
* This issue is more common in openstack compute nodes
with networking (ovs/ovn) that takes long to startup,
which might delay the startup of tgt.service _after_
cinder-volume.service.
[Test Steps]
* Steps to reproduce are detailed in comment #2.
Summary:
* Install mysql, rabbitmq-server, keystone, and cinder
(controller and storage nodes; backup node unneeded).
* Configure cinder-volume (storage node) for LVM backend
and tgtadm iSCSI helper (tgt.service).
* Create a cinder volume, and configure it as 'in-use'.
* Simulate a start delay on tgt.service with a drop-in.
* Restart services: cinder-volume.service tgt.service
* Check sequence of service startup.
* Check status of the cinder volume:
'in-use' (expected) or 'error' (bug).
* Check log file /var/log/cinder/cinder-volume.log for
'tgtadm: failed to send request hdr to tgt daemon'.
[Regression Potential]
* The fix introduces systemd unit 'After=' and 'Wants='
properties for tgt.service in cinder-volume.service,
thus might delay the boot process (multi-user.target).
$ systemctl show cinder-volume.service | grep WantedBy=
WantedBy=multi-user.target
* However, the boot process already waits on tgt.service
anyway, thus the difference (if any) should not be big,
and would provide more correct behavior.
$ systemctl show tgt.service | grep WantedBy=
WantedBy=multi-user.target
* If tgt.service is not present (tgt package not installed)
_no errors_ occur, as both 'After=' and 'Wants=' are weak
ordering/dependency properties (man 5 systemd.unit).
[Other Info]
* The fix uses a systemd service drop-in snippet because
the service unit is generated by openstack-pkg-tools
(pkgos-gen-systemd-unit) based on the 'init' service,
and it only emits 'Wants=' for network-online.target.
* Changing that in openstack-pkg-tools changes behavior
in stable releases, and only manifest at build time,
for many openstack packages that have no issues now.
* We'll continue to pursue the general improvement in
Debian, so it comes into Ubuntu development release,
but for the Ubuntu stable releases, this should do.
[Original Bug Description]
Real-world example:
1) Unit `ovs-vswitchd.service` took 2 minutes to start up.
2) That delayed `network.target` (`ovs-vswitchd.service` has `Before=network.target`).
3) That delayed `tgt.service` too (it has `After=network.target`).
4) BUT that did _not_ delay `cinder-volume.service` (it does _not_ have `After=tgt.service`)
5) So it failed to talk to tgtd with tgtadm, and volume re-export failed.
$ cat sos_commands/logs/journalctl_--no-pager_--catalog_--boot \
| grep -E -B1 'Subject: Unit (cinder-volume.service|tgt.service|ovs-vswitchd.service|network.target)'
Aug 10 06:23:15 <HOST> systemd[1]: Started OpenStack Cinder Volume.
-- Subject: Unit cinder-volume.service has finished start-up
--
<<< ERROR in cinder-volume.log >>>
Aug 10 06:23:16 <HOST> systemd[1]: Starting Open vSwitch Forwarding Unit...
-- Subject: Unit ovs-vswitchd.service has begun start-up
--
<<< DELAY of 2 minutes >>>
Aug 10 06:25:17 <HOST> systemd[1]: Started Open vSwitch Forwarding Unit.
-- Subject: Unit ovs-vswitchd.service has finished start-up
--
Aug 10 06:25:17 <HOST> systemd[1]: Reached target Network.
-- Subject: Unit network.target has finished start-up
--
Aug 10 06:25:17 <HOST> systemd[1]: Starting (i)SCSI target daemon...
-- Subject: Unit tgt.service has begun start-up
--
Aug 10 06:25:19 <HOST> systemd[1]: Started (i)SCSI target daemon.
-- Subject: Unit tgt.service has finished start-up
<<< NOW tgtd is running >>>
@ var/log/cinder/cinder-volume.log
9901 2022-08-10 06:23:21.515 3939 INFO cinder.service [-] Starting cinder-volume node (version 12.0.9)
...
9932 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager [req-e67a852a-6cce-4073-a2de-d3487c85d586 - - - - -] Failed to re-export volume, setting to ERROR.: ProcessExecutionError: Unexpected error while running command.
9933 Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf tgtadm --lld iscsi --op show --mode target
9934 Exit code: 107
9935 Stdout: u''
9936 Stderr: u'tgtadm: failed to send request hdr to tgt daemon, Transport endpoint is not connected\n'
9937 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager Traceback (most recent call last):
9938 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/cinder/volume/manager.py", line 486, in init_host
9939 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager self.driver.ensure_export(ctxt, volume)
9940 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 826, in ensure_export
9941 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager self.target_driver.ensure_export(context, volume, volume_path)
9942 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/cinder/volume/targets/iscsi.py", line 261, in ensure_export
9943 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager old_name=None, **portals_config)
9944 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/cinder/utils.py", line 818, in _wrapper
9945 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager return r.call(f, *args, **kwargs)
9946 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/retrying.py", line 206, in call
9947 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager return attempt.get(self._wrap_exception)
9948 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/retrying.py", line 247, in get
9949 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager six.reraise(self.value[0], self.value[1], self.value[2])
9950 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/retrying.py", line 200, in call
9951 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
9952 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/cinder/volume/targets/tgt.py", line 141, in create_iscsi_target
9953 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager run_as_root=True)
9954 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/cinder/utils.py", line 126, in execute
9955 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager return processutils.execute(*cmd, **kwargs)
9956 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager File "/usr/lib/python2.7/dist-packages/oslo_concurrency/processutils.py", line 424, in execute
9957 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager cmd=sanitized_cmd)
9958 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager ProcessExecutionError: Unexpected error while running command.
9959 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf tgtadm --lld iscsi --op show --mode target
9960 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager Exit code: 107
9961 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager Stdout: u''
9962 2022-08-10 06:23:23.398 3932 ERROR cinder.volume.manager Stderr: u'tgtadm: failed to send request hdr to tgt daemon, Transport endpoint is not connected\n' |
[Impact]
* The cinder-volume service might fail to re-export volumes
in-use on startup if tgt.service isn't fully started yet.
* This affects the 'lvm' driver with 'tgtadm' target helper
(which runs 'tgtadm' commands that need the service ready).
* Snippets from /var/log/cinder/cinder-volume.log:
Failed to re-export volume, setting to ERROR.
...
Command: tgtadm --lld iscsi --op show --mode target
...
Stderr: 'tgtadm: failed to send request hdr to tgt daemon,
Transport endpoint is not connected\n'
* This issue is more common in openstack compute nodes
with networking (ovs/ovn) that takes long to startup,
which might delay the startup of tgt.service _after_
cinder-volume.service.
[Test Steps]
* Steps to reproduce are detailed in comment #3.
Summary:
* Install mysql, rabbitmq-server, keystone, and cinder
(controller and storage nodes; backup node unneeded).
* Configure cinder-volume (storage node) for LVM backend
and tgtadm iSCSI helper (tgt.service).
* Create a cinder volume, and configure it as 'in-use'.
* Simulate a start delay on tgt.service with a drop-in.
* Restart services: cinder-volume.service tgt.service
* Check sequence of service startup.
* Check status of the cinder volume:
'in-use' (expected) or 'error' (bug).
* Check log file /var/log/cinder/cinder-volume.log for
'tgtadm: failed to send request hdr to tgt daemon'.
[Regression Potential]
* The fix introduces systemd unit 'After=' and 'Wants='
properties for tgt.service in cinder-volume.service,
thus might delay the boot process (multi-user.target).
$ systemctl show cinder-volume.service | grep WantedBy=
WantedBy=multi-user.target
* However, the boot process already waits on tgt.service
anyway, thus the difference (if any) should not be big,
and would provide more correct behavior.
$ systemctl show tgt.service | grep WantedBy=
WantedBy=multi-user.target
* If tgt.service is not present (tgt package not installed)
_no errors_ occur, as both 'After=' and 'Wants=' are weak
ordering/dependency properties (man 5 systemd.unit).
[Other Info]
* The fix uses a systemd service drop-in snippet because
the service unit is generated by openstack-pkg-tools
(pkgos-gen-systemd-unit) based on the 'init' service,
and it only emits 'Wants=' for network-online.target.
* Changing that in openstack-pkg-tools changes behavior
in stable releases, and only manifest at build time,
for many openstack packages that have no issues now.
* We'll continue to pursue the general improvement in
Debian, so it comes into Ubuntu development release,
but for the Ubuntu stable releases, this should do.
[Original Bug Description]
Real-world example in comment #2. |
|
| 2023-10-18 18:28:00 |
Launchpad Janitor |
merge proposal linked |
|
https://code.launchpad.net/~mfo/ubuntu/+source/cinder/+git/cinder/+merge/453937 |
|
| 2023-10-18 18:28:33 |
Mauricio Faria de Oliveira |
nominated for series |
|
Ubuntu Jammy |
|
| 2023-10-18 18:28:33 |
Mauricio Faria de Oliveira |
bug task added |
|
cinder (Ubuntu Jammy) |
|
| 2023-10-18 18:28:33 |
Mauricio Faria de Oliveira |
nominated for series |
|
Ubuntu Focal |
|
| 2023-10-18 18:28:33 |
Mauricio Faria de Oliveira |
bug task added |
|
cinder (Ubuntu Focal) |
|
| 2023-10-18 18:28:33 |
Mauricio Faria de Oliveira |
nominated for series |
|
Ubuntu Bionic |
|
| 2023-10-18 18:28:33 |
Mauricio Faria de Oliveira |
bug task added |
|
cinder (Ubuntu Bionic) |
|
| 2023-10-18 18:28:33 |
Mauricio Faria de Oliveira |
nominated for series |
|
Ubuntu Mantic |
|
| 2023-10-18 18:28:33 |
Mauricio Faria de Oliveira |
bug task added |
|
cinder (Ubuntu Mantic) |
|
| 2023-10-18 18:28:33 |
Mauricio Faria de Oliveira |
nominated for series |
|
Ubuntu Lunar |
|
| 2023-10-18 18:28:33 |
Mauricio Faria de Oliveira |
bug task added |
|
cinder (Ubuntu Lunar) |
|
| 2023-10-18 18:28:41 |
Mauricio Faria de Oliveira |
cinder (Ubuntu Bionic): status |
New |
Won't Fix |
|
| 2023-10-18 18:28:45 |
Mauricio Faria de Oliveira |
cinder (Ubuntu Focal): status |
New |
Confirmed |
|
| 2023-10-18 18:28:48 |
Mauricio Faria de Oliveira |
cinder (Ubuntu Jammy): status |
New |
Confirmed |
|
| 2023-10-18 18:28:51 |
Mauricio Faria de Oliveira |
cinder (Ubuntu Lunar): status |
New |
Confirmed |
|
| 2023-10-18 18:29:02 |
Mauricio Faria de Oliveira |
bug task deleted |
cinder (Debian) |
|
|
| 2023-10-18 18:29:13 |
Mauricio Faria de Oliveira |
cinder (Ubuntu Bionic): importance |
Undecided |
Medium |
|
| 2023-10-18 18:29:15 |
Mauricio Faria de Oliveira |
cinder (Ubuntu Focal): importance |
Undecided |
Medium |
|
| 2023-10-18 18:29:16 |
Mauricio Faria de Oliveira |
cinder (Ubuntu Jammy): importance |
Undecided |
Medium |
|
| 2023-10-18 18:29:18 |
Mauricio Faria de Oliveira |
cinder (Ubuntu Lunar): importance |
Undecided |
Medium |
|
| 2023-10-18 18:29:20 |
Mauricio Faria de Oliveira |
cinder (Ubuntu Bionic): assignee |
|
Mauricio Faria de Oliveira (mfo) |
|
| 2023-10-18 18:29:21 |
Mauricio Faria de Oliveira |
cinder (Ubuntu Focal): assignee |
|
Mauricio Faria de Oliveira (mfo) |
|
| 2023-10-18 18:29:23 |
Mauricio Faria de Oliveira |
cinder (Ubuntu Jammy): assignee |
|
Mauricio Faria de Oliveira (mfo) |
|
| 2023-10-18 18:29:24 |
Mauricio Faria de Oliveira |
cinder (Ubuntu Lunar): assignee |
|
Mauricio Faria de Oliveira (mfo) |
|
| 2023-10-24 21:34:17 |
Launchpad Janitor |
merge proposal linked |
|
https://code.launchpad.net/~mfo/ubuntu/+source/cinder/+git/cinder/+merge/454428 |
|
| 2023-11-10 17:30:17 |
Launchpad Janitor |
merge proposal linked |
|
https://code.launchpad.net/~mfo/ubuntu/+source/cinder/+git/cinder/+merge/455467 |
|
| 2024-01-02 18:24:04 |
Mauricio Faria de Oliveira |
nominated for series |
|
Ubuntu Noble |
|
| 2024-01-02 18:24:04 |
Mauricio Faria de Oliveira |
bug task added |
|
cinder (Ubuntu Noble) |
|
| 2024-01-02 18:24:10 |
Mauricio Faria de Oliveira |
cinder (Ubuntu Noble): status |
In Progress |
Fix Committed |
|
| 2024-01-02 18:28:14 |
Mauricio Faria de Oliveira |
cinder (Ubuntu Mantic): status |
In Progress |
Confirmed |
|
| 2024-01-03 10:42:47 |
Launchpad Janitor |
cinder (Ubuntu Noble): status |
Fix Committed |
Fix Released |
|
| 2024-02-06 15:45:28 |
Heather Lemon |
cinder (Ubuntu Lunar): status |
Confirmed |
Won't Fix |
|
| 2024-02-06 15:45:36 |
Heather Lemon |
cinder (Ubuntu Lunar): assignee |
Mauricio Faria de Oliveira (mfo) |
|
|
| 2024-02-06 15:45:47 |
Heather Lemon |
cinder (Ubuntu Bionic): assignee |
Mauricio Faria de Oliveira (mfo) |
|
|
| 2024-02-16 15:49:12 |
Heather Lemon |
attachment added |
|
lp1987663-jammy.debdiff https://bugs.launchpad.net/ubuntu/+source/cinder/+bug/1987663/+attachment/5746671/+files/lp1987663-jammy.debdiff |
|
| 2024-02-16 16:46:07 |
Heather Lemon |
attachment added |
|
lp1987663-focal.debdiff https://bugs.launchpad.net/ubuntu/+source/cinder/+bug/1987663/+attachment/5746673/+files/lp1987663-focal.debdiff |
|
| 2024-02-16 17:26:38 |
Heather Lemon |
attachment added |
|
lp1987663-mantic.debdiff https://bugs.launchpad.net/ubuntu/+source/cinder/+bug/1987663/+attachment/5746689/+files/lp1987663-mantic.debdiff |
|
| 2024-02-16 17:27:00 |
Heather Lemon |
cinder (Ubuntu Focal): status |
Confirmed |
In Progress |
|
| 2024-02-16 17:27:02 |
Heather Lemon |
cinder (Ubuntu Jammy): status |
Confirmed |
In Progress |
|
| 2024-02-16 17:27:06 |
Heather Lemon |
cinder (Ubuntu Mantic): status |
Confirmed |
In Progress |
|
| 2024-02-26 14:58:46 |
Edward Hope-Morley |
bug task added |
|
cloud-archive |
|
| 2024-02-26 14:59:17 |
Edward Hope-Morley |
nominated for series |
|
cloud-archive/antelope |
|
| 2024-02-26 14:59:17 |
Edward Hope-Morley |
bug task added |
|
cloud-archive/antelope |
|
| 2024-02-26 14:59:17 |
Edward Hope-Morley |
nominated for series |
|
cloud-archive/caracal |
|
| 2024-02-26 14:59:17 |
Edward Hope-Morley |
bug task added |
|
cloud-archive/caracal |
|
| 2024-02-26 14:59:17 |
Edward Hope-Morley |
nominated for series |
|
cloud-archive/xena |
|
| 2024-02-26 14:59:17 |
Edward Hope-Morley |
bug task added |
|
cloud-archive/xena |
|
| 2024-02-26 14:59:17 |
Edward Hope-Morley |
nominated for series |
|
cloud-archive/yoga |
|
| 2024-02-26 14:59:17 |
Edward Hope-Morley |
bug task added |
|
cloud-archive/yoga |
|
| 2024-02-26 14:59:17 |
Edward Hope-Morley |
nominated for series |
|
cloud-archive/wallaby |
|
| 2024-02-26 14:59:17 |
Edward Hope-Morley |
bug task added |
|
cloud-archive/wallaby |
|
| 2024-02-26 14:59:17 |
Edward Hope-Morley |
nominated for series |
|
cloud-archive/victoria |
|
| 2024-02-26 14:59:17 |
Edward Hope-Morley |
bug task added |
|
cloud-archive/victoria |
|
| 2024-02-26 14:59:17 |
Edward Hope-Morley |
nominated for series |
|
cloud-archive/zed |
|
| 2024-02-26 14:59:17 |
Edward Hope-Morley |
bug task added |
|
cloud-archive/zed |
|
| 2024-02-26 14:59:17 |
Edward Hope-Morley |
nominated for series |
|
cloud-archive/bobcat |
|
| 2024-02-26 14:59:17 |
Edward Hope-Morley |
bug task added |
|
cloud-archive/bobcat |
|
| 2024-02-26 14:59:17 |
Edward Hope-Morley |
nominated for series |
|
cloud-archive/ussuri |
|
| 2024-02-26 14:59:17 |
Edward Hope-Morley |
bug task added |
|
cloud-archive/ussuri |
|
| 2024-02-26 14:59:42 |
Edward Hope-Morley |
cloud-archive/caracal: status |
New |
Fix Released |
|
| 2024-03-01 17:17:53 |
Mauricio Faria de Oliveira |
cinder (Ubuntu Mantic): status |
In Progress |
Incomplete |
|
| 2024-03-01 17:18:01 |
Mauricio Faria de Oliveira |
cinder (Ubuntu Jammy): status |
In Progress |
Incomplete |
|
| 2024-03-01 17:18:09 |
Mauricio Faria de Oliveira |
cinder (Ubuntu Focal): status |
In Progress |
Incomplete |
|
| 2024-03-12 14:06:23 |
Heather Lemon |
bug |
|
|
added subscriber Heather Lemon |
| 2024-03-19 11:54:11 |
James Page |
cloud-archive/victoria: status |
New |
Won't Fix |
|
| 2024-03-19 11:54:26 |
James Page |
cloud-archive/xena: status |
New |
Won't Fix |
|
| 2024-04-08 15:36:48 |
James Page |
cinder (Ubuntu Mantic): status |
Incomplete |
New |
|
| 2024-04-08 15:36:56 |
James Page |
cinder (Ubuntu Jammy): status |
Incomplete |
New |
|
| 2024-04-08 15:37:04 |
James Page |
cinder (Ubuntu Focal): status |
Incomplete |
New |
|
| 2024-04-08 15:38:26 |
James Page |
cloud-archive/zed: status |
New |
Invalid |
|
| 2024-04-08 15:38:38 |
James Page |
cloud-archive/zed: status |
Invalid |
Won't Fix |
|
| 2024-04-17 16:51:33 |
Mauricio Faria de Oliveira |
cinder (Ubuntu Lunar): importance |
Medium |
Undecided |
|
| 2024-04-19 12:26:07 |
Mauricio Faria de Oliveira |
cloud-archive/wallaby: status |
New |
Won't Fix |
|
| 2024-04-19 12:27:39 |
Mauricio Faria de Oliveira |
cloud-archive/ussuri: status |
New |
Incomplete |
|
| 2024-04-19 15:59:44 |
Mauricio Faria de Oliveira |
cinder (Ubuntu Mantic): status |
New |
In Progress |
|
| 2024-04-19 15:59:55 |
Mauricio Faria de Oliveira |
cinder (Ubuntu Jammy): status |
New |
In Progress |
|
| 2024-04-19 16:00:09 |
Mauricio Faria de Oliveira |
cinder (Ubuntu Focal): status |
New |
In Progress |
|
| 2024-04-19 16:00:33 |
Mauricio Faria de Oliveira |
cloud-archive/yoga: status |
New |
In Progress |
|
| 2024-04-19 16:00:51 |
Mauricio Faria de Oliveira |
cloud-archive/bobcat: status |
New |
In Progress |
|
| 2024-04-19 16:01:27 |
Mauricio Faria de Oliveira |
cloud-archive/antelope: status |
New |
Incomplete |
|
| 2024-04-19 16:02:27 |
Mauricio Faria de Oliveira |
cloud-archive/antelope: status |
Incomplete |
Triaged |
|
| 2024-04-19 16:02:37 |
Mauricio Faria de Oliveira |
cloud-archive/ussuri: status |
Incomplete |
Triaged |
|
| 2024-04-26 07:40:36 |
Timo Aaltonen |
cinder (Ubuntu Mantic): status |
In Progress |
Fix Committed |
|
| 2024-04-26 07:40:37 |
Timo Aaltonen |
bug |
|
|
added subscriber Ubuntu Stable Release Updates Team |
| 2024-04-26 07:40:51 |
Timo Aaltonen |
bug |
|
|
added subscriber SRU Verification |
| 2024-04-26 07:40:58 |
Timo Aaltonen |
tags |
|
verification-needed verification-needed-mantic |
|
| 2024-04-26 07:43:09 |
Timo Aaltonen |
cinder (Ubuntu Jammy): status |
In Progress |
Fix Committed |
|
| 2024-04-26 07:43:13 |
Timo Aaltonen |
tags |
verification-needed verification-needed-mantic |
verification-needed verification-needed-jammy verification-needed-mantic |
|
| 2024-04-26 07:46:15 |
Timo Aaltonen |
cinder (Ubuntu Focal): status |
In Progress |
Fix Committed |
|
| 2024-04-26 07:46:20 |
Timo Aaltonen |
tags |
verification-needed verification-needed-jammy verification-needed-mantic |
verification-needed verification-needed-focal verification-needed-jammy verification-needed-mantic |
|
| 2024-04-30 18:09:23 |
Mauricio Faria de Oliveira |
attachment added |
|
2024 04 30 proposed verification mantic jammy focal.txt https://bugs.launchpad.net/cloud-archive/ussuri/+bug/1987663/+attachment/5773339/+files/2024%2004%2030%20proposed%20verification%20mantic%20jammy%20focal.txt |
|
| 2024-04-30 18:09:42 |
Mauricio Faria de Oliveira |
tags |
verification-needed verification-needed-focal verification-needed-jammy verification-needed-mantic |
verification-done verification-done-focal verification-done-jammy verification-done-mantic |
|
| 2024-05-09 16:08:43 |
Launchpad Janitor |
cinder (Ubuntu Mantic): status |
Fix Committed |
Fix Released |
|
| 2024-05-09 16:08:53 |
Andreas Hasenack |
removed subscriber Ubuntu Stable Release Updates Team |
|
|
|
| 2024-05-28 22:03:31 |
Launchpad Janitor |
cinder (Ubuntu Focal): status |
Fix Committed |
Fix Released |
|
| 2024-05-28 22:03:49 |
Launchpad Janitor |
cinder (Ubuntu Jammy): status |
Fix Committed |
Fix Released |
|
| 2024-06-05 08:11:34 |
James Page |
cloud-archive/yoga: status |
In Progress |
Fix Committed |
|
| 2024-06-05 08:11:36 |
James Page |
tags |
verification-done verification-done-focal verification-done-jammy verification-done-mantic |
verification-done verification-done-focal verification-done-jammy verification-done-mantic verification-yoga-needed |
|
