Activity log for bug #1872813

Date Who What changed Old value New value Message
2020-04-14 19:54:20 Dan Watkins bug added bug
2020-04-14 19:54:38 Dan Watkins cloud-init: assignee Dan Watkins (daniel-thewatkins)
2020-04-14 19:55:21 Dan Watkins attachment added cloud-init.tar.gz https://bugs.launchpad.net/cloud-init/+bug/1872813/+attachment/5354111/+files/cloud-init.tar.gz
2020-04-14 19:55:31 Dan Watkins cloud-init: status New In Progress
2020-04-14 20:52:22 Dan Watkins bug task added open-iscsi (Ubuntu)
2020-04-14 20:52:32 Dan Watkins cloud-init: status In Progress Invalid
2020-04-14 20:55:56 John Chittum bug added subscriber John Chittum
2020-04-15 15:46:43 Dan Watkins open-iscsi (Ubuntu): assignee Dan Watkins (daniel-thewatkins)
2020-04-15 15:46:45 Dan Watkins open-iscsi (Ubuntu): status New In Progress
2020-04-15 15:51:44 Steve Langasek open-iscsi (Ubuntu Focal): status In Progress Fix Committed
2020-04-15 15:51:47 Steve Langasek bug added subscriber Ubuntu Stable Release Updates Team
2020-04-15 15:51:52 Steve Langasek bug added subscriber SRU Verification
2020-04-15 15:51:58 Steve Langasek tags verification-needed verification-needed-focal
2020-04-15 20:47:22 Launchpad Janitor open-iscsi (Ubuntu Focal): status Fix Committed Fix Released
2020-04-21 12:23:34 Francis Ginther tags verification-needed verification-needed-focal id-5bbe5d6e338b8e69a2c66363 verification-needed verification-needed-focal
2020-08-13 04:43:44 Launchpad Janitor merge proposal linked https://code.launchpad.net/~rafaeldtinoco/+git/open-iscsi/+merge/389217
2020-08-13 04:47:37 Rafael David Tinoco merge proposal unlinked https://code.launchpad.net/~rafaeldtinoco/+git/open-iscsi/+merge/389217
2020-08-13 13:07:40 Launchpad Janitor merge proposal linked https://code.launchpad.net/~rafaeldtinoco/ubuntu/+source/open-iscsi/+git/open-iscsi/+merge/389234
2020-08-13 13:17:33 Rafael David Tinoco merge proposal unlinked https://code.launchpad.net/~rafaeldtinoco/ubuntu/+source/open-iscsi/+git/open-iscsi/+merge/389234
2020-08-13 14:21:01 Launchpad Janitor merge proposal linked https://code.launchpad.net/~rafaeldtinoco/ubuntu/+source/open-iscsi/+git/open-iscsi/+merge/389234
2020-08-19 19:21:03 Launchpad Janitor merge proposal linked https://code.launchpad.net/~rafaeldtinoco/ubuntu/+source/open-iscsi/+git/open-iscsi/+merge/389565
2020-12-03 13:57:19 Launchpad Janitor merge proposal linked https://code.launchpad.net/~paelzer/ubuntu/+source/open-iscsi/+git/open-iscsi/+merge/394815
2020-12-04 07:32:37 Christian Ehrhardt  merge proposal unlinked https://code.launchpad.net/~paelzer/ubuntu/+source/open-iscsi/+git/open-iscsi/+merge/394815
2021-01-19 12:43:09 Launchpad Janitor merge proposal linked https://code.launchpad.net/~paelzer/ubuntu/+source/open-iscsi/+git/open-iscsi/+merge/396493
2022-04-07 12:55:32 Jorge Merlino nominated for series Ubuntu Bionic
2022-04-07 12:55:32 Jorge Merlino bug task added open-iscsi (Ubuntu Bionic)
2022-04-07 12:55:42 Jorge Merlino open-iscsi (Ubuntu Bionic): assignee Jorge Merlino (jorge-merlino)
2022-04-07 13:11:19 Jorge Merlino tags id-5bbe5d6e338b8e69a2c66363 verification-needed verification-needed-focal id-5bbe5d6e338b8e69a2c66363 sts verification-needed verification-needed-focal
2022-04-07 13:12:42 Jorge Merlino attachment added lp1872813_bionic.debdiff https://bugs.launchpad.net/ubuntu/+source/open-iscsi/+bug/1872813/+attachment/5577913/+files/lp1872813_bionic.debdiff
2022-04-07 13:13:19 Jorge Merlino open-iscsi (Ubuntu Bionic): status New In Progress
2022-04-07 17:46:13 Jorge Merlino bug added subscriber STS Sponsors
2022-04-09 10:39:20 Heitor Alves de Siqueira tags id-5bbe5d6e338b8e69a2c66363 sts verification-needed verification-needed-focal id-5bbe5d6e338b8e69a2c66363 sts sts-sponsor-halves verification-needed verification-needed-focal
2022-04-09 10:41:02 Heitor Alves de Siqueira bug added subscriber Heitor Alves de Siqueira
2022-04-19 20:27:48 Jorge Merlino description Currently focal images on Oracle are failing to get data from the Oracle DS with this traceback: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/cloudinit/sources/__init__.py", line 772, in find_source if s.update_metadata([EventType.BOOT_NEW_INSTANCE]): File "/usr/lib/python3/dist-packages/cloudinit/sources/__init__.py", line 661, in update_metadata result = self.get_data() File "/usr/lib/python3/dist-packages/cloudinit/sources/__init__.py", line 279, in get_data return_value = self._get_data() File "/usr/lib/python3/dist-packages/cloudinit/sources/DataSourceOracle.py", line 195, in _get_data with dhcp.EphemeralDHCPv4(net.find_fallback_nic()): File "/usr/lib/python3/dist-packages/cloudinit/net/dhcp.py", line 57, in __enter__ return self.obtain_lease() File "/usr/lib/python3/dist-packages/cloudinit/net/dhcp.py", line 109, in obtain_lease ephipv4.__enter__() File "/usr/lib/python3/dist-packages/cloudinit/net/__init__.py", line 1019, in __enter__ self._bringup_static_routes() File "/usr/lib/python3/dist-packages/cloudinit/net/__init__.py", line 1071, in _bringup_static_routes util.subp( File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 2084, in subp raise ProcessExecutionError(stdout=out, stderr=err, cloudinit.util.ProcessExecutionError: Unexpected error while running command. Command: ['ip', '-4', 'route', 'add', '0.0.0.0/0', 'via', '10.0.0.1', 'dev', 'ens3'] Exit code: 2 Reason: - Stdout: Stderr: RTNETLINK answers: File exists In https://github.com/canonical/cloud-init/blob/46cf23c28812d3e3ba0c570defd9a05628af5556/cloudinit/sources/DataSourceOracle.py#L194-L198, we can see that this path is only taken if _is_iscsi_root returns False. [Impact] When creating a bare metal instance on Oracle Cloud (which are backed by an iscsi disk), the IP address is configured on an interface (enp45s0f0) on boot, but cloud-init is generating a /etc/netplan/50-cloud-init.yaml with an entry to configure enp12s0f0 using dhcp. As a result, enp12s0f0 will send a DHCPREQUEST and wait for a reply until it times out, delaying the boot process, as there's no dhcp server serving this interface. This is caused by a missing /run/initramfs/open-iscsi.interface that should point to the enp45s0f0 interface [Fix] There is a script from the open-iscsi package that checks if there are no iscsi disks present and if there are no disks removes the /run/initramfs/open-iscsi.interface file that stores the interface where the iscsi disk is present. This script originally runs along the local-top initrd scripts but uses the /dev/disk/by-path/ path to find if there are iscsi discs present. This path does not yet exists when the local-top scripts are run so the file is always removed. This was fixed in Focal by moving the script to run along the local-bottom scripts. When these scripts run the /dev/disk/by-path/ path exists. [Test Plan] This can be reproduced by instancing any bare metal instance on Oracle Cloud (all are backed by an iscsi disk) and checking if the /run/initramfs/open-iscsi.interface file is present. [Where problems could occur] There should be no problems as the script runs anyway but later into the boot process. If the script fails to run it could leave the open-iscsi.interface file present with no iscsi drives but that should cause no issues besides delaying the boot process. [Original description] Currently focal images on Oracle are failing to get data from the Oracle DS with this traceback: Traceback (most recent call last):   File "/usr/lib/python3/dist-packages/cloudinit/sources/__init__.py", line 772, in find_source     if s.update_metadata([EventType.BOOT_NEW_INSTANCE]):   File "/usr/lib/python3/dist-packages/cloudinit/sources/__init__.py", line 661, in update_metadata     result = self.get_data()   File "/usr/lib/python3/dist-packages/cloudinit/sources/__init__.py", line 279, in get_data     return_value = self._get_data()   File "/usr/lib/python3/dist-packages/cloudinit/sources/DataSourceOracle.py", line 195, in _get_data     with dhcp.EphemeralDHCPv4(net.find_fallback_nic()):   File "/usr/lib/python3/dist-packages/cloudinit/net/dhcp.py", line 57, in __enter__     return self.obtain_lease()   File "/usr/lib/python3/dist-packages/cloudinit/net/dhcp.py", line 109, in obtain_lease     ephipv4.__enter__()   File "/usr/lib/python3/dist-packages/cloudinit/net/__init__.py", line 1019, in __enter__     self._bringup_static_routes()   File "/usr/lib/python3/dist-packages/cloudinit/net/__init__.py", line 1071, in _bringup_static_routes     util.subp(   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 2084, in subp     raise ProcessExecutionError(stdout=out, stderr=err, cloudinit.util.ProcessExecutionError: Unexpected error while running command. Command: ['ip', '-4', 'route', 'add', '0.0.0.0/0', 'via', '10.0.0.1', 'dev', 'ens3'] Exit code: 2 Reason: - Stdout: Stderr: RTNETLINK answers: File exists In https://github.com/canonical/cloud-init/blob/46cf23c28812d3e3ba0c570defd9a05628af5556/cloudinit/sources/DataSourceOracle.py#L194-L198, we can see that this path is only taken if _is_iscsi_root returns False.
2022-04-20 13:17:56 Heitor Alves de Siqueira removed subscriber STS Sponsors
2022-04-20 13:36:42 Heitor Alves de Siqueira open-iscsi (Ubuntu Bionic): importance Undecided High
2022-04-28 15:37:15 Łukasz Zemczak open-iscsi (Ubuntu Bionic): status In Progress Fix Committed
2022-04-28 15:37:57 Łukasz Zemczak tags id-5bbe5d6e338b8e69a2c66363 sts sts-sponsor-halves verification-needed verification-needed-focal id-5bbe5d6e338b8e69a2c66363 sts sts-sponsor-halves verification-needed verification-needed-bionic verification-needed-focal
2022-04-29 13:29:10 Jorge Merlino tags id-5bbe5d6e338b8e69a2c66363 sts sts-sponsor-halves verification-needed verification-needed-bionic verification-needed-focal id-5bbe5d6e338b8e69a2c66363 sts sts-sponsor-halves verification-done-bionic verification-needed verification-needed-focal
2022-05-10 15:13:03 Brian Murray removed subscriber Ubuntu Stable Release Updates Team
2022-05-10 15:23:40 Launchpad Janitor open-iscsi (Ubuntu Bionic): status Fix Committed Fix Released
2023-05-12 05:36:16 James Falcon bug watch added https://github.com/canonical/cloud-init/issues/3651