Hi, testing this fix, we found that in certain scenarios, if we don't call _rescan_multipath when attaching/detaching iSCSI volumes, the iSCSI sessions are not logged out. Our current workaround is doing a double _rescan_multipath in those places. Tested with Netapp e-series 5524 / xenial /mitaka Perhatps the rescans are there for a reason... WITHOUT RESCAN: Jan 25 09:24:40 calling os-brick to detach iSCSI Volume Jan 25 09:24:40 Lock "connect_volume" acquired by "os_brick.initiator.connector.disconnect_volume" :: waited 0.000s Jan 25 09:24:40 multipath -ll /dev/sdr Jan 25 09:24:40 multipath -ll /dev/sdr" returned: 0 in 0.218s Jan 25 09:24:40 multipath ['-ll', u'/dev/sdr']: stdout=360080e5000297ea40000050658885f45 dm-6 NETAPP,INF-01-00#012size=10G features='4 queue_if_no_path pg_init_retries 50 retain_attached_hw_handle' hwhandler='1 rdac' wp=rw#012|-+- policy=' service-time 0' prio=14 status=active#012| |- 11:0:0:135 sdr 65:16 active ready running#012| |- 3:0:0:135 sds 65:32 active ready running#012| |- 8:0:0:135 sdq 65:0 active ready running#012| `- 9:0:0:135 sdt 65:48 active ready runni ng#012`-+- policy='service-time 0' prio=9 status=enabled#012 |- 10:0:0:135 sdo 8:224 active ready running#012 |- 10:0:0:162 sdi 8:128 active faulty running#012 |- 11:0:0:162 sdj 8:144 active faulty running#012 |- 12:0:0:135 sdn 8:208 active ready running#012 |- 12:0:0:162 sdk 8:160 active faulty running#012 |- 13:0:0:135 sdp 8:240 active ready running#012 |- 13:0:0:162 sdl 8:176 active faulty running#012 |- 3:0:0:162 sdb 8:16 active faulty running#012 |- 4:0:0 :135 sdm 8:192 active ready running#012 |- 4:0:0:162 sdc 8:32 active faulty running#012 |- 8:0:0:162 sdg 8:96 active faulty running#012 `- 9:0:0:162 sdh 8:112 active faulty running#012 stderr= Jan 25 09:24:40 remove multipath device /dev/sdr Jan 25 09:24:40 multipath -l /dev/sdr Jan 25 09:24:40 multipath -l /dev/sdr" returned: 0 in 0.176s Jan 25 09:24:40 Couldn't find multipath device /dev/mapper/360080e5000297ea40000050658885f45 Jan 25 09:24:40 Disconnect multipath device /dev/mapper/360080e5000297ea40000050658885f45 Jan 25 09:24:40 multipath -ll Jan 25 09:24:41 multipath -ll" returned: 0 in 0.248s Jan 25 09:24:41 multipath ['-ll']: stdout=3624a9370dbcfee6048974fe300011180 dm-1 ##,###012size=1.0G features='0' hwhandler='0' wp=rw#012360080e5000297ea40000050658885f45 dm-6 NETAPP,INF-01-00#012size=10G features='4 queue_if_no_path pg_init_retries 50 retain_attached_hw_handle' hwhandler='1 rdac' wp=rw#012|-+- policy='service-time 0' prio=14 status=active#012| |- 11:0:0:135 sdr 65:16 active ready running#012| |- 3:0:0:135 sds 65:32 active ready running#012| |- 8:0:0:135 sdq 65:0 active ready running#012| `- 9:0:0:135 sdt 65:48 active ready running#012`-+- policy='service-time 0' prio=9 status=enabled#012 |- 10:0:0:135 sdo 8:224 active ready running#012 |- 10:0:0:162 sdi 8:128 active faulty running#012 |- 11:0:0:162 sdj 8:144 active faulty running#012 |- 12:0:0:135 sdn 8:208 active ready running#012 |- 12:0:0:162 sdk 8:160 active faulty running#012 |- 13:0:0:135 sdp 8:240 active ready running#012 |- 13:0:0:162 sdl 8:176 active faulty running#012 |- 3:0:0:162 sdb 8:16 active faulty running#012 |- 4:0:0:135 sdm 8:192 active ready running#012 |- 4:0:0:162 sdc 8:32 active faulty running#012 |- 8:0:0:162 sdg 8:96 active faulty running#012 `- 9:0:0:162 sdh 8:112 active faulty running#0123600a0980443331746a2b44384c685179 dm-7 NETAPP,LUN C-Mode#012size=1.0G features='2 queue_if_no_path retain_attached_hw_handler' hwhandler='0' wp=rw#012`-+- policy='round-robin 0' prio=23 status=active#012 |- 5:0:0:0 sdd 8:48 active ready running#012 |- 6:0:0:0 sde 8:64 active ready running#012 `- 7:0:0:0 sdf 8:80 active ready running#0123624a9370dbcfee6048974fe300011181 dm-3 ##,###012size=1.0G features='0' hwhandler='0' wp=rw#012 stderr= Jan 25 09:24:41 iscsiadm -m discovery -t sendtargets -p 10.10.100.14:3260 Jan 25 09:24:41 iscsiadm -m discovery -t sendtargets -p 10.10.100.14:3260" returned: 0 in 0.182s Jan 25 09:24:41 iscsiadm ['-m', 'discovery', '-t', 'sendtargets', '-p', u'10.10.100.14:3260']: stdout=10.10.100.14:3260,2 iqn.1992-08.com.netapp:5504.60080e5000297b380000000053beb5cf#01210.10.100.15:3260,2 iqn.1992-08.com.netapp:5504.60080e5000297b380000000053beb5cf#01210.10.100.16:3260,2 iqn.1992-08.com.netapp:5504.60080e5000297b380000000053beb5cf#01210.10.100.17:3260,2 iqn.1992-08.com.netapp:5504.60080e5000297b380000000053beb5cf#01210.10.100.10:3260,1 iqn.1992-08.com.netapp:5504.60080e5000297b380000000053beb5cf#01210.10.100.11:3260,1 iqn.1992-08.com.netapp:5504.60080e5000297b380000000053beb5cf#01210.10.100.12:3260,1 iqn.1992-08.com.netapp:5504.60080e5000297b380000000053beb5cf#01210.10.100.13:3260,1 iqn.1992-08.com.netapp:5504.60080e5000297b380000000053beb5cf#012 stderr= Jan 25 09:24:41 Lock "connect_volume" released by "os_brick.initiator.connector.disconnect_volume" :: held 0.839s Jan 25 09:24:41 Disconnected iSCSI Volume vdb Jan 25 09:24:41 cat /etc/iscsi/initiatorname.iscsi Jan 25 09:24:41 cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.165s WITH RESCAN: Jan 25 09:56:55 multipath -l /dev/sdf Jan 25 09:56:55 multipath -l /dev/sdf" returned: 0 in 0.173s Jan 25 09:56:55 Found multipath device = /dev/mapper/3600a0980443331746a2b44384c685179 Jan 25 09:56:55 multipath LUNs to remove [{'device': '/dev/sdd', 'host': '5', 'id': '0', 'channel': '0', 'lun': '0'}, {'device': '/dev/sde', 'host': '6', 'id': '0', 'channel': '0', 'lun': '0'}, {'device': '/dev/sdf', 'host': '7', 'id': '0' , 'channel': '0', 'lun': '0'}] Jan 25 09:56:55 Flushing IO for device /dev/sdd Jan 25 09:56:55 blockdev --flushbufs /dev/sdd Jan 25 09:56:55 blockdev --flushbufs /dev/sdd" returned: 0 in 0.143s Jan 25 09:56:55 Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete Jan 25 09:56:55 tee -a /sys/block/sdd/device/delete Jan 25 09:56:55 tee -a /sys/block/sdd/device/delete" returned: 0 in 0.189s Jan 25 09:56:55 Flushing IO for device /dev/sde Jan 25 09:56:55 blockdev --flushbufs /dev/sde Jan 25 09:56:56 blockdev --flushbufs /dev/sde" returned: 0 in 0.146s Jan 25 09:56:56 Remove SCSI device /dev/sde with /sys/block/sde/device/delete Jan 25 09:56:56 tee -a /sys/block/sde/device/delete Jan 25 09:56:56 tee -a /sys/block/sde/device/delete" returned: 0 in 0.185s Jan 25 09:56:56 Flushing IO for device /dev/sdf Jan 25 09:56:56 blockdev --flushbufs /dev/sdf Jan 25 09:56:56 blockdev --flushbufs /dev/sdf" returned: 0 in 0.150s Jan 25 09:56:56 Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete Jan 25 09:56:56 tee -a /sys/block/sdf/device/delete Jan 25 09:56:56 tee -a /sys/block/sdf/device/delete" returned: 0 in 0.174s Jan 25 09:56:56 Flush multipath device 3600a0980443331746a2b44384c685179 Jan 25 09:56:56 multipath -f 3600a0980443331746a2b44384c685179 Jan 25 09:56:56 multipath -f 3600a0980443331746a2b44384c685179" returned: 0 in 0.158s Jan 25 09:56:56 Disconnect multipath device /dev/mapper/3600a0980443331746a2b44384c685179 Jan 25 09:56:56 multipath -ll Jan 25 09:56:57 multipath -ll" returned: 0 in 0.326s Jan 25 09:56:57 multipath ['-ll']: stdout=3624a9370dbcfee6048974fe300011180 dm-1 ##,###012size=1.0G features='0' hwhandler='0' wp=rw#012360080e5000297ea40000050658885f45 dm-6 NETAPP,INF-01-00#012size=10G features='4 queue_if_no_path pg_init_retries 50 retain_attached_hw_handle' hwhandler='1 rdac' wp=rw#012|-+- policy='service-time 0' prio=0 status=active#012| |- 11:0:0:135 sdr 65:16 failed faulty running#012| |- 3:0:0:135 sds 65:32 failed faulty running#012| |- 8:0:0:135 sdq 65:0 failed faulty running#012| `- 9:0:0:135 sdt 65:48 failed faulty running#012`-+- policy='service-time 0' prio=0 status=enabled#012 |- 10:0:0:135 sdo 8:224 failed faulty running#012 |- 10:0:0:162 sdi 8:128 active faulty running#012 |- 11:0:0:162 sdj 8:144 active faulty running#012 |- 12:0:0:135 sdn 8:208 failed faulty running#012 |- 12:0:0:162 sdk 8:160 active faulty running#012 |- 13:0:0:135 sdp 8:240 failed faulty running#012 |- 13:0:0:162 sdl 8:176 active faulty running#012 |- 3:0:0:162 sdb 8:16 active faulty running#012 |- 4:0:0:135 sdm 8:192 failed faulty running#012 |- 4:0:0:162 sdc 8:32 active faulty running#012 |- 8:0:0:162 sdg 8:96 active faulty running#012 `- 9:0:0:162 sdh 8:112 active faulty running#0123624a9370dbcfee6048974fe300011181 dm-3 ##,###012size=1.0G features='0' hwhandler='0' wp=rw#012 stderr= Jan 25 09:56:57 iscsiadm -m discovery -t sendtargets -p 10.10.0.30:3260 Jan 25 09:56:57 iscsiadm -m discovery -t sendtargets -p 10.10.0.30:3260" returned: 0 in 0.184s Jan 25 09:56:57 iscsiadm ['-m', 'discovery', '-t', 'sendtargets', '-p', u'10.10.0.30:3260']: stdout=10.10.0.30:3260,1033 iqn.1992-08.com.netapp:sn.3aebbdea09b111e3be0e123478563412:vs.18#01210.10.0.32:3260,1042 iqn.1992-08.com.netapp:sn.3aebbdea09b111e3be0e123478563412:vs.18#01210.10.0.31:3260,1035 iqn.1992-08.com.netapp:sn.3aebbdea09b111e3be0e123478563412:vs.18#012 stderr= Jan 25 09:56:57 iscsiadm -m node -T iqn.1992-08.com.netapp:sn.3aebbdea09b111e3be0e123478563412:vs.18 -p 10.10.0.30:3260,1033 --op update -n node.startup -v manual Jan 25 09:56:57 iscsiadm -m node -T iqn.1992-08.com.netapp:sn.3aebbdea09b111e3be0e123478563412:vs.18 -p 10.10.0.30:3260,1033 --op update -n node.startup -v manual" returned: 0 in 0.144s Jan 25 09:56:57 iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= Jan 25 09:56:57 iscsiadm -m node -T iqn.1992-08.com.netapp:sn.3aebbdea09b111e3be0e123478563412:vs.18 -p 10.10.0.30:3260,1033 --logout Jan 25 09:56:58 iscsiadm -m node -T iqn.1992-08.com.netapp:sn.3aebbdea09b111e3be0e123478563412:vs.18 -p 10.10.0.30:3260,1033 --logout" returned: 0 in 0.653s Jan 25 09:56:58 iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.1992-08.com.netapp:sn.3aebbdea09b111e3be0e123478563412:vs.18, portal: 10.10.0.30,3260]#012Logout of [sid: 31, target: iqn.1992-08.com.netapp:sn.3aebbdea09b111e3be0e123478563412:vs.18, portal: 10.10.0.30,3260] successful.#012 stderr= Jan 25 09:56:58 iscsiadm -m node -T iqn.1992-08.com.netapp:sn.3aebbdea09b111e3be0e123478563412:vs.18 -p 10.10.0.30:3260,1033 --op delete Jan 25 09:56:58 iscsiadm -m node -T iqn.1992-08.com.netapp:sn.3aebbdea09b111e3be0e123478563412:vs.18 -p 10.10.0.30:3260,1033 --op delete" returned: 0 in 0.158s Jan 25 09:56:58 iscsiadm ('--op', 'delete'): stdout= stderr=