tgt connection issues can make it impossible to delete targets
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
tgt (Ubuntu) |
Fix Released
|
High
|
Chuck Short | ||
Trusty |
Fix Released
|
High
|
Chuck Short |
Bug Description
Under heavy load, openiscsi will sometimes report connection errors when using tgt:
Apr 8 22:02:44 node003-cont001 iscsid: Connection2:0 to [target: iqn.2010-
Apr 8 22:10:53 node003-cont001 iscsid: Kernel reported iSCSI connection 2:0 error (1021 - ISCSI_ERR_
Apr 8 22:10:56 node003-cont001 iscsid: connection2:0 is operational after recovery (1 attempts)
Apr 8 22:18:47 node003-cont001 iscsid: Kernel reported iSCSI connection 2:0 error (1021 - ISCSI_ERR_
Apr 8 22:18:50 node003-cont001 iscsid: connection2:0 is operational after recovery (1 attempts)
Even though openiscsi has disconnected:
Apr 8 22:34:04 node003-cont001 iscsid: Connection2:0 to [target: iqn.2010-
tgt still shows the old connections:
$ sudo tgtadm --op show --mode target
Target 5: iqn.2010-
System information:
Driver: iscsi
State: ready
I_T nexus information:
I_T nexus: 5
IP Address: 172.21.1.3
I_T nexus: 6
IP Address: 172.21.1.3
When these duplicate connections are there, the volume cannot be deleted:
$ sudo tgt-admin -v --force --delete iqn.2010-
# Removing target: iqn.2010-
tgtadm -C 0 --op delete --mode conn --tid 5 --sid 6 --cid 0
tgtadm -C 0 --op delete --mode conn --tid 5 --sid 5 --cid 0
tgtadm -C 0 --mode target --op delete --tid=5
tgtadm: this target is still active
Command:
tgtadm -C 0 --mode target --op delete --tid=5
exited with code: 22.
The following errors show up in syslog illustrating the force delete failing:
Apr 9 22:31:50 node001-cont001 tgtd: conn_close_
Apr 9 22:31:50 node001-cont001 tgtd: tgt_event_
Apr 9 22:31:50 node001-cont001 tgtd: iscsi_event_
Apr 9 22:31:50 node001-cont001 tgtd: conn_close_
Apr 9 22:31:50 node001-cont001 tgtd: tgt_event_
Apr 9 22:31:50 node001-cont001 tgtd: iscsi_event_
Apr 9 22:31:50 node001-cont001 tgtd: tgt_target_
And the connections are still there:
$ sudo tgt-admin -v --show
tgtadm -C 0 --op show --mode target
Target 5: iqn.2010-
System information:
Driver: iscsi
State: ready
I_T nexus information:
I_T nexus: 5
IP Address: 172.21.1.3
I_T nexus: 6
IP Address: 172.21.1.3
Related branches
Changed in tgt (Ubuntu Trusty): | |
assignee: | nobody → Chuck Short (zulcss) |
Changed in tgt (Ubuntu Trusty): | |
importance: | Undecided → High |
no longer affects: | tgt-project |
I believe this may be fixed by:
https:/ /github. com/fujita/ tgt/commit/ e6e8d0fd3b83208 278fb7ed765c366 5ae7c5ab49
but also may require:
https:/ /github. com/fujita/ tgt/commit/ 05fc2cb424863fb f2f3c60a8b61730 8ef1e370c5
I'm doing a test of build 1.0.46 tgt to see if it resolves the issue.