If we create volume from image in batch, after all the volume created successfully, some device patch will be residual on the cinder node. I add some log and create 10 volume from image in batch, the log message I got is: root@ubuntu-204:~# tailf /var/log/cinder/cinder-volume.log |grep ERROR 2015-12-26 12:00:54.507 ERROR [pid:20056] [MainThread] [tid:139921212819568] cinder.volume.driver [req-6ab8bf42-e204-40ec-9df8-9e57a36bd7dc [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin initialize_connection 2015-12-26 12:00:59.300 ERROR [pid:20056] [MainThread] [tid:139921212819568] cinder.volume.driver [req-6ab8bf42-e204-40ec-9df8-9e57a36bd7dc [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin connect volume 2015-12-26 12:01:00.681 ERROR [pid:20056] [MainThread] [tid:139921210679696] cinder.volume.driver [req-35bbb08e-5600-4a6a-9e89-fa49b8bbbc70 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin initialize_connection 2015-12-26 12:01:02.480 ERROR [pid:20056] [MainThread] [tid:139921212819568] cinder.volume.driver [req-6ab8bf42-e204-40ec-9df8-9e57a36bd7dc [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin disconnect volume 2015-12-26 12:01:02.845 ERROR [pid:20056] [MainThread] [tid:139921212819568] os_brick.initiator.connector [req-6ab8bf42-e204-40ec-9df8-9e57a36bd7dc [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] devices left: [] 2015-12-26 12:01:02.846 ERROR [pid:20056] [MainThread] [tid:139921212819568] os_brick.initiator.connector [req-6ab8bf42-e204-40ec-9df8-9e57a36bd7dc [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] No devices left, logout the session 2015-12-26 12:01:03.716 ERROR [pid:20056] [MainThread] [tid:139921212819568] cinder.volume.driver [req-6ab8bf42-e204-40ec-9df8-9e57a36bd7dc [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin terminate_connection 2015-12-26 12:01:03.724 ERROR [pid:20056] [MainThread] [tid:139921210679536] cinder.volume.driver [req-d8d5b526-f5b5-44ed-8f0e-c159ad8ba2b4 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin initialize_connection 2015-12-26 12:01:04.163 ERROR [pid:20056] [MainThread] [tid:139921210679696] cinder.volume.driver [req-35bbb08e-5600-4a6a-9e89-fa49b8bbbc70 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin connect volume 2015-12-26 12:01:08.258 ERROR [pid:20056] [MainThread] [tid:139921210679696] cinder.volume.driver [req-35bbb08e-5600-4a6a-9e89-fa49b8bbbc70 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin disconnect volume 2015-12-26 12:01:08.602 ERROR [pid:20056] [MainThread] [tid:139921210679696] os_brick.initiator.connector [req-35bbb08e-5600-4a6a-9e89-fa49b8bbbc70 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] devices left: ['/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-1-part4', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-1'] 2015-12-26 12:01:08.604 ERROR [pid:20056] [MainThread] [tid:139921210679696] cinder.volume.driver [req-35bbb08e-5600-4a6a-9e89-fa49b8bbbc70 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin terminate_connection 2015-12-26 12:01:09.676 ERROR [pid:20056] [MainThread] [tid:139921210679376] cinder.volume.driver [req-a62de095-6835-4d0e-bdac-cfdda5697775 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin initialize_connection 2015-12-26 12:01:14.085 ERROR [pid:20056] [MainThread] [tid:139921210683216] cinder.volume.driver [req-26fb6c2a-bc31-45e9-9484-0f775c95e9cc [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin initialize_connection 2015-12-26 12:01:17.938 ERROR [pid:20056] [MainThread] [tid:139921210077744] cinder.volume.driver [req-984e54b7-3eb2-4b6b-b396-98ef74c05581 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin initialize_connection 2015-12-26 12:01:24.541 ERROR [pid:20056] [MainThread] [tid:139921209528400] cinder.volume.driver [req-f94b2463-924a-498d-a20e-e7cb29a81417 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin initialize_connection 2015-12-26 12:01:30.575 ERROR [pid:20056] [MainThread] [tid:139921212819568] cinder.volume.driver [req-6ab8bf42-e204-40ec-9df8-9e57a36bd7dc [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] End terminate_connection 2015-12-26 12:01:31.164 ERROR [pid:20056] [MainThread] [tid:139921221721136] cinder.volume.driver [req-1d006681-a780-4c26-8241-39c8a7887eae [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin initialize_connection 2015-12-26 12:01:35.215 ERROR [pid:20056] [MainThread] [tid:139921212029840] cinder.volume.driver [req-84552c6d-9a21-49e5-8cf2-6ff52ab3b205 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin initialize_connection 2015-12-26 12:01:35.638 ERROR [pid:20056] [MainThread] [tid:139921210679536] cinder.volume.driver [req-d8d5b526-f5b5-44ed-8f0e-c159ad8ba2b4 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin connect volume 2015-12-26 12:01:37.620 ERROR [pid:20056] [MainThread] [tid:139921210679536] cinder.volume.driver [req-d8d5b526-f5b5-44ed-8f0e-c159ad8ba2b4 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin disconnect volume 2015-12-26 12:01:37.799 ERROR [pid:20056] [MainThread] [tid:139921210679536] os_brick.initiator.connector [req-d8d5b526-f5b5-44ed-8f0e-c159ad8ba2b4 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] devices left: [] 2015-12-26 12:01:37.799 ERROR [pid:20056] [MainThread] [tid:139921210679536] os_brick.initiator.connector [req-d8d5b526-f5b5-44ed-8f0e-c159ad8ba2b4 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] No devices left, logout the session 2015-12-26 12:01:38.533 ERROR [pid:20056] [MainThread] [tid:139921210679536] cinder.volume.driver [req-d8d5b526-f5b5-44ed-8f0e-c159ad8ba2b4 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin terminate_connection 2015-12-26 12:01:41.616 ERROR [pid:20056] [MainThread] [tid:139921227148336] cinder.volume.driver [req-72970932-8bf7-4a13-aa43-9615da434f22 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin initialize_connection 2015-12-26 12:01:41.741 ERROR [pid:20056] [MainThread] [tid:139921210679696] cinder.volume.driver [req-35bbb08e-5600-4a6a-9e89-fa49b8bbbc70 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] End terminate_connection 2015-12-26 12:01:42.849 ERROR [pid:20056] [MainThread] [tid:139921210679376] cinder.volume.driver [req-a62de095-6835-4d0e-bdac-cfdda5697775 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin connect volume 2015-12-26 12:01:44.162 ERROR [pid:20056] [MainThread] [tid:139921210683216] cinder.volume.driver [req-26fb6c2a-bc31-45e9-9484-0f775c95e9cc [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin connect volume 2015-12-26 12:01:45.580 ERROR [pid:20056] [MainThread] [tid:139921210077744] cinder.volume.driver [req-984e54b7-3eb2-4b6b-b396-98ef74c05581 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin connect volume 2015-12-26 12:01:46.498 ERROR [pid:20056] [MainThread] [tid:139921210679376] cinder.volume.driver [req-a62de095-6835-4d0e-bdac-cfdda5697775 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin disconnect volume 2015-12-26 12:01:46.730 ERROR [pid:20056] [MainThread] [tid:139921209528400] cinder.volume.driver [req-f94b2463-924a-498d-a20e-e7cb29a81417 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin connect volume 2015-12-26 12:01:46.999 ERROR [pid:20056] [MainThread] [tid:139921210683216] cinder.volume.driver [req-26fb6c2a-bc31-45e9-9484-0f775c95e9cc [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin disconnect volume 2015-12-26 12:01:47.491 ERROR [pid:20056] [MainThread] [tid:139921210679376] os_brick.initiator.connector [req-a62de095-6835-4d0e-bdac-cfdda5697775 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] devices left: ['/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-4', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-1-part4', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-3', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-1'] 2015-12-26 12:01:47.494 ERROR [pid:20056] [MainThread] [tid:139921210679376] cinder.volume.driver [req-a62de095-6835-4d0e-bdac-cfdda5697775 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin terminate_connection 2015-12-26 12:01:48.095 ERROR [pid:20056] [MainThread] [tid:139921221721136] cinder.volume.driver [req-1d006681-a780-4c26-8241-39c8a7887eae [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin connect volume 2015-12-26 12:01:49.456 ERROR [pid:20056] [MainThread] [tid:139921210683216] os_brick.initiator.connector [req-26fb6c2a-bc31-45e9-9484-0f775c95e9cc [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] devices left: ['/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-2-part4', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-2', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-5', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-4', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-1-part4', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-1'] 2015-12-26 12:01:49.459 ERROR [pid:20056] [MainThread] [tid:139921210683216] cinder.volume.driver [req-26fb6c2a-bc31-45e9-9484-0f775c95e9cc [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin terminate_connection 2015-12-26 12:01:49.658 ERROR [pid:20056] [MainThread] [tid:139921212029840] cinder.volume.driver [req-84552c6d-9a21-49e5-8cf2-6ff52ab3b205 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin connect volume 2015-12-26 12:01:49.678 ERROR [pid:20056] [MainThread] [tid:139921210077744] cinder.volume.driver [req-984e54b7-3eb2-4b6b-b396-98ef74c05581 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin disconnect volume 2015-12-26 12:01:51.554 ERROR [pid:20056] [MainThread] [tid:139921209528400] cinder.volume.driver [req-f94b2463-924a-498d-a20e-e7cb29a81417 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin disconnect volume 2015-12-26 12:01:52.085 ERROR [pid:20056] [MainThread] [tid:139921210077744] os_brick.initiator.connector [req-984e54b7-3eb2-4b6b-b396-98ef74c05581 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] devices left: ['/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-3-part4', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-7', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-6', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-3', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-2-part4', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-2', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-5', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-1-part4', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-1'] 2015-12-26 12:01:52.088 ERROR [pid:20056] [MainThread] [tid:139921210077744] cinder.volume.driver [req-984e54b7-3eb2-4b6b-b396-98ef74c05581 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin terminate_connection 2015-12-26 12:01:52.447 ERROR [pid:20056] [MainThread] [tid:139921209528400] os_brick.initiator.connector [req-f94b2463-924a-498d-a20e-e7cb29a81417 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] devices left: ['/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-3-part4', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-7', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-6', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-3', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-2-part4', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-2', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-1-part4', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-1'] 2015-12-26 12:01:52.451 ERROR [pid:20056] [MainThread] [tid:139921209528400] cinder.volume.driver [req-f94b2463-924a-498d-a20e-e7cb29a81417 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin terminate_connection 2015-12-26 12:01:53.781 ERROR [pid:20056] [MainThread] [tid:139921221721136] cinder.volume.driver [req-1d006681-a780-4c26-8241-39c8a7887eae [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin disconnect volume 2015-12-26 12:01:53.946 ERROR [pid:20056] [MainThread] [tid:139921221721136] os_brick.initiator.connector [req-1d006681-a780-4c26-8241-39c8a7887eae [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] devices left: ['/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-3-part4', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-7', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-3', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-2-part4', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-2', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-1-part4', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-1'] 2015-12-26 12:01:53.950 ERROR [pid:20056] [MainThread] [tid:139921221721136] cinder.volume.driver [req-1d006681-a780-4c26-8241-39c8a7887eae [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin terminate_connection 2015-12-26 12:01:54.248 ERROR [pid:20056] [MainThread] [tid:139921212029840] cinder.volume.driver [req-84552c6d-9a21-49e5-8cf2-6ff52ab3b205 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin disconnect volume 2015-12-26 12:01:54.427 ERROR [pid:20056] [MainThread] [tid:139921212029840] os_brick.initiator.connector [req-84552c6d-9a21-49e5-8cf2-6ff52ab3b205 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] devices left: ['/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-3-part4', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-3', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-2-part4', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-2', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-1-part4', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-1'] 2015-12-26 12:01:54.430 ERROR [pid:20056] [MainThread] [tid:139921212029840] cinder.volume.driver [req-84552c6d-9a21-49e5-8cf2-6ff52ab3b205 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin terminate_connection 2015-12-26 12:02:20.826 ERROR [pid:20056] [MainThread] [tid:139921210679536] cinder.volume.driver [req-d8d5b526-f5b5-44ed-8f0e-c159ad8ba2b4 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] End terminate_connection 2015-12-26 12:02:22.227 ERROR [pid:20056] [MainThread] [tid:139921227148336] cinder.volume.driver [req-72970932-8bf7-4a13-aa43-9615da434f22 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin connect volume 2015-12-26 12:02:23.295 ERROR [pid:20056] [MainThread] [tid:139921210679376] cinder.volume.driver [req-a62de095-6835-4d0e-bdac-cfdda5697775 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] End terminate_connection 2015-12-26 12:02:24.680 ERROR [pid:20056] [MainThread] [tid:139921227148336] cinder.volume.driver [req-72970932-8bf7-4a13-aa43-9615da434f22 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin disconnect volume 2015-12-26 12:02:24.989 ERROR [pid:20056] [MainThread] [tid:139921227148336] os_brick.initiator.connector [req-72970932-8bf7-4a13-aa43-9615da434f22 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] devices left: ['/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-3-part4', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-3', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-2-part4', '/dev/disk/by-path/ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-2'] 2015-12-26 12:02:24.991 ERROR [pid:20056] [MainThread] [tid:139921227148336] cinder.volume.driver [req-72970932-8bf7-4a13-aa43-9615da434f22 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] Begin terminate_connection 2015-12-26 12:02:54.791 ERROR [pid:20056] [MainThread] [tid:139921210683216] cinder.volume.driver [req-26fb6c2a-bc31-45e9-9484-0f775c95e9cc [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] End terminate_connection 2015-12-26 12:02:55.320 ERROR [pid:20056] [MainThread] [tid:139921210077744] cinder.volume.driver [req-984e54b7-3eb2-4b6b-b396-98ef74c05581 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] End terminate_connection 2015-12-26 12:02:56.222 ERROR [pid:20056] [MainThread] [tid:139921209528400] cinder.volume.driver [req-f94b2463-924a-498d-a20e-e7cb29a81417 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] End terminate_connection 2015-12-26 12:02:56.727 ERROR [pid:20056] [MainThread] [tid:139921221721136] cinder.volume.driver [req-1d006681-a780-4c26-8241-39c8a7887eae [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] End terminate_connection 2015-12-26 12:02:57.190 ERROR [pid:20056] [MainThread] [tid:139921212029840] cinder.volume.driver [req-84552c6d-9a21-49e5-8cf2-6ff52ab3b205 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] End terminate_connection 2015-12-26 12:02:58.066 ERROR [pid:20056] [MainThread] [tid:139921227148336] cinder.volume.driver [req-72970932-8bf7-4a13-aa43-9615da434f22 [0b4b08a35a9b4241b550903d6dfa0c1c 1157592a1496419fb1bbb839dd96032a] End terminate_connection After all the volumes created successfully, some device patch are residual: root@ubuntu-204:/dev/disk/by-path# ll total 0 drwxr-xr-x 2 root root 200 Dec 26 12:02 ./ drwxr-xr-x 6 root root 120 Dec 23 10:47 ../ lrwxrwxrwx 1 root root 10 Dec 26 12:01 ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-2 -> ../../sdlp lrwxrwxrwx 1 root root 11 Dec 26 12:01 ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-2-part4 -> ../../sdlp4 lrwxrwxrwx 1 root root 10 Dec 26 12:01 ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-3 -> ../../sdlm lrwxrwxrwx 1 root root 11 Dec 26 12:01 ip-111.111.101.231:3260-iscsi-iqn.2006-08.com.huawei:oceanstor:21000022a105b261::1020000:111.111.101.231-lun-3-part4 -> ../../sdlm4 lrwxrwxrwx 1 root root 9 Oct 8 06:28 pci-0000:00:10.0-scsi-0:0:0:0 -> ../../sda lrwxrwxrwx 1 root root 10 Oct 8 06:28 pci-0000:00:10.0-scsi-0:0:0:0-part1 -> ../../sda1 lrwxrwxrwx 1 root root 10 Oct 8 06:28 pci-0000:00:10.0-scsi-0:0:0:0-part2 -> ../../sda2 lrwxrwxrwx 1 root root 10 Oct 8 06:28 pci-0000:00:10.0-scsi-0:0:0:0-part5 -> ../../sda5