Key kernel logs indicate this is a "device is held open by someone" type issue. Sample logs at the time of the failure:
2020-03-04T12:44:54.819 controller-0 kernel: err [157361.484752] block drbd8: State change failed: Device is held open by someone
2020-03-04T12:44:54.819 controller-0 kernel: err [157361.487387] block drbd6: State change failed: Device is held open by someone
2020-03-04T12:44:55.373 controller-0 kernel: err [157361.986267] block drbd9: State change failed: Device is held open by someone
2020-03-04T12:44:55.373 controller-0 kernel: err [157361.987222] block drbd7: State change failed: Device is held open by someone
2020-03-04T12:44:55.373 controller-0 kernel: err [157361.987475] block drbd5: State change failed: Device is held open by someone
2020-03-04T12:45:09.006 controller-0 kernel: err [157375.714197] block drbd2: State change failed: Device is held open by someone
2020-03-04T12:45:09.472 controller-0 kernel: err [157376.178824] block drbd0: State change failed: Device is held open by someone
2020-03-04T12:45:10.991 controller-0 kernel: err [157377.694175] block drbd1: State change failed: Device is held open by someone
Key kernel logs indicate this is a "device is held open by someone" type issue. Sample logs at the time of the failure:
2020-03- 04T12:44: 54.819 controller-0 kernel: err [157361.484752] block drbd8: State change failed: Device is held open by someone 04T12:44: 54.819 controller-0 kernel: err [157361.487387] block drbd6: State change failed: Device is held open by someone 04T12:44: 55.373 controller-0 kernel: err [157361.986267] block drbd9: State change failed: Device is held open by someone 04T12:44: 55.373 controller-0 kernel: err [157361.987222] block drbd7: State change failed: Device is held open by someone 04T12:44: 55.373 controller-0 kernel: err [157361.987475] block drbd5: State change failed: Device is held open by someone 04T12:45: 09.006 controller-0 kernel: err [157375.714197] block drbd2: State change failed: Device is held open by someone 04T12:45: 09.472 controller-0 kernel: err [157376.178824] block drbd0: State change failed: Device is held open by someone 04T12:45: 10.991 controller-0 kernel: err [157377.694175] block drbd1: State change failed: Device is held open by someone
2020-03-
2020-03-
2020-03-
2020-03-
2020-03-
2020-03-
2020-03-