Low memory situations result in root partition being remounted read-only
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
cryptsetup |
New
|
Undecided
|
Unassigned | ||
linux (Ubuntu) |
Confirmed
|
Undecided
|
Unassigned |
Bug Description
Instead of killing something with a high niceness low memory situations seem to hang something super-ultra-so-very vital, writes fail and the root partition is remounted read-only. After that systemd-journald starts stupidly spamming and earlier logs are rendered unusable.
I'd post more logs but https:/
This has happened at least four times, across many kernel versions. With Ubuntu 18.10, 19.04 and 19.10.
```
[827788.409138] sd 5:0:0:0: [sdb] tag#12 FAILED Result: hostbyte=DID_OK driverbyte=
[827788.409141] sd 5:0:0:0: [sdb] tag#12 CDB: Write(10) 2a 00 01 e0 b8 f0 00 00 10 00
[827788.409143] blk_update_request: I/O error, dev sdb, sector 31504624 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0
[827788.409151] EXT4-fs warning (device dm-1): ext4_end_bio:309: I/O error 10 writing to inode 1577543 (offset 0 size 0 starting block 3871518)
[827788.409154] Buffer I/O error on device dm-1, logical block 3871518
[827788.409163] EXT4-fs warning (device dm-1): ext4_end_bio:309: I/O error 10 writing to inode 1577543 (offset 0 size 0 starting block 3871519)
[827788.409164] Buffer I/O error on device dm-1, logical block 3871519
[827788.409172] sd 5:0:0:0: [sdb] tag#11 FAILED Result: hostbyte=DID_OK driverbyte=
[827788.409174] sd 5:0:0:0: [sdb] tag#11 CDB: Write(10) 2a 00 01 e0 bb 70 00 00 08 00
[827788.409175] blk_update_request: I/O error, dev sdb, sector 31505264 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0
[827788.409179] EXT4-fs warning (device dm-1): ext4_end_bio:309: I/O error 10 writing to inode 1577543 (offset 0 size 0 starting block 3871598)
[827788.409180] Buffer I/O error on device dm-1, logical block 3871598
[827788.409188] sd 5:0:0:0: [sdb] tag#10 FAILED Result: hostbyte=DID_OK driverbyte=
[827788.409189] sd 5:0:0:0: [sdb] tag#10 CDB: Write(10) 2a 00 01 e0 ba 60 00 00 38 00
[827788.409190] blk_update_request: I/O error, dev sdb, sector 31504992 op 0x1:(WRITE) flags 0x0 phys_seg 7 prio class 0
[827788.409194] EXT4-fs warning (device dm-1): ext4_end_bio:309: I/O error 10 writing to inode 1577543 (offset 0 size 0 starting block 3871564)
[827788.409195] Buffer I/O error on device dm-1, logical block 3871564
[827788.409196] Buffer I/O error on device dm-1, logical block 3871565
[827788.409198] Buffer I/O error on device dm-1, logical block 3871566
[827788.409199] Buffer I/O error on device dm-1, logical block 3871567
[827788.409201] Buffer I/O error on device dm-1, logical block 3871568
[827788.409202] Buffer I/O error on device dm-1, logical block 3871569
[827788.409203] Buffer I/O error on device dm-1, logical block 3871570
[827788.409210] sd 5:0:0:0: [sdb] tag#9 FAILED Result: hostbyte=DID_OK driverbyte=
[827788.409211] sd 5:0:0:0: [sdb] tag#9 CDB: Write(10) 2a 00 01 e0 ba 30 00 00 08 00
[827788.409212] blk_update_request: I/O error, dev sdb, sector 31504944 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0
[827788.409216] EXT4-fs warning (device dm-1): ext4_end_bio:309: I/O error 10 writing to inode 1577543 (offset 0 size 0 starting block 3871558)
[827788.409220] sd 5:0:0:0: [sdb] tag#8 FAILED Result: hostbyte=DID_OK driverbyte=
[827788.409221] sd 5:0:0:0: [sdb] tag#8 CDB: Write(10) 2a 00 01 e0 ba 50 00 00 08 00
[827788.409222] blk_update_request: I/O error, dev sdb, sector 31504976 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0
[827788.409225] EXT4-fs warning (device dm-1): ext4_end_bio:309: I/O error 10 writing to inode 1577543 (offset 0 size 0 starting block 3871562)
[827788.409228] sd 5:0:0:0: [sdb] tag#4 FAILED Result: hostbyte=DID_OK driverbyte=
[827788.409229] sd 5:0:0:0: [sdb] tag#4 CDB: Write(10) 2a 00 01 e0 bb 88 00 00 08 00
[827788.409230] blk_update_request: I/O error, dev sdb, sector 31505288 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0
[827788.409233] EXT4-fs warning (device dm-1): ext4_end_bio:309: I/O error 10 writing to inode 1577543 (offset 0 size 0 starting block 3871601)
[827818.628273] sd 5:0:0:0: [sdb] tag#31 FAILED Result: hostbyte=DID_OK driverbyte=
[827818.628276] sd 5:0:0:0: [sdb] tag#31 CDB: Write(10) 2a 00 01 cf 12 38 00 00 30 00
[827818.628279] blk_update_request: I/O error, dev sdb, sector 30347832 op 0x1:(WRITE) flags 0x800 phys_seg 6 prio class 0
[827818.628347] sd 5:0:0:0: [sdb] tag#28 FAILED Result: hostbyte=DID_OK driverbyte=
[827818.628351] sd 5:0:0:0: [sdb] tag#28 CDB: Write(10) 2a 00 01 93 2f b0 00 00 08 00
[827818.628353] blk_update_request: I/O error, dev sdb, sector 26423216 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0
[827818.628358] Aborting journal on device dm-1-8.
[827818.628374] EXT4-fs warning (device dm-1): ext4_end_bio:309: I/O error 10 writing to inode 1577543 (offset 0 size 0 starting block 3236342)
[827818.628379] buffer_io_error: 3 callbacks suppressed
[827818.628381] Buffer I/O error on device dm-1, logical block 3236342
[827818.628401] sd 5:0:0:0: [sdb] tag#23 FAILED Result: hostbyte=DID_OK driverbyte=
[827818.628404] sd 5:0:0:0: [sdb] tag#23 CDB: Write(10) 2a 00 00 08 20 00 00 00 08 00
[827818.628406] blk_update_request: I/O error, dev sdb, sector 532480 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0
[827818.628412] Buffer I/O error on dev dm-1, logical block 0, lost async page write
[827818.628422] sd 5:0:0:0: [sdb] tag#21 FAILED Result: hostbyte=DID_OK driverbyte=
[827818.628423] sd 5:0:0:0: [sdb] tag#21 CDB: Write(10) 2a 00 01 e0 bb f0 00 00 08 00
[827818.628424] blk_update_request: I/O error, dev sdb, sector 31505392 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0
[827818.628431] EXT4-fs warning (device dm-1): ext4_end_bio:309: I/O error 10 writing to inode 1577543 (offset 0 size 0 starting block 3871614)
[827818.628433] Buffer I/O error on device dm-1, logical block 3871614
[827818.628438] sd 5:0:0:0: [sdb] tag#2 FAILED Result: hostbyte=DID_OK driverbyte=
[827818.628440] sd 5:0:0:0: [sdb] tag#2 CDB: Write(10) 2a 00 01 a0 fa 68 00 00 08 00
[827818.628441] blk_update_request: I/O error, dev sdb, sector 27327080 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0
[827818.628445] EXT4-fs warning (device dm-1): ext4_end_bio:309: I/O error 10 writing to inode 1351263 (offset 0 size 0 starting block 3349325)
[827818.628446] Buffer I/O error on device dm-1, logical block 3349325
[827818.628451] sd 5:0:0:0: [sdb] tag#0 FAILED Result: hostbyte=DID_OK driverbyte=
[827818.628453] sd 5:0:0:0: [sdb] tag#0 CDB: Write(10) 2a 00 01 dc 9c 90 00 00 08 00
[827818.628454] blk_update_request: I/O error, dev sdb, sector 31235216 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0
[827818.628458] EXT4-fs warning (device dm-1): ext4_end_bio:309: I/O error 10 writing to inode 1313164 (offset 0 size 0 starting block 3837842)
[827818.628459] Buffer I/O error on device dm-1, logical block 3837842
[827818.670084] EXT4-fs (dm-1): previous I/O error to superblock detected
[827833.710692] usb 3-6.1: USB disconnect, device number 41
[827834.707792] usb 3-6.1: new low-speed USB device number 42 using xhci_hcd
[827835.528834] usb 3-6.1: New USB device found, idVendor=0463, idProduct=ffff, bcdDevice= 1.00
[827835.528836] usb 3-6.1: New USB device strings: Mfr=1, Product=2, SerialNumber=4
[827835.528838] usb 3-6.1: Product: Ellipse PRO
[827835.528839] usb 3-6.1: Manufacturer: EATON
[827839.336303] hid-generic 0003:0463:
[827848.687401] sd 5:0:0:0: [sdb] tag#29 FAILED Result: hostbyte=DID_OK driverbyte=
[827848.687404] sd 5:0:0:0: [sdb] tag#29 CDB: Write(10) 2a 00 02 50 7b e8 00 00 20 00
[827848.687407] blk_update_request: I/O error, dev sdb, sector 38829032 op 0x1:(WRITE) flags 0x0 phys_seg 4 prio class 0
[827848.687415] EXT4-fs warning (device dm-1): ext4_end_bio:309: I/O error 10 writing to inode 1704104 (offset 0 size 0 starting block 4787069)
[827848.687417] Buffer I/O error on device dm-1, logical block 4787069
[827848.687420] Buffer I/O error on device dm-1, logical block 4787070
[827848.687425] EXT4-fs warning (device dm-1): ext4_end_bio:309: I/O error 10 writing to inode 1704104 (offset 0 size 0 starting block 4787071)
[827848.687426] Buffer I/O error on device dm-1, logical block 4787071
[827848.687430] EXT4-fs warning (device dm-1): ext4_end_bio:309: I/O error 10 writing to inode 1704104 (offset 0 size 0 starting block 4787072)
[827848.687431] Buffer I/O error on device dm-1, logical block 4787072
[827848.687439] sd 5:0:0:0: [sdb] tag#20 FAILED Result: hostbyte=DID_OK driverbyte=
[827848.687441] sd 5:0:0:0: [sdb] tag#20 CDB: Write(10) 2a 00 02 da 6f b8 00 00 10 00
[827848.687442] blk_update_request: I/O error, dev sdb, sector 47869880 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0
[827848.687445] EXT4-fs warning (device dm-1): ext4_end_bio:309: I/O error 10 writing to inode 1704088 (offset 0 size 0 starting block 5917175)
[827848.687446] Buffer I/O error on device dm-1, logical block 5917175
[827848.687449] EXT4-fs warning (device dm-1): ext4_end_bio:309: I/O error 10 writing to inode 1704088 (offset 0 size 0 starting block 5917176)
[827848.687450] Buffer I/O error on device dm-1, logical block 5917176
[827848.687458] sd 5:0:0:0: [sdb] tag#19 FAILED Result: hostbyte=DID_OK driverbyte=
[827848.687459] sd 5:0:0:0: [sdb] tag#19 CDB: Write(10) 2a 00 01 cc 20 00 00 00 08 00
[827848.687460] blk_update_request: I/O error, dev sdb, sector 30154752 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0
[827848.687463] blk_update_request: I/O error, dev sdb, sector 30154752 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0
[827848.687467] Buffer I/O error on dev dm-1, logical block 3702784, lost sync page write
[827848.687473] sd 5:0:0:0: [sdb] tag#18 FAILED Result: hostbyte=DID_OK driverbyte=
[827848.687476] JBD2: Error -5 detected when updating journal superblock for dm-1-8.
[827848.687478] sd 5:0:0:0: [sdb] tag#18 CDB: Write(10) 2a 00 02 da 6f a8 00 00 08 00
[827848.687479] blk_update_request: I/O error, dev sdb, sector 47869864 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0
[827848.687482] EXT4-fs warning (device dm-1): ext4_end_bio:309: I/O error 10 writing to inode 1704088 (offset 0 size 0 starting block 5917173)
[827848.687483] Buffer I/O error on device dm-1, logical block 5917173
[827849.861197] kauditd_printk_skb: 2 callbacks suppressed
[827849.861200] audit: type=1107 audit(158466498
[827863.341252] JBD2: Detected IO errors while flushing file data on dm-1-8
[827863.343642] EXT4-fs error (device dm-1): ext4_journal_
[827863.343645] EXT4-fs (dm-1): Remounting filesystem read-only
[827863.351655] EXT4-fs error (device dm-1): ext4_journal_
[827863.366372] EXT4-fs error (device dm-1): ext4_journal_
[827863.372043] EXT4-fs error (device dm-1): ext4_journal_
[827863.372044] EXT4-fs error (device dm-1): ext4_journal_
[827863.372050] EXT4-fs error (device dm-1): ext4_journal_
[827863.373408] EXT4-fs error (device dm-1): ext4_journal_
[827863.374416] EXT4-fs error (device dm-1): ext4_journal_
[827863.384710] EXT4-fs error (device dm-1): ext4_journal_
[827863.384713] EXT4-fs (dm-1): ext4_writepages: jbd2_start: 1023 pages, ino 1351263; err -30
[827863.384714] EXT4-fs error (device dm-1): ext4_journal_
[827891.892138] audit: type=1107 audit(158466503
[827893.609791] usb 3-2: USB disconnect, device number 36
[828009.578504] sd 5:0:0:0: [sdb] tag#31 FAILED Result: hostbyte=DID_OK driverbyte=
[828009.578507] sd 5:0:0:0: [sdb] tag#31 CDB: Write(10) 2a 00 01 dd bb a8 00 00 08 00
[828009.578510] blk_update_request: I/O error, dev sdb, sector 31308712 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0
[828009.578518] EXT4-fs warning (device dm-1): ext4_end_bio:309: I/O error 10 writing to inode 1572874 (offset 0 size 0 starting block 3847029)
[828009.578520] Buffer I/O error on device dm-1, logical block 3847029
[828009.578531] sd 5:0:0:0: [sdb] tag#30 FAILED Result: hostbyte=DID_OK driverbyte=
[828009.578533] sd 5:0:0:0: [sdb] tag#30 CDB: Write(10) 2a 00 01 e0 5e 48 00 00 08 00
[828009.578534] blk_update_request: I/O error, dev sdb, sector 31481416 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0
[828009.578538] EXT4-fs warning (device dm-1): ext4_end_bio:309: I/O error 10 writing to inode 1572874 (offset 0 size 0 starting block 3868617)
[828009.578540] Buffer I/O error on device dm-1, logical block 3868617
[828009.578544] sd 5:0:0:0: [sdb] tag#29 FAILED Result: hostbyte=DID_OK driverbyte=
[828009.578545] sd 5:0:0:0: [sdb] tag#29 CDB: Write(10) 2a 00 01 dd bf 20 00 00 08 00
[828009.578546] blk_update_request: I/O error, dev sdb, sector 31309600 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0
[828009.578549] EXT4-fs warning (device dm-1): ext4_end_bio:309: I/O error 10 writing to inode 1572874 (offset 0 size 0 starting block 3847140)
[828009.578550] Buffer I/O error on device dm-1, logical block 3847140
[828009.578553] sd 5:0:0:0: [sdb] tag#13 FAILED Result: hostbyte=DID_OK driverbyte=
[828009.578554] sd 5:0:0:0: [sdb] tag#13 CDB: Write(10) 2a 00 01 dd d0 18 00 00 08 00
[828009.578556] blk_update_request: I/O error, dev sdb, sector 31313944 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0
[828009.578559] EXT4-fs warning (device dm-1): ext4_end_bio:309: I/O error 10 writing to inode 1572874 (offset 0 size 0 starting block 3847683)
[828009.578560] Buffer I/O error on device dm-1, logical block 3847683
[828009.578570] sd 5:0:0:0: [sdb] tag#12 FAILED Result: hostbyte=DID_OK driverbyte=
[828009.578571] sd 5:0:0:0: [sdb] tag#12 CDB: Write(10) 2a 00 01 e0 65 90 00 00 08 00
[828009.578572] blk_update_request: I/O error, dev sdb, sector 31483280 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0
[828009.578576] EXT4-fs warning (device dm-1): ext4_end_bio:309: I/O error 10 writing to inode 1572874 (offset 0 size 0 starting block 3868850)
[828009.578577] Buffer I/O error on device dm-1, logical block 3868850
[828009.578582] sd 5:0:0:0: [sdb] tag#2 FAILED Result: hostbyte=DID_OK driverbyte=
[828009.578583] sd 5:0:0:0: [sdb] tag#2 CDB: Write(10) 2a 00 01 dd cf f8 00 00 10 00
[828009.578584] blk_update_request: I/O error, dev sdb, sector 31313912 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 0
[828009.578587] EXT4-fs warning (device dm-1): ext4_end_bio:309: I/O error 10 writing to inode 1572874 (offset 0 size 0 starting block 3847679)
[828009.578588] Buffer I/O error on device dm-1, logical block 3847679
[828009.578592] EXT4-fs warning (device dm-1): ext4_end_bio:309: I/O error 10 writing to inode 1572874 (offset 0 size 0 starting block 3847680)
[828009.578593] Buffer I/O error on device dm-1, logical block 3847680
[828083.421275] GpuWatchdog[9783]: segfault at 0 ip 00007f0951c1827d sp 00007f094770db90 error 6 in libcef.
[828083.421293] Code: 00 79 09 48 8b 7d a0 e8 01 80 c1 02 41 8b 85 00 01 00 00 85 c0 0f 84 ab 00 00 00 49 8b 45 00 4c 89 ef be 01 00 00 00 ff 50 58 <c7> 04 25 00 00 00 00 37 13 00 00 c6 05 c1 a5 37 03 01 80 bd 7f ff
[828110.661767] audit: type=1107 audit(158466524
[828110.928912] fbcon: Taking over console
[828110.948111] Console: switching to colour frame buffer device 160x64
[828115.032600] audit: type=1107 audit(158466525
[828118.599720] audit: type=1326 audit(158466525
[828118.599859] audit: type=1326 audit(158466525
[828118.826628] systemd-
[828118.826657] systemd-
[828118.827653] systemd-
[828118.827721] systemd-
[828118.827745] systemd-
[828118.827771] systemd-
[828118.827793] systemd-
[828118.827815] systemd-
[828118.827839] systemd-
[828118.831107] systemd-
[828119.616184] audit: type=1326 audit(158466525
[828119.616270] audit: type=1326 audit(158466525
[828120.930906] audit: type=1326 audit(158466525
[828120.930974] audit: type=1326 audit(158466525
[828125.093997] audit: type=1326 audit(158466526
[828125.094029] audit: type=1326 audit(158466526
[828125.094110] systemd-
[828125.094137] systemd-
[828125.097634] systemd-
[828125.097655] systemd-
[828125.100831] systemd-
[828125.100880] systemd-
[828125.100902] systemd-
[828125.100921] systemd-
[828125.100941] systemd-
[828125.100959] systemd-
[828180.451459] systemd-
[828180.451489] systemd-
[828180.451510] systemd-
[828180.451612] systemd-
[828180.451634] systemd-
[828180.451655] systemd-
[828180.451677] systemd-
[828180.451698] systemd-
[828180.451718] systemd-
[828180.451739] systemd-
[828185.954576] usb 3-6.1: USB disconnect, device number 42
[828185.959381] audit: type=1107 audit(158466532
[828185.962613] systemd-
[828185.962656] systemd-
[828185.962716] systemd-
[828185.966702] systemd-
[828185.966760] systemd-
[828185.966788] systemd-
[828185.966815] systemd-
[828185.966841] systemd-
[828185.966867] systemd-
[828185.966900] systemd-
[828186.689004] usb 3-6.1: new low-speed USB device number 53 using xhci_hcd
[828187.504724] usb 3-6.1: New USB device found, idVendor=0463, idProduct=ffff, bcdDevice= 1.00
[828187.504726] usb 3-6.1: New USB device strings: Mfr=1, Product=2, SerialNumber=4
[828187.504727] usb 3-6.1: Product: Ellipse PRO
[828187.504728] usb 3-6.1: Manufacturer: EATON
[828191.324513] hid-generic 0003:0463:
[828191.326821] systemd-
[828191.344129] systemd-
[828191.344185] systemd-
[828191.358238] systemd-
[828191.358362] systemd-
[828193.422178] audit: type=1107 audit(158466533
[828193.422299] systemd-
[828193.424810] systemd-
[828193.425068] systemd-
[828193.425091] systemd-
[828193.425111] systemd-
```
OS: Ubuntu 19.10
Thank you for taking the time to report this bug and helping to make Ubuntu better. It seems that your bug report is not filed about a specific source package though, rather it is just filed against Ubuntu in general. It is important that bug reports be filed about source packages so that people interested in the package can find the bugs about it. You can find some hints about determining what package your bug might be about at https:/ /wiki.ubuntu. com/Bugs/ FindRightPackag e. You might also ask for help in the #ubuntu-bugs irc channel on Freenode.
To change the source package that this bug is filed about visit https:/ /bugs.launchpad .net/ubuntu/ +bug/1868189/ +editstatus and add the package name in the text box next to the word Package.
[This is an automated message. I apologize if it reached you inappropriately; please just reply to this message indicating so.]