HP ProLiant m400 Server: kernel boot failed because of failed sata probe

[Ming Lei]

1, upgrade to vivid from trysty

2, boot the server, then the following log in [1] can be observed

[1] kernel booting log
Starting kernel ...

L3C: 8MB
[ 0.000000] Booting Linux on physical CPU 0x0
[ 0.000000] Initializing cgroup subsys cpuset
[ 0.000000] Initializing cgroup subsys cpu
[ 0.000000] Initializing cgroup subsys cpuacct
[ 0.000000] Linux version 3.19.0-21-generic (buildd@beebe) (gcc version 4.9.2 (Ubuntu/Linaro 4.9.2-10ubuntu13) ) #21-Ubuntu SMP Sun Jun 14 18:34:06 UTC 2015 (Ubuntu 3.19.0-21.21-generic 3.19.8)
[ 0.000000] CPU: AArch64 Processor [500f0000] revision 0
[ 0.000000] Detected PIPT I-cache on CPU0
[ 0.000000] efi: Getting EFI parameters from FDT:
[ 0.000000] efi: UEFI not found.
[ 0.000000] PERCPU: Embedded 14 pages/cpu @ffffffc7fff49000 s19968 r8192 d29184 u57344
[ 0.000000] Built 1 zonelists in Zone order, mobility grouping on. Total pages: 8257536
[ 0.000000] Kernel command line: console=ttyS0,9600n8r ro
[ 0.000000] log_buf_len individual max cpu contribution: 4096 bytes
[ 0.000000] log_buf_len total cpu_extra contributions: 28672 bytes
[ 0.000000] log_buf_len min size: 16384 bytes
[ 0.000000] log_buf_len: 65536 bytes
[ 0.000000] early log buf free: 14868(90%)
[ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[ 0.000000] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[ 0.000000] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes)
[ 0.000000] Memory: 32942004K/33554432K available (7287K kernel code, 812K rwdata, 3180K rodata, 604K init, 743K bss, 612428K reserved, 0K cma-reserved)
[ 0.000000] Virtual kernel memory layout:
[ 0.000000] vmalloc : 0xffffff8000000000 - 0xffffffbdbfff0000 ( 246 GB)
[ 0.000000] vmemmap : 0xffffffbdc0000000 - 0xffffffbfc0000000 ( 8 GB maximum)
[ 0.000000] 0xffffffbec0000000 - 0xffffffbee0000000 ( 512 MB actual)
[ 0.000000] PCI I/O : 0xffffffbffa000000 - 0xffffffbffb000000 ( 16 MB)
[ 0.000000] fixed : 0xffffffbffbdfd000 - 0xffffffbffbdff000 ( 8 KB)
[ 0.000000] modules : 0xffffffbffc000000 - 0xffffffc000000000 ( 64 MB)
[ 0.000000] memory : 0xffffffc000000000 - 0xffffffc800000000 ( 32768 MB)
[ 0.000000] .init : 0xffffffc000abb000 - 0xffffffc000b52000 ( 604 KB)
[ 0.000000] .text : 0xffffffc000080000 - 0xffffffc000abaf04 ( 10476 KB)
[ 0.000000] .data : 0xffffffc000b57000 - 0xffffffc000c22200 ( 813 KB)
[ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1
[ 0.000000] Hierarchical RCU implementation.
[ 0.000000] RCU dyntick-idle grace-period acceleration is enabled.
[ 0.000000] NR_IRQS:64 nr_irqs:64 0
[ 0.000000] Architected cp15 timer(s) running at 50.00MHz (phys).
[ 0.000002] sched_clock: 56 bits at 50MHz, resolution 20ns, wraps every 2748779069440ns
[ 0.000069] Console: colour dummy device 80x25
[ 0.000082] Calibrating delay loop (skipped), value calculated using timer frequency.. 100.00 BogoMIPS (lpj=500000)
[ 0.000087] pid_max: default: 32768 minimum: 301
[ 0.000114] Security Framework initialized
[ 0.000149] AppArmor: AppArmor initialized
[ 0.000151] Yama: becoming mindful.
[ 0.000218] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes)
[ 0.000223] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes)
[ 0.000602] Initializing cgroup subsys memory
[ 0.000613] Initializing cgroup subsys devices
[ 0.000617] Initializing cgroup subsys freezer
[ 0.000621] Initializing cgroup subsys net_cls
[ 0.000624] Initializing cgroup subsys blkio
[ 0.000628] Initializing cgroup subsys perf_event
[ 0.000631] Initializing cgroup subsys net_prio
[ 0.000635] Initializing cgroup subsys hugetlb
[ 0.000653] ftrace: allocating 26186 entries in 103 pages
[ 0.011825] hw perfevents: enabled with arm/armv8-pmuv3 PMU driver, 5 counters available
[ 0.011839] EFI services will not be available.
[ 0.012826] CPU1: Booted secondary processor
[ 0.012830] Detected PIPT I-cache on CPU1
[ 0.012986] CPU2: Booted secondary processor
[ 0.012989] Detected PIPT I-cache on CPU2
[ 0.013131] CPU3: Booted secondary processor
[ 0.013133] Detected PIPT I-cache on CPU3
[ 0.013266] CPU4: Booted secondary processor
[ 0.013269] Detected PIPT I-cache on CPU4
[ 0.013410] CPU5: Booted secondary processor
[ 0.013412] Detected PIPT I-cache on CPU5
[ 0.013545] CPU6: Booted secondary processor
[ 0.013548] Detected PIPT I-cache on CPU6
[ 0.013687] CPU7: Booted secondary processor
[ 0.013689] Detected PIPT I-cache on CPU7
[ 0.013718] Brought up 8 CPUs
[ 0.013730] SMP: Total of 8 processors activated.
[ 0.014041] devtmpfs: initialized
[ 0.014210] evm: security.selinux
[ 0.014213] evm: security.SMACK64
[ 0.014215] evm: security.SMACK64EXEC
[ 0.014217] evm: security.SMACK64TRANSMUTE
[ 0.014218] evm: security.SMACK64MMAP
[ 0.014220] evm: security.ima
[ 0.014221] evm: security.capability
[ 0.014288] DMI not present or invalid.
[ 0.015620] NET: Registered protocol family 16
[ 0.041721] cpuidle: using governor ladder
[ 0.062855] cpuidle: using governor menu
[ 0.062873] vdso: 2 pages (1 code @ ffffffc000b5d000, 1 data @ ffffffc000b5c000)
[ 0.062891] hw-breakpoint: found 4 breakpoint and 4 watchpoint registers.
[ 0.063073] software IO TLB [mem 0x40ffc00000-0x4100000000] (4MB) mapped at [ffffffc0ffc00000-ffffffc0ffffffff]
[ 0.063098] DMA: preallocated 256 KiB pool for atomic allocations
[ 0.063149] Serial: AMBA PL011 UART driver
[ 0.092496] vgaarb: loaded
[ 0.092912] SCSI subsystem initialized
[ 0.093060] usbcore: registered new interface driver usbfs
[ 0.093077] usbcore: registered new interface driver hub
[ 0.093106] usbcore: registered new device driver usb
[ 0.093502] NetLabel: Initializing
[ 0.093505] NetLabel: domain hash size = 128
[ 0.093507] NetLabel: protocols = UNLABELED CIPSOv4
[ 0.093527] NetLabel: unlabeled traffic allowed by default
[ 0.093733] XGene: PCIe MSI driver v0.1
[ 0.093799] Switched to clocksource arch_sys_counter
[ 0.105421] AppArmor: AppArmor Filesystem Enabled
[ 0.108389] NET: Registered protocol family 2
[ 0.108637] TCP established hash table entries: 262144 (order: 9, 2097152 bytes)
[ 0.109303] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[ 0.109670] TCP: Hash tables configured (established 262144 bind 65536)
[ 0.109694] TCP: reno registered
[ 0.109702] UDP hash table entries: 16384 (order: 7, 524288 bytes)
[ 0.109968] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes)
[ 0.110318] NET: Registered protocol family 1
[ 0.110432] Trying to unpack rootfs image as initramfs...
[ 0.643283] Freeing initrd memory: 25380K (ffffffc7ee736000 - ffffffc7effff000)
[ 0.643420] kvm [1]: Using HYP init bounce page @47d9f81000
[ 0.643500] kvm [1]: interrupt-controller@780c0000 IRQ5
[ 0.643620] kvm [1]: timer IRQ3
[ 0.643630] kvm [1]: Hyp mode initialized successfully
[ 0.644165] futex hash table entries: 2048 (order: 5, 131072 bytes)
[ 0.644188] Initialise system trusted keyring
[ 0.644241] audit: initializing netlink subsys (disabled)
[ 0.644274] audit: type=2000 audit(0.640:1): initialized
[ 0.644537] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[ 0.646908] zpool: loaded
[ 0.646914] zbud: loaded
[ 0.647165] VFS: Disk quotas dquot_6.5.2
[ 0.647224] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 0.648060] fuse init (API version 7.23)
[ 0.648294] Key type big_key registered
[ 0.648686] Key type asymmetric registered
[ 0.648692] Asymmetric key parser 'x509' registered
[ 0.648771] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 252)
[ 0.648829] io scheduler noop registered
[ 0.648835] io scheduler deadline registered (default)
[ 0.648891] io scheduler cfq registered
[ 0.649140] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[ 0.649151] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[ 0.649195] PCI host bridge /soc/pcie@1f500000 ranges:
[ 0.649200] No bus range found for /soc/pcie@1f500000, using [bus 00-ff]
[ 0.649208] MEM 0xa130000000..0xa1afffffff -> 0x30000000
[ 0.649236] xgene-pcie 1f500000.pcie: (rc) x8 gen-2 link up
[ 0.649293] xgene-pcie 1f500000.pcie: PCI host bridge to bus 0000:00
[ 0.649297] pci_bus 0000:00: root bus resource [bus 00-ff]
[ 0.649302] pci_bus 0000:00: root bus resource [mem 0xa130000000-0xa1afffffff] (bus address [0x30000000-0xafffffff])
[ 0.663919] pci 0000:00:00.0: BAR 15: assigned [mem 0xa130000000-0xa1307fffff 64bit pref]
[ 0.663923] pci 0000:00:00.0: BAR 14: assigned [mem 0xa130800000-0xa1309fffff]
[ 0.663928] pci 0000:01:00.0: BAR 2: assigned [mem 0xa130000000-0xa1307fffff 64bit pref]
[ 0.664115] pci 0000:01:00.0: BAR 0: assigned [mem 0xa130800000-0xa1308fffff 64bit]
[ 0.664302] pci 0000:01:00.0: BAR 6: assigned [mem 0xa130900000-0xa1309fffff pref]
[ 0.664347] pci 0000:00:00.0: PCI bridge to [bus 01]
[ 0.664353] pci 0000:00:00.0: bridge window [mem 0xa130800000-0xa1309fffff]
[ 0.664357] pci 0000:00:00.0: bridge window [mem 0xa130000000-0xa1307fffff 64bit pref]
[ 0.664438] pcieport 0000:00:00.0: Signaling PME through PCIe PME interrupt
[ 0.664442] pci 0000:01:00.0: Signaling PME through PCIe PME interrupt
[ 0.664757] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[ 0.666978] console [ttyS0] disabled
[ 0.667007] 1c021000.serial: ttyS0 at MMIO 0x1c021000 (irq = 27, base_baud = 3125000) is a 16550A
[ 10.844289] console [ttyS0] enabled
[ 10.888469] brd: module loaded
[ 10.926227] loop: module loaded
[ 10.964239] libphy: Fixed MDIO Bus: probed
[ 11.013389] tun: Universal TUN/TAP device driver, 1.6
[ 11.074003] tun: (C) 1999-2004 Max Krasnyansky <email address hidden>
[ 11.148284] PPP generic driver version 2.4.2
[ 11.199630] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[ 11.277990] ehci-pci: EHCI PCI platform driver
[ 11.331314] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[ 11.405488] ohci-pci: OHCI PCI platform driver
[ 11.458814] uhci_hcd: USB Universal Host Controller Interface driver
[ 11.535217] mousedev: PS/2 mouse device common for all mice
[ 11.602163] i2c /dev entries driver
[ 11.644061] platform soc:gpio_poweroff: Driver poweroff-gpio requests probe deferral
[ 11.737220] device-mapper: uevent: version 1.0.3
[ 11.792734] device-mapper: ioctl: 4.29.0-ioctl (2014-10-28) initialised: <email address hidden>
[ 11.894072] Driver 'mmcblk' needs updating - please use bus_type methods
[ 11.974576] ledtrig-cpu: registered to indicate activity on CPUs
[ 12.046811] TCP: cubic registered
[ 12.086778] NET: Registered protocol family 10
[ 12.140462] NET: Registered protocol family 17
[ 12.193802] Key type dns_resolver registered
[ 12.245240] Loading compiled-in X.509 certificates
[ 12.304120] Loaded X.509 cert 'Magrathea: Glacier signing key: e15f231a166c64ce4f1e4e2628af477f6ef725aa'
[ 12.417953] registered taskstats version 1
[ 12.470230] Key type trusted registered
[ 12.526931] Key type encrypted registered
[ 12.575027] AppArmor: AppArmor sha1 policy hashing enabled
[ 12.640858] ima: No TPM chip found, activating TPM-bypass!
[ 12.706728] evm: HMAC attrs: 0x1
[ 12.745753] platform soc:gpio_poweroff: Driver poweroff-gpio requests probe deferral
[ 12.838725] /build/buildd/linux-3.19.0/drivers/rtc/hctosys.c: unable to open rtc device (rtc0)
[ 12.942592] Freeing unused kernel memory: 604K (ffffffc000abb000 - ffffffc000b52000)
[ 13.035548] Freeing alternatives memory: 12K (ffffffc000b52000 - ffffffc000b55000)
Loading, please [ 13.146139] random: systemd-udevd urandom read with 1 bits of entropy available
wait...
starting version 219
[ 13.260972] xgene-ahci 1a800000.sata: can't request region for resource [mem 0x1f23a000-0x1f23a0ff]
[ 13.263634] mlx4_core: Mellanox ConnectX core driver v2.2-1 (Feb, 2014)
[ 13.263640] mlx4_core: Initializing 0000:01:00.0
[ 13.511613] xgene-ahci: probe of 1a800000.sata failed with error -16
[ 20.415105] mlx4_core 0000:01:00.0: PCIe BW is different than device's capability
[ 20.504928] mlx4_core 0000:01:00.0: PCIe link speed is 5.0GT/s, device supports 8.0GT/s
[ 20.601005] mlx4_core 0000:01:00.0: PCIe link width is x8, device supports x8
[ 20.686813] mlx4_core 0000:01:00.0: Found no xgene,msi phandle
[ 20.858281] platform soc:gpio_poweroff: Driver poweroff-gpio requests probe deferral
[ 20.860717] pps_core: LinuxPPS API ver. 1 registered
[ 20.860719] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <email address hidden>
[ 20.863075] PTP clock support registered
[ 20.874252] mlx4_en: Mellanox ConnectX HCA Ethernet driver v2.2-1 (Feb 2014)
[ 20.874886] mlx4_en 0000:01:00.0: registered PHC clock
[ 20.874947] mlx4_en 0000:01:00.0: Activating port:1
[ 20.892817] mlx4_en: 0000:01:00.0: Port 1: Using 64 TX rings
[ 20.892819] mlx4_en: 0000:01:00.0: Port 1: Using 4 RX rings
[ 20.892821] mlx4_en: 0000:01:00.0: Port 1: frag:0 - size:1518 prefix:0 stride:1536
[ 20.893092] mlx4_en: 0000:01:00.0: Port 1: Initializing port
[ 20.894568] mlx4_en 0000:01:00.0: Activating port:2
[ 20.904386] mlx4_en: 0000:01:00.0: Port 2: Using 64 TX rings
[ 20.904388] mlx4_en: 0000:01:00.0: Port 2: Using 4 RX rings
[ 20.904390] mlx4_en: 0000:01:00.0: Port 2: frag:0 - size:1518 prefix:0 stride:1536
[ 20.904630] mlx4_en: 0000:01:00.0: Port 2: Initializing port
[ 21.461432] mlx4_en: eth1: Link Up
Begin: Loading e[ 22.095484] mlx4_en: eth0: Link Up
ssential drivers ... done.
Begin: Running /scripts/init-premount ... done.
Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done.
Begin: Loading e[ 52.125818] hidraw: raw HID events driver (C) Jiri Kosina
ssential drivers[ 52.201240] usbcore: registered new interface driver usbhid
 ... done.
Beg[ 52.281213] usbhid: USB HID core driver
in: Running /scripts/init-premount ... done.
Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done.
Gave up waiting for root device. Common problems:
 - Boot args (cat /proc/cmdline)
   - Check rootdelay= (did the system wait long enough?)
   - Check root= (did the system wait for the right device?)
 - Missing modules (cat /proc/modules; ls /dev)
ALERT! /dev/disk/by-label/cloudimg-rootfs does not exist. Dropping to a shell!

BusyBox v1.22.1 (Ubuntu 1:1.22.0-9ubuntu1) built-in shell (ash)
Enter 'help' for a list of built-in commands.

(initramfs)

[Brad Figg (brad-figg)]

This bug is missing log files that will aid in diagnosing the problem. From a terminal window please run:

apport-collect 1469937

and then change the status of the bug to 'Confirmed'.

If, due to the nature of the issue you have encountered, you are unable to run this command, please add a comment stating that fact and change the bug status to 'Confirmed'.

This change has been made by an automated script, maintained by the Ubuntu Kernel Team.

[Ming Lei (tom-leiming)]

Turns out the firmware on this server is a bit old(U-Boot 2013.04 (Oct 01 2014 - 15:18:17)), and the problem
doesn't exit on another server which firmware is U-Boot 2013.04 (Mar 26 2015 - 11:31:01).