Incredible 2min boot delay

[EricDHH]

Binary package hint: linux-image-generic

Description: Ubuntu 11.04
Release: 11.04 amd64

With lastest kernel i got a break in bootup, after gdm the screen turns violet and the harddiscs take a break. 2 minutes nothing happens, it's not possible to switch to a virtual console to have a look at it. But in syslog you can see the delay.

May 1 10:01:00 agamemnon ntpdate[1249]: step time server 91.189.94.4 offset 0.7
54982 sec
May 1 10:01:00 agamemnon kernel: [ 18.020094] eth1: no IPv6 routers present
May 1 10:01:36 agamemnon kernel: [ 54.225887] Clocksource tsc unstable (delta
 = -17179873749 ns)
May 1 10:01:36 agamemnon kernel: [ 54.226037] Switching to clocksource hpet
May 1 10:01:46 agamemnon kernel: [ 63.690139] CE: hpet increased min_delta_ns
 to 20113 nsec
May 1 10:03:47 agamemnon init: udevtrigger post-stop process (427) terminated w
ith status 1
May 1 10:03:48 agamemnon kernel: [ 185.248139] vesafb: framebuffer at 0xd00000
00, mapped to 0xffffc90011c80000, using 5824k, total 5824k
May 1 10:03:48 agamemnon kernel: [ 185.248149] vesafb: mode is 1400x1050x32, l
inelength=5632, pages=0
May 1 10:03:48 agamemnon kernel: [ 185.248155] vesafb: scrolling: redraw
May 1 10:03:48 agamemnon kernel: [ 185.248162] vesafb: Truecolor: size=0:8:8:8
, shift=0:16:8:0

ProblemType: Bug
DistroRelease: Ubuntu 11.04
Package: linux-image (not installed)
ProcVersionSignature: Ubuntu 2.6.38-8.42-genusername 2.6.38.2
Uname: Linux 2.6.38-8-generic x86_64
NonfreeKernelModules: fglrx
AlsaVersion: Advanced Linux Sound Architecture Driver Version 1.0.23.
Architecture: amd64
AudioDevicesInUse:
 USER PID ACCESS COMMAND
 /dev/snd/controlC0: eric 1776 F.... pulseaudio
CRDA: Error: [Errno 2] Datei oder Verzeichnis nicht gefunden
Card0.Amixer.info:
 Card hw:0 'Audigy2'/'SB Audigy 2 ZS [SB0350] (rev.4, serial:0x20021102) at 0xcf00, irq 21'
   Mixer name : 'SigmaTel STAC9721,23'
   Components : 'AC97a:83847609'
   Controls : 210
   Simple ctrls : 46
Card1.Amixer.info:
 Card hw:1 'Generic'/'HD-Audio Generic at 0xfdefc000 irq 43'
   Mixer name : 'ATI R6xx HDMI'
   Components : 'HDA:1002aa01,00aa0100,00100200'
   Controls : 4
   Simple ctrls : 1
Card1.Amixer.values:
 Simple mixer control 'IEC958',0
   Capabilities: pswitch pswitch-joined penum
   Playback channels: Mono
   Mono: Playback [on]
CheckboxSubmission: 72ffaca291c05635776d4a13f9e644e4
CheckboxSystem: 32980ee028b29311fef8e195a759b031
Date: Sun May 1 10:10:49 2011
HibernationDevice: RESUME=UUID=56843c74-2af4-4594-b417-5bc9c34e8e75
InstallationMedia: Ubuntu 10.10 "Maverick Meerkat" - Release amd64 (20101007)
IwConfig: Error: [Errno 2] Datei oder Verzeichnis nicht gefunden
MachineType: Gigabyte Technology Co., Ltd. GA-MA770T-UD3
ProcEnviron:
 LANGUAGE=de_DE:de_DE.UTF8:en
 PATH=(custom, no user)
 LANG=de_DE.utf8
 SHELL=/bin/bash
ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-2.6.38-8-genusername root=UUID=f2932462-e3b8-4660-8c03-105827421b5c ro quiet splash elevator=noop vt.handoff=7
RelatedPackageVersions:
 linux-restricted-modules-2.6.38-8-generic N/A
 linux-backports-modules-2.6.38-8-generic N/A
 linux-firmware 1.52
RfKill: Error: [Errno 2] Datei oder Verzeichnis nicht gefunden
SourcePackage: linux
UdevDb: Error: [Errno 2] Datei oder Verzeichnis nicht gefunden
UpgradeStatus: Upgraded to natty on 2011-04-26 (4 days ago)
dmi.bios.date: 04/09/2010
dmi.bios.vendor: Award Software International, Inc.
dmi.bios.version: F3
dmi.board.name: GA-MA770T-UD3
dmi.board.vendor: Gigabyte Technology Co., Ltd.
dmi.board.version: x.x
dmi.chassis.type: 3
dmi.chassis.vendor: Gigabyte Technology Co., Ltd.
dmi.modalias: dmi:bvnAwardSoftwareInternational,Inc.:bvrF3:bd04/09/2010:svnGigabyteTechnologyCo.,Ltd.:pnGA-MA770T-UD3:pvr:rvnGigabyteTechnologyCo.,Ltd.:rnGA-MA770T-UD3:rvrx.x:cvnGigabyteTechnologyCo.,Ltd.:ct3:cvr:
dmi.product.name: GA-MA770T-UD3
dmi.sys.vendor: Gigabyte Technology Co., Ltd.

[EricDHH (ericdhh)]

I add a bootchart, it runs to 50s then the wait minutes appears but bootchart is not able to see this. For testing reason i boot my old 10.10 amd64 live usb, there is no such hang in the older version.

[EricDHH (ericdhh)]

If the bootup hangs in this state, the computer did not shut down. It turns to the purple unity screen with the dots and stay there. It does not matter if ctrl-alt-del or the powerbutton are pressed, nothing happens there.
Again, this did not exist in the lastest betas from 11.04, must be a quirk from the stable kernelparts. This bug drives me crazy, ubuntu boots even slower than the slowest windows and i have to powerdown the computer on the backside.

[EricDHH (ericdhh)]

Got a kernel update
ii linux-generic 2.6.38.9.23 Complete Generic Linux kernel

Status: no change, same behaviour as before. Between 11:00 27 and 11:01.02 nothing happens. The computer stood in the solid purple screen and no actions on the controllers are visible.

Jun 2 11:00:27 agamemnon rsyslogd: [origin software="rsyslogd" swVersion="4.6.4
" x-pid="926" x-info="http://www.rsyslog.com"] exiting on signal 15.
Jun 2 11:01:02 agamemnon kernel: imklog 4.6.4, log source = /proc/kmsg started.
Jun 2 11:01:02 agamemnon rsyslogd: [origin software="rsyslogd" swVersion="4.6.4
" x-pid="934" x-info="http://www.rsyslog.com"] (re)start
Jun 2 11:01:02 agamemnon rsyslogd: rsyslogd's groupid changed to 103

[EricDHH (ericdhh)]

Next kernel update

linux-image-2.6.38-10-generic_2.6.38-10.44_amd64.deb

No change of this problem, the bootup is still alive:-(

[EricDHH (ericdhh)]

Further checkups

- exclude all mounts in fstab except root: delayed boot
- tested kernel -8 to -10: delayed boot
- boot in repairmode: delayed boot
- unplug all sata / ata drives except root: delayed boot

Tested with 10.10 amd64 and 11.04 amd64 live usb stick, not delayed.

What is it?

[EricDHH (ericdhh)]

More checkups

removed "quiet" and "splash" from default/grub config, update-grub but no visual output, The sytem already stays in the empty purple screen.
Installed openssh-server, now i can ssh to the machine while in the purple waitstate. I see that init and udevadm eat all ressources when using top.

Tried "acpi=off" as argument, did not help

[EricDHH (ericdhh)]

Things from the syslog while the happening

Jun 25 21:39:36 agamemnon avahi-daemon[976]: New relevant interface eth1.IPv6 for mDNS.
Jun 25 21:39:36 agamemnon avahi-daemon[976]: Registering new address record for fe80::6ef0:49ff:fe09:84ea on eth1.*.
Jun 25 21:39:36 agamemnon NetworkManager[974]: <info> Policy set 'Auto eth1' (eth1) as default for IPv4 routing and DNS.
Jun 25 21:39:36 agamemnon NetworkManager[974]: <info> Activation (eth1) successful, device activated.
Jun 25 21:39:36 agamemnon NetworkManager[974]: <info> Activation (eth1) Stage 5 of 5 (IP Configure Commit) complete.
Jun 25 21:39:45 agamemnon ntpdate[1343]: adjust time server 91.189.94.4 offset 0.338322 sec
Jun 25 21:39:45 agamemnon kernel: [ 17.580020] eth1: no IPv6 routers present

Here is the break, as you see we lost minutes!

Jun 25 21:42:32 agamemnon init: udevtrigger post-stop process (503) terminated with status 1
Jun 25 21:42:32 agamemnon kernel: [ 184.432386] vesafb: framebuffer at 0xd0000000, mapped to 0xffffc90011c80000, using 1920k, total 1920k
Jun 25 21:42:32 agamemnon kernel: [ 184.432397] vesafb: mode is 800x600x32, linelength=3200, pages=0
Jun 25 21:42:32 agamemnon kernel: [ 184.432402] vesafb: scrolling: redraw
Jun 25 21:42:32 agamemnon kernel: [ 184.432409] vesafb: Truecolor: size=0:8:8:8, shift=0:16:8:0
Jun 25 21:42:32 agamemnon kernel: [ 184.437420] Console: switching to colour frame buffer device 100x37
Jun 25 21:42:32 agamemnon kernel: [ 184.439453] ppdev: user-space parallel port driver
Jun 25 21:42:32 agamemnon kernel: [ 184.446272] fb0: VESA VGA frame buffer device
Jun 25 21:42:32 agamemnon kernel: [ 184.450664] audit_printk_skb: 12 callbacks suppressed
Jun 25 21:42:32 agamemnon kernel: [ 184.450666] type=1400 audit(1309030952.779:15): apparmor="STATUS" operation="profile_replace" name="/usr/lib/cups/backend/cups-pdf" pid=1630 comm="apparmor_parser"
Jun 25 21:42:32 agamemnon kernel: [ 184.451018] type=1400 audit(1309030952.779:16): apparmor="STATUS" operation="profile_replace" name="/usr/sbin/cupsd" pid=1630 comm="apparmor_parser"
Jun 25 21:42:32 agamemnon gdm-binary[1636]: WARNING: Unable to load file '/etc/gdm/custom.conf': Datei oder Verzeichnis nicht gefunden
Jun 25 21:42:32 agamemnon gdm-binary[1636]: WARNING: Unable to find users: no seat-id found
Jun 25 21:42:32 agamemnon gdm-simple-slave[1642]: WARNING: Unable to load file '/etc/gdm/custom.conf': Datei oder Verzeichnis nicht gefunden
Jun 25 21:42:32 agamemnon acpid: client connected from 1645[0:0]
Jun 25 21:42:32 agamemnon acpid: 1 client rule loaded
Jun 25 21:42:32 agamemnon udevd[426]: worker [469] unexpectedly returned with status 0x0100
Jun 25 21:42:32 agamemnon udevd[426]: worker [469] failed while handling '/devices/pci0000:00/0000:00:14.4/0000:03:07.0/sound/card0/controlC0'
Jun 25 21:42:32 agamemnon udevd[426]: worker [445] unexpectedly returned with status 0x0100
Jun 25 21:42:32 agamemnon udevd[426]: worker [445] failed while handling '/devices/pci0000:00/0000:00:02.0/0000:01:00.1/sound/card1/controlC1'

[EricDHH (ericdhh)]

Linked to 433943 cause the first attempted result in the logfiles are the crashed udevtrigger. This seems to be a problem that periodically appears in ubuntu distros.