WARNING: at /build/buildd/linux-2.6.37/kernel/trace/ftrace.c:1014 ftrace_bug+0x289/0x2c0()

[Delan Azabani]

Only in natty, 2.6.37-9-server, newly introduced problem not in 2.6.37-8-server. Probably in generic too, though I haven't tested this.

In /var/log/messages during boot:

Dec 14 07:30:41 localhost kernel: [ 2.406335] ------------[ cut here ]------------
Dec 14 07:30:41 localhost kernel: [ 2.406341] WARNING: at /build/buildd/linux-2.6.37/kernel/trace/ftrace.c:1014 ftrace_bug+0x289/0x2c0()
Dec 14 07:30:41 localhost kernel: [ 2.406343] Hardware name: EP45T-UD3P
Dec 14 07:30:41 localhost kernel: [ 2.406344] Modules linked in: crc32c_intel(+) libcrc32c
Dec 14 07:30:41 localhost kernel: [ 2.406347] Pid: 147, comm: modprobe Not tainted 2.6.37-9-server #22-Ubuntu
Dec 14 07:30:41 localhost kernel: [ 2.406348] Call Trace:
Dec 14 07:30:41 localhost kernel: [ 2.406353] [<ffffffff8106625f>] warn_slowpath_common+0x7f/0xc0
Dec 14 07:30:41 localhost kernel: [ 2.406356] [<ffffffffa000a1d4>] ? crc32c_intel_cra_init+0x4/0x14 [crc32c_intel]
Dec 14 07:30:41 localhost kernel: [ 2.406358] [<ffffffff810662ba>] warn_slowpath_null+0x1a/0x20
Dec 14 07:30:41 localhost kernel: [ 2.406360] [<ffffffff810e1089>] ftrace_bug+0x289/0x2c0
Dec 14 07:30:41 localhost kernel: [ 2.406363] [<ffffffffa000a1d4>] ? crc32c_intel_cra_init+0x4/0x14 [crc32c_intel]
Dec 14 07:30:41 localhost kernel: [ 2.406365] [<ffffffff810e130a>] ftrace_update_code+0x11a/0x150
Dec 14 07:30:41 localhost kernel: [ 2.406367] [<ffffffffa000a1d4>] ? crc32c_intel_cra_init+0x4/0x14 [crc32c_intel]
Dec 14 07:30:41 localhost kernel: [ 2.406369] [<ffffffff810e1741>] ftrace_process_locs+0x91/0xc0
Dec 14 07:30:41 localhost kernel: [ 2.406371] [<ffffffff810e3095>] ftrace_module_notify+0x45/0x50
Dec 14 07:30:41 localhost kernel: [ 2.406374] [<ffffffff815d3dfd>] notifier_call_chain+0x4d/0x70
Dec 14 07:30:41 localhost kernel: [ 2.406376] [<ffffffff8108dac8>] __blocking_notifier_call_chain+0x58/0x80
Dec 14 07:30:41 localhost kernel: [ 2.406378] [<ffffffff8108db06>] blocking_notifier_call_chain+0x16/0x20
Dec 14 07:30:41 localhost kernel: [ 2.406382] [<ffffffff810a4e27>] sys_init_module+0x87/0x220
Dec 14 07:30:41 localhost kernel: [ 2.406384] [<ffffffff8100c082>] system_call_fastpath+0x16/0x1b
Dec 14 07:30:41 localhost kernel: [ 2.406386] ---[ end trace fe53bf35d3e75dd1 ]---

When manually modprobing:

root@delan1:/# modprobe crc32c_intel
FATAL: Error inserting crc32c_intel (/lib/modules/2.6.37-9-server/kernel/arch/x86/crypto/crc32c-intel.ko): No such device

[Aron Xu (happyaron)]

Confirmed in 2.6.37-9-generic:

$ sudo modprobe crc32c-intel
FATAL: Error inserting crc32c_intel (/lib/modules/2.6.37-9-generic/kernel/arch/x86/crypto/crc32c-intel.ko): No such device

[Anton Anikin (anton-anikin)]

sam problem with 2.6.37-10

[Jonathan Kolberg (bulldog98)]

Same with 2.6.37-11

[Marc Brinkmann (marc-brinkmann)]

i can confirm that bug with ubuntu 10.10 x64 with mainline-kernel 2.6.37-rc8 and 2.6.37

sudo modprobe crc32c_intel
FATAL: Error inserting crc32c_intel (/lib/modules/2.6.37-020637-generic/kernel/arch/x86/crypto/crc32c-intel.ko): No such device

[Marc Brinkmann (marc-brinkmann)]

Same on 2.6.36-3 mainline
sudo modprobe crc32c_intel
FATAL: Error inserting crc32c_intel (/lib/modules/2.6.36-02063603-generic/kernel/arch/x86/crypto/crc32c-intel.ko): No such device

[Marc Brinkmann (marc-brinkmann)]

I read here: https://btrfs.wiki.kernel.org/index.php/Getting_started

"Compiling the kernel support
Btrfs uses libcrc32c in the kernel for file and metadata checksums and zlib to compress data. The necessary options are automatically selected when you select to compile BTrFS: CONFIG_LIBCRC32C, CONFIG_ZLIB_INFLATE and CONFIG_ZLIB_DEFLATE. "

Now when i boot my machine with 2.6.37 it tells me, / has 51.1GB free while on 2.6.35 / has 55.5 GB free.
So i assume the error is connected to the compression of btrfs (which i have activated on my /).

However when i run the modprobe command with the official 2.6.35-24-generic, i get the very same error message...

i hope one can understand me and the information helps solving this topic.

[Aron Xu (happyaron)]

Yes, btrfs require libcrc32c to help handle compression checksum of the filesystem, so the module is required to be loaded before actually mount it. There is a fact, that AMD CPUs won't have the chance to use crc32c_intel, I am curious about if everyone commented above is running AMD CPUs.

I didn't read the actual code in Ubuntu kernel tree, but I guess they have hard code to load the Intel specific crc32c_intel module first, then crc32c module for other architectures So the problem should be reproducible on any other platforms other than on Intel CPUs. If the kernel just load crc32c, Intel CPUs won't have the chance to load crc32c_intel because crc32c has a higher priority than crc32_intel.

[Marc Brinkmann (marc-brinkmann)]

No i have an Intel CPU.
I hope my Hardinfo helps:

Computer

Summary
Computer
Processor 2x Intel(R) Core(TM)2 Duo CPU T9600 @ 2.80GHz
Memory 4054MB (686MB used)
Operating System Ubuntu 10.10
User Name marc (Marc Brinkmann)
Date/Time Do 13 Jan 2011 10:40:38 CET
Display
Resolution 1680x1050 pixels
OpenGL Renderer Unknown
X11 Vendor The X.Org Foundation
Multimedia
Audio Adapter HDA-Intel - HDA Intel
Input Devices
Lid Switch
Power Button
Power Button
AT Translated Set 2 keyboard
Logitech USB-PS/2 Optical Mouse
USB 2.0 Camera
PS/2 Mouse
AlpsPS/2 ALPS GlidePoint
Video Bus
ENE eHome Infrared Remote Receiver
HDA Intel Mic
HDA Intel Headphone
Printers
No printers found
SCSI Disks
ATA WDC WD5000BEVT-2
Optiarc BD RW BD-5730S
PNY USB 2.0 FD
Operating System
Version
Kernel Linux 2.6.37-020637-generic (x86_64)
Compiled #201101050908 SMP Wed Jan 5 09:09:44 UTC 2011
C Library GNU C Library version 2.12.1 (stable)
Default C Compiler GNU C Compiler version 4.4.5 (Ubuntu/Linaro 4.4.4-14ubuntu5)
Distribution Ubuntu 10.10
Current Session
Computer Name darkwing
User Name marc (Marc Brinkmann)
Home Directory /home/marc
Desktop Environment GNOME 2.32.0
Misc
Uptime 11 minutes
Load Average 0,00, 0,00, 0,00
Kernel Modules
Loaded Modules
xts XTS block cipher mode
gf128mul Functions for multiplying elements of GF(2^128)
dm_crypt device-mapper target for transparent encryption / decryption
usb_storage USB Mass Storage driver for Linux
uas
cryptd Software async crypto daemon
aes_x86_64 Rijndael (AES) Cipher Algorithm, asm optimized
aes_generic Rijndael (AES) Cipher Algorithm
binfmt_misc
vboxnetadp Oracle VM VirtualBox Network Adapter Driver
vboxnetflt Oracle VM VirtualBox Network Filter Driver
vboxdrv Oracle VM VirtualBox Support Driver
nfsd
lockd NFS file locking service version 0.5.
nfs_acl
auth_rpcgss
sunrpc
exportfs
kvm_intel
kvm
parport_pc PC-style parallel port driver
ppdev
arc4 ARC4 Cipher Algorithm
snd_hda_codec_hdmi HDMI HD-audio codec
ir_lirc_codec LIRC IR handler bridge
lirc_dev LIRC base driver module
snd_hda_codec_realtek Realtek HD-audio codec
ir_sony_decoder Sony IR protocol decoder
iwlagn Intel(R) Wireless WiFi Link AGN driver for Linux
nvidia
iwlcore iwl core
snd_hda_intel Intel HDA driver
rc_rc6_mce
ir_jvc_decoder JVC IR protocol decoder
ir_rc6_decoder RC6 IR protocol decoder
ir_rc5_decoder RC5(x) IR protocol decoder
snd_hda_codec HDA codec core
mac80211 IEEE 802.11 subsystem
joydev Joystick device interfaces
ir_nec_decoder NEC IR protocol decoder
snd_hwdep Hardware dependent layer
video ACPI Video Driver
output Display Output Switcher Lowlevel Control Abstraction
ene_ir Infrared input driver for KB3926B/C/D/E/F (aka ENE0100/ENE0200/ENE0201/ENE0202) CIR port
uvcvideo USB Video Class driver
snd_pcm Midlevel PCM code for ALSA.
cfg80211 wireless configuration support
ir_core
videodev Device registrar for Video4Linux drivers v2
jmb38x_ms JMicron jmb38x MemoryStick driver
v4l1_compat v4l(1) compatibility layer for v4l2 drivers.
snd_seq_midi Advanced Linux Sound Architecture sequencer MIDI synth.
memstick Sony MemoryStick core driver
snd_rawmidi Midlevel RawMidi code for ALSA.
snd_seq_midi_event MIDI byte <-> sequencer event coder
s...

[Jan Girlich (vollkorn)]

I have a Thinkpad R51 with Intel chipset and am affected, too.
But it works just fine on my Thinkpad X61 with intel chipset, so I believe this is hardware specific.

Since this happens during boot before any console gets started (only saw following error message after hitting ESC on the bootsplash): How to find out which component is causing it?

FATAL: Error inserting crc32c_intel (/lib/modules/2.6.37-12-generic/kernel/arch/x86/crypto/crc32-intel.ko): No such device
stdin: error 0

[Aron Xu (happyaron)]

Could you run `lsmod' on the working laptop and paste the output here?
(or upload in a file)

--
Regards,
Aron Xu

[Marc Brinkmann (marc-brinkmann)]

http://pastebin.com/qydnuDsn

[Aron Xu (happyaron)]

well, no clue in lsmod output, :(

[Marc Brinkmann (marc-brinkmann)]

Oh, i'm sorry. i misunderstood you
it was no working one, as i run just one laptop.
and on this i have the situation..

is there anything else i could do?

[Jan Girlich (vollkorn)]

Hey Aron,
here is the output of lsmod on my Thinkpad X61 where the current natty boots up fine (done with up-to-date natty live CD):

Module Size Used by
binfmt_misc 13213 1
dm_crypt 18012 0
lp 13349 0
snd_hda_codec_analog 70788 1
arc4 12473 2
snd_hda_intel 24140 2
snd_usb_audio 99605 1
snd_hda_codec 90901 2 snd_hda_codec_analog,snd_hda_intel
snd_pcm 80274 3 snd_hda_intel,snd_usb_audio,snd_hda_codec
thinkpad_acpi 73780 0
snd_hwdep 13274 2 snd_usb_audio,snd_hda_codec
snd_usbmidi_lib 24389 1 snd_usb_audio
snd_seq_midi 13132 0
snd_rawmidi 25301 2 snd_usbmidi_lib,snd_seq_midi
snd_seq_midi_event 14475 1 snd_seq_midi
iwlagn 280166 0
snd_seq 51303 2 snd_seq_midi,snd_seq_midi_event
pcmcia 43767 0
iwlcore 138295 1 iwlagn
uvcvideo 66852 0
snd_timer 28689 2 snd_pcm,snd_seq
snd_seq_device 14110 3 snd_seq_midi,snd_rawmidi,snd_seq
mac80211 246296 2 iwlagn,iwlcore
ppdev 12849 0
videodev 75171 1 uvcvideo
tpm_tis 13993 0
v4l1_compat 21825 2 uvcvideo,videodev
parport_pc 32111 1
tpm 21121 1 tpm_tis
yenta_socket 27230 0
joydev 17322 0
snd 55129 18 snd_hda_codec_analog,snd_hda_intel,snd_usb_audio,snd_hda_codec,thinkpad_acpi,snd_hwdep,snd_pcm,snd_usbmidi_lib,snd_rawmidi,snd_seq,snd_timer,snd_seq_device
nvram 14035 1 thinkpad_acpi
tpm_bios 13460 1 tpm
parport 36746 3 lp,ppdev,parport_pc
pcmcia_rsrc 18292 1 yenta_socket
cfg80211 146707 3 iwlagn,iwlcore,mac80211
pcmcia_core 21505 3 pcmcia,yenta_socket,pcmcia_rsrc
psmouse 64260 0
soundcore 12600 1 snd
snd_page_alloc 14073 2 snd_hda_intel,snd_pcm
serio_raw 12990 0
squashfs 35795 1
aufs 158932 3953
nls_iso8859_1 12617 1
nls_cp437 12751 1
vfat 17313 1
fat 55474 1 vfat
dm_raid45 88410 0
xor 21860 1 dm_raid45
btrfs 517268 0
zlib_deflate 26594 1 btrfs
libcrc32c 12543 1 btrfs
hid_cherry 12547 0
usbhid 45936 0
hid 76993 2 hid_cherry,usbhid
usb_storage 43946 1
uas 17676 0
i915 393710 3
drm_kms_helper 40746 1 i915
drm 182215 4 i915,drm_kms_helper
ahci 21591 1
sdhci_pci 13573 0
firewire_ohci 31396 0
firewire_core 60264 1 firewire_ohci
e1000e 138373 0
sdhci 22720 1 sdhci_pci
crc_itu_t 12627 1 firewire_core
libahci 25249 1 ahci
i2c_algo_bit 13150 1 i915
video 18975 1 i915
outpu...

[Aron Xu (happyaron)]

Still no clue, :(

[Jan Girlich (vollkorn)]

I found out something interesting by accident.

If I create a natty boot disk with usb-creator-gtk and choose the option to store documents and settings on the disk (tested with 1GB) the crc32c error occurs, but if I turn it off and select to discard any changes on shutdown, it works!

So then I had a closer look and noticed the HDD LED is lit up when the error occurs. I took out the harddrive and tried again and the HDD LED was still lit. I figure it shows the USB read/write activity, too, since there was no other drive the laptop could possibly read from or write on.

This was tested on my Thinkpad R51. "lsmod" made with the same natty live CD as the one of my X61 before:

Module Size Used by
dm_crypt 18012 0
lp 13349 0
snd_intel8x0 33213 2
snd_ac97_codec 105614 1 snd_intel8x0
ac97_bus 12642 1 snd_ac97_codec
snd_pcm 80274 2 snd_intel8x0,snd_ac97_codec
thinkpad_acpi 73780 0
snd_seq_midi 13132 0
ipw2100 77368 0
snd_rawmidi 25301 1 snd_seq_midi
pcmcia 43767 0
snd_seq_midi_event 14475 1 snd_seq_midi
libipw 46642 1 ipw2100
snd_seq 51303 2 snd_seq_midi,snd_seq_midi_event
nsc_ircc 23199 0
binfmt_misc 13213 1
lib80211 14570 1 libipw
yenta_socket 27230 0
ppdev 12849 0
snd_timer 28689 2 snd_pcm,snd_seq
cfg80211 146707 2 ipw2100,libipw
joydev 17322 0
snd_seq_device 14110 3 snd_seq_midi,snd_rawmidi,snd_seq
irda 185130 1 nsc_ircc
pcmcia_rsrc 18292 1 yenta_socket
parport_pc 32111 1
snd 55129 12 snd_intel8x0,snd_ac97_codec,snd_pcm,thinkpad_acpi,snd_rawmidi,snd_seq,snd_timer,snd_seq_device
pcmcia_core 21505 3 pcmcia,yenta_socket,pcmcia_rsrc
psmouse 64260 0
parport 36746 3 lp,ppdev,parport_pc
nvram 14035 1 thinkpad_acpi
soundcore 12600 1 snd
crc_ccitt 12595 1 irda
shpchp 32345 0
serio_raw 12990 0
snd_page_alloc 14073 2 snd_intel8x0,snd_pcm
squashfs 35795 1
aufs 158932 4032
nls_iso8859_1 12617 1
nls_cp437 12751 1
vfat 17313 1
fat 55474 1 vfat
dm_raid45 88410 0
xor 21860 1 dm_raid45
btrfs 517268 0
zlib_deflate 26594 1 btrfs
libcrc32c 12543 1 btrfs
i915 393710 2
drm_kms_helper 40746 1 i915
drm 182215 2 i915,drm_kms_helper
usb_storage 43946 1
uas 17676 0
e100 40108 0
i2c_algo_bit 13150 1 i915
floppy 60032 0
video 18975 1 i915
output 12999 1 video

[Jan Girlich (vollkorn)]

Anyone who can confirm the error only shows up with a data partition on a thumbdrive, but works fine without one? If someone could confirm this we could rename the title of the bug and track it down better.

[Marc Brinkmann (marc-brinkmann)]

No i dont have a datapartition on USB.
I'm running a real Notebook on a real HDD partition with /boot as ext2 and / as btrfs (extendet partition next to swap)

/dev/sda1 ext2 /boot pri
/dev/sda2 ntfs pri
/dev/sda3 ext
/dev/sda5 btrfs /
/dev/sda6 linux-swap

[Jan Girlich (vollkorn)]

But it wouldn't be a problem for you testing natty from a USB thumbdrive on your computer causing problems, right? Would be great if you could do so.

[Marc Brinkmann (marc-brinkmann)]

I just bootet from a USB Drive, with Natty x64 Daily ISO 24.01.2011
modprobe and lsmod gave the following:
http://pastebin.com/32H4KXqR

[Marc Brinkmann (marc-brinkmann)]

i also tested it with kernel 2.6.38 rc2 and i ran the modprobe command with 2.6.35 generic (most recent).
I always get the same errormessage (even when i boot from usb-drive on my PC).
i just don't get, why it is displayes in 2.6.37 as error, but not in 2.6.35....

[Marc Brinkmann (marc-brinkmann)]

when i run the modprobe crc32c_intel command on another machine (asus Eee PC) from SysrecordCD 2.0.1 (with altkernel 2.6.36) i get the very same message: [..]no such device

i can see, that my / with btrfs and compression shows ca 55.6gb free with kernel <= 2.6.35.X and 51.1GB free with >= 2.6.36.X
Something should have been changed there.

The newest proposed Ubuntu generic kernel 2.6.35.26 from yesterday still works fine.

[Damian (damianator)]

I can confirm that in 11.04 alpha2, when installing to usb stick using "Startup disk creator" with persistence disabled it works for me. With persistece enabled it just hangs at boot.

[Marc Brinkmann (marc-brinkmann)]

i just finished my installation of ubuntu 11.04 in VM and added "compress" in my fstab.
i got the our errormessage.
Kernel is 2.6.38.2-generic.

[Marc Brinkmann (marc-brinkmann)]

additionally i can say, that compress=lzo does not change anything.

[penalvch (penalvch)]

Delan Azabani, thank you for reporting this bug and helping make Ubuntu better. This bug was reported a while ago and there hasn't been any activity in it recently. We were wondering if this is still an issue? Can you try with the latest development release of Ubuntu? ISO CD images are available from http://cdimage.ubuntu.com/releases/ .

If it remains an issue, could you run the following command in the development release from a Terminal (Applications->Accessories->Terminal). It will automatically gather and attach updated debug information to this report.

apport-collect -p linux <replace-with-bug-number>

Also, if you could test the latest upstream kernel available that would be great. It will allow additional upstream developers to examine the issue. Refer to https://wiki.ubuntu.com/KernelMainlineBuilds . Once you've tested the upstream kernel, please remove the 'needs-upstream-testing' tag. This can be done by clicking on the yellow pencil icon next to the tag located at the bottom of the bug description and deleting the 'needs-upstream-testing' text. Please let us know your results.

Thanks in advance.

[Launchpad Janitor (janitor)]

[Expired for linux (Ubuntu) because there has been no activity for 60 days.]