AoE module doesn't work with vblade

[vnevoa]

Binary package hint: linux-source-2.6.17

The Ata-over-Ethernet kernel module doesn't discover the available "blades" and therefore it is not possible to mount any block devices that where exported via the "vblade" server.

Actually, nothing works the way it should: the udev file system entries (/dev/etherd/*) are not created, and even when created manually with "aoe-mkdevs /dev/etherd" they fail to function (try "sudo echo 1 > /dev/etherd/discover").

A quick and easy test:

sudo apt-get install aoetools vblade

# export the device localy:
sudo vblade 1 1 lo /dev/hda &

# tell the kernel to find it:
sudo modprobe aoe
sudo aoe-mkdevs /dev/etherd
sudo aoe-discover
sudo aoe-stat

On my system, "aoe-stat" doesn't return anything.
A find | grep in /sys/ doesn't reveal anything related to "etherd" or "aoe".

If, however, I replace the module with the latest compiled from Coraid's source (version 40, http://www.coraid.com/support/linux/aoe6-40.tar.gz), everything works great; in the above test I get the correct response from aoe-stat:
"e1.1 40.027GB lo up"
and I can mount "/dev/etherd/e1.1p1" without problems.

This problem happens with:
- aoe kernel module version 22 (linux-image-2.6.17-10-generic)
- aoetools 10
- vblade 10-1

Can't we just put in the latest version?

[Ben Collins (ben-collins)]

Only need one

[Adriaan Peeters (apeeters)]

Confirmed the problem on my Edgy install, did not try the Coraid driver yet.

[Adriaan Peeters (apeeters)]

Works with coraid version 40, 43 (the latest) doesn't work!

[David Rasch (rasch)]

46 (available from ooraid) seems to work well

I've also had issues with the version included in the stock kernel not allowing 'removal' and not refreshing when devices go down/up

[scramatte (s-cramatte)]

I'm running a 2.6.22 with the latest coraid driver under feisty with UDEV
I've create a file calle /etc/udev/rules.d/60-aoe.rules

--- /etc/udev/rules.d/60-aoe.rules ---
# aoe char devices
SUBSYSTEM="aoe", KERNEL="discover", NAME="etherd/%k", GROUP="disk", MODE="0220"
SUBSYSTEM="aoe", KERNEL="err", NAME="etherd/%k", GROUP="disk", MODE="0440"
SUBSYSTEM="aoe", KERNEL="interfaces", NAME="etherd/%k", GROUP="disk", MODE="0220"
SUBSYSTEM="aoe", KERNEL="revalidate", NAME="etherd/%k", GROUP="disk", MODE="0220"

# aoe block devices
KERNEL="etherd*", NAME="%k", GROUP="disk"
---------------------------------------------------

etherd is never created so when I launch aoe-discover

What I've missed ?

[Brian Murray (brian-murray)]

I am assigning this bug to the 'ubuntu-kernel-team' per their bug policy. For future reference you can learn more about their bug policy at https://wiki.ubuntu.com/KernelTeamBugPolicies .

[Leann Ogasawara (leannogasawara)]

Hi Everyone,

The 18 month support period for Edgy Eft 6.10 has reached it's end of life. As a result, we are closing the linux-source-2.6.17 Edgy Eft kernel task. However, Hardy Heron 8.04 was recently released. It would be helpful if you could test the new release and verify if this is still an issue - http://www.ubuntu.com/getubuntu/download . You should be able to test your bug using the Hardy LiveCD. If the issue still exists, please add the Hardy kernel "linux" task to the bug report. This can be done by clicking on the "Also affects distribution" link in the Actions area on left hand side of the bug report. Select "Ubuntu" as the Distribution and type in "linux" for the Source Package Name. Thanks.

[Kent Borg (kentborg)]

It seems I am having the same problem with 8.04 running 2.6.24-19-generic. Is there a way to resurrect this as a current bug? Or, do I post a new one?

Thanks,

-kb

[Leann Ogasawara (leannogasawara)]

Hi Kent,

Care to do one more test? Care to confirm this is still an issue with the latest Alpha for the upcoming Intrepid Ibex 8.10. The reason I ask is that Hardy looks to have vesion 32 of the aoe driver (via 'modinfo aoe') and Intrepid contains version 47. The original bug reporter commented:

"If, however, I replace the module with the latest compiled from Coraid's source (version 40, http://www.coraid.com/support/linux/aoe6-40.tar.gz), everything works great;"

So I would hope that version 47 which exists in Intrepid will give you a resolution? More information regarding the latest Alpha for Intrepid Ibex 8.10 can be found here: http://www.ubuntu.com/testing. Please let us know your results. Thanks.

[Leann Ogasawara (leannogasawara)]

The Ubuntu Kernel Team is planning to move to the 2.6.27 kernel for the upcoming Intrepid Ibex 8.10 release. As a result, the kernel team would appreciate it if you could please test this newer 2.6.27 Ubuntu kernel. There are one of two ways you should be able to test:

1) If you are comfortable installing packages on your own, the linux-image-2.6.27-* package is currently available for you to install and test.

--or--

2) The upcoming Alpha5 for Intrepid Ibex 8.10 will contain this newer 2.6.27 Ubuntu kernel. Alpha5 is set to be released Thursday Sept 4. Please watch http://www.ubuntu.com/testing for Alpha5 to be announced. You should then be able to test via a LiveCD.

Please let us know immediately if this newer 2.6.27 kernel resolves the bug reported here or if the issue remains. More importantly, please open a new bug report for each new bug/regression introduced by the 2.6.27 kernel and tag the bug report with 'linux-2.6.27'. Also, please specifically note if the issue does or does not appear in the 2.6.26 kernel. Thanks again, we really appreicate your help and feedback.

[Markus Korn (thekorn)]

Unfortunately this bug report is being closed because we received no response to the last inquiry for information. However, the Intrepid Ibex 8.10 Beta release was most recently announced - http://www.ubuntu.com/testing/intrepid/beta . If you are able to confirm this is still an issue with this most recent release please feel free to reopen this report. To reopen the bug report you can click on the current status, under the Status column, and change the Status back to "New".

Thanks,
Markus

[Henry Wertz (hwertz)]

     I can confirm this is a probelm in 8.10. I updated just now (Nov 13th).
     Steps to reproduce:
     sudo modprobe aoe
     dmesg
     ...........
     [85898.044715] aoe: AoE v47 initialised.
user@qbert:~$ sudo aoe-discover
aoe-discover: /dev/etherd/discover does not exist or is not writeable.
user@qbert:~$ ls /dev/ether*
ls: cannot access /dev/ether*: No such file or directory
user@qbert:~$
     It appears that udev has no rules for aoe whatsoever.
     Suggested possibilities for repair:
     1) Put in udev rules. Probably best but I have no idea where to start.
     2) Easy hack, change aoe-mkdevs so it doesn't sanity check
(currently:
user@qbert:~$ sudo aoe-mkdevs /dev/etherd
aoe-mkdevs Error: udev detected. You shouldn't need to use aoe-mkdevs.
aoe-mkdevs: Please see the aoe-mkdevs manpage.
aoe-mkdevs: Exiting.
)

     Let them go under /dev/.static/dev/ or whatever, as long as the aoetools are self-consistant I don't see the harm, except from an aesthetic standpoint.)
     3) Are there newer aoetools that just aren't in tree? the kernel aoe atuff is v47, aoetools is v26.
     For me severity is low. I thought I'd play with ata-over-ethernet a little. it doesn't work right now. I didn't have specific plans for it, I was just going to keep around with trying to share CD-ROMs, see if aoe over some ethernet gives xp the massive speedup I got when I put a bunch of XPs applications on a samba share instead of local. (I don't have an XP install any more, though so that might put a monkey in the wrench. 2 Gentoo and 4 Ubuntu systems 8-).

[trylik (marek-nasionka)]

i can confirm it on 2-6-19

marek@ubuntu:/usr/lib/lastfm$ sudo modinfo aoe
filename: /lib/modules/2.6.27-9-generic/kernel/drivers/block/aoe/aoe.ko
version: 47
description: AoE block/char driver for 2.6.2 and newer 2.6 kernels
author: Sam Hopkins <email address hidden>
license: GPL
srcversion: 7CE23D5979BA9EEEA953DE3
depends:
vermagic: 2.6.27-9-generic SMP mod_unload modversions 586
parm: aoe_iflist:aoe_iflist="dev1 [dev2 ...]" (string)
parm: aoe_deadsecs:After aoe_deadsecs seconds, give up and fail dev. (int)
parm: aoe_maxout:Only aoe_maxout outstanding packets for every MAC on eX.Y. (int)

marek@ubuntu:/usr/lib/lastfm$ sudo aoe-mkdevs /dev/etherd
aoe-mkdevs Error: udev detected. You shouldn't need to use aoe-mkdevs.
aoe-mkdevs: Please see the aoe-mkdevs manpage.
aoe-mkdevs: Exiting.

[Launchpad Janitor (janitor)]

Per a decision made by the Ubuntu Kernel Team, bugs will longer be assigned to the ubuntu-kernel-team in Launchpad as part of the bug triage process. The ubuntu-kernel-team is being unassigned from this bug report. Refer to https://wiki.ubuntu.com/KernelTeamBugPolicies for more information. Thanks.

[Jamin W. Collins (jcollins)]

With 8.04, I was able to get udev support working by adding the attached ruleset.

[gord-s (gord-sssnaps)]

I confirm works for me with that set too Jamin. (8.04) Thanks for that, I have 65TB + on 100+spindles waiting to go over to Ubuntu SAN from Debian SAN :)

[kernel-janitor (kernel-janitor)]

Hi vasco-nevoa,

This bug was reported a while ago and there hasn't been any activity in it recently. We were wondering if this is still an issue? Can you try with the latest development release of Ubuntu? ISO CD images are available from http://cdimage.ubuntu.com/releases/ .

If it remains an issue, could you run the following command from a Terminal (Applications->Accessories->Terminal). It will automatically gather and attach updated debug information to this report.

apport-collect -p linux-image-`uname -r` 75179

Also, if you could test the latest upstream kernel available that would be great. It will allow additional upstream developers to examine the issue. Refer to https://wiki.ubuntu.com/KernelMainlineBuilds . Once you've tested the upstream kernel, please remove the 'needs-upstream-testing' tag. This can be done by clicking on the yellow pencil icon next to the tag located at the bottom of the bug description and deleting the 'needs-upstream-testing' text. Please let us know your results.

Thanks in advance.

[This is an automated message. Apologies if it has reached you inappropriately; please just reply to this message indicating so.]

[Jeremy Foshee (jeremyfoshee)]

This bug report was marked as Incomplete and has not had any updated comments for quite some time. As a result this bug is being closed. Please reopen if this is still an issue in the current Ubuntu release http://www.ubuntu.com/getubuntu/download . Also, please be sure to provide any requested information that may have been missing. To reopen the bug, click on the current status under the Status column and change the status back to "New". Thanks.

[This is an automated message. Apologies if it has reached you inappropriately; please just reply to this message indicating so.]