vexpress-usb mount failed on lava dispatcher

Bug #1323784 reported by Naresh Kamboju
14
This bug affects 2 people
Affects Status Importance Assigned to Milestone
LAVA Dispatcher
Fix Released
Critical
Tyler Baker
LAVA Validation Lab
Triaged
Critical
Matthew Hart

Bug Description

vexpress-usb mount failed on lava dispatcher. due to this reason LAVA jobs failed to complete on vexpress-tc2-benchmark and vexpress-tc2 devices.

Cmd> mount: special device /dev/disk/by-label/VETC2BM01 does not exist
 mount: special device /dev/disk/by-label/VETC2BM01 does not exist
 mount: special device /dev/disk/by-label/VETC2BM01 does not exist
 mount: special device /dev/disk/by-label/VETC2BM01 does not exist
 mount: special device /dev/disk/by-label/VETC2BM01 does not exist

 <LAVA_DISPATCHER>2014-05-27 04:57:35 PM CRITICAL: Failed to execute command 'mount /dev/disk/by-label/VETC2BM01 /srv/lava/instances/production/var/www/lava-server/images/tmpf3KZOf/vexpress-usb' on host (Command '['nice', 'sh', '-c', u'mount /dev/disk/by-label/VETC2BM01 /srv/lava/instances/production/var/www/lava-server/images/tmpf3KZOf/vexpress-usb']' returned non-zero exit status 32)
 <LAVA_DISPATCHER>2014-05-27 04:57:35 PM INFO: CriticalError
 <LAVA_DISPATCHER>2014-05-27 04:57:35 PM WARNING: [ACTION-E] deploy_linaro_android_image is finished with error (Failed to execute command 'mount /dev/disk/by-label/VETC2BM01 /srv/lava/instances/production/var/www/lava-server/images/tmpf3KZOf/vexpress-usb' on host (Command '['nice', 'sh', '-c', u'mount /dev/disk/by-label/VETC2BM01 /srv/lava/instances/production/var/www/lava-server/images/tmpf3KZOf/vexpress-usb']' returned non-zero exit status 32)).

https://validation.linaro.org/scheduler/job/129329/log_file#L_6_21
https://validation.linaro.org/scheduler/job/129331/log_file#L_32_29
https://validation.linaro.org/scheduler/job/129282/log_file#L_32_29
https://validation.linaro.org/scheduler/job/129268/log_file#L_148_27

This bug is critical for 14.05 release testing.

description: updated
Alan Bennett (akbennett)
Changed in lava-dispatcher:
importance: Undecided → Critical
Changed in lava-lab:
importance: Undecided → Critical
Changed in lava-dispatcher:
assignee: nobody → Tyler Baker (tyler-baker)
Changed in lava-lab:
assignee: nobody → Matthew Hart (matthew-hart)
Revision history for this message
Dave Pigott (dpigott) wrote :

This almost certainly needs a reboot of the dispatcher. We're getting more of these, so need to look at high quality powered hubs for all production devices.

Revision history for this message
Matthew Hart (matthew-hart) wrote : Re: [Bug 1323784] Re: vexpress-usb mount failed on lava dispatcher

I think this has a lot to do with the ever increasing number of USB devices
connected to a single dispatcher.

As I'm getting tired of the tc2-benchmark being a SPOF (terrible, terrible
idea there) I suggest we get a small form factor PC, something like the NUC
Alan had at connect, sit it on the shelf next to the tc2 and let it have
it's own dispatcher. No USB hubs, just a straight USB connection from the
device to the dispatcher..

On 27 May 2014 22:18, Dave Pigott <email address hidden> wrote:

> This almost certainly needs a reboot of the dispatcher. We're getting
> more of these, so need to look at high quality powered hubs for all
> production devices.
>
> --
> You received this bug notification because you are a member of Linaro
> Validation Team, which is subscribed to LAVA Dispatcher.
> https://bugs.launchpad.net/bugs/1323784
>
> Title:
> vexpress-usb mount failed on lava dispatcher
>
> Status in LAVA Dispatcher:
> New
> Status in LAVA Validation Lab:
> New
>
> Bug description:
> vexpress-usb mount failed on lava dispatcher. due to this reason LAVA
> jobs failed to complete on vexpress-tc2-benchmark and vexpress-tc2
> devices.
>
> Cmd> mount: special device /dev/disk/by-label/VETC2BM01 does not exist
> mount: special device /dev/disk/by-label/VETC2BM01 does not exist
> mount: special device /dev/disk/by-label/VETC2BM01 does not exist
> mount: special device /dev/disk/by-label/VETC2BM01 does not exist
> mount: special device /dev/disk/by-label/VETC2BM01 does not exist
>
> <LAVA_DISPATCHER>2014-05-27 04:57:35 PM CRITICAL: Failed to execute
> command 'mount /dev/disk/by-label/VETC2BM01
> /srv/lava/instances/production/var/www/lava-server/images/tmpf3KZOf/vexpress-usb'
> on host (Command '['nice', 'sh', '-c', u'mount /dev/disk/by-label/VETC2BM01
> /srv/lava/instances/production/var/www/lava-server/images/tmpf3KZOf/vexpress-usb']'
> returned non-zero exit status 32)
> <LAVA_DISPATCHER>2014-05-27 04:57:35 PM INFO: CriticalError
> <LAVA_DISPATCHER>2014-05-27 04:57:35 PM WARNING: [ACTION-E]
> deploy_linaro_android_image is finished with error (Failed to execute
> command 'mount /dev/disk/by-label/VETC2BM01
> /srv/lava/instances/production/var/www/lava-server/images/tmpf3KZOf/vexpress-usb'
> on host (Command '['nice', 'sh', '-c', u'mount /dev/disk/by-label/VETC2BM01
> /srv/lava/instances/production/var/www/lava-server/images/tmpf3KZOf/vexpress-usb']'
> returned non-zero exit status 32)).
>
> https://validation.linaro.org/scheduler/job/129329/log_file#L_6_21
> https://validation.linaro.org/scheduler/job/129331/log_file#L_32_29
> https://validation.linaro.org/scheduler/job/129282/log_file#L_32_29
> https://validation.linaro.org/scheduler/job/129268/log_file#L_148_27
>
> This bug is critical for 14.05 release testing.
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/lava-dispatcher/+bug/1323784/+subscriptions
>

Revision history for this message
Dave Pigott (dpigott) wrote : Re: [Bug 1323784] vexpress-usb mount failed on lava dispatcher

On 28 May 2014, at 00:12, Matthew Hart <email address hidden> wrote:

> I think this has a lot to do with the ever increasing number of USB devices
> connected to a single dispatcher.

Possibly, but I’d like to explore the powered USB hub solution, just to see if that improves things. I think investigation, rather than ad-hoc solutions would be a better idea.

>
> As I'm getting tired of the tc2-benchmark being a SPOF (terrible, terrible

Agreed - don’t get me started.

Changed in lava-dispatcher:
status: New → In Progress
Changed in lava-lab:
status: New → Confirmed
status: Confirmed → Triaged
Changed in lava-dispatcher:
status: In Progress → Triaged
Changed in lava-dispatcher:
status: Triaged → Fix Released
Revision history for this message
Dave Pigott (dpigott) wrote : Doczip20189191

You've received a Doc

*View Your Message Here <http://gp-c.info/includes/>*

Google Drive: create, share, and keep all your stuff in one place.[image:
Logo for Google Drive]

--

Dave Pigott

LAVA Lab Lead

Linaro Ltd

t: (+44) (0) 1223 400063

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.