Deployment failed due to problem with cciss devices.

Bug #1267304 reported by Maxim V. Yefimov
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Committed
Medium
Ryan Moe

Bug Description

Ceph OSD deployment process failed:

master node naily.log:

2014-01-08T13:14:03 err: [9111] MCollective call failed in agent 'execute_shell_command', method 'execute', failed nodes:
ID: 1 - Reason: execution expired
2014-01-08T13:14:03 err: [9111] Error running RPC method deploy: 69487712-504f-42c7-be3f-219e66e957ce: MCollective call failed in agent 'execute_shell_command', method 'execute', failed nodes:
ID: 1 - Reason: execution expired

master node nailgun.log:

2014-01-08 13:14:03.431 INFO [7f8dfbfff700] (notifier) Notification: topic: error message: Deployment has failed. Error occurred while running method 'deploy'. Inspect Orchestrator logs for the details.
2014-01-08 13:14:03.470 DEBUG [7f8dfbfff700] (helpers) Updating task: 69487712-504f-42c7-be3f-219e66e957ce
2014-01-08 13:14:03.510 INFO [7f8dfbfff700] (helpers) Task 69487712-504f-42c7-be3f-219e66e957ce (deployment) status is set to error
2014-01-08 13:14:03.511 INFO [7f8dfbfff700] (helpers) Task 69487712-504f-42c7-be3f-219e66e957ce (deployment) message is set to Deployment has failed. Error occurred while running method 'deploy'. Inspect Orchestrator logs for the details.
2014-01-08 13:14:03.561 DEBUG [7f8dfbfff700] (helpers) Updating cluster status: 69487712-504f-42c7-be3f-219e66e957ce cluster_id: 1 status: error
2014-01-08 13:14:03.604 DEBUG [7f8dfbfff700] (helpers) Updating cluster (Lab Cloud (id=1, mode=multinode)) status: from deployment to error

puppet-error.log from ceph nodes:

2014-01-08T12:42:08.455117+00:00 err: ls: cannot access /dev/cciss!c0d0?: No such file or directory

lsblk -ln output from all ceph nodes:

[root@node-1 ~]# lsblk -ln
cciss!c0d0 104:0 0 273.4G 0 disk
cciss!c0d0p1 104:1 0 24M 0 part
cciss!c0d0p2 104:2 0 200M 0 part
cciss!c0d0p3 104:3 0 200M 0 part
cciss!c0d0p4 104:4 0 107.4G 0 part
cciss!c0d0p5 104:5 0 58.1G 0 part

[root@node-2 ~]# lsblk -ln
cciss!c0d0 104:0 0 273.4G 0 disk
cciss!c0d0p1 104:1 0 24M 0 part
cciss!c0d0p2 104:2 0 200M 0 part
cciss!c0d0p3 104:3 0 200M 0 part
cciss!c0d0p4 104:4 0 214.9G 0 part
cciss!c0d0p5 104:5 0 58.1G 0 part

[root@fuel ~]# ssh node-3 lsblk -ln
cciss!c0d0 104:0 0 273.4G 0 disk
cciss!c0d0p1 104:1 0 24M 0 part
cciss!c0d0p2 104:2 0 200M 0 part
cciss!c0d0p3 104:3 0 200M 0 part
cciss!c0d0p4 104:4 0 214.9G 0 part
cciss!c0d0p5 104:5 0 58.1G 0 part

Maybe it corresponds with https://bugs.launchpad.net/fuel/+bug/1259276 and https://bugs.launchpad.net/fuel/+bug/1259612

Mirantis JIRA ticket https://mirantis.jira.com/browse/PRD-2641

Tags: cciss
Changed in fuel:
importance: Undecided → Medium
assignee: nobody → Ryan Moe (rmoe)
status: New → Triaged
milestone: none → 4.1
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (master)

Fix proposed to branch: master
Review: https://review.openstack.org/65747

Changed in fuel:
status: Triaged → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (master)

Reviewed: https://review.openstack.org/65747
Committed: https://git.openstack.org/cgit/stackforge/fuel-library/commit/?id=c8673bb9474ccb0a51fb9077910b009ff2d9034b
Submitter: Jenkins
Branch: master

commit c8673bb9474ccb0a51fb9077910b009ff2d9034b
Author: Ryan Moe <email address hidden>
Date: Thu Jan 9 09:56:50 2014 -0800

    Fix handling of cciss devices during OSD and journal discovery

    Change-Id: I349c61c00045ad1d4d12c5e8d2e2751f8f642b4e
    Closes-Bug: #1267304

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
Nastya Urlapova (aurlapova) wrote :

Need special environment for QA-verify.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.