[BVT]Deploy master node failed on keystone-manage bootsrap

Bug #1551584 reported by Tatyanka
12
This bug affects 2 people
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Released
Critical
Ivan Berezovskiy

Bug Description

Deploy ceph HA with RadosGW for objects

    Scenario:

            Create cluster with Neutron
            Add 3 nodes with controller role
            Add 3 nodes with compute and ceph-osd role
            Deploy the cluster
            Check ceph status
            Run OSTF tests
            Check the radosqw daemon is started

Actual:
failed with
Error Message

Waiting timed out

Stacktrace

Traceback (most recent call last):
  File "/usr/lib/python2.7/unittest/case.py", line 331, in run
    testMethod()
  File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
    self._testFunc()
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
    compatability.capture_type_error(s_func)
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
    func()
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
    func(test_case.state.get_state())
  File "/home/jenkins/workspace/9.0-mitaka.main.ubuntu.smoke_neutron/fuelweb_test/helpers/decorators.py", line 113, in wrapper
    raise test_exception
TimeoutError: Waiting timed out

In log there are several error related to bootsrap, latest is:
Debug: Exec[keystone-manage bootstrap](provider=posix): Executing 'keystone-manage bootstrap --bootstrap-password nAa8ogEq0krB9ia1NeuYEafa'
Debug: Executing 'keystone-manage bootstrap --bootstrap-password nAa8ogEq0krB9ia1NeuYEafa'
Notice: /Stage[main]/Keystone/Exec[keystone-manage bootstrap]/returns: usage: keystone-manage [db_sync|db_version|domain_config_upload|fernet_rotate|fernet_setup|mapping_purge|mapping_engine|pki_setup|saml_idp_metadata|ssl_setup|token_flush]
Notice: /Stage[main]/Keystone/Exec[keystone-manage bootstrap]/returns: keystone-manage: error: argument command: invalid choice: 'bootstrap' (choose from 'db_sync', 'db_version', 'domain_config_upload', 'fernet_rotate', 'fernet_setup', 'mapping_purge', 'mapping_engine', 'pki_setup', 'saml_idp_metadata', 'ssl_setup', 'token_flush')
Error: /Stage[main]/Keystone/Exec[keystone-manage bootstrap]: Failed to call refresh: keystone-manage bootstrap --bootstrap-password nAa8ogEq0krB9ia1NeuYEafa returned 2 instead of one of [0]
Error: /Stage[main]/Keystone/Exec[keystone-manage bootstrap]: keystone-manage bootstrap --bootstrap-password nAa8ogEq0krB9ia1NeuYEafa returned 2 instead of one of [0]
Debug: Class[Keystone::Db::Sync]: The container Stage[main] will propagate my refresh event
Info: Class[Keystone::Db::Sync]: Scheduling refresh of Service[keystone]

http://paste.openstack.org/show/488698/

Tags: area-mos
Revision history for this message
Tatyanka (tatyana-leontovich) wrote :
Revision history for this message
Alexander Kislitsky (akislitsky) wrote :

We had unavailable mirrors:

./puppet/bootstrap_admin_node.log:Could not retrieve mirrorlist http://mirror.fuel-infra.org/mos-repos/centos/mos9.0-centos7-fuel/mos-mirrors-os.txt error was
./puppet/bootstrap_admin_node.log:14: curl#6 - "Could not resolve host: mirror.fuel-infra.org; Unknown error"

Also we had no fuel-nailgun installed on the master node.
Marking as invalid. Please reopen the bug if will be reproduced.

Changed in fuel:
status: New → Invalid
Revision history for this message
Alexander Kislitsky (akislitsky) wrote :
Changed in fuel:
status: Invalid → Confirmed
Revision history for this message
slava valyavskiy (slava-val-al) wrote :
Revision history for this message
slava valyavskiy (slava-val-al) wrote :

Patch, where keystone bootstrap functionality was introduced - https://review.openstack.org/#/c/255599/

Revision history for this message
Michael Polenchuk (mpolenchuk) wrote :

I guess we have to update keystone to 9.0 (M) for master node.

Changed in fuel:
assignee: Fuel Python Team (fuel-python) → MOS Packaging Team (mos-packaging)
tags: added: area-mos
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (master)

Fix proposed to branch: master
Review: https://review.openstack.org/286479

Changed in fuel:
assignee: MOS Packaging Team (mos-packaging) → Ivan Berezovskiy (iberezovskiy)
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (master)

Reviewed: https://review.openstack.org/286479
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=4a63d8c43d2f50f408cec35049522d366d42b95d
Submitter: Jenkins
Branch: master

commit 4a63d8c43d2f50f408cec35049522d366d42b95d
Author: iberezovskiy <email address hidden>
Date: Tue Mar 1 13:21:20 2016 +0300

    Do not run keystone bootstrap command

    Our MOS packages are outdated, so 'keystone-manage bootstrap'
    command aren't available and can't be run.

    Revert this patch after MOS packages update.

    Closes-bug: #1551584

    Change-Id: I961e3782c95096321cfc4b09fc2e5f899f265551

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
Igor Yozhikov (iyozhikov) wrote :

Keystone has been updated yesterday evening - https://review.fuel-infra.org/#/c/17646/

Revision history for this message
Tatyanka (tatyana-leontovich) wrote :

verified on 60 iso

Changed in fuel:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.