[BVT]Deploy master node failed on keystone-manage bootsrap

Bug #1551584 reported by Tatyanka
12
This bug affects 2 people
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Released
Critical
Ivan Berezovskiy

Bug Description

Deploy ceph HA with RadosGW for objects

    Scenario:

            Create cluster with Neutron
            Add 3 nodes with controller role
            Add 3 nodes with compute and ceph-osd role
            Deploy the cluster
            Check ceph status
            Run OSTF tests
            Check the radosqw daemon is started

Actual:
failed with
Error Message

Waiting timed out

Stacktrace

Traceback (most recent call last):
  File "/usr/lib/python2.7/unittest/case.py", line 331, in run
    testMethod()
  File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
    self._testFunc()
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
    compatability.capture_type_error(s_func)
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
    func()
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
    func(test_case.state.get_state())
  File "/home/jenkins/workspace/9.0-mitaka.main.ubuntu.smoke_neutron/fuelweb_test/helpers/decorators.py", line 113, in wrapper
    raise test_exception
TimeoutError: Waiting timed out

In log there are several error related to bootsrap, latest is:
Debug: Exec[keystone-manage bootstrap](provider=posix): Executing 'keystone-manage bootstrap --bootstrap-password nAa8ogEq0krB9ia1NeuYEafa'
Debug: Executing 'keystone-manage bootstrap --bootstrap-password nAa8ogEq0krB9ia1NeuYEafa'
Notice: /Stage[main]/Keystone/Exec[keystone-manage bootstrap]/returns: usage: keystone-manage [db_sync|db_version|domain_config_upload|fernet_rotate|fernet_setup|mapping_purge|mapping_engine|pki_setup|saml_idp_metadata|ssl_setup|token_flush]
Notice: /Stage[main]/Keystone/Exec[keystone-manage bootstrap]/returns: keystone-manage: error: argument command: invalid choice: 'bootstrap' (choose from 'db_sync', 'db_version', 'domain_config_upload', 'fernet_rotate', 'fernet_setup', 'mapping_purge', 'mapping_engine', 'pki_setup', 'saml_idp_metadata', 'ssl_setup', 'token_flush')
Error: /Stage[main]/Keystone/Exec[keystone-manage bootstrap]: Failed to call refresh: keystone-manage bootstrap --bootstrap-password nAa8ogEq0krB9ia1NeuYEafa returned 2 instead of one of [0]
Error: /Stage[main]/Keystone/Exec[keystone-manage bootstrap]: keystone-manage bootstrap --bootstrap-password nAa8ogEq0krB9ia1NeuYEafa returned 2 instead of one of [0]
Debug: Class[Keystone::Db::Sync]: The container Stage[main] will propagate my refresh event
Info: Class[Keystone::Db::Sync]: Scheduling refresh of Service[keystone]

http://paste.openstack.org/show/488698/

Tags: area-mos
Revision history for this message
Tatyanka (tatyana-leontovich) wrote :
Revision history for this message
Alexander Kislitsky (akislitsky) wrote :

We had unavailable mirrors:

./puppet/bootstrap_admin_node.log:Could not retrieve mirrorlist http://mirror.fuel-infra.org/mos-repos/centos/mos9.0-centos7-fuel/mos-mirrors-os.txt error was
./puppet/bootstrap_admin_node.log:14: curl#6 - "Could not resolve host: mirror.fuel-infra.org; Unknown error"

Also we had no fuel-nailgun installed on the master node.
Marking as invalid. Please reopen the bug if will be reproduced.

Changed in fuel:
status: New → Invalid
Revision history for this message
Alexander Kislitsky (akislitsky) wrote :
Changed in fuel:
status: Invalid → Confirmed
Revision history for this message
slava valyavskiy (slava-val-al) wrote :
Revision history for this message
slava valyavskiy (slava-val-al) wrote :

Patch, where keystone bootstrap functionality was introduced - https://review.openstack.org/#/c/255599/

Revision history for this message
Michael Polenchuk (mpolenchuk) wrote :

I guess we have to update keystone to 9.0 (M) for master node.

Changed in fuel:
assignee: Fuel Python Team (fuel-python) → MOS Packaging Team (mos-packaging)
tags: added: area-mos
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (master)

Fix proposed to branch: master
Review: https://review.openstack.org/286479

Changed in fuel:
assignee: MOS Packaging Team (mos-packaging) → Ivan Berezovskiy (iberezovskiy)
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (master)

Reviewed: https://review.openstack.org/286479
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=4a63d8c43d2f50f408cec35049522d366d42b95d
Submitter: Jenkins
Branch: master

commit 4a63d8c43d2f50f408cec35049522d366d42b95d
Author: iberezovskiy <email address hidden>
Date: Tue Mar 1 13:21:20 2016 +0300

    Do not run keystone bootstrap command

    Our MOS packages are outdated, so 'keystone-manage bootstrap'
    command aren't available and can't be run.

    Revert this patch after MOS packages update.

    Closes-bug: #1551584

    Change-Id: I961e3782c95096321cfc4b09fc2e5f899f265551

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
Igor Yozhikov (iyozhikov) wrote :

Keystone has been updated yesterday evening - https://review.fuel-infra.org/#/c/17646/

Revision history for this message
Tatyanka (tatyana-leontovich) wrote :

verified on 60 iso

Changed in fuel:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers