[System tests] OSTF tests fail with Unauthorized: The request you have made requires authentication. (HTTP 401)

Bug #1318645 reported by Andrey Sledzinskiy
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Invalid
Medium
Fuel Python (Deprecated)

Bug Description

http://jenkins-product.srt.mirantis.net:8080/view/0_0_swarm/job/master_fuelmain.system_test.ubuntu.services/41/testReport/%28root%29/deploy_ceilometer_ha_multirole/deploy_ceilometer_ha_multirole/

http://jenkins-product.srt.mirantis.net:8080/view/0_0_swarm/job/master_fuelmain.system_test.ubuntu.services/41/testReport/junit/%28root%29/deploy_ceilometer_ha_with_mongo/deploy_ceilometer_ha_with_mongo/

Error Message

Failed tests, fails: 24 should fail: 0 failed tests name: [{u'List ceilometer availability': u''}, {u'Request flavor list': u''}, {u'Request image list': u''}, {u'Request instance list': u''}, {u'Request absolute limits list': u''}, {u'Request snapshot list': u''}, {u'Request volume list': u''}, {u'Request stack list': u''}, {u'Request active services list': u''}, {u'Request user list': u''}, {u'Check that required services are running': u''}, {u'Check internet connectivity from a compute': u''}, {u'Check DNS resolution on compute node': u''}, {u'Request list of networks': u''}, {u'Create instance flavor': u''}, {u'Create volume and attach it to instance': u''}, {u'Create keypair': u''}, {u'Create security group': u''}, {u'Check network parameters': u''}, {u'Launch instance': u''}, {u'Check network connectivity from instance without floating IP': u''}, {u'Check network connectivity from instance via floating IP': u''}, {u'Launch instance, create snapshot, launch instance from snapshot': u''}, {u'Create user and authenticate with it to Horizon': u''}]

Stacktrace

Traceback (most recent call last):
  File "/usr/lib/python2.7/unittest/case.py", line 332, in run
    testMethod()
  File "/usr/lib/python2.7/unittest/case.py", line 1044, in runTest
    self._testFunc()
  File "/home/jenkins/venv-nailgun-tests/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
    compatability.capture_type_error(s_func)
  File "/home/jenkins/venv-nailgun-tests/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
    func()
  File "/home/jenkins/venv-nailgun-tests/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
    func(test_case.state.get_state())
  File "/home/jenkins/workspace/master_fuelmain.system_test.ubuntu.services/fuelweb_test/helpers/decorators.py", line 49, in wrapper
    return func(*args, **kwagrs)
  File "/home/jenkins/workspace/master_fuelmain.system_test.ubuntu.services/fuelweb_test/tests/test_services.py", line 438, in deploy_ceilometer_ha_multirole
    should_fail=0)
  File "/home/jenkins/workspace/master_fuelmain.system_test.ubuntu.services/fuelweb_test/__init__.py", line 48, in wrapped
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/master_fuelmain.system_test.ubuntu.services/fuelweb_test/models/fuel_web_client.py", line 499, in run_ostf
    failed_test_name=failed_test_name)
  File "/home/jenkins/workspace/master_fuelmain.system_test.ubuntu.services/fuelweb_test/__init__.py", line 48, in wrapped
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/master_fuelmain.system_test.ubuntu.services/fuelweb_test/models/fuel_web_client.py", line 172, in assert_ostf_run
    failed_tests_res))
  File "/home/jenkins/venv-nailgun-tests/local/lib/python2.7/site-packages/proboscis/asserts.py", line 163, in assert_true
    raise ASSERTION_ERROR(message)
AssertionError: Failed tests, fails: 24 should fail: 0 failed tests name: [{u'List ceilometer availability': u''}, {u'Request flavor list': u''}, {u'Request image list': u''}, {u'Request instance list': u''}, {u'Request absolute limits list': u''}, {u'Request snapshot list': u''}, {u'Request volume list': u''}, {u'Request stack list': u''}, {u'Request active services list': u''}, {u'Request user list': u''}, {u'Check that required services are running': u''}, {u'Check internet connectivity from a compute': u''}, {u'Check DNS resolution on compute node': u''}, {u'Request list of networks': u''}, {u'Create instance flavor': u''}, {u'Create volume and attach it to instance': u''}, {u'Create keypair': u''}, {u'Create security group': u''}, {u'Check network parameters': u''}, {u'Launch instance': u''}, {u'Check network connectivity from instance without floating IP': u''}, {u'Check network connectivity from instance via floating IP': u''}, {u'Launch instance, create snapshot, launch instance from snapshot': u''}, {u'Create user and authenticate with it to Horizon': u''}]

From OSTF log:

Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/nose/suite.py", line 208, in run
    self.setUp()
  File "/usr/lib/python2.6/site-packages/nose/suite.py", line 291, in setUp
    self.setupContext(ancestor)
  File "/usr/lib/python2.6/site-packages/nose/suite.py", line 314, in setupContext
    try_run(context, names)
  File "/usr/lib/python2.6/site-packages/nose/util.py", line 469, in try_run
    return func()
  File "/usr/lib/python2.6/site-packages/fuel_health/nmanager.py", line 650, in setUpClass
    super(SanityChecksTest, cls).setUpClass()
  File "/usr/lib/python2.6/site-packages/fuel_health/test.py", line 80, in setUpClass
    cls.manager = cls.manager_class()
  File "/usr/lib/python2.6/site-packages/fuel_health/nmanager.py", line 95, in __init__
    self.savanna_client = self._get_savanna_client()
  File "/usr/lib/python2.6/site-packages/fuel_health/nmanager.py", line 226, in _get_savanna_client
    tenant.id for tenant in self.identity_client.tenants.list()
  File "/usr/lib/python2.6/site-packages/keystoneclient/v2_0/tenants.py", line 118, in list
    tenant_list = self._list("/tenants%s" % query, "tenants")
  File "/usr/lib/python2.6/site-packages/keystoneclient/base.py", line 106, in _list
    resp, body = self.client.get(url)
  File "/usr/lib/python2.6/site-packages/keystoneclient/httpclient.py", line 590, in get
    return self._cs_request(url, 'GET', **kwargs)
  File "/usr/lib/python2.6/site-packages/keystoneclient/httpclient.py", line 582, in _cs_request
    return self.request(url, method, **kwargs)
  File "/usr/lib/python2.6/site-packages/keystoneclient/httpclient.py", line 564, in request
    resp = super(HTTPClient, self).request(url, method, **kwargs)
  File "/usr/lib/python2.6/site-packages/keystoneclient/baseclient.py", line 21, in request
    return self.session.request(url, method, **kwargs)
  File "/usr/lib/python2.6/site-packages/keystoneclient/utils.py", line 318, in inner
    return func(*args, **kwargs)
  File "/usr/lib/python2.6/site-packages/keystoneclient/session.py", line 251, in request
    raise exceptions.from_response(resp, method, url)
Unauthorized: The request you have made requires authentication. (HTTP 401)

Revision history for this message
Andrey Sledzinskiy (asledzinskiy) wrote :
description: updated
Revision history for this message
Tatyanka (tatyana-leontovich) wrote :

hm in some way we had expired token :( I can see that we use timeout 3600 for token expiration, may be we need more orfen request token in ostf.

tags: added: ostf
Changed in fuel:
milestone: 5.0 → 5.1
Changed in fuel:
status: New → Confirmed
Revision history for this message
Tatyanka (tatyana-leontovich) wrote :

can not reproduce - so downgrade priority to meddium

Changed in fuel:
importance: High → Medium
Revision history for this message
Tatyanka (tatyana-leontovich) wrote :
Changed in fuel:
status: Confirmed → Invalid
Changed in fuel:
status: Invalid → Confirmed
Revision history for this message
Anastasia Palkina (apalkina) wrote :
Download full text (3.2 KiB)

Reproduced on ISO #125

"build_id": "2014-07-15_09-57-01",
"mirantis": "yes",
"build_number": "125",
"ostf_sha": "09b6bccf7d476771ac859bb3c76c9ebec9da9e1f",
"nailgun_sha": "3b347e9c6a08bb30d85a122398eacd605fb62305",
"production": "docker",
"api": "1.0",
"fuelmain_sha": "019cb348b50e71bf1c522bea649b3cdb0bcca28a",
"astute_sha": "5df009e8eab611750309a4c5b5c9b0f7b9d85806",
"release": "5.0.1",
"fuellib_sha": "2d1e1369c13bc9771e9473086cb064d257a21fc2"

1. Create new environment (Ubuntu, HA mode)
2. Choose nova-network, vlan manager
3. Choose both Ceph
4. Choose Ceilometer
5. Untag storage and management networks and move it to other interface
6. Start deployment. It was successful
7. Start OSTF tests. Many of it has failed without error
8. There is common error in HealthCheck logs:

2014-07-16 07:59:40 ERROR

(nose_storage_plugin) <nose.suite.ContextSuite context=VolumesTest>:setup
Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/nose/suite.py", line 208, in run
    self.setUp()
  File "/usr/lib/python2.6/site-packages/nose/suite.py", line 291, in setUp
    self.setupContext(ancestor)
  File "/usr/lib/python2.6/site-packages/nose/suite.py", line 314, in setupContext
    try_run(context, names)
  File "/usr/lib/python2.6/site-packages/nose/util.py", line 469, in try_run
    return func()
  File "/usr/lib/python2.6/site-packages/fuel_health/tests/smoke/test_create_volume.py", line 29, in setUpClass
    super(VolumesTest, cls).setUpClass()
  File "/usr/lib/python2.6/site-packages/fuel_health/nmanager.py", line 707, in setUpClass
    super(SmokeChecksTest, cls).setUpClass()
  File "/usr/lib/python2.6/site-packages/fuel_health/test.py", line 80, in setUpClass
    cls.manager = cls.manager_class()
  File "/usr/lib/python2.6/site-packages/fuel_health/nmanager.py", line 94, in __init__
    self.savanna_client = self._get_savanna_client()
  File "/usr/lib/python2.6/site-packages/fuel_health/nmanager.py", line 225, in _get_savanna_client
    tenant.id for tenant in self.identity_client.tenants.list()
  File "/usr/lib/python2.6/site-packages/keystoneclient/v2_0/tenants.py", line 118, in list
    tenant_list = self._list("/tenants%s" % query, "tenants")
  File "/usr/lib/python2.6/site-packages/keystoneclient/base.py", line 106, in _list
    resp, body = self.client.get(url)
  File "/usr/lib/python2.6/site-packages/keystoneclient/httpclient.py", line 590, in get
    return self._cs_request(url, 'GET', **kwargs)
  File "/usr/lib/python2.6/site-packages/keystoneclient/httpclient.py", line 582, in _cs_request
    return self.request(url, method, **kwargs)
  File "/usr/lib/python2.6/site-packages/keystoneclient/httpclient.py", line 564, in request
    resp = super(HTTPClient, self).request(url, method, **kwargs)
  File "/usr/lib/python2.6/site-packages/keystoneclient/baseclient.py", line 21, in request
    return self.session.request(url, method, **kwargs)
  File "/usr/lib/python2.6/site-packages/keystoneclient/utils.py", line 318, in inner
    return func(*args, **kwargs)
  File "/usr/lib/python2.6/site-packages/keystoneclient/session.py", line 251, in request
    raise exceptions.from_response(resp, method, url)
Unauthorized...

Read more...

Revision history for this message
Anastasia Palkina (apalkina) wrote :
Changed in fuel:
assignee: Fuel QA Team (fuel-qa) → Tatyana (tatyana-leontovich)
Changed in fuel:
assignee: Tatyana (tatyana-leontovich) → Fuel Python Team (fuel-python)
Kamil Sambor (ksambor)
Changed in fuel:
assignee: Fuel Python Team (fuel-python) → Kamil Sambor (ksambor)
Kamil Sambor (ksambor)
Changed in fuel:
assignee: Kamil Sambor (ksambor) → Fuel Python Team (fuel-python)
Revision history for this message
Dmitry Borodaenko (angdraug) wrote :

Moved to 5.0.2 in 5.0.x series since it's not High or Critical priority.

Artem Roma (aroma-x)
Changed in fuel:
assignee: Fuel Python Team (fuel-python) → Artem Roma (aroma-x)
Dmitry Pyzhov (dpyzhov)
Changed in fuel:
milestone: 5.1 → 6.0
Artem Roma (aroma-x)
Changed in fuel:
assignee: Artem Roma (aroma-x) → Fuel Python Team (fuel-python)
Revision history for this message
Dmitry Pyzhov (dpyzhov) wrote :

Looks like it is not reproducible any more. Please reopen if it appears again.

no longer affects: fuel/5.0.x
Changed in fuel:
status: Confirmed → Invalid
Revision history for this message
Roman Vyalov (r0mikiam) wrote :
Changed in fuel:
status: Invalid → Confirmed
Revision history for this message
Ihor Kalnytskyi (ikalnytskyi) wrote :

Hi Roman, as far as I see, it's not about OSTF. You failed because you can't generate diagnostic snapshot. The issue in Fuel's Keystone, not in OpenStack's Keystone. So Invalid. Please file a separate issue.

Changed in fuel:
status: Confirmed → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.