ostf fails, nova service wasn't started up

Bug #1419058 reported by Igor Yozhikov
This bug report is a duplicate of:  Bug #1419779: package dependencies are not met. Edit Remove
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Confirmed
Critical
Igor Yozhikov

Bug Description

job url - http://jenkins-product.srt.mirantis.net:8080/job/6.1.staging.centos.bvt_1/75/console

from job log:
2015-02-06 16:25:09,715 - INFO fuel_web_client.py:81 -- Wait OSTF tests at cluster #1 for 1800 seconds
2015-02-06 16:31:42,432 - INFO fuel_web_client.py:183 -- OSTF test statuses are : {u'Create volume and boot instance from it': u'skipped', u'Launch instance, create snapshot, launch instance from snapshot': u'success', u'Create instance flavor': u'success', u'Request volume list': u'success', u'Request user list': u'success', u'Create user and authenticate with it to Horizon': u'success', u'Create security group': u'success', u'Launch instance': u'success', u'Request image list': u'success', u'Request active services list': u'success', u'Check internet connectivity from a compute': u'success', u'Check DNS resolution on compute node': u'success', u'Check that required services are running': u'failure', u'Request snapshot list': u'success', u'Check network connectivity from instance via floating IP': u'success', u'Create keypair': u'success', u'Request flavor list': u'success', u'Check network connectivity from instance without floating IP': u'success', u'Create volume and attach it to instance': u'skipped', u'Request instance list': u'success', u'Request stack list': u'success', u'Check galera environment state': u'success', u'Check RabbitMQ is available': u'success', u'Request absolute limits list': u'success', u'Check network parameters': u'success', u'Request list of networks': u'success', u'Check data replication over mysql': u'success', u'Check amount of tables in databases is the same on each node': u'success'}
2015-02-06 16:31:42,599 - INFO fuel_web_client.py:625 -- Wait for task {u'status': u'running', u'name': u'dump', u'cluster': None, u'result': {}, u'progress': 0, u'message': None, u'id': 10, u'uuid': u'9c7d054a-2974-4202-a303-9657490d8ff5'} 300 seconds
2015-02-06 16:32:57,975 - INFO decorators.py:42 -- Saving logs to "/home/jenkins/workspace/6.1.staging.centos.bvt_1/logs/fail_error_deploy_ha_vlan-2015_02_06__16_32_57.tar.gz" file
2015-02-06 16:33:53,522 - INFO decorators.py:140 -- <<<<<****************************************************************************************************>>>>>
2015-02-06 16:33:53,523 - INFO decorators.py:141 -- Failed in method 'deploy_ha_vlan'. Make snapshot: error_deploy_ha_vlan
2015-02-06 16:33:53,523 - INFO decorators.py:150 -- You could revert this snapshot using [dos.py revert 6.1.staging.CentOS.bvt_1.75.2015-02-06_14-11-20 --snapshot-name error_deploy_ha_vlan && dos.py resume 6.1.staging.CentOS.bvt_1.75.2015-02-06_14-11-20 && virsh net-dumpxml 6.1.staging.CentOS.bvt_1.75.2015-02-06_14-11-20_admin | grep -P "(\d+\.){3}" -o | awk '{print "Admin node IP: "$0"2"}']
2015-02-06 16:33:53,523 - INFO decorators.py:155 -- <<<<<****************************************************************************************************>>>>>
FAIL

======================================================================
FAIL: Deploy cluster in HA mode with VLAN Manager
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
    compatability.capture_type_error(s_func)
  File "/usr/lib/python2.7/dist-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
    func()
  File "/usr/lib/python2.7/dist-packages/proboscis/case.py", line 350, in func
    func(test_case.state.get_state())
  File "/home/jenkins/workspace/6.1.staging.centos.bvt_1/fuelweb_test/helpers/decorators.py", line 64, in wrapper
    return func(*args, **kwargs)
  File "/home/jenkins/workspace/6.1.staging.centos.bvt_1/fuelweb_test/tests/test_ha.py", line 93, in deploy_ha_vlan
    test_sets=['ha', 'smoke', 'sanity'])
  File "/home/jenkins/workspace/6.1.staging.centos.bvt_1/fuelweb_test/__init__.py", line 48, in wrapped
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/6.1.staging.centos.bvt_1/fuelweb_test/models/fuel_web_client.py", line 598, in run_ostf
    failed_test_name=failed_test_name)
  File "/home/jenkins/workspace/6.1.staging.centos.bvt_1/fuelweb_test/__init__.py", line 48, in wrapped
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/6.1.staging.centos.bvt_1/fuelweb_test/models/fuel_web_client.py", line 196, in assert_ostf_run
    failed_tests_res))
AssertionError: Failed tests, fails: 1 should fail: 0 failed tests name: [{u'Check that required services are running (failure)': u'Some nova services have not been started.. Please refer to OpenStack logs for more details.'}]

Tags: staging
ruhe (ruhe)
tags: added: staging
Changed in fuel:
milestone: none → 6.1
Revision history for this message
Igor Yozhikov (iyozhikov) wrote :

Also I've got this from diagnostic snapshot, something goes wrong with kickstart:
./10.108.5.2/var/log/docker-logs/remote/node-2.test.domain.local/install/ks-post.log
...
2015-02-06T15:48:01.182966+00:00 info: --> Finished Dependency Resolution
2015-02-06T15:48:01.182966+00:00 info: Error: Package: rubygem-yajl-ruby-1.1.0-1.el6.x86_64 (@anaconda-CentOS-201410241409.x86_64/6.3)
2015-02-06T15:48:01.183047+00:00 info: Requires: ruby(abi) = 1.8
2015-02-06T15:48:01.183047+00:00 info: Removing: ruby-libs-1.8.7.352-13.el6.x86_64 (@2014.2-6.1)
2015-02-06T15:48:01.183054+00:00 info: ruby(abi) = 1.8
2015-02-06T15:48:01.183357+00:00 info: Obsoleted By: ruby-2.1.1-1.1.x86_64 (2014.2-6.1)
2015-02-06T15:48:01.183357+00:00 info: ruby(abi) = 2.1
2015-02-06T15:48:01.183494+00:00 info: Error: Package: rubygem-mixlib-cli-1.2.2-3.el6.noarch (@anaconda-CentOS-201410241409.x86_64/6.3)
2015-02-06T15:48:01.183660+00:00 info: Requires: ruby(abi) = 1.8
2015-02-06T15:48:01.183792+00:00 info: Removing: ruby-libs-1.8.7.352-13.el6.x86_64 (@2014.2-6.1)
2015-02-06T15:48:01.183966+00:00 info: ruby(abi) = 1.8
2015-02-06T15:48:01.184104+00:00 info: Obsoleted By: ruby-2.1.1-1.1.x86_64 (2014.2-6.1)
2015-02-06T15:48:01.184244+00:00 info: ruby(abi) = 2.1
2015-02-06T15:48:01.184390+00:00 info: Error: Package: rubygem-rethtool-0.0.3-2.mira1.noarch (@anaconda-CentOS-201410241409.x86_64/6.3)
2015-02-06T15:48:01.184705+00:00 info: Requires: ruby(abi) = 1.8
2015-02-06T15:48:01.184705+00:00 info: Removing: ruby-libs-1.8.7.352-13.el6.x86_64 (@2014.2-6.1)
2015-02-06T15:48:01.184806+00:00 info: ruby(abi) = 1.8
2015-02-06T15:48:01.188264+00:00 info: ruby(abi) = 2.1
2015-02-06T15:48:01.188149+00:00 info: Obsoleted By: ruby-2.1.1-1.1.x86_64 (2014.2-6.1)
2015-02-06T15:48:01.188432+00:00 info: Error: Package: rubygem-mixlib-cli-1.2.2-3.el6.noarch (@anaconda-CentOS-201410241409.x86_64/6.3)
2015-02-06T15:48:01.188596+00:00 info: Requires: ruby(rubygems)
2015-02-06T15:48:01.188761+00:00 info: Removing: rubygems-1.3.7-5.el6.noarch (@2014.2-6.1)
2015-02-06T15:48:01.188912+00:00 info: ruby(rubygems) = 1.3.7
2015-02-06T15:48:01.189078+00:00 info: Obsoleted By: ruby-2.1.1-1.1.x86_64 (2014.2-6.1)
2015-02-06T15:48:01.189230+00:00 info: Not found
...

Dmitry Ilyin (idv1985)
Changed in fuel:
status: New → Confirmed
Revision history for this message
Igor Shishkin (teran) wrote :

Igor, please investigate it and assign to proper team.
In common it looks like something wrong with package base on your copy-pastes.

Changed in fuel:
assignee: Fuel DevOps (fuel-devops) → Igor Yozhikov (iyozhikov)
Revision history for this message
Igor Yozhikov (iyozhikov) wrote :

Sorry for the mistake, this one looks like duplicate of https://bugs.launchpad.net/fuel/+bug/1419779 because of log entries:
...
Error: Package: rubygem-netaddr-1.5.0-2.el6.noarch (@anaconda-CentOS-201410241409.x86_64/6.3)
           Requires: ruby(rubygems)
           Removing: rubygems-1.3.7-5.el6.noarch (@2014.2-6.1)
               ruby(rubygems) = 1.3.7
           Obsoleted By: ruby-2.1.1-1.1.x86_64 (2014.2-6.1)
               Not found
Error: Package: rubygem-ipaddress-0.8.0-3.el6.noarch (@anaconda-CentOS-201410241409.x86_64/6.3)
           Requires: ruby(rubygems)
           Removing: rubygems-1.3.7-5.el6.noarch (@2014.2-6.1)
               ruby(rubygems) = 1.3.7
           Obsoleted By: ruby-2.1.1-1.1.x86_64 (2014.2-6.1)
               Not found
...

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.