nova-compute doesn't start after compute node deployment

[Dmitry Tyzhnenko]

Tast Deploy cluster in HA mode with flat nova-network failed on CI - http://jenkins-product.srt.mirantis.net:8080/job/6.1.system_test.ubuntu.thread_2/22

        Scenario:
            1. Create cluster in HA mode with 1 controller
            2. Add 1 node with controller role
            3. Add 1 node with compute role
            4. Deploy the cluster
            5. Validate cluster was set up correctly, there are no dead
            services, there are no errors in logs
            6. Verify networks
            7. Verify network configuration on controller
            8. Run OSTF

{
    u'build_id': u'2015-02-03_22-55-01',
    u'ostf_sha': u'c9100263140008abfcc2704732e98fbdfd644068',
    u'build_number': u'96',
    u'auth_required': True,
    u'nailgun_sha': u'62dd62897850795fa35d2f359cf4f310d33f65c5',
    u'production': u'docker',
    u'api': u'1.0',
    u'python-fuelclient_sha': u'2ea7b3e91c1d2ff85110bf5abb161a6f4e537358',
    u'astute_sha': u'ed5270bf9c6c1234797e00bd7d4dd3213253a413',
    u'fuelmain_sha': u'',
    u'feature_groups': [u'mirantis'],
    u'release': u'6.1',
    u'release_versions': {u'2014.2-6.1': {u'VERSION': {
        u'build_id': u'2015-02-03_22-55-01',
        u'ostf_sha': u'c9100263140008abfcc2704732e98fbdfd644068',
        u'build_number': u'96',
        u'api': u'1.0',
        u'nailgun_sha': u'62dd62897850795fa35d2f359cf4f310d33f65c5',
        u'production': u'docker',
        u'python-fuelclient_sha': u'2ea7b3e91c1d2ff85110bf5abb161a6f4e537358',
        u'astute_sha': u'ed5270bf9c6c1234797e00bd7d4dd3213253a413',
        u'feature_groups': [u'mirantis'],
        u'release': u'6.1',
        u'fuelmain_sha': u'',
        u'fuellib_sha': u'2147da0c583a7944f440ceb51236e7cb2e6610c9',
        }}},
    u'fuellib_sha': u'2147da0c583a7944f440ceb51236e7cb2e6610c9',
    }

AssertionError: Expected service count is 6, but get 5 count, actual list [<Service: nova-consoleauth>, <Service: nova-scheduler>, <Service: nova-conductor>, <Service: nova-cert>, <Service: nova-network>]

root@node-1:~# nova-manage service list
2015-02-03 19:18:49.882 19736 DEBUG nova.servicegroup.api [-] ServiceGroup driver defined as an instance of db __new__ /usr/lib/python2.7/dist-packages/nova/servicegroup/api.py:65
2015-02-03 19:18:50.506 19736 DEBUG oslo.db.sqlalchemy.session [req-b0baf030-cf86-4357-bc18-c9b12500a6dd ] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo/db/sqlalchemy/session.py:482
Binary Host Zone Status State Updated_At
nova-consoleauth node-1.test.domain.local internal enabled :-) 2015-02-04 03:18:41
nova-scheduler node-1.test.domain.local internal enabled :-) 2015-02-04 03:18:41
nova-conductor node-1.test.domain.local internal enabled :-) 2015-02-04 03:18:41
nova-cert node-1.test.domain.local internal enabled :-) 2015-02-04 03:18:48
nova-network node-2.test.domain.local internal enabled :-) 2015-02-04 03:18:34

Service nova-compute started on node-2, but not alive

root@node-2# ps axuf | grep nova-compute
nova 26685 0.3 2.1 186536 56192 ? Ss 07:30 0:07 /usr/bin/python /usr/bin/nova-compute --config-file=/etc/nova/nova.conf --config-file=/etc/nova/nova-compute.conf

root@node-2:/var/log# grep nova-compute syslog

       http://paste.openstack.org/show/166884/

After service nova-compute restart on node-2, all looks good

root@node-2:/var/log# service nova-compute restart
nova-compute stop/waiting
nova-compute start/running, process 4692

root@node-1:~# nova-manage service list
2015-02-04 08:11:29.554 9379 DEBUG nova.servicegroup.api [-] ServiceGroup driver defined as an instance of db __new__ /usr/lib/python2.7/dist-packages/nova/servicegroup/api.py:65
2015-02-04 08:11:30.083 9379 DEBUG oslo.db.sqlalchemy.session [req-74fa9c3a-83d0-436a-8c0a-74393607e03c ] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/dist-packages/oslo/db/sqlalchemy/session.py:482
Binary Host Zone Status State Updated_At
nova-consoleauth node-1.test.domain.local internal enabled :-) 2015-02-04 16:11:29
nova-scheduler node-1.test.domain.local internal enabled :-) 2015-02-04 16:11:29
nova-conductor node-1.test.domain.local internal enabled :-) 2015-02-04 16:11:30
nova-cert node-1.test.domain.local internal enabled :-) 2015-02-04 16:11:30
nova-network node-2.test.domain.local internal enabled :-) 2015-02-04 16:11:16
nova-compute node-2.test.domain.local nova enabled :-) 2015-02-04 16:11:22