SM provision of r3.2.3.x-3 kilo stuck with dependency failures

Bug #1698202 reported by wenqing liang
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Won't Fix
Low
Dheeraj Gautam
R3.2
Fix Committed
Critical
Dheeraj Gautam
R3.2.3.x
Fix Committed
Critical
Dheeraj Gautam

Bug Description

R3.2.3.x-3 kilo provision stuck with dependency failure:

Jun 15 19:23:45 server2 puppet-agent[30659]: python exec_provision_control.py --api_server_ip "10.10.0.200" --api_server_port 8082 --host_name_list "server2,server3,server1" --host_ip_list "10.10.0.5,10.10.0.6,10.10.0.4" --router_asn "64512" --mt_options "admin,c0ntrail123,admin" && echo exec-provision-control >> /etc/contrail/contrail_config_exec.out returned 1 instead of one of [0]
Jun 15 19:23:45 server2 puppet-agent[30659]: (/Stage[config]/Contrail::Exec_provision_control/Exec[exec-provision-control]/returns) change from notrun to 0 failed: python exec_provision_control.py --api_server_ip "10.10.0.200" --api_server_port 8082 --host_name_list "server2,server3,server1" --host_ip_list "10.10.0.5,10.10.0.6,10.10.0.4" --router_asn "64512" --mt_options "admin,c0ntrail123,admin" && echo exec-provision-control >> /etc/contrail/contrail_config_exec.out returned 1 instead of one of [0]
Jun 15 19:23:45 server2 puppet-agent[30659]: (/Stage[config]/Contrail::Exec_provision_control/Notify[executed exec_provision_control]) Dependency Exec[exec-provision-control] has failures: true
Jun 15 19:23:45 server2 puppet-agent[30659]: (/Stage[config]/Contrail::Exec_provision_control/Notify[executed exec_provision_control]) Skipping because of failed dependencies
Jun 15 19:23:45 server2 puppet-agent[30659]: (/Stage[config]/Contrail::Setup_external_bgp/Notify[executed setup_external_bgp]) Dependency Exec[exec-provision-control] has failures: true
Jun 15 19:23:45 server2 puppet-agent[30659]: (/Stage[config]/Contrail::Setup_external_bgp/Notify[executed setup_external_bgp]) Skipping because of failed dependencies
Jun 15 19:23:45 server2 puppet-agent[30659]: (/Stage[config]/Contrail::Provision_metadata_services/Exec[provision-metadata-services]) Dependency Exec[exec-provision-control] has failures: true
Jun 15 19:23:45 server2 puppet-agent[30659]: (/Stage[config]/Contrail::Provision_metadata_services/Exec[provision-metadata-services]) Skipping because of failed dependencies
Jun 15 19:23:45 server2 puppet-agent[30659]: (/Stage[config]/Contrail::Provision_encap_type/Exec[provision-encap-type]) Dependency Exec[exec-provision-control] has failures: true
Jun 15 19:23:45 server2 puppet-agent[30659]: (/Stage[config]/Contrail::Provision_encap_type/Exec[provision-encap-type]) Skipping because of failed dependencies
Jun 15 19:23:45 server2 puppet-agent[30659]: (/Stage[config]/Contrail::Provision_encap_type/Notify[executed provision_encap_type]) Dependency Exec[exec-provision-control] has failures: true
Jun 15 19:23:45 server2 puppet-agent[30659]: (/Stage[config]/Contrail::Provision_encap_type/Notify[executed provision_encap_type]) Skipping because of failed dependencies
Jun 15 19:23:45 server2 puppet-agent[30659]: (/Stage[config]/Contrail::Provision_role_config/Exec[provision-role-config]) Dependency Exec[exec-provision-control] has failures: true
Jun 15 19:23:45 server2 puppet-agent[30659]: (/Stage[config]/Contrail::Provision_role_config/Exec[provision-role-config]) Skipping because of failed dependencies
Jun 15 19:23:45 server2 puppet-agent[30659]: (/Stage[config]/Contrail::Provision_role_config/Notify[executed provision_role_config]) Dependency Exec[exec-provision-control] has failures: true
Jun 15 19:23:45 server2 puppet-agent[30659]: (/Stage[config]/Contrail::Provision_role_config/Notify[executed provision_role_config]) Skipping because of failed dependencies
Jun 15 19:23:45 server2 puppet-agent[30659]: (/Stage[config]/Contrail::Provision_role_database/Exec[provision-role-database]) Dependency Exec[exec-provision-control] has failures: true
@

root@servermanager:~# server-manager status server
{
    "server": [
        {
            "id": "server2",
            "ip_address": "10.0.0.5",
            "mac_address": "02:53:81:49:FE:37",
            "status": "config_started"
        },
        {
            "id": "server3",
            "ip_address": "10.0.0.6",
            "mac_address": "02:33:E3:8C:6A:D6",
            "status": "config_started"
        },
        {
            "id": "server1",
            "ip_address": "10.0.0.4",
            "mac_address": "02:9E:92:B6:F2:E0",
            "status": "config_started"
        },
        {
            "id": "server4",
            "ip_address": "10.0.0.7",
            "mac_address": "02:4F:93:6E:BC:0B",
            "status": "provision_started"
        },
        {
            "id": "server5",
            "ip_address": "10.0.0.8",
            "mac_address": "02:E0:FB:89:7D:34",
            "status": "provision_started"
        }
    ]
}
root@servermanager:~#

            "provision_role_sequence": "{'completed': [(u'server3', 'keepalived', '2017_06_15__18_07_35'), (u'server1', 'keepalived', '2017_06_15__18_07_39'), (u'server2', 'keepalived', '2017_06_15__18_08_55'), (u'server2', 'haproxy', '2017_06_15__18_09_12'), (u'server1', 'haproxy', '2017_06_15__18_09_15'), (u'server3', 'haproxy', '2017_06_15__18_09_17'), (u'server1', 'database', '2017_06_15__18_10_10'), (u'server3', 'database', '2017_06_15__18_10_20'), (u'server2', 'database', '2017_06_15__18_10_23'), (u'server3', 'openstack', '2017_06_15__18_20_26'), (u'server1', 'openstack', '2017_06_15__18_23_02'), (u'server2', 'openstack', '2017_06_15__18_25_51'), (u'server2', 'pre_exec_vnc_galera', '2017_06_15__18_27_24'), (u'server3', 'pre_exec_vnc_galera', '2017_06_15__18_28_47'), (u'server1', 'pre_exec_vnc_galera', '2017_06_15__18_38_53'), (u'server2', 'post_exec_vnc_galera', '2017_06_15__18_39_28'), (u'server3', 'post_exec_vnc_galera', '2017_06_15__18_39_45'), (u'server1', 'post_exec_vnc_galera', '2017_06_15__18_40_19')], 'steps': [[(u'server2', u'config'), (u'server3', u'config'), (u'server1', u'config')], [(u'server2', u'control'), (u'server3', u'control'), (u'server1', u'control')], [(u'server2', u'collector'), (u'server3', u'collector'), (u'server1', u'collector')], [(u'server2', u'webui'), (u'server3', u'webui'), (u'server1', u'webui')], [(u'server1', 'post_provision'), (u'server2', 'post_provision'), (u'server3', 'post_provision')], [(u'server4', 'compute'), (u'server4', 'post_provision'), (u'server5', 'compute'), (u'server5', 'post_provision')]]}",
            "provisioned_id": null

Jeba Paulaiyan (jebap)
no longer affects: juniperopenstack/r4.0
no longer affects: juniperopenstack/trunk
Changed in juniperopenstack:
status: New → Won't Fix
importance: Critical → Low
milestone: r4.1.0.0-fcs → none
wenqing liang (wliang)
summary: - SM provision of r3.2.3.x-3 mitaka stuck with dependency failures
+ SM provision of r3.2.3.x-3 kilo stuck with dependency failures
Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R3.2

Review in progress for https://review.opencontrail.org/32896
Submitter: Dheeraj Gautam (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R3.2.3.x

Review in progress for https://review.opencontrail.org/32897
Submitter: Dheeraj Gautam (<email address hidden>)

Revision history for this message
wenqing liang (wliang) wrote :

This is broken in build 3 as build 2 provision went through without any issues.

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/32896
Committed: http://github.com/Juniper/contrail-puppet/commit/29868698cdf91b854c53a7273a5daaa55a957731
Submitter: Zuul (<email address hidden>)
Branch: R3.2

commit 29868698cdf91b854c53a7273a5daaa55a957731
Author: Dheeraj Gautam <email address hidden>
Date: Thu Jun 15 17:53:22 2017 -0700

pass database_index correctly. in correct zookeeper id causes zookeeper cluster failure

Change-Id: I58485304473420814620e2ba2492531ce12f939a
Closes-Bug: #1698202

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/32897
Committed: http://github.com/Juniper/contrail-puppet/commit/dd30e9759af990d2be53a0994ef52bf8de63216b
Submitter: Zuul (<email address hidden>)
Branch: R3.2.3.x

commit dd30e9759af990d2be53a0994ef52bf8de63216b
Author: Dheeraj Gautam <email address hidden>
Date: Thu Jun 15 17:53:22 2017 -0700

pass database_index correctly. in correct zookeeper id causes zookeeper cluster failure

Change-Id: I58485304473420814620e2ba2492531ce12f939a
Closes-Bug: #1698202

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.