RHOSP13- R5.0-182- schema and few other services are in Init state after fresh provisioning

Bug #1786449 reported by alok kumar on 2018-08-10
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
R5.0
High
alexey-mr
Trunk
High
alexey-mr

Bug Description

It's a fresh overcloud stack deployemnt with 3 contrail controllers and 3 openstack and 3 computes.

Few services are down on contrail controllers:

on cfgm0 192.168.24.19:

== Contrail config ==
svc-monitor: active
nodemgr: active
device-manager: initializing
api: active
schema: initializing (Database:Cassandra[] connection down)

on cfgm1 192.168.24.15:

== Contrail config ==
svc-monitor: initializing
nodemgr: active
device-manager: active
api: active
schema: initializing

on cfgm2 192.168.24.7:

== Contrail config ==
svc-monitor: initializing
nodemgr: active
device-manager: initializing
api: active
schema: initializing

Error in schema log:

08/10/2018 09:12:18 AM [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = overcloud-contrailcontroller-2:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 7 pid = 1 start_time = 1533892100363055 collector_name = collector_ip = 10.1.0.26:8086 collector_list = [ 10.1.0.26:8086, 10.1.0.25:8086, 10.1.0.14:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 4 >>
08/10/2018 09:12:22 AM [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = overcloud-contrailcontroller-2 process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 10.1.0.25:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.1.0.25:2181, 10.1.0.14:2181, 10.1.0.26:2181, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.1.0.25:5673, 10.1.0.14:5673, 10.1.0.26:5673, ] status = Up description = >>, ] description = Collector connection down >>, ] >>

setup info:
Undercloud: 192.168.122.179 on 10.204.217.133

(undercloud) [stack@queensa ~]$ openstack server list
+--------------------------------------+--------------------------------+--------+------------------------+----------------+---------------------+
| ID | Name | Status | Networks | Image | Flavor |
+--------------------------------------+--------------------------------+--------+------------------------+----------------+---------------------+
| 65075a66-4fa8-4ebb-ac49-951c3246dc11 | overcloud-novacompute-0 | ACTIVE | ctlplane=192.168.24.9 | overcloud-full | compute |
| 824d1089-71d7-4eda-af1b-48e4760a2706 | overcloud-contrailcontroller-1 | ACTIVE | ctlplane=192.168.24.15 | overcloud-full | contrail-controller |
| 284207f4-51b7-49bd-9d55-0ebaf5ca8688 | overcloud-contrailcontroller-2 | ACTIVE | ctlplane=192.168.24.7 | overcloud-full | contrail-controller |
| 6472e498-8746-4657-9531-8c40954bcb12 | overcloud-contrailcontroller-0 | ACTIVE | ctlplane=192.168.24.19 | overcloud-full | contrail-controller |
| f926c4e7-b2d5-4490-9542-83b5dd8ed905 | overcloud-controller-1 | ACTIVE | ctlplane=192.168.24.22 | overcloud-full | control |
| 29de6273-abd6-4998-bf3d-0a501e595fe5 | overcloud-controller-2 | ACTIVE | ctlplane=192.168.24.10 | overcloud-full | control |
| a5e4da7f-02d4-4152-b113-c606319721d3 | overcloud-controller-0 | ACTIVE | ctlplane=192.168.24.12 | overcloud-full | control |
| 996014c7-9eb6-4d23-a45b-370153ef57d3 | overcloud-novacompute-1 | ACTIVE | ctlplane=192.168.24.6 | overcloud-full | compute |
| 3ceaddd4-be87-4722-9e9a-5e23bfaad209 | overcloud-novacompute-2 | ACTIVE | ctlplane=192.168.24.17 | overcloud-full | compute |
+--------------------------------------+--------------------------------+--------+------------------------+----------------+---------------------+

alok kumar (kalok) on 2018-08-10
tags: added: sanityblocker
tags: added: rhosp13
Jeba Paulaiyan (jebap) on 2018-08-11
tags: added: contrail-networking
To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers