10/12/2017 09:59:37 PM [contrail-svc-monitor]: __default__ [SYS_NOTICE]: SvcMonitorLog: Initializing RabbitMQ connection, urls ['pyamqp://guest:C5772F9829C2@192.168.192.6:5672//'] 10/12/2017 09:59:37 PM [contrail-svc-monitor]: __default__ [SYS_NOTICE]: SvcMonitorLog: RabbitMQ connection down 10/12/2017 09:59:37 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Initializing description = >>, ] description = Database:RabbitMQ[] connection down >>, ] >> 10/12/2017 09:59:37 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Down description = >>, ] description = Database:RabbitMQ[] connection down >>, ] >> 10/12/2017 09:59:37 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Down description = >>, ] description = Collector, Database:RabbitMQ[] connection down >>, ] >> 10/12/2017 09:59:37 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 17574 start_time = 1507825777291031 collector_name = collector_ip = collector_list = [ 192.168.192.6:8086, 192.168.192.7:8086, 192.168.192.5:8086, ] >> sm_queue_count = 3 max_sm_queue_count = 3 >> 10/12/2017 09:59:37 PM [contrail-svc-monitor]: __default__ [SYS_NOTICE]: SvcMonitorLog: RabbitMQ connection ESTABLISHED 10/12/2017 09:59:37 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector connection down >>, ] >> 10/12/2017 09:59:37 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Zookeeper:Zookeeper[] connection down >>, ] >> 10/12/2017 09:59:41 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 09:59:41 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Zookeeper:Zookeeper[] connection down >>, ] >> 10/12/2017 09:59:41 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Zookeeper:Zookeeper[] connection down >>, ] >> 10/12/2017 09:59:41 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 17574 start_time = 1507825777291031 collector_name = collector_ip = 192.168.192.6:8086 collector_list = [ 192.168.192.6:8086, 192.168.192.7:8086, 192.168.192.5:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 09:59:45 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 09:59:45 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.7:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Zookeeper:Zookeeper[] connection down >>, ] >> 10/12/2017 09:59:45 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.7:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Zookeeper:Zookeeper[] connection down >>, ] >> 10/12/2017 09:59:45 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 17574 start_time = 1507825777291031 collector_name = collector_ip = 192.168.192.7:8086 collector_list = [ 192.168.192.6:8086, 192.168.192.7:8086, 192.168.192.5:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 09:59:49 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 09:59:49 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.5:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Zookeeper:Zookeeper[] connection down >>, ] >> 10/12/2017 09:59:49 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.5:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Zookeeper:Zookeeper[] connection down >>, ] >> 10/12/2017 09:59:49 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 17574 start_time = 1507825777291031 collector_name = collector_ip = 192.168.192.5:8086 collector_list = [ 192.168.192.6:8086, 192.168.192.7:8086, 192.168.192.5:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 09:59:52 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.5:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Down description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Zookeeper:Zookeeper[] connection down >>, ] >> 10/12/2017 09:59:53 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 09:59:53 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Down description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Zookeeper:Zookeeper[] connection down >>, ] >> 10/12/2017 09:59:53 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Down description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Zookeeper:Zookeeper[] connection down >>, ] >> 10/12/2017 09:59:53 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 17574 start_time = 1507825777291031 collector_name = collector_ip = 192.168.192.6:8086 collector_list = [ 192.168.192.6:8086, 192.168.192.7:8086, 192.168.192.5:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 09:59:56 PM [contrail-svc-monitor]: __default__ [SYS_NOTICE]: SvcMonitorLog: Waiting to be elected as master... 10/12/2017 09:59:56 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector connection down >>, ] >> 10/12/2017 09:59:56 PM [contrail-svc-monitor]: __default__ [SYS_NOTICE]: SvcMonitorLog: Elected master SVC Monitor node. Initializing... 10/12/2017 09:59:56 PM [contrail-svc-monitor]: Cannot write http_port 8088 to /tmp/contrail-svc-monitor.17553.http_port 10/12/2017 09:59:56 PM [contrail-svc-monitor]: Starting Introspect on HTTP Port 8088 10/12/2017 09:59:56 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 09:59:57 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 09:59:57 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.7:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 09:59:57 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.7:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 09:59:57 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 17574 http_port = 8088 start_time = 1507825777291031 collector_name = collector_ip = 192.168.192.7:8086 collector_list = [ 192.168.192.6:8086, 192.168.192.7:8086, 192.168.192.5:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:00:01 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 10:00:01 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.5:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:00:01 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.5:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:00:01 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 17574 http_port = 8088 start_time = 1507825777291031 collector_name = collector_ip = 192.168.192.5:8086 collector_list = [ 192.168.192.6:8086, 192.168.192.7:8086, 192.168.192.5:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:00:05 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 10:00:05 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:00:05 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:00:05 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 17574 http_port = 8088 start_time = 1507825777291031 collector_name = collector_ip = 192.168.192.6:8086 collector_list = [ 192.168.192.6:8086, 192.168.192.7:8086, 192.168.192.5:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:00:09 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 10:00:09 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.7:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:00:09 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.7:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:00:09 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 17574 http_port = 8088 start_time = 1507825777291031 collector_name = collector_ip = 192.168.192.7:8086 collector_list = [ 192.168.192.6:8086, 192.168.192.7:8086, 192.168.192.5:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:00:13 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 10:00:13 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.5:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:00:13 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.5:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:00:13 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 17574 http_port = 8088 start_time = 1507825777291031 collector_name = collector_ip = 192.168.192.5:8086 collector_list = [ 192.168.192.6:8086, 192.168.192.7:8086, 192.168.192.5:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:00:17 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 10:00:17 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:00:17 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:00:17 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 17574 http_port = 8088 start_time = 1507825777291031 collector_name = collector_ip = 192.168.192.6:8086 collector_list = [ 192.168.192.6:8086, 192.168.192.7:8086, 192.168.192.5:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:00:20 PM [contrail-svc-monitor]: __default__ [SYS_NOTICE]: SvcMonitorLog: Waiting for keyspace config_db_uuid to be created 10/12/2017 10:00:20 PM [contrail-svc-monitor]: __default__ [SYS_NOTICE]: SvcMonitorLog: Cassandra connection ESTABLISHED 10/12/2017 10:00:20 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector connection down >>, ] >> 10/12/2017 10:00:22 PM [contrail-svc-monitor]: __default__ [SYS_NOTICE]: SvcMonitorLog: Initializing RabbitMQ connection, urls ['pyamqp://guest:C5772F9829C2@192.168.192.6:5672//'] 10/12/2017 10:00:22 PM [contrail-svc-monitor]: __default__ [SYS_NOTICE]: SvcMonitorLog: RabbitMQ connection down 10/12/2017 10:00:22 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Initializing description = >>, ] description = Database:RabbitMQ[] connection down >>, ] >> 10/12/2017 10:00:22 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Down description = >>, ] description = Database:RabbitMQ[] connection down >>, ] >> 10/12/2017 10:00:22 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Down description = >>, ] description = Collector, Database:RabbitMQ[] connection down >>, ] >> 10/12/2017 10:00:22 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 20889 start_time = 1507825822578401 collector_name = collector_ip = collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 3 max_sm_queue_count = 3 >> 10/12/2017 10:00:22 PM [contrail-svc-monitor]: __default__ [SYS_NOTICE]: SvcMonitorLog: RabbitMQ connection ESTABLISHED 10/12/2017 10:00:22 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector connection down >>, ] >> 10/12/2017 10:00:22 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Zookeeper:Zookeeper[] connection down >>, ] >> 10/12/2017 10:00:22 PM [contrail-svc-monitor]: __default__ [SYS_NOTICE]: SvcMonitorLog: Waiting to be elected as master... 10/12/2017 10:00:22 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector connection down >>, ] >> 10/12/2017 10:00:22 PM [contrail-svc-monitor]: __default__ [SYS_NOTICE]: SvcMonitorLog: Elected master SVC Monitor node. Initializing... 10/12/2017 10:00:22 PM [contrail-svc-monitor]: Cannot write http_port 8088 to /tmp/contrail-svc-monitor.17553.http_port 10/12/2017 10:00:22 PM [contrail-svc-monitor]: Starting Introspect on HTTP Port 8088 10/12/2017 10:00:22 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:00:26 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 10:00:26 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.5:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:00:26 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.5:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:00:26 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.5:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:00:30 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 10:00:30 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.7:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:00:30 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.7:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:00:30 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.7:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:00:34 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 10:00:34 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:00:34 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:00:34 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.6:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:00:38 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 10:00:38 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.5:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:00:38 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.5:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:00:38 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.5:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:00:42 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 10:00:42 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.7:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:00:42 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.7:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:00:42 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.7:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:00:46 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 10:00:46 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:00:46 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:00:46 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.6:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:00:50 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 10:00:50 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.5:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:00:50 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.5:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:00:50 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.5:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:00:54 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 10:00:54 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.7:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:00:54 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.7:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:00:54 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.7:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:00:58 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 10:00:58 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:00:58 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:00:58 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.6:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:01:02 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 10:01:02 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.5:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:01:02 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.5:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:01:02 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.5:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:01:06 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 10:01:06 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.7:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:01:06 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.7:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:01:06 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.7:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:01:10 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 10:01:10 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:01:10 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:01:10 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.6:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:01:14 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 10:01:14 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.5:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:01:14 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.5:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:01:14 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.5:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:01:18 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 10:01:18 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.7:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:01:18 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.7:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Database:Cassandra[] connection down >>, ] >> 10/12/2017 10:01:18 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.7:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:01:22 PM [contrail-svc-monitor]: __default__ [SYS_NOTICE]: SvcMonitorLog: Cassandra connection ESTABLISHED 10/12/2017 10:01:22 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.7:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector connection down >>, ] >> 10/12/2017 10:01:22 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 10:01:22 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector connection down >>, ] >> 10/12/2017 10:01:22 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector connection down >>, ] >> 10/12/2017 10:01:22 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.6:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:01:22 PM [contrail-svc-monitor]: __default__ [SYS_NOTICE]: SvcMonitorLog: Initializing RabbitMQ connection, urls ['pyamqp://guest:C5772F9829C2@192.168.192.6:5672//'] 10/12/2017 10:01:22 PM [contrail-svc-monitor]: __default__ [SYS_NOTICE]: SvcMonitorLog: RabbitMQ connection down 10/12/2017 10:01:22 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Initializing description = >>, ] description = Collector, Database:RabbitMQ[] connection down >>, ] >> 10/12/2017 10:01:22 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Down description = >>, ] description = Collector, Database:RabbitMQ[] connection down >>, ] >> 10/12/2017 10:01:22 PM [contrail-svc-monitor]: __default__ [SYS_NOTICE]: SvcMonitorLog: RabbitMQ connection ESTABLISHED 10/12/2017 10:01:22 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector connection down >>, ] >> 10/12/2017 10:01:22 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Initializing >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, ApiServer:ApiServer[None] connection down >>, ] >> 10/12/2017 10:01:22 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Down description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, ApiServer:ApiServer[] connection down >>, ] >> 10/12/2017 10:01:26 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 10:01:26 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.5:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Down description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, ApiServer:ApiServer[] connection down >>, ] >> 10/12/2017 10:01:26 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.5:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Down description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, ApiServer:ApiServer[] connection down >>, ] >> 10/12/2017 10:01:26 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.5:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:01:30 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 10:01:30 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.7:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Down description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, ApiServer:ApiServer[] connection down >>, ] >> 10/12/2017 10:01:30 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.7:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Down description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, ApiServer:ApiServer[] connection down >>, ] >> 10/12/2017 10:01:30 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.7:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:01:34 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 10:01:34 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Down description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, ApiServer:ApiServer[] connection down >>, ] >> 10/12/2017 10:01:34 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Down description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, ApiServer:ApiServer[] connection down >>, ] >> 10/12/2017 10:01:34 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.6:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:01:38 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 10:01:38 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.5:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Down description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, ApiServer:ApiServer[] connection down >>, ] >> 10/12/2017 10:01:38 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.5:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Down description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, ApiServer:ApiServer[] connection down >>, ] >> 10/12/2017 10:01:38 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.5:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:01:42 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 10:01:42 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.7:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Down description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, ApiServer:ApiServer[] connection down >>, ] >> 10/12/2017 10:01:42 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.7:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Down description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, ApiServer:ApiServer[] connection down >>, ] >> 10/12/2017 10:01:42 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.7:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:01:46 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 10:01:46 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Down description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, ApiServer:ApiServer[] connection down >>, ] >> 10/12/2017 10:01:46 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Down description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, ApiServer:ApiServer[] connection down >>, ] >> 10/12/2017 10:01:46 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.6:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:01:50 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 10:01:50 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.5:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Down description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, ApiServer:ApiServer[] connection down >>, ] >> 10/12/2017 10:01:50 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.5:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Down description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, ApiServer:ApiServer[] connection down >>, ] >> 10/12/2017 10:01:50 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.5:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:01:54 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 10:01:54 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.7:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Down description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, ApiServer:ApiServer[] connection down >>, ] >> 10/12/2017 10:01:54 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.7:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Down description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, ApiServer:ApiServer[] connection down >>, ] >> 10/12/2017 10:01:54 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.7:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:01:58 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 10:01:58 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Down description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, ApiServer:ApiServer[] connection down >>, ] >> 10/12/2017 10:01:58 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Down description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, ApiServer:ApiServer[] connection down >>, ] >> 10/12/2017 10:01:58 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.6:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:02:02 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 10:02:02 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.5:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Down description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, ApiServer:ApiServer[] connection down >>, ] >> 10/12/2017 10:02:02 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.5:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Down description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, ApiServer:ApiServer[] connection down >>, ] >> 10/12/2017 10:02:02 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.5:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:02:06 PM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/12/2017 10:02:06 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.7:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Down description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, ApiServer:ApiServer[] connection down >>, ] >> 10/12/2017 10:02:06 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.7:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Down description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, ApiServer:ApiServer[] connection down >>, ] >> 10/12/2017 10:02:06 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.7:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:02:10 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Down description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, ApiServer:ApiServer[] connection down >>, ] >> 10/12/2017 10:02:34 PM [contrail-svc-monitor]: Session Event: TCP Connection Closed 10/12/2017 10:02:34 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Down description = ClientInit to Idle on EvTcpClose >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Down description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, ApiServer:ApiServer[] connection down >>, ] >> 10/12/2017 10:02:34 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 1 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.6:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/12/2017 10:02:38 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.5:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Down description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, ApiServer:ApiServer[] connection down >>, ] >> 10/12/2017 10:02:56 PM [contrail-svc-monitor]: __default__ [SYS_ERR]: SvcMonitorLog: Python 2.7.6: /usr/bin/python Thu Oct 12 22:02:56 2017 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python2.7/dist-packages/cfgm_common/vnc_amqp.py in _vnc_subscribe_callback(self=, oper_info={u'fq_name': [u'default-domain'], u'obj_dict': {u'fq_name': [u'default-domain'], u'id_perms': {u'created': u'2017-10-12T16:31:39.021436', u'creator': None, u'description': None, u'enable': True, u'last_modified': u'2017-10-12T16:31:39.021436', u'permissions': {u'group': u'cloud-admin-group', u'group_access': 7, u'other_access': 7, u'owner': u'cloud-admin', u'owner_access': 7}, u'user_visible': True, u'uuid': {u'uuid_lslong': 12707039397205226396L, u'uuid_mslong': 14913204110074661362L}}, u'perms2': {u'global_access': 0, u'owner': u'cloud-admin', u'owner_access': 7, u'share': []}, u'uuid': u'cef6581f-e3e5-49f2-b058-7901c94fb39c'}, u'oper': u'CREATE', u'request-id': u'req-0b32bed3-2de0-42a9-ae6b-a2617d845578', u'type': u'domain', u'uuid': u'cef6581f-e3e5-49f2-b058-7901c94fb39c'}) 63 try: 64 self.oper_info = oper_info 65 self.vnc_subscribe_actions() 66 67 except ConnectionError: self = self.vnc_subscribe_actions = > /usr/lib/python2.7/dist-packages/cfgm_common/vnc_amqp.py in vnc_subscribe_actions(self=) 127 (self. obj_type, obj_id, oper)) 128 return 129 self.evaluate_dependency() 130 131 def _get_key_from_oper_info(self): self = self.evaluate_dependency = > /usr/lib/python2.7/dist-packages/cfgm_common/vnc_amqp.py in evaluate_dependency(self=) 220 return 221 222 self.init_msgbus_fq_name() 223 self.init_msgbus_dtr() 224 self = self.init_msgbus_fq_name = > /usr/lib/python2.7/dist-packages/cfgm_common/vnc_amqp.py in init_msgbus_fq_name(self=) 206 207 def init_msgbus_fq_name(self): 208 self.msg_tracer.fq_name = self.obj.name 209 210 def init_msgbus_dtr(self): self = self.msg_tracer = MessageBusNotifyTrace(_context='', _scope='', _c...ne, _disable_sending_all_messages=False, _role=0) self.msg_tracer.fq_name = None self.obj = self.obj.name undefined : 'DomainSM' object has no attribute 'name' __class__ = __delattr__ = __dict__ = {} __doc__ = 'Attribute not found.' __format__ = __getattribute__ = __getitem__ = __getslice__ = __hash__ = __init__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __unicode__ = args = ("'DomainSM' object has no attribute 'name'",) message = "'DomainSM' object has no attribute 'name'" The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python2.7/dist-packages/cfgm_common/vnc_amqp.py", line 65, in _vnc_subscribe_callback self.vnc_subscribe_actions() File "/usr/lib/python2.7/dist-packages/cfgm_common/vnc_amqp.py", line 129, in vnc_subscribe_actions self.evaluate_dependency() File "/usr/lib/python2.7/dist-packages/cfgm_common/vnc_amqp.py", line 222, in evaluate_dependency self.init_msgbus_fq_name() File "/usr/lib/python2.7/dist-packages/cfgm_common/vnc_amqp.py", line 208, in init_msgbus_fq_name self.msg_tracer.fq_name = self.obj.name AttributeError: 'DomainSM' object has no attribute 'name' 10/12/2017 10:02:56 PM [contrail-svc-monitor]: __default__ [SYS_NOTICE]: SvcMonitorLog: check_service_interval set to 60 seconds 10/12/2017 10:03:08 PM [contrail-svc-monitor]: Session Event: TCP Connection Closed 10/12/2017 10:03:08 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.5:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Up >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector connection down >>, ] >> 10/12/2017 10:03:08 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 2 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.5:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 4 >> 10/12/2017 10:03:12 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.7:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Up >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector connection down >>, ] >> 10/12/2017 10:03:42 PM [contrail-svc-monitor]: Session Event: TCP Connection Closed 10/12/2017 10:03:42 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.7:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Up >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector connection down >>, ] >> 10/12/2017 10:03:42 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 3 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.7:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 4 >> 10/12/2017 10:03:46 PM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Up >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector connection down >>, ] >> 10/12/2017 10:40:34 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 3c786c51-129a-4c1f-9f9c-1a2decd16df7 was not found for operation UPDATE 10/12/2017 10:40:34 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 3c786c51-129a-4c1f-9f9c-1a2decd16df7 was not found for operation UPDATE 10/12/2017 10:40:34 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 3c786c51-129a-4c1f-9f9c-1a2decd16df7 was not found for operation DELETE 10/12/2017 10:40:34 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid fdfa1093-97b4-4a4c-a0c2-9587c80035e6 was not found for operation UPDATE 10/12/2017 10:40:34 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid fdfa1093-97b4-4a4c-a0c2-9587c80035e6 was not found for operation UPDATE 10/12/2017 10:40:34 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid fdfa1093-97b4-4a4c-a0c2-9587c80035e6 was not found for operation DELETE 10/12/2017 10:40:34 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid bb080feb-d0ef-4789-be4b-6d6e24146e48 was not found for operation UPDATE 10/12/2017 10:40:34 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid bb080feb-d0ef-4789-be4b-6d6e24146e48 was not found for operation UPDATE 10/12/2017 10:40:34 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid bb080feb-d0ef-4789-be4b-6d6e24146e48 was not found for operation DELETE 10/12/2017 10:40:34 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 08cc7c97-eb86-445b-af6a-6755085ee3de was not found for operation UPDATE 10/12/2017 10:40:34 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 08cc7c97-eb86-445b-af6a-6755085ee3de was not found for operation UPDATE 10/12/2017 10:40:34 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 08cc7c97-eb86-445b-af6a-6755085ee3de was not found for operation DELETE 10/12/2017 10:40:34 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 8f4ca9df-2c66-49b8-8f9b-07844bdd101f was not found for operation UPDATE 10/12/2017 10:40:34 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 8f4ca9df-2c66-49b8-8f9b-07844bdd101f was not found for operation UPDATE 10/12/2017 10:40:34 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 8f4ca9df-2c66-49b8-8f9b-07844bdd101f was not found for operation DELETE 10/12/2017 10:40:34 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 8028c0e0-db1a-4af8-a898-31f24d3dfec6 was not found for operation UPDATE 10/12/2017 10:40:34 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 8028c0e0-db1a-4af8-a898-31f24d3dfec6 was not found for operation UPDATE 10/12/2017 10:40:34 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 8028c0e0-db1a-4af8-a898-31f24d3dfec6 was not found for operation DELETE 10/12/2017 10:42:44 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 431c2fab-7ea1-4a3c-acb5-7ad33661f5e9 was not found for operation UPDATE 10/12/2017 10:42:44 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 431c2fab-7ea1-4a3c-acb5-7ad33661f5e9 was not found for operation UPDATE 10/12/2017 10:42:44 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 431c2fab-7ea1-4a3c-acb5-7ad33661f5e9 was not found for operation DELETE 10/12/2017 10:42:44 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 35e2ed5b-9d12-4507-9487-596e7faee48f was not found for operation UPDATE 10/12/2017 10:42:44 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 35e2ed5b-9d12-4507-9487-596e7faee48f was not found for operation UPDATE 10/12/2017 10:42:44 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 35e2ed5b-9d12-4507-9487-596e7faee48f was not found for operation DELETE 10/12/2017 10:42:44 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 4d52db1c-2cb0-49c4-9bb4-d466f2e8e666 was not found for operation UPDATE 10/12/2017 10:42:44 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 4d52db1c-2cb0-49c4-9bb4-d466f2e8e666 was not found for operation UPDATE 10/12/2017 10:42:44 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 4d52db1c-2cb0-49c4-9bb4-d466f2e8e666 was not found for operation DELETE 10/12/2017 10:42:44 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid abd238c2-17cb-46b4-8343-6e41ee9371b1 was not found for operation UPDATE 10/12/2017 10:42:44 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid abd238c2-17cb-46b4-8343-6e41ee9371b1 was not found for operation UPDATE 10/12/2017 10:42:44 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid abd238c2-17cb-46b4-8343-6e41ee9371b1 was not found for operation DELETE 10/12/2017 10:42:44 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 6335cb8f-8f6f-47a9-8c2f-ca9ecfe602c3 was not found for operation UPDATE 10/12/2017 10:42:44 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 6335cb8f-8f6f-47a9-8c2f-ca9ecfe602c3 was not found for operation UPDATE 10/12/2017 10:42:44 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 6335cb8f-8f6f-47a9-8c2f-ca9ecfe602c3 was not found for operation DELETE 10/12/2017 10:42:44 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid c21f7c40-be92-450d-a670-c36c48dd2cf9 was not found for operation UPDATE 10/12/2017 10:42:44 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid c21f7c40-be92-450d-a670-c36c48dd2cf9 was not found for operation UPDATE 10/12/2017 10:42:44 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid c21f7c40-be92-450d-a670-c36c48dd2cf9 was not found for operation DELETE 10/12/2017 10:45:25 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 722048be-8462-4fee-ab01-e05cde40f8bd was not found for operation UPDATE 10/12/2017 10:45:25 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 722048be-8462-4fee-ab01-e05cde40f8bd was not found for operation DELETE 10/12/2017 10:45:25 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid c3c26332-131a-424b-ba50-322d07c83270 was not found for operation UPDATE 10/12/2017 10:45:25 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid c3c26332-131a-424b-ba50-322d07c83270 was not found for operation DELETE 10/12/2017 10:45:25 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 38926c8a-98d2-48d4-838f-c81b4cf2611e was not found for operation UPDATE 10/12/2017 10:45:25 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 38926c8a-98d2-48d4-838f-c81b4cf2611e was not found for operation DELETE 10/12/2017 10:45:25 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 603b230d-2688-46ed-b037-62ae112ddc82 was not found for operation UPDATE 10/12/2017 10:45:25 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 603b230d-2688-46ed-b037-62ae112ddc82 was not found for operation DELETE 10/12/2017 10:45:25 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid e213c902-3d22-46a9-97d3-3f8d1793f623 was not found for operation UPDATE 10/12/2017 10:45:25 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid e213c902-3d22-46a9-97d3-3f8d1793f623 was not found for operation DELETE 10/12/2017 10:45:25 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 45b4c985-481c-4d33-ae67-e7085de4af43 was not found for operation UPDATE 10/12/2017 10:45:25 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 45b4c985-481c-4d33-ae67-e7085de4af43 was not found for operation DELETE 10/12/2017 10:47:28 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid c6d6ad77-ea43-42fe-8a77-bdce2ea45c0a was not found for operation UPDATE 10/12/2017 10:47:28 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid c6d6ad77-ea43-42fe-8a77-bdce2ea45c0a was not found for operation DELETE 10/12/2017 10:47:28 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 91a3af38-5aca-4e0a-a7dd-bfbb3518d690 was not found for operation UPDATE 10/12/2017 10:47:28 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 91a3af38-5aca-4e0a-a7dd-bfbb3518d690 was not found for operation DELETE 10/12/2017 10:47:28 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid b9d2a9c3-9c15-4476-a021-40f58a3525dc was not found for operation UPDATE 10/12/2017 10:47:28 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid b9d2a9c3-9c15-4476-a021-40f58a3525dc was not found for operation DELETE 10/12/2017 10:47:28 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid ccfadd6f-884a-45ed-99c7-1029fc96eaaa was not found for operation UPDATE 10/12/2017 10:47:28 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid ccfadd6f-884a-45ed-99c7-1029fc96eaaa was not found for operation DELETE 10/12/2017 10:47:28 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid fc80d1e5-747a-4619-9b3a-c2e60db25274 was not found for operation UPDATE 10/12/2017 10:47:28 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid fc80d1e5-747a-4619-9b3a-c2e60db25274 was not found for operation DELETE 10/12/2017 10:47:28 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 77c2b3b1-81ad-4585-bb6d-9fe1459e322c was not found for operation UPDATE 10/12/2017 10:47:28 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 77c2b3b1-81ad-4585-bb6d-9fe1459e322c was not found for operation DELETE 10/12/2017 10:49:51 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid f2f175ce-64b1-499e-87e0-e9c4a39033d0 was not found for operation UPDATE 10/12/2017 10:49:51 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid f2f175ce-64b1-499e-87e0-e9c4a39033d0 was not found for operation UPDATE 10/12/2017 10:49:51 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid f2f175ce-64b1-499e-87e0-e9c4a39033d0 was not found for operation DELETE 10/12/2017 10:49:51 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid fbd571cc-923e-4ac4-9892-94f6dd53306d was not found for operation UPDATE 10/12/2017 10:49:51 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid fbd571cc-923e-4ac4-9892-94f6dd53306d was not found for operation UPDATE 10/12/2017 10:49:51 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid fbd571cc-923e-4ac4-9892-94f6dd53306d was not found for operation DELETE 10/12/2017 10:49:51 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 5cd4aacf-9fbf-4a00-a6cc-0a41bb8389f5 was not found for operation UPDATE 10/12/2017 10:49:51 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 5cd4aacf-9fbf-4a00-a6cc-0a41bb8389f5 was not found for operation UPDATE 10/12/2017 10:49:51 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 5cd4aacf-9fbf-4a00-a6cc-0a41bb8389f5 was not found for operation DELETE 10/12/2017 10:49:51 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid eba0dc26-9a68-4487-ae88-2d01ae87a34c was not found for operation UPDATE 10/12/2017 10:49:51 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid eba0dc26-9a68-4487-ae88-2d01ae87a34c was not found for operation UPDATE 10/12/2017 10:49:51 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid eba0dc26-9a68-4487-ae88-2d01ae87a34c was not found for operation DELETE 10/12/2017 10:49:51 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid afb97c31-6e85-44b6-814c-a42607ee55cb was not found for operation UPDATE 10/12/2017 10:49:51 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid afb97c31-6e85-44b6-814c-a42607ee55cb was not found for operation UPDATE 10/12/2017 10:49:51 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid afb97c31-6e85-44b6-814c-a42607ee55cb was not found for operation DELETE 10/12/2017 10:49:51 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid b9d52d80-a74c-44b7-a3c9-42a36f074ed4 was not found for operation UPDATE 10/12/2017 10:49:51 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid b9d52d80-a74c-44b7-a3c9-42a36f074ed4 was not found for operation UPDATE 10/12/2017 10:49:51 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid b9d52d80-a74c-44b7-a3c9-42a36f074ed4 was not found for operation DELETE 10/12/2017 10:53:55 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 18b3f57b-9b98-42b8-bd56-5d14e7866a7a was not found for operation UPDATE 10/12/2017 10:53:55 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 18b3f57b-9b98-42b8-bd56-5d14e7866a7a was not found for operation DELETE 10/12/2017 10:53:55 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 3ce9c869-7fa7-4bdb-ad39-8a6ee165bd0f was not found for operation UPDATE 10/12/2017 10:53:55 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 3ce9c869-7fa7-4bdb-ad39-8a6ee165bd0f was not found for operation DELETE 10/12/2017 10:53:55 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 0ece271c-9f61-47c1-94ef-0bbe08ef0fde was not found for operation UPDATE 10/12/2017 10:53:55 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 0ece271c-9f61-47c1-94ef-0bbe08ef0fde was not found for operation DELETE 10/12/2017 10:53:55 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 537bdb51-66cf-4d29-82c0-f952ef6dda6f was not found for operation UPDATE 10/12/2017 10:53:55 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 537bdb51-66cf-4d29-82c0-f952ef6dda6f was not found for operation DELETE 10/12/2017 10:53:55 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 78ec782f-99e1-41a8-abfe-d4986af91456 was not found for operation UPDATE 10/12/2017 10:53:55 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 78ec782f-99e1-41a8-abfe-d4986af91456 was not found for operation DELETE 10/12/2017 10:53:55 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid e9846d20-b6a6-49fb-b273-f170493e2bfd was not found for operation UPDATE 10/12/2017 10:53:55 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid e9846d20-b6a6-49fb-b273-f170493e2bfd was not found for operation DELETE 10/12/2017 10:53:59 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid fc746b01-a96c-4188-a20e-f8edd74f668d was not found for operation UPDATE 10/12/2017 10:53:59 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid fc746b01-a96c-4188-a20e-f8edd74f668d was not found for operation DELETE 10/12/2017 10:53:59 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid fa1babe4-b6a6-4004-8101-1580501918a1 was not found for operation UPDATE 10/12/2017 10:53:59 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid fa1babe4-b6a6-4004-8101-1580501918a1 was not found for operation DELETE 10/12/2017 10:53:59 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 53cb7595-0b78-4b76-a921-94d4284217d3 was not found for operation UPDATE 10/12/2017 10:53:59 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 53cb7595-0b78-4b76-a921-94d4284217d3 was not found for operation DELETE 10/12/2017 10:53:59 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid e889e904-c36b-412d-ae3e-13a10900c1ec was not found for operation UPDATE 10/12/2017 10:53:59 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid e889e904-c36b-412d-ae3e-13a10900c1ec was not found for operation DELETE 10/12/2017 10:53:59 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 31c6652a-5081-4fd8-b7f0-bf2c8073253f was not found for operation UPDATE 10/12/2017 10:53:59 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 31c6652a-5081-4fd8-b7f0-bf2c8073253f was not found for operation DELETE 10/12/2017 10:53:59 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 91bd1035-7d12-49d9-8697-ff73a559ffc0 was not found for operation UPDATE 10/12/2017 10:53:59 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 91bd1035-7d12-49d9-8697-ff73a559ffc0 was not found for operation DELETE 10/12/2017 10:54:15 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 11874677-606d-4b84-a914-1c3c507b544a was not found for operation DELETE 10/12/2017 10:54:15 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 18b33cc2-fe19-41e5-bdc1-78451c316731 was not found for operation DELETE 10/12/2017 10:54:15 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 6ee01ee6-cdd4-48e9-9d8d-7d9c5dcc1475 was not found for operation DELETE 10/12/2017 10:54:15 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid e879c8ae-2e77-4a3c-a60f-f24a275f28ff was not found for operation DELETE 10/12/2017 10:54:15 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid caf1586d-a3f9-43ae-911f-63470926ec87 was not found for operation DELETE 10/12/2017 10:54:15 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid d104bb7f-45f9-48e7-a812-d662e33a5393 was not found for operation DELETE 10/12/2017 11:00:57 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid c454a039-4ffd-4df6-a66e-414d294533c2 was not found for operation DELETE 10/12/2017 11:00:57 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 4d01cdd5-44ec-4398-90f7-4acc9fd9e122 was not found for operation DELETE 10/12/2017 11:00:57 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 0c33d65b-ce23-401d-a2f1-a3bd9041cdfc was not found for operation DELETE 10/12/2017 11:00:57 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid a6f855b1-0641-4db3-b226-199976870117 was not found for operation DELETE 10/12/2017 11:00:57 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid e0007cdc-b2ae-4356-a70f-17014f036147 was not found for operation DELETE 10/12/2017 11:00:57 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid dfd5e3be-6563-4266-b47e-3770fa4ae727 was not found for operation DELETE 10/12/2017 11:06:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 9fe1c8c6-8f1b-42c8-a14a-71de9ac8dd37 was not found for operation UPDATE 10/12/2017 11:06:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 9fe1c8c6-8f1b-42c8-a14a-71de9ac8dd37 was not found for operation UPDATE 10/12/2017 11:06:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 9fe1c8c6-8f1b-42c8-a14a-71de9ac8dd37 was not found for operation UPDATE 10/12/2017 11:06:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 9fe1c8c6-8f1b-42c8-a14a-71de9ac8dd37 was not found for operation DELETE 10/12/2017 11:06:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 1107b03a-63cc-43f1-8e7a-ff0bf84e1765 was not found for operation UPDATE 10/12/2017 11:06:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 1107b03a-63cc-43f1-8e7a-ff0bf84e1765 was not found for operation UPDATE 10/12/2017 11:06:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 1107b03a-63cc-43f1-8e7a-ff0bf84e1765 was not found for operation UPDATE 10/12/2017 11:06:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 1107b03a-63cc-43f1-8e7a-ff0bf84e1765 was not found for operation DELETE 10/12/2017 11:06:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 52f4433c-8c4e-45a2-ba3d-76db888d375a was not found for operation UPDATE 10/12/2017 11:06:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 52f4433c-8c4e-45a2-ba3d-76db888d375a was not found for operation UPDATE 10/12/2017 11:06:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 52f4433c-8c4e-45a2-ba3d-76db888d375a was not found for operation UPDATE 10/12/2017 11:06:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 52f4433c-8c4e-45a2-ba3d-76db888d375a was not found for operation DELETE 10/12/2017 11:06:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 0189ea6f-7ec7-4427-befc-a1fe32b4c09d was not found for operation UPDATE 10/12/2017 11:06:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 0189ea6f-7ec7-4427-befc-a1fe32b4c09d was not found for operation UPDATE 10/12/2017 11:06:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 0189ea6f-7ec7-4427-befc-a1fe32b4c09d was not found for operation UPDATE 10/12/2017 11:06:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 0189ea6f-7ec7-4427-befc-a1fe32b4c09d was not found for operation DELETE 10/12/2017 11:06:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 8b8a306d-1100-4459-9842-b0e7da675788 was not found for operation UPDATE 10/12/2017 11:06:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 8b8a306d-1100-4459-9842-b0e7da675788 was not found for operation UPDATE 10/12/2017 11:06:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 8b8a306d-1100-4459-9842-b0e7da675788 was not found for operation UPDATE 10/12/2017 11:06:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 8b8a306d-1100-4459-9842-b0e7da675788 was not found for operation DELETE 10/12/2017 11:06:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid e9296673-3dfe-43c2-aed9-631cbfc7cfa9 was not found for operation UPDATE 10/12/2017 11:06:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid e9296673-3dfe-43c2-aed9-631cbfc7cfa9 was not found for operation UPDATE 10/12/2017 11:06:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid e9296673-3dfe-43c2-aed9-631cbfc7cfa9 was not found for operation UPDATE 10/12/2017 11:06:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid e9296673-3dfe-43c2-aed9-631cbfc7cfa9 was not found for operation DELETE 10/12/2017 11:09:42 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 35ad8381-887b-4fb1-90a3-6bbaaf90a636 was not found for operation DELETE 10/12/2017 11:09:42 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 9c5077ff-cc5e-4a6e-8442-f62c1615975a was not found for operation DELETE 10/12/2017 11:09:42 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 000ff435-7338-497a-8d11-c251786337e5 was not found for operation DELETE 10/12/2017 11:09:42 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid d6600124-1558-473c-9dc8-ef89f5876955 was not found for operation DELETE 10/12/2017 11:09:42 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 701377e4-edd4-4ab0-b6df-b9eb3de308d5 was not found for operation DELETE 10/12/2017 11:09:42 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 84238515-7a2d-493d-ad7b-b10cbffc9dee was not found for operation DELETE 10/12/2017 11:10:17 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid f07b760f-28b6-422c-9eca-b80409b5284f was not found for operation DELETE 10/12/2017 11:10:17 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 1be5444e-ad36-450e-a406-bef05dc09704 was not found for operation DELETE 10/12/2017 11:10:17 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 974a3910-0a79-49aa-9b89-031e2e39108c was not found for operation DELETE 10/12/2017 11:10:17 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid c4cad909-3346-4a08-844b-360591e8126f was not found for operation DELETE 10/12/2017 11:10:17 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 20e0681f-f979-407c-b137-928a676360c1 was not found for operation DELETE 10/12/2017 11:10:17 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid fcd7b453-11eb-48ea-a9e8-a7dd1504cb50 was not found for operation DELETE 10/12/2017 11:12:20 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid b985ad81-a552-42c8-a083-7d10dfe04c4b was not found for operation DELETE 10/12/2017 11:12:20 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid dea845e2-61ba-40b8-9a0b-717d12e79a3d was not found for operation DELETE 10/12/2017 11:12:20 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 2968f053-51a9-4af5-8f21-8ea95efcb17c was not found for operation DELETE 10/12/2017 11:12:20 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid cc5849ed-d3e4-4365-b0ab-40c756ea0479 was not found for operation DELETE 10/12/2017 11:12:20 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 71efa395-562d-4bc1-b43d-6b1f80610742 was not found for operation DELETE 10/12/2017 11:12:20 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 3e5164c2-08b6-4d7c-87eb-d80ddfd5e7cf was not found for operation DELETE 10/12/2017 11:13:00 PM [contrail-svc-monitor]: __default__ [SYS_NOTICE]: SvcMonitorLog: vrouter default-global-system-config:nodei2 updated with vm default-domain__ctest-TestRouterSNAT-47327103__snat_2fa4885c-be5b-4a80-87d5-9e28b6638901_93e890e0-9251-4470-92f7-41ba9cde0678__1 10/12/2017 11:13:01 PM [contrail-svc-monitor]: __default__ [SYS_NOTICE]: SvcMonitorLog: vrouter default-global-system-config:nodei1 updated with vm default-domain__ctest-TestRouterSNAT-47327103__snat_2fa4885c-be5b-4a80-87d5-9e28b6638901_93e890e0-9251-4470-92f7-41ba9cde0678__2 10/12/2017 11:14:06 PM [contrail-svc-monitor]: Duplicate uve delete 10/12/2017 11:14:06 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object virtual_machine_interface uuid 5c53a910-ed3d-4081-be74-de63ead2f765 was not found for operation DELETE 10/12/2017 11:14:06 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 8900176d-5d70-48ad-b9d3-7fd7b6815508 was not found for operation UPDATE 10/12/2017 11:14:06 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object virtual_machine_interface uuid 44e4d05c-7ff3-4427-9e34-4311f8d9bdf4 was not found for operation DELETE 10/12/2017 11:14:06 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object virtual_machine uuid bc62719d-60f1-4eca-a073-0d9fded73f4a was not found for operation DELETE 10/12/2017 11:14:06 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 8900176d-5d70-48ad-b9d3-7fd7b6815508 was not found for operation UPDATE 10/12/2017 11:14:06 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 8900176d-5d70-48ad-b9d3-7fd7b6815508 was not found for operation DELETE 10/12/2017 11:14:06 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object virtual_machine_interface uuid 02d07abc-1b3b-4752-90f0-6c6e48d34b7c was not found for operation DELETE 10/12/2017 11:14:06 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object virtual_machine_interface uuid 88026048-ae09-41f9-ae44-23cdb9a20669 was not found for operation DELETE 10/12/2017 11:14:06 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object virtual_machine uuid d5030359-9876-439d-a9e9-be9d09950f5b was not found for operation DELETE 10/12/2017 11:15:41 PM [contrail-svc-monitor]: Duplicate uve delete <3bd2f009-79d1-4361-b40a-92ff732267db> 10/12/2017 11:15:42 PM [contrail-svc-monitor]: __default__ [SYS_NOTICE]: SvcMonitorLog: vrouter default-global-system-config:nodei1 updated with vm default-domain__ctest-TestLBaaSV2-42093866__3bd2f009-79d1-4361-b40a-92ff732267db__1 10/12/2017 11:15:43 PM [contrail-svc-monitor]: __default__ [SYS_NOTICE]: SvcMonitorLog: vrouter default-global-system-config:nodei3 updated with vm default-domain__ctest-TestLBaaSV2-42093866__3bd2f009-79d1-4361-b40a-92ff732267db__2 10/12/2017 11:15:43 PM [contrail-svc-monitor]: Duplicate uve delete <3bd2f009-79d1-4361-b40a-92ff732267db> 10/12/2017 11:15:57 PM [contrail-svc-monitor]: Duplicate uve delete <3bd2f009-79d1-4361-b40a-92ff732267db> 10/12/2017 11:15:58 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object service_instance uuid 20d30cc4-0215-43ef-9047-557b7abba325 was not found for operation DELETE 10/12/2017 11:16:39 PM [contrail-svc-monitor]: Duplicate uve delete 10/12/2017 11:16:39 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object virtual_machine uuid c7b53591-9fe0-4b96-b855-01cda986939b was not found for operation DELETE 10/12/2017 11:16:39 PM [contrail-svc-monitor]: Duplicate uve delete 10/12/2017 11:16:39 PM [contrail-svc-monitor]: Duplicate uve delete 10/12/2017 11:16:39 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object virtual_machine uuid 507dc8d5-c801-4c3e-b989-debc8e8e38cd was not found for operation DELETE 10/12/2017 11:19:20 PM [contrail-svc-monitor]: Duplicate uve delete 10/12/2017 11:19:20 PM [contrail-svc-monitor]: __default__ [SYS_NOTICE]: SvcMonitorLog: vrouter default-global-system-config:nodei3 updated with vm default-domain__ctest-TestLBaaSV2-42093866__d8d28365-741a-4672-96f9-067b6c8a9ecc__1 10/12/2017 11:19:20 PM [contrail-svc-monitor]: __default__ [SYS_NOTICE]: SvcMonitorLog: vrouter default-global-system-config:nodei2 updated with vm default-domain__ctest-TestLBaaSV2-42093866__d8d28365-741a-4672-96f9-067b6c8a9ecc__2 10/12/2017 11:19:22 PM [contrail-svc-monitor]: Duplicate uve delete 10/12/2017 11:19:22 PM [contrail-svc-monitor]: Duplicate uve delete 10/12/2017 11:19:22 PM [contrail-svc-monitor]: Duplicate uve delete 10/12/2017 11:19:23 PM [contrail-svc-monitor]: Duplicate uve delete 10/12/2017 11:22:06 PM [contrail-svc-monitor]: Duplicate uve delete 10/12/2017 11:22:08 PM [contrail-svc-monitor]: Duplicate uve delete 10/12/2017 11:22:10 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object service_instance uuid 6f45725b-0dfd-42a9-b082-a60c2e3d68e9 was not found for operation DELETE 10/12/2017 11:22:47 PM [contrail-svc-monitor]: Duplicate uve delete 10/12/2017 11:22:47 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object virtual_machine uuid b02c83b9-3383-4452-97a9-3a8046b4d2a7 was not found for operation DELETE 10/12/2017 11:22:47 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object virtual_machine_interface uuid 0f7b4f26-aa7d-46a7-8dc2-1d17f5cf9578 was not found for operation DELETE 10/12/2017 11:22:47 PM [contrail-svc-monitor]: Duplicate uve delete 10/12/2017 11:22:53 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object security_group uuid bbca1544-dd96-4fd9-800b-3b5ccd3b19c7 was not found for operation DELETE 10/12/2017 11:22:53 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object project uuid 009f9517-5f70-4deb-b0ee-09a29096d130 was not found for operation DELETE 10/12/2017 11:25:30 PM [contrail-svc-monitor]: Duplicate uve delete <3746478f-99ad-4c50-8850-ce53671cc94f> 10/12/2017 11:25:30 PM [contrail-svc-monitor]: __default__ [SYS_NOTICE]: SvcMonitorLog: vrouter default-global-system-config:nodei3 updated with vm default-domain__ctest-TestLBaaSV2-42093866__3746478f-99ad-4c50-8850-ce53671cc94f__1 10/12/2017 11:25:31 PM [contrail-svc-monitor]: __default__ [SYS_NOTICE]: SvcMonitorLog: vrouter default-global-system-config:nodei2 updated with vm default-domain__ctest-TestLBaaSV2-42093866__3746478f-99ad-4c50-8850-ce53671cc94f__2 10/12/2017 11:25:33 PM [contrail-svc-monitor]: Duplicate uve delete <3746478f-99ad-4c50-8850-ce53671cc94f> 10/12/2017 11:25:33 PM [contrail-svc-monitor]: Duplicate uve delete <3746478f-99ad-4c50-8850-ce53671cc94f> 10/12/2017 11:25:33 PM [contrail-svc-monitor]: Duplicate uve delete <3746478f-99ad-4c50-8850-ce53671cc94f> 10/12/2017 11:25:35 PM [contrail-svc-monitor]: Duplicate uve delete <3746478f-99ad-4c50-8850-ce53671cc94f> 10/12/2017 11:27:36 PM [contrail-svc-monitor]: Duplicate uve delete <3746478f-99ad-4c50-8850-ce53671cc94f> 10/12/2017 11:27:37 PM [contrail-svc-monitor]: Duplicate uve delete <3746478f-99ad-4c50-8850-ce53671cc94f> 10/12/2017 11:27:39 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object service_instance uuid 5e81ddb6-6295-4473-b863-923b5e503ea7 was not found for operation DELETE 10/12/2017 11:27:54 PM [contrail-svc-monitor]: Duplicate uve delete 10/12/2017 11:27:54 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object virtual_machine uuid d126d499-e6c3-47c9-bc92-1a3ad56b5016 was not found for operation DELETE 10/12/2017 11:27:54 PM [contrail-svc-monitor]: Duplicate uve delete 10/12/2017 11:27:54 PM [contrail-svc-monitor]: Duplicate uve delete 10/12/2017 11:27:54 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object virtual_machine uuid 6a4c7e72-b35e-4ca0-8f26-ec5f9cad37ca was not found for operation DELETE 10/12/2017 11:29:18 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 5c4e65a4-6985-4360-a6a6-b6761bf5f62e was not found for operation UPDATE 10/12/2017 11:29:18 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 5c4e65a4-6985-4360-a6a6-b6761bf5f62e was not found for operation DELETE 10/12/2017 11:29:18 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid c1982ffd-d19d-4822-a84a-3c3d0a674020 was not found for operation UPDATE 10/12/2017 11:29:18 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid c1982ffd-d19d-4822-a84a-3c3d0a674020 was not found for operation DELETE 10/12/2017 11:29:18 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 71ac8942-a412-4516-96b8-674942762180 was not found for operation UPDATE 10/12/2017 11:29:18 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 71ac8942-a412-4516-96b8-674942762180 was not found for operation DELETE 10/12/2017 11:29:18 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 1a9f2457-13f9-4189-afb0-e189b570ea89 was not found for operation UPDATE 10/12/2017 11:29:18 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 1a9f2457-13f9-4189-afb0-e189b570ea89 was not found for operation DELETE 10/12/2017 11:29:18 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 35eb8e95-cf16-43ca-8cfd-e7b555565a02 was not found for operation UPDATE 10/12/2017 11:29:18 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 35eb8e95-cf16-43ca-8cfd-e7b555565a02 was not found for operation DELETE 10/12/2017 11:29:18 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 866dae44-d7c8-47bf-ba46-1efd965091e0 was not found for operation UPDATE 10/12/2017 11:29:18 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 866dae44-d7c8-47bf-ba46-1efd965091e0 was not found for operation DELETE 10/12/2017 11:33:17 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 37a66589-f173-4172-ad9b-05044e343f8f was not found for operation UPDATE 10/12/2017 11:33:17 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 37a66589-f173-4172-ad9b-05044e343f8f was not found for operation DELETE 10/12/2017 11:33:17 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 45d5f824-d3cc-4fc5-8a2e-285eccc21ad1 was not found for operation UPDATE 10/12/2017 11:33:17 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 45d5f824-d3cc-4fc5-8a2e-285eccc21ad1 was not found for operation DELETE 10/12/2017 11:33:17 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid f2bbb173-e31a-4c01-9176-7223e0c59213 was not found for operation UPDATE 10/12/2017 11:33:17 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid f2bbb173-e31a-4c01-9176-7223e0c59213 was not found for operation DELETE 10/12/2017 11:33:17 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid b9811188-a8f1-4b8e-b2dd-f7e4a4a74c7a was not found for operation UPDATE 10/12/2017 11:33:17 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid b9811188-a8f1-4b8e-b2dd-f7e4a4a74c7a was not found for operation DELETE 10/12/2017 11:33:17 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 1a62fef0-b1e2-44ed-b8e5-528f59fba7a3 was not found for operation UPDATE 10/12/2017 11:33:17 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 1a62fef0-b1e2-44ed-b8e5-528f59fba7a3 was not found for operation DELETE 10/12/2017 11:33:17 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 2f383b65-83a1-4350-86b4-0bc78991cdde was not found for operation UPDATE 10/12/2017 11:33:17 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 2f383b65-83a1-4350-86b4-0bc78991cdde was not found for operation DELETE 10/12/2017 11:47:44 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid d2087094-ad83-45d4-a4ec-69144bac0ffc was not found for operation UPDATE 10/12/2017 11:47:44 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid d2087094-ad83-45d4-a4ec-69144bac0ffc was not found for operation DELETE 10/12/2017 11:47:44 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid f1d23053-337a-4863-8b23-29eaf17235e1 was not found for operation UPDATE 10/12/2017 11:47:44 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid f1d23053-337a-4863-8b23-29eaf17235e1 was not found for operation DELETE 10/12/2017 11:47:44 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid a7c687af-3f72-46bb-9d82-6adc58737701 was not found for operation UPDATE 10/12/2017 11:47:44 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid a7c687af-3f72-46bb-9d82-6adc58737701 was not found for operation DELETE 10/12/2017 11:47:44 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid d0370fff-cebf-4ba9-abfd-e5221e4bdc90 was not found for operation UPDATE 10/12/2017 11:47:44 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid d0370fff-cebf-4ba9-abfd-e5221e4bdc90 was not found for operation DELETE 10/12/2017 11:47:44 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 9087b05a-1c2d-4248-b996-37cc6dd053a5 was not found for operation UPDATE 10/12/2017 11:47:44 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 9087b05a-1c2d-4248-b996-37cc6dd053a5 was not found for operation DELETE 10/12/2017 11:47:44 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid ae50fb31-94d3-4a4f-a017-8edf13d39a02 was not found for operation UPDATE 10/12/2017 11:47:44 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid ae50fb31-94d3-4a4f-a017-8edf13d39a02 was not found for operation DELETE 10/12/2017 11:51:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid ec192f42-7d16-4a1a-a424-10cd36a035c2 was not found for operation UPDATE 10/12/2017 11:51:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid ec192f42-7d16-4a1a-a424-10cd36a035c2 was not found for operation DELETE 10/12/2017 11:51:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid c6795a59-721d-4d99-b2b3-82db47c3b790 was not found for operation UPDATE 10/12/2017 11:51:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid c6795a59-721d-4d99-b2b3-82db47c3b790 was not found for operation DELETE 10/12/2017 11:51:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid de5e0b24-9ca4-4467-9f13-05323efb0470 was not found for operation UPDATE 10/12/2017 11:51:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid de5e0b24-9ca4-4467-9f13-05323efb0470 was not found for operation DELETE 10/12/2017 11:51:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 1c455447-e0c8-45fd-9ad9-0b39f3471f5b was not found for operation UPDATE 10/12/2017 11:51:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 1c455447-e0c8-45fd-9ad9-0b39f3471f5b was not found for operation DELETE 10/12/2017 11:51:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 34d9b124-dc7b-4d64-98fa-74f2be230003 was not found for operation UPDATE 10/12/2017 11:51:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 34d9b124-dc7b-4d64-98fa-74f2be230003 was not found for operation DELETE 10/12/2017 11:51:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 66520985-9a48-46c2-8597-e41da5bdf169 was not found for operation UPDATE 10/12/2017 11:51:27 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 66520985-9a48-46c2-8597-e41da5bdf169 was not found for operation DELETE 10/12/2017 11:56:08 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 23386f45-d8b8-40ae-acc3-af974900f8d5 was not found for operation UPDATE 10/12/2017 11:56:08 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 23386f45-d8b8-40ae-acc3-af974900f8d5 was not found for operation DELETE 10/12/2017 11:56:08 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 8566d554-3da6-421e-bd48-58ac6b4fef02 was not found for operation UPDATE 10/12/2017 11:56:08 PM [contrail-svc-monitor]: __default__ [SYS_WARN]: SvcMonitorLog: Object instance_ip uuid 8566d554-3da6-421e-bd48-58ac6b4fef02 was not found for operation DELETE 10/13/2017 12:30:27 AM [contrail-svc-monitor]: Session Event: TCP Connection Closed 10/13/2017 12:30:27 AM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.5:8086, ] status = Initializing description = Established to Connect on EvTcpClose >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Up >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector connection down >>, ] >> 10/13/2017 12:30:57 AM [contrail-svc-monitor]: Session Event: TCP Connection Closed 10/13/2017 12:30:57 AM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.5:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Up >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector connection down >>, ] >> 10/13/2017 12:30:57 AM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 5 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.5:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 4 >> 10/13/2017 12:31:01 AM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.7:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Up >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector connection down >>, ] >> 10/13/2017 12:31:31 AM [contrail-svc-monitor]: Session Event: TCP Connection Closed 10/13/2017 12:31:31 AM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.7:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Up >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector connection down >>, ] >> 10/13/2017 12:31:31 AM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 6 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.7:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 4 >> 10/13/2017 12:31:35 AM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/13/2017 12:31:35 AM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Up >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector connection down >>, ] >> 10/13/2017 12:31:35 AM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Up >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector connection down >>, ] >> 10/13/2017 12:31:35 AM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 6 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.6:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/13/2017 12:31:39 AM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.5:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Up >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector connection down >>, ] >> 10/13/2017 12:32:09 AM [contrail-svc-monitor]: Session Event: TCP Connection Closed 10/13/2017 12:32:09 AM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.5:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Up >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector connection down >>, ] >> 10/13/2017 12:32:09 AM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 7 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.5:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 4 >> 10/13/2017 12:32:18 AM [contrail-svc-monitor]: Session Event: TCP Connect Fail 10/13/2017 12:32:18 AM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.7:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Up >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector connection down >>, ] >> 10/13/2017 12:32:18 AM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.7:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Up >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector connection down >>, ] >> 10/13/2017 12:32:18 AM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 7 pid = 20889 http_port = 8088 start_time = 1507825822578401 collector_name = collector_ip = 192.168.192.7:8086 collector_list = [ 192.168.192.5:8086, 192.168.192.7:8086, 192.168.192.6:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/13/2017 12:32:22 AM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 192.168.192.6:9161, 192.168.192.5:9161, 192.168.192.7:9161, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 127.0.0.1:8082, ] status = Up >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector connection down >>, ] >> 10/13/2017 12:38:10 AM [contrail-svc-monitor]: __default__ [SYS_ERR]: SvcMonitorLog: Unable to delete the old ampq queue: connection already closed 10/13/2017 12:38:34 AM [contrail-svc-monitor]: __default__ [SYS_NOTICE]: SvcMonitorLog: Initializing RabbitMQ connection, urls ['pyamqp://guest:C5772F9829C2@192.168.192.6:5672//'] 10/13/2017 12:38:34 AM [contrail-svc-monitor]: __default__ [SYS_NOTICE]: SvcMonitorLog: RabbitMQ connection down 10/13/2017 12:38:34 AM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Initializing description = >>, ] description = Database:RabbitMQ[] connection down >>, ] >> 10/13/2017 12:38:34 AM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Down description = >>, ] description = Database:RabbitMQ[] connection down >>, ] >> 10/13/2017 12:38:34 AM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Down description = >>, ] description = Collector, Database:RabbitMQ[] connection down >>, ] >> 10/13/2017 12:38:34 AM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = nodec7:Config:contrail-svc-monitor:0 client_info = << status = Idle successful_connections = 0 pid = 31506 start_time = 1507835314586394 collector_name = collector_ip = collector_list = [ 192.168.192.6:8086, 192.168.192.7:8086, 192.168.192.5:8086, ] >> sm_queue_count = 3 max_sm_queue_count = 3 >> 10/13/2017 12:38:34 AM [contrail-svc-monitor]: __default__ [SYS_NOTICE]: SvcMonitorLog: RabbitMQ connection ESTABLISHED 10/13/2017 12:38:34 AM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector connection down >>, ] >> 10/13/2017 12:38:34 AM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Initializing description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector, Zookeeper:Zookeeper[] connection down >>, ] >> 10/13/2017 12:38:34 AM [contrail-svc-monitor]: __default__ [SYS_NOTICE]: SvcMonitorLog: Waiting to be elected as master... 10/13/2017 12:38:34 AM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector connection down >>, ] >> 10/13/2017 12:38:38 AM [contrail-svc-monitor]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = nodec7 process_status = [ << module_id = contrail-svc-monitor instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 192.168.192.6:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Zookeeper name = Zookeeper server_addrs = [ 192.168.192.6:2181, 192.168.192.5:2181, 192.168.192.7:2181, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 192.168.192.6:5672, ] status = Up description = >>, ] description = Collector connection down >>, ] >>