I tried setting ENABLE_SSL: True and did see the errors mentioned above, though contrail-status shows services to be UP. Assigning to Ananth to confirm if the logs seen are really errors or if they can be ignored.
%<-------------------
[srvr1] ~ # contrail-status
Pod Service Original Name State Status
analytics alarm-gen contrail-analytics-alarm-gen running Up 15 minutes
analytics api contrail-analytics-api running Up 15 minutes
analytics collector contrail-analytics-collector running Up 15 minutes
analytics nodemgr contrail-nodemgr running Up 15 minutes
analytics query-engine contrail-analytics-query-engine running Up 15 minutes
analytics snmp-collector contrail-analytics-snmp-collector running Up 15 minutes
analytics topology contrail-analytics-topology running Up 15 minutes
config api contrail-controller-config-api running Up 17 minutes
config device-manager contrail-controller-config-devicemgr running Up 17 minutes
config nodemgr contrail-nodemgr running Up 17 minutes
config schema contrail-controller-config-schema running Up 17 minutes
config svc-monitor contrail-controller-config-svcmonitor running Up 17 minutes
config-database cassandra contrail-external-cassandra running Up 18 minutes
config-database nodemgr contrail-nodemgr running Up 18 minutes
config-database rabbitmq contrail-external-rabbitmq running Up 18 minutes
config-database zookeeper contrail-external-zookeeper running Up 18 minutes
control control contrail-controller-control-control running Up 16 minutes
control dns contrail-controller-control-dns running Up 16 minutes
control named contrail-controller-control-named running Up 16 minutes
control nodemgr contrail-nodemgr running Up 16 minutes
database cassandra contrail-external-cassandra running Up 15 minutes
database kafka contrail-external-kafka running Up 15 minutes
database nodemgr contrail-nodemgr running Up 15 minutes
database zookeeper contrail-external-zookeeper running Up 15 minutes
webui job contrail-controller-webui-job running Up 16 minutes
webui web contrail-controller-webui-web running Up 16 minutes
== Contrail control ==
control: active
nodemgr: active
named: active
dns: active
== Contrail config-database ==
nodemgr: initializing (Disk for DB is too low. )
zookeeper: active
rabbitmq: active
cassandra: active
== Contrail database ==
kafka: active
nodemgr: initializing (Disk for DB is too low. )
zookeeper: active
cassandra: active
== Contrail analytics ==
snmp-collector: active
query-engine: active
api: active
alarm-gen: active
nodemgr: active
collector: active
topology: active
== Contrail webui ==
web: active
job: active
== Contrail config ==
svc-monitor: active
nodemgr: active
device-manager: active
api: active
schema: active
I tried setting ENABLE_SSL: True and did see the errors mentioned above, though contrail-status shows services to be UP. Assigning to Ananth to confirm if the logs seen are really errors or if they can be ignored.
%<----- ------- ------- analytics- alarm-gen running Up 15 minutes analytics- api running Up 15 minutes analytics- collector running Up 15 minutes analytics- query-engine running Up 15 minutes analytics- snmp-collector running Up 15 minutes analytics- topology running Up 15 minutes controller- config- api running Up 17 minutes controller- config- devicemgr running Up 17 minutes controller- config- schema running Up 17 minutes controller- config- svcmonitor running Up 17 minutes external- cassandra running Up 18 minutes external- rabbitmq running Up 18 minutes external- zookeeper running Up 18 minutes controller- control- control running Up 16 minutes controller- control- dns running Up 16 minutes controller- control- named running Up 16 minutes external- cassandra running Up 15 minutes external- kafka running Up 15 minutes external- zookeeper running Up 15 minutes controller- webui-job running Up 16 minutes controller- webui-web running Up 16 minutes
[srvr1] ~ # contrail-status
Pod Service Original Name State Status
analytics alarm-gen contrail-
analytics api contrail-
analytics collector contrail-
analytics nodemgr contrail-nodemgr running Up 15 minutes
analytics query-engine contrail-
analytics snmp-collector contrail-
analytics topology contrail-
config api contrail-
config device-manager contrail-
config nodemgr contrail-nodemgr running Up 17 minutes
config schema contrail-
config svc-monitor contrail-
config-database cassandra contrail-
config-database nodemgr contrail-nodemgr running Up 18 minutes
config-database rabbitmq contrail-
config-database zookeeper contrail-
control control contrail-
control dns contrail-
control named contrail-
control nodemgr contrail-nodemgr running Up 16 minutes
database cassandra contrail-
database kafka contrail-
database nodemgr contrail-nodemgr running Up 15 minutes
database zookeeper contrail-
webui job contrail-
webui web contrail-
== Contrail control ==
control: active
nodemgr: active
named: active
dns: active
== Contrail config-database ==
nodemgr: initializing (Disk for DB is too low. )
zookeeper: active
rabbitmq: active
cassandra: active
== Contrail database ==
kafka: active
nodemgr: initializing (Disk for DB is too low. )
zookeeper: active
cassandra: active
== Contrail analytics ==
snmp-collector: active
query-engine: active
api: active
alarm-gen: active
nodemgr: active
collector: active
topology: active
== Contrail webui ==
web: active
job: active
== Contrail config ==
svc-monitor: active
nodemgr: active
device-manager: active
api: active
schema: active
[srvr1] ~ # cat /var/log/ contrail/ contrail- collector. log rverTrace: data= [ name = srvr2:Compute: contrail- vrouter- nodemgr: 0 generator_info= [ [ [ hostname = srvr1 gen_attr= [ connects = 1 connect_time = 1533677306418469 resets = 0 reset_time = 0 in_clear = 0 ] ], ] ] ] rverTrace: data= [ name = srvr1:Analytics :contrail- topology: 0 generator_info= [ [ [ hostname = srvr1 gen_attr= [ connects = 1 connect_time = 1533677306421841 resets = 0 reset_time = 0 in_clear = 0 ] ], ] ] ] rverTrace: data= [ name = srvr1:Analytics :contrail- analytics- api:0 generator_info= [ [ [ hostname = srvr1 gen_attr= [ connects = 1 connect_time = 1533677306385545 resets = 0 reset_time = 0 in_clear = 0 ] ], ] ] ] rverTrace: data= [ name = srvr1:Analytics :contrail- snmp-collector: 0 generator_info= [ [ [ hostname = srvr1 gen_attr= [ connects = 1 connect_time = 1533677306425220 resets = 0 reset_time = 0 in_clear = 0 ] ], ] ] ] rverTrace: data= [ name = srvr1:Config: contrail- svc-monitor: 0 generator_info= [ [ [ hostname = srvr1 gen_attr= [ connects = 1 connect_time = 1533677306427926 resets = 0 reset_time = 0 in_clear = 0 ] ], ] ] ] rverTrace: data= [ name = srvr1:Analytics :contrail- collector: 0 generator_info= [ [ [ hostname = srvr1 gen_attr= [ connects = 1 connect_time = 1533677306426406 resets = 0 reset_time = 0 in_clear = 0 ] ], ] ] ] geLog: Session 127.0.0. 1:8089: :127.0. 0.1:59124 > SSL Handshake failed due to error: 336130315 category: asio.ssl message: wrong version number src/contrail- common/ io/ssl_ server. cc 92 geLog: Session 127.0.0. 1:8089: :127.0. 0.1:59126 < Read failed due to error asio.ssl 335544539 : short read src/contrail- common/ io/tcp_ session. cc 487 geLog: Session 127.0.0. 1:8089: :127.0. 0.1:59204 > SSL Handshake failed due to error: 336130315 category: asio.ssl message: wrong version number src/contrail- common/ io/ssl_ server. cc 92 geLog: Session 127.0.0. 1:8089: :127.0. 0.1:59206 < Read failed due to error asio.ssl 335544539 : short read src/contrail- common/ io/tcp_ session. cc 487 geLog: Session 127.0.0. 1:8089: :127.0. 0.1:59270 > SSL Handshake failed due to error: 336130315 category: asio.ssl message: wrong version number src/contrail- common/ io/ssl_ server. cc 92 geLog: Session 127.0.0. 1:8089: :127.0. 0.1:59272 < Read failed due to error asio.ssl 335544539 : short read src/contrail- common/ io/tcp_ session. cc 487 geLog: Session 127.0.0. 1:8089: :127.0. 0.1:59364 > SSL Handshake failed due to error: 336130315 category: asio.ssl message: wrong version number src/contrail- common/ io/ssl_ server. cc 92 geLog: Session 127.0.0. 1:8089: :127.0. 0.1:59366 < Read failed due to error asio.ssl 335544539 : short read src/contrail- common/ io/tcp_ session. cc 487 geLog: Session 127.0.0. 1:8089: :127.0. 0.1:32928 > SSL Handshake failed due to error: 336130315 category: asio.ssl message: wrong version number src/contrail- common/ io/ssl_ server. cc 92 geLog: Session 127.0.0. 1:8089: :127.0. 0.1:32930 < Read failed due to error asio.ssl 335544539 : short read src/contrail- common/ io/tcp_ session. cc 487
...
...
2018-08-07 Tue 21:28:26:420.867 UTC srvr1 [Thread 140622134724352, Pid 1]: SANDESH: Send FAILED: 1533677306420420 [SYS_NOTICE]: SandeshModuleSe
2018-08-07 Tue 21:28:26:427.659 UTC srvr1 [Thread 140622134724352, Pid 1]: SANDESH: Send FAILED: 1533677306424195 [SYS_NOTICE]: SandeshModuleSe
2018-08-07 Tue 21:28:26:427.715 UTC srvr1 [Thread 140622134724352, Pid 1]: SANDESH: Send FAILED: 1533677306425195 [SYS_NOTICE]: SandeshModuleSe
2018-08-07 Tue 21:28:26:427.740 UTC srvr1 [Thread 140622134724352, Pid 1]: SANDESH: Send FAILED: 1533677306426992 [SYS_NOTICE]: SandeshModuleSe
2018-08-07 Tue 21:28:26:430.047 UTC srvr1 [Thread 140622134724352, Pid 1]: SANDESH: Send FAILED: 1533677306429418 [SYS_NOTICE]: SandeshModuleSe
2018-08-07 Tue 21:28:26:431.065 UTC srvr1 [Thread 140621926889216, Pid 1]: SANDESH: Send FAILED: 1533677306430959 [SYS_NOTICE]: SandeshModuleSe
2018-08-07 Tue 21:28:45:464.627 UTC srvr1 [Thread 140622375313408, Pid 1]: TCP [SYS_ERR]: TcpSessionMessa
2018-08-07 Tue 21:28:45:524.846 UTC srvr1 [Thread 140622375313408, Pid 1]: TCP [SYS_ERR]: TcpSessionMessa
2018-08-07 Tue 21:28:52:553.397 UTC srvr1 [Thread 140622375313408, Pid 1]: TCP [SYS_ERR]: TcpSessionMessa
2018-08-07 Tue 21:28:52:607.657 UTC srvr1 [Thread 140622375313408, Pid 1]: TCP [SYS_ERR]: TcpSessionMessa
2018-08-07 Tue 21:28:56:462.808 UTC srvr1 [Thread 140622375313408, Pid 1]: TCP [SYS_ERR]: TcpSessionMessa
2018-08-07 Tue 21:28:56:511.678 UTC srvr1 [Thread 140622375313408, Pid 1]: TCP [SYS_ERR]: TcpSessionMessa
2018-08-07 Tue 21:29:04:464.603 UTC srvr1 [Thread 140622375313408, Pid 1]: TCP [SYS_ERR]: TcpSessionMessa
2018-08-07 Tue 21:29:04:522.790 UTC srvr1 [Thread 140622375313408, Pid 1]: TCP [SYS_ERR]: TcpSessionMessa
2018-08-07 Tue 21:42:11:495.765 UTC srvr1 [Thread 140622375313408, Pid 1]: TCP [SYS_ERR]: TcpSessionMessa
2018-08-07 Tue 21:42:11:548.498 UTC srvr1 [Thread 140622375313408, Pid 1]: TCP [SYS_ERR]: TcpSessionMessa
------- ------- ------- >%