Noticed that contrail-database-nodemgr service is in "EXITED" state after installing Contrail 3.0.2.0-47~liberty version on a server running ubuntu 14.04.
== Contrail Supervisor Database ==
supervisor-database: active
contrail-database-nodemgr EXITED
kafka active
root@ccra-bng-5:/var/log/contrail# uname -a
Linux ccra-bng-5 3.13.0-85-generic #129-Ubuntu SMP Thu Mar 17 20:50:15 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
root@ccra-bng-5:/var/log/contrail# contrail-version
Package Version Build-ID | Repo | Package Name
-------------------------------------- ------------------------------ ----------------------------------
contrail-analytics 3.0.2.0-47 47
contrail-config 3.0.2.0-47 47
contrail-config-openstack 3.0.2.0-47 47
contrail-control 3.0.2.0-47 47
contrail-dns 3.0.2.0-47 47
contrail-docs 3.0.2.0-47 47
contrail-f5 3.0.2.0-47 47
contrail-fabric-utils 3.0.2.0-47 47
contrail-heat 3.0.2.0-47 47
contrail-install-packages 3.0.2.0-47~liberty 47
contrail-lib 3.0.2.0-47 47
contrail-nodemgr 3.0.2.0-47 47
contrail-nova-networkapi 3.0.2.0-47 47
contrail-openstack 3.0.2.0-47 47
contrail-openstack-analytics 3.0.2.0-47 47
contrail-openstack-config 3.0.2.0-47 47
contrail-openstack-control 3.0.2.0-47 47
contrail-openstack-dashboard 3.0.2.0-47 47
contrail-openstack-database 3.0.2.0-47 47
contrail-openstack-webui 3.0.2.0-47 47
contrail-setup 3.0.2.0-47 47
contrail-utils 3.0.2.0-47 47
contrail-web-controller 3.0.2.0-47 47
contrail-web-core 3.0.2.0-47 47
ifmap-python-client 0.1-2 47
ifmap-server 0.3.2-1contrail2 47
neutron-plugin-contrail 3.0.2.0-47 47
nova-api 2:12.0.1-0ubuntu1~cloud0.1contrail47
nova-common 2:12.0.1-0ubuntu1~cloud0.1contrail47
nova-conductor 2:12.0.1-0ubuntu1~cloud0.1contrail47
nova-console 2:12.0.1-0ubuntu1~cloud0.1contrail47
nova-consoleauth 2:12.0.1-0ubuntu1~cloud0.1contrail47
nova-novncproxy 2:12.0.1-0ubuntu1~cloud0.1contrail47
nova-objectstore 2:12.0.1-0ubuntu1~cloud0.1contrail47
nova-scheduler 2:12.0.1-0ubuntu1~cloud0.1contrail47
python-contrail 3.0.2.0-47 47
python-neutronclient 1:3.1.0-0ubuntu1~cloud0.2contrail47
python-nova 2:12.0.1-0ubuntu1~cloud0.1contrail47
Error logs from contrail-config-nodemgr-stderr.log:
root@ccra-bng-5:/var/log/contrail# cat contrail-database-nodemgr-stderr.log
Discovery server: 8.8.8.101
Discovery port: 5998
Collector address: []
06/15/2016 02:24:37 PM [contrail-database-nodemgr]: SANDESH: CONNECT TO COLLECTOR: True
06/15/2016 02:24:37 PM [contrail-database-nodemgr]: SANDESH: Logging: LEVEL: [SYS_INFO] -> [SYS_INFO]
06/15/2016 02:24:37 PM [contrail-database-nodemgr]: SANDESH: Logging: FILE: [None] -> [<stdout>]
06/15/2016 02:24:37 PM [contrail-database-nodemgr]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0]
06/15/2016 02:24:37 PM [contrail-database-nodemgr]: SANDESH: Trace: PRINT: [None] -> [False]
06/15/2016 02:24:37 PM [contrail-database-nodemgr]: SANDESH: Flow Logging: [None] -> [False]
06/15/2016 02:24:37 PM [contrail-database-nodemgr]: send_nodemgr_process_status_base: Sending UVE:NodeStatusUVE(_context='', _scope='', _category='', _send_queue_enabled=True, _seqnum=0, _versionsig=1642340850, _source='ccra-bng-5', _instance_id='0', _client=None, _type=6, _hints=1, _http_server=None, _logger=None, _more=False, _node_type='Database', data=NodeStatus(status=None, name='ccra-bng-5', deleted=None, disk_usage_info=None, build_info='{"build-info" : [{"build-version" : "3.0.2.0", "build-time" : "2016-06-03 00:03:34.570952", "build-user" : "contrail-builder", "build-hostname" : "contrail-ec-build19.juniper.net", "build-id" : "3.0.2.0-47", "build-number" : "47"}]}', system_mem_cpu_usage=None, process_mem_cpu_usage=None, system_cpu_info=None, process_status=[ProcessStatus(instance_id='0', module_id='contrail-database-nodemgr', state='Functional', description='', connection_infos=None)], all_core_file_list=None, _table='ObjectDatabaseInfo', process_info=None, description=None), _module='contrail-database-nodemgr', _level=2147483647, _timestamp=1465980877557586, _client_context='', _connect_to_collector=True, _role=0)
06/15/2016 02:24:37 PM [contrail-database-nodemgr]: Processing event[EvStart] in state[none]
06/15/2016 02:24:37 PM [contrail-database-nodemgr]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle]
06/15/2016 02:24:37 PM [contrail-database-nodemgr]: Processing event[EvSandeshUVESend] in state[Idle]
06/15/2016 02:24:37 PM [contrail-database-nodemgr]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = ccra-bng-5 system_cpu_info = << num_socket = 2 num_cpu = 48 num_core_per_socket = 12 num_thread_per_core = 2 >> >>
06/15/2016 02:24:37 PM [contrail-database-nodemgr]: Discarding event[EvSandeshUVESend] in state[Idle]
06/15/2016 02:24:37 PM [contrail-database-nodemgr]: Processing event[EvSandeshUVESend] in state[Idle]
06/15/2016 02:24:37 PM [contrail-database-nodemgr]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = ccra-bng-5 process_status = [ << module_id = contrail-database-nodemgr instance_id = 0 state = Functional description = >>, ] build_info = {"build-info" : [{"build-version" : "3.0.2.0", "build-time" : "2016-06-03 00:03:34.570952", "build-user" : "contrail-builder", "build-hostname" : "contrail-ec-build19.juniper.net", "build-id" : "3.0.2.0-47", "build-number" : "47"}]} >>
06/15/2016 02:24:37 PM [contrail-database-nodemgr]: Discarding event[EvSandeshUVESend] in state[Idle]
06/15/2016 02:24:37 PM [contrail-database-nodemgr]: Starting Introspect on HTTP Port 8103
06/15/2016 02:24:37 PM [contrail-database-nodemgr]: Cannot write http_port 8103 to /tmp/contrail-database-nodemgr.22426.http_port
wokeup and found a line
wokeup and found a line
wokeup and found a line
06/15/2016 02:24:38 PM [contrail-database-nodemgr]: send_process_state_db_base: Sending UVE:NodeStatusUVE(_context='', _scope='', _category='', _send_queue_enabled=True, _seqnum=0, _versionsig=1642340850, _source='ccra-bng-5', _instance_id='0', _client=None, _type=6, _hints=1, _http_server=None, _logger=None, _more=False, _node_type='Database', data=NodeStatus(status=None, name='ccra-bng-5', deleted=False, disk_usage_info=None, build_info='{"build-info" : [{"build-version" : "3.0.2.0", "build-time" : "2016-06-03 00:03:34.570952", "build-user" : "contrail-builder", "build-hostname" : "contrail-ec-build19.juniper.net", "build-id" : "3.0.2.0-47", "build-number" : "47"}]}', system_mem_cpu_usage=None, process_mem_cpu_usage=None, system_cpu_info=None, process_status=None, all_core_file_list=None, _table='ObjectDatabaseInfo', process_info=[ProcessInfo(process_name='contrail-database-nodemgr', process_state='PROCESS_STATE_RUNNING', last_stop_time='', start_count=1, core_file_list=[], last_start_time='1465980878089703', stop_count=0, last_exit_time='', exit_count=0), ProcessInfo(process_name='kafka', process_state='PROCESS_STATE_STARTING', last_stop_time='', start_count=0, core_file_list=[], last_start_time='', stop_count=0, last_exit_time='', exit_count=0)], description=None), _module='contrail-database-nodemgr', _level=2147483647, _timestamp=1465980878089970, _client_context='', _connect_to_collector=True, _role=0)
06/15/2016 02:24:38 PM [contrail-database-nodemgr]: Processing event[EvSandeshUVESend] in state[Idle]
06/15/2016 02:24:38 PM [contrail-database-nodemgr]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = ccra-bng-5 deleted = False process_info = [ << process_name = contrail-database-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1465980878089703 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = kafka process_state = PROCESS_STATE_STARTING start_count = 0 stop_count = 0 exit_count = 0 last_start_time = last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "3.0.2.0", "build-time" : "2016-06-03 00:03:34.570952", "build-user" : "contrail-builder", "build-hostname" : "contrail-ec-build19.juniper.net", "build-id" : "3.0.2.0-47", "build-number" : "47"}]} >>
06/15/2016 02:24:38 PM [contrail-database-nodemgr]: Discarding event[EvSandeshUVESend] in state[Idle]
wokeup and found a line
06/15/2016 02:24:38 PM [contrail-database-nodemgr]: send_process_state_db_base: Sending UVE:NodeStatusUVE(_context='', _scope='', _category='', _send_queue_enabled=True, _seqnum=0, _versionsig=1642340850, _source='ccra-bng-5', _instance_id='0', _client=None, _type=6, _hints=1, _http_server=None, _logger=None, _more=False, _node_type='Database', data=NodeStatus(status=None, name='ccra-bng-5', deleted=False, disk_usage_info=None, build_info='{"build-info" : [{"build-version" : "3.0.2.0", "build-time" : "2016-06-03 00:03:34.570952", "build-user" : "contrail-builder", "build-hostname" : "contrail-ec-build19.juniper.net", "build-id" : "3.0.2.0-47", "build-number" : "47"}]}', system_mem_cpu_usage=None, process_mem_cpu_usage=None, system_cpu_info=None, process_status=None, all_core_file_list=None, _table='ObjectDatabaseInfo', process_info=[ProcessInfo(process_name='contrail-database-nodemgr', process_state='PROCESS_STATE_RUNNING', last_stop_time='', start_count=1, core_file_list=[], last_start_time='1465980878089703', stop_count=0, last_exit_time='', exit_count=0), ProcessInfo(process_name='kafka', process_state='PROCESS_STATE_RUNNING', last_stop_time='', start_count=1, core_file_list=[], last_start_time='1465980878091469', stop_count=0, last_exit_time='', exit_count=0)], description=None), _module='contrail-database-nodemgr', _level=2147483647, _timestamp=1465980878091699, _client_context='', _connect_to_collector=True, _role=0)
06/15/2016 02:24:38 PM [contrail-database-nodemgr]: Processing event[EvSandeshUVESend] in state[Idle]
06/15/2016 02:24:38 PM [contrail-database-nodemgr]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = ccra-bng-5 deleted = False process_info = [ << process_name = contrail-database-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1465980878089703 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = kafka process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1465980878091469 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "3.0.2.0", "build-time" : "2016-06-03 00:03:34.570952", "build-user" : "contrail-builder", "build-hostname" : "contrail-ec-build19.juniper.net", "build-id" : "3.0.2.0-47", "build-number" : "47"}]} >>
06/15/2016 02:24:38 PM [contrail-database-nodemgr]: Discarding event[EvSandeshUVESend] in state[Idle]
06/15/2016 02:24:42 PM [contrail-database-nodemgr]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/15/2016 02:24:42 PM [contrail-database-nodemgr]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/15/2016 02:24:42 PM [contrail-database-nodemgr]: Processing event[EvCollectorUnknown] in state[Connect]
06/15/2016 02:24:42 PM [contrail-database-nodemgr]: Sandesh Client: Event[EvCollectorUnknown] => State[Connect] -> State[Disconnect]
wokeup and found a line
Exception AssertionError: AssertionError() in <module 'threading' from '/usr/lib/python2.7/threading.pyc'> ignored
Exception AssertionError: AssertionError() in <module 'threading' from '/usr/lib/python2.7/threading.pyc'> ignored
Exception AssertionError: AssertionError() in <module 'threading' from '/usr/lib/python2.7/threading.pyc'> ignored
06/15/2016 02:25:01 PM [contrail-database-nodemgr]: Processing event[EvSandeshUVESend] in state[Disconnect]
06/15/2016 02:25:01 PM [contrail-database-nodemgr]: SANDESH: [DROP: WrongClientSMState] DatabaseUsage: data = << name = ccra-bng-5 database_usage = [ << disk_space_used_1k = 4875432 disk_space_available_1k = 656873488 analytics_db_size_1k = 4 >>, ] >>
06/15/2016 02:25:01 PM [contrail-database-nodemgr]: Discarding event[EvSandeshUVESend] in state[Disconnect]
Exception AssertionError: AssertionError() in <module 'threading' from '/usr/lib/python2.7/threading.pyc'> ignored
Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/gevent/greenlet.py", line 327, in run
result = self._run(*self.args, **self.kwargs)
File "/usr/lib/python2.7/dist-packages/nodemgr/database_nodemgr/database_event_manager.py", line 341, in runforever
self.database_periodic()
File "/usr/lib/python2.7/dist-packages/nodemgr/database_nodemgr/database_event_manager.py", line 246, in database_periodic
self.send_database_status()
File "/usr/lib/python2.7/dist-packages/nodemgr/database_nodemgr/database_event_manager.py", line 265, in send_database_status
self.get_pending_compaction_count(op)
AttributeError: 'NoneType' object has no attribute 'pending_compaction_tasks'
<Greenlet at 0x7f450a8ebe10: <bound method DatabaseEventManager.runforever of <nodemgr.database_nodemgr.database_event_manager.DatabaseEventManager object at 0x7f450b42b110>>> failed with AttributeError
root@ccra-bng-5:/var/log/contrail#
this is a dup of another bug, fixed in later build..
b51 is the release build.. why are you testing b47?
> On Jun 15, 2016, at 3:55 AM, Rathinasabapathy <email address hidden> wrote:
>
> Public bug reported:
>
> Noticed that contrail-
> after installing Contrail 3.0.2.0-47~liberty version on a server running
> ubuntu 14.04.
>
> == Contrail Supervisor Database ==
> supervisor-
> contrail-
> kafka active
>
> root@ccra-
> Linux ccra-bng-5 3.13.0-85-generic #129-Ubuntu SMP Thu Mar 17 20:50:15 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
>
> root@ccra-
> Package Version Build-ID | Repo | Package Name
> -------
> contrail-analytics 3.0.2.0-47 47
> contrail-config 3.0.2.0-47 47
> contrail-
> contrail-control 3.0.2.0-47 47
> contrail-dns 3.0.2.0-47 47
> contrail-docs 3.0.2.0-47 47
> contrail-f5 3.0.2.0-47 47
> contrail-
> contrail-heat 3.0.2.0-47 47
> contrail-
> contrail-lib 3.0.2.0-47 47
> contrail-nodemgr 3.0.2.0-47 47
> contrail-
> contrail-openstack 3.0.2.0-47 47
> contrail-
> contrail-
> contrail-
> contrail-
> contrail-
> contrail-
> contrail-setup 3.0.2.0-47 47
> contrail-utils 3.0.2.0-47 47
> contrail-
> contrail-web-core 3.0.2.0-47 47
> ifmap-python-client 0.1-2 47
> ifmap-server 0.3.2-1contrail2 47
> neutron-
> nova-api 2:12.0.
> nova-common 2:12.0.
> nova-conductor 2:12.0.