Hi Raj,

Build b47 was pointed as R3.0.2 candidate build 2 weeks back and I was not aware that newer builds are available. Could you please point me the path for downloading the latest build?

Thanks,
Sabapathy

-----Original Message-----
From: Raj Reddy 
Sent: Wednesday, June 15, 2016 10:52 PM
To: Bug 1592764 <email address hidden>; Rathinasabapathy Sakthivel <email address hidden>
Subject: Re: [Bug 1592764] [NEW] 3.0.2.0-47~liberty: contrail-database-nodemgr service failed to start

this is a dup of another bug, fixed in later build..
b51 is the release build.. why are you testing b47?

> On Jun 15, 2016, at 3:55 AM, Rathinasabapathy <email address hidden> wrote:
> 
> Public bug reported:
> 
> Noticed that contrail-database-nodemgr service is in "EXITED" state 
> after installing Contrail 3.0.2.0-47~liberty version on a server 
> running ubuntu 14.04.
> 
> == Contrail Supervisor Database ==
> supervisor-database:          active
> contrail-database-nodemgr     EXITED
> kafka                         active
> 
> root@ccra-bng-5:/var/log/contrail# uname -a Linux ccra-bng-5 
> 3.13.0-85-generic #129-Ubuntu SMP Thu Mar 17 20:50:15 UTC 2016 x86_64 
> x86_64 x86_64 GNU/Linux
> 
> root@ccra-bng-5:/var/log/contrail# contrail-version
> Package                                Version                        Build-ID | Repo | Package Name
> -------------------------------------- ------------------------------ ----------------------------------
> contrail-analytics                     3.0.2.0-47                     47
> contrail-config                        3.0.2.0-47                     47
> contrail-config-openstack              3.0.2.0-47                     47
> contrail-control                       3.0.2.0-47                     47
> contrail-dns                           3.0.2.0-47                     47
> contrail-docs                          3.0.2.0-47                     47
> contrail-f5                            3.0.2.0-47                     47
> contrail-fabric-utils                  3.0.2.0-47                     47
> contrail-heat                          3.0.2.0-47                     47
> contrail-install-packages              3.0.2.0-47~liberty             47
> contrail-lib                           3.0.2.0-47                     47
> contrail-nodemgr                       3.0.2.0-47                     47
> contrail-nova-networkapi               3.0.2.0-47                     47
> contrail-openstack                     3.0.2.0-47                     47
> contrail-openstack-analytics           3.0.2.0-47                     47
> contrail-openstack-config              3.0.2.0-47                     47
> contrail-openstack-control             3.0.2.0-47                     47
> contrail-openstack-dashboard           3.0.2.0-47                     47
> contrail-openstack-database            3.0.2.0-47                     47
> contrail-openstack-webui               3.0.2.0-47                     47
> contrail-setup                         3.0.2.0-47                     47
> contrail-utils                         3.0.2.0-47                     47
> contrail-web-controller                3.0.2.0-47                     47
> contrail-web-core                      3.0.2.0-47                     47
> ifmap-python-client                    0.1-2                          47
> ifmap-server                           0.3.2-1contrail2               47
> neutron-plugin-contrail                3.0.2.0-47                     47
> nova-api                               2:12.0.1-0ubuntu1~cloud0.1contrail47
> nova-common                            2:12.0.1-0ubuntu1~cloud0.1contrail47
> nova-conductor                         2:12.0.1-0ubuntu1~cloud0.1contrail47
> nova-console                           2:12.0.1-0ubuntu1~cloud0.1contrail47
> nova-consoleauth                       2:12.0.1-0ubuntu1~cloud0.1contrail47
> nova-novncproxy                        2:12.0.1-0ubuntu1~cloud0.1contrail47
> nova-objectstore                       2:12.0.1-0ubuntu1~cloud0.1contrail47
> nova-scheduler                         2:12.0.1-0ubuntu1~cloud0.1contrail47
> python-contrail                        3.0.2.0-47                     47
> python-neutronclient                   1:3.1.0-0ubuntu1~cloud0.2contrail47
> python-nova                            2:12.0.1-0ubuntu1~cloud0.1contrail47
> 
> Error logs from contrail-config-nodemgr-stderr.log:
> 
> root@ccra-bng-5:/var/log/contrail# cat 
> contrail-database-nodemgr-stderr.log
> Discovery server: 8.8.8.101
> Discovery port: 5998
> Collector address: []
> 06/15/2016 02:24:37 PM [contrail-database-nodemgr]: SANDESH: CONNECT 
> TO COLLECTOR: True
> 06/15/2016 02:24:37 PM [contrail-database-nodemgr]: SANDESH: Logging: 
> LEVEL: [SYS_INFO] -> [SYS_INFO]
> 06/15/2016 02:24:37 PM [contrail-database-nodemgr]: SANDESH: Logging: 
> FILE: [None] -> [<stdout>]
> 06/15/2016 02:24:37 PM [contrail-database-nodemgr]: SANDESH: Logging: 
> SYSLOG: [None] -> [LOG_LOCAL0]
> 06/15/2016 02:24:37 PM [contrail-database-nodemgr]: SANDESH: Trace: 
> PRINT: [None] -> [False]
> 06/15/2016 02:24:37 PM [contrail-database-nodemgr]: SANDESH: Flow 
> Logging: [None] -> [False]
> 06/15/2016 02:24:37 PM [contrail-database-nodemgr]: 
> send_nodemgr_process_status_base: Sending 
> UVE:NodeStatusUVE(_context='', _scope='', _category='', 
> _send_queue_enabled=True, _seqnum=0, _versionsig=1642340850, 
> _source='ccra-bng-5', _instance_id='0', _client=None, _type=6, 
> _hints=1, _http_server=None, _logger=None, _more=False, 
> _node_type='Database', data=NodeStatus(status=None, name='ccra-bng-5', 
> deleted=None, disk_usage_info=None, build_info='{"build-info" : 
> [{"build-version" : "3.0.2.0", "build-time" : "2016-06-03 
> 00:03:34.570952", "build-user" : "contrail-builder", "build-hostname" 
> : "contrail-ec-build19.juniper.net", "build-id" : "3.0.2.0-47", 
> "build-number" : "47"}]}', system_mem_cpu_usage=None, 
> process_mem_cpu_usage=None, system_cpu_info=None, 
> process_status=[ProcessStatus(instance_id='0', 
> module_id='contrail-database-nodemgr', state='Functional', 
> description='', connection_infos=None)], all_core_file_list=None, 
> _table='ObjectDatabaseInfo', process_info=None, description=None), 
> _module='contrail-database-nodemgr', _level=2147483647, 
> _timestamp=1465980877557586, _client_context='', 
> _connect_to_collector=True, _role=0)
> 06/15/2016 02:24:37 PM [contrail-database-nodemgr]: Processing 
> event[EvStart] in state[none]
> 06/15/2016 02:24:37 PM [contrail-database-nodemgr]: Sandesh Client: 
> Event[EvStart] => State[none] -> State[Idle]
> 06/15/2016 02:24:37 PM [contrail-database-nodemgr]: Processing 
> event[EvSandeshUVESend] in state[Idle]
> 06/15/2016 02:24:37 PM [contrail-database-nodemgr]: SANDESH: [DROP: 
> WrongClientSMState] NodeStatusUVE: data = <<  name = ccra-bng-5  
> system_cpu_info = <<  num_socket = 2  num_cpu = 48  
> num_core_per_socket = 12  num_thread_per_core = 2  >>  >>
> 06/15/2016 02:24:37 PM [contrail-database-nodemgr]: Discarding 
> event[EvSandeshUVESend] in state[Idle]
> 06/15/2016 02:24:37 PM [contrail-database-nodemgr]: Processing event[EvSandeshUVESend] in state[Idle]
> 06/15/2016 02:24:37 PM [contrail-database-nodemgr]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = ccra-bng-5  process_status = [ <<  module_id = contrail-database-nodemgr  instance_id = 0  state = Functional  description =   >>,  ]  build_info = {"build-info" : [{"build-version" : "3.0.2.0", "build-time" : "2016-06-03 00:03:34.570952", "build-user" : "contrail-builder", "build-hostname" : "contrail-ec-build19.juniper.net", "build-id" : "3.0.2.0-47", "build-number" : "47"}]}  >>
> 06/15/2016 02:24:37 PM [contrail-database-nodemgr]: Discarding 
> event[EvSandeshUVESend] in state[Idle]
> 06/15/2016 02:24:37 PM [contrail-database-nodemgr]: Starting 
> Introspect on HTTP Port 8103
> 06/15/2016 02:24:37 PM [contrail-database-nodemgr]: Cannot write 
> http_port 8103 to /tmp/contrail-database-nodemgr.22426.http_port
> wokeup and found a line
> wokeup and found a line
> wokeup and found a line
> 06/15/2016 02:24:38 PM [contrail-database-nodemgr]: 
> send_process_state_db_base: Sending UVE:NodeStatusUVE(_context='', 
> _scope='', _category='', _send_queue_enabled=True, _seqnum=0, 
> _versionsig=1642340850, _source='ccra-bng-5', _instance_id='0', 
> _client=None, _type=6, _hints=1, _http_server=None, _logger=None, 
> _more=False, _node_type='Database', data=NodeStatus(status=None, 
> name='ccra-bng-5', deleted=False, disk_usage_info=None, 
> build_info='{"build-info" : [{"build-version" : "3.0.2.0", 
> "build-time" : "2016-06-03 00:03:34.570952", "build-user" : 
> "contrail-builder", "build-hostname" : 
> "contrail-ec-build19.juniper.net", "build-id" : "3.0.2.0-47", 
> "build-number" : "47"}]}', system_mem_cpu_usage=None, 
> process_mem_cpu_usage=None, system_cpu_info=None, process_status=None, 
> all_core_file_list=None, _table='ObjectDatabaseInfo', 
> process_info=[ProcessInfo(process_name='contrail-database-nodemgr', 
> process_state='PROCESS_STATE_RUNNING', last_stop_time='', 
> start_count=1, core_file_list=[], last_start_time='1465980878089703', 
> stop_count=0, last_exit_time='', exit_count=0), 
> ProcessInfo(process_name='kafka', 
> process_state='PROCESS_STATE_STARTING', last_stop_time='', 
> start_count=0, core_file_list=[], last_start_time='', stop_count=0, 
> last_exit_time='', exit_count=0)], description=None), 
> _module='contrail-database-nodemgr', _level=2147483647, 
> _timestamp=1465980878089970, _client_context='', 
> _connect_to_collector=True, _role=0)
> 06/15/2016 02:24:38 PM [contrail-database-nodemgr]: Processing event[EvSandeshUVESend] in state[Idle]
> 06/15/2016 02:24:38 PM [contrail-database-nodemgr]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = ccra-bng-5  deleted = False  process_info = [ <<  process_name = contrail-database-nodemgr  process_state = PROCESS_STATE_RUNNING  start_count = 1  stop_count = 0  exit_count = 0  last_start_time = 1465980878089703  last_stop_time =   last_exit_time =   core_file_list = [  ]  >>, <<  process_name = kafka  process_state = PROCESS_STATE_STARTING  start_count = 0  stop_count = 0  exit_count = 0  last_start_time =   last_stop_time =   last_exit_time =   core_file_list = [  ]  >>,  ]  build_info = {"build-info" : [{"build-version" : "3.0.2.0", "build-time" : "2016-06-03 00:03:34.570952", "build-user" : "contrail-builder", "build-hostname" : "contrail-ec-build19.juniper.net", "build-id" : "3.0.2.0-47", "build-number" : "47"}]}  >>
> 06/15/2016 02:24:38 PM [contrail-database-nodemgr]: Discarding 
> event[EvSandeshUVESend] in state[Idle] wokeup and found a line
> 06/15/2016 02:24:38 PM [contrail-database-nodemgr]: 
> send_process_state_db_base: Sending UVE:NodeStatusUVE(_context='', 
> _scope='', _category='', _send_queue_enabled=True, _seqnum=0, 
> _versionsig=1642340850, _source='ccra-bng-5', _instance_id='0', 
> _client=None, _type=6, _hints=1, _http_server=None, _logger=None, 
> _more=False, _node_type='Database', data=NodeStatus(status=None, 
> name='ccra-bng-5', deleted=False, disk_usage_info=None, 
> build_info='{"build-info" : [{"build-version" : "3.0.2.0", 
> "build-time" : "2016-06-03 00:03:34.570952", "build-user" : 
> "contrail-builder", "build-hostname" : 
> "contrail-ec-build19.juniper.net", "build-id" : "3.0.2.0-47", 
> "build-number" : "47"}]}', system_mem_cpu_usage=None, 
> process_mem_cpu_usage=None, system_cpu_info=None, process_status=None, 
> all_core_file_list=None, _table='ObjectDatabaseInfo', 
> process_info=[ProcessInfo(process_name='contrail-database-nodemgr', 
> process_state='PROCESS_STATE_RUNNING', last_stop_time='', 
> start_count=1, core_file_list=[], last_start_time='1465980878089703', 
> stop_count=0, last_exit_time='', exit_count=0), 
> ProcessInfo(process_name='kafka', 
> process_state='PROCESS_STATE_RUNNING', last_stop_time='', 
> start_count=1, core_file_list=[], last_start_time='1465980878091469', 
> stop_count=0, last_exit_time='', exit_count=0)], description=None), 
> _module='contrail-database-nodemgr', _level=2147483647, 
> _timestamp=1465980878091699, _client_context='', 
> _connect_to_collector=True, _role=0)
> 06/15/2016 02:24:38 PM [contrail-database-nodemgr]: Processing event[EvSandeshUVESend] in state[Idle]
> 06/15/2016 02:24:38 PM [contrail-database-nodemgr]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = ccra-bng-5  deleted = False  process_info = [ <<  process_name = contrail-database-nodemgr  process_state = PROCESS_STATE_RUNNING  start_count = 1  stop_count = 0  exit_count = 0  last_start_time = 1465980878089703  last_stop_time =   last_exit_time =   core_file_list = [  ]  >>, <<  process_name = kafka  process_state = PROCESS_STATE_RUNNING  start_count = 1  stop_count = 0  exit_count = 0  last_start_time = 1465980878091469  last_stop_time =   last_exit_time =   core_file_list = [  ]  >>,  ]  build_info = {"build-info" : [{"build-version" : "3.0.2.0", "build-time" : "2016-06-03 00:03:34.570952", "build-user" : "contrail-builder", "build-hostname" : "contrail-ec-build19.juniper.net", "build-id" : "3.0.2.0-47", "build-number" : "47"}]}  >>
> 06/15/2016 02:24:38 PM [contrail-database-nodemgr]: Discarding 
> event[EvSandeshUVESend] in state[Idle]
> 06/15/2016 02:24:42 PM [contrail-database-nodemgr]: Processing 
> event[EvIdleHoldTimerExpired] in state[Idle]
> 06/15/2016 02:24:42 PM [contrail-database-nodemgr]: Sandesh Client: 
> Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
> 06/15/2016 02:24:42 PM [contrail-database-nodemgr]: Processing 
> event[EvCollectorUnknown] in state[Connect]
> 06/15/2016 02:24:42 PM [contrail-database-nodemgr]: Sandesh Client: 
> Event[EvCollectorUnknown] => State[Connect] -> State[Disconnect] 
> wokeup and found a line Exception AssertionError: AssertionError() in 
> <module 'threading' from '/usr/lib/python2.7/threading.pyc'> ignored 
> Exception AssertionError: AssertionError() in <module 'threading' from 
> '/usr/lib/python2.7/threading.pyc'> ignored Exception AssertionError: 
> AssertionError() in <module 'threading' from 
> '/usr/lib/python2.7/threading.pyc'> ignored
> 06/15/2016 02:25:01 PM [contrail-database-nodemgr]: Processing 
> event[EvSandeshUVESend] in state[Disconnect]
> 06/15/2016 02:25:01 PM [contrail-database-nodemgr]: SANDESH: [DROP: 
> WrongClientSMState] DatabaseUsage: data = <<  name = ccra-bng-5  
> database_usage = [ <<  disk_space_used_1k = 4875432  
> disk_space_available_1k = 656873488  analytics_db_size_1k = 4  >>,  ]  
> >>
> 06/15/2016 02:25:01 PM [contrail-database-nodemgr]: Discarding 
> event[EvSandeshUVESend] in state[Disconnect] Exception AssertionError: 
> AssertionError() in <module 'threading' from '/usr/lib/python2.7/threading.pyc'> ignored Traceback (most recent call last):
>  File "/usr/lib/python2.7/dist-packages/gevent/greenlet.py", line 327, in run
>    result = self._run(*self.args, **self.kwargs)  File 
> "/usr/lib/python2.7/dist-packages/nodemgr/database_nodemgr/database_event_manager.py", line 341, in runforever
>    self.database_periodic()
>  File "/usr/lib/python2.7/dist-packages/nodemgr/database_nodemgr/database_event_manager.py", line 246, in database_periodic
>    self.send_database_status()
>  File "/usr/lib/python2.7/dist-packages/nodemgr/database_nodemgr/database_event_manager.py", line 265, in send_database_status
>    self.get_pending_compaction_count(op)
> AttributeError: 'NoneType' object has no attribute 'pending_compaction_tasks'
> <Greenlet at 0x7f450a8ebe10: <bound method 
> DatabaseEventManager.runforever of 
> <nodemgr.database_nodemgr.database_event_manager.DatabaseEventManager 
> object at 0x7f450b42b110>>> failed with AttributeError
> 
> root@ccra-bng-5:/var/log/contrail#
> 
> ** Affects: opencontrail
>     Importance: Undecided
>         Status: New
> 
> --
> You received this bug notification because you are a member of 
> Contrail Systems engineering, which is subscribed to OpenContrail.
> https://bugs.launchpad.net/bugs/1592764
> 
> Title:
>  3.0.2.0-47~liberty: contrail-database-nodemgr service failed to start
> 
> Status in OpenContrail:
>  New
> 
> Bug description:
>  Noticed that contrail-database-nodemgr service is in "EXITED" state  
> after installing Contrail 3.0.2.0-47~liberty version on a server  
> running ubuntu 14.04.
> 
>  == Contrail Supervisor Database ==
>  supervisor-database:          active
>  contrail-database-nodemgr     EXITED
>  kafka                         active
> 
>  root@ccra-bng-5:/var/log/contrail# uname -a  Linux ccra-bng-5 
> 3.13.0-85-generic #129-Ubuntu SMP Thu Mar 17 20:50:15 UTC 2016 x86_64 
> x86_64 x86_64 GNU/Linux
> 
>  root@ccra-bng-5:/var/log/contrail# contrail-version
>  Package                                Version                        Build-ID | Repo | Package Name
>  -------------------------------------- ------------------------------ ----------------------------------
>  contrail-analytics                     3.0.2.0-47                     47
>  contrail-config                        3.0.2.0-47                     47
>  contrail-config-openstack              3.0.2.0-47                     47
>  contrail-control                       3.0.2.0-47                     47
>  contrail-dns                           3.0.2.0-47                     47
>  contrail-docs                          3.0.2.0-47                     47
>  contrail-f5                            3.0.2.0-47                     47
>  contrail-fabric-utils                  3.0.2.0-47                     47
>  contrail-heat                          3.0.2.0-47                     47
>  contrail-install-packages              3.0.2.0-47~liberty             47
>  contrail-lib                           3.0.2.0-47                     47
>  contrail-nodemgr                       3.0.2.0-47                     47
>  contrail-nova-networkapi               3.0.2.0-47                     47
>  contrail-openstack                     3.0.2.0-47                     47
>  contrail-openstack-analytics           3.0.2.0-47                     47
>  contrail-openstack-config              3.0.2.0-47                     47
>  contrail-openstack-control             3.0.2.0-47                     47
>  contrail-openstack-dashboard           3.0.2.0-47                     47
>  contrail-openstack-database            3.0.2.0-47                     47
>  contrail-openstack-webui               3.0.2.0-47                     47
>  contrail-setup                         3.0.2.0-47                     47
>  contrail-utils                         3.0.2.0-47                     47
>  contrail-web-controller                3.0.2.0-47                     47
>  contrail-web-core                      3.0.2.0-47                     47
>  ifmap-python-client                    0.1-2                          47
>  ifmap-server                           0.3.2-1contrail2               47
>  neutron-plugin-contrail                3.0.2.0-47                     47
>  nova-api                               2:12.0.1-0ubuntu1~cloud0.1contrail47
>  nova-common                            2:12.0.1-0ubuntu1~cloud0.1contrail47
>  nova-conductor                         2:12.0.1-0ubuntu1~cloud0.1contrail47
>  nova-console                           2:12.0.1-0ubuntu1~cloud0.1contrail47
>  nova-consoleauth                       2:12.0.1-0ubuntu1~cloud0.1contrail47
>  nova-novncproxy                        2:12.0.1-0ubuntu1~cloud0.1contrail47
>  nova-objectstore                       2:12.0.1-0ubuntu1~cloud0.1contrail47
>  nova-scheduler                         2:12.0.1-0ubuntu1~cloud0.1contrail47
>  python-contrail                        3.0.2.0-47                     47
>  python-neutronclient                   1:3.1.0-0ubuntu1~cloud0.2contrail47
>  python-nova                            2:12.0.1-0ubuntu1~cloud0.1contrail47
> 
>  Error logs from contrail-config-nodemgr-stderr.log:
> 
>  root@ccra-bng-5:/var/log/contrail# cat 
> contrail-database-nodemgr-stderr.log
>  Discovery server: 8.8.8.101
>  Discovery port: 5998
>  Collector address: []
>  06/15/2016 02:24:37 PM [contrail-database-nodemgr]: SANDESH: CONNECT 
> TO COLLECTOR: True
>  06/15/2016 02:24:37 PM [contrail-database-nodemgr]: SANDESH: Logging: 
> LEVEL: [SYS_INFO] -> [SYS_INFO]
>  06/15/2016 02:24:37 PM [contrail-database-nodemgr]: SANDESH: Logging: 
> FILE: [None] -> [<stdout>]
>  06/15/2016 02:24:37 PM [contrail-database-nodemgr]: SANDESH: Logging: 
> SYSLOG: [None] -> [LOG_LOCAL0]
>  06/15/2016 02:24:37 PM [contrail-database-nodemgr]: SANDESH: Trace: 
> PRINT: [None] -> [False]
>  06/15/2016 02:24:37 PM [contrail-database-nodemgr]: SANDESH: Flow 
> Logging: [None] -> [False]
>  06/15/2016 02:24:37 PM [contrail-database-nodemgr]: 
> send_nodemgr_process_status_base: Sending 
> UVE:NodeStatusUVE(_context='', _scope='', _category='', 
> _send_queue_enabled=True, _seqnum=0, _versionsig=1642340850, 
> _source='ccra-bng-5', _instance_id='0', _client=None, _type=6, 
> _hints=1, _http_server=None, _logger=None, _more=False, 
> _node_type='Database', data=NodeStatus(status=None, name='ccra-bng-5', 
> deleted=None, disk_usage_info=None, build_info='{"build-info" : 
> [{"build-version" : "3.0.2.0", "build-time" : "2016-06-03 
> 00:03:34.570952", "build-user" : "contrail-builder", "build-hostname" 
> : "contrail-ec-build19.juniper.net", "build-id" : "3.0.2.0-47", 
> "build-number" : "47"}]}', system_mem_cpu_usage=None, 
> process_mem_cpu_usage=None, system_cpu_info=None, 
> process_status=[ProcessStatus(instance_id='0', 
> module_id='contrail-database-nodemgr', state='Functional', 
> description='', connection_infos=None)], all_core_file_list=None, 
> _table='ObjectDatabaseInfo', process_info=None, description=None), 
> _module='contrail-database-nodemgr', _level=2147483647, 
> _timestamp=1465980877557586, _client_context='', 
> _connect_to_collector=True, _role=0)
>  06/15/2016 02:24:37 PM [contrail-database-nodemgr]: Processing 
> event[EvStart] in state[none]
>  06/15/2016 02:24:37 PM [contrail-database-nodemgr]: Sandesh Client: 
> Event[EvStart] => State[none] -> State[Idle]
>  06/15/2016 02:24:37 PM [contrail-database-nodemgr]: Processing 
> event[EvSandeshUVESend] in state[Idle]
>  06/15/2016 02:24:37 PM [contrail-database-nodemgr]: SANDESH: [DROP: 
> WrongClientSMState] NodeStatusUVE: data = <<  name = ccra-bng-5  
> system_cpu_info = <<  num_socket = 2  num_cpu = 48  
> num_core_per_socket = 12  num_thread_per_core = 2  >>  >>
>  06/15/2016 02:24:37 PM [contrail-database-nodemgr]: Discarding 
> event[EvSandeshUVESend] in state[Idle]
>  06/15/2016 02:24:37 PM [contrail-database-nodemgr]: Processing event[EvSandeshUVESend] in state[Idle]
>  06/15/2016 02:24:37 PM [contrail-database-nodemgr]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = ccra-bng-5  process_status = [ <<  module_id = contrail-database-nodemgr  instance_id = 0  state = Functional  description =   >>,  ]  build_info = {"build-info" : [{"build-version" : "3.0.2.0", "build-time" : "2016-06-03 00:03:34.570952", "build-user" : "contrail-builder", "build-hostname" : "contrail-ec-build19.juniper.net", "build-id" : "3.0.2.0-47", "build-number" : "47"}]}  >>
>  06/15/2016 02:24:37 PM [contrail-database-nodemgr]: Discarding 
> event[EvSandeshUVESend] in state[Idle]
>  06/15/2016 02:24:37 PM [contrail-database-nodemgr]: Starting 
> Introspect on HTTP Port 8103
>  06/15/2016 02:24:37 PM [contrail-database-nodemgr]: Cannot write 
> http_port 8103 to /tmp/contrail-database-nodemgr.22426.http_port
>  wokeup and found a line
>  wokeup and found a line
>  wokeup and found a line
>  06/15/2016 02:24:38 PM [contrail-database-nodemgr]: 
> send_process_state_db_base: Sending UVE:NodeStatusUVE(_context='', 
> _scope='', _category='', _send_queue_enabled=True, _seqnum=0, 
> _versionsig=1642340850, _source='ccra-bng-5', _instance_id='0', 
> _client=None, _type=6, _hints=1, _http_server=None, _logger=None, 
> _more=False, _node_type='Database', data=NodeStatus(status=None, 
> name='ccra-bng-5', deleted=False, disk_usage_info=None, 
> build_info='{"build-info" : [{"build-version" : "3.0.2.0", 
> "build-time" : "2016-06-03 00:03:34.570952", "build-user" : 
> "contrail-builder", "build-hostname" : 
> "contrail-ec-build19.juniper.net", "build-id" : "3.0.2.0-47", 
> "build-number" : "47"}]}', system_mem_cpu_usage=None, 
> process_mem_cpu_usage=None, system_cpu_info=None, process_status=None, 
> all_core_file_list=None, _table='ObjectDatabaseInfo', 
> process_info=[ProcessInfo(process_name='contrail-database-nodemgr', 
> process_state='PROCESS_STATE_RUNNING', last_stop_time='', 
> start_count=1, core_file_list=[], last_start_time='1465980878089703', 
> stop_count=0, last_exit_time='', exit_count=0), 
> ProcessInfo(process_name='kafka', 
> process_state='PROCESS_STATE_STARTING', last_stop_time='', 
> start_count=0, core_file_list=[], last_start_time='', stop_count=0, 
> last_exit_time='', exit_count=0)], description=None), 
> _module='contrail-database-nodemgr', _level=2147483647, 
> _timestamp=1465980878089970, _client_context='', 
> _connect_to_collector=True, _role=0)
>  06/15/2016 02:24:38 PM [contrail-database-nodemgr]: Processing event[EvSandeshUVESend] in state[Idle]
>  06/15/2016 02:24:38 PM [contrail-database-nodemgr]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = ccra-bng-5  deleted = False  process_info = [ <<  process_name = contrail-database-nodemgr  process_state = PROCESS_STATE_RUNNING  start_count = 1  stop_count = 0  exit_count = 0  last_start_time = 1465980878089703  last_stop_time =   last_exit_time =   core_file_list = [  ]  >>, <<  process_name = kafka  process_state = PROCESS_STATE_STARTING  start_count = 0  stop_count = 0  exit_count = 0  last_start_time =   last_stop_time =   last_exit_time =   core_file_list = [  ]  >>,  ]  build_info = {"build-info" : [{"build-version" : "3.0.2.0", "build-time" : "2016-06-03 00:03:34.570952", "build-user" : "contrail-builder", "build-hostname" : "contrail-ec-build19.juniper.net", "build-id" : "3.0.2.0-47", "build-number" : "47"}]}  >>
>  06/15/2016 02:24:38 PM [contrail-database-nodemgr]: Discarding 
> event[EvSandeshUVESend] in state[Idle]  wokeup and found a line
>  06/15/2016 02:24:38 PM [contrail-database-nodemgr]: 
> send_process_state_db_base: Sending UVE:NodeStatusUVE(_context='', 
> _scope='', _category='', _send_queue_enabled=True, _seqnum=0, 
> _versionsig=1642340850, _source='ccra-bng-5', _instance_id='0', 
> _client=None, _type=6, _hints=1, _http_server=None, _logger=None, 
> _more=False, _node_type='Database', data=NodeStatus(status=None, 
> name='ccra-bng-5', deleted=False, disk_usage_info=None, 
> build_info='{"build-info" : [{"build-version" : "3.0.2.0", 
> "build-time" : "2016-06-03 00:03:34.570952", "build-user" : 
> "contrail-builder", "build-hostname" : 
> "contrail-ec-build19.juniper.net", "build-id" : "3.0.2.0-47", 
> "build-number" : "47"}]}', system_mem_cpu_usage=None, 
> process_mem_cpu_usage=None, system_cpu_info=None, process_status=None, 
> all_core_file_list=None, _table='ObjectDatabaseInfo', 
> process_info=[ProcessInfo(process_name='contrail-database-nodemgr', 
> process_state='PROCESS_STATE_RUNNING', last_stop_time='', 
> start_count=1, core_file_list=[], last_start_time='1465980878089703', 
> stop_count=0, last_exit_time='', exit_count=0), 
> ProcessInfo(process_name='kafka', 
> process_state='PROCESS_STATE_RUNNING', last_stop_time='', 
> start_count=1, core_file_list=[], last_start_time='1465980878091469', 
> stop_count=0, last_exit_time='', exit_count=0)], description=None), 
> _module='contrail-database-nodemgr', _level=2147483647, 
> _timestamp=1465980878091699, _client_context='', 
> _connect_to_collector=True, _role=0)
>  06/15/2016 02:24:38 PM [contrail-database-nodemgr]: Processing event[EvSandeshUVESend] in state[Idle]
>  06/15/2016 02:24:38 PM [contrail-database-nodemgr]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = ccra-bng-5  deleted = False  process_info = [ <<  process_name = contrail-database-nodemgr  process_state = PROCESS_STATE_RUNNING  start_count = 1  stop_count = 0  exit_count = 0  last_start_time = 1465980878089703  last_stop_time =   last_exit_time =   core_file_list = [  ]  >>, <<  process_name = kafka  process_state = PROCESS_STATE_RUNNING  start_count = 1  stop_count = 0  exit_count = 0  last_start_time = 1465980878091469  last_stop_time =   last_exit_time =   core_file_list = [  ]  >>,  ]  build_info = {"build-info" : [{"build-version" : "3.0.2.0", "build-time" : "2016-06-03 00:03:34.570952", "build-user" : "contrail-builder", "build-hostname" : "contrail-ec-build19.juniper.net", "build-id" : "3.0.2.0-47", "build-number" : "47"}]}  >>
>  06/15/2016 02:24:38 PM [contrail-database-nodemgr]: Discarding 
> event[EvSandeshUVESend] in state[Idle]
>  06/15/2016 02:24:42 PM [contrail-database-nodemgr]: Processing 
> event[EvIdleHoldTimerExpired] in state[Idle]
>  06/15/2016 02:24:42 PM [contrail-database-nodemgr]: Sandesh Client: 
> Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
>  06/15/2016 02:24:42 PM [contrail-database-nodemgr]: Processing 
> event[EvCollectorUnknown] in state[Connect]
>  06/15/2016 02:24:42 PM [contrail-database-nodemgr]: Sandesh Client: 
> Event[EvCollectorUnknown] => State[Connect] -> State[Disconnect]  
> wokeup and found a line  Exception AssertionError: AssertionError() in 
> <module 'threading' from '/usr/lib/python2.7/threading.pyc'> ignored  
> Exception AssertionError: AssertionError() in <module 'threading' from 
> '/usr/lib/python2.7/threading.pyc'> ignored  Exception AssertionError: 
> AssertionError() in <module 'threading' from 
> '/usr/lib/python2.7/threading.pyc'> ignored
>  06/15/2016 02:25:01 PM [contrail-database-nodemgr]: Processing 
> event[EvSandeshUVESend] in state[Disconnect]
>  06/15/2016 02:25:01 PM [contrail-database-nodemgr]: SANDESH: [DROP: 
> WrongClientSMState] DatabaseUsage: data = <<  name = ccra-bng-5  
> database_usage = [ <<  disk_space_used_1k = 4875432  
> disk_space_available_1k = 656873488  analytics_db_size_1k = 4  >>,  ]  
> >>
>  06/15/2016 02:25:01 PM [contrail-database-nodemgr]: Discarding 
> event[EvSandeshUVESend] in state[Disconnect]  Exception 
> AssertionError: AssertionError() in <module 'threading' from '/usr/lib/python2.7/threading.pyc'> ignored  Traceback (most recent call last):
>    File "/usr/lib/python2.7/dist-packages/gevent/greenlet.py", line 327, in run
>      result = self._run(*self.args, **self.kwargs)
>    File "/usr/lib/python2.7/dist-packages/nodemgr/database_nodemgr/database_event_manager.py", line 341, in runforever
>      self.database_periodic()
>    File "/usr/lib/python2.7/dist-packages/nodemgr/database_nodemgr/database_event_manager.py", line 246, in database_periodic
>      self.send_database_status()
>    File "/usr/lib/python2.7/dist-packages/nodemgr/database_nodemgr/database_event_manager.py", line 265, in send_database_status
>      self.get_pending_compaction_count(op)
>  AttributeError: 'NoneType' object has no attribute 'pending_compaction_tasks'
>  <Greenlet at 0x7f450a8ebe10: <bound method 
> DatabaseEventManager.runforever of 
> <nodemgr.database_nodemgr.database_event_manager.DatabaseEventManager 
> object at 0x7f450b42b110>>> failed with AttributeError
> 
>  root@ccra-bng-5:/var/log/contrail#
> 
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/opencontrail/+bug/1592764/+subscriptions