Nodemgr inactive on docker ImportError

[wenqing liang]

In r5.0.0-144 newton,

contrail-control-nodemgr: inactive
contrail-config-nodemgr: inactive
contrail-analytics-nodemgr: inactive
contrail-database-nodemgr: inactive

Dec 21 22:14:51 server6 systemd[1]: Started "Contrail control nodemanager".
Dec 21 22:14:52 server6 contrail-nodemgr[6103]: Traceback (most recent call last):
Dec 21 22:14:52 server6 contrail-nodemgr[6103]: File "/usr/bin/contrail-nodemgr", line 9, in <module>
Dec 21 22:14:52 server6 contrail-nodemgr[6103]: load_entry_point('nodemgr==0.1.dev0', 'console_scripts', 'contrail-nodemgr')()
Dec 21 22:14:52 server6 contrail-nodemgr[6103]: File "/usr/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 565, in load_entry_point
Dec 21 22:14:52 server6 contrail-nodemgr[6103]: return get_distribution(dist).load_entry_point(group, name)
Dec 21 22:14:52 server6 contrail-nodemgr[6103]: File "/usr/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 2589, in load_entry_point
Dec 21 22:14:52 server6 contrail-nodemgr[6103]: return ep.load()
Dec 21 22:14:52 server6 contrail-nodemgr[6103]: File "/usr/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 2249, in load
Dec 21 22:14:52 server6 contrail-nodemgr[6103]: return self.resolve()
Dec 21 22:14:52 server6 contrail-nodemgr[6103]: File "/usr/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 2255, in resolve
Dec 21 22:14:52 server6 contrail-nodemgr[6103]: module = __import__(self.module_name, fromlist=['__name__'], level=0)
Dec 21 22:14:52 server6 contrail-nodemgr[6103]: File "/usr/lib/python2.7/dist-packages/nodemgr/main.py", line 50, in <module>
Dec 21 22:14:52 server6 contrail-nodemgr[6103]: from analytics_nodemgr.analytics_event_manager import AnalyticsEventManager
Dec 21 22:14:52 server6 contrail-nodemgr[6103]: File "/usr/lib/python2.7/dist-packages/gevent/builtins.py", line 93, in __import__
Dec 21 22:14:52 server6 contrail-nodemgr[6103]: result = _import(*args, **kwargs)
Dec 21 22:14:52 server6 contrail-nodemgr[6103]: File "/usr/lib/python2.7/dist-packages/nodemgr/analytics_nodemgr/analytics_event_manager.py", line 13, in <module>
Dec 21 22:14:52 server6 contrail-nodemgr[6103]: from nodemgr.common.event_manager import EventManager, EventManagerTypeInfo
Dec 21 22:14:52 server6 contrail-nodemgr[6103]: File "/usr/lib/python2.7/dist-packages/gevent/builtins.py", line 93, in __import__
Dec 21 22:14:52 server6 contrail-nodemgr[6103]: result = _import(*args, **kwargs)
Dec 21 22:14:52 server6 contrail-nodemgr[6103]: File "/usr/lib/python2.7/dist-packages/nodemgr/common/event_manager.py", line 46, in <module>
Dec 21 22:14:52 server6 contrail-nodemgr[6103]: from docker_process_manager import DockerProcessInfoManager
Dec 21 22:14:52 server6 contrail-nodemgr[6103]: File "/usr/lib/python2.7/dist-packages/gevent/builtins.py", line 93, in __import__
Dec 21 22:14:52 server6 contrail-nodemgr[6103]: result = _import(*args, **kwargs)
Dec 21 22:14:52 server6 contrail-nodemgr[6103]: File "/usr/lib/python2.7/dist-packages/nodemgr/common/docker_process_manager.py", line 5, in <module>
Dec 21 22:14:52 server6 contrail-nodemgr[6103]: import docker
Dec 21 22:14:52 server6 contrail-nodemgr[6103]: File "/usr/lib/python2.7/dist-packages/gevent/builtins.py", line 93, in __import__
Dec 21 22:14:52 server6 contrail-nodemgr[6103]: result = _import(*args, **kwargs)
Dec 21 22:14:52 server6 contrail-nodemgr[6103]: ImportError: No module named docker
Dec 21 22:14:52 server6 systemd[1]: contrail-control-nodemgr.service: Main process exited, code=exited, status=1/FAILURE
Dec 21 22:14:52 server6 systemd[1]: contrail-control-nodemgr.service: Unit entered failed state.
Dec 21 22:14:52 server6 systemd[1]: contrail-control-nodemgr.service: Failed with result 'exit-code'.
Dec 21 22:14:52 server6 systemd[1]: contrail-control-nodemgr.service: Service hold-off time over, scheduling restart.
Dec 21 22:14:52 server6 systemd[1]: Stopped "Contrail control nodemanager".
Dec 21 22:14:52 server6 systemd[1]: Started "Contrail control nodemanager".
Dec 21 22:14:52 server6 contrail-nodemgr[6147]: Traceback (most recent call last):
Dec 21 22:14:52 server6 contrail-nodemgr[6147]: File "/usr/bin/contrail-nodemgr", line 9, in <module>
Dec 21 22:14:52 server6 contrail-nodemgr[6147]: load_entry_point('nodemgr==0.1.dev0', 'console_scripts', 'contrail-nodemgr')()
Dec 21 22:14:52 server6 contrail-nodemgr[6147]: File "/usr/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 565, in load_entry_point
Dec 21 22:14:52 server6 contrail-nodemgr[6147]: return get_distribution(dist).load_entry_point(group, name)
Dec 21 22:14:52 server6 contrail-nodemgr[6147]: File "/usr/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 2589, in load_entry_point

[Andrey Pavlov (apavlov-e)]

please add deployment/environment details

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/38551
Submitter: Andrey Pavlov (<email address hidden>)

[Jeba Paulaiyan (jebap)]

Environment:

Ubuntu16 / Newton
CB 5.0.0-145
Provisioned with SM

Here are the setup details:
+--------------------------------------+------------------+---------------------+--------------------------------------+
| id | fixed_ip_address | floating_ip_address | port_id |
+--------------------------------------+------------------+---------------------+--------------------------------------+
| 20390c71-7950-4652-ab5a-87edd7c618c6 | 10.0.0.9 | 10.87.118.53 | 7558686c-f7b3-4233-aa43-9ad437803008 |
| 83bb3583-0afd-4a37-af28-b2b8d40986a8 | 10.0.0.8 | 10.87.118.49 | 0358d6a6-bf31-4b33-8f12-b0e165ee39e6 |
| 6dfd04c0-a4e8-4632-9134-4fdfc4c737f4 | 10.0.0.10 | 10.87.118.37 | dcb68fad-a48e-446c-9837-619c4856d4a3 |
| 73bc70ab-8cb4-43d0-bbe1-524ebb6e2f34 | 10.0.0.11 | 10.87.118.35 | 6f4e0069-0cc0-475d-bedd-c7ef375fc251 |
| dc37a88a-7c43-4481-b693-8347c770886b | 10.0.0.4 | 10.87.118.51 | 90226f81-d2ba-4256-a408-f5e1ccf09f6f |
| 3997d4f5-0b18-44ae-b3c8-dd156bfd7fa1 | 10.0.0.13 | 10.87.118.42 | e897aaaf-1898-40d4-987b-3074d249803e |
| 10d39ba4-0c80-4613-9946-58296ceb28fd | 10.0.0.12 | 10.87.118.50 | 2e612724-472d-41c3-b4c4-e885529bcb7c |
| b91ecec8-6b9e-4397-bdb6-d404c25b4388 | 10.0.0.5 | 10.87.118.36 | 9f5c4fa6-267a-4f2d-8168-940756eea88c |
| 4a936fac-c07b-4cd4-8524-4683ead6345a | 10.0.0.6 | 10.87.118.52 | fd665710-95a2-4e70-8285-243005a65b89 |
| 6263b79e-6c60-4082-8c03-acaf3e1d4be4 | 10.0.0.14 | 10.87.118.41 | ae249fe7-88b2-48c7-a4a5-760160237427 |
| 633e3d66-42e9-4f96-a55a-ef0662da89d7 | 10.0.0.7 | 10.87.118.40 | e948a3d6-1dcf-47b2-8619-35a336005e8a |
+--------------------------------------+------------------+---------------------+--------------------------------------+

Server-manager: 10.87.118.41

root@servermanager:~# server-manager display server --select id,ip_address,roles
+----------+------------+--------------------------------------------------------------------------+
| id | ip_address | roles |
+----------+------------+--------------------------------------------------------------------------+
| server4 | 10.0.0.7 | [u'contrail-controller', u'contrail-analytics', u'contrail-analyticsdb'] |
| server10 | 10.0.0.13 | [u'contrail-compute'] |
| server5 | 10.0.0.8 | [u'contrail-controller', u'contrail-analytics', u'contrail-analyticsdb'] |
| server1 | 10.0.0.4 | [u'openstack'] |
| server6 | 10.0.0.9 | [u'contrail-controller', u'contrail-analytics', u'contrail-analyticsdb'] |
| server3 | 10.0.0.6 | [u'openstack'] |
| server7 | 10.0.0.10 | [u'contrail-lb'] |
| server8 | 10.0.0.11 | [u'contrail-compute'] |
| server2 | 10.0.0.5 | [u'opensta...

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/38551
Submitter: Andrey Pavlov (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/38551
Committed: http://github.com/Juniper/contrail-controller/commit/70ab8e4a1fe49890978b85f4b98a00fd5950cdc5
Submitter: Zuul (<email address hidden>)
Branch: master

commit 70ab8e4a1fe49890978b85f4b98a00fd5950cdc5
Author: Andrey Pavlov <email address hidden>
Date: Wed Dec 27 12:18:31 2017 +0300

nodemgr: fix nodemgr loading for 'fat' containers

- import 'docker' plugin in place
- fix using old psutil library

Change-Id: Ib4c774700e9de51c3be78c03b627a1881a10906c
Closes-Bug: #1739822