[systest] Tests for sending statistics fail: 'Command dockerctl shell nailgun grep -sw "ERROR" /var/log/nailgun/statsenderd.log returned exit code "2", but expected "1". Output: []; []'

[Artem Panchenko]

System test 'check_openstack_stat' fails while trying to force statistics sending, because '/var/log/nailgun/statsenderd.log' log file doesn't exist in Nailgun docker container:

Traceback (most recent call last):
  File "/usr/lib/python2.7/unittest/case.py", line 331, in run
    testMethod()
  File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
    self._testFunc()
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
    compatability.capture_type_error(s_func)
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
    func()
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
    func(test_case.state.get_state())
  File "/home/jenkins/workspace/8.0.system_test.ubuntu.thread_3/fuelweb_test/helpers/decorators.py", line 83, in wrapper
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/8.0.system_test.ubuntu.thread_3/fuelweb_test/tests/test_ceph.py", line 388, in check_openstack_stat
    self.env.nailgun_actions.force_fuel_stats_sending()
  File "/home/jenkins/workspace/8.0.system_test.ubuntu.thread_3/fuelweb_test/helpers/fuel_actions.py", line 487, in force_fuel_stats_sending
    self.execute_in_container(cmd, exit_code=1)
  File "/home/jenkins/workspace/8.0.system_test.ubuntu.thread_3/fuelweb_test/helpers/fuel_actions.py", line 81, in execute_in_container
    err=result['stderr']
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/asserts.py", line 55, in assert_equal
    raise ASSERTION_ERROR(message)
AssertionError: Command dockerctl shell nailgun grep -sw "ERROR" /var/log/nailgun/statsenderd.log returned exit code "2", but expected "1". Output: []; []

Previously that log file was managed by supervisord, but currently in CentOS7 systemd is used. So we need to investigate how to correctly check statsenderd status now and if possible get rid of logs parsing in tests.

[Artem Panchenko (apanchenko-8)]

Related bug #1523476 about missed log files. Lowering priority to medium, because fix for logging will also fix the test. But still need to investigate a possibility of removing logs parsing from tests (get service status using API, CLI commands, etc.).

[Alexander Kislitsky (akislitsky)]

Bug about missed log files is fixed. Now we have no docker on the master node. Bug as invalid now.