nova-network.log is absent in the diagnostic snapshot

[Dennis Dmitriev]

Cluster configuration: CentOS, nova-network, 1 controller, 1 compute

Example CI job: http://jenkins-product.srt.mirantis.net:8080/view/6.1/job/6.1.centos.smoke_nova/193/

On the compute node:
[root@node-2 ~]# ls -la /var/log/nova/
total 264
drwxr-x--- 2 nova nova 4096 Apr 4 04:54 .
drwxr-xr-x 12 root root 4096 Apr 4 04:53 ..
-rw-r--r-- 1 nova nova 59784 Apr 4 04:54 api.log
-rw-r--r-- 1 nova nova 165016 Apr 4 06:02 compute.log
-rw-r--r-- 1 nova nova 5336 Apr 4 04:54 network.log
-rw-r--r-- 1 root root 23940 Apr 4 04:54 nova-manage.log
[root@node-2 ~]#

But in the diagnostic snapshot:
$ ls -la ./10.109.25.2/var/log/docker-logs/remote/node-2.test.domain.local/nova*
-rw-r--r-- 1 dis dis 27818 апр 4 08:01 ./10.109.25.2/var/log/docker-logs/remote/node-2.test.domain.local/nova-api.log
-rw-r--r-- 1 dis dis 68252 апр 4 08:01 ./10.109.25.2/var/log/docker-logs/remote/node-2.test.domain.local/nova-compute.log
-rw-r--r-- 1 dis dis 14403 апр 4 08:01 ./10.109.25.2/var/log/docker-logs/remote/node-2.test.domain.local/nova-manage.log
$

[Stanislaw Bogatkin (sbogatkin)]

Cannot reproduce that on ISO #248.
I had installed CentOS, nova-network, 1 controller, 1 compute. After that on compute node I saw:
[root@node-2 ~]# ls -lah /var/log/nova/
total 28K
drwxr-x--- 2 nova nova 4.0K Apr 20 10:52 .
drwxr-xr-x 12 root root 4.0K Apr 20 10:51 ..
-rw-r--r-- 1 nova nova 813 Apr 20 10:52 api.log
-rw-r--r-- 1 nova nova 12K Apr 20 11:03 compute.log
-rw-r--r-- 1 nova nova 1.3K Apr 20 10:52 network.log
-rw-r--r-- 1 root root 0 Apr 20 10:52 nova-manage.log

On controller node:
[root@nailgun ~]# ls -lah /var/log/docker-logs/remote/node-2.test.domain.local/nova*
-rw-r----- 1 root adm 629 Apr 20 10:52 /var/log/docker-logs/remote/node-2.test.domain.local/nova-api.log
-rw-r----- 1 root adm 9.0K Apr 20 11:03 /var/log/docker-logs/remote/node-2.test.domain.local/nova-compute.log
-rw-r----- 1 root adm 816 Apr 20 10:52 /var/log/docker-logs/remote/node-2.test.domain.local/nova-network.log

(We can see that nova-manage isn't here. It happens cause it has zero size on compute and data from nova-manage was never sended to master.)

In diagnostic snapshot I can see all that files too. So, need more steps for reproduce. Marked as incomplete.

[Dennis Dmitriev (ddmitriev)]

Please check on environment with 3 controllers, or get a diagnostic snapshot from any HA job on CI, for example http://jenkins-product.srt.mirantis.net:8080/view/6.1_swarm/job/6.1.system_test.centos.ha_neutron/106/:

[root@nailgun ~]# ls -lah /var/log/docker-logs/remote/node-1.test.domain.local/nova*
-rw-r----- 1 root adm 8.4M Apr 30 14:50 /var/log/docker-logs/remote/node-1.test.domain.local/nova-api.log
-rw-r----- 1 root adm 242K Apr 30 14:49 /var/log/docker-logs/remote/node-1.test.domain.local/nova-cert.log
-rw-r----- 1 root adm 389K Apr 30 14:50 /var/log/docker-logs/remote/node-1.test.domain.local/nova-conductor.log
-rw-r----- 1 root adm 241K Apr 30 14:49 /var/log/docker-logs/remote/node-1.test.domain.local/nova-consoleauth.log
-rw-r----- 1 root adm 18K Apr 23 21:15 /var/log/docker-logs/remote/node-1.test.domain.local/nova-manage.log
-rw-r----- 1 root adm 1.8K Apr 30 11:56 /var/log/docker-logs/remote/node-1.test.domain.local/nova-novncproxy.log
-rw-r----- 1 root adm 42K Apr 30 11:56 /var/log/docker-logs/remote/node-1.test.domain.local/nova-objectstore.log
-rw-r----- 1 root adm 581K Apr 30 14:49 /var/log/docker-logs/remote/node-1.test.domain.local/nova-scheduler.log

[root@nailgun ~]# ls -lah /var/log/docker-logs/remote/node-2.test.domain.local/nova*
-rw-r----- 1 root adm 8.3M Apr 30 14:49 /var/log/docker-logs/remote/node-2.test.domain.local/nova-api.log
-rw-r----- 1 root adm 232K Apr 30 14:49 /var/log/docker-logs/remote/node-2.test.domain.local/nova-cert.log
-rw-r----- 1 root adm 324K Apr 30 14:48 /var/log/docker-logs/remote/node-2.test.domain.local/nova-conductor.log
-rw-r----- 1 root adm 221K Apr 30 14:48 /var/log/docker-logs/remote/node-2.test.domain.local/nova-consoleauth.log
-rw-r----- 1 root adm 14K Apr 23 21:49 /var/log/docker-logs/remote/node-2.test.domain.local/nova-manage.log
-rw-r----- 1 root adm 1.8K Apr 30 11:53 /var/log/docker-logs/remote/node-2.test.domain.local/nova-novncproxy.log
-rw-r----- 1 root adm 42K Apr 30 11:53 /var/log/docker-logs/remote/node-2.test.domain.local/nova-objectstore.log
-rw-r----- 1 root adm 539K Apr 30 14:48 /var/log/docker-logs/remote/node-2.test.domain.local/nova-scheduler.log

[root@nailgun ~]# ls -lah /var/log/docker-logs/remote/node-3.test.domain.local/nova*
-rw-r----- 1 root adm 8.8M Apr 30 14:50 /var/log/docker-logs/remote/node-3.test.domain.local/nova-api.log
-rw-r----- 1 root adm 282K Apr 30 14:50 /var/log/docker-logs/remote/node-3.test.domain.local/nova-cert.log
-rw-r----- 1 root adm 372K Apr 30 14:50 /var/log/docker-logs/remote/node-3.test.domain.local/nova-conductor.log
-rw-r----- 1 root adm 286K Apr 30 14:50 /var/log/docker-logs/remote/node-3.test.domain.local/nova-consoleauth.log
-rw-r----- 1 root adm 15K Apr 23 22:16 /var/log/docker-logs/remote/node-3.test.domain.local/nova-manage.log
-rw-r----- 1 root adm 1.8K Apr 30 11:22 /var/log/docker-logs/remote/node-3.test.domain.local/nova-novncproxy.log
-rw-r----- 1 root adm 62K Apr 30 11:35 /var/log/docker-logs/remote/node-3.test.domain.local/nova-objectstore.log
-rw-r----- 1 root adm 609K Apr 30 14:49 /var/log/docker-logs/remote/node-3.test.domain.local/nova-scheduler.log

[Dennis Dmitriev (ddmitriev)]

Sorry for wrong example link in #3.
Here is a nova-network based tests: http://jenkins-product.srt.mirantis.net:8080/view/6.1_swarm/job/6.1.system_test.ubuntu.thread_3/110/

[Dennis Dmitriev (ddmitriev)]

On compute nodes nova-network.log present on HA and one-controller configurations, this but actually invalid.