latest kolla/ubuntu-binary-heka:3.0.0 container keep on restarting

[prameswar]

i build all-in-one kolla with master and deployed. while deployment every thing seems good. but when i did "docker ps -a " kolla/ubuntu-binary-heka:3.0.0 keep on restarting.

docker ps -a

54d441cb9dd6 kolla/ubuntu-binary-heka:3.0.0 "kolla_start" 26 minutes ago Restarting (1) 12 minutes ago heka

while deployment there was no error:

PLAY [senlin-api,senlin-engine] ************************************************

TASK [setup] *******************************************************************
ok: [localhost]

TASK [common : include] ********************************************************
skipping: [localhost]

TASK [common : Registering common role has run] ********************************
skipping: [localhost]

TASK [senlin : include] ********************************************************
skipping: [localhost]

PLAY RECAP *********************************************************************
localhost : ok=193 changed=23 unreachable=0 failed=0

[Sajauddin (sajauddin-mohammad)]

What are the specifications of RAM and cpu?
This issue is mainly faced incase of insufficient resources. You can increase the resource and try to redeploy

[Eduardo Gonzalez (egonzalez90)]

Paste "docker logs heka" output to see if any error is raised.

[prameswar (prameswar)]

System specification :
RAM : 8000 MB
cpu core : 2
created VM using virtualbox

Logs:

coplete Logs : http://paste.openstack.org/show/583416/

partial logs:

2016/09/29 07:09:42 Loading: [keystone_apache_logstreamer_input]
2016/09/29 07:09:42 Error making runner for keystone_apache_logstreamer_input: Initialization failed for 'keystone_apache_logstreamer_input': open /var/cache/hekad/logstreamer/keystone-apache-admin: permission denied :: open /var/cache/hekad/logstreamer/keystone-apache-public: permission denied
2016/09/29 07:09:42 Loading: [mariadb_logstreamer_input]
2016/09/29 07:09:42 Error making runner for mariadb_logstreamer_input: Initialization failed for 'mariadb_logstreamer_input': open /var/cache/hekad/logstreamer/mariadb: permission denied
2016/09/29 07:09:42 Loading: [openstack_logstreamer_input]
2016/09/29 07:09:42 Error making runner for openstack_logstreamer_input: Initialization failed for 'openstack_logstreamer_input': open /var/cache/hekad/logstreamer/glance_api: permission denied :: open /var/cache/hekad/logstreamer/glance_registry: permission denied :: open /var/cache/hekad/logstreamer/heat_heat-api-cfn: permission denied :: open /var/cache/hekad/logstreamer/keystone_keystone-apache-admin-error: permission denied :: open /var/cache/hekad/logstreamer/keystone_keystone-apache-public-access: permission denied :: open /var/cache/hekad/logstreamer/neutron_dnsmasq: permission denied :: open /var/cache/hekad/logstreamer/neutron_neutron-metadata-agent: permission denied :: open /var/cache/hekad/logstreamer/neutron_neutron-openvswitch-agent: permission denied :: open /var/cache/hekad/logstreamer/nova_nova-novncproxy: permission denied :: open /var/cache/hekad/logstreamer/heat_heat-engine: permission denied :: open /var/cache/hekad/logstreamer/keystone_keystone-apache-admin-access: permission denied :: open /var/cache/hekad/logstreamer/neutron_neutron-l3-agent: permission denied :: open /var/cache/hekad/logstreamer/nova_nova-compute: permission denied :: open /var/cache/hekad/logstreamer/nova_nova-consoleauth: permission denied :: open /var/cache/hekad/logstreamer/nova_nova-manage: permission denied :: open /var/cache/hekad/logstreamer/keystone_keystone-apache-public-error: permission denied :: open /var/cache/hekad/logstreamer/neutron_neutron-dhcp-agent: permission denied :: open /var/cache/hekad/logstreamer/neutron_neutron-server: permission denied :: open /var/cache/hekad/logstreamer/nova_nova-scheduler: permission denied :: open /var/cache/hekad/logstreamer/heat_heat-api: permission denied :: open /var/cache/hekad/logstreamer/keystone_keystone: permission denied :: open /var/cache/hekad/logstreamer/neutron_neutron-ns-metadata-proxy-feba65dd-60ac-4762-962c-b5271e3a090f: permission denied :: open /var/cache/hekad/logstreamer/nova_nova-api: permission denied :: open /var/cache/hekad/logstreamer/nova_nova-conductor: permission denied
2016/09/29 07:09:42 Loading: [rabbitmq_logstreamer_input]
2016/09/29 07:09:42 Error making runner for rabbitmq_logstreamer_input: Initialization failed for 'rabbitmq_logstreamer_input': open /var/cache/hekad/logstreamer/rabbit-sasl: permission denied :: open /var/cache/hekad/logstreamer/rabbit: per...

[Steven Dake (sdake)]

will deploy today and attempt to confirm. FWIW this would be a huge regression and needs to be fixed asap if such as it blocks all dev.

[Jeffrey Zhang (jeffrey4l)]

never saw such issue in CI.

could u clean all the image and try to build again?

[Steven Dake (sdake)]

I can't duplicate this either. The permission error you have indicates a docker failure of some sort. My guess is you have an OOM condition (dmesg will tell you as much) or a OOD condition. Docker poorly handles these two scenarios.

Leaving in incomplete. Can you test on a system with more ram please? 8gb may not be sufficient even though or docs state it as a minimum and the gate seems to run in 8gb. You may not have swap enabled on your system (however, the gate does).