Kolla cli deploy fails with error Keystone: keystone : Creating Keystone database, Status: failed, Message: unable to find /home/ansible/.my.cnf.

Bug #1699866 reported by Ankit Pahwa
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
kolla
Expired
Undecided
Unassigned

Bug Description

Hi

While i am trying to deploy kolla on control node
I get the below error, where 10.10.10.254 is my kolla_external_vip_address and is an internally generated one.

TASK [keystone : Creating Keystone database] ***********************************
fatal: [controlnode1.oracle.com]: FAILED! => {"stdout": "localhost | FAILED! => {\r\n \"changed\": false, \r\n \"failed\": true, \r\n \"msg\": \"unable to find /home/ansible/.my.cnf. Exception message: (2003, \\\"Can't connect to MySQL server on '10.10.10.254' (4)\\\")\"\r\n}", "cmd": ["docker", "exec", "-t", "kolla_toolbox", "/usr/bin/ansible", "localhost", "-m", "mysql_db", "-a", "login_host='10.10.10.254' login_port='3306' login_user='root' login_password='<usingmine>' name='keystone'"], "end": "2017-06-22 10:50:52.921982", "_ansible_no_log": false, "_ansible_delegated_vars": {"ansible_host": "controlnode1.oracle.com"}, "changed": false, "rc": 1, "start": "2017-06-22 10:50:21.688188", "stderr": "", "delta": "0:00:31.233794", "invocation": {"module_name": "command", "module_args": {"warn": true, "executable": null, "_uses_shell": false, "_raw_params": "docker exec -t kolla_toolbox /usr/bin/ansible localhost -m mysql_db -a \"login_host='10.10.10.254' login_port='3306' login_user='root' login_password='' name='keystone'\"", "removes": null, "creates": null, "chdir": null}}, "stdout_lines": ["localhost | FAILED! => {", " \"changed\": false, ", " \"failed\": true, ", " \"msg\": \"unable to find /home/ansible/.my.cnf. Exception message: (2003, \\\"Can't connect to MySQL server on '10.10.10.254' (4)\\\")\"", "}"], "failed_when_result": true, "warnings": [], "failed": true}

PLAY RECAP *********************************************************************
controlnode1.oracle.com : ok=45 changed=1 unreachable=0 failed=1 ignored=0
10.196.146.93 : ok=32 changed=1 unreachable=0 failed=0 ignored=0
10.196.146.94 : ok=32 changed=1 unreachable=0 failed=0 ignored=0
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/kollacli/commands/deploy.py", line 103, in take_action
    .format(msg=job.get_error_message()))
CommandError: ERROR: Job failed:
Host: controlnode1.oracle.com, Task: keystone : Creating Keystone database, Status: failed, Message: unable to find /home/ansible/.my.cnf. Exception message: (2003, \

any pointer in this regard would really help
Thanks

summary: - Kollacli deploy fails with error Keystone: keystone : Creating Keystone
+ Kolla cli deploy fails with error Keystone: keystone : Creating Keystone
database, Status: failed, Message: unable to find /home/ansible/.my.cnf.
Revision history for this message
Surya Prakash Singh (confisurya) wrote :

@Ankit what version of docker and ansible using in current environment ?
At the first level I see two possibility one is whether ansible installed or not on controller node and second is version compatibility with docker.

Will you please provide more information for better investigation.

Revision history for this message
Ankit Pahwa (raunitankit) wrote :

thanks for your response Surya
Here are the details
docker version
Client:
 Version: 1.12.6
 API version: 1.24
 Go version: go1.6.4
 Git commit: ac13b2b
 Built: Wed Mar 22 02:52:47 2017
 OS/Arch: linux/amd64

Server:
 Version: 1.12.6
 API version: 1.24
 Go version: go1.6.4
 Git commit: ac13b2b
 Built: Wed Mar 22 02:52:47 2017
 OS/Arch: linux/amd64

ansible
ansible 2.1.0.0
  config file = /etc/ansible/ansible.cfg
  configured module search path = Default w/o overrides

Revision history for this message
Ankit Pahwa (raunitankit) wrote :

Hi There
I just did an upgrade on my linux on all the machines: controlnode, and two target nodes or compute nodes
and now I am not able to start the heka container.
the heka image exists and also was pulled by both the compute nodes(one of them is shown below)
The error is just

Starting heka container, Status: failed, Message: The requested image does not exist: controlnode1:5443/oracle/ol-openstack-heka:3.0.1

output of docker ps on controlnode:

[root@controlnode1 ~]# docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
2e8d5f067ac0 controlnode1:5443/openstack/ol-openstack-iscsid:3.0.1 "kolla_start" 7 days ago Up 6 minutes iscsid
c4936894c349 controlnode1:5443/openstack/ol-openstack-cron:3.0.1 "kolla_start" 2 weeks ago Up 6 minutes cron
36e7e4694fde controlnode1:5443/openstack/ol-openstack-kolla-toolbox:3.0.1 "/bin/sleep infinity" 2 weeks ago Up 6 minutes kolla_toolbox
8b10f3185ff8 controlnode1:5443/openstack/ol-openstack-heka:3.0.1 "kolla_start" 2 weeks ago Up 6 minutes heka
[root@controlnode1 ~]#

output of docker ps on compute node:

[root@barcelona ~]# docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
5d4b47e250bb controlnode1:5443/openstack/ol-openstack-multipathd:3.0.1 "kolla_start" 7 days ago Up 7 minutes multipathd
20675087d463 controlnode1:5443/openstack/ol-openstack-iscsid:3.0.1 "kolla_start" 7 days ago Up 7 minutes iscsid
9cfc7fc9c322 controlnode1:5443/openstack/ol-openstack-cron:3.0.1 "kolla_start" 7 days ago Up 7 minutes cron
709d16bdb1e6 controlnode1:5443/openstack/ol-openstack-kolla-toolbox:3.0.1 "/bin/sleep infinity" 7 days ago Up 7 minutes kolla_toolbox
bc79b7877ce3 controlnode1:5443/openstack/ol-openstack-heka:3.0.1 "kolla_start" 7 days ago Up 7 minutes heka
[root@barcelona ~]#

any pointers in this regard are highly appreciated

Revision history for this message
Surya Prakash Singh (confisurya) wrote :

@Ankit Still looking into your 1st issue.

But for the current issue in logging, Heka is deprecated and is replaced with Fluentd.

Please read https://docs.openstack.org/releasenotes/kolla-ansible/ocata.html#upgrade-notes

Revision history for this message
Surya Prakash Singh (confisurya) wrote :

but still It seems that there is some issue w.r.t Heka and upgrade, investigating the same.

Revision history for this message
Ankit Pahwa (raunitankit) wrote :

Thanks Surya!
Appreciate your help in this regards.

Can you help me with how can i get the "Fluentd" image as the package that i use is the local docker registry installation after downloading the package and that package does'nt seem to have this image.
I downloaded the latest openstack from
https://edelivery.oracle.com/

[root@controlnode1 ~]# docker images | grep Fluentd
[root@controlnode1 ~]#

Revision history for this message
Ankit Pahwa (raunitankit) wrote :

Anything on this?

Revision history for this message
Surya Prakash Singh (confisurya) wrote :

Hi Ankit,

actually i didn't use this way, sorry may be somebody else can help into this.

Revision history for this message
Michal Nasiadka (mnasiadka) wrote :

Is it still a bug? If yes - please update.

Changed in kolla:
status: New → Incomplete
Revision history for this message
Launchpad Janitor (janitor) wrote :

[Expired for kolla because there has been no activity for 60 days.]

Changed in kolla:
status: Incomplete → Expired
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.