trove install fails

Bug #1738529 reported by Gheorghe Ungureanu
14
This bug affects 3 people
Affects Status Importance Assigned to Milestone
OpenStack-Ansible
Fix Released
Medium
kourosh vivan

Bug Description

When I try to install trove, it tries to connect to neutron on the public endpoint IP and the request gets refused:

TASK [os_trove : Get trove service net id] ************************************************************************************************************************************************************************
task path: /etc/ansible/roles/os_trove/tasks/trove_service_network.yml:67
Saturday 16 December 2017 02:59:05 +0200 (0:00:00.013) 0:00:54.221 *****
container_name: "osa-controller_trove_taskmanager_container-46fb1e24"
physical_host: "osa-controller"
Container confirmed
Using module file /opt/ansible-runtime/local/lib/python2.7/site-packages/ansible/modules/cloud/openstack/os_networks_facts.py
container_name: "osa-controller_trove_taskmanager_container-46fb1e24"
physical_host: "osa-controller"
Container confirmed
<172.29.236.11> ESTABLISH SSH CONNECTION FOR USER: root
<172.29.236.11> SSH: EXEC ssh -vvv -C -o ControlMaster=auto -o ControlPersist=60s -o StrictHostKeyChecking=no -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o User=root -o ConnectTimeout=5 -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o ServerAliveInterval=64 -o ServerAliveCountMax=1024 -o Compression=no -o TCPKeepAlive=yes -o VerifyHostKeyDNS=no -o ForwardX11=no -o ForwardAgent=yes -T -o ControlPath=/root/.ansible/cp/91b96b3250 172.29.236.11 'lxc-attach --clear-env --name osa-controller_trove_taskmanager_container-46fb1e24 -- su - root -c '"'"'/bin/sh -c '"'"'"'"'"'"'"'"'/usr/bin/python && sleep 0'"'"'"'"'"'"'"'"''"'"''
<172.29.236.11> (1, '', 'OpenSSH_7.2p2 Ubuntu-4ubuntu2.2, OpenSSL 1.0.2g 1 Mar 2016\r\ndebug1: Reading configuration data /etc/ssh/ssh_config\r\ndebug1: /etc/ssh/ssh_config line 19: Applying options for *\r\ndebug1: auto-mux: Trying existing master\r\ndebug2: fd 3 setting O_NONBLOCK\r\ndebug2: mux_client_hello_exchange: master version 4\r\ndebug3: mux_client_forwards: request forwardings: 0 local, 0 remote\r\ndebug3: mux_client_request_session: entering\r\ndebug3: mux_client_request_alive: entering\r\ndebug3: mux_client_request_alive: done pid = 22923\r\ndebug3: mux_client_request_session: session request sent\r\ndebug1: mux_client_request_session: master session id: 2\r\nmesg: ttyname failed: Inappropriate ioctl for device\nTraceback (most recent call last):\n File "/tmp/ansible_XpAWxr/ansible_module_os_networks_facts.py", line 160, in <module>\n main()\n File "/tmp/ansible_XpAWxr/ansible_module_os_networks_facts.py", line 149, in main\n module.params[\'filters\'])\n File "/usr/local/lib/python2.7/dist-packages/shade/openstackcloud.py", line 1463, in search_networks\n networks = self.list_networks(filters)\n File "/usr/local/lib/python2.7/dist-packages/shade/openstackcloud.py", line 1628, in list_networks\n data = self._network_client.get("/networks.json", params=filters)\n File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/adapter.py", line 288, in get\n return self.request(url, \'GET\', **kwargs)\n File "/usr/local/lib/python2.7/dist-packages/shade/_adapter.py", line 197, in request\n response = self.manager.submit_task(RequestTask(**kwargs))\n File "/usr/local/lib/python2.7/dist-packages/shade/task_manager.py", line 260, in submit_task\n return self.run_task(task=task, raw=raw)\n File "/usr/local/lib/python2.7/dist-packages/shade/task_manager.py", line 271, in run_task\n return self._run_task(task, raw=raw)\n File "/usr/local/lib/python2.7/dist-packages/shade/task_manager.py", line 285, in _run_task\n return task.wait(raw)\n File "/usr/local/lib/python2.7/dist-packages/shade/task_manager.py", line 99, in wait\n self._traceback)\n File "/usr/local/lib/python2.7/dist-packages/shade/task_manager.py", line 128, in run\n self.done(self.main(client))\n File "/usr/local/lib/python2.7/dist-packages/shade/_adapter.py", line 195, in main\n return request_method(**self.args)\n File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/adapter.py", line 192, in request\n return self.session.request(url, method, **kwargs)\n File "/usr/local/lib/python2.7/dist-packages/positional/__init__.py", line 108, in inner\n return wrapped(*args, **kwargs)\n File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py", line 703, in request\n resp = send(**kwargs)\n File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py", line 777, in _send_request\n raise exceptions.ConnectFailure(msg)\nkeystoneauth1.exceptions.connection.ConnectFailure: Unable to establish connection to http://192.168.122.11:9696/v2.0/networks.json: (\'Connection aborted.\', BadStatusLine("\'\'",))\ndebug3: mux_client_read_packet: read header failed: Broken pipe\r\ndebug2: Received exit status from master 1\r\n')
fatal: [osa-controller_trove_taskmanager_container-46fb1e24]: FAILED! => {
    "changed": false,
    "failed": true,
    "module_stderr": "OpenSSH_7.2p2 Ubuntu-4ubuntu2.2, OpenSSL 1.0.2g 1 Mar 2016\r\ndebug1: Reading configuration data /etc/ssh/ssh_config\r\ndebug1: /etc/ssh/ssh_config line 19: Applying options for *\r\ndebug1: auto-mux: Trying existing master\r\ndebug2: fd 3 setting O_NONBLOCK\r\ndebug2: mux_client_hello_exchange: master version 4\r\ndebug3: mux_client_forwards: request forwardings: 0 local, 0 remote\r\ndebug3: mux_client_request_session: entering\r\ndebug3: mux_client_request_alive: entering\r\ndebug3: mux_client_request_alive: done pid = 22923\r\ndebug3: mux_client_request_session: session request sent\r\ndebug1: mux_client_request_session: master session id: 2\r\nmesg: ttyname failed: Inappropriate ioctl for device\nTraceback (most recent call last):\n File \"/tmp/ansible_XpAWxr/ansible_module_os_networks_facts.py\", line 160, in <module>\n main()\n File \"/tmp/ansible_XpAWxr/ansible_module_os_networks_facts.py\", line 149, in main\n module.params['filters'])\n File \"/usr/local/lib/python2.7/dist-packages/shade/openstackcloud.py\", line 1463, in search_networks\n networks = self.list_networks(filters)\n File \"/usr/local/lib/python2.7/dist-packages/shade/openstackcloud.py\", line 1628, in list_networks\n data = self._network_client.get(\"/networks.json\", params=filters)\n File \"/usr/local/lib/python2.7/dist-packages/keystoneauth1/adapter.py\", line 288, in get\n return self.request(url, 'GET', **kwargs)\n File \"/usr/local/lib/python2.7/dist-packages/shade/_adapter.py\", line 197, in request\n response = self.manager.submit_task(RequestTask(**kwargs))\n File \"/usr/local/lib/python2.7/dist-packages/shade/task_manager.py\", line 260, in submit_task\n return self.run_task(task=task, raw=raw)\n File \"/usr/local/lib/python2.7/dist-packages/shade/task_manager.py\", line 271, in run_task\n return self._run_task(task, raw=raw)\n File \"/usr/local/lib/python2.7/dist-packages/shade/task_manager.py\", line 285, in _run_task\n return task.wait(raw)\n File \"/usr/local/lib/python2.7/dist-packages/shade/task_manager.py\", line 99, in wait\n self._traceback)\n File \"/usr/local/lib/python2.7/dist-packages/shade/task_manager.py\", line 128, in run\n self.done(self.main(client))\n File \"/usr/local/lib/python2.7/dist-packages/shade/_adapter.py\", line 195, in main\n return request_method(**self.args)\n File \"/usr/local/lib/python2.7/dist-packages/keystoneauth1/adapter.py\", line 192, in request\n return self.session.request(url, method, **kwargs)\n File \"/usr/local/lib/python2.7/dist-packages/positional/__init__.py\", line 108, in inner\n return wrapped(*args, **kwargs)\n File \"/usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py\", line 703, in request\n resp = send(**kwargs)\n File \"/usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py\", line 777, in _send_request\n raise exceptions.ConnectFailure(msg)\nkeystoneauth1.exceptions.connection.ConnectFailure: Unable to establish connection to http://192.168.122.11:9696/v2.0/networks.json: ('Connection aborted.', BadStatusLine(\"''\",))\ndebug3: mux_client_read_packet: read header failed: Broken pipe\r\ndebug2: Received exit status from master 1\r\n",
    "module_stdout": "",
    "msg": "MODULE FAILURE",
    "rc": 1
}

Revision history for this message
Gheorghe Ungureanu (gunix) wrote :

Sorry, guys, I totally ignored this:
https://docs.openstack.org/openstack-ansible-os_trove/pike/configure-trove.html

bug can be closed atm.

Revision history for this message
Gheorghe Ungureanu (gunix) wrote :
Download full text (3.5 KiB)

I take my last comment back. I went through configuring networks and adding dbaas and also adding a flat network from openstack, and I still get the following error:

fatal: [osa-controller_trove_taskmanager_container-e4ad8003]: FAILED! => {
    "changed": false,
    "failed": true,
    "module_stderr": "OpenSSH_7.2p2 Ubuntu-4ubuntu2.2, OpenSSL 1.0.2g 1 Mar 2016\r\ndebug1: Reading configuration data /etc/ssh/ssh_config\r\ndebug1: /etc/ssh/ssh_config line 19: Applying options for *\r\ndebug1: auto-mux: Trying existing master\r\ndebug2: fd 3 setting O_NONBLOCK\r\ndebug2: mux_client_hello_exchange: master version 4\r\ndebug3: mux_client_forwards: request forwardings: 0 local, 0 remote\r\ndebug3: mux_client_request_session: entering\r\ndebug3: mux_client_request_alive: entering\r\ndebug3: mux_client_request_alive: done pid = 27277\r\ndebug3: mux_client_request_session: session request sent\r\ndebug1: mux_client_request_session: master session id: 2\r\nmesg: ttyname failed: Inappropriate ioctl for device\nTraceback (most recent call last):\n File \"/tmp/ansible_ANrlP0/ansible_module_os_networks_facts.py\", line 160, in <module>\n main()\n File \"/tmp/ansible_ANrlP0/ansible_module_os_networks_facts.py\", line 149, in main\n module.params['filters'])\n File \"/usr/local/lib/python2.7/dist-packages/shade/openstackcloud.py\", line 1463, in search_networks\n networks = self.list_networks(filters)\n File \"/usr/local/lib/python2.7/dist-packages/shade/openstackcloud.py\", line 1628, in list_networks\n data = self._network_client.get(\"/networks.json\", params=filters)\n File \"/usr/local/lib/python2.7/dist-packages/keystoneauth1/adapter.py\", line 288, in get\n return self.request(url, 'GET', **kwargs)\n File \"/usr/local/lib/python2.7/dist-packages/shade/_adapter.py\", line 197, in request\n response = self.manager.submit_task(RequestTask(**kwargs))\n File \"/usr/local/lib/python2.7/dist-packages/shade/task_manager.py\", line 260, in submit_task\n return self.run_task(task=task, raw=raw)\n File \"/usr/local/lib/python2.7/dist-packages/shade/task_manager.py\", line 271, in run_task\n return self._run_task(task, raw=raw)\n File \"/usr/local/lib/python2.7/dist-packages/shade/task_manager.py\", line 285, in _run_task\n return task.wait(raw)\n File \"/usr/local/lib/python2.7/dist-packages/shade/task_manager.py\", line 99, in wait\n self._traceback)\n File \"/usr/local/lib/python2.7/dist-packages/shade/task_manager.py\", line 128, in run\n self.done(self.main(client))\n File \"/usr/local/lib/python2.7/dist-packages/shade/_adapter.py\", line 195, in main\n return request_method(**self.args)\n File \"/usr/local/lib/python2.7/dist-packages/keystoneauth1/adapter.py\", line 192, in request\n return self.session.request(url, method, **kwargs)\n File \"/usr/local/lib/python2.7/dist-packages/positional/__init__.py\", line 108, in inner\n return wrapped(*args, **kwargs)\n File \"/usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py\", line 703, in request\n resp = send(**kwargs)\n File \"/usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py\", line 777, in _send_request\n raise exce...

Read more...

Revision history for this message
Ondrej Vasko (lirt) wrote :

My installation also fails on the same step (os_trove : Get trove service net id) but in my case I see that it uses `external_vip_address` instead of `internal` for endpoint (as IP address above http://192.168.122.11:9696...) which is not reachable in my case.

I'm wondering if that is not the case in example above. It seems that this step is somehow not using config from ~/.config/openstack/clouds.yaml or that ansible module works differently.

I am using Ubuntu 16.04 and stable pike OSA release 16.0.5

Changed in openstack-ansible:
status: New → Confirmed
importance: Undecided → Medium
Revision history for this message
Dario Zanzico (dario.zanzico) wrote :

I got it to work by adding
endpoint_type: "{{ trove_service_net_endpoint_type }}"
to the task:

- name: Get trove service net id
  os_networks_facts:
    cloud: default
    validate_certs: "{{ trove_service_net_validate_certs }}"
    wait: yes
    name: "{{ trove_service_net_name }}"
    endpoint_type: "{{ trove_service_net_endpoint_type }}"
  run_once: true
  when: not trove_developer_mode | bool

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to openstack-ansible-os_trove (master)

Fix proposed to branch: master
Review: https://review.opendev.org/694077

Changed in openstack-ansible:
assignee: nobody → kourosh vivan (kourosh-vivan)
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to openstack-ansible-os_trove (master)

Reviewed: https://review.opendev.org/694077
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-os_trove/commit/?id=04aa9a527ab50b6370db2a26459c355d55d67d3c
Submitter: Zuul
Branch: master

commit 04aa9a527ab50b6370db2a26459c355d55d67d3c
Author: Kourosh Vivan <email address hidden>
Date: Wed Nov 13 15:00:39 2019 +0100

    Fix keystone API call

    API call should use trove_service_net_endpoint_type

    Change-Id: Ib25705c08787164d2f070cc4acbdc0837bc30c8b
    Close-bug: #1738529

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to openstack-ansible-os_trove (stable/train)

Fix proposed to branch: stable/train
Review: https://review.opendev.org/695447

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to openstack-ansible-os_trove (stable/stein)

Fix proposed to branch: stable/stein
Review: https://review.opendev.org/695448

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to openstack-ansible-os_trove (stable/stein)

Reviewed: https://review.opendev.org/695448
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-os_trove/commit/?id=d9fed6ebe0c376d0420fa666403b4731af4a6de2
Submitter: Zuul
Branch: stable/stein

commit d9fed6ebe0c376d0420fa666403b4731af4a6de2
Author: Kourosh Vivan <email address hidden>
Date: Wed Nov 13 15:00:39 2019 +0100

    Fix keystone API call

    API call should use trove_service_net_endpoint_type

    Change-Id: Ib25705c08787164d2f070cc4acbdc0837bc30c8b
    Close-bug: #1738529
    (cherry picked from commit 04aa9a527ab50b6370db2a26459c355d55d67d3c)

tags: added: in-stable-stein
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to openstack-ansible-os_trove (stable/train)

Reviewed: https://review.opendev.org/695447
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-os_trove/commit/?id=8330de8cb6163d9ef2250f3855c87cebc3d621ed
Submitter: Zuul
Branch: stable/train

commit 8330de8cb6163d9ef2250f3855c87cebc3d621ed
Author: Kourosh Vivan <email address hidden>
Date: Wed Nov 13 15:00:39 2019 +0100

    Fix keystone API call

    API call should use trove_service_net_endpoint_type

    Change-Id: Ib25705c08787164d2f070cc4acbdc0837bc30c8b
    Close-bug: #1738529
    (cherry picked from commit 04aa9a527ab50b6370db2a26459c355d55d67d3c)

tags: added: in-stable-train
Changed in openstack-ansible:
status: In Progress → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.