Activity log for bug #1844572

Date Who What changed Old value New value Message
2019-09-18 19:29:58 Chris Winnicki bug added bug
2019-09-18 19:29:58 Chris Winnicki attachment added ALL_NODES_20190918.182456.tar https://bugs.launchpad.net/bugs/1844572/+attachment/5289516/+files/ALL_NODES_20190918.182456.tar
2019-09-18 19:30:38 Chris Winnicki attachment added ansible.log https://bugs.launchpad.net/starlingx/+bug/1844572/+attachment/5289517/+files/ansible.log
2019-09-18 20:11:26 Ghada Khalil description Brief Description ----------------- openstack-barbican-api.service lost port binding to IPv6 interface Severity -------- Provide the severity of the defect. <Critical: System/Feature is not usable due to the defect> <Major: System/Feature is usable but degraded> <Minor: System/Feature is usable with minor issue> Steps to Reproduce ------------------ Install controller-0 Example of localhost.yml [sysadmin@controller-0 ~(keystone_admin)]$ cat localhost.yml system_mode: duplex dns_servers: - 2620:10a:a001:a103::2 management_subnet: fd00:204::/64 management_multicast_subnet: ff05::1b:0/124 cluster_host_subnet: fd00:205::/64 cluster_pod_subnet: fd00:206::/64 cluster_service_subnet: fd00:207::/112 external_oam_subnet: 2620:10a:a001:a103::6:0/64 external_oam_gateway_address: 2620:10a:a001:a103::6:0 external_oam_floating_address: 2620:10a:a001:a103::1237 external_oam_node_0_address: 2620:10a:a001:a103::1235 external_oam_node_1_address: 2620:10a:a001:a103::1236 admin_password: admin_password ansible_become_pass: admin_become_password pxeboot_subnet: 192.168.202.0/24 docker_http_proxy: http://yow-proxomatic.wrs.com:3128 docker_https_proxy: http://yow-proxomatic.wrs.com:3129 docker_no_proxy: - registry.local - tis-lab-registry.cumulus.wrs.com - tis-lab-docker-registry.cumulus.wrs.com ssl_ca_cert: /home/sysadmin/ca-cert.pem docker_registries: unified: url: tis-lab-docker-registry.cumulus.wrs.com username: username password: userpassword * run the ansible playbook (maybe required to run it more than once) ansible-playbook /usr/share/ansible/stx-ansible/playbooks/bootstrap/bootstrap.yml Expected Behavior ------------------ ansible-playbook should execute to completion without errors Actual Behavior ---------------- ansible-playbook failed with the following: 2019-09-17 18:19:40,952 p=138621 u=sysadmin | fatal: [localhost]: FAILED! => {"changed": true, "cmd": "source /etc/platform/openrc; openstack secret store -n k8s-registry-secret -p 'username:jerry password:jP@ssw0rd' -c 'Secret href' -f value", "delta": "0:00:02.852287", "end": "2019-09-17 18:19:40.931761", "msg": "non-zero return code", "rc": 1, "start": "2019-09-17 18:19:38.079474", "stderr": "Failed to contact the endpoint at http://[abcd:204::2]:9311 for discovery. Fallback to using that endpoint as the base url.\nUnable to establish connection to http://[abcd:204::2]:9311/secrets/: HTTPConnectionPool(host='abcd:204::2', port=9311): Max retries exceeded with url: /secrets/ (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fb26afe44d0>: Failed to establish a new connection: [Errno 111] Connection refused',))", "stderr_lines": ["Failed to contact the endpoint at http://[abcd:204::2]:9311 for discovery. Fallback to using that endpoint as the base url.", "Unable to establish connection to http://[abcd:204::2]:9311/secrets/: HTTPConnectionPool(host='abcd:204::2', port=9311): Max retries exceeded with url: /secrets/ (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fb26afe44d0>: Failed to establish a new connection: [Errno 111] Connection refused',))"], "stdout": "", "stdout_lines": []} 2019-09-17 18:19:40,953 p=138621 u=sysadmin | PLAY RECAP ************************************************************************************************************************************************************************* 2019-09-17 18:19:40,953 p=138621 u=sysadmin | localhost : ok=109 changed=28 unreachable=0 failed=1 Reproducibility --------------- 3 of 3 System Configuration -------------------- AIO-duplex Wind River Lab: yow-cgcs-wildcat-78_79 Branch/Pull Time/Commit ----------------------- 2019-09-16_20-00-00 Last Pass --------- 2019-09-03_20-00-00 Timestamp/Logs -------------- 2019-09-17 20:35:13 * Logs attached Test Activity ------------- System install Brief Description ----------------- openstack-barbican-api.service lost port binding to IPv6 interface after ansible playbook replay Severity -------- Major - images cannot be downloaded Steps to Reproduce ------------------ Install controller-0 Example of localhost.yml [sysadmin@controller-0 ~(keystone_admin)]$ cat localhost.yml system_mode: duplex dns_servers: - 2620:10a:a001:a103::2 management_subnet: fd00:204::/64 management_multicast_subnet: ff05::1b:0/124 cluster_host_subnet: fd00:205::/64 cluster_pod_subnet: fd00:206::/64 cluster_service_subnet: fd00:207::/112 external_oam_subnet: 2620:10a:a001:a103::6:0/64 external_oam_gateway_address: 2620:10a:a001:a103::6:0 external_oam_floating_address: 2620:10a:a001:a103::1237 external_oam_node_0_address: 2620:10a:a001:a103::1235 external_oam_node_1_address: 2620:10a:a001:a103::1236 admin_password: admin_password ansible_become_pass: admin_become_password pxeboot_subnet: 192.168.202.0/24 docker_http_proxy: http://yow-proxomatic.wrs.com:3128 docker_https_proxy: http://yow-proxomatic.wrs.com:3129 docker_no_proxy: - registry.local - tis-lab-registry.cumulus.wrs.com - tis-lab-docker-registry.cumulus.wrs.com ssl_ca_cert: /home/sysadmin/ca-cert.pem docker_registries:   unified:     url: tis-lab-docker-registry.cumulus.wrs.com     username: username     password: userpassword * run the ansible playbook (maybe required to run it more than once) ansible-playbook /usr/share/ansible/stx-ansible/playbooks/bootstrap/bootstrap.yml Expected Behavior ------------------ ansible-playbook should execute to completion without errors Actual Behavior ---------------- ansible-playbook failed with the following: 2019-09-17 18:19:40,952 p=138621 u=sysadmin | fatal: [localhost]: FAILED! => {"changed": true, "cmd": "source /etc/platform/openrc; openstack secret store -n k8s-registry-secret -p 'username:jerry password:jP@ssw0rd' -c 'Secret href' -f value", "delta": "0:00:02.852287", "end": "2019-09-17 18:19:40.931761", "msg": "non-zero return code", "rc": 1, "start": "2019-09-17 18:19:38.079474", "stderr": "Failed to contact the endpoint at http://[abcd:204::2]:9311 for discovery. Fallback to using that endpoint as the base url.\nUnable to establish connection to http://[abcd:204::2]:9311/secrets/: HTTPConnectionPool(host='abcd:204::2', port=9311): Max retries exceeded with url: /secrets/ (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fb26afe44d0>: Failed to establish a new connection: [Errno 111] Connection refused',))", "stderr_lines": ["Failed to contact the endpoint at http://[abcd:204::2]:9311 for discovery. Fallback to using that endpoint as the base url.", "Unable to establish connection to http://[abcd:204::2]:9311/secrets/: HTTPConnectionPool(host='abcd:204::2', port=9311): Max retries exceeded with url: /secrets/ (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fb26afe44d0>: Failed to establish a new connection: [Errno 111] Connection refused',))"], "stdout": "", "stdout_lines": []} 2019-09-17 18:19:40,953 p=138621 u=sysadmin | PLAY RECAP ************************************************************************************************************************************************************************* 2019-09-17 18:19:40,953 p=138621 u=sysadmin | localhost : ok=109 changed=28 unreachable=0 failed=1 Reproducibility --------------- seen once. not sure how reproducible the issue is. System Configuration -------------------- AIO-duplex Wind River Lab: yow-cgcs-wildcat-78_79 Branch/Pull Time/Commit ----------------------- 2019-09-16_20-00-00 Last Pass --------- 2019-09-03_20-00-00 Timestamp/Logs -------------- 2019-09-17 20:35:13 * Logs attached Test Activity ------------- System install
2019-09-18 20:11:47 Ghada Khalil bug added subscriber Bill Zvonar
2019-09-18 20:11:50 Ghada Khalil starlingx: importance Undecided Medium
2019-09-18 20:11:52 Ghada Khalil starlingx: status New Triaged
2019-09-18 20:12:05 Ghada Khalil starlingx: assignee Alex Kozyrev (akozyrev)
2019-09-18 20:12:17 Ghada Khalil tags stx.3.0 stx.containers
2019-09-24 21:01:58 OpenStack Infra starlingx: status Triaged In Progress
2019-10-02 14:42:02 OpenStack Infra starlingx: status In Progress Fix Released
2019-10-04 02:21:07 Yang Liu tags stx.3.0 stx.containers stx.3.0 stx.containers stx.retestneeded
2019-10-31 15:56:04 Chris Winnicki tags stx.3.0 stx.containers stx.retestneeded stx.3.0 stx.containers