fs053: Bad admin creds while checking rally deployment

[Rafael Folco]

2019-05-10 12:20:32.384261 | primary | Error while checking admin credentials:
2019-05-10 12:20:32.384374 | primary | TypeError: Bad admin creds:

http://logs.rdoproject.org/81/658081/1/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053/a562522/job-output.txt.gz

https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053

2019-05-10 12:20:28.344632 | primary | TASK [browbeat/rally : Check Rally deployment] *********************************
2019-05-10 12:20:28.362341 | primary | Friday 10 May 2019 12:20:28 +0000 (0:00:04.097) 0:04:40.439 ************
2019-05-10 12:20:32.382075 | primary | fatal: [undercloud]: FAILED! => {
2019-05-10 12:20:32.382319 | primary | "changed": true,
2019-05-10 12:20:32.382642 | primary | "cmd": ". /home/zuul/browbeat/.rally-venv/bin/activate; . /home/zuul/overcloudrc; rally deployment check",
2019-05-10 12:20:32.382833 | primary | "delta": "0:00:03.187106",
2019-05-10 12:20:32.382990 | primary | "end": "2019-05-10 12:20:32.347591",
2019-05-10 12:20:32.383092 | primary | "rc": 1,
2019-05-10 12:20:32.383240 | primary | "start": "2019-05-10 12:20:29.160485"
2019-05-10 12:20:32.383293 | primary | }
2019-05-10 12:20:32.383350 | primary |
2019-05-10 12:20:32.383403 | primary | STDOUT:
2019-05-10 12:20:32.383479 | primary |
2019-05-10 12:20:32.383694 | primary | --------------------------------------------------------------------------------
2019-05-10 12:20:32.383824 | primary | Platform openstack:
2019-05-10 12:20:32.384049 | primary | --------------------------------------------------------------------------------
2019-05-10 12:20:32.384106 | primary |
2019-05-10 12:20:32.384261 | primary | Error while checking admin credentials:
2019-05-10 12:20:32.384374 | primary | TypeError: Bad admin creds:
2019-05-10 12:20:32.384450 | primary | {
2019-05-10 12:20:32.384536 | primary | "api_info": {
2019-05-10 12:20:32.384619 | primary | "keystone": {
2019-05-10 12:20:32.384750 | primary | "service_type": "identityv3",
2019-05-10 12:20:32.384866 | primary | "version": 3
2019-05-10 12:20:32.384924 | primary | }
2019-05-10 12:20:32.385045 | primary | },
2019-05-10 12:20:32.385173 | primary | "auth_url": "http://10.0.0.5:5000",
2019-05-10 12:20:32.385277 | primary | "domain_name": null,
2019-05-10 12:20:32.385376 | primary | "endpoint_type": null,
2019-05-10 12:20:32.385488 | primary | "https_cacert": "",
2019-05-10 12:20:32.385587 | primary | "https_cert": "",
2019-05-10 12:20:32.385702 | primary | "https_insecure": false,
2019-05-10 12:20:32.385816 | primary | "https_key": "",
2019-05-10 12:20:32.385916 | primary | "password": "***",
2019-05-10 12:20:32.386028 | primary | "profiler_conn_str": null,
2019-05-10 12:20:32.386131 | primary | "profiler_hmac_key": null,
2019-05-10 12:20:32.386264 | primary | "project_domain_name": "Default",
2019-05-10 12:20:32.386379 | primary | "region_name": "regionOne",
2019-05-10 12:20:32.386499 | primary | "tenant_name": "admin",
2019-05-10 12:20:32.386621 | primary | "user_domain_name": "Default",
2019-05-10 12:20:32.386712 | primary | "username": "admin"
2019-05-10 12:20:32.386767 | primary | }
2019-05-10 12:20:32.386840 | primary |
2019-05-10 12:20:32.386890 | primary |
2019-05-10 12:20:32.386957 | primary | MSG:
2019-05-10 12:20:32.387001 | primary |
2019-05-10 12:20:32.387087 | primary | non-zero return code
2019-05-10 12:20:32.404768 | primary |
2019-05-10 12:20:32.404963 | primary | RUNNING HANDLER [browbeat/firewall : restart iptables] *************************
2019-05-10 12:20:32.431132 | primary | Friday 10 May 2019 12:20:32 +0000 (0:00:04.068) 0:04:44.507 ************
2019-05-10 12:20:32.432717 | primary |
2019-05-10 12:20:32.432907 | primary | PLAY RECAP *********************************************************************
2019-05-10 12:20:32.433059 | primary | undercloud : ok=41 changed=31 unreachable=0 failed=1
2019-05-10 12:20:32.433081 | primary |
2019-05-10 12:20:32.463505 | primary | Friday 10 May 2019 12:20:32 +0000 (0:00:00.032) 0:04:44.540 ************
2019-05-10 12:20:32.463696 | primary | ===============================================================================
2019-05-10 12:20:32.463936 | primary | browbeat/browbeat : Generate hosts and ssh-config on Browbeat Machine - Zuul -- 76.81s
2019-05-10 12:20:32.464105 | primary | browbeat/rally : Install Rally with OpenStack plugins into rally-venv -- 49.84s
2019-05-10 12:20:32.464264 | primary | browbeat/browbeat : Install requirements.txt into browbeat-venv -------- 45.26s
2019-05-10 12:20:32.465041 | primary | browbeat/perfkitbenchmarker : Install PerfKitBenchmarker Openstack requirements into perfkit-venv -- 16.65s
2019-05-10 12:20:32.465246 | primary | browbeat/perfkitbenchmarker : Fix requirements for (OSP11 Ocata) inside perfkit-venv --- 9.86s
2019-05-10 12:20:32.465444 | primary | browbeat/perfkitbenchmarker : Install PerfKitBenchmarker requirements into perfkit-venv --- 9.15s
2019-05-10 12:20:32.465610 | primary | browbeat/browbeat : Install dependencies for CentOS --------------------- 7.37s
2019-05-10 12:20:32.465847 | primary | browbeat/perfkitbenchmarker : Create perfkit virtualenv ----------------- 5.13s
2019-05-10 12:20:32.466000 | primary | browbeat/browbeat : Create browbeat virtualenv -------------------------- 5.08s
2019-05-10 12:20:32.466142 | primary | browbeat/rally : Create rally virtualenv -------------------------------- 4.94s
2019-05-10 12:20:32.466281 | primary | browbeat/browbeat : Install virtualenv and setuptools- zuul user -------- 4.82s
2019-05-10 12:20:32.466439 | primary | browbeat/rally : Setup rally deployment --------------------------------- 4.10s
2019-05-10 12:20:32.466601 | primary | browbeat/rally : Check Rally deployment --------------------------------- 4.07s
2019-05-10 12:20:32.466746 | primary | browbeat/rally : Setup rally.conf --------------------------------------- 3.90s
2019-05-10 12:20:32.466905 | primary | browbeat/perfkitbenchmarker : Clone PerfKitBenchmarker on undercloud ---- 3.65s
2019-05-10 12:20:32.467053 | primary | browbeat/stockpile : Clone stockpile ------------------------------------ 2.84s
2019-05-10 12:20:32.467194 | primary | browbeat/rally : Install elasticsearch into rally-venv ------------------ 2.81s
2019-05-10 12:20:32.467334 | primary | browbeat/pre-install-setup : Make sure dependencies are installed ------- 2.53s
2019-05-10 12:20:32.467490 | primary | browbeat/browbeat : Install pip ----------------------------------------- 2.34s
2019-05-10 12:20:32.467651 | primary | browbeat/rally : Setup rally database ----------------------------------- 2.24s
2019-05-10 12:20:32.581964 | primary | +(./toci_quickstart.sh:154): exit_value=2
2019-05-10 12:20:32.582102 | primary | +(./toci_quickstart.sh:157): [[ 2 == 0 ]]
2019-05-10 12:20:32.582189 | primary | +(./toci_quickstart.sh:158): [[ 2 != 0 ]]
2019-05-10 12:20:32.582329 | primary | +(./toci_quickstart.sh:158): echo 'Playbook run of browbeat-minimal.yml failed'
2019-05-10 12:20:32.582451 | primary | Playbook run of browbeat-minimal.yml failed
2019-05-10 12:20:32.582533 | primary | +(./toci_quickstart.sh:158): break
2019-05-10 12:20:32.582638 | primary | +(./toci_quickstart.sh:160): [[ 2 == 0 ]]
2019-05-10 12:20:32.582747 | primary | +(./toci_quickstart.sh:160): echo 'Playbook run failed'
2019-05-10 12:20:32.582824 | primary | Playbook run failed
2019-05-10 12:20:32.582940 | primary | +(./toci_quickstart.sh:163): echo 'Quickstart completed.'
2019-05-10 12:20:32.582992 | primary | Quickstart completed.
2019-05-10 12:20:32.583066 | primary | +(./toci_quickstart.sh:164): exit 2
2019-05-10 12:20:33.036799 | primary | ERROR
2019-05-10 12:20:33.037172 | primary | {
2019-05-10 12:20:33.037244 | primary | "delta": "2:42:08.507146",
2019-05-10 12:20:33.037298 | primary | "end": "2019-05-10 12:20:32.635588",
2019-05-10 12:20:33.037346 | primary | "msg": "non-zero return code",
2019-05-10 12:20:33.037421 | primary | "rc": 2,
2019-05-10 12:20:33.037467 | primary | "start": "2019-05-10 09:38:24.128442"
2019-05-10 12:20:33.037512 | primary | }
2019-05-10 12:20:33.099982 |
2019-05-10 12:20:33.100129 | PLAY RECAP
2019-05-10 12:20:33.100205 | primary | ok: 7 changed: 4 unreachable: 0 failed: 1

[Waldemar Znoinski (wznoinsk)]

it looks to be fixed in master of rally-openstack by this commit: https://github.com/openstack/rally-openstack/commit/5f1a8f7137c19d74d58fd0ddf9e2ab319662ad0b

maybe we could push for retagging the 1.4.0 to that commit ?

[yatin (yatinkarel)]

rally-openstack 1.5.0 released with the required commit:- https://review.opendev.org/#/c/661984/1/deliverables/_independent/rally-openstack.yaml and is available on pypi:- https://pypi.org/project/rally-openstack/#history, and in browbeat rally_openstack_version is set to 1.5.0 now with:- https://review.opendev.org/#/c/662054/, to clear tripleo fs053 issue need to set rally_openstack_version in https://opendev.org/x/browbeat/src/branch/master/ansible/install/group_vars/zuul_all.yml

[yatin (yatinkarel)]

Job is passing now:- https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, https://review.opendev.org/#/c/662607/1/ansible/install/group_vars/zuul_all.yml has fixed it