ci: OVB based jobs are not collecting logs from OC nodes
Bug #1755891 reported by
Matt Young
This bug affects 1 person
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
tripleo |
Fix Released
|
High
|
Matt Young |
Bug Description
As of {unknown_date} we do not have logs being collected and/or persisted for OC nodes from OVB jobs.
Example:
We do have logs for the UC, but not OC nodes. In this specific case as well OC deploy was successful:
tags: | added: alert |
Changed in tripleo: | |
milestone: | none → rocky-3 |
milestone: | rocky-3 → rocky-1 |
tags: | added: quickstart |
description: | updated |
Changed in tripleo: | |
milestone: | rocky-1 → rocky-2 |
To post a comment you must log in.
Looks like OC nodes are unreachable at the point in time when collect logs is invoked. root cause unknown (so far)
---
https:/ /logs.rdoprojec t.org/openstack -periodic/ periodic- tripleo- ci-centos- 7-ovb-1ctlr_ 1comp-featurese t020-queens/ 1107bd8/ console. txt.gz# _2018-03- 14_10_01_ 33_327
+(./toci_ quickstart. sh:66): QUICKSTART_ COLLECTLOGS_ CMD='
/home/jenkins/ workspace/ periodic- tripleo- ci-centos- 7-ovb-1ctlr_ 1comp-featurese t020-queens/ .quickstart/ bin/ansible- playbook workspace/ periodic- tripleo- ci-centos- 7-ovb-1ctlr_ 1comp-featurese t020-queens/ .quickstart/ playbooks/ collect- logs.yml jenkins/ workspace/ periodic- tripleo- ci-centos- 7-ovb-1ctlr_ 1comp-featurese t020-queens/ .quickstart/ config/ release/ tripleo- ci/promotion- testing- hash-queens. yml jenkins/ workspace/ periodic- tripleo- ci-centos- 7-ovb-1ctlr_ 1comp-featurese t020-queens/ .quickstart/ config/ general_ config/ featureset020. yml new/tripleo- ci/toci- quickstart/ config/ testenv/ ovb.yml --extra-vars @/opt/stack/ new/tripleo- ci/toci- quickstart/ config/ testenv/ ovb-rdocloud. yml dir=/home/ jenkins/ workspace/ periodic- tripleo- ci-centos- 7-ovb-1ctlr_ 1comp-featurese t020-queens/ .quickstart workspace/ periodic- tripleo- ci-centos- 7-ovb-1ctlr_ 1comp-featurese t020-queens/ .quickstart/ hosts root=/opt/ stack/new dir=/home/ jenkins args='\ ''--validation- errors- nonfatal' \'' new/tripleo- ci/toci- quickstart/ config/ collect- logs.yml dir=/home/ jenkins/ workspace/ periodic- tripleo- ci-centos- 7-ovb-1ctlr_ 1comp-featurese t020-queens/ logs
/home/jenkins/
-vv
--extra-vars @/home/
--extra-vars @/home/
--extra-vars @/opt/stack/
--extra-vars local_working_
--extra-vars virthost=undercloud
--inventory /home/jenkins/
--extra-vars tripleo_
--extra-vars working_
--extra-vars validation_
--extra-vars @/opt/stack/
--extra-vars artcl_collect_
--tags all
--skip-tags teardown-all '
---
https:/ /logs.rdoprojec t.org/openstack -periodic/ periodic- tripleo- ci-centos- 7-ovb-1ctlr_ 1comp-featurese t020-queens/ 1107bd8/ quickstart_ collect_ logs.log
fatal: [overcloud- controller- foo-0]: UNREACHABLE! => {"changed": false, "msg": "Failed to connect to the host via ssh: Warning: Permanently added '127.0.0.2' (ECDSA) to the list of known hosts. identification: Connection closed by remote host novacompute- bar-0]: UNREACHABLE! => {"changed": false, "msg": "Failed to connect to the host via ssh: Warning: Permanently added '127.0.0.2' (ECDSA) to the list of known hosts. identification: Connection closed by remote host
channel 0: open failed: connect failed: No route to host
stdio forwarding failed
ssh_exchange_
", "unreachable": true}
fatal: [overcloud-
channel 0: open failed: connect failed: No route to host
stdio forwarding failed
ssh_exchange_
", "unreachable": true}