tripleo reproducer fails w/ "waiting on logger"

Bug #1833465 reported by wes hayutin on 2019-06-19
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Critical
Unassigned

Bug Description

2019-06-19 19:21:27.268870 | Job console starting...
2019-06-19 19:21:46.423161 | Running Ansible setup...
2019-06-19 19:21:51.437485 | PRE-RUN START: [trusted : gerrit/zuul-config/playbooks/base/pre.yaml@master]
2019-06-19 19:21:53.028564 |
2019-06-19 19:21:53.028691 | PLAY [localhost]
2019-06-19 19:21:53.061234 |
2019-06-19 19:21:53.061349 | TASK [Setup log path fact]
2019-06-19 19:21:53.117590 | localhost | ok
2019-06-19 19:21:53.179959 |
2019-06-19 19:21:53.180081 | TASK [set-zuul-log-path-fact : Set log path for a change]
2019-06-19 19:21:53.272460 | localhost | ok
2019-06-19 19:21:53.297052 |
2019-06-19 19:21:53.297218 | TASK [set-zuul-log-path-fact : Set log path for a ref update]
2019-06-19 19:21:53.354892 | localhost | skipping: Conditional result was False
2019-06-19 19:21:53.383457 |
2019-06-19 19:21:53.383653 | TASK [set-zuul-log-path-fact : Set log path for a periodic job]
2019-06-19 19:21:53.449788 | localhost | skipping: Conditional result was False
2019-06-19 19:21:53.472919 |
2019-06-19 19:21:53.473045 | TASK [emit-job-header : Print job information]
2019-06-19 19:21:53.550911 | # Job Information
2019-06-19 19:21:53.551089 | Ansible Version: 2.7.10
2019-06-19 19:21:53.551132 | Job: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-dlrn-hash-tag
2019-06-19 19:21:53.551168 | Pipeline: check
2019-06-19 19:21:53.551202 | Executor: 4ec1357d62bc
2019-06-19 19:21:53.551234 | Triggered by: http://localhost:8080/c/test1/+/1001
2019-06-19 19:21:53.551266 | Log URL (when completed): http://logs.openstack.org/01/1001/1/check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-dlrn-hash-tag/541ebc9/
2019-06-19 19:21:53.577544 |
2019-06-19 19:21:53.577680 | LOOP [emit-job-header : Print node information]
2019-06-19 19:21:53.670728 | localhost | ok:
2019-06-19 19:21:53.670887 | localhost | # Node Information
2019-06-19 19:21:53.670931 | localhost | Hostname: tripleo-ovb-centos-7-localhost-rdo-cloud-0000000002
2019-06-19 19:21:53.670968 | localhost | Provider: localhost-rdo-cloud
2019-06-19 19:21:53.671013 | localhost | Label: tripleo-ovb-centos-7
2019-06-19 19:21:53.671059 | localhost | Interface IP: 38.145.35.113
2019-06-19 19:21:53.699673 |
2019-06-19 19:21:53.699825 | PLAY [all]
2019-06-19 19:21:53.755757 |
2019-06-19 19:21:53.755867 | TASK [Gather network facts]
2019-06-19 19:21:54.734122 | primary | ok
2019-06-19 19:21:54.825850 |
2019-06-19 19:21:54.825985 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2019-06-19 19:21:55.143404 | primary -> localhost | ok
2019-06-19 19:21:55.181493 |
2019-06-19 19:21:55.181610 | TASK [add-build-sshkey : Create Temp SSH key]
2019-06-19 19:21:55.517158 | primary -> localhost | Generating public/private rsa key pair.
2019-06-19 19:21:55.517480 | primary -> localhost | Your identification has been saved in /tmp/tmp89049bwq/541ebc99498b4e9da01a5ab847f6c0d7/work/541ebc99498b4e9da01a5ab847f6c0d7_id_rsa.
2019-06-19 19:21:55.517556 | primary -> localhost | Your public key has been saved in /tmp/tmp89049bwq/541ebc99498b4e9da01a5ab847f6c0d7/work/541ebc99498b4e9da01a5ab847f6c0d7_id_rsa.pub.
2019-06-19 19:21:55.517617 | primary -> localhost | The key fingerprint is:
2019-06-19 19:21:55.517673 | primary -> localhost | SHA256:ca69DzetiznzL3fLIQtcceB4Wa8KugtR5YWNSu41Yjo zuul-build-sshkey
2019-06-19 19:21:55.517728 | primary -> localhost | The key's randomart image is:
2019-06-19 19:21:55.517781 | primary -> localhost | +---[RSA 1024]----+
2019-06-19 19:21:55.517834 | primary -> localhost | | .+.. . |
2019-06-19 19:21:55.517888 | primary -> localhost | | .oo.+ + .|
2019-06-19 19:21:55.517940 | primary -> localhost | | oo.o. = ..|
2019-06-19 19:21:55.517993 | primary -> localhost | | .=+o . o. |
2019-06-19 19:21:55.518046 | primary -> localhost | | .+Soo. .. |
2019-06-19 19:21:55.518098 | primary -> localhost | | E..+...o |
2019-06-19 19:21:55.518151 | primary -> localhost | | ..o oo+... |
2019-06-19 19:21:55.518203 | primary -> localhost | | . .o*oo= o|
2019-06-19 19:21:55.518256 | primary -> localhost | | o.+==*.+.|
2019-06-19 19:21:55.518322 | primary -> localhost | +----[SHA256]-----+
2019-06-19 19:21:55.518442 | primary -> localhost | ok: Runtime: 0:00:00.011193
2019-06-19 19:21:55.552228 |
2019-06-19 19:21:55.552431 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2019-06-19 19:21:55.623718 | primary | skipping: Conditional result was False
2019-06-19 19:21:55.649861 |
2019-06-19 19:21:55.649993 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2019-06-19 19:21:56.492889 | primary | changed
2019-06-19 19:21:56.525515 |
2019-06-19 19:21:56.525711 | TASK [add-build-sshkey : Make sure user has a .ssh]
2019-06-19 19:21:57.209547 | primary | ok
2019-06-19 19:21:57.251702 |
2019-06-19 19:21:57.251891 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2019-06-19 19:21:59.312945 | primary | changed
2019-06-19 19:21:59.343365 |
2019-06-19 19:21:59.343551 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2019-06-19 19:22:01.227035 | primary | changed
2019-06-19 19:22:01.263048 |
2019-06-19 19:22:01.263164 | TASK [add-build-sshkey : Remove master key from local agent]
2019-06-19 19:22:01.556639 | primary -> localhost | changed
2019-06-19 19:22:01.592777 |
2019-06-19 19:22:01.592892 | TASK [add-build-sshkey : Add back temp key]
2019-06-19 19:22:01.773266 | primary -> localhost | Identity added: /tmp/tmp89049bwq/541ebc99498b4e9da01a5ab847f6c0d7/work/541ebc99498b4e9da01a5ab847f6c0d7_id_rsa (/tmp/tmp89049bwq/541ebc99498b4e9da01a5ab847f6c0d7/work/541ebc99498b4e9da01a5ab847f6c0d7_id_rsa)
2019-06-19 19:22:01.773558 | primary -> localhost | ok: Runtime: 0:00:00.002806
2019-06-19 19:22:01.804567 |
2019-06-19 19:22:01.804766 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2019-06-19 19:22:02.412783 | primary | ok
2019-06-19 19:22:02.438609 |
2019-06-19 19:22:02.438733 | TASK [start-zuul-console : Start zuul_console daemon.]
2019-06-19 19:22:03.108431 | primary | ok
2019-06-19 19:22:03.138189 |
2019-06-19 19:22:03.138307 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2019-06-19 19:22:03.349116 | primary -> localhost | changed
2019-06-19 19:22:03.380096 |
2019-06-19 19:22:03.380219 | TASK [log-inventory : Copy ansible inventory to logs dir]
2019-06-19 19:22:03.805886 | primary -> localhost | changed
2019-06-19 19:22:03.840848 |
2019-06-19 19:22:03.840973 | PLAY [all]
2019-06-19 19:22:03.897806 |
2019-06-19 19:22:03.897953 | TASK [validate-host : Define zuul_info_dir fact]
2019-06-19 19:22:04.056997 | primary | ok
2019-06-19 19:22:04.092598 |
2019-06-19 19:22:04.092739 | TASK [validate-host : Ensure Zuul Ansible directory exists]
2019-06-19 19:22:04.280109 | primary -> localhost | ok
2019-06-19 19:22:04.311696 |
2019-06-19 19:22:04.311862 | TASK [validate-host : Collect information about the host]
2019-06-19 19:22:05.447907 | primary | ok
2019-06-19 19:22:05.512493 |
2019-06-19 19:22:05.512642 | TASK [validate-host : Write out all ansible variables/facts known for each host]
2019-06-19 19:22:05.893476 | primary -> localhost | changed
2019-06-19 19:22:05.927753 |
2019-06-19 19:22:05.927869 | TASK [validate-host : Collect information about zuul worker]
2019-06-19 19:22:06.527476 | primary | ok
2019-06-19 19:22:06.599071 |
2019-06-19 19:22:06.599205 | TASK [validate-host : Write out all zuul information for each host]
2019-06-19 19:22:06.930581 | primary -> localhost | changed
2019-06-19 19:22:06.966738 |
2019-06-19 19:22:06.966857 | TASK [prepare-workspace : Start zuul_console daemon.]
2019-06-19 19:22:07.539661 | primary | ok
2019-06-19 19:22:07.572527 |
2019-06-19 19:22:07.572723 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2019-06-19 19:23:13.890589 | primary | Output suppressed because no_log was given
2019-06-19 19:23:13.923320 |
2019-06-19 19:23:13.923473 | TASK [mirror-info : Create /etc/ci]
2019-06-19 19:23:15.512146 | primary | changed
2019-06-19 19:23:15.545166 |
2019-06-19 19:23:15.545284 | TASK [mirror-info : Install ci_mirror script]
2019-06-19 19:23:17.442890 | primary | changed
2019-06-19 19:23:17.476346 |
2019-06-19 19:23:17.476462 | TASK [configure-mirrors : Set up infrastructure mirrors]
2019-06-19 19:23:17.569935 | primary | ok
2019-06-19 19:23:17.608946 | primary | included: /tmp/tmp89049bwq/541ebc99498b4e9da01a5ab847f6c0d7/trusted/project_2/opendev.org/zuul/zuul-jobs/roles/configure-mirrors/tasks/mirror.yaml
2019-06-19 19:23:17.616517 |
2019-06-19 19:23:17.616611 | TASK [configure-mirrors : Install .pydistutils.cfg configuration in homedir]
2019-06-19 19:23:19.514433 | primary | changed
2019-06-19 19:23:19.546568 |
2019-06-19 19:23:19.546684 | LOOP [configure-mirrors : Include OS-specific variables]
2019-06-19 19:23:19.671953 | primary | ok: "/tmp/tmp89049bwq/541ebc99498b4e9da01a5ab847f6c0d7/trusted/project_2/opendev.org/zuul/zuul-jobs/roles/configure-mirrors/vars/CentOS.yaml"
2019-06-19 19:23:19.672153 | primary | ok: All items complete
2019-06-19 19:23:19.672205 |
2019-06-19 19:23:19.704288 |
2019-06-19 19:23:19.704417 | TASK [configure-mirrors : Install /etc/pip.conf configuration]
2019-06-19 19:23:21.506642 | primary | changed
2019-06-19 19:23:21.538312 |
2019-06-19 19:23:21.538491 | LOOP [configure-mirrors : Setup distribution specific packaging mirrors]
2019-06-19 19:23:21.599137 | primary | ok: "/tmp/tmp89049bwq/541ebc99498b4e9da01a5ab847f6c0d7/trusted/project_2/opendev.org/zuul/zuul-jobs/roles/configure-mirrors/tasks/mirror/CentOS.yaml"
2019-06-19 19:23:21.629258 | primary | included: /tmp/tmp89049bwq/541ebc99498b4e9da01a5ab847f6c0d7/trusted/project_2/opendev.org/zuul/zuul-jobs/roles/configure-mirrors/tasks/mirror/CentOS.yaml
2019-06-19 19:23:21.637767 |
2019-06-19 19:23:21.637871 | LOOP [configure-mirrors : Install CentOS repository files]
2019-06-19 19:23:23.508675 | primary | changed: "etc/yum.repos.d/CentOS-Base.repo"
2019-06-19 19:23:23.508973 | primary | ok: All items complete
2019-06-19 19:23:23.509036 |
2019-06-19 19:23:25.088771 | primary | changed: "etc/yum.repos.d/epel.repo"
2019-06-19 19:23:25.128288 |
2019-06-19 19:23:25.128451 | TASK [configure-mirrors : Disable deltrarpm]
2019-06-19 19:23:25.756829 | primary | changed: option added
2019-06-19 19:23:25.785850 |
2019-06-19 19:23:25.785979 | LOOP [configure-mirrors : Update yum cache]
2019-06-19 19:24:37.430096 | primary | Loaded plugins: fastestmirror
2019-06-19 19:24:37.430346 | primary | Cleaning repos: base extras updates
2019-06-19 19:24:37.430414 | primary | Cleaning up list of fastest mirrors
2019-06-19 19:24:37.430465 | primary | Other repos take up 45 M of disk space (use --verbose for details)
2019-06-19 19:24:37.430549 | primary | ok: Item: yum clean all Runtime: 0:00:01.514130
2019-06-19 19:24:48.752982 | primary | Loaded plugins: fastestmirror
2019-06-19 19:24:48.753100 | primary | Determining fastest mirrors
2019-06-19 19:24:48.753149 | primary | Metadata Cache Created
2019-06-19 19:24:48.753212 | primary | ok: Item: yum makecache Runtime: 0:00:10.922101
2019-06-19 19:24:48.775125 |
2019-06-19 19:24:48.775291 | PLAY RECAP
2019-06-19 19:24:48.775388 | localhost | ok: 3 changed: 0 unreachable: 0 failed: 0
2019-06-19 19:24:48.775465 | primary | ok: 31 changed: 18 unreachable: 0 failed: 0
2019-06-19 19:24:48.775524 |
2019-06-19 19:24:48.994886 | PRE-RUN END RESULT_NORMAL: [trusted : gerrit/zuul-config/playbooks/base/pre.yaml@master]
2019-06-19 19:24:48.995049 | PRE-RUN START: [untrusted : opendev.org/zuul/zuul-jobs/playbooks/multinode/pre.yaml@master]
2019-06-19 19:24:50.580525 |
2019-06-19 19:24:50.580654 | PLAY [Configure a multi node environment]
2019-06-19 19:24:50.619775 |
2019-06-19 19:24:50.619907 | TASK [Set up multi-node known hosts]
2019-06-19 19:24:50.667252 | primary | ok
2019-06-19 19:24:50.743791 |
2019-06-19 19:24:50.743919 | TASK [multi-node-known-hosts : Get known_hosts facts]
2019-06-19 19:24:52.336398 | primary | ok
2019-06-19 19:24:52.375746 |
2019-06-19 19:24:52.375859 | LOOP [multi-node-known-hosts : add known_host record for every public key of every other ip, hostname for ansible_user]
2019-06-19 19:24:52.959500 | primary | changed:
2019-06-19 19:24:52.959698 | primary | {
2019-06-19 19:24:52.959746 | primary | "key": "10.0.0.23 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN8NiaedKz2Ue+d5phSgu4RsfcL2pt3+mPOP+DmqmhkCSGQ4jHm0b/65MUalQIJZYYD2RHMkvSNI0nCtCHtYAqs=",
2019-06-19 19:24:52.959786 | primary | "name": "10.0.0.23"
2019-06-19 19:24:52.959824 | primary | }
2019-06-19 19:24:53.322273 | primary | changed:
2019-06-19 19:24:53.322414 | primary | {
2019-06-19 19:24:53.322458 | primary | "key": "10.0.0.23 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJI7YTvSBgCJdWRElGdW1MmT9mntgwwkZcRWdiZrpwEj",
2019-06-19 19:24:53.322495 | primary | "name": "10.0.0.23"
2019-06-19 19:24:53.322529 | primary | }
2019-06-19 19:24:53.604485 | primary | changed:
2019-06-19 19:24:53.604611 | primary | {
2019-06-19 19:24:53.604655 | primary | "key": "10.0.0.23 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1MIsoA98wzHh70A7DdTOnh+30/Rwe/ra+OAMYPdff3bwNGYOY3Vr859b8Kid1xjEouP0ehSoCJsqtwScKa6jqmkjMitzTnK7eKQ0aL1ipUhw7ApOYzBmjP4I03CQpQk+FLUBDpF2706pDr2GmrEZw8D6Q1k32ht8FucE20uoBEiHVIhKUCUB6rh391/hUMytoTPRz968yk9cvPtoOYb3/aoiRqcANiFoYtlO8U9NRJI0u+c8nk8IYc+NbJmQrUV4WdRaVchv/uW6QnVFfxlaIOsxJZgoWJ5A2CFFVMOU0wN296vv4DJr5PvfgGbljvr8ognJcos/8r2tg1/4fjomB",
2019-06-19 19:24:53.604694 | primary | "name": "10.0.0.23"
2019-06-19 19:24:53.604730 | primary | }
2019-06-19 19:24:53.907855 | primary | changed:
2019-06-19 19:24:53.907977 | primary | {
2019-06-19 19:24:53.908029 | primary | "key": "38.145.35.113 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN8NiaedKz2Ue+d5phSgu4RsfcL2pt3+mPOP+DmqmhkCSGQ4jHm0b/65MUalQIJZYYD2RHMkvSNI0nCtCHtYAqs=",
2019-06-19 19:24:53.908074 | primary | "name": "38.145.35.113"
2019-06-19 19:24:53.908117 | primary | }
2019-06-19 19:24:54.190713 | primary | changed:
2019-06-19 19:24:54.190832 | primary | {
2019-06-19 19:24:54.190875 | primary | "key": "38.145.35.113 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJI7YTvSBgCJdWRElGdW1MmT9mntgwwkZcRWdiZrpwEj",
2019-06-19 19:24:54.190912 | primary | "name": "38.145.35.113"
2019-06-19 19:24:54.190947 | primary | }
2019-06-19 19:24:54.494010 | primary | changed:
2019-06-19 19:24:54.494134 | primary | {
2019-06-19 19:24:54.494177 | primary | "key": "38.145.35.113 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1MIsoA98wzHh70A7DdTOnh+30/Rwe/ra+OAMYPdff3bwNGYOY3Vr859b8Kid1xjEouP0ehSoCJsqtwScKa6jqmkjMitzTnK7eKQ0aL1ipUhw7ApOYzBmjP4I03CQpQk+FLUBDpF2706pDr2GmrEZw8D6Q1k32ht8FucE20uoBEiHVIhKUCUB6rh391/hUMytoTPRz968yk9cvPtoOYb3/aoiRqcANiFoYtlO8U9NRJI0u+c8nk8IYc+NbJmQrUV4WdRaVchv/uW6QnVFfxlaIOsxJZgoWJ5A2CFFVMOU0wN296vv4DJr5PvfgGbljvr8ognJcos/8r2tg1/4fjomB",
2019-06-19 19:24:54.494216 | primary | "name": "38.145.35.113"
2019-06-19 19:24:54.494261 | primary | }
2019-06-19 19:24:54.775799 | primary | changed:
2019-06-19 19:24:54.775914 | primary | {
2019-06-19 19:24:54.775956 | primary | "key": "fe80::f816:3eff:fe07:e9c1 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN8NiaedKz2Ue+d5phSgu4RsfcL2pt3+mPOP+DmqmhkCSGQ4jHm0b/65MUalQIJZYYD2RHMkvSNI0nCtCHtYAqs=",
2019-06-19 19:24:54.775992 | primary | "name": "fe80::f816:3eff:fe07:e9c1"
2019-06-19 19:24:54.776027 | primary | }
2019-06-19 19:24:55.078854 | primary | changed:
2019-06-19 19:24:55.078962 | primary | {
2019-06-19 19:24:55.079003 | primary | "key": "fe80::f816:3eff:fe07:e9c1 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJI7YTvSBgCJdWRElGdW1MmT9mntgwwkZcRWdiZrpwEj",
2019-06-19 19:24:55.079039 | primary | "name": "fe80::f816:3eff:fe07:e9c1"
2019-06-19 19:24:55.079072 | primary | }
2019-06-19 19:24:55.351820 | primary | changed:
2019-06-19 19:24:55.351952 | primary | {
2019-06-19 19:24:55.351994 | primary | "key": "fe80::f816:3eff:fe07:e9c1 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1MIsoA98wzHh70A7DdTOnh+30/Rwe/ra+OAMYPdff3bwNGYOY3Vr859b8Kid1xjEouP0ehSoCJsqtwScKa6jqmkjMitzTnK7eKQ0aL1ipUhw7ApOYzBmjP4I03CQpQk+FLUBDpF2706pDr2GmrEZw8D6Q1k32ht8FucE20uoBEiHVIhKUCUB6rh391/hUMytoTPRz968yk9cvPtoOYb3/aoiRqcANiFoYtlO8U9NRJI0u+c8nk8IYc+NbJmQrUV4WdRaVchv/uW6QnVFfxlaIOsxJZgoWJ5A2CFFVMOU0wN296vv4DJr5PvfgGbljvr8ognJcos/8r2tg1/4fjomB",
2019-06-19 19:24:55.352043 | primary | "name": "fe80::f816:3eff:fe07:e9c1"
2019-06-19 19:24:55.352080 | primary | }
2019-06-19 19:24:55.644754 | primary | changed:
2019-06-19 19:24:55.644874 | primary | {
2019-06-19 19:24:55.644915 | primary | "key": "tripleo-ovb-centos-7-localhost-rdo-cloud-0000000002 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN8NiaedKz2Ue+d5phSgu4RsfcL2pt3+mPOP+DmqmhkCSGQ4jHm0b/65MUalQIJZYYD2RHMkvSNI0nCtCHtYAqs=",
2019-06-19 19:24:55.644951 | primary | "name": "tripleo-ovb-centos-7-localhost-rdo-cloud-0000000002"
2019-06-19 19:24:55.644986 | primary | }
2019-06-19 19:24:55.968168 | primary | changed:
2019-06-19 19:24:55.968327 | primary | {
2019-06-19 19:24:55.968376 | primary | "key": "tripleo-ovb-centos-7-localhost-rdo-cloud-0000000002 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJI7YTvSBgCJdWRElGdW1MmT9mntgwwkZcRWdiZrpwEj",
2019-06-19 19:24:55.968433 | primary | "name": "tripleo-ovb-centos-7-localhost-rdo-cloud-0000000002"
2019-06-19 19:24:55.968466 | primary | }
2019-06-19 19:24:56.299694 | primary | changed:
2019-06-19 19:24:56.299809 | primary | {
2019-06-19 19:24:56.299852 | primary | "key": "tripleo-ovb-centos-7-localhost-rdo-cloud-0000000002 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1MIsoA98wzHh70A7DdTOnh+30/Rwe/ra+OAMYPdff3bwNGYOY3Vr859b8Kid1xjEouP0ehSoCJsqtwScKa6jqmkjMitzTnK7eKQ0aL1ipUhw7ApOYzBmjP4I03CQpQk+FLUBDpF2706pDr2GmrEZw8D6Q1k32ht8FucE20uoBEiHVIhKUCUB6rh391/hUMytoTPRz968yk9cvPtoOYb3/aoiRqcANiFoYtlO8U9NRJI0u+c8nk8IYc+NbJmQrUV4WdRaVchv/uW6QnVFfxlaIOsxJZgoWJ5A2CFFVMOU0wN296vv4DJr5PvfgGbljvr8ognJcos/8r2tg1/4fjomB",
2019-06-19 19:24:56.299889 | primary | "name": "tripleo-ovb-centos-7-localhost-rdo-cloud-0000000002"
2019-06-19 19:24:56.299924 | primary | }
2019-06-19 19:24:56.337014 |
2019-06-19 19:24:56.337166 | LOOP [multi-node-known-hosts : add default known_host record for every user]
2019-06-19 19:24:56.815157 | primary | changed:
2019-06-19 19:24:56.815472 | primary | {
2019-06-19 19:24:56.815545 | primary | "key": "10.0.0.23 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN8NiaedKz2Ue+d5phSgu4RsfcL2pt3+mPOP+DmqmhkCSGQ4jHm0b/65MUalQIJZYYD2RHMkvSNI0nCtCHtYAqs=",
2019-06-19 19:24:56.815613 | primary | "name": "10.0.0.23"
2019-06-19 19:24:56.815678 | primary | }
2019-06-19 19:24:56.815767 | primary | changed: All items complete
2019-06-19 19:24:56.815839 |
2019-06-19 19:24:57.159789 | primary | changed:
2019-06-19 19:24:57.159903 | primary | {
2019-06-19 19:24:57.159945 | primary | "key": "10.0.0.23 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJI7YTvSBgCJdWRElGdW1MmT9mntgwwkZcRWdiZrpwEj",
2019-06-19 19:24:57.159982 | primary | "name": "10.0.0.23"
2019-06-19 19:24:57.160017 | primary | }
2019-06-19 19:24:57.482065 | primary | changed:
2019-06-19 19:24:57.482181 | primary | {
2019-06-19 19:24:57.482223 | primary | "key": "10.0.0.23 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1MIsoA98wzHh70A7DdTOnh+30/Rwe/ra+OAMYPdff3bwNGYOY3Vr859b8Kid1xjEouP0ehSoCJsqtwScKa6jqmkjMitzTnK7eKQ0aL1ipUhw7ApOYzBmjP4I03CQpQk+FLUBDpF2706pDr2GmrEZw8D6Q1k32ht8FucE20uoBEiHVIhKUCUB6rh391/hUMytoTPRz968yk9cvPtoOYb3/aoiRqcANiFoYtlO8U9NRJI0u+c8nk8IYc+NbJmQrUV4WdRaVchv/uW6QnVFfxlaIOsxJZgoWJ5A2CFFVMOU0wN296vv4DJr5PvfgGbljvr8ognJcos/8r2tg1/4fjomB",
2019-06-19 19:24:57.482262 | primary | "name": "10.0.0.23"
2019-06-19 19:24:57.482297 | primary | }
2019-06-19 19:24:57.866595 | primary | changed:
2019-06-19 19:24:57.866728 | primary | {
2019-06-19 19:24:57.866785 | primary | "key": "38.145.35.113 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN8NiaedKz2Ue+d5phSgu4RsfcL2pt3+mPOP+DmqmhkCSGQ4jHm0b/65MUalQIJZYYD2RHMkvSNI0nCtCHtYAqs=",
2019-06-19 19:24:57.866835 | primary | "name": "38.145.35.113"
2019-06-19 19:24:57.866881 | primary | }
2019-06-19 19:24:58.210080 | primary | changed:
2019-06-19 19:24:58.210213 | primary | {
2019-06-19 19:24:58.210254 | primary | "key": "38.145.35.113 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJI7YTvSBgCJdWRElGdW1MmT9mntgwwkZcRWdiZrpwEj",
2019-06-19 19:24:58.210290 | primary | "name": "38.145.35.113"
2019-06-19 19:24:58.210325 | primary | }
2019-06-19 19:24:58.552766 | primary | changed:
2019-06-19 19:24:58.552888 | primary | {
2019-06-19 19:24:58.552937 | primary | "key": "38.145.35.113 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1MIsoA98wzHh70A7DdTOnh+30/Rwe/ra+OAMYPdff3bwNGYOY3Vr859b8Kid1xjEouP0ehSoCJsqtwScKa6jqmkjMitzTnK7eKQ0aL1ipUhw7ApOYzBmjP4I03CQpQk+FLUBDpF2706pDr2GmrEZw8D6Q1k32ht8FucE20uoBEiHVIhKUCUB6rh391/hUMytoTPRz968yk9cvPtoOYb3/aoiRqcANiFoYtlO8U9NRJI0u+c8nk8IYc+NbJmQrUV4WdRaVchv/uW6QnVFfxlaIOsxJZgoWJ5A2CFFVMOU0wN296vv4DJr5PvfgGbljvr8ognJcos/8r2tg1/4fjomB",
2019-06-19 19:24:58.552981 | primary | "name": "38.145.35.113"
2019-06-19 19:24:58.553021 | primary | }
2019-06-19 19:24:58.896341 | primary | changed:
2019-06-19 19:24:58.896469 | primary | {
2019-06-19 19:24:58.896522 | primary | "key": "fe80::f816:3eff:fe07:e9c1 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN8NiaedKz2Ue+d5phSgu4RsfcL2pt3+mPOP+DmqmhkCSGQ4jHm0b/65MUalQIJZYYD2RHMkvSNI0nCtCHtYAqs=",
2019-06-19 19:24:58.896569 | primary | "name": "fe80::f816:3eff:fe07:e9c1"
2019-06-19 19:24:58.896613 | primary | }
2019-06-19 19:24:59.240885 | primary | changed:
2019-06-19 19:24:59.241012 | primary | {
2019-06-19 19:24:59.241067 | primary | "key": "fe80::f816:3eff:fe07:e9c1 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJI7YTvSBgCJdWRElGdW1MmT9mntgwwkZcRWdiZrpwEj",
2019-06-19 19:24:59.241116 | primary | "name": "fe80::f816:3eff:fe07:e9c1"
2019-06-19 19:24:59.241161 | primary | }
2019-06-19 19:24:59.547487 | primary | changed:
2019-06-19 19:24:59.547645 | primary | {
2019-06-19 19:24:59.547715 | primary | "key": "fe80::f816:3eff:fe07:e9c1 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1MIsoA98wzHh70A7DdTOnh+30/Rwe/ra+OAMYPdff3bwNGYOY3Vr859b8Kid1xjEouP0ehSoCJsqtwScKa6jqmkjMitzTnK7eKQ0aL1ipUhw7ApOYzBmjP4I03CQpQk+FLUBDpF2706pDr2GmrEZw8D6Q1k32ht8FucE20uoBEiHVIhKUCUB6rh391/hUMytoTPRz968yk9cvPtoOYb3/aoiRqcANiFoYtlO8U9NRJI0u+c8nk8IYc+NbJmQrUV4WdRaVchv/uW6QnVFfxlaIOsxJZgoWJ5A2CFFVMOU0wN296vv4DJr5PvfgGbljvr8ognJcos/8r2tg1/4fjomB",
2019-06-19 19:24:59.547785 | primary | "name": "fe80::f816:3eff:fe07:e9c1"
2019-06-19 19:24:59.547829 | primary | }
2019-06-19 19:24:59.921185 | primary | changed:
2019-06-19 19:24:59.921308 | primary | {
2019-06-19 19:24:59.921358 | primary | "key": "tripleo-ovb-centos-7-localhost-rdo-cloud-0000000002 ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN8NiaedKz2Ue+d5phSgu4RsfcL2pt3+mPOP+DmqmhkCSGQ4jHm0b/65MUalQIJZYYD2RHMkvSNI0nCtCHtYAqs=",
2019-06-19 19:24:59.921420 | primary | "name": "tripleo-ovb-centos-7-localhost-rdo-cloud-0000000002"
2019-06-19 19:24:59.921466 | primary | }
2019-06-19 19:25:00.264370 | primary | changed:
2019-06-19 19:25:00.264494 | primary | {
2019-06-19 19:25:00.264547 | primary | "key": "tripleo-ovb-centos-7-localhost-rdo-cloud-0000000002 ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJI7YTvSBgCJdWRElGdW1MmT9mntgwwkZcRWdiZrpwEj",
2019-06-19 19:25:00.264592 | primary | "name": "tripleo-ovb-centos-7-localhost-rdo-cloud-0000000002"
2019-06-19 19:25:00.264634 | primary | }
2019-06-19 19:25:00.608570 | primary | changed:
2019-06-19 19:25:00.608683 | primary | {
2019-06-19 19:25:00.608725 | primary | "key": "tripleo-ovb-centos-7-localhost-rdo-cloud-0000000002 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1MIsoA98wzHh70A7DdTOnh+30/Rwe/ra+OAMYPdff3bwNGYOY3Vr859b8Kid1xjEouP0ehSoCJsqtwScKa6jqmkjMitzTnK7eKQ0aL1ipUhw7ApOYzBmjP4I03CQpQk+FLUBDpF2706pDr2GmrEZw8D6Q1k32ht8FucE20uoBEiHVIhKUCUB6rh391/hUMytoTPRz968yk9cvPtoOYb3/aoiRqcANiFoYtlO8U9NRJI0u+c8nk8IYc+NbJmQrUV4WdRaVchv/uW6QnVFfxlaIOsxJZgoWJ5A2CFFVMOU0wN296vv4DJr5PvfgGbljvr8ognJcos/8r2tg1/4fjomB",
2019-06-19 19:25:00.608764 | primary | "name": "tripleo-ovb-centos-7-localhost-rdo-cloud-0000000002"
2019-06-19 19:25:00.608800 | primary | }
2019-06-19 19:25:00.643187 |
2019-06-19 19:25:00.643319 | TASK [Set up multi-node hosts file]
2019-06-19 19:25:00.697163 | primary | ok
2019-06-19 19:25:00.741438 |
2019-06-19 19:25:00.741562 | TASK [multi-node-hosts-file : Set up the list of hosts and addresses]
2019-06-19 19:25:00.891869 | primary | ok
2019-06-19 19:25:00.925150 |
2019-06-19 19:25:00.925329 | LOOP [multi-node-hosts-file : Add inventory hostnames to the hosts file]
2019-06-19 19:25:01.577877 | primary | changed: line added
2019-06-19 19:25:01.891731 | primary | changed: line added
2019-06-19 19:25:01.923341 |
2019-06-19 19:25:01.923490 | TASK [Set up multi-node firewall]
2019-06-19 19:25:01.979499 | primary | ok
2019-06-19 19:25:02.033785 |
2019-06-19 19:25:02.033907 | TASK [multi-node-firewall : Ensure iptables]
2019-06-19 19:25:03.421856 | primary | ok
2019-06-19 19:25:03.462594 |
2019-06-19 19:25:03.462718 | TASK [multi-node-firewall : Set up the host ip addresses]
2019-06-19 19:25:03.646678 | primary | ok
2019-06-19 19:25:03.680460 |
2019-06-19 19:25:03.680619 | LOOP [multi-node-firewall : Set up ipv4 iptables rules]
2019-06-19 19:25:04.363611 | primary | changed: "10.0.0.23"
2019-06-19 19:25:04.363846 | primary | changed: All items complete
2019-06-19 19:25:04.363899 |
2019-06-19 19:25:04.720515 | primary | changed: "38.145.35.113"
2019-06-19 19:25:04.757718 |
2019-06-19 19:25:04.757882 | LOOP [multi-node-firewall : Set up ipv6 iptables rules]
2019-06-19 19:25:04.849994 |
2019-06-19 19:25:04.850147 | TASK [Persist iptables rules]
2019-06-19 19:25:04.908058 | primary | ok
2019-06-19 19:25:04.955060 |
2019-06-19 19:25:04.955181 | TASK [persistent-firewall : List current ipv4 rules]
2019-06-19 19:25:05.018460 | [primary] Waiting on logger
2019-06-19 19:25:05.166888 | [primary] Waiting on logger
2019-06-19 19:25:05.317638 | [primary] Waiting on logger
2019-06-19 19:25:05.468660 | [primary] Waiting on logger
2019-06-19 19:25:05.616736 | [primary] Waiting on logger
2019-06-19 19:25:05.764766 | [primary] Waiting on logger
2019-06-19 19:25:05.914908 | [primary] Waiting on logger
2019-06-19 19:25:06.062611 | [primary] Waiting on logger
2019-06-19 19:25:06.210817 | [primary] Waiting on logger
2019-06-19 19:25:06.358931 | [primary] Waiting on logger
2019-06-19 19:25:06.507331 | [primary] Waiting on logger
2019-06-19 19:25:06.654813 | [primary] Waiting on logger
2019-06-19 19:25:06.804944 | [primary] Waiting on logger
2019-06-19 19:25:06.954094 | [primary] Waiting on logger
2019-06-19 19:25:07.101178 | [primary] Waiting on logger
2019-06-19 19:25:07.249051 | [primary] Waiting on logger
2019-06-19 19:25:07.404070 | [primary] Waiting on logger
2019-06-19 19:25:07.553235 | [primary] Waiting on logger
2019-06-19 19:25:07.701163 | [primary] Waiting on logger
2019-06-19 19:25:07.849333 | [primary] Waiting on logger
2019-06-19 19:25:07.998561 | [primary] Waiting on logger
2019-06-19 19:25:08.147741 | [primary] Waiting on logger
2019-06-19 19:25:08.296128 | [primary] Waiting on logger
2019-06-19 19:25:08.444474 | [primary] Waiting on logger
2019-06-19 19:25:08.592548 | [primary] Waiting on logger
2019-06-19 19:25:08.740695 | [primary] Waiting on logger
2019-06-19 19:25:08.889727 | [primary] Waiting on logger
2019-06-19 19:25:09.038749 | [primary] Waiting on logger
2019-06-19 19:25:09.187619 | [primary] Waiting on logger
2019-06-19 19:25:09.335237 | [primary] Waiting on logger
2019-06-19 19:25:09.483568 | [primary] Waiting on logger
2019-06-19 19:25:09.630639 | [primary] Waiting on logger
2019-06-19 19:25:09.778571 | [primary] Waiting on logger
2019-06-19 19:25:09.926503 | [primary] Waiting on logger
2019-06-19 19:25:10.074648 | [primary] Waiting on logger
2019-06-19 19:25:10.222933 | [primary] Waiting on logger
2019-06-19 19:25:10.370881 | [primary] Waiting on logger
2019-06-19 19:25:10.517944 | [primary] Waiting on logger
2019-06-19 19:25:10.665854 | [primary] Waiting on logger
2019-06-19 19:25:10.814770 | [primary] Waiting on logger
2019-06-19 19:25:10.965892 | [primary] Waiting on logger
2019-06-19 19:25:11.113880 | [primary] Waiting on logger
2019-06-19 19:25:11.263012 | [primary] Waiting on logger
2019-06-19 19:25:11.410913 | [primary] Waiting on logger
2019-06-19 19:25:11.559741 | [primary] Waiting on logger
2019-06-19 19:25:11.707915 | [primary] Waiting on logger
2019-06-19 19:25:11.855995 | [primary] Waiting on logger
2019-06-19 19:25:12.005023 | [primary] Waiting on logger
2019-06-19 19:25:12.151975 | [primary] Waiting on logger
2019-06-19 19:25:12.300128 | [primary] Waiting on logger
2019-06-19 19:25:12.447554 | [primary] Waiting on logger
2019-06-19 19:25:12.595862 | [primary] Waiting on logger
2019-06-19 19:25:12.745944 | [primary] Waiting on logger
2019-06-19 19:25:12.894177 | [primary] Waiting on logger
2019-06-19 19:25:13.042598 | [primary] Waiting on logger
2019-06-19 19:25:13.191327 | [primary] Waiting on logger
2019-06-19 19:25:13.342331 | [primary] Waiting on logger
2019-06-19 19:25:13.499557 | [primary] Waiting on logger
2019-06-19 19:25:13.648468 | [primary] Waiting on logger
2019-06-19 19:25:13.796248 | [primary] Waiting on logger
2019-06-19 19:25:13.944535 | [primary] Waiting on logger
2019-06-19 19:25:14.095577 | [primary] Waiting on logger
2019-06-19 19:25:14.244625 | [primary] Waiting on logger
2019-06-19 19:25:14.393603 | [primary] Waiting on logger
2019-06-19 19:25:14.542644 | [primary] Waiting on logger
2019-06-19 19:25:14.690596 | [primary] Waiting on logger
2019-06-19 19:25:14.839452 | [primary] Waiting on logger
2019-06-19 19:25:14.989613 | [primary] Waiting on logger
2019-06-19 19:25:15.137652 | [primary] Waiting on logger
2019-06-19 19:25:15.286600 | [primary] Waiting on logger
2019-06-19 19:25:15.434709 | [primary] Waiting on logger
2019-06-19 19:25:15.582656 | [primary] Waiting on logger
2019-06-19 19:25:15.732721 | [primary] Waiting on logger
2019-06-19 19:25:15.880561 | [primary] Waiting on logger
2019-06-19 19:25:16.028872 | [primary] Waiting on logger
2019-06-19 19:25:16.176928 | [primary] Waiting on logger
2019-06-19 19:25:16.324941 | [primary] Waiting on logger
2019-06-19 19:25:16.472949 | [primary] Waiting on logger
2019-06-19 19:25:16.621026 | [primary] Waiting on logger
2019-06-19 19:25:16.769166 | [primary] Waiting on logger
2019-06-19 19:25:16.918538 | [primary] Waiting on logger
2019-06-19 19:25:17.065846 | [primary] Waiting on logger
2019-06-19 19:25:17.213914 | [primary] Waiting on logger
2019-06-19 19:25:17.360967 | [primary] Waiting on logger
2019-06-19 19:25:17.509101 | [primary] Waiting on logger

7968b5e93378 rdoci/zuul:6afa22c9 "/usr/bin/dumb-ini..." 38 minutes ago Exited (0) 37 minutes ago tripleo-ci-reproducer_gerritconfig_1

wes hayutin (weshayutin) wrote :

looking in the compose logs... is this related? A zuul config error

web_1 | 2019-06-19 19:32:33,565 - gear.Client.b'unknown' - DEBUG - Job complete; <gear.Job 0x7f4efa492978 handle: b'H:::ffff:172.18.0.9:113' name: zuul:config_errors_list unique: 1560972753.5461595> data: ['[{"source_context": {"project": "openstack/tripleo-ci", "branch": "master", "path": "zuul.d/build-image.yaml"}, "error": "Zuul encountered a syntax error while parsing its configuration in the\\nrepo openstack/tripleo-ci on branch master. The error was:\\n\\n Unknown project opendev.org/openstack/diskimage-builder\\n\\nThe error appears in the following job stanza:\\n\\n job:\\n name: tripleo-buildimage-ironic-python-agent-centos-7\\n parent: tripleo-ci-base-singlenode\\n run: playbooks/tripleo-buildimage/run-v3.yaml\\n post-run: playbooks/tripleo-buildimage/post.yaml\\n ti

wes hayutin (weshayutin) wrote :

oh wait... maybe this is an ovb issue?

wes hayutin (weshayutin) wrote :

whayutin•/tmp ᐅ openstack image list | grep bmc thinkdoe ⌚ 14:25:28
| c59224e2-c5df-4a86-b7b6-49556d8c7f5c | bmc-base | active |
| b145783b-07e0-4e4a-b99a-d094cdbb6386 | bmc-template | active |
| c1f9afa1-2f96-4264-8e06-5c111a9966ba | bmc-template | active |
whayutin•/tmp ᐅ

wes hayutin (weshayutin) wrote :

removed shared, bmc-template, kept the public one :)
whayutin•RDO-CI/TRIPLEO-QUICKSTART/review.rdoproject.org-config ᐅ openstack image list | grep bmc  review/arx_cruz/periodic-reproducer-job✔ thinkdoe ⌚ 14:40:49
| c59224e2-c5df-4a86-b7b6-49556d8c7f5c | bmc-base | active |
| c1f9afa1-2f96-4264-8e06-5c111a9966ba | bmc-template | active |

noticed the following

web_1 | 2019-06-19 20:37:10,495 - zuul.web - DEBUG - Connecting to finger server None:None
web_1 | 2019-06-19 20:37:10,495 - zuul.web - ERROR - Error processing websocket message:
web_1 | Traceback (most recent call last):
web_1 | File "/usr/local/lib/python3.7/site-packages/zuul/web/__init__.py", line 100, in received_message
web_1 | self._streamLog(req)
web_1 | File "/usr/local/lib/python3.7/site-packages/zuul/web/__init__.py", line 142, in _streamLog
web_1 | request['uuid'])
web_1 | File "/usr/local/lib/python3.7/site-packages/zuul/web/__init__.py", line 160, in __init__
web_1 | (server, port), timeout=10)
web_1 | File "/usr/local/lib/python3.7/socket.py", line 707, in create_connection
web_1 | for res in getaddrinfo(host, port, 0, SOCK_STREAM):
web_1 | File "/usr/local/lib/python3.7/socket.py", line 748, in getaddrinfo
web_1 | for res in _socket.getaddrinfo(host, port, family, type, proto, flags):

2019-06-19 20:39:07.392576 | Timeout exception waiting for the logger. Please check connectivity to [38.145.35.48:19885]

wes hayutin (weshayutin) wrote :

19-06-19 20:45:57.183603 | [primary] Waiting on logger
2019-06-19 20:45:57.331687 | [primary] Waiting on logger
2019-06-19 20:45:57.479783 | [primary] Waiting on logger
2019-06-19 20:45:57.552091 | [Zuul] Log Stream did not terminate
2019-06-19 20:45:57.553105 | primary | ERROR
2019-06-19 20:45:57.553534 | primary | {
2019-06-19 20:45:57.553706 | primary | "delta": "0:00:00.017255",
2019-06-19 20:45:57.553896 | primary | "end": "2019-06-19 20:45:27.487103",
2019-06-19 20:45:57.554084 | primary | "msg": "non-zero return code",
2019-06-19 20:45:57.554263 | primary | "rc": 1,
2019-06-19 20:45:57.554466 | primary | "start": "2019-06-19 20:45:27.469848"
2019-06-19 20:45:57.554609 | primary | }
2019-06-19 20:45:57.583643 |
2019-06-19 20:45:57.583795 | PLAY RECAP
2019-06-19 20:45:57.583926 | primary | ok: 1 changed: 0 unreachable: 0 failed: 1
2019-06-19 20:45:57.584013 |
2019-06-19 20:45:57.627574 | [primary] Waiting on logger
2019-06-19 20:45:57.814523 | POST-RUN END RESULT_UNREACHABLE: [trusted : gerrit/zuul-config/playbooks/tripleo-rdo-base/post-ovb-delete.yaml@master]
2019-06-19 20:45:57.814675 | POST-RUN START: [untrusted : opendev.org/openstack/tripleo-ci/playbooks/tripleo-ci/post.yaml@master]
2019-06-19 20:45:59.359020 |
2019-06-19 20:45:59.359145 | PLAY [Write console log to localhost as fact zuul_console_json]
2019-06-19 20:45:59.391306 |
2019-06-19 20:45:59.391468 | TASK [capture console log json as fact]
2019-06-19 20:45:59.480064 | localhost | ok
2019-06-19 20:45:59.548224 |
2019-06-19 20:45:59.548340 | PLAY [Collect logs]
2019-06-19 20:45:59.603123 |
2019-06-19 20:45:59.603281 | TASK [set collection timeout]
2019-06-19 20:45:59.702726 | primary | ok
2019-06-19 20:45:59.754870 |
2019-06-19 20:45:59.755032 | TASK [Copy zuul_console_json log to workspace for reproducer]
2019-06-19 20:46:02.445121 | primary | ERROR
2019-06-19 20:46:02.445438 | primary | {
2019-06-19 20:46:02.445514 | primary | "checksum": "0fa54c3e9908d85875153f4c2d9f43922b08d114",
2019-06-19 20:46:02.445572 | primary | "diff": [],
2019-06-19 20:46:02.445624 | primary | "msg": "Destination directory /home/zuul/workspace/logs does not exist"
2019-06-19 20:46:02.445680 | primary | }

wes hayutin (weshayutin) wrote :

2019-06-19 20:53:17.297069 | primary | ok: 30 changed: 17 unreachable: 1 failed: 0
2019-06-19 20:53:17.297116 |
2019-06-19 20:53:17.511527 | PRE-RUN END RESULT_UNREACHABLE: [trusted : gerrit/zuul-config/playbooks/base/pre.yaml@master]
2019-06-19 20:53:17.511805 | POST-RUN START: [trusted : gerrit/zuul-config/playbooks/tripleo-rdo-base/post-ovb-delete.yaml@master]

wes hayutin (weshayutin) wrote :

ah FINALLY, real error

019-06-19 20:56:26.017993 | primary | Output suppressed because no_log was given
2019-06-19 20:56:26.050790 |
2019-06-19 20:56:26.050969 | TASK [mirror-info : Create /etc/ci]
2019-06-19 20:56:50.226007 | primary | ERROR
2019-06-19 20:56:50.226281 | primary | {
2019-06-19 20:56:50.226344 | primary | "msg": "SSH Error: data could not be sent to remote host \"38.145.34.185\". Make sure this host can be reached over ssh",
2019-06-19 20:56:50.226427 | primary | "unreachable": true
2019-06-19 20:56:50.226477 | primary | }
2019-06-19 20:56:50.253249 |
2019-06-19 20:56:50.253422 | PLAY RECAP
2019-06-19 20:56:50.253526 | localhost | ok: 3 changed: 0 unreachable: 0 failed: 0
2019-06-19 20:56:50.253609 | primary | ok: 21 changed: 11 unreachable: 1 failed: 0

Trying to update all zuul images in https://review.rdoproject.org/r/#/c/21389/

Changed in tripleo:
milestone: train-2 → train-3
wes hayutin (weshayutin) wrote :

hasn't happened in a bit.. closing

Changed in tripleo:
status: Triaged → Incomplete
Ronelle Landy (rlandy) wrote :

I am still seeing this error using the reproducer with rdocloud

Changed in tripleo:
status: Incomplete → Triaged
To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers