So noticed it's taking time for network operations(example: docker pull) on an overcloud node.
So for some images it takes time > 10 minutes(ideally should take few seconds as it's local network).
so on affected node all docker pull takes time.
Good to check if it's master only or affects all releases to properly isolate the issue.
So noticed it's taking time for network operations(example: docker pull) on an overcloud node.
So for some images it takes time > 10 minutes(ideally should take few seconds as it's local network).
so on affected node all docker pull takes time.
Good to check if it's master only or affects all releases to properly isolate the issue.
Example 1(14 minute 21 second):- https:/ /logs.rdoprojec t.org/openstack -periodic- master/ opendev. org/openstack/ tripleo- ci/master/ periodic- tripleo- ci-centos- 7-ovb-1ctlr_ 1comp-featurese t002-master- upload/ edd7af2/ logs/undercloud /home/zuul/ overcloud_ deploy. log.txt. gz#_2019- 08-14_03_ 45_18 controller- 0] => { 24.1:8787/ tripleomaster/ centos- binary- cinder- volume: dff0f7b2c1ce50d 9929321f65f1ab2 90f2d042a9_ e8dbf8af- updated- 20190814013900" ,
2019-08-14 03:45:18 | changed: [overcloud-
2019-08-14 03:45:18 |
2019-08-14 03:45:18 | "changed": true,
2019-08-14 03:45:18 | "cmd": "docker pull 192.168.
2019-08-14 03:45:18 | "delta": "0:14:21.982103",
2019-08-14 03:45:18 | "end": "2019-08-14 03:39:27.913156",
2019-08-14 03:45:18 | "rc": 0,
2019-08-14 03:45:18 | "start": "2019-08-14 03:25:05.931053"
2019-08-14 03:45:18 | }
Example 2(10 minute 32 second):- https:/ /logs.rdoprojec t.org/64/ 676364/ 1/openstack- check/tripleo- ci-centos- 7-ovb-3ctlr_ 1comp-featurese t001/19bb5b1/ logs/undercloud /home/zuul/ overcloud_ deploy. log.txt. gz#_2019- 08-15_16_ 38_15
2019-08-15 16:38:15 | changed: [overcloud- controller- 2] => { 24.1:8787/ tripleomaster/ centos- binary- cinder- volume: 6cd9e55d69e90ea 73219abced4e9a3 f2372b204e_ 10e135ca- updated- 20190815144647" ,
2019-08-15 16:38:15 |
2019-08-15 16:38:15 | "changed": true,
2019-08-15 16:38:15 | "cmd": "docker pull 192.168.
2019-08-15 16:38:15 | "delta": "0:10:32.870128",
2019-08-15 16:38:15 | "end": "2019-08-15 16:37:34.438094",
2019-08-15 16:38:15 | "rc": 0,
2019-08-15 16:38:15 | "start": "2019-08-15 16:27:01.567966"
2019-08-15 16:38:15 | }