sysinv 2020-10-20 04:03:30.375 76443 INFO sysinv.agent.lldp.manager [-] Configured sysinv LLDP agent drivers: [] sysinv 2020-10-20 04:03:30.376 76443 INFO sysinv.agent.lldp.manager [-] Loaded sysinv LLDP agent drivers: [] sysinv 2020-10-20 04:03:30.376 76443 INFO sysinv.agent.lldp.manager [-] Registered sysinv LLDP agent drivers: [] sysinv 2020-10-20 04:03:30.407 76443 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:03:31.109 77572 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:03:31.409 76443 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:03:31.415 76443 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 3 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:03:32.111 77572 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:03:32.117 77572 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 3 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:03:34.418 76443 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:03:34.424 76443 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 5 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:03:35.120 77572 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:03:35.126 77572 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 5 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:03:39.427 76443 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:03:39.433 76443 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 7 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:03:40.129 77572 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:03:40.135 77572 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 7 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:03:46.436 76443 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:03:46.441 76443 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 9 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:03:47.137 77572 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:03:47.143 77572 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 9 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:03:55.446 76443 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:03:55.513 76443 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on localhost:5672 sysinv 2020-10-20 04:03:55.524 76443 INFO sysinv.agent.manager [-] _report_to_conductor initial_reports_required=set(['pci_device', 'pv', 'cpu', 'lvg', 'numa', 'memory', 'disk', 'port']) sysinv 2020-10-20 04:03:55.524 76443 INFO sysinv.agent.manager [-] Sysinv Agent audit running inv_get_and_report. sysinv 2020-10-20 04:03:56.147 77572 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:03:56.154 77572 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on localhost:5672 sysinv 2020-10-20 04:03:56.162 77572 INFO sysinv.fpga_agent.manager [-] sysinv-fpga-agent started sysinv 2020-10-20 04:03:56.162 77572 INFO sysinv.fpga_agent.manager [-] Waiting for docker login flag. sysinv 2020-10-20 04:03:56.879 76443 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on localhost:5672 sysinv 2020-10-20 04:04:00.954 84436 INFO migrate.versioning.api [-] 0 -> 1... sysinv 2020-10-20 04:04:01.800 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:01.800 84436 INFO migrate.versioning.api [-] 1 -> 2... sysinv 2020-10-20 04:04:03.745 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:03.746 84436 INFO migrate.versioning.api [-] 2 -> 3... sysinv 2020-10-20 04:04:03.751 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:03.752 84436 INFO migrate.versioning.api [-] 3 -> 4... sysinv 2020-10-20 04:04:03.757 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:03.757 84436 INFO migrate.versioning.api [-] 4 -> 5... sysinv 2020-10-20 04:04:03.761 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:03.761 84436 INFO migrate.versioning.api [-] 5 -> 6... sysinv 2020-10-20 04:04:03.768 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:03.768 84436 INFO migrate.versioning.api [-] 6 -> 7... sysinv 2020-10-20 04:04:03.772 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:03.772 84436 INFO migrate.versioning.api [-] 7 -> 8... sysinv 2020-10-20 04:04:03.778 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:03.778 84436 INFO migrate.versioning.api [-] 8 -> 9... sysinv 2020-10-20 04:04:03.788 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:03.788 84436 INFO migrate.versioning.api [-] 9 -> 10... sysinv 2020-10-20 04:04:03.794 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:03.794 84436 INFO migrate.versioning.api [-] 10 -> 11... sysinv 2020-10-20 04:04:03.798 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:03.798 84436 INFO migrate.versioning.api [-] 11 -> 12... sysinv 2020-10-20 04:04:03.805 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:03.805 84436 INFO migrate.versioning.api [-] 12 -> 13... sysinv 2020-10-20 04:04:03.811 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:03.811 84436 INFO migrate.versioning.api [-] 13 -> 14... sysinv 2020-10-20 04:04:03.817 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:03.817 84436 INFO migrate.versioning.api [-] 14 -> 15... sysinv 2020-10-20 04:04:03.822 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:03.822 84436 INFO migrate.versioning.api [-] 15 -> 16... sysinv 2020-10-20 04:04:03.828 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:03.828 84436 INFO migrate.versioning.api [-] 16 -> 17... sysinv 2020-10-20 04:04:03.831 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:03.831 84436 INFO migrate.versioning.api [-] 17 -> 18... sysinv 2020-10-20 04:04:03.838 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:03.838 84436 INFO migrate.versioning.api [-] 18 -> 19... sysinv 2020-10-20 04:04:03.842 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:03.842 84436 INFO migrate.versioning.api [-] 19 -> 20... sysinv 2020-10-20 04:04:03.848 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:03.849 84436 INFO migrate.versioning.api [-] 20 -> 21... sysinv 2020-10-20 04:04:03.853 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:03.854 84436 INFO migrate.versioning.api [-] 21 -> 22... sysinv 2020-10-20 04:04:03.860 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:03.860 84436 INFO migrate.versioning.api [-] 22 -> 23... sysinv 2020-10-20 04:04:03.864 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:03.864 84436 INFO migrate.versioning.api [-] 23 -> 24... sysinv 2020-10-20 04:04:03.870 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:03.870 84436 INFO migrate.versioning.api [-] 24 -> 25... sysinv 2020-10-20 04:04:03.873 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:03.873 84436 INFO migrate.versioning.api [-] 25 -> 26... sysinv 2020-10-20 04:04:03.886 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:03.886 84436 INFO migrate.versioning.api [-] 26 -> 27... sysinv 2020-10-20 04:04:03.890 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:03.891 84436 INFO migrate.versioning.api [-] 27 -> 28... sysinv 2020-10-20 04:04:03.896 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:03.897 84436 INFO migrate.versioning.api [-] 28 -> 29... sysinv 2020-10-20 04:04:03.901 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:03.901 84436 INFO migrate.versioning.api [-] 29 -> 30... sysinv 2020-10-20 04:04:03.907 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:03.908 84436 INFO migrate.versioning.api [-] 30 -> 31... sysinv 2020-10-20 04:04:03.935 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:03.936 84436 INFO migrate.versioning.api [-] 31 -> 32... sysinv 2020-10-20 04:04:03.959 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:03.959 84436 INFO migrate.versioning.api [-] 32 -> 33... sysinv 2020-10-20 04:04:03.991 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:03.991 84436 INFO migrate.versioning.api [-] 33 -> 34... sysinv 2020-10-20 04:04:04.226 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:04.227 84436 INFO migrate.versioning.api [-] 34 -> 35... sysinv 2020-10-20 04:04:04.245 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:04.245 84436 INFO migrate.versioning.api [-] 35 -> 36... sysinv 2020-10-20 04:04:04.383 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:04.383 84436 INFO migrate.versioning.api [-] 36 -> 37... sysinv 2020-10-20 04:04:04.440 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:04.440 84436 INFO migrate.versioning.api [-] 37 -> 38... sysinv 2020-10-20 04:04:04.611 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:04.611 84436 INFO migrate.versioning.api [-] 38 -> 39... sysinv 2020-10-20 04:04:04.675 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:04.675 84436 INFO migrate.versioning.api [-] 39 -> 40... sysinv 2020-10-20 04:04:04.728 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:04.729 84436 INFO migrate.versioning.api [-] 40 -> 41... sysinv 2020-10-20 04:04:04.839 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:04.840 84436 INFO migrate.versioning.api [-] 41 -> 42... sysinv 2020-10-20 04:04:04.997 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:04.997 84436 INFO migrate.versioning.api [-] 42 -> 43... sysinv 2020-10-20 04:04:05.183 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:05.183 84436 INFO migrate.versioning.api [-] 43 -> 44... sysinv 2020-10-20 04:04:05.344 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:05.344 84436 INFO migrate.versioning.api [-] 44 -> 45... sysinv 2020-10-20 04:04:05.386 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:05.386 84436 INFO migrate.versioning.api [-] 45 -> 46... sysinv 2020-10-20 04:04:05.391 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:05.391 84436 INFO migrate.versioning.api [-] 46 -> 47... sysinv 2020-10-20 04:04:05.398 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:05.398 84436 INFO migrate.versioning.api [-] 47 -> 48... sysinv 2020-10-20 04:04:05.402 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:05.402 84436 INFO migrate.versioning.api [-] 48 -> 49... sysinv 2020-10-20 04:04:05.408 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:05.408 84436 INFO migrate.versioning.api [-] 49 -> 50... sysinv 2020-10-20 04:04:05.643 84436 INFO 050_consolidated_r4 [-] Migrate pv_state sysinv 2020-10-20 04:04:05.735 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:05.735 84436 INFO migrate.versioning.api [-] 50 -> 51... sysinv 2020-10-20 04:04:05.750 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:05.750 84436 INFO migrate.versioning.api [-] 51 -> 52... sysinv 2020-10-20 04:04:05.803 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:05.803 84436 INFO migrate.versioning.api [-] 52 -> 53... sysinv 2020-10-20 04:04:05.903 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:05.903 84436 INFO migrate.versioning.api [-] 53 -> 54... sysinv 2020-10-20 04:04:05.920 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:05.920 84436 INFO migrate.versioning.api [-] 54 -> 55... sysinv 2020-10-20 04:04:06.007 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:06.007 84436 INFO migrate.versioning.api [-] 55 -> 56... sysinv 2020-10-20 04:04:06.048 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:06.049 84436 INFO migrate.versioning.api [-] 56 -> 57... sysinv 2020-10-20 04:04:06.060 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:06.060 84436 INFO migrate.versioning.api [-] 57 -> 58... sysinv 2020-10-20 04:04:06.162 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:06.162 84436 INFO migrate.versioning.api [-] 58 -> 59... sysinv 2020-10-20 04:04:06.177 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:06.177 84436 INFO migrate.versioning.api [-] 59 -> 60... sysinv 2020-10-20 04:04:06.207 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:06.207 84436 INFO migrate.versioning.api [-] 60 -> 61... sysinv 2020-10-20 04:04:06.245 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:06.245 84436 INFO migrate.versioning.api [-] 61 -> 62... sysinv 2020-10-20 04:04:06.276 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:06.276 84436 INFO migrate.versioning.api [-] 62 -> 63... sysinv 2020-10-20 04:04:07.133 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:07.134 84436 INFO migrate.versioning.api [-] 63 -> 64... sysinv 2020-10-20 04:04:07.167 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:07.167 84436 INFO migrate.versioning.api [-] 64 -> 65... sysinv 2020-10-20 04:04:07.294 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:07.295 84436 INFO migrate.versioning.api [-] 65 -> 66... sysinv 2020-10-20 04:04:07.360 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:07.361 84436 INFO migrate.versioning.api [-] 66 -> 67... sysinv 2020-10-20 04:04:07.399 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:07.399 84436 INFO migrate.versioning.api [-] 67 -> 68... sysinv 2020-10-20 04:04:07.484 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:07.485 84436 INFO migrate.versioning.api [-] 68 -> 69... sysinv 2020-10-20 04:04:07.501 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:07.501 84436 INFO migrate.versioning.api [-] 69 -> 70... sysinv 2020-10-20 04:04:07.506 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:07.506 84436 INFO migrate.versioning.api [-] 70 -> 71... sysinv 2020-10-20 04:04:07.555 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:07.555 84436 INFO migrate.versioning.api [-] 71 -> 72... sysinv 2020-10-20 04:04:07.558 84436 INFO 072_remove_ceilometer_service_parameter [-] Deleting ceilometer metering_time_to_live service parameter sysinv 2020-10-20 04:04:07.569 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:07.569 84436 INFO migrate.versioning.api [-] 72 -> 73... sysinv 2020-10-20 04:04:07.608 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:07.609 84436 INFO migrate.versioning.api [-] 73 -> 74... sysinv 2020-10-20 04:04:07.630 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:07.630 84436 INFO migrate.versioning.api [-] 74 -> 75... sysinv 2020-10-20 04:04:07.671 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:07.671 84436 INFO migrate.versioning.api [-] 75 -> 76... sysinv 2020-10-20 04:04:07.745 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:07.745 84436 INFO migrate.versioning.api [-] 76 -> 77... sysinv 2020-10-20 04:04:07.845 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:07.845 84436 INFO migrate.versioning.api [-] 77 -> 78... sysinv 2020-10-20 04:04:07.888 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:07.888 84436 INFO migrate.versioning.api [-] 78 -> 79... sysinv 2020-10-20 04:04:07.921 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:07.921 84436 INFO migrate.versioning.api [-] 79 -> 80... sysinv 2020-10-20 04:04:07.966 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:07.966 84436 INFO migrate.versioning.api [-] 80 -> 81... sysinv 2020-10-20 04:04:08.017 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:08.017 84436 INFO migrate.versioning.api [-] 81 -> 82... sysinv 2020-10-20 04:04:08.038 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:08.038 84436 INFO migrate.versioning.api [-] 82 -> 83... sysinv 2020-10-20 04:04:08.459 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:08.459 84436 INFO migrate.versioning.api [-] 83 -> 84... sysinv 2020-10-20 04:04:08.590 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:08.591 84436 INFO migrate.versioning.api [-] 84 -> 85... sysinv 2020-10-20 04:04:08.644 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:08.644 84436 INFO migrate.versioning.api [-] 85 -> 86... sysinv 2020-10-20 04:04:08.661 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:08.662 84436 INFO migrate.versioning.api [-] 86 -> 87... sysinv 2020-10-20 04:04:08.685 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:08.686 84436 INFO migrate.versioning.api [-] 87 -> 88... sysinv 2020-10-20 04:04:08.728 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:08.728 84436 INFO migrate.versioning.api [-] 88 -> 89... sysinv 2020-10-20 04:04:08.771 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:08.771 84436 INFO migrate.versioning.api [-] 89 -> 90... sysinv 2020-10-20 04:04:08.804 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:08.804 84436 INFO migrate.versioning.api [-] 90 -> 91... sysinv 2020-10-20 04:04:08.822 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:08.822 84436 INFO migrate.versioning.api [-] 91 -> 92... sysinv 2020-10-20 04:04:08.872 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:08.872 84436 INFO migrate.versioning.api [-] 92 -> 93... sysinv 2020-10-20 04:04:08.928 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:08.929 84436 INFO migrate.versioning.api [-] 93 -> 94... sysinv 2020-10-20 04:04:08.981 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:08.981 84436 INFO migrate.versioning.api [-] 94 -> 95... sysinv 2020-10-20 04:04:09.030 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:09.030 84436 INFO migrate.versioning.api [-] 95 -> 96... sysinv 2020-10-20 04:04:09.069 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:09.069 84436 INFO migrate.versioning.api [-] 96 -> 97... sysinv 2020-10-20 04:04:09.120 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:09.120 84436 INFO migrate.versioning.api [-] 97 -> 98... sysinv 2020-10-20 04:04:09.132 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:09.132 84436 INFO migrate.versioning.api [-] 98 -> 99... sysinv 2020-10-20 04:04:09.136 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:09.136 84436 INFO migrate.versioning.api [-] 99 -> 100... sysinv 2020-10-20 04:04:09.140 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:09.140 84436 INFO migrate.versioning.api [-] 100 -> 101... sysinv 2020-10-20 04:04:09.147 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:09.147 84436 INFO migrate.versioning.api [-] 101 -> 102... sysinv 2020-10-20 04:04:09.150 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:09.150 84436 INFO migrate.versioning.api [-] 102 -> 103... sysinv 2020-10-20 04:04:09.156 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:09.156 84436 INFO migrate.versioning.api [-] 103 -> 104... sysinv 2020-10-20 04:04:09.247 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:09.247 84436 INFO migrate.versioning.api [-] 104 -> 105... sysinv 2020-10-20 04:04:09.383 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:09.383 84436 INFO migrate.versioning.api [-] 105 -> 106... sysinv 2020-10-20 04:04:09.441 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:09.441 84436 INFO migrate.versioning.api [-] 106 -> 107... sysinv 2020-10-20 04:04:09.486 84436 INFO migrate.versioning.api [-] done sysinv 2020-10-20 04:04:11.982 84851 INFO sysinv.helm.helm [-] No entry points for systemconfig.helm_applications found. sysinv 2020-10-20 04:04:11.983 84851 INFO sysinv.helm.helm [-] No entry points for systemconfig.armada.manifest_ops found. sysinv 2020-10-20 04:04:11.993 84851 INFO sysinv.conductor.manager [-] sysinv-conductor start committed system={'system_mode': None, 'created_at': datetime.datetime(2020, 10, 20, 4, 4, 11, 893909, tzinfo=), 'uuid': u'c743a346-f508-4abd-9ab8-09fca79d3071', 'software_version': u'20.12', 'service_project_name': None, 'system_type': None, 'name': u'9d36d9ba-bd18-46f6-83c0-7f16a0d3b398', 'description': None, 'location': None, 'updated_at': None, 'capabilities': {}, 'id': 1, 'contact': None, 'security_feature': u'nopti nospectre_v2 nospectre_v1', 'services': 72, 'timezone': None, 'security_profile': u'standard', 'distributed_cloud_role': None, 'region_name': None} sysinv 2020-10-20 04:04:12.030 84851 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on localhost:5672 sysinv 2020-10-20 04:04:12.105 84851 ERROR sysinv.conductor.keystone_listener [-] Failed to get management IP address: Address could not be found for controller-mgmt: AddressNotFoundByName: Address could not be found for controller-mgmt sysinv 2020-10-20 04:04:56.941 76443 INFO sysinv.agent.manager [-] get_ihost_by_macs rpc Timeout. sysinv 2020-10-20 04:04:56.954 87380 WARNING oslo_config.cfg [-] Deprecated: Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S release.). Its value may be silently ignored in the future. sysinv 2020-10-20 04:04:56.955 87380 WARNING oslo_config.cfg [-] Deprecated: Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken". sysinv 2020-10-20 04:04:56.959 87380 WARNING keystonemiddleware.auth_token [-] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. sysinv 2020-10-20 04:04:56.962 87380 INFO oslo.service.wsgi [-] sysinv_api listening on :::6385 sysinv 2020-10-20 04:04:56.963 87380 INFO oslo_service.service [-] Starting 2 workers sysinv 2020-10-20 04:04:56.966 76443 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on localhost:5672 sysinv 2020-10-20 04:04:56.990 84851 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on localhost:5672 sysinv 2020-10-20 04:04:56.994 76443 WARNING sysinv.openstack.common.loopingcall [-] task run outlasted interval by 1.470521 sec sysinv 2020-10-20 04:04:56.995 76443 INFO sysinv.agent.manager [-] _report_to_conductor initial_reports_required=set(['pci_device', 'pv', 'cpu', 'lvg', 'numa', 'memory', 'disk', 'port']) sysinv 2020-10-20 04:04:56.995 76443 INFO sysinv.agent.manager [-] Sysinv Agent audit running inv_get_and_report. sysinv 2020-10-20 04:05:12.240 84851 ERROR sysinv.conductor.kube_app [-] Kubernetes is not configured. API operations will not be available.: KubeNotConfigured: Kubernetes is not configured. API operations will not be available. sysinv 2020-10-20 04:05:33.641 87485 WARNING keystonemiddleware.auth_token [-] Using the in-process token cache is deprecated as of the 4.2.0 release and may be removed in the 5.0.0 release or the 'O' development cycle. The in-process cache causes inconsistent results and high memory usage. When the feature is removed the auth_token middleware will not cache tokens by default which may result in performance issues. It is recommended to use memcache for the auth_token token cache by setting the memcached_servers option. sysinv 2020-10-20 04:05:34.645 87485 INFO sysinv.api.controllers.v1.system [-] update system mode simplex sysinv 2020-10-20 04:05:34.767 87485 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on localhost:5672 sysinv 2020-10-20 04:05:34.783 84851 INFO sysinv.conductor.manager [-] _config_update_hosts config_uuid=c37e4d93-dcf2-4f1d-849c-1d504b1c44ff sysinv 2020-10-20 04:05:34.788 87485 INFO sysinv.api.controllers.v1.system [-] update system timezone to UTC sysinv 2020-10-20 04:05:34.800 84851 INFO sysinv.conductor.manager [-] _config_update_hosts config_uuid=26774083-3a59-4eae-bbe2-aec98ca979f5 sysinv 2020-10-20 04:05:34.800 84851 INFO sysinv.conductor.manager [-] applying runtime manifest config_uuid=26774083-3a59-4eae-bbe2-aec98ca979f5 sysinv 2020-10-20 04:05:34.814 84851 INFO sysinv.agent.rpcapi [-] config_apply_runtime_manifest: fanout_cast: sending config 26774083-3a59-4eae-bbe2-aec98ca979f5 {'force': False, 'personalities': ['worker', 'storage']} to agent sysinv 2020-10-20 04:05:34.822 84851 INFO sysinv.conductor.manager [-] _config_update_hosts config_uuid=56ada8e0-576d-48a7-b8a7-0246e4148c86 sysinv 2020-10-20 04:05:34.822 84851 INFO sysinv.conductor.manager [-] applying runtime manifest config_uuid=56ada8e0-576d-48a7-b8a7-0246e4148c86, classes: ['openstack::horizon::runtime'] sysinv 2020-10-20 04:05:34.834 84851 INFO sysinv.agent.rpcapi [-] config_apply_runtime_manifest: fanout_cast: sending config 56ada8e0-576d-48a7-b8a7-0246e4148c86 {'classes': ['openstack::horizon::runtime'], 'force': False, 'personalities': ['controller']} to agent sysinv 2020-10-20 04:05:36.351 87485 INFO sysinv.api.controllers.v1.dns [-] dns {'uuid': u'7ddaae84-30b8-4a8b-a80b-256bbaf70d84', 'nameservers': u'192.168.100.1', 'created_at': datetime.datetime(2020, 10, 20, 4, 4, 11, 905079, tzinfo=), 'updated_at': None, 'action': None, 'isystem_uuid': u'c743a346-f508-4abd-9ab8-09fca79d3071', 'id': 1, 'forisystemid': 1}; ip_family: ipv4 sysinv 2020-10-20 04:05:36.372 84851 INFO sysinv.conductor.manager [-] _config_update_hosts config_uuid=0a55e06d-9da7-4709-bef8-759dce2797df sysinv 2020-10-20 04:05:36.427 84851 INFO sysinv.conductor.manager [-] Updating parameters configuration for service: docker sysinv 2020-10-20 04:05:36.434 84851 INFO sysinv.conductor.manager [-] _config_update_hosts config_uuid=7c3bf11f-b484-481b-839a-275d85b4cfcd sysinv 2020-10-20 04:05:36.452 84851 INFO sysinv.conductor.manager [-] Updating parameters configuration for service: docker sysinv 2020-10-20 04:05:36.458 84851 INFO sysinv.conductor.manager [-] _config_update_hosts config_uuid=6cdbea3f-0826-4ce5-bd86-5edb8a7d8400 sysinv 2020-10-20 04:05:36.477 84851 INFO sysinv.conductor.manager [-] Updating parameters configuration for service: docker sysinv 2020-10-20 04:05:36.483 84851 INFO sysinv.conductor.manager [-] _config_update_hosts config_uuid=1b9f8870-758e-47e9-8588-80edf5b0ca4f sysinv 2020-10-20 04:05:36.504 84851 INFO sysinv.conductor.manager [-] Updating parameters configuration for service: docker sysinv 2020-10-20 04:05:36.510 84851 INFO sysinv.conductor.manager [-] _config_update_hosts config_uuid=0f3e9502-f814-4b02-a626-8517d04bc53e sysinv 2020-10-20 04:05:36.527 84851 INFO sysinv.conductor.manager [-] Updating parameters configuration for service: docker sysinv 2020-10-20 04:05:36.532 84851 INFO sysinv.conductor.manager [-] _config_update_hosts config_uuid=52578f73-53af-4eb4-866d-8a7702af9a33 sysinv 2020-10-20 04:05:36.575 87485 INFO sysinv.api.controllers.v1.host [-] SYS_I host controller-0 ihost_post_start_2020-10-20-04-05-36 add sysinv 2020-10-20 04:05:36.593 87485 INFO sysinv.api.controllers.v1.host [-] update_subfunctions: subfunctions not set. personality=controller sysinv 2020-10-20 04:05:36.594 87485 INFO sysinv.api.controllers.v1.host [-] BM is to be deprovisioned sysinv 2020-10-20 04:05:36.594 87485 INFO sysinv.api.controllers.v1.host [-] bm_ip in delta=set(['tboot', 'bm_password', 'subfunctions', 'bm_ip', 'rootfs_device', 'bm_username', 'availability', 'console', 'uuid', 'mgmt_ip', 'hostname', 'capabilities', 'operational', 'location', 'invprovision', 'administrative', 'personality', 'reboot_needed', 'boot_device', 'mgmt_mac', 'install_output', 'bm_type']) obm_ip= nbm_ip= sysinv 2020-10-20 04:05:36.594 87485 INFO sysinv.api.controllers.v1.host [-] controller-0 bm semantic checks for user_agent Python-httplib2/0.9.2 (gzip) passed sysinv 2020-10-20 04:05:36.604 84851 INFO sysinv.conductor.manager [-] Local Region Name: RegionOne sysinv 2020-10-20 04:05:36.614 84851 INFO sysinv.conductor.manager [-] Disk size : 476 ... large disk defaults sysinv 2020-10-20 04:05:36.614 84851 INFO sysinv.conductor.manager [-] Creating FS:platform:platform-lv 10 sysinv 2020-10-20 04:05:36.625 84851 INFO sysinv.conductor.manager [-] Creating FS:database:pgsql-lv 10 sysinv 2020-10-20 04:05:36.631 84851 INFO sysinv.conductor.manager [-] Creating FS:extension:extension-lv 1 sysinv 2020-10-20 04:05:36.637 84851 INFO sysinv.conductor.manager [-] Creating FS:etcd:etcd-lv 5 sysinv 2020-10-20 04:05:36.642 84851 INFO sysinv.conductor.manager [-] Creating FS:docker-distribution:dockerdistribution-lv 16 sysinv 2020-10-20 04:05:36.680 84851 INFO sysinv.db.sqlalchemy.api [-] _host_upgrade_create system version=20.12 sysinv 2020-10-20 04:05:36.693 84851 INFO sysinv.common.fm [-] Generating FM Customer Log {'hostid': u'controller-0', 'entity_type': 'host', 'event_id': '200.020', 'entity': u'host=controller-0.event=discovered', 'fm_severity': 'clear', 'reason_text': u"controller-0 has been 'discovered'.", 'fm_event_type': 'equipment'} fmAPI.cpp(140): Failed to connect to FM Manager. fmAPI.cpp(140): Failed to connect to FM Manager. sysinv 2020-10-20 04:05:36.693 84851 WARNING root [-] fm_python_extension: Failed to connect to FM manager: NodeNotFound: Node 00:00:00:00:00:00 could not be found. sysinv 2020-10-20 04:05:36.694 84851 ERROR sysinv.common.fm [-] Failed to generate customer log, fm_uuid=None.: NodeNotFound: Node 00:00:00:00:00:00 could not be found. sysinv 2020-10-20 04:05:36.701 84851 INFO sysinv.conductor.manager [-] configure_ihost controller-0 sysinv 2020-10-20 04:05:37.818 84851 INFO sysinv.conductor.manager [-] Inventory incomplete, will try again in 1 second. sysinv 2020-10-20 04:05:38.826 84851 INFO sysinv.conductor.manager [-] Inventory incomplete, will try again in 1 second. sysinv 2020-10-20 04:05:39.833 84851 INFO sysinv.conductor.manager [-] Inventory incomplete, will try again in 1 second. sysinv 2020-10-20 04:05:40.841 84851 INFO sysinv.conductor.manager [-] Inventory incomplete, will try again in 1 second. sysinv 2020-10-20 04:05:41.849 84851 INFO sysinv.conductor.manager [-] Inventory incomplete, will try again in 1 second. sysinv 2020-10-20 04:05:42.857 84851 INFO sysinv.conductor.manager [-] Inventory incomplete, will try again in 1 second. sysinv 2020-10-20 04:05:43.868 84851 INFO sysinv.conductor.manager [-] Inventory incomplete, will try again in 1 second. sysinv 2020-10-20 04:05:44.875 84851 INFO sysinv.conductor.manager [-] Inventory incomplete, will try again in 1 second. sysinv 2020-10-20 04:05:45.884 84851 INFO sysinv.conductor.manager [-] Inventory incomplete, will try again in 1 second. sysinv 2020-10-20 04:05:46.891 84851 INFO sysinv.conductor.manager [-] Inventory incomplete, will try again in 1 second. sysinv 2020-10-20 04:05:47.898 84851 INFO sysinv.conductor.manager [-] Inventory incomplete, will try again in 1 second. sysinv 2020-10-20 04:05:48.905 84851 INFO sysinv.conductor.manager [-] Inventory incomplete, will try again in 1 second. sysinv 2020-10-20 04:05:49.913 84851 INFO sysinv.conductor.manager [-] Inventory incomplete, will try again in 1 second. sysinv 2020-10-20 04:05:50.921 84851 INFO sysinv.conductor.manager [-] Inventory incomplete, will try again in 1 second. sysinv 2020-10-20 04:05:51.929 84851 INFO sysinv.conductor.manager [-] Inventory incomplete, will try again in 1 second. sysinv 2020-10-20 04:05:52.938 84851 INFO sysinv.conductor.manager [-] Inventory incomplete, will try again in 1 second. sysinv 2020-10-20 04:05:53.946 84851 INFO sysinv.conductor.manager [-] Inventory incomplete, will try again in 1 second. sysinv 2020-10-20 04:05:54.953 84851 INFO sysinv.conductor.manager [-] Inventory incomplete, will try again in 1 second. sysinv 2020-10-20 04:05:55.961 84851 INFO sysinv.conductor.manager [-] Inventory incomplete, will try again in 1 second. sysinv 2020-10-20 04:05:56.968 84851 INFO sysinv.conductor.manager [-] Inventory incomplete, will try again in 1 second. sysinv 2020-10-20 04:05:57.976 84851 INFO sysinv.conductor.manager [-] Inventory incomplete, will try again in 1 second. sysinv 2020-10-20 04:05:58.443 84851 INFO sysinv.conductor.manager [-] Updating platform data for host: 448a679f-bf8a-4819-8602-c0123f481cdb with: {u'first_report': True, u'action_state': u'reinstalled'} sysinv 2020-10-20 04:05:58.452 84851 INFO sysinv.conductor.manager [-] controller-0 updating action_state=reinstalled sysinv 2020-10-20 04:05:58.466 76443 INFO sysinv.agent.manager [-] Removed /etc/platform/.first_boot sysinv 2020-10-20 04:05:58.467 76443 INFO sysinv.agent.manager [-] Sysinv Agent platform update by host: {'first_report': True, 'action_state': 'reinstalled'} sysinv 2020-10-20 04:05:58.467 76443 INFO sysinv.agent.manager [-] Agent found matching ihost: 448a679f-bf8a-4819-8602-c0123f481cdb sysinv 2020-10-20 04:05:58.467 76443 INFO sysinv.agent.manager [-] _report_to_conductor initial_reports_required=set(['pci_device', 'pv', 'cpu', 'lvg', 'numa', 'memory', 'disk', 'port']) sysinv 2020-10-20 04:05:58.664 84851 INFO sysinv.conductor.manager [-] Attempting to create new port {u'dev_id': 0, u'sriov_numvfs': u'0\n', u'link_mode': u'0', u'driver': u'i40e', 'bootp': None, u'prevision': u'-r02', u'dpdksupport': True, u'mac': u'3c:fd:fe:e6:13:f0', u'sriov_vf_pdevice_id': None, 'host_id': 1, 'interface_id': 1, u'speed': u'10000', u'psvendor': u'Intel Corporation [8086]', u'numa_node': u'0', u'pclass': u'Ethernet controller [0200]', u'mtu': u'1500', u'pvendor': u'Intel Corporation [8086]', u'sriov_vfs_pci_address': u'', u'psdevice': u'Ethernet Converged Network Adapter X710-2 [0008]', u'pciaddr': u'0000:18:00.0', u'pdevice': u'Ethernet Controller X710 for 10GbE SFP+ [1572]', u'pname': u'enp24s0f0', u'sriov_vf_driver': None, u'sriov_totalvfs': u'64\n'} on host 448a679f-bf8a-4819-8602-c0123f481cdb sysinv 2020-10-20 04:05:58.896 84851 INFO sysinv.conductor.manager [-] Attempting to create new port {u'dev_id': 0, u'sriov_numvfs': u'0\n', u'link_mode': u'0', u'driver': u'i40e', 'bootp': None, u'prevision': u'-r02', u'dpdksupport': True, u'mac': u'3c:fd:fe:e6:13:f1', u'sriov_vf_pdevice_id': None, 'host_id': 1, 'interface_id': 2, u'speed': u'10000', u'psvendor': u'Intel Corporation [8086]', u'numa_node': u'0', u'pclass': u'Ethernet controller [0200]', u'mtu': u'1500', u'pvendor': u'Intel Corporation [8086]', u'sriov_vfs_pci_address': u'', u'psdevice': u'Ethernet Converged Network Adapter X710 [0000]', u'pciaddr': u'0000:18:00.1', u'pdevice': u'Ethernet Controller X710 for 10GbE SFP+ [1572]', u'pname': u'enp24s0f1', u'sriov_vf_driver': None, u'sriov_totalvfs': u'64\n'} on host 448a679f-bf8a-4819-8602-c0123f481cdb sysinv 2020-10-20 04:05:58.998 84851 INFO sysinv.conductor.manager [-] Inventory incomplete, will try again in 1 second. sysinv 2020-10-20 04:05:59.014 84851 INFO sysinv.conductor.manager [-] Attempting to create new port {u'dev_id': 0, u'sriov_numvfs': u'0\n', u'link_mode': u'0', u'driver': u'i40e', 'bootp': None, u'prevision': u'-r09', u'dpdksupport': True, u'mac': u'a4:bf:01:71:44:62', u'sriov_vf_pdevice_id': None, 'host_id': 1, 'interface_id': 3, u'speed': u'10000', u'psvendor': u'Intel Corporation [8086]', u'numa_node': u'0', u'pclass': u'Ethernet controller [0200]', u'mtu': u'1500', u'pvendor': u'Intel Corporation [8086]', u'sriov_vfs_pci_address': u'', u'psdevice': u'Device [35ce]', u'pciaddr': u'0000:3d:00.0', u'pdevice': u'Ethernet Connection X722 for 10GBASE-T [37d2]', u'pname': u'eno1', u'sriov_vf_driver': None, u'sriov_totalvfs': u'32\n'} on host 448a679f-bf8a-4819-8602-c0123f481cdb sysinv 2020-10-20 04:05:59.133 84851 INFO sysinv.conductor.manager [-] Attempting to create new port {u'dev_id': 0, u'sriov_numvfs': u'0\n', u'link_mode': u'0', u'driver': u'i40e', 'bootp': None, u'prevision': u'-r09', u'dpdksupport': True, u'mac': u'a4:bf:01:71:44:63', u'sriov_vf_pdevice_id': None, 'host_id': 1, 'interface_id': 4, u'speed': u'10000', u'psvendor': u'Intel Corporation [8086]', u'numa_node': u'0', u'pclass': u'Ethernet controller [0200]', u'mtu': u'1500', u'pvendor': u'Intel Corporation [8086]', u'sriov_vfs_pci_address': u'', u'psdevice': u'Device [35ce]', u'pciaddr': u'0000:3d:00.1', u'pdevice': u'Ethernet Connection X722 for 10GBASE-T [37d2]', u'pname': u'eno2', u'sriov_vf_driver': None, u'sriov_totalvfs': u'32\n'} on host 448a679f-bf8a-4819-8602-c0123f481cdb sysinv 2020-10-20 04:05:59.181 84851 INFO sysinv.conductor.manager [-] Attempting to create new device {u'sriov_numvfs': 0, u'driver': None, u'prevision': u'-r09', u'sriov_vf_driver': None, u'sriov_vf_pdevice_id': None, 'host_id': 1, u'psvendor': u'Intel Corporation', u'extra_info': None, u'name': u'pci_0000_00_11_0', u'numa_node': u'0', u'pdevice_id': u'a1ec', u'pclass': u'Unassigned class [ff00]', u'pvendor': u'Intel Corporation', u'sriov_vfs_pci_address': u'', u'psdevice': u'Device 0000', u'pciaddr': u'0000:00:11.0', u'pdevice': u'C620 Series Chipset Family MROM 0', u'pvendor_id': u'8086', u'pclass_id': u'ff0000', u'enabled': False, u'sriov_totalvfs': None} on host 1 sysinv 2020-10-20 04:05:59.202 84851 INFO sysinv.conductor.manager [-] Attempting to create new device {u'sriov_numvfs': 0, u'driver': None, u'prevision': u'-r09', u'sriov_vf_driver': None, u'sriov_vf_pdevice_id': None, 'host_id': 1, u'psvendor': u'Intel Corporation', u'extra_info': None, u'name': u'pci_0000_00_11_1', u'numa_node': u'0', u'pdevice_id': u'a1ed', u'pclass': u'Unassigned class [ff00]', u'pvendor': u'Intel Corporation', u'sriov_vfs_pci_address': u'', u'psdevice': u'Device 35ce', u'pciaddr': u'0000:00:11.1', u'pdevice': u'C620 Series Chipset Family MROM 1', u'pvendor_id': u'8086', u'pclass_id': u'ff0000', u'enabled': False, u'sriov_totalvfs': None} on host 1 sysinv 2020-10-20 04:05:59.220 84851 INFO sysinv.conductor.manager [-] Attempting to create new device {u'sriov_numvfs': 0, u'driver': u'ahci', u'prevision': u'-r09', u'sriov_vf_driver': None, u'sriov_vf_pdevice_id': None, 'host_id': 1, u'psvendor': u'-p01', u'extra_info': None, u'name': u'pci_0000_00_11_5', u'numa_node': u'0', u'pdevice_id': u'a1d2', u'pclass': u'SATA controller', u'pvendor': u'Intel Corporation', u'sriov_vfs_pci_address': u'', u'psdevice': u'Intel Corporation', u'pciaddr': u'0000:00:11.5', u'pdevice': u'C620 Series Chipset Family SSATA Controller [AHCI mode]', u'pvendor_id': u'8086', u'pclass_id': u'010601', u'enabled': False, u'sriov_totalvfs': None} on host 1 sysinv 2020-10-20 04:05:59.239 84851 INFO sysinv.conductor.manager [-] Attempting to create new device {u'sriov_numvfs': 0, u'driver': None, u'prevision': u'-r09', u'sriov_vf_driver': None, u'sriov_vf_pdevice_id': None, 'host_id': 1, u'psvendor': u'-p30', u'extra_info': None, u'name': u'pci_0000_00_14_0', u'numa_node': u'0', u'pdevice_id': u'a1af', u'pclass': u'USB controller', u'pvendor': u'Intel Corporation', u'sriov_vfs_pci_address': u'', u'psdevice': u'Intel Corporation', u'pciaddr': u'0000:00:14.0', u'pdevice': u'C620 Series Chipset Family USB 3.0 xHCI Controller', u'pvendor_id': u'8086', u'pclass_id': u'0c0330', u'enabled': False, u'sriov_totalvfs': None} on host 1 sysinv 2020-10-20 04:05:59.257 84851 INFO sysinv.conductor.manager [-] Attempting to create new device {u'sriov_numvfs': 0, u'driver': None, u'prevision': u'-r09', u'sriov_vf_driver': None, u'sriov_vf_pdevice_id': None, 'host_id': 1, u'psvendor': u'Intel Corporation', u'extra_info': None, u'name': u'pci_0000_00_14_2', u'numa_node': u'0', u'pdevice_id': u'a1b1', u'pclass': u'Signal processing controller', u'pvendor': u'Intel Corporation', u'sriov_vfs_pci_address': u'', u'psdevice': u'Device 35ce', u'pciaddr': u'0000:00:14.2', u'pdevice': u'C620 Series Chipset Family Thermal Subsystem', u'pvendor_id': u'8086', u'pclass_id': u'118000', u'enabled': False, u'sriov_totalvfs': None} on host 1 sysinv 2020-10-20 04:05:59.276 84851 INFO sysinv.conductor.manager [-] Attempting to create new device {u'sriov_numvfs': 0, u'driver': u'mei_me', u'prevision': u'-r09', u'sriov_vf_driver': None, u'sriov_vf_pdevice_id': None, 'host_id': 1, u'psvendor': u'Intel Corporation', u'extra_info': None, u'name': u'pci_0000_00_16_0', u'numa_node': u'0', u'pdevice_id': u'a1ba', u'pclass': u'Communication controller', u'pvendor': u'Intel Corporation', u'sriov_vfs_pci_address': u'', u'psdevice': u'Device 35ce', u'pciaddr': u'0000:00:16.0', u'pdevice': u'C620 Series Chipset Family MEI Controller #1', u'pvendor_id': u'8086', u'pclass_id': u'078000', u'enabled': False, u'sriov_totalvfs': None} on host 1 sysinv 2020-10-20 04:05:59.295 84851 INFO sysinv.conductor.manager [-] Attempting to create new device {u'sriov_numvfs': 0, u'driver': None, u'prevision': u'-r09', u'sriov_vf_driver': None, u'sriov_vf_pdevice_id': None, 'host_id': 1, u'psvendor': u'Intel Corporation', u'extra_info': None, u'name': u'pci_0000_00_16_1', u'numa_node': u'0', u'pdevice_id': u'a1bb', u'pclass': u'Communication controller', u'pvendor': u'Intel Corporation', u'sriov_vfs_pci_address': u'', u'psdevice': u'Device 35ce', u'pciaddr': u'0000:00:16.1', u'pdevice': u'C620 Series Chipset Family MEI Controller #2', u'pvendor_id': u'8086', u'pclass_id': u'078000', u'enabled': False, u'sriov_totalvfs': None} on host 1 sysinv 2020-10-20 04:05:59.313 84851 INFO sysinv.conductor.manager [-] Attempting to create new device {u'sriov_numvfs': 0, u'driver': None, u'prevision': u'-r09', u'sriov_vf_driver': None, u'sriov_vf_pdevice_id': None, 'host_id': 1, u'psvendor': u'Intel Corporation', u'extra_info': None, u'name': u'pci_0000_00_16_4', u'numa_node': u'0', u'pdevice_id': u'a1be', u'pclass': u'Communication controller', u'pvendor': u'Intel Corporation', u'sriov_vfs_pci_address': u'', u'psdevice': u'Device 35ce', u'pciaddr': u'0000:00:16.4', u'pdevice': u'C620 Series Chipset Family MEI Controller #3', u'pvendor_id': u'8086', u'pclass_id': u'078000', u'enabled': False, u'sriov_totalvfs': None} on host 1 sysinv 2020-10-20 04:05:59.332 84851 INFO sysinv.conductor.manager [-] Attempting to create new device {u'sriov_numvfs': 0, u'driver': u'ahci', u'prevision': u'-r09', u'sriov_vf_driver': None, u'sriov_vf_pdevice_id': None, 'host_id': 1, u'psvendor': u'-p01', u'extra_info': None, u'name': u'pci_0000_00_17_0', u'numa_node': u'0', u'pdevice_id': u'a182', u'pclass': u'SATA controller', u'pvendor': u'Intel Corporation', u'sriov_vfs_pci_address': u'', u'psdevice': u'Intel Corporation', u'pciaddr': u'0000:00:17.0', u'pdevice': u'C620 Series Chipset Family SATA Controller [AHCI mode]', u'pvendor_id': u'8086', u'pclass_id': u'010601', u'enabled': False, u'sriov_totalvfs': None} on host 1 sysinv 2020-10-20 04:05:59.350 84851 INFO sysinv.conductor.manager [-] Attempting to create new device {u'sriov_numvfs': 0, u'driver': None, u'prevision': u'-r09', u'sriov_vf_driver': None, u'sriov_vf_pdevice_id': None, 'host_id': 1, u'psvendor': u'Intel Corporation', u'extra_info': None, u'name': u'pci_0000_00_1f_2', u'numa_node': u'0', u'pdevice_id': u'a1a1', u'pclass': u'Memory controller', u'pvendor': u'Intel Corporation', u'sriov_vfs_pci_address': u'', u'psdevice': u'Device 35ce', u'pciaddr': u'0000:00:1f.2', u'pdevice': u'C620 Series Chipset Family Power Management Controller', u'pvendor_id': u'8086', u'pclass_id': u'058000', u'enabled': False, u'sriov_totalvfs': None} on host 1 sysinv 2020-10-20 04:05:59.368 84851 INFO sysinv.conductor.manager [-] Attempting to create new device {u'sriov_numvfs': 0, u'driver': u'i801_smbus', u'prevision': u'-r09', u'sriov_vf_driver': None, u'sriov_vf_pdevice_id': None, 'host_id': 1, u'psvendor': u'Intel Corporation', u'extra_info': None, u'name': u'pci_0000_00_1f_4', u'numa_node': u'0', u'pdevice_id': u'a1a3', u'pclass': u'SMBus', u'pvendor': u'Intel Corporation', u'sriov_vfs_pci_address': u'', u'psdevice': u'Device 35ce', u'pciaddr': u'0000:00:1f.4', u'pdevice': u'C620 Series Chipset Family SMBus', u'pvendor_id': u'8086', u'pclass_id': u'0c0500', u'enabled': False, u'sriov_totalvfs': None} on host 1 sysinv 2020-10-20 04:05:59.387 84851 INFO sysinv.conductor.manager [-] Attempting to create new device {u'sriov_numvfs': 0, u'driver': None, u'prevision': u'-r09', u'sriov_vf_driver': None, u'sriov_vf_pdevice_id': None, 'host_id': 1, u'psvendor': u'Intel Corporation', u'extra_info': None, u'name': u'pci_0000_00_1f_5', u'numa_node': u'0', u'pdevice_id': u'a1a4', u'pclass': u'Serial bus controller [0c80]', u'pvendor': u'Intel Corporation', u'sriov_vfs_pci_address': u'', u'psdevice': u'Device 35ce', u'pciaddr': u'0000:00:1f.5', u'pdevice': u'C620 Series Chipset Family SPI Controller', u'pvendor_id': u'8086', u'pclass_id': u'0c8000', u'enabled': False, u'sriov_totalvfs': None} on host 1 sysinv 2020-10-20 04:05:59.405 84851 INFO sysinv.conductor.manager [-] Attempting to create new device {u'sriov_numvfs': 0, u'driver': None, u'prevision': u'-r41', u'sriov_vf_driver': None, u'sriov_vf_pdevice_id': None, 'host_id': 1, u'psvendor': u'ASPEED Technology, Inc.', u'extra_info': None, u'name': u'pci_0000_02_00_0', u'numa_node': u'0', u'pdevice_id': u'2000', u'pclass': u'VGA compatible controller', u'pvendor': u'ASPEED Technology, Inc.', u'sriov_vfs_pci_address': u'', u'psdevice': u'ASPEED Graphics Family', u'pciaddr': u'0000:02:00.0', u'pdevice': u'ASPEED Graphics Family', u'pvendor_id': u'1a03', u'pclass_id': u'030000', u'enabled': True, u'sriov_totalvfs': None} on host 1 sysinv 2020-10-20 04:05:59.751 84851 INFO sysinv.conductor.manager [-] Logical CPU topology: host:controller-0 (controller,worker), sockets:2, cores/socket=25, threads/core=2, reference:current (initial) sysinv 2020-10-20 04:05:59.751 84851 INFO sysinv.conductor.manager [-] cpu_id : 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 sysinv 2020-10-20 04:05:59.752 84851 INFO sysinv.conductor.manager [-] socket_id : 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 sysinv 2020-10-20 04:05:59.752 84851 INFO sysinv.conductor.manager [-] core_id : 0 1 2 3 4 5 6 9 10 11 12 13 16 17 18 19 20 21 24 25 26 27 28 29 0 1 2 3 4 5 6 8 9 10 11 12 13 16 17 18 19 20 21 25 26 27 28 29 0 1 2 3 4 5 6 9 10 11 12 13 16 17 18 19 20 21 24 25 26 27 28 29 0 1 2 3 4 5 6 8 9 10 11 12 13 16 17 18 19 20 21 25 26 27 28 29 sysinv 2020-10-20 04:05:59.752 84851 INFO sysinv.conductor.manager [-] thread_id : 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 sysinv 2020-10-20 04:06:00.017 84851 INFO sysinv.conductor.manager [-] Inventory incomplete, will try again in 1 second. sysinv 2020-10-20 04:06:00.384 84851 INFO sysinv.conductor.manager [-] Update CPU grub config, host_uuid (448a679f-bf8a-4819-8602-c0123f481cdb), name (controller-0) sysinv 2020-10-20 04:06:00.391 84851 INFO sysinv.conductor.manager [-] update_grub_config, host uuid: (448a679f-bf8a-4819-8602-c0123f481cdb), force: (False) sysinv 2020-10-20 04:06:00.397 84851 INFO sysinv.conductor.manager [-] Setting config target of host 'controller-0' to '73810052-d135-4681-81b7-bece245babce'. sysinv 2020-10-20 04:06:00.406 84851 INFO sysinv.conductor.manager [-] _config_update_hosts config_uuid=73810052-d135-4681-81b7-bece245babce sysinv 2020-10-20 04:06:00.406 84851 INFO sysinv.conductor.manager [-] applying runtime manifest config_uuid=73810052-d135-4681-81b7-bece245babce, classes: ['platform::compute::grub::runtime', 'platform::compute::config::runtime'] sysinv 2020-10-20 04:06:00.413 84851 INFO sysinv.conductor.manager [-] Cannot generate the configuration for controller-0, the host is not inventoried yet. sysinv 2020-10-20 04:06:00.420 84851 INFO sysinv.agent.rpcapi [-] config_apply_runtime_manifest: fanout_cast: sending config 73810052-d135-4681-81b7-bece245babce {'classes': ['platform::compute::grub::runtime', 'platform::compute::config::runtime'], 'force': False, 'personalities': ['controller', 'worker'], 'host_uuids': [u'448a679f-bf8a-4819-8602-c0123f481cdb']} to agent sysinv 2020-10-20 04:06:01.023 84851 INFO sysinv.conductor.manager [-] Inventory incomplete, will try again in 1 second. sysinv 2020-10-20 04:06:01.962 84851 INFO sysinv.conductor.manager [-] Partition create on host: 1. Details: {'status': 1, 'forihostid': 1, u'device_path': u'/dev/disk/by-path/pci-0000:00:11.5-ata-2.0-part1', u'start_mib': u'1', u'uuid': u'1cbc2131-ac0a-4a8b-971f-4f6a780ea99d', 'idisk_id': 1, u'type_name': u'Platform Backup', u'device_node': u'/dev/sda1', u'end_mib': u'10001', 'idisk_uuid': u'48d87919-58e7-4b5a-a6d4-0c61b3952240', u'type_guid': u'ba5eba11-0000-1111-2222-000000000002', u'size_mib': u'10000'} sysinv 2020-10-20 04:06:01.984 84851 INFO sysinv.conductor.manager [-] Partition create on host: 1. Details: {'status': 1, 'forihostid': 1, u'device_path': u'/dev/disk/by-path/pci-0000:00:11.5-ata-2.0-part2', u'start_mib': u'10001', u'uuid': u'e59da16c-96f6-4957-9a8a-b6c1be9dbcc2', 'idisk_id': 1, u'type_name': u'EFI System', u'device_node': u'/dev/sda2', u'end_mib': u'10301', 'idisk_uuid': u'48d87919-58e7-4b5a-a6d4-0c61b3952240', u'type_guid': u'c12a7328-f81f-11d2-ba4b-00a0c93ec93b', u'size_mib': u'300'} sysinv 2020-10-20 04:06:02.000 84851 INFO sysinv.conductor.manager [-] Partition create on host: 1. Details: {'status': 1, 'forihostid': 1, u'device_path': u'/dev/disk/by-path/pci-0000:00:11.5-ata-2.0-part3', u'start_mib': u'10301', u'uuid': u'2973e616-c1e5-4909-bca5-58f5b6063570', 'idisk_id': 1, u'type_name': u'Microsoft basic data', u'device_node': u'/dev/sda3', u'end_mib': u'10801', 'idisk_uuid': u'48d87919-58e7-4b5a-a6d4-0c61b3952240', u'type_guid': u'ebd0a0a2-b9e5-4433-87c0-68b6b72699c7', u'size_mib': u'500'} sysinv 2020-10-20 04:06:02.017 84851 INFO sysinv.conductor.manager [-] Partition create on host: 1. Details: {'status': 1, 'forihostid': 1, u'device_path': u'/dev/disk/by-path/pci-0000:00:11.5-ata-2.0-part4', u'start_mib': u'10801', u'uuid': u'2e33e4fc-54ad-4b3b-8401-c5549b1ab57b', 'idisk_id': 1, u'type_name': u'Microsoft basic data', u'device_node': u'/dev/sda4', u'end_mib': u'30801', 'idisk_uuid': u'48d87919-58e7-4b5a-a6d4-0c61b3952240', u'type_guid': u'ebd0a0a2-b9e5-4433-87c0-68b6b72699c7', u'size_mib': u'20000'} sysinv 2020-10-20 04:06:02.039 84851 INFO sysinv.conductor.manager [-] Inventory incomplete, will try again in 1 second. sysinv 2020-10-20 04:06:02.040 84851 INFO sysinv.conductor.manager [-] Partition create on host: 1. Details: {'status': 1, 'forihostid': 1, u'device_path': u'/dev/disk/by-path/pci-0000:00:11.5-ata-2.0-part5', u'start_mib': u'30801', u'uuid': u'7d8d63f3-accd-4560-af3e-e8381643cd65', 'idisk_id': 1, u'type_name': u'Linux LVM', u'device_node': u'/dev/sda5', u'end_mib': u'198737', 'idisk_uuid': u'48d87919-58e7-4b5a-a6d4-0c61b3952240', u'type_guid': u'e6d6d379-f507-44c2-a23c-238f2a3df928', u'size_mib': u'167936'} sysinv 2020-10-20 04:06:02.124 84851 INFO sysinv.conductor.manager [-] Inconsistent Data: Not adding PV: {u'lvm_pe_alloced': 4570, 'forihostid': 1, u'lvm_pe_total': 5247, u'lvm_vg_name': u'cgts-vg', u'lvm_pv_name': u'/dev/sda5', u'lvm_pv_uuid': u'SLnd5I-kt1C-stwx-gIbY-UJ5c-DcKy-8qcTlL', u'lvm_pv_size': 176060104704} sysinv 2020-10-20 04:06:02.246 84851 INFO sysinv.conductor.manager [-] platform_interfaces host_id=1 info_list=[] sysinv 2020-10-20 04:06:03.080 84851 INFO sysinv.conductor.manager [-] Inventory incomplete, will try again in 1 second. sysinv 2020-10-20 04:06:03.788 76443 INFO sysinv.agent.manager [-] Disk size for /dev/disk/by-path/pci-0000:00:11.5-ata-2.0: 476 ... large disk defaults sysinv 2020-10-20 04:06:03.820 84851 INFO sysinv.conductor.manager [-] Creating Host FS:scratch:scratch-lv 16 for host id 1 sysinv 2020-10-20 04:06:03.827 84851 INFO sysinv.conductor.manager [-] Creating Host FS:backup:backup-lv 25 for host id 1 sysinv 2020-10-20 04:06:03.834 84851 INFO sysinv.conductor.manager [-] Creating Host FS:docker:docker-lv 30 for host id 1 sysinv 2020-10-20 04:06:03.840 84851 INFO sysinv.conductor.manager [-] Creating Host FS:kubelet:kubelet-lv 10 for host id 1 sysinv 2020-10-20 04:06:03.849 76443 INFO sysinv.agent.manager [-] Initial inventory completed host 448a679f-bf8a-4819-8602-c0123f481cdb sysinv 2020-10-20 04:06:03.866 76443 WARNING sysinv.openstack.common.loopingcall [-] task run outlasted interval by 6.871189 sec sysinv 2020-10-20 04:06:04.102 84851 INFO sysinv.conductor.manager [-] Setting config target of host 'controller-0' to '1d6439ab-71e1-418a-b78e-c7000cf897cb'. sysinv 2020-10-20 04:06:04.113 84851 INFO sysinv.conductor.manager [-] _config_update_hosts config_uuid=1d6439ab-71e1-418a-b78e-c7000cf897cb sysinv 2020-10-20 04:06:04.113 84851 INFO sysinv.conductor.manager [-] applying runtime manifest config_uuid=1d6439ab-71e1-418a-b78e-c7000cf897cb, classes: ['openstack::keystone::endpoint::runtime', 'openstack::barbican::runtime'] sysinv 2020-10-20 04:06:04.119 84851 INFO sysinv.puppet.puppet [-] Updating hiera for host: controller-0 with config_uuid: 1d6439ab-71e1-418a-b78e-c7000cf897cb sysinv 2020-10-20 04:06:05.053 84851 WARNING sysinv.puppet.kubernetes [-] Unable to retrieve kubernetes version: KubeNotConfigured: Kubernetes is not configured. API operations will not be available. sysinv 2020-10-20 04:06:05.313 76443 INFO sysinv.agent.manager [-] Agent config applied 0a55e06d-9da7-4709-bef8-759dce2797df sysinv 2020-10-20 04:06:05.342 84851 INFO sysinv.conductor.manager [-] _remove_config_from_reboot_config_list host: 448a679f-bf8a-4819-8602-c0123f481cdb,config_uuid: 0a55e06d-9da7-4709-bef8-759dce2797df sysinv 2020-10-20 04:06:05.711 84851 INFO sysinv.agent.rpcapi [-] config_apply_runtime_manifest: fanout_cast: sending config 1d6439ab-71e1-418a-b78e-c7000cf897cb {'classes': ['openstack::keystone::endpoint::runtime', 'openstack::barbican::runtime'], 'force': True, 'personalities': ['controller'], 'host_uuids': [u'448a679f-bf8a-4819-8602-c0123f481cdb']} to agent sysinv 2020-10-20 04:06:05.713 76443 INFO sysinv.agent.manager [-] config_apply_runtime_manifest: 1d6439ab-71e1-418a-b78e-c7000cf897cb {u'classes': [u'openstack::keystone::endpoint::runtime', u'openstack::barbican::runtime'], u'force': True, u'personalities': [u'controller'], u'host_uuids': [u'448a679f-bf8a-4819-8602-c0123f481cdb']} controller sysinv 2020-10-20 04:06:05.714 76443 INFO sysinv.agent.manager [-] controller-active sysinv 2020-10-20 04:06:05.714 76443 INFO sysinv.agent.manager [-] _apply_runtime_manifest with hieradata_path = '/opt/platform/puppet/20.12/hieradata' sysinv 2020-10-20 04:06:12.101 84851 ERROR sysinv.conductor.kube_app [-] Kubernetes is not configured. API operations will not be available.: KubeNotConfigured: Kubernetes is not configured. API operations will not be available. sysinv 2020-10-20 04:07:12.163 84851 ERROR sysinv.conductor.kube_app [-] Kubernetes is not configured. API operations will not be available.: KubeNotConfigured: Kubernetes is not configured. API operations will not be available. sysinv 2020-10-20 04:07:47.661 76443 INFO sysinv.agent.manager [-] Runtime manifest apply completed for classes [u'openstack::keystone::endpoint::runtime', u'openstack::barbican::runtime']. sysinv 2020-10-20 04:07:47.664 76443 INFO sysinv.agent.manager [-] Agent config applied 1d6439ab-71e1-418a-b78e-c7000cf897cb sysinv 2020-10-20 04:07:47.678 84851 INFO sysinv.conductor.manager [-] _remove_config_from_reboot_config_list host: 448a679f-bf8a-4819-8602-c0123f481cdb,config_uuid: 1d6439ab-71e1-418a-b78e-c7000cf897cb sysinv 2020-10-20 04:07:50.814 87484 WARNING keystonemiddleware.auth_token [-] Using the in-process token cache is deprecated as of the 4.2.0 release and may be removed in the 5.0.0 release or the 'O' development cycle. The in-process cache causes inconsistent results and high memory usage. When the feature is removed the auth_token middleware will not cache tokens by default which may result in performance issues. It is recommended to use memcache for the auth_token token cache by setting the memcached_servers option. sysinv 2020-10-20 04:07:51.944 87484 INFO sysinv.api.controllers.v1.interface [-] Setting MAC of interface lo to 00:00:00:00:00:00; taken from None sysinv 2020-10-20 04:07:54.352 87484 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on localhost:5672 sysinv 2020-10-20 04:08:12.181 84851 ERROR sysinv.conductor.kube_app [-] Kubernetes is not configured. API operations will not be available.: KubeNotConfigured: Kubernetes is not configured. API operations will not be available. sysinv 2020-10-20 04:09:12.182 84851 ERROR sysinv.conductor.kube_app [-] Kubernetes is not configured. API operations will not be available.: KubeNotConfigured: Kubernetes is not configured. API operations will not be available. sysinv 2020-10-20 04:10:12.186 84851 ERROR sysinv.conductor.kube_app [-] Kubernetes is not configured. API operations will not be available.: KubeNotConfigured: Kubernetes is not configured. API operations will not be available. sysinv 2020-10-20 04:11:12.196 84851 ERROR sysinv.conductor.kube_app [-] Kubernetes is not configured. API operations will not be available.: KubeNotConfigured: Kubernetes is not configured. API operations will not be available. sysinv 2020-10-20 04:12:31.404 87484 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['uptime', 'task'] sysinv 2020-10-20 04:12:38.059 87484 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2020-10-20-04-12-38 patch sysinv 2020-10-20 04:12:38.060 87484 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['availability'] sysinv 2020-10-20 04:12:38.078 87484 INFO sysinv.api.controllers.v1.host [-] host controller-0 ihost_patch_end_2020-10-20-04-12-38 patch sysinv 2020-10-20 04:12:38.125 87484 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2020-10-20-04-12-38 patch sysinv 2020-10-20 04:12:38.126 87484 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['subfunction_avail'] sysinv 2020-10-20 04:12:38.154 87484 INFO sysinv.api.controllers.v1.host [-] host controller-0 ihost_patch_end_2020-10-20-04-12-38 patch sysinv 2020-10-20 04:14:51.517 84851 INFO sysinv.openstack.common.service [-] Caught SIGTERM, exiting sysinv 2020-10-20 04:14:54.661 127267 INFO sysinv.helm.helm [-] No entry points for systemconfig.helm_applications found. sysinv 2020-10-20 04:14:54.662 127267 INFO sysinv.helm.helm [-] No entry points for systemconfig.armada.manifest_ops found. sysinv 2020-10-20 04:14:54.672 127267 INFO sysinv.conductor.manager [-] sysinv-conductor start committed system={'system_mode': u'simplex', 'created_at': datetime.datetime(2020, 10, 20, 4, 4, 11, 893909, tzinfo=), 'uuid': u'c743a346-f508-4abd-9ab8-09fca79d3071', 'software_version': u'20.12', 'service_project_name': u'services', 'system_type': u'All-in-one', 'name': u'9d36d9ba-bd18-46f6-83c0-7f16a0d3b398', 'description': None, 'location': None, 'updated_at': datetime.datetime(2020, 10, 20, 4, 5, 34, 643183, tzinfo=), 'capabilities': {u'https_enabled': False, u'vswitch_type': u'none', u'region_config': False, u'sdn_enabled': False, u'shared_services': u'[]'}, 'id': 1, 'contact': None, 'security_feature': u'nopti nospectre_v2 nospectre_v1', 'services': 72, 'timezone': u'UTC', 'security_profile': u'standard', 'distributed_cloud_role': None, 'region_name': u'RegionOne'} sysinv 2020-10-20 04:14:54.698 127267 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on localhost:5672 sysinv 2020-10-20 04:14:54.814 127267 INFO sysinv.conductor.keystone_listener [-] Sysinv keystone listener started! sysinv 2020-10-20 04:14:54.849 127267 INFO sysinv.conductor.manager [-] _upgrade_downgrade_kube_static_images executing playbook: /usr/share/ansible/stx-ansible/playbooks/upgrade-static-images.yml for version v1.18.1 sysinv 2020-10-20 04:15:04.237 127267 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on localhost:5672 sysinv 2020-10-20 04:15:24.834 127267 WARNING oslo_messaging.server [-] Possible hang: wait is waiting for stop to complete sysinv 2020-10-20 04:15:26.917 87484 INFO sysinv.common.utils [-] Checksum file is included and validated. sysinv 2020-10-20 04:15:26.919 87484 INFO sysinv.api.controllers.v1.kube_app [-] No patch required for application nginx-ingress-controller (1.0-0). sysinv 2020-10-20 04:15:26.948 87484 INFO sysinv.api.controllers.v1.kube_app [-] Tar file of application nginx-ingress-controller verified. sysinv 2020-10-20 04:15:26.970 127267 INFO sysinv.conductor.kube_app [-] Application nginx-ingress-controller (1.0-0) upload started. sysinv 2020-10-20 04:15:27.014 127267 INFO sysinv.conductor.kube_app [-] PluginHelper: nginx-ingress-controller does not contains any platform plugins. sysinv 2020-10-20 04:15:27.668 127267 INFO sysinv.conductor.kube_app [-] Copy /opt/platform/armada/20.12/nginx-ingress-controller to armada-api-ff8895c46-sx8c2:/tmp/manifests . sysinv 2020-10-20 04:15:27.926 127267 INFO sysinv.conductor.kube_app [-] Copy /opt/platform/helm/20.12/nginx-ingress-controller to armada-api-ff8895c46-sx8c2:/tmp/overrides . sysinv 2020-10-20 04:15:28.236 127267 INFO sysinv.conductor.kube_app [-] Armada validate command: 'armada validate /tmp/manifests/nginx-ingress-controller/1.0-0/nginx-ingress-controller-nginx_ingress_controller_manifest.yaml' sysinv 2020-10-20 04:15:29.052 127267 INFO sysinv.conductor.kube_app [-] Manifest file /manifests/nginx-ingress-controller/1.0-0/nginx-ingress-controller-nginx_ingress_controller_manifest.yaml was successfully validated. sysinv 2020-10-20 04:15:29.136 127267 INFO sysinv.conductor.kube_app [-] Helm chart nginx-ingress validated sysinv 2020-10-20 04:15:29.139 127267 INFO sysinv.conductor.kube_app [-] Application nginx-ingress-controller (1.0-0) will load charts to chart repo stx-platform sysinv 2020-10-20 04:15:29.140 127267 INFO sysinv.conductor.kube_app [-] Application nginx-ingress-controller (1.0-0) will disable charts [] by default sysinv 2020-10-20 04:15:29.227 127267 INFO sysinv.conductor.kube_app [-] Helm chart nginx-ingress-1.4.0.tgz uploaded sysinv 2020-10-20 04:15:29.266 127267 INFO sysinv.conductor.kube_app [-] Generating application overrides to discover required images. sysinv 2020-10-20 04:15:29.444 127267 INFO sysinv.conductor.kube_app [-] Manifest file /opt/platform/armada/20.12/nginx-ingress-controller/1.0-0/nginx-ingress-controller-nginx_ingress_controller_manifest.yaml updated with new image tags sysinv 2020-10-20 04:15:29.462 127267 INFO sysinv.conductor.kube_app [-] Application nginx-ingress-controller (1.0-0) upload completed. sysinv 2020-10-20 04:15:38.404 127267 INFO sysinv.conductor.manager [-] app_lifecycle_actions for app nginx-ingress-controller, opp apply pre uploaded sysinv 2020-10-20 04:15:38.404 127267 INFO sysinv.conductor.kube_app [-] kube_app.py lifecycle action for application nginx-ingress-controller (1.0-0) operation apply (pre) started. sysinv 2020-10-20 04:15:38.426 127267 INFO sysinv.conductor.kube_app [-] Register the initial abort status of app nginx-ingress-controller fmAPI.cpp(137): Connected to FM Manager. sysinv 2020-10-20 04:15:38.698 127267 INFO sysinv.conductor.kube_app [-] Application nginx-ingress-controller (1.0-0) apply started. sysinv 2020-10-20 04:15:38.762 127267 INFO sysinv.conductor.kube_app [-] Secret default-registry-key created under Namespace kube-system. sysinv 2020-10-20 04:15:38.767 127267 INFO sysinv.conductor.kube_app [-] Generating application overrides... sysinv 2020-10-20 04:15:38.854 127267 INFO sysinv.conductor.kube_app [-] Application overrides generated. sysinv 2020-10-20 04:15:38.870 127267 INFO sysinv.conductor.kube_app [-] Image registry.local:9001/quay.io/kubernetes-ingress-controller/nginx-ingress-controller:0.23.0 download started from local registry sysinv 2020-10-20 04:15:38.912 127267 INFO sysinv.conductor.kube_app [-] Image registry.local:9001/k8s.gcr.io/defaultbackend:1.4 download started from local registry sysinv 2020-10-20 04:15:39.282 127267 INFO sysinv.conductor.kube_app [-] Image registry.local:9001/quay.io/kubernetes-ingress-controller/nginx-ingress-controller:0.23.0 is not available in local registry, download started from public/private registry sysinv 2020-10-20 04:15:39.372 127267 INFO sysinv.conductor.kube_app [-] Image registry.local:9001/k8s.gcr.io/defaultbackend:1.4 is not available in local registry, download started from public/private registry sysinv 2020-10-20 04:15:41.051 127267 INFO sysinv.common.utils [-] ansible-playbook: PLAY [all] ********************************************************************* TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [Fail if kubernetes_version is not defined] ******************************* TASK [Create the upgrade overrides file] *************************************** changed: [localhost] TASK [Read the overrides variables] ******************************************** ok: [localhost] TASK [common/push-docker-images : Get docker registries if not in bootstap or restore mode] *** included: /usr/share/ansible/stx-ansible/playbooks/roles/common/push-docker-images/tasks/get_docker_registry.yml for localhost => (item={u'name': u'k8s_registry', u'value': {u'url': u'k8s.gcr.io'}}) included: /usr/share/ansible/stx-ansible/playbooks/roles/common/push-docker-images/tasks/get_docker_registry.yml for localhost => (item={u'name': u'gcr_registry', u'value': {u'url': u'gcr.io'}}) included: /usr/share/ansible/stx-ansible/playbooks/roles/common/push-docker-images/tasks/get_docker_registry.yml for localhost => (item={u'name': u'quay_registry', u'value': {u'url': u'quay.io'}}) included: /usr/share/ansible/stx-ansible/playbooks/roles/common/push-docker-images/tasks/get_docker_registry.yml for localhost => (item={u'name': u'docker_registry', u'value': {u'url': u'docker.io'}}) included: /usr/share/ansible/stx-ansible/playbooks/roles/common/push-docker-images/tasks/get_docker_registry.yml for localhost => (item={u'name': u'elastic_registry', u'value': {u'url': u'docker.elastic.co'}}) TASK [common/push-docker-images : Query the k8s_registry] ********************** changed: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'name': u'secure', 'value': u'False'}) ok: [localhost] => (item={'name': u'url', 'value': u'kasstxj.ka.intel.com:5000'}) TASK [common/push-docker-images : Validate k8s_registry information if it exists] *** TASK [common/push-docker-images : Set secure to bool] ************************** ok: [localhost] TASK [common/push-docker-images : Get the k8s_registry barbican secret if it's authenticated] *** TASK [common/push-docker-images : Validate k8s_registry secret] **************** TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'value': u'kasstxj.ka.intel.com:5000', 'key': u'url'}) ok: [localhost] => (item={'value': False, 'key': u'secure'}) TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : Query the gcr_registry] ********************** changed: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'name': u'secure', 'value': u'False'}) ok: [localhost] => (item={'name': u'url', 'value': u'kasstxj.ka.intel.com:5000'}) TASK [common/push-docker-images : Validate gcr_registry information if it exists] *** TASK [common/push-docker-images : Set secure to bool] ************************** ok: [localhost] TASK [common/push-docker-images : Get the gcr_registry barbican secret if it's authenticated] *** TASK [common/push-docker-images : Validate gcr_registry secret] **************** TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'value': u'kasstxj.ka.intel.com:5000', 'key': u'url'}) ok: [localhost] => (item={'value': False, 'key': u'secure'}) TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : Query the quay_registry] ********************* changed: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'name': u'secure', 'value': u'False'}) ok: [localhost] => (item={'name': u'url', 'value': u'kasstxj.ka.intel.com:5000'}) TASK [common/push-docker-images : Validate quay_registry information if it exists] *** TASK [common/push-docker-images : Set secure to bool] ************************** ok: [localhost] TASK [common/push-docker-images : Get the quay_registry barbican secret if it's authenticated] *** TASK [common/push-docker-images : Validate quay_registry secret] *************** TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'value': u'kasstxj.ka.intel.com:5000', 'key': u'url'}) ok: [localhost] => (item={'value': False, 'key': u'secure'}) TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : Query the docker_registry] ******************* changed: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'name': u'secure', 'value': u'False'}) ok: [localhost] => (item={'name': u'url', 'value': u'kasstxj.ka.intel.com:5000'}) TASK [common/push-docker-images : Validate docker_registry information if it exists] *** TASK [common/push-docker-images : Set secure to bool] ************************** ok: [localhost] TASK [common/push-docker-images : Get the docker_registry barbican secret if it's authenticated] *** TASK [common/push-docker-images : Validate docker_registry secret] ************* TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'value': u'kasstxj.ka.intel.com:5000', 'key': u'url'}) ok: [localhost] => (item={'value': False, 'key': u'secure'}) TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : Query the elastic_registry] ****************** changed: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'name': u'secure', 'value': u'False'}) ok: [localhost] => (item={'name': u'url', 'value': u'kasstxj.ka.intel.com:5000'}) TASK [common/push-docker-images : Validate elastic_registry information if it exists] *** TASK [common/push-docker-images : Set secure to bool] ************************** ok: [localhost] TASK [common/push-docker-images : Get the elastic_registry barbican secret if it's authenticated] *** TASK [common/push-docker-images : Validate elastic_registry secret] ************ TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'value': u'kasstxj.ka.intel.com:5000', 'key': u'url'}) ok: [localhost] => (item={'value': False, 'key': u'secure'}) TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : Get registry credentials if registry type is AWS ECR] *** TASK [common/load-images-information : set_fact] ******************************* TASK [common/load-images-information : Get the list of kubernetes images] ****** changed: [localhost] TASK [common/load-images-information : set_fact] ******************************* ok: [localhost] TASK [common/load-images-information : include_vars] *************************** ok: [localhost] TASK [common/load-images-information : Get the list of platform images] ******** ok: [localhost] TASK [common/push-docker-images : Set download images list] ******************** TASK [common/push-docker-images : Set download images list to static images if upgrading static images] *** ok: [localhost] TASK [common/push-docker-images : Set download images list to k8s network images if upgrading k8s networking] *** TASK [common/push-docker-images : Set download images list to kubernetes images if upgrading kubernetes] *** TASK [common/push-docker-images : Set download images list to netapp images if installing trident] *** TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : debug] *************************************** ok: [localhost] => { "download_images_list": [ "gcr.io/kubernetes-helm/tiller:v2.16.1", "quay.io/airshipit/armada:8a1638098f88d92bf799ef4934abe569789b885e-ubuntu_bionic", "docker.io/starlingx/n3000-opae:stx.4.0-v1.0.0", "quay.io/stackanetes/kubernetes-entrypoint:v0.3.1" ] } TASK [common/push-docker-images : Set registries information] ****************** ok: [localhost] => (item={u'replaced_url': u'kasstxj.ka.intel.com:5000', u'default_url': u'k8s.gcr.io'}) ok: [localhost] => (item={u'replaced_url': u'kasstxj.ka.intel.com:5000', u'default_url': u'gcr.io'}) ok: [localhost] => (item={u'replaced_url': u'kasstxj.ka.intel.com:5000', u'default_url': u'quay.io'}) ok: [localhost] => (item={u'replaced_url': u'kasstxj.ka.intel.com:5000', u'default_url': u'docker.io'}) ok: [localhost] => (item={u'replaced_url': u'kasstxj.ka.intel.com:5000', u'default_url': u'docker.elastic.co'}) TASK [common/push-docker-images : Log in k8s, gcr, quay, docker registries if credentials exist] *** TASK [common/push-docker-images : Get local registry credentials] ************** changed: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : Download images and push to local registry] *** changed: [localhost] TASK [common/push-docker-images : debug] *************************************** ok: [localhost] => { "msg": [ "Image is up to date for sha256:1f92aa902d739d544e621fe2ceaee04a4fc5b67c3e3ed8cf0b19aa2620763d3a", "Image is up to date for sha256:3061a8a540ac0dee710c1b37edad7855581dc027a18890759c91792615505f13", "Image is up to date for sha256:fb95693fe5c67fc46893c1735d85f00f462dc7f5254f5ddbcbbe85fd4ef71717", "Image is up to date for sha256:7fb3c2364b87e9241db7549bf11d42c129130f44e930d1ce36523fc693186e89", "Image download succeeded: kasstxj.ka.intel.com:5000/kubernetes-helm/tiller:v2.16.1", "Image push succeeded: registry.local:9001/gcr.io/kubernetes-helm/tiller:v2.16.1", "Image kasstxj.ka.intel.com:5000/kubernetes-helm/tiller:v2.16.1 download succeeded by containerd", "Image download succeeded: kasstxj.ka.intel.com:5000/airshipit/armada:8a1638098f88d92bf799ef4934abe569789b885e-ubuntu_bionic", "Image push succeeded: registry.local:9001/quay.io/airshipit/armada:8a1638098f88d92bf799ef4934abe569789b885e-ubuntu_bionic", "Image kasstxj.ka.intel.com:5000/airshipit/armada:8a1638098f88d92bf799ef4934abe569789b885e-ubuntu_bionic download succeeded by containerd", "Image download succeeded: kasstxj.ka.intel.com:5000/starlingx/n3000-opae:stx.4.0-v1.0.0", "Image push succeeded: registry.local:9001/docker.io/starlingx/n3000-opae:stx.4.0-v1.0.0", "Image kasstxj.ka.intel.com:5000/starlingx/n3000-opae:stx.4.0-v1.0.0 download succeeded by containerd", "Image download succeeded: kasstxj.ka.intel.com:5000/stackanetes/kubernetes-entrypoint:v0.3.1", "Image push succeeded: registry.local:9001/quay.io/stackanetes/kubernetes-entrypoint:v0.3.1", "Image kasstxj.ka.intel.com:5000/stackanetes/kubernetes-entrypoint:v0.3.1 download succeeded by containerd", "All images downloaded and pushed to the local registry in 27.5366711617 seconds" ] } TASK [common/push-docker-images : Log out of k8s, gcr, quay, docker registries if credentials exist] *** PLAY RECAP ********************************************************************* localhost : ok=50 changed=9 unreachable=0 failed=0 . sysinv 2020-10-20 04:15:41.059 127267 INFO sysinv.conductor.manager [-] _upgrade_downgrade_kube_networking executing playbook: /usr/share/ansible/stx-ansible/playbooks/upgrade-k8s-networking.yml for version v1.18.1 sysinv 2020-10-20 04:15:41.333 127267 INFO sysinv.conductor.kube_app [-] Remove image kasstxj.ka.intel.com:5000/defaultbackend:1.4 after push to local registry. sysinv 2020-10-20 04:15:41.346 127267 INFO sysinv.conductor.kube_app [-] Image registry.local:9001/k8s.gcr.io/defaultbackend:1.4 download succeeded in 2 seconds sysinv 2020-10-20 04:16:22.785 127267 INFO sysinv.conductor.kube_app [-] Remove image kasstxj.ka.intel.com:5000/kubernetes-ingress-controller/nginx-ingress-controller:0.23.0 after push to local registry. sysinv 2020-10-20 04:16:22.977 127267 INFO sysinv.conductor.kube_app [-] Image registry.local:9001/quay.io/kubernetes-ingress-controller/nginx-ingress-controller:0.23.0 download succeeded in 44 seconds sysinv 2020-10-20 04:16:22.977 127267 INFO sysinv.conductor.kube_app [-] All docker images for application nginx-ingress-controller were successfully downloaded in 44 seconds sysinv 2020-10-20 04:16:23.486 127267 INFO sysinv.conductor.kube_app [-] Copy /opt/platform/armada/20.12/nginx-ingress-controller to armada-api-ff8895c46-sx8c2:/tmp/manifests . sysinv 2020-10-20 04:16:23.737 127267 INFO sysinv.conductor.kube_app [-] Copy /opt/platform/helm/20.12/nginx-ingress-controller to armada-api-ff8895c46-sx8c2:/tmp/overrides . sysinv 2020-10-20 04:16:23.991 127267 INFO sysinv.conductor.kube_app [-] Starting progress monitoring thread for app nginx-ingress-controller sysinv 2020-10-20 04:16:24.008 127267 INFO sysinv.conductor.kube_app [-] Armada apply command: 'armada apply --debug --enable-chart-cleanup /tmp/manifests/nginx-ingress-controller/1.0-0/nginx-ingress-controller-nginx_ingress_controller_manifest.yaml --values /tmp/overrides/nginx-ingress-controller/1.0-0/kube-system-nginx-ingress.yaml ' sysinv 2020-10-20 04:16:25.023 127267 INFO sysinv.conductor.kube_app [-] processing chart: ic-nginx-ingress, overall completion: 100.0% sysinv 2020-10-20 04:16:38.473 127267 INFO sysinv.common.utils [-] ansible-playbook: PLAY [all] ********************************************************************* TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [Fail if kubernetes_version is not defined] ******************************* TASK [Create the upgrade overrides file] *************************************** changed: [localhost] TASK [Read the overrides variables] ******************************************** ok: [localhost] TASK [Set networking facts] **************************************************** ok: [localhost] TASK [common/push-docker-images : Get docker registries if not in bootstap or restore mode] *** included: /usr/share/ansible/stx-ansible/playbooks/roles/common/push-docker-images/tasks/get_docker_registry.yml for localhost => (item={u'name': u'k8s_registry', u'value': {u'url': u'k8s.gcr.io'}}) included: /usr/share/ansible/stx-ansible/playbooks/roles/common/push-docker-images/tasks/get_docker_registry.yml for localhost => (item={u'name': u'gcr_registry', u'value': {u'url': u'gcr.io'}}) included: /usr/share/ansible/stx-ansible/playbooks/roles/common/push-docker-images/tasks/get_docker_registry.yml for localhost => (item={u'name': u'quay_registry', u'value': {u'url': u'quay.io'}}) included: /usr/share/ansible/stx-ansible/playbooks/roles/common/push-docker-images/tasks/get_docker_registry.yml for localhost => (item={u'name': u'docker_registry', u'value': {u'url': u'docker.io'}}) included: /usr/share/ansible/stx-ansible/playbooks/roles/common/push-docker-images/tasks/get_docker_registry.yml for localhost => (item={u'name': u'elastic_registry', u'value': {u'url': u'docker.elastic.co'}}) TASK [common/push-docker-images : Query the k8s_registry] ********************** changed: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'name': u'secure', 'value': u'False'}) ok: [localhost] => (item={'name': u'url', 'value': u'kasstxj.ka.intel.com:5000'}) TASK [common/push-docker-images : Validate k8s_registry information if it exists] *** TASK [common/push-docker-images : Set secure to bool] ************************** ok: [localhost] TASK [common/push-docker-images : Get the k8s_registry barbican secret if it's authenticated] *** TASK [common/push-docker-images : Validate k8s_registry secret] **************** TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'value': u'kasstxj.ka.intel.com:5000', 'key': u'url'}) ok: [localhost] => (item={'value': False, 'key': u'secure'}) TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : Query the gcr_registry] ********************** changed: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'name': u'secure', 'value': u'False'}) ok: [localhost] => (item={'name': u'url', 'value': u'kasstxj.ka.intel.com:5000'}) TASK [common/push-docker-images : Validate gcr_registry information if it exists] *** TASK [common/push-docker-images : Set secure to bool] ************************** ok: [localhost] TASK [common/push-docker-images : Get the gcr_registry barbican secret if it's authenticated] *** TASK [common/push-docker-images : Validate gcr_registry secret] **************** TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'value': u'kasstxj.ka.intel.com:5000', 'key': u'url'}) ok: [localhost] => (item={'value': False, 'key': u'secure'}) TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : Query the quay_registry] ********************* changed: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'name': u'secure', 'value': u'False'}) ok: [localhost] => (item={'name': u'url', 'value': u'kasstxj.ka.intel.com:5000'}) TASK [common/push-docker-images : Validate quay_registry information if it exists] *** TASK [common/push-docker-images : Set secure to bool] ************************** ok: [localhost] TASK [common/push-docker-images : Get the quay_registry barbican secret if it's authenticated] *** TASK [common/push-docker-images : Validate quay_registry secret] *************** TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'value': u'kasstxj.ka.intel.com:5000', 'key': u'url'}) ok: [localhost] => (item={'value': False, 'key': u'secure'}) TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : Query the docker_registry] ******************* changed: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'name': u'secure', 'value': u'False'}) ok: [localhost] => (item={'name': u'url', 'value': u'kasstxj.ka.intel.com:5000'}) TASK [common/push-docker-images : Validate docker_registry information if it exists] *** TASK [common/push-docker-images : Set secure to bool] ************************** ok: [localhost] TASK [common/push-docker-images : Get the docker_registry barbican secret if it's authenticated] *** TASK [common/push-docker-images : Validate docker_registry secret] ************* TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'value': u'kasstxj.ka.intel.com:5000', 'key': u'url'}) ok: [localhost] => (item={'value': False, 'key': u'secure'}) TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : Query the elastic_registry] ****************** changed: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'name': u'secure', 'value': u'False'}) ok: [localhost] => (item={'name': u'url', 'value': u'kasstxj.ka.intel.com:5000'}) TASK [common/push-docker-images : Validate elastic_registry information if it exists] *** TASK [common/push-docker-images : Set secure to bool] ************************** ok: [localhost] TASK [common/push-docker-images : Get the elastic_registry barbican secret if it's authenticated] *** TASK [common/push-docker-images : Validate elastic_registry secret] ************ TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'value': u'kasstxj.ka.intel.com:5000', 'key': u'url'}) ok: [localhost] => (item={'value': False, 'key': u'secure'}) TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : Get registry credentials if registry type is AWS ECR] *** TASK [common/load-images-information : set_fact] ******************************* TASK [common/load-images-information : Get the list of kubernetes images] ****** changed: [localhost] TASK [common/load-images-information : set_fact] ******************************* ok: [localhost] TASK [common/load-images-information : include_vars] *************************** ok: [localhost] TASK [common/load-images-information : Get the list of platform images] ******** ok: [localhost] TASK [common/push-docker-images : Set download images list] ******************** TASK [common/push-docker-images : Set download images list to static images if upgrading static images] *** TASK [common/push-docker-images : Set download images list to k8s network images if upgrading k8s networking] *** ok: [localhost] TASK [common/push-docker-images : Set download images list to kubernetes images if upgrading kubernetes] *** TASK [common/push-docker-images : Set download images list to netapp images if installing trident] *** TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : debug] *************************************** ok: [localhost] => { "download_images_list": [ "quay.io/calico/cni:v3.12.0", "quay.io/calico/node:v3.12.0", "quay.io/calico/kube-controllers:v3.12.0", "quay.io/calico/pod2daemon-flexvol:v3.12.0", "docker.io/nfvpe/multus:v3.4", "docker.io/starlingx/k8s-cni-sriov:stx.3.0-v2.2", "docker.io/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae" ] } TASK [common/push-docker-images : Set registries information] ****************** ok: [localhost] => (item={u'replaced_url': u'kasstxj.ka.intel.com:5000', u'default_url': u'k8s.gcr.io'}) ok: [localhost] => (item={u'replaced_url': u'kasstxj.ka.intel.com:5000', u'default_url': u'gcr.io'}) ok: [localhost] => (item={u'replaced_url': u'kasstxj.ka.intel.com:5000', u'default_url': u'quay.io'}) ok: [localhost] => (item={u'replaced_url': u'kasstxj.ka.intel.com:5000', u'default_url': u'docker.io'}) ok: [localhost] => (item={u'replaced_url': u'kasstxj.ka.intel.com:5000', u'default_url': u'docker.elastic.co'}) TASK [common/push-docker-images : Log in k8s, gcr, quay, docker registries if credentials exist] *** TASK [common/push-docker-images : Get local registry credentials] ************** changed: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : Download images and push to local registry] *** changed: [localhost] TASK [common/push-docker-images : debug] *************************************** ok: [localhost] => { "msg": [ "Image is up to date for sha256:cb6799752c46cb16c0c5bebcb355e988a1cd1b3745ce8b67e004abe9a81340a8", "Image is up to date for sha256:fc05bc4225f39e81dcbd0035457977276ed8a6054e6bde6406e39b672e9724f5", "Image is up to date for sha256:53aa421faf0acd88f8a4cb113e9db2cc65b2a2954640ed96a56c4b94233674d8", "Image is up to date for sha256:98793d0a88c823c4fc0fb1b3833d12932be270fc4b6d62bc181f0f54413fe12d", "Image is up to date for sha256:7cf8e2d1b7337338a3f977d07abdf63d80d5005458dfab3ab8962c2bab99d40d", "Image is up to date for sha256:cfba917fa8e18db8b00696adce24aa84b3d64483036aef72fd6256cff3b89da6", "Image is up to date for sha256:a2bef2b25274b1acbdfde5e2f3de432475e15d4036b2108cea2dce968b0c29ea", "Image download succeeded: kasstxj.ka.intel.com:5000/calico/cni:v3.12.0", "Image push succeeded: registry.local:9001/quay.io/calico/cni:v3.12.0", "Image kasstxj.ka.intel.com:5000/calico/cni:v3.12.0 download succeeded by containerd", "Image download succeeded: kasstxj.ka.intel.com:5000/calico/node:v3.12.0", "Image push succeeded: registry.local:9001/quay.io/calico/node:v3.12.0", "Image kasstxj.ka.intel.com:5000/calico/node:v3.12.0 download succeeded by containerd", "Image download succeeded: kasstxj.ka.intel.com:5000/calico/kube-controllers:v3.12.0", "Image push succeeded: registry.local:9001/quay.io/calico/kube-controllers:v3.12.0", "Image kasstxj.ka.intel.com:5000/calico/kube-controllers:v3.12.0 download succeeded by containerd", "Image download succeeded: kasstxj.ka.intel.com:5000/calico/pod2daemon-flexvol:v3.12.0", "Image push succeeded: registry.local:9001/quay.io/calico/pod2daemon-flexvol:v3.12.0", "Image kasstxj.ka.intel.com:5000/calico/pod2daemon-flexvol:v3.12.0 download succeeded by containerd", "Image download succeeded: kasstxj.ka.intel.com:5000/nfvpe/multus:v3.4", "Image push succeeded: registry.local:9001/docker.io/nfvpe/multus:v3.4", "Image kasstxj.ka.intel.com:5000/nfvpe/multus:v3.4 download succeeded by containerd", "Image download succeeded: kasstxj.ka.intel.com:5000/starlingx/k8s-cni-sriov:stx.3.0-v2.2", "Image push succeeded: registry.local:9001/docker.io/starlingx/k8s-cni-sriov:stx.3.0-v2.2", "Image kasstxj.ka.intel.com:5000/starlingx/k8s-cni-sriov:stx.3.0-v2.2 download succeeded by containerd", "Image download succeeded: kasstxj.ka.intel.com:5000/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae", "Image push succeeded: registry.local:9001/docker.io/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae", "Image kasstxj.ka.intel.com:5000/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae download succeeded by containerd", "All images downloaded and pushed to the local registry in 29.0702500343 seconds" ] } TASK [common/push-docker-images : Log out of k8s, gcr, quay, docker registries if credentials exist] *** TASK [Create Calico config file] *********************************************** changed: [localhost] TASK [Update Calico Networking] ************************************************ changed: [localhost] TASK [Create Multus config file] *********************************************** changed: [localhost] TASK [Update Multus Networking] ************************************************ changed: [localhost] TASK [Create SRIOV Networking config file] ************************************* changed: [localhost] TASK [Update SRIOV Networking] ************************************************* changed: [localhost] TASK [Create SRIOV device plugin config file] ********************************** changed: [localhost] TASK [Update SRIOV device plugin] ********************************************** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=59 changed=17 unreachable=0 failed=0 . sysinv 2020-10-20 04:17:15.927 127267 INFO sysinv.conductor.kube_app [-] Application manifest /manifests/nginx-ingress-controller/1.0-0/nginx-ingress-controller-nginx_ingress_controller_manifest.yaml was successfully applied/re-applied. sysinv 2020-10-20 04:17:15.928 127267 INFO sysinv.conductor.kube_app [-] Exiting progress monitoring thread for app nginx-ingress-controller sysinv 2020-10-20 04:17:16.513 127267 INFO sysinv.conductor.kube_app [-] Application nginx-ingress-controller (1.0-0) apply completed. sysinv 2020-10-20 04:17:16.513 127267 INFO sysinv.conductor.manager [-] app_lifecycle_actions for app nginx-ingress-controller, opp apply post applied sysinv 2020-10-20 04:17:16.514 127267 INFO sysinv.conductor.kube_app [-] kube_app.py lifecycle action for application nginx-ingress-controller (1.0-0) operation apply (post) started. sysinv 2020-10-20 04:17:33.889 87484 INFO sysinv.common.utils [-] Checksum file is included and validated. sysinv 2020-10-20 04:17:33.890 87484 INFO sysinv.api.controllers.v1.kube_app [-] No patch required for application cert-manager (1.0-6). sysinv 2020-10-20 04:17:33.937 87484 INFO sysinv.api.controllers.v1.kube_app [-] Tar file of application cert-manager verified. sysinv 2020-10-20 04:17:33.949 127267 INFO sysinv.conductor.kube_app [-] Application cert-manager (1.0-6) upload started. sysinv 2020-10-20 04:17:34.001 127267 INFO sysinv.conductor.kube_app [-] PluginHelper: Creating cert-manager plugin directory /opt/platform/helm/20.12/cert-manager/1.0-6/plugins. sysinv 2020-10-20 04:17:34.002 127267 INFO sysinv.conductor.kube_app [-] PluginHelper: Installing cert-manager plugin /scratch/apps/cert-manager/1.0-6/plugins/k8sapp_cert_manager-1.0-py2.py3-none-any.whl to /opt/platform/helm/20.12/cert-manager/1.0-6/plugins. sysinv 2020-10-20 04:17:34.493 127267 INFO sysinv.conductor.kube_app [-] Copy /opt/platform/armada/20.12/cert-manager to armada-api-ff8895c46-sx8c2:/tmp/manifests . sysinv 2020-10-20 04:17:34.693 127267 INFO sysinv.conductor.kube_app [-] Copy /opt/platform/helm/20.12/cert-manager to armada-api-ff8895c46-sx8c2:/tmp/overrides . sysinv 2020-10-20 04:17:34.910 127267 INFO sysinv.conductor.kube_app [-] Armada validate command: 'armada validate /tmp/manifests/cert-manager/1.0-6/cert-manager-certmanager-manifest.yaml' sysinv 2020-10-20 04:17:35.636 127267 INFO sysinv.conductor.kube_app [-] Manifest file /manifests/cert-manager/1.0-6/cert-manager-certmanager-manifest.yaml was successfully validated. sysinv 2020-10-20 04:17:35.745 127267 INFO sysinv.conductor.kube_app [-] Helm chart cert-manager validated sysinv 2020-10-20 04:17:35.788 127267 INFO sysinv.conductor.kube_app [-] Helm chart psp-rolebinding validated sysinv 2020-10-20 04:17:35.790 127267 INFO sysinv.conductor.kube_app [-] Application cert-manager (1.0-6) will load charts to chart repo stx-platform sysinv 2020-10-20 04:17:35.790 127267 INFO sysinv.conductor.kube_app [-] Application cert-manager (1.0-6) will disable charts [] by default sysinv 2020-10-20 04:17:35.897 127267 INFO sysinv.conductor.kube_app [-] Helm chart psp-rolebinding-0.1.0.tgz uploaded sysinv 2020-10-20 04:17:35.975 127267 INFO sysinv.conductor.kube_app [-] Helm chart cert-manager-v0.1.0.tgz uploaded sysinv 2020-10-20 04:17:35.979 127267 INFO sysinv.conductor.kube_app [-] PluginHelper: Enabled plugin directory /opt/platform/helm/20.12/cert-manager/1.0-6/plugins: created /usr/lib64/python2.7/site-packages/stx_app-cert-manager-1.0-6.pth sysinv 2020-10-20 04:17:36.020 127267 INFO sysinv.conductor.kube_app [-] PluginHelper: Disabled plugin directory /opt/platform/helm/20.12/cert-manager/1.0-6/plugins: removed /usr/lib64/python2.7/site-packages/stx_app-cert-manager-1.0-6.pth sysinv 2020-10-20 04:17:36.020 127267 INFO sysinv.conductor.kube_app [-] PluginHelper: Disabling distributions: [u'k8sapp-cert-manager'] sysinv 2020-10-20 04:17:36.030 127267 INFO sysinv.helm.helm [-] Couldn't find endpoint distribution located at /opt/platform/helm/20.12/cert-manager/1.0-6/plugins for sysinv 1.0 sysinv 2020-10-20 04:17:36.031 127267 INFO sysinv.helm.helm [-] Removed stevedore namespace: systemconfig.helm_plugins.cert_manager sysinv 2020-10-20 04:17:36.058 127267 INFO sysinv.conductor.kube_app [-] PluginHelper: Enabled plugin directory /opt/platform/helm/20.12/cert-manager/1.0-6/plugins: created /usr/lib64/python2.7/site-packages/stx_app-cert-manager-1.0-6.pth sysinv 2020-10-20 04:17:36.061 127267 INFO sysinv.conductor.kube_app [-] Generating application overrides to discover required images. sysinv 2020-10-20 04:17:36.191 127267 INFO sysinv.conductor.kube_app [-] PluginHelper: Disabled plugin directory /opt/platform/helm/20.12/cert-manager/1.0-6/plugins: removed /usr/lib64/python2.7/site-packages/stx_app-cert-manager-1.0-6.pth sysinv 2020-10-20 04:17:36.191 127267 INFO sysinv.conductor.kube_app [-] PluginHelper: Disabling distributions: [u'k8sapp-cert-manager'] sysinv 2020-10-20 04:17:36.196 127267 INFO sysinv.helm.helm [-] Couldn't find endpoint distribution located at /opt/platform/helm/20.12/cert-manager/1.0-6/plugins for sysinv 1.0 sysinv 2020-10-20 04:17:36.196 127267 INFO sysinv.helm.helm [-] Removed stevedore namespace: systemconfig.helm_plugins.cert_manager sysinv 2020-10-20 04:17:36.256 127267 INFO sysinv.conductor.kube_app [-] Manifest file /opt/platform/armada/20.12/cert-manager/1.0-6/cert-manager-certmanager-manifest.yaml updated with new image tags sysinv 2020-10-20 04:17:36.272 127267 INFO sysinv.conductor.kube_app [-] Application cert-manager (1.0-6) upload completed. sysinv 2020-10-20 04:17:44.171 127267 INFO sysinv.conductor.manager [-] app_lifecycle_actions for app cert-manager, opp apply pre uploaded sysinv 2020-10-20 04:17:44.172 127267 INFO sysinv.conductor.kube_app [-] PluginHelper: Enabled plugin directory /opt/platform/helm/20.12/cert-manager/1.0-6/plugins: created /usr/lib64/python2.7/site-packages/stx_app-cert-manager-1.0-6.pth sysinv 2020-10-20 04:17:44.175 127267 INFO sysinv.conductor.kube_app [-] kube_app.py lifecycle action for application cert-manager (1.0-6) operation apply (pre) started. sysinv 2020-10-20 04:17:44.175 127267 INFO sysinv.conductor.kube_app [-] PluginHelper: Disabled plugin directory /opt/platform/helm/20.12/cert-manager/1.0-6/plugins: removed /usr/lib64/python2.7/site-packages/stx_app-cert-manager-1.0-6.pth sysinv 2020-10-20 04:17:44.175 127267 INFO sysinv.conductor.kube_app [-] PluginHelper: Disabling distributions: [u'k8sapp-cert-manager'] sysinv 2020-10-20 04:17:44.180 127267 INFO sysinv.helm.helm [-] Couldn't find endpoint distribution located at /opt/platform/helm/20.12/cert-manager/1.0-6/plugins for sysinv 1.0 sysinv 2020-10-20 04:17:44.180 127267 INFO sysinv.helm.helm [-] Removed stevedore namespace: systemconfig.helm_plugins.cert_manager sysinv 2020-10-20 04:17:44.191 127267 INFO sysinv.conductor.kube_app [-] Register the initial abort status of app cert-manager sysinv 2020-10-20 04:17:44.492 127267 INFO sysinv.conductor.kube_app [-] Application cert-manager (1.0-6) apply started. sysinv 2020-10-20 04:17:44.542 127267 INFO sysinv.conductor.kube_app [-] Secret default-registry-key created under Namespace cert-manager. sysinv 2020-10-20 04:17:44.543 127267 INFO sysinv.conductor.kube_app [-] PluginHelper: Enabled plugin directory /opt/platform/helm/20.12/cert-manager/1.0-6/plugins: created /usr/lib64/python2.7/site-packages/stx_app-cert-manager-1.0-6.pth sysinv 2020-10-20 04:17:44.552 127267 INFO sysinv.conductor.kube_app [-] Generating application overrides... sysinv 2020-10-20 04:17:44.734 127267 INFO sysinv.conductor.kube_app [-] Application overrides generated. sysinv 2020-10-20 04:17:44.777 127267 INFO sysinv.conductor.kube_app [-] Image registry.local:9001/quay.io/jetstack/cert-manager-webhook:v0.15.0 download started from local registry sysinv 2020-10-20 04:17:44.802 127267 INFO sysinv.conductor.kube_app [-] Image registry.local:9001/quay.io/jetstack/cert-manager-acmesolver:v0.15.0 download started from local registry sysinv 2020-10-20 04:17:44.842 127267 INFO sysinv.conductor.kube_app [-] Image registry.local:9001/quay.io/jetstack/cert-manager-cainjector:v0.15.0 download started from local registry sysinv 2020-10-20 04:17:44.960 127267 INFO sysinv.conductor.kube_app [-] Image registry.local:9001/quay.io/jetstack/cert-manager-controller:v0.15.0 download started from local registry sysinv 2020-10-20 04:17:45.187 127267 INFO sysinv.conductor.kube_app [-] Image registry.local:9001/quay.io/jetstack/cert-manager-webhook:v0.15.0 is not available in local registry, download started from public/private registry sysinv 2020-10-20 04:17:45.397 127267 INFO sysinv.conductor.kube_app [-] Image registry.local:9001/quay.io/jetstack/cert-manager-cainjector:v0.15.0 is not available in local registry, download started from public/private registry sysinv 2020-10-20 04:17:45.477 127267 INFO sysinv.conductor.kube_app [-] Image registry.local:9001/quay.io/jetstack/cert-manager-acmesolver:v0.15.0 is not available in local registry, download started from public/private registry sysinv 2020-10-20 04:17:45.563 127267 INFO sysinv.conductor.kube_app [-] Image registry.local:9001/quay.io/jetstack/cert-manager-controller:v0.15.0 is not available in local registry, download started from public/private registry sysinv 2020-10-20 04:17:49.521 127267 INFO sysinv.conductor.kube_app [-] Remove image kasstxj.ka.intel.com:5000/jetstack/cert-manager-acmesolver:v0.15.0 after push to local registry. sysinv 2020-10-20 04:17:49.536 127267 INFO sysinv.conductor.kube_app [-] Image registry.local:9001/quay.io/jetstack/cert-manager-acmesolver:v0.15.0 download succeeded in 4 seconds sysinv 2020-10-20 04:17:50.207 127267 INFO sysinv.conductor.kube_app [-] Remove image kasstxj.ka.intel.com:5000/jetstack/cert-manager-webhook:v0.15.0 after push to local registry. sysinv 2020-10-20 04:17:50.221 127267 INFO sysinv.conductor.kube_app [-] Image registry.local:9001/quay.io/jetstack/cert-manager-webhook:v0.15.0 download succeeded in 5 seconds sysinv 2020-10-20 04:17:51.408 127267 INFO sysinv.conductor.kube_app [-] Remove image kasstxj.ka.intel.com:5000/jetstack/cert-manager-cainjector:v0.15.0 after push to local registry. sysinv 2020-10-20 04:17:51.420 127267 INFO sysinv.conductor.kube_app [-] Image registry.local:9001/quay.io/jetstack/cert-manager-cainjector:v0.15.0 download succeeded in 6 seconds sysinv 2020-10-20 04:17:52.377 127267 INFO sysinv.conductor.kube_app [-] Remove image kasstxj.ka.intel.com:5000/jetstack/cert-manager-controller:v0.15.0 after push to local registry. sysinv 2020-10-20 04:17:52.414 127267 INFO sysinv.conductor.kube_app [-] Image registry.local:9001/quay.io/jetstack/cert-manager-controller:v0.15.0 download succeeded in 7 seconds sysinv 2020-10-20 04:17:52.415 127267 INFO sysinv.conductor.kube_app [-] All docker images for application cert-manager were successfully downloaded in 7 seconds sysinv 2020-10-20 04:17:52.792 127267 INFO sysinv.conductor.kube_app [-] Copy /opt/platform/armada/20.12/cert-manager to armada-api-ff8895c46-sx8c2:/tmp/manifests . sysinv 2020-10-20 04:17:52.986 127267 INFO sysinv.conductor.kube_app [-] Copy /opt/platform/helm/20.12/cert-manager to armada-api-ff8895c46-sx8c2:/tmp/overrides . sysinv 2020-10-20 04:17:53.171 127267 INFO sysinv.conductor.kube_app [-] Armada apply command: 'armada apply --debug --enable-chart-cleanup /tmp/manifests/cert-manager/1.0-6/cert-manager-certmanager-manifest.yaml --values /tmp/overrides/cert-manager/1.0-6/cert-manager-cert-manager.yaml --values /tmp/overrides/cert-manager/1.0-6/cert-manager-psp-rolebinding.yaml ' sysinv 2020-10-20 04:17:53.420 127267 INFO sysinv.conductor.kube_app [-] Starting progress monitoring thread for app cert-manager sysinv 2020-10-20 04:17:54.446 127267 INFO sysinv.conductor.kube_app [-] processing chart: cm-cert-manager, overall completion: 100.0% sysinv 2020-10-20 04:18:05.596 127267 INFO sysinv.conductor.kube_app [-] processing chart: cm-cert-manager-psp-rolebinding, overall completion: 200.0% sysinv 2020-10-20 04:18:07.958 127267 INFO sysinv.conductor.kube_app [-] Application manifest /manifests/cert-manager/1.0-6/cert-manager-certmanager-manifest.yaml was successfully applied/re-applied. sysinv 2020-10-20 04:18:07.960 127267 INFO sysinv.conductor.kube_app [-] Exiting progress monitoring thread for app cert-manager sysinv 2020-10-20 04:18:08.624 127267 INFO sysinv.conductor.kube_app [-] Application cert-manager (1.0-6) apply completed. sysinv 2020-10-20 04:18:08.624 127267 INFO sysinv.conductor.manager [-] app_lifecycle_actions for app cert-manager, opp apply post applied sysinv 2020-10-20 04:18:08.625 127267 INFO sysinv.conductor.kube_app [-] kube_app.py lifecycle action for application cert-manager (1.0-6) operation apply (post) started. sysinv 2020-10-20 04:22:16.312 87485 WARNING sysinv.api.controllers.v1.ntp [-] ntp {'uuid': u'7ddaae84-30b8-4a8b-a80b-256bbaf70d84', 'created_at': datetime.datetime(2020, 10, 20, 4, 4, 11, 911948, tzinfo=), 'updated_at': None, 'ntpservers': u'0.pool.ntp.org,1.pool.ntp.org', 'action': None, 'isystem_uuid': u'c743a346-f508-4abd-9ab8-09fca79d3071', 'id': 1, 'forisystemid': 1} sysinv 2020-10-20 04:22:16.334 127267 INFO sysinv.conductor.manager [-] Setting config target of host 'controller-0' to 'e310c0dc-1554-48a1-922d-3a696afd4180'. sysinv 2020-10-20 04:22:16.344 127267 INFO sysinv.conductor.manager [-] _config_update_hosts config_uuid=e310c0dc-1554-48a1-922d-3a696afd4180 sysinv 2020-10-20 04:22:18.771 87485 INFO sysinv.api.controllers.v1.system [-] update vswitch_type to {u'https_enabled': False, u'vswitch_type': 'ovs-dpdk', u'region_config': False, u'sdn_enabled': False, u'shared_services': u'[]'} sysinv 2020-10-20 04:22:18.775 127267 INFO sysinv.conductor.manager [-] update_vswitch_type sysinv 2020-10-20 04:22:18.783 127267 INFO sysinv.conductor.manager [-] Setting config target of host 'controller-0' to 'b509c59a-2b36-4cb3-bfdf-731eeb053afa'. sysinv 2020-10-20 04:22:18.793 127267 INFO sysinv.conductor.manager [-] _config_update_hosts config_uuid=3509c59a-2b36-4cb3-bfdf-731eeb053afa sysinv 2020-10-20 04:22:18.793 127267 INFO sysinv.conductor.manager [-] applying runtime manifest config_uuid=3509c59a-2b36-4cb3-bfdf-731eeb053afa, classes: ['platform::sysctl::controller::runtime', 'platform::nfv::runtime'] sysinv 2020-10-20 04:22:18.800 127267 INFO sysinv.puppet.puppet [-] Updating hiera for host: controller-0 with config_uuid: 3509c59a-2b36-4cb3-bfdf-731eeb053afa sysinv 2020-10-20 04:22:21.142 127267 INFO sysinv.conductor.manager [-] Evaluating app reapply of cert-manager sysinv 2020-10-20 04:22:21.323 127267 INFO sysinv.conductor.manager [-] No override change after configuration action, skipping re-apply of cert-manager sysinv 2020-10-20 04:22:21.327 127267 INFO sysinv.agent.rpcapi [-] config_apply_runtime_manifest: fanout_cast: sending config 3509c59a-2b36-4cb3-bfdf-731eeb053afa {'classes': ['platform::sysctl::controller::runtime', 'platform::nfv::runtime'], 'force': False, 'personalities': ['controller']} to agent sysinv 2020-10-20 04:22:21.336 127267 INFO sysinv.conductor.manager [-] Setting config target of host 'controller-0' to 'ca180b2d-b4ea-4584-88c3-d7cbfcc2e86c'. sysinv 2020-10-20 04:22:21.346 127267 INFO sysinv.conductor.manager [-] _config_update_hosts config_uuid=ca180b2d-b4ea-4584-88c3-d7cbfcc2e86c sysinv 2020-10-20 04:22:23.732 87484 INFO sysinv.api.controllers.v1.host [-] host_cpus_modify host_uuid=448a679f-bf8a-4819-8602-c0123f481cdb capabilities=[{'function': 'vswitch', 'sockets': [{'0': 1}]}] sysinv 2020-10-20 04:22:24.228 87484 INFO sysinv.api.controllers.v1.host [-] icpu_update uuid=2d728152-9a64-4843-849e-e15162e15741 value={'allocated_function': 'Vswitch'} sysinv 2020-10-20 04:22:24.238 87484 INFO sysinv.api.controllers.v1.host [-] icpu_update uuid=7a374c40-906b-450e-988c-c95067c0e8bd value={'allocated_function': 'Vswitch'} sysinv 2020-10-20 04:22:24.258 127267 INFO sysinv.conductor.manager [-] update_grub_config, host uuid: (448a679f-bf8a-4819-8602-c0123f481cdb), force: (False) sysinv 2020-10-20 04:22:24.265 127267 INFO sysinv.conductor.manager [-] Setting config target of host 'controller-0' to 'd80b0216-d3e4-42c1-bf8e-f5b2b3ee7cdd'. sysinv 2020-10-20 04:22:24.274 127267 INFO sysinv.conductor.manager [-] _config_update_hosts config_uuid=580b0216-d3e4-42c1-bf8e-f5b2b3ee7cdd sysinv 2020-10-20 04:22:24.274 127267 INFO sysinv.conductor.manager [-] applying runtime manifest config_uuid=580b0216-d3e4-42c1-bf8e-f5b2b3ee7cdd, classes: ['platform::compute::grub::runtime', 'platform::compute::config::runtime'] sysinv 2020-10-20 04:22:24.282 127267 INFO sysinv.puppet.puppet [-] Updating hiera for host: controller-0 with config_uuid: 580b0216-d3e4-42c1-bf8e-f5b2b3ee7cdd sysinv 2020-10-20 04:22:26.133 127267 INFO sysinv.conductor.manager [-] Evaluating app reapply of cert-manager sysinv 2020-10-20 04:22:26.290 127267 INFO sysinv.conductor.manager [-] No override change after configuration action, skipping re-apply of cert-manager sysinv 2020-10-20 04:22:26.293 127267 INFO sysinv.agent.rpcapi [-] config_apply_runtime_manifest: fanout_cast: sending config 580b0216-d3e4-42c1-bf8e-f5b2b3ee7cdd {'classes': ['platform::compute::grub::runtime', 'platform::compute::config::runtime'], 'force': False, 'personalities': ['controller', 'worker'], 'host_uuids': [u'448a679f-bf8a-4819-8602-c0123f481cdb']} to agent sysinv 2020-10-20 04:22:29.049 87485 INFO sysinv.api.controllers.v1.storage_ceph [-] Create new ceph cluster record sysinv 2020-10-20 04:22:29.064 87485 INFO sysinv.api.controllers.v1.storage_ceph [-] Create primary ceph tier record. sysinv 2020-10-20 04:22:31.695 87485 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2020-10-20-04-22-31 patch sysinv 2020-10-20 04:22:31.696 87485 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_end. No changes from mtce/1.0. sysinv 2020-10-20 04:22:59.111 87484 INFO sysinv.api.controllers.v1.label [-] patch_data: {'openstack-control-plane': 'enabled'} sysinv 2020-10-20 04:22:59.131 127267 INFO sysinv.conductor.manager [-] update_kubernetes_label: label_dict={u'openstack-control-plane': u'enabled'} sysinv 2020-10-20 04:22:59.180 87484 INFO sysinv.api.controllers.v1.rest_api [-] PATCH cmd:http://localhost:30001/nfvi-plugins/v1/hosts hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:{"hostname": "controller-0", "uuid": "448a679f-bf8a-4819-8602-c0123f481cdb"} sysinv 2020-10-20 04:22:59.181 87484 WARNING sysinv.api.controllers.v1.rest_api [-] URLError Error e=: URLError: sysinv 2020-10-20 04:23:02.011 87484 INFO sysinv.api.controllers.v1.label [-] patch_data: {'openstack-compute-node': 'enabled'} sysinv 2020-10-20 04:23:02.029 127267 INFO sysinv.conductor.manager [-] update_kubernetes_label: label_dict={u'openstack-compute-node': u'enabled'} sysinv 2020-10-20 04:23:02.067 87484 INFO sysinv.api.controllers.v1.rest_api [-] PATCH cmd:http://localhost:30001/nfvi-plugins/v1/hosts hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:{"hostname": "controller-0", "uuid": "448a679f-bf8a-4819-8602-c0123f481cdb"} sysinv 2020-10-20 04:23:02.068 87484 WARNING sysinv.api.controllers.v1.rest_api [-] URLError Error e=: URLError: sysinv 2020-10-20 04:23:05.061 87484 INFO sysinv.api.controllers.v1.label [-] patch_data: {'openvswitch': 'enabled'} sysinv 2020-10-20 04:23:05.088 127267 INFO sysinv.conductor.manager [-] update_kubernetes_label: label_dict={u'openvswitch': u'enabled'} sysinv 2020-10-20 04:23:05.129 87484 INFO sysinv.api.controllers.v1.rest_api [-] PATCH cmd:http://localhost:30001/nfvi-plugins/v1/hosts hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:{"hostname": "controller-0", "uuid": "448a679f-bf8a-4819-8602-c0123f481cdb"} sysinv 2020-10-20 04:23:05.129 87484 WARNING sysinv.api.controllers.v1.rest_api [-] URLError Error e=: URLError: sysinv 2020-10-20 04:23:07.453 87485 INFO sysinv.api.controllers.v1.label [-] patch_data: {'sriov': 'enabled'} sysinv 2020-10-20 04:23:07.475 127267 INFO sysinv.conductor.manager [-] update_kubernetes_label: label_dict={u'sriov': u'enabled'} sysinv 2020-10-20 04:23:07.513 87485 INFO sysinv.api.controllers.v1.rest_api [-] PATCH cmd:http://localhost:30001/nfvi-plugins/v1/hosts hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:{"hostname": "controller-0", "uuid": "448a679f-bf8a-4819-8602-c0123f481cdb"} sysinv 2020-10-20 04:23:07.514 87485 WARNING sysinv.api.controllers.v1.rest_api [-] URLError Error e=: URLError: sysinv 2020-10-20 04:23:18.596 127267 INFO sysinv.conductor.manager [-] Setting config target of host 'controller-0' to '9db035f6-9c61-4929-997d-5389ac851f6c'. sysinv 2020-10-20 04:23:18.611 127267 INFO sysinv.conductor.manager [-] _config_update_hosts config_uuid=1db035f6-9c61-4929-997d-5389ac851f6c sysinv 2020-10-20 04:23:18.612 127267 INFO sysinv.conductor.manager [-] applying runtime manifest config_uuid=1db035f6-9c61-4929-997d-5389ac851f6c, classes: ['platform::partitions::runtime'] sysinv 2020-10-20 04:23:18.622 127267 INFO sysinv.puppet.puppet [-] Updating hiera for host: controller-0 with config_uuid: 1db035f6-9c61-4929-997d-5389ac851f6c sysinv 2020-10-20 04:23:20.578 127267 INFO sysinv.conductor.manager [-] Evaluating app reapply of cert-manager sysinv 2020-10-20 04:23:20.766 127267 INFO sysinv.conductor.manager [-] No override change after configuration action, skipping re-apply of cert-manager sysinv 2020-10-20 04:23:20.771 127267 INFO sysinv.agent.rpcapi [-] config_apply_runtime_manifest: fanout_cast: sending config 1db035f6-9c61-4929-997d-5389ac851f6c {'force': True, 'host_uuids': [u'448a679f-bf8a-4819-8602-c0123f481cdb'], 'partition_uuid': u'dcb7dc96-6629-48c4-b996-29eea3e9188b', 'report_status': 'manage_disk_partitions', 'classes': ['platform::partitions::runtime'], 'idisk_uuid': u'48d87919-58e7-4b5a-a6d4-0c61b3952240', 'personalities': [u'controller']} to agent sysinv 2020-10-20 04:23:20.783 76443 INFO sysinv.agent.manager [-] config_apply_runtime_manifest: 1db035f6-9c61-4929-997d-5389ac851f6c {u'force': True, u'host_uuids': [u'448a679f-bf8a-4819-8602-c0123f481cdb'], u'partition_uuid': u'dcb7dc96-6629-48c4-b996-29eea3e9188b', u'idisk_uuid': u'48d87919-58e7-4b5a-a6d4-0c61b3952240', u'classes': [u'platform::partitions::runtime'], u'report_status': u'manage_disk_partitions', u'personalities': [u'controller']} controller sysinv 2020-10-20 04:23:20.784 76443 INFO sysinv.agent.manager [-] controller-active sysinv 2020-10-20 04:23:20.784 76443 INFO sysinv.agent.manager [-] _apply_runtime_manifest with hieradata_path = '/opt/platform/puppet/20.12/hieradata' sysinv 2020-10-20 04:23:30.430 127267 INFO sysinv.conductor.manager [-] PART updating information for partition dcb7dc96-6629-48c4-b996-29eea3e9188b on host 448a679f-bf8a-4819-8602-c0123f481cdb was successful: {u'status': 0, u'device_path': u'/dev/disk/by-path/pci-0000:00:11.5-ata-2.0-part6', u'start_mib': 198737.0, u'uuid': u'dcb7dc96-6629-48c4-b996-29eea3e9188b', u'ihost_uuid': u'448a679f-bf8a-4819-8602-c0123f481cdb', u'type_name': u'LVM Physical Volume', u'available_mib': 187248, u'end_mib': 301137.0, u'type_guid': u'ba5eba11-0000-1111-2222-000000000001', u'size_mib': 102400.0} sysinv 2020-10-20 04:23:30.832 76443 INFO sysinv.agent.manager [-] Runtime manifest apply completed for classes [u'platform::partitions::runtime']. sysinv 2020-10-20 04:23:30.861 127267 INFO sysinv.conductor.manager [-] PART manifest application for partition dcb7dc96-6629-48c4-b996-29eea3e9188b on host 448a679f-bf8a-4819-8602-c0123f481cdb was successful sysinv 2020-10-20 04:23:30.867 127267 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:23:30.868 127267 WARNING sysinv.api.controllers.v1.rest_api [-] URLError Error e=: URLError: sysinv 2020-10-20 04:23:30.869 127267 INFO sysinv.conductor.manager [-] vim_api get_sw_update_strategy timed out sysinv 2020-10-20 04:23:31.383 76443 INFO sysinv.agent.manager [-] Agent config applied 1db035f6-9c61-4929-997d-5389ac851f6c sysinv 2020-10-20 04:23:31.395 127267 INFO sysinv.conductor.manager [-] _remove_config_from_reboot_config_list host: 448a679f-bf8a-4819-8602-c0123f481cdb,config_uuid: 1db035f6-9c61-4929-997d-5389ac851f6c sysinv 2020-10-20 04:23:31.396 127267 INFO sysinv.conductor.manager [-] _remove_config_from_reboot_config_list fail host:448a679f-bf8a-4819-8602-c0123f481cdb sysinv 2020-10-20 04:23:41.786 87485 WARNING wsme.api [-] Client-side error: No disk with id dcb7dc96-6629-48c4-b996-29eea3e9188b: DiskNotFound: No disk with id dcb7dc96-6629-48c4-b996-29eea3e9188b sysinv 2020-10-20 04:23:44.479 127267 INFO sysinv.conductor.manager [-] Setting config target of host 'controller-0' to 'a99562a0-8158-435e-a07e-81490457f770'. sysinv 2020-10-20 04:23:44.490 127267 INFO sysinv.conductor.manager [-] _config_update_hosts config_uuid=299562a0-8158-435e-a07e-81490457f770 sysinv 2020-10-20 04:23:44.491 127267 INFO sysinv.conductor.manager [-] applying runtime manifest config_uuid=299562a0-8158-435e-a07e-81490457f770, classes: ['platform::partitions::runtime'] sysinv 2020-10-20 04:23:44.501 127267 INFO sysinv.puppet.puppet [-] Updating hiera for host: controller-0 with config_uuid: 299562a0-8158-435e-a07e-81490457f770 sysinv 2020-10-20 04:23:46.445 127267 INFO sysinv.conductor.manager [-] Evaluating app reapply of cert-manager sysinv 2020-10-20 04:23:46.606 127267 INFO sysinv.conductor.manager [-] No override change after configuration action, skipping re-apply of cert-manager sysinv 2020-10-20 04:23:46.609 127267 INFO sysinv.agent.rpcapi [-] config_apply_runtime_manifest: fanout_cast: sending config 299562a0-8158-435e-a07e-81490457f770 {'force': True, 'host_uuids': [u'448a679f-bf8a-4819-8602-c0123f481cdb'], 'partition_uuid': u'cb857d4b-10a0-46a0-a327-1ca6a1ed0b9c', 'report_status': 'manage_disk_partitions', 'classes': ['platform::partitions::runtime'], 'idisk_uuid': u'48d87919-58e7-4b5a-a6d4-0c61b3952240', 'personalities': [u'controller']} to agent sysinv 2020-10-20 04:23:46.612 76443 INFO sysinv.agent.manager [-] config_apply_runtime_manifest: 299562a0-8158-435e-a07e-81490457f770 {u'force': True, u'host_uuids': [u'448a679f-bf8a-4819-8602-c0123f481cdb'], u'partition_uuid': u'cb857d4b-10a0-46a0-a327-1ca6a1ed0b9c', u'idisk_uuid': u'48d87919-58e7-4b5a-a6d4-0c61b3952240', u'classes': [u'platform::partitions::runtime'], u'report_status': u'manage_disk_partitions', u'personalities': [u'controller']} controller sysinv 2020-10-20 04:23:46.612 76443 INFO sysinv.agent.manager [-] controller-active sysinv 2020-10-20 04:23:46.612 76443 INFO sysinv.agent.manager [-] _apply_runtime_manifest with hieradata_path = '/opt/platform/puppet/20.12/hieradata' sysinv 2020-10-20 04:23:54.810 127267 INFO sysinv.conductor.manager [-] Sending agent update request for host 1 to update (audit_lvg, audit_partition, audit_pv) sysinv 2020-10-20 04:23:54.819 127267 INFO sysinv.agent.rpcapi [-] AgentApi.agent_update: fanout_cast: sending update request to agent for: (audit_lvg, audit_partition, audit_pv) sysinv 2020-10-20 04:23:56.742 127267 INFO sysinv.conductor.manager [-] PART updating information for partition cb857d4b-10a0-46a0-a327-1ca6a1ed0b9c on host 448a679f-bf8a-4819-8602-c0123f481cdb was successful: {u'status': 0, u'device_path': u'/dev/disk/by-path/pci-0000:00:11.5-ata-2.0-part7', u'start_mib': 301137.0, u'uuid': u'cb857d4b-10a0-46a0-a327-1ca6a1ed0b9c', u'ihost_uuid': u'448a679f-bf8a-4819-8602-c0123f481cdb', u'type_name': u'LVM Physical Volume', u'available_mib': 166768, u'end_mib': 321617.0, u'type_guid': u'ba5eba11-0000-1111-2222-000000000001', u'size_mib': 20480.0} sysinv 2020-10-20 04:23:57.117 76443 INFO sysinv.agent.manager [-] Runtime manifest apply completed for classes [u'platform::partitions::runtime']. sysinv 2020-10-20 04:23:57.134 127267 INFO sysinv.conductor.manager [-] PART manifest application for partition cb857d4b-10a0-46a0-a327-1ca6a1ed0b9c on host 448a679f-bf8a-4819-8602-c0123f481cdb was successful sysinv 2020-10-20 04:23:57.138 127267 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:23:57.139 127267 WARNING sysinv.api.controllers.v1.rest_api [-] URLError Error e=: URLError: sysinv 2020-10-20 04:23:57.139 127267 INFO sysinv.conductor.manager [-] vim_api get_sw_update_strategy timed out sysinv 2020-10-20 04:23:57.606 76443 INFO sysinv.agent.manager [-] Agent config applied 299562a0-8158-435e-a07e-81490457f770 sysinv 2020-10-20 04:23:57.619 127267 INFO sysinv.conductor.manager [-] _remove_config_from_reboot_config_list host: 448a679f-bf8a-4819-8602-c0123f481cdb,config_uuid: 299562a0-8158-435e-a07e-81490457f770 sysinv 2020-10-20 04:23:57.619 127267 INFO sysinv.conductor.manager [-] _remove_config_from_reboot_config_list fail host:448a679f-bf8a-4819-8602-c0123f481cdb sysinv 2020-10-20 04:23:57.651 76443 INFO sysinv.agent.manager [-] SysInv Agent Audit force updates: (audit_lvg, audit_partition, audit_pv) sysinv 2020-10-20 04:23:59.187 127267 INFO sysinv.conductor.manager [-] PV not found in Agent. uuid: 0a59633e-2b57-4509-85ff-8afb531ccbee current state: adding sysinv 2020-10-20 04:24:05.272 87484 WARNING wsme.api [-] Client-side error: No disk with id cb857d4b-10a0-46a0-a327-1ca6a1ed0b9c: DiskNotFound: No disk with id cb857d4b-10a0-46a0-a327-1ca6a1ed0b9c sysinv 2020-10-20 04:24:10.883 127267 INFO sysinv.conductor.manager [-] Setting config target of host 'controller-0' to 'ba8f872a-f451-4218-8605-023ca9f8e164'. sysinv 2020-10-20 04:24:10.893 127267 INFO sysinv.conductor.manager [-] _config_update_hosts config_uuid=ba8f872a-f451-4218-8605-023ca9f8e164 sysinv 2020-10-20 04:24:13.858 127267 INFO sysinv.conductor.manager [-] update_grub_config, host uuid: (448a679f-bf8a-4819-8602-c0123f481cdb), force: (True) sysinv 2020-10-20 04:24:13.867 127267 INFO sysinv.conductor.manager [-] Setting config target of host 'controller-0' to 'e2c66df4-6f43-4f9e-ad32-7529d0a54198'. sysinv 2020-10-20 04:24:13.877 127267 INFO sysinv.conductor.manager [-] _config_update_hosts config_uuid=62c66df4-6f43-4f9e-ad32-7529d0a54198 sysinv 2020-10-20 04:24:13.877 127267 INFO sysinv.conductor.manager [-] applying runtime manifest config_uuid=62c66df4-6f43-4f9e-ad32-7529d0a54198, classes: ['platform::compute::grub::runtime', 'platform::compute::config::runtime'] sysinv 2020-10-20 04:24:13.884 127267 INFO sysinv.puppet.puppet [-] Updating hiera for host: controller-0 with config_uuid: 62c66df4-6f43-4f9e-ad32-7529d0a54198 sysinv 2020-10-20 04:24:15.820 127267 INFO sysinv.conductor.manager [-] Evaluating app reapply of cert-manager sysinv 2020-10-20 04:24:15.995 127267 INFO sysinv.conductor.manager [-] No override change after configuration action, skipping re-apply of cert-manager sysinv 2020-10-20 04:24:15.998 127267 INFO sysinv.agent.rpcapi [-] config_apply_runtime_manifest: fanout_cast: sending config 62c66df4-6f43-4f9e-ad32-7529d0a54198 {'classes': ['platform::compute::grub::runtime', 'platform::compute::config::runtime'], 'force': True, 'personalities': ['controller', 'worker'], 'host_uuids': [u'448a679f-bf8a-4819-8602-c0123f481cdb']} to agent sysinv 2020-10-20 04:24:16.001 76443 INFO sysinv.agent.manager [-] config_apply_runtime_manifest: 62c66df4-6f43-4f9e-ad32-7529d0a54198 {u'classes': [u'platform::compute::grub::runtime', u'platform::compute::config::runtime'], u'force': True, u'personalities': [u'controller', u'worker'], u'host_uuids': [u'448a679f-bf8a-4819-8602-c0123f481cdb']} controller sysinv 2020-10-20 04:24:16.002 76443 INFO sysinv.agent.manager [-] controller-active sysinv 2020-10-20 04:24:16.002 76443 INFO sysinv.agent.manager [-] _apply_runtime_manifest with hieradata_path = '/opt/platform/puppet/20.12/hieradata' sysinv 2020-10-20 04:24:18.702 127267 INFO sysinv.conductor.manager [-] update_grub_config, host uuid: (448a679f-bf8a-4819-8602-c0123f481cdb), force: (True) sysinv 2020-10-20 04:24:18.712 127267 INFO sysinv.conductor.manager [-] Setting config target of host 'controller-0' to 'ed01a9a0-cf83-4394-81aa-097fba0a4ec4'. sysinv 2020-10-20 04:24:18.724 127267 INFO sysinv.conductor.manager [-] _config_update_hosts config_uuid=6d01a9a0-cf83-4394-81aa-097fba0a4ec4 sysinv 2020-10-20 04:24:18.724 127267 INFO sysinv.conductor.manager [-] applying runtime manifest config_uuid=6d01a9a0-cf83-4394-81aa-097fba0a4ec4, classes: ['platform::compute::grub::runtime', 'platform::compute::config::runtime'] sysinv 2020-10-20 04:24:18.732 127267 INFO sysinv.puppet.puppet [-] Updating hiera for host: controller-0 with config_uuid: 6d01a9a0-cf83-4394-81aa-097fba0a4ec4 sysinv 2020-10-20 04:24:21.440 127267 INFO sysinv.conductor.manager [-] Evaluating app reapply of cert-manager sysinv 2020-10-20 04:24:21.722 127267 INFO sysinv.conductor.manager [-] No override change after configuration action, skipping re-apply of cert-manager sysinv 2020-10-20 04:24:21.727 127267 INFO sysinv.agent.rpcapi [-] config_apply_runtime_manifest: fanout_cast: sending config 6d01a9a0-cf83-4394-81aa-097fba0a4ec4 {'classes': ['platform::compute::grub::runtime', 'platform::compute::config::runtime'], 'force': True, 'personalities': ['controller', 'worker'], 'host_uuids': [u'448a679f-bf8a-4819-8602-c0123f481cdb']} to agent sysinv 2020-10-20 04:24:23.109 76443 INFO sysinv.agent.manager [-] Runtime manifest apply completed for classes [u'platform::compute::grub::runtime', u'platform::compute::config::runtime']. sysinv 2020-10-20 04:24:23.110 76443 INFO sysinv.agent.manager [-] Agent config applied 62c66df4-6f43-4f9e-ad32-7529d0a54198 sysinv 2020-10-20 04:24:23.124 127267 INFO sysinv.conductor.manager [-] _remove_config_from_reboot_config_list host: 448a679f-bf8a-4819-8602-c0123f481cdb,config_uuid: 62c66df4-6f43-4f9e-ad32-7529d0a54198 sysinv 2020-10-20 04:24:23.125 127267 INFO sysinv.conductor.manager [-] _remove_config_from_reboot_config_list fail host:448a679f-bf8a-4819-8602-c0123f481cdb sysinv 2020-10-20 04:24:23.144 76443 INFO sysinv.agent.manager [-] config_apply_runtime_manifest: 6d01a9a0-cf83-4394-81aa-097fba0a4ec4 {u'classes': [u'platform::compute::grub::runtime', u'platform::compute::config::runtime'], u'force': True, u'personalities': [u'controller', u'worker'], u'host_uuids': [u'448a679f-bf8a-4819-8602-c0123f481cdb']} controller sysinv 2020-10-20 04:24:23.144 76443 INFO sysinv.agent.manager [-] controller-active sysinv 2020-10-20 04:24:23.145 76443 INFO sysinv.agent.manager [-] _apply_runtime_manifest with hieradata_path = '/opt/platform/puppet/20.12/hieradata' sysinv 2020-10-20 04:24:24.641 127267 INFO sysinv.conductor.manager [-] update_grub_config, host uuid: (448a679f-bf8a-4819-8602-c0123f481cdb), force: (True) sysinv 2020-10-20 04:24:24.650 127267 INFO sysinv.conductor.manager [-] Setting config target of host 'controller-0' to 'dc44ae7c-696e-45e2-8976-3f157d5615a4'. sysinv 2020-10-20 04:24:24.662 127267 INFO sysinv.conductor.manager [-] _config_update_hosts config_uuid=5c44ae7c-696e-45e2-8976-3f157d5615a4 sysinv 2020-10-20 04:24:24.662 127267 INFO sysinv.conductor.manager [-] applying runtime manifest config_uuid=5c44ae7c-696e-45e2-8976-3f157d5615a4, classes: ['platform::compute::grub::runtime', 'platform::compute::config::runtime'] sysinv 2020-10-20 04:24:24.670 127267 INFO sysinv.puppet.puppet [-] Updating hiera for host: controller-0 with config_uuid: 5c44ae7c-696e-45e2-8976-3f157d5615a4 sysinv 2020-10-20 04:24:27.066 127267 INFO sysinv.conductor.manager [-] Evaluating app reapply of cert-manager sysinv 2020-10-20 04:24:27.276 127267 INFO sysinv.conductor.manager [-] No override change after configuration action, skipping re-apply of cert-manager sysinv 2020-10-20 04:24:27.280 127267 INFO sysinv.agent.rpcapi [-] config_apply_runtime_manifest: fanout_cast: sending config 5c44ae7c-696e-45e2-8976-3f157d5615a4 {'classes': ['platform::compute::grub::runtime', 'platform::compute::config::runtime'], 'force': True, 'personalities': ['controller', 'worker'], 'host_uuids': [u'448a679f-bf8a-4819-8602-c0123f481cdb']} to agent sysinv 2020-10-20 04:24:28.954 76443 INFO sysinv.agent.manager [-] Runtime manifest apply completed for classes [u'platform::compute::grub::runtime', u'platform::compute::config::runtime']. sysinv 2020-10-20 04:24:28.955 76443 INFO sysinv.agent.manager [-] Agent config applied 6d01a9a0-cf83-4394-81aa-097fba0a4ec4 sysinv 2020-10-20 04:24:28.972 127267 INFO sysinv.conductor.manager [-] _remove_config_from_reboot_config_list host: 448a679f-bf8a-4819-8602-c0123f481cdb,config_uuid: 6d01a9a0-cf83-4394-81aa-097fba0a4ec4 sysinv 2020-10-20 04:24:28.973 127267 INFO sysinv.conductor.manager [-] _remove_config_from_reboot_config_list fail host:448a679f-bf8a-4819-8602-c0123f481cdb sysinv 2020-10-20 04:24:28.993 76443 INFO sysinv.agent.manager [-] config_apply_runtime_manifest: 5c44ae7c-696e-45e2-8976-3f157d5615a4 {u'classes': [u'platform::compute::grub::runtime', u'platform::compute::config::runtime'], u'force': True, u'personalities': [u'controller', u'worker'], u'host_uuids': [u'448a679f-bf8a-4819-8602-c0123f481cdb']} controller sysinv 2020-10-20 04:24:28.993 76443 INFO sysinv.agent.manager [-] controller-active sysinv 2020-10-20 04:24:28.993 76443 INFO sysinv.agent.manager [-] _apply_runtime_manifest with hieradata_path = '/opt/platform/puppet/20.12/hieradata' sysinv 2020-10-20 04:24:29.770 127267 INFO sysinv.conductor.manager [-] update_grub_config, host uuid: (448a679f-bf8a-4819-8602-c0123f481cdb), force: (True) sysinv 2020-10-20 04:24:29.778 127267 INFO sysinv.conductor.manager [-] Setting config target of host 'controller-0' to 'ce5523c0-dcaf-49bd-8fce-45b894e5983f'. sysinv 2020-10-20 04:24:29.788 127267 INFO sysinv.conductor.manager [-] _config_update_hosts config_uuid=4e5523c0-dcaf-49bd-8fce-45b894e5983f sysinv 2020-10-20 04:24:29.789 127267 INFO sysinv.conductor.manager [-] applying runtime manifest config_uuid=4e5523c0-dcaf-49bd-8fce-45b894e5983f, classes: ['platform::compute::grub::runtime', 'platform::compute::config::runtime'] sysinv 2020-10-20 04:24:29.798 127267 INFO sysinv.puppet.puppet [-] Updating hiera for host: controller-0 with config_uuid: 4e5523c0-dcaf-49bd-8fce-45b894e5983f sysinv 2020-10-20 04:24:32.250 127267 INFO sysinv.conductor.manager [-] Evaluating app reapply of cert-manager sysinv 2020-10-20 04:24:32.454 127267 INFO sysinv.conductor.manager [-] No override change after configuration action, skipping re-apply of cert-manager sysinv 2020-10-20 04:24:32.460 127267 INFO sysinv.agent.rpcapi [-] config_apply_runtime_manifest: fanout_cast: sending config 4e5523c0-dcaf-49bd-8fce-45b894e5983f {'classes': ['platform::compute::grub::runtime', 'platform::compute::config::runtime'], 'force': True, 'personalities': ['controller', 'worker'], 'host_uuids': [u'448a679f-bf8a-4819-8602-c0123f481cdb']} to agent sysinv 2020-10-20 04:24:34.957 76443 INFO sysinv.agent.manager [-] Runtime manifest apply completed for classes [u'platform::compute::grub::runtime', u'platform::compute::config::runtime']. sysinv 2020-10-20 04:24:34.958 76443 INFO sysinv.agent.manager [-] Agent config applied 5c44ae7c-696e-45e2-8976-3f157d5615a4 sysinv 2020-10-20 04:24:34.971 127267 INFO sysinv.conductor.manager [-] _remove_config_from_reboot_config_list host: 448a679f-bf8a-4819-8602-c0123f481cdb,config_uuid: 5c44ae7c-696e-45e2-8976-3f157d5615a4 sysinv 2020-10-20 04:24:34.972 127267 INFO sysinv.conductor.manager [-] _remove_config_from_reboot_config_list fail host:448a679f-bf8a-4819-8602-c0123f481cdb sysinv 2020-10-20 04:24:34.989 76443 INFO sysinv.agent.manager [-] config_apply_runtime_manifest: 4e5523c0-dcaf-49bd-8fce-45b894e5983f {u'classes': [u'platform::compute::grub::runtime', u'platform::compute::config::runtime'], u'force': True, u'personalities': [u'controller', u'worker'], u'host_uuids': [u'448a679f-bf8a-4819-8602-c0123f481cdb']} controller sysinv 2020-10-20 04:24:34.990 76443 INFO sysinv.agent.manager [-] controller-active sysinv 2020-10-20 04:24:34.990 76443 INFO sysinv.agent.manager [-] _apply_runtime_manifest with hieradata_path = '/opt/platform/puppet/20.12/hieradata' sysinv 2020-10-20 04:24:37.647 87484 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2020-10-20-04-24-37 patch sysinv 2020-10-20 04:24:37.647 87484 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['action'] sysinv 2020-10-20 04:24:37.671 87484 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost check_unlock_application sysinv 2020-10-20 04:24:37.674 87484 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost check_unlock_controller sysinv 2020-10-20 04:24:37.847 87484 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost check_unlock_worker sysinv 2020-10-20 04:24:38.413 87484 INFO sysinv.api.controllers.v1.host [-] Memory: Total=95196 MiB, Allocated=18264 MiB, 2M: 40348 pages None pages pending, 1G: 78 pages 10 pages pending sysinv 2020-10-20 04:24:38.413 87484 INFO sysinv.api.controllers.v1.host [-] pending 1G memory node=b9ca39f7-18a8-43f8-bb31-3358723089b4 mib_reserved=7000 sysinv 2020-10-20 04:24:38.466 87484 INFO sysinv.api.controllers.v1.host [-] Memory: Total=96735 MiB, Allocated=12264 MiB, 2M: 47367 pages None pages pending, 1G: 92 pages 10 pages pending sysinv 2020-10-20 04:24:38.466 87484 INFO sysinv.api.controllers.v1.host [-] pending 1G memory node=7e58b1fb-0a5a-400d-ae83-b503bbb97709 mib_reserved=8000 sysinv 2020-10-20 04:24:38.508 87484 INFO sysinv.api.controllers.v1.host [-] host(controller-0) node(1): vm_mem_mib=88196, sysinv 2020-10-20 04:24:38.509 87484 INFO sysinv.api.controllers.v1.host [-] Updating mem values of host(controller-0) node(1): {'vm_hugepages_nr_4K': 19956736} sysinv 2020-10-20 04:24:38.527 87484 INFO sysinv.api.controllers.v1.host [-] host(controller-0) node(2): vm_mem_mib=95735, sysinv 2020-10-20 04:24:38.528 87484 INFO sysinv.api.controllers.v1.host [-] Updating mem values of host(controller-0) node(2): {'vm_hugepages_nr_4K': 21886720} sysinv 2020-10-20 04:24:39.403 87484 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://192.168.204.1:5491/v1/query_hosts/ hdr:None payload:None sysinv 2020-10-20 04:24:39.403 87484 WARNING sysinv.api.controllers.v1.rest_api [-] URLError Error e=: URLError: sysinv 2020-10-20 04:24:39.404 87484 WARNING sysinv.api.controllers.v1.host [-] No response from patch api controller-0 e='NoneType' object has no attribute '__getitem__' sysinv 2020-10-20 04:24:39.404 87484 INFO sysinv.api.controllers.v1.host [-] controller-0 _semantic_mtc_check_action unlock sysinv 2020-10-20 04:24:39.404 87484 INFO sysinv.api.controllers.v1.host [-] controller-0 action=unlock ihost_val_prenotify: {'ihost_action': 'unlock'} ihost_val: {'ihost_action': 'unlock', 'task': u'Unlocking'} sysinv 2020-10-20 04:24:39.405 87484 INFO sysinv.api.controllers.v1.host [-] controller-0 host.update.ihost_val_prenotify {'ihost_action': 'unlock'} sysinv 2020-10-20 04:24:39.405 87484 INFO sysinv.api.controllers.v1.host [-] controller-0 action_check action=unlock, notify_vim=False notify_mtce=True rc=True sysinv 2020-10-20 04:24:39.405 87484 INFO sysinv.api.controllers.v1.host [-] controller-0 post action_check hostupdate action=unlock notify_vim=False notify_mtc=True skip_notify_mtce=False sysinv 2020-10-20 04:24:39.405 87484 INFO sysinv.api.controllers.v1.host [-] controller-0 stage_action unlock sysinv 2020-10-20 04:24:39.405 87484 INFO sysinv.api.controllers.v1.host [-] controller-0 _handle_unlock_action sysinv 2020-10-20 04:24:39.406 87484 INFO sysinv.api.controllers.v1.host [-] controller-0 Action staged: unlock sysinv 2020-10-20 04:24:39.406 87484 INFO sysinv.api.controllers.v1.host [-] controller-0 post action_stage hostupdate action=unlock notify_vim=False notify_mtc=True skip_notify_mtce=False sysinv 2020-10-20 04:24:39.406 87484 INFO sysinv.api.controllers.v1.host [-] controller-0 2. delta_handle ['action'] sysinv 2020-10-20 04:24:39.406 87484 INFO sysinv.api.controllers.v1.host [-] controller-0 post delta_handle hostupdate action=unlock notify_vim=False notify_mtc=True skip_notify_mtce=False sysinv 2020-10-20 04:24:39.407 87484 INFO sysinv.api.controllers.v1.host [-] update ihost_val_prenotify: {'ihost_action': 'unlock'} sysinv 2020-10-20 04:24:39.427 87484 INFO sysinv.api.controllers.v1.host [-] controller-0 apply ihost_val {'ihost_action': 'unlock', 'task': u'Unlocking'} sysinv 2020-10-20 04:24:39.427 87484 INFO sysinv.api.controllers.v1.host [-] controller-0 Perform configure_ihost. sysinv 2020-10-20 04:24:39.433 127267 INFO sysinv.conductor.manager [-] configure_ihost controller-0 sysinv 2020-10-20 04:24:40.379 127267 INFO sysinv.puppet.puppet [-] Updating hiera for host: controller-0 with config_uuid: None sysinv 2020-10-20 04:24:40.906 76443 INFO sysinv.agent.manager [-] Runtime manifest apply completed for classes [u'platform::compute::grub::runtime', u'platform::compute::config::runtime']. sysinv 2020-10-20 04:24:40.907 76443 INFO sysinv.agent.manager [-] Agent config applied 4e5523c0-dcaf-49bd-8fce-45b894e5983f sysinv 2020-10-20 04:24:40.974 127267 INFO sysinv.conductor.manager [-] _remove_config_from_reboot_config_list host: 448a679f-bf8a-4819-8602-c0123f481cdb,config_uuid: 4e5523c0-dcaf-49bd-8fce-45b894e5983f sysinv 2020-10-20 04:24:40.974 127267 INFO sysinv.conductor.manager [-] _remove_config_from_reboot_config_list fail host:448a679f-bf8a-4819-8602-c0123f481cdb sysinv 2020-10-20 04:24:42.176 127267 INFO sysinv.conductor.manager [-] creating ceph_mon for host controller-0 with ceph_mon_gib=20. sysinv 2020-10-20 04:24:42.192 127267 INFO sysinv.conductor.manager [-] Setting config target of host 'controller-0' to 'ba503315-588d-4352-9d42-9ffc318f12d7'. sysinv 2020-10-20 04:24:42.201 127267 INFO sysinv.conductor.manager [-] _config_update_hosts config_uuid=3a503315-588d-4352-9d42-9ffc318f12d7 sysinv 2020-10-20 04:24:42.201 127267 INFO sysinv.conductor.manager [-] applying runtime manifest config_uuid=ba503315-588d-4352-9d42-9ffc318f12d7, classes: ['platform::compute::grub::runtime', 'platform::compute::config::runtime'] sysinv 2020-10-20 04:24:42.208 127267 INFO sysinv.puppet.puppet [-] Updating hiera for host: controller-0 with config_uuid: ba503315-588d-4352-9d42-9ffc318f12d7 sysinv 2020-10-20 04:24:44.191 127267 INFO sysinv.conductor.manager [-] Evaluating app reapply of cert-manager sysinv 2020-10-20 04:24:44.355 127267 INFO sysinv.conductor.manager [-] No override change after configuration action, skipping re-apply of cert-manager sysinv 2020-10-20 04:24:44.358 127267 INFO sysinv.agent.rpcapi [-] config_apply_runtime_manifest: fanout_cast: sending config 3a503315-588d-4352-9d42-9ffc318f12d7 {'classes': ['platform::compute::grub::runtime', 'platform::compute::config::runtime'], 'force': True, 'personalities': ['controller'], 'host_uuids': [u'448a679f-bf8a-4819-8602-c0123f481cdb']} to agent sysinv 2020-10-20 04:24:44.361 76443 INFO sysinv.agent.manager [-] config_apply_runtime_manifest: 3a503315-588d-4352-9d42-9ffc318f12d7 {u'classes': [u'platform::compute::grub::runtime', u'platform::compute::config::runtime'], u'force': True, u'personalities': [u'controller'], u'host_uuids': [u'448a679f-bf8a-4819-8602-c0123f481cdb']} controller sysinv 2020-10-20 04:24:44.361 76443 INFO sysinv.agent.manager [-] controller-active sysinv 2020-10-20 04:24:44.362 76443 INFO sysinv.agent.manager [-] _apply_runtime_manifest with hieradata_path = '/opt/platform/puppet/20.12/hieradata' sysinv 2020-10-20 04:24:44.367 127267 INFO sysinv.conductor.manager [-] Setting config target of host 'controller-0' to '9cf90f10-432f-4016-adbd-48c28c847fb2'. sysinv 2020-10-20 04:24:44.377 127267 INFO sysinv.conductor.manager [-] _config_update_hosts config_uuid=1cf90f10-432f-4016-adbd-48c28c847fb2 sysinv 2020-10-20 04:24:44.378 127267 INFO sysinv.puppet.puppet [-] Updating hiera for host: controller-0 with config_uuid: 9cf90f10-432f-4016-adbd-48c28c847fb2 sysinv 2020-10-20 04:24:45.846 87484 INFO sysinv.api.controllers.v1.host [-] controller-0 Action unlock perform notify_mtce sysinv 2020-10-20 04:24:45.847 87484 INFO sysinv.api.controllers.v1.mtce_api [-] host_add for controller-0 cmd=http://localhost:2112/v1/hosts/ hdr={'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload={'tboot': u'false', 'ttys_dcd': None, 'subfunctions': u'controller,worker', 'bm_ip': None, 'install_state': None, 'rootfs_device': u'/dev/disk/by-path/pci-0000:00:11.5-ata-2.0', 'bm_username': None, 'clock_synchronization': u'ntp', 'operation': 'add', 'serialid': None, 'id': 1, 'vim_progress_status': None, 'console': u'ttyS0,115200', 'uuid': u'448a679f-bf8a-4819-8602-c0123f481cdb', 'mgmt_ip': u'192.168.204.2', 'software_load': u'20.12', 'config_status': None, 'hostname': u'controller-0', 'iscsi_initiator_name': None, 'capabilities': {u'stor_function': u'monitor'}, 'install_output': u'text', 'device_image_update': None, 'location': {}, 'availability': u'online', 'invprovision': u'provisioning', 'peer_id': None, 'administrative': u'locked', 'personality': u'controller', 'recordtype': u'standard', 'reboot_needed': False, 'bm_mac': None, 'inv_state': u'inventoried', 'mtce_info': None, 'isystem_uuid': u'c743a346-f508-4abd-9ab8-09fca79d3071', 'boot_device': u'/dev/disk/by-path/pci-0000:00:11.5-ata-2.0', 'install_state_info': None, 'mgmt_mac': u'00:00:00:00:00:00', 'subfunction_oper': u'disabled', 'target_load': u'20.12', 'vsc_controllers': None, 'operational': u'disabled', 'subfunction_avail': u'online', 'action': u'unlock', 'bm_type': u'none'} sysinv 2020-10-20 04:24:45.847 87484 INFO sysinv.api.controllers.v1.rest_api [-] POST cmd:http://localhost:2112/v1/hosts/ hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:{"tboot": "false", "ttys_dcd": null, "subfunctions": "controller,worker", "bm_ip": null, "install_state": null, "rootfs_device": "/dev/disk/by-path/pci-0000:00:11.5-ata-2.0", "bm_username": null, "clock_synchronization": "ntp", "operation": "add", "serialid": null, "id": 1, "vim_progress_status": null, "console": "ttyS0,115200", "uuid": "448a679f-bf8a-4819-8602-c0123f481cdb", "mgmt_ip": "192.168.204.2", "software_load": "20.12", "config_status": null, "hostname": "controller-0", "iscsi_initiator_name": null, "capabilities": {"stor_function": "monitor"}, "install_output": "text", "device_image_update": null, "location": {}, "availability": "online", "invprovision": "provisioning", "peer_id": null, "administrative": "locked", "personality": "controller", "recordtype": "standard", "reboot_needed": false, "bm_mac": null, "inv_state": "inventoried", "mtce_info": null, "isystem_uuid": "c743a346-f508-4abd-9ab8-09fca79d3071", "boot_device": "/dev/disk/by-path/pci-0000:00:11.5-ata-2.0", "install_state_info": null, "mgmt_mac": "00:00:00:00:00:00", "subfunction_oper": "disabled", "target_load": "20.12", "vsc_controllers": null, "operational": "disabled", "subfunction_avail": "online", "action": "unlock", "bm_type": "none"} sysinv 2020-10-20 04:24:45.858 87484 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'pass'} sysinv 2020-10-20 04:24:45.873 87484 INFO sysinv.api.controllers.v1.host [-] host controller-0 ihost_patch_end_2020-10-20-04-24-45 patch sysinv 2020-10-20 04:24:45.889 87485 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2020-10-20-04-24-45 patch sysinv 2020-10-20 04:24:45.889 87485 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['subfunction_avail', 'administrative', 'availability'] sysinv 2020-10-20 04:24:45.890 87485 INFO sysinv.api.controllers.v1.host [-] controller-0 2. delta_handle ['administrative'] sysinv 2020-10-20 04:24:45.890 87485 INFO sysinv.api.controllers.v1.host [-] controller-0 post delta_handle hostupdate action=None notify_vim=False notify_mtc=False skip_notify_mtce=False sysinv 2020-10-20 04:24:45.921 87485 INFO sysinv.api.controllers.v1.host [-] host controller-0 ihost_patch_end_2020-10-20-04-24-45 patch sysinv 2020-10-20 04:24:45.966 87484 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['uptime', 'task'] sysinv 2020-10-20 04:24:49.927 76443 INFO sysinv.agent.manager [-] Runtime manifest apply completed for classes [u'platform::compute::grub::runtime', u'platform::compute::config::runtime']. sysinv 2020-10-20 04:24:49.928 76443 INFO sysinv.agent.manager [-] Agent config applied ba503315-588d-4352-9d42-9ffc318f12d7 sysinv 2020-10-20 04:24:49.942 127267 INFO sysinv.conductor.manager [-] _remove_config_from_reboot_config_list host: 448a679f-bf8a-4819-8602-c0123f481cdb,config_uuid: ba503315-588d-4352-9d42-9ffc318f12d7 sysinv 2020-10-20 04:24:49.942 127267 INFO sysinv.conductor.manager [-] _remove_config_from_reboot_config_list fail host:448a679f-bf8a-4819-8602-c0123f481cdb sysinv 2020-10-20 04:24:54.765 127267 INFO sysinv.conductor.manager [-] Sending agent update request for host 1 to update (audit_lvg, audit_pv) sysinv 2020-10-20 04:24:54.772 127267 INFO sysinv.agent.rpcapi [-] AgentApi.agent_update: fanout_cast: sending update request to agent for: (audit_lvg, audit_pv) sysinv 2020-10-20 04:24:54.869 76443 INFO sysinv.agent.manager [-] SysInv Agent Audit force updates: (audit_lvg, audit_pv) sysinv 2020-10-20 04:24:56.309 127267 INFO sysinv.conductor.manager [-] PV not found in Agent. uuid: 0a59633e-2b57-4509-85ff-8afb531ccbee current state: adding sysinv 2020-10-20 04:24:56.309 127267 INFO sysinv.conductor.manager [-] PV not found in Agent. uuid: 451b955c-80bd-43fb-a154-39e56c58409d current state: adding sysinv 2020-10-20 04:25:18.452 77572 INFO sysinv.openstack.common.service [-] Caught SIGTERM, exiting sysinv 2020-10-20 04:25:18.516 87380 INFO oslo_service.service [-] Caught SIGTERM, stopping children sysinv 2020-10-20 04:25:18.518 87380 INFO oslo.service.wsgi [-] Stopping WSGI server. sysinv 2020-10-20 04:25:18.518 87380 INFO oslo_service.service [-] Waiting on 2 children to exit sysinv 2020-10-20 04:25:18.519 87485 INFO oslo.service.wsgi [-] Stopping WSGI server. sysinv 2020-10-20 04:25:18.518 87484 INFO oslo.service.wsgi [-] Stopping WSGI server. sysinv 2020-10-20 04:25:18.648 87380 INFO oslo_service.service [-] Child 87484 exited with status 0 sysinv 2020-10-20 04:25:18.674 87380 INFO oslo_service.service [-] Child 87485 exited with status 0 sysinv 2020-10-20 04:25:19.832 127267 INFO sysinv.openstack.common.service [-] Caught SIGTERM, exiting sysinv 2020-10-20 04:25:21.897 76443 ERROR sysinv.openstack.common.rpc.common [-] Failed to consume message from queue: Socket closed: IOError: Socket closed 2020-10-20 04:25:21.897 76443 ERROR sysinv.openstack.common.rpc.common Traceback (most recent call last): 2020-10-20 04:25:21.897 76443 ERROR sysinv.openstack.common.rpc.common File "/usr/lib64/python2.7/site-packages/sysinv/openstack/common/rpc/impl_kombu.py", line 564, in ensure 2020-10-20 04:25:21.897 76443 ERROR sysinv.openstack.common.rpc.common return method(*args, **kwargs) 2020-10-20 04:25:21.897 76443 ERROR sysinv.openstack.common.rpc.common File "/usr/lib64/python2.7/site-packages/sysinv/openstack/common/rpc/impl_kombu.py", line 644, in _consume 2020-10-20 04:25:21.897 76443 ERROR sysinv.openstack.common.rpc.common return self.connection.drain_events(timeout=timeout) 2020-10-20 04:25:21.897 76443 ERROR sysinv.openstack.common.rpc.common File "/usr/lib/python2.7/site-packages/kombu/connection.py", line 301, in drain_events 2020-10-20 04:25:21.897 76443 ERROR sysinv.openstack.common.rpc.common return self.transport.drain_events(self.connection, **kwargs) 2020-10-20 04:25:21.897 76443 ERROR sysinv.openstack.common.rpc.common File "/usr/lib/python2.7/site-packages/kombu/transport/pyamqp.py", line 103, in drain_events 2020-10-20 04:25:21.897 76443 ERROR sysinv.openstack.common.rpc.common return connection.drain_events(**kwargs) 2020-10-20 04:25:21.897 76443 ERROR sysinv.openstack.common.rpc.common File "/usr/lib/python2.7/site-packages/amqp/connection.py", line 464, in drain_events 2020-10-20 04:25:21.897 76443 ERROR sysinv.openstack.common.rpc.common return self.blocking_read(timeout) 2020-10-20 04:25:21.897 76443 ERROR sysinv.openstack.common.rpc.common File "/usr/lib/python2.7/site-packages/amqp/connection.py", line 468, in blocking_read 2020-10-20 04:25:21.897 76443 ERROR sysinv.openstack.common.rpc.common frame = self.transport.read_frame() 2020-10-20 04:25:21.897 76443 ERROR sysinv.openstack.common.rpc.common File "/usr/lib/python2.7/site-packages/amqp/transport.py", line 269, in read_frame 2020-10-20 04:25:21.897 76443 ERROR sysinv.openstack.common.rpc.common frame_header = read(7, True) 2020-10-20 04:25:21.897 76443 ERROR sysinv.openstack.common.rpc.common File "/usr/lib/python2.7/site-packages/amqp/transport.py", line 417, in _read 2020-10-20 04:25:21.897 76443 ERROR sysinv.openstack.common.rpc.common raise IOError('Socket closed') 2020-10-20 04:25:21.897 76443 ERROR sysinv.openstack.common.rpc.common IOError: Socket closed 2020-10-20 04:25:21.897 76443 ERROR sysinv.openstack.common.rpc.common sysinv 2020-10-20 04:25:21.901 76443 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:25:21.906 76443 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:25:22.908 76443 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:25:22.913 76443 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 3 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:25:25.864 76443 INFO sysinv.openstack.common.service [-] Caught SIGTERM, exiting sysinv 2020-10-20 04:29:32.571 3581 INFO sysinv.agent.lldp.manager [-] Configured sysinv LLDP agent drivers: [] sysinv 2020-10-20 04:29:32.572 3581 INFO sysinv.agent.lldp.manager [-] Loaded sysinv LLDP agent drivers: [] sysinv 2020-10-20 04:29:32.572 3581 INFO sysinv.agent.lldp.manager [-] Registered sysinv LLDP agent drivers: [] sysinv 2020-10-20 04:29:32.617 3581 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:29:32.617 4431 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:29:33.619 3581 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:29:33.619 4431 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:29:33.624 3581 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 3 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:29:33.625 4431 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 3 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:29:36.628 3581 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:29:36.628 4431 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:29:36.633 3581 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 5 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:29:36.634 4431 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 5 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:29:41.636 3581 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:29:41.637 4431 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:29:41.642 3581 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 7 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:29:41.643 4431 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 7 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:29:48.644 3581 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:29:48.645 4431 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:29:48.649 3581 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 9 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:29:48.651 4431 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 9 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:29:57.654 3581 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:29:57.655 4431 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:29:57.659 3581 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 11 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:29:57.661 4431 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 11 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:30:08.666 3581 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:30:08.667 4431 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:30:08.671 3581 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 13 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:30:08.673 4431 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 13 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:30:21.680 3581 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:30:21.681 4431 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:30:21.685 3581 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 15 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:30:21.686 4431 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 15 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:30:36.696 3581 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:30:36.697 4431 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:30:36.702 3581 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 17 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:30:36.702 4431 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 17 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:30:53.714 3581 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:30:53.715 4431 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:30:53.720 3581 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 19 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:30:53.720 4431 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 19 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:31:12.734 3581 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:31:12.735 4431 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:31:12.740 3581 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 21 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:31:12.740 4431 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 21 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:31:33.756 3581 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:31:33.757 4431 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:31:33.762 3581 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 23 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:31:33.762 4431 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 23 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:31:56.780 3581 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:31:56.780 4431 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:31:56.785 3581 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 25 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:31:56.786 4431 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 25 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:32:21.806 3581 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:32:21.806 4431 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:32:21.811 3581 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 27 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:32:21.812 4431 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 27 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:32:48.834 4431 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:32:48.834 3581 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:32:48.839 4431 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 29 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:32:48.840 3581 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 29 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:33:17.864 4431 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:33:17.864 3581 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:33:17.869 4431 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:33:17.870 3581 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:33:47.895 4431 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:33:47.895 3581 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:33:47.900 4431 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:33:47.901 3581 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:34:17.925 4431 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:34:17.926 3581 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:34:17.931 4431 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:34:17.932 3581 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:34:47.957 4431 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:34:47.957 3581 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:34:47.962 4431 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:34:47.963 3581 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:35:17.988 4431 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:35:17.989 3581 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:35:17.993 4431 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:35:17.994 3581 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:35:48.018 4431 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:35:48.020 3581 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:35:48.024 4431 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:35:48.026 3581 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:36:18.050 4431 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:36:18.051 3581 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:36:18.055 4431 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:36:18.057 3581 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:36:48.080 4431 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:36:48.082 3581 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:36:48.086 4431 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:36:48.088 3581 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:37:18.111 4431 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:37:18.114 3581 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 sysinv 2020-10-20 04:37:18.116 4431 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:37:18.119 3581 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:37:34.587 4431 INFO sysinv.openstack.common.service [-] Caught SIGTERM, exiting sysinv 2020-10-20 04:37:34.650 3581 INFO sysinv.openstack.common.service [-] Caught SIGTERM, exiting sysinv 2020-10-20 04:37:35.415 98452 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on 192.168.204.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:37:35.446 98607 INFO sysinv.agent.lldp.manager [-] Configured sysinv LLDP agent drivers: ['lldpd', 'ovs'] sysinv 2020-10-20 04:37:35.450 98607 INFO sysinv.agent.lldp.manager [-] Loaded sysinv LLDP agent drivers: ['lldpd', 'ovs'] sysinv 2020-10-20 04:37:35.450 98607 INFO sysinv.agent.lldp.manager [-] Registered sysinv LLDP agent drivers: ['lldpd', 'ovs'] sysinv 2020-10-20 04:37:35.481 98607 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on 192.168.204.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:37:36.416 98452 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on 192.168.204.1:5672 sysinv 2020-10-20 04:37:36.422 98452 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on 192.168.204.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 3 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:37:36.483 98607 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on 192.168.204.1:5672 sysinv 2020-10-20 04:37:36.488 98607 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on 192.168.204.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 3 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:37:39.425 98452 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on 192.168.204.1:5672 sysinv 2020-10-20 04:37:39.431 98452 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on 192.168.204.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 5 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:37:39.492 98607 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on 192.168.204.1:5672 sysinv 2020-10-20 04:37:39.497 98607 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on 192.168.204.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 5 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:37:44.434 98452 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on 192.168.204.1:5672 sysinv 2020-10-20 04:37:44.440 98452 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on 192.168.204.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 7 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:37:44.500 98607 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on 192.168.204.1:5672 sysinv 2020-10-20 04:37:44.506 98607 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on 192.168.204.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 7 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:37:51.443 98452 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on 192.168.204.1:5672 sysinv 2020-10-20 04:37:51.448 98452 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on 192.168.204.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 9 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:37:51.509 98607 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on 192.168.204.1:5672 sysinv 2020-10-20 04:37:51.515 98607 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on 192.168.204.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 9 seconds.: error: [Errno 111] ECONNREFUSED sysinv 2020-10-20 04:37:59.512 105738 INFO sysinv.helm.helm [-] No entry points for systemconfig.helm_applications found. sysinv 2020-10-20 04:37:59.513 105738 INFO sysinv.helm.helm [-] No entry points for systemconfig.armada.manifest_ops found. sysinv 2020-10-20 04:37:59.547 105864 WARNING oslo_config.cfg [-] Deprecated: Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S release.). Its value may be silently ignored in the future. sysinv 2020-10-20 04:37:59.548 105864 WARNING oslo_config.cfg [-] Deprecated: Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken". sysinv 2020-10-20 04:37:59.552 105864 WARNING keystonemiddleware.auth_token [-] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. sysinv 2020-10-20 04:37:59.555 105864 INFO oslo.service.wsgi [-] sysinv_api listening on 192.168.204.1:6385 sysinv 2020-10-20 04:37:59.556 105864 INFO oslo_service.service [-] Starting 1 workers sysinv 2020-10-20 04:37:59.564 105864 WARNING keystonemiddleware._common.config [-] The option "user_domain_name" is not known to keystonemiddleware sysinv 2020-10-20 04:37:59.564 105864 WARNING keystonemiddleware._common.config [-] The option "auth_url" is not known to keystonemiddleware sysinv 2020-10-20 04:37:59.565 105864 WARNING keystonemiddleware._common.config [-] The option "project_domain_name" is not known to keystonemiddleware sysinv 2020-10-20 04:37:59.565 105864 WARNING keystonemiddleware._common.config [-] The option "username" is not known to keystonemiddleware sysinv 2020-10-20 04:37:59.565 105864 WARNING keystonemiddleware._common.config [-] The option "project_name" is not known to keystonemiddleware sysinv 2020-10-20 04:37:59.565 105864 WARNING keystonemiddleware._common.config [-] The option "password" is not known to keystonemiddleware sysinv 2020-10-20 04:37:59.565 105864 WARNING keystonemiddleware.auth_token [-] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. sysinv 2020-10-20 04:37:59.568 105864 INFO oslo.service.wsgi [-] sysinv_api_pxe listening on 169.254.202.1:6385 sysinv 2020-10-20 04:37:59.568 105864 INFO oslo_service.service [-] Starting 1 workers sysinv 2020-10-20 04:37:59.576 105738 INFO sysinv.conductor.kube_app [-] PluginHelper: App cert-manager, version 1.0-6: Found valid plugin sysinv 2020-10-20 04:37:59.586 105738 INFO sysinv.conductor.manager [-] sysinv-conductor start committed system={'system_mode': u'simplex', 'created_at': datetime.datetime(2020, 10, 20, 4, 4, 11, 893909, tzinfo=), 'uuid': u'c743a346-f508-4abd-9ab8-09fca79d3071', 'software_version': u'20.12', 'service_project_name': u'services', 'system_type': u'All-in-one', 'name': u'9d36d9ba-bd18-46f6-83c0-7f16a0d3b398', 'description': None, 'location': None, 'updated_at': datetime.datetime(2020, 10, 20, 4, 22, 18, 768551, tzinfo=), 'capabilities': {u'https_enabled': False, u'vswitch_type': u'ovs-dpdk', u'region_config': False, u'sdn_enabled': False, u'shared_services': u'[]'}, 'id': 1, 'contact': None, 'security_feature': u'nopti nospectre_v2 nospectre_v1', 'services': 72, 'timezone': u'UTC', 'security_profile': u'standard', 'distributed_cloud_role': None, 'region_name': u'RegionOne'} sysinv 2020-10-20 04:37:59.611 105738 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on 192.168.204.1:5672 sysinv 2020-10-20 04:37:59.734 105738 INFO sysinv.conductor.keystone_listener [-] Sysinv keystone listener started! sysinv 2020-10-20 04:37:59.774 105738 INFO sysinv.conductor.manager [-] _upgrade_downgrade_kube_static_images executing playbook: /usr/share/ansible/stx-ansible/playbooks/upgrade-static-images.yml for version v1.18.1 sysinv 2020-10-20 04:38:00.453 98452 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on 192.168.204.1:5672 sysinv 2020-10-20 04:38:00.460 98452 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on 192.168.204.1:5672 sysinv 2020-10-20 04:38:00.466 98452 INFO sysinv.fpga_agent.manager [-] sysinv-fpga-agent started sysinv 2020-10-20 04:38:00.467 98452 INFO sysinv.fpga_agent.manager [-] Waiting for docker login flag. sysinv 2020-10-20 04:38:00.519 98607 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on 192.168.204.1:5672 sysinv 2020-10-20 04:38:00.526 98607 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on 192.168.204.1:5672 sysinv 2020-10-20 04:38:00.533 98607 INFO sysinv.agent.manager [-] _report_to_conductor initial_reports_required=set(['pci_device', 'pv', 'cpu', 'lvg', 'numa', 'memory', 'disk', 'port']) sysinv 2020-10-20 04:38:00.533 98607 INFO sysinv.agent.manager [-] Sysinv Agent audit running inv_get_and_report. sysinv 2020-10-20 04:38:00.933 98607 WARNING sysinv.agent.pci [-] Enabling device enp24s0f0 to query link speed sysinv 2020-10-20 04:38:00.939 98607 WARNING sysinv.agent.pci [-] ATTR speed unknown for: enp24s0f0 (flags: 0x1002): IOError: [Errno 22] Invalid argument sysinv 2020-10-20 04:38:00.939 98607 WARNING sysinv.agent.pci [-] Disabling device enp24s0f0 after querying link speed: IOError: [Errno 22] Invalid argument sysinv 2020-10-20 04:38:01.247 98607 WARNING sysinv.agent.pci [-] Enabling device enp24s0f1 to query link speed sysinv 2020-10-20 04:38:01.252 98607 WARNING sysinv.agent.pci [-] ATTR speed unknown for: enp24s0f1 (flags: 0x1002): IOError: [Errno 22] Invalid argument sysinv 2020-10-20 04:38:01.253 98607 WARNING sysinv.agent.pci [-] Disabling device enp24s0f1 after querying link speed: IOError: [Errno 22] Invalid argument sysinv 2020-10-20 04:38:01.377 107057 WARNING keystonemiddleware.auth_token [-] Using the in-process token cache is deprecated as of the 4.2.0 release and may be removed in the 5.0.0 release or the 'O' development cycle. The in-process cache causes inconsistent results and high memory usage. When the feature is removed the auth_token middleware will not cache tokens by default which may result in performance issues. It is recommended to use memcache for the auth_token token cache by setting the memcached_servers option. sysinv 2020-10-20 04:38:01.867 98607 WARNING sysinv.agent.pci [-] Enabling device eno2 to query link speed sysinv 2020-10-20 04:38:01.872 98607 WARNING sysinv.agent.pci [-] ATTR speed unknown for: eno2 (flags: 0x1002): IOError: [Errno 22] Invalid argument sysinv 2020-10-20 04:38:01.873 98607 WARNING sysinv.agent.pci [-] Disabling device eno2 after querying link speed: IOError: [Errno 22] Invalid argument sysinv 2020-10-20 04:38:01.962 98607 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on 192.168.204.1:5672 sysinv 2020-10-20 04:38:02.112 105738 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on 192.168.204.1:5672 sysinv 2020-10-20 04:38:02.145 105738 INFO sysinv.conductor.manager [-] Updating platform data for host: 448a679f-bf8a-4819-8602-c0123f481cdb with: {u'first_report': True} sysinv 2020-10-20 04:38:02.163 98607 INFO sysinv.agent.manager [-] Sysinv Agent platform update by host: {'first_report': True} sysinv 2020-10-20 04:38:02.164 98607 INFO sysinv.agent.manager [-] Agent found matching ihost: 448a679f-bf8a-4819-8602-c0123f481cdb sysinv 2020-10-20 04:38:02.164 98607 INFO sysinv.agent.manager [-] _report_to_conductor initial_reports_required=set(['pci_device', 'pv', 'cpu', 'lvg', 'numa', 'memory', 'disk', 'port']) sysinv 2020-10-20 04:38:02.480 105738 INFO sysinv.conductor.manager [-] port a144afaf-76d4-496c-96a6-f935e174f982 update attr: {'speed': None, 'sriov_vfs_pci_address': u'', 'sriov_totalvfs': u'64\n', 'sriov_vf_pdevice_id': None, 'dpdksupport': True, 'sriov_numvfs': u'0\n', 'driver': u'i40e', 'sriov_vf_driver': None} sysinv 2020-10-20 04:38:02.732 105738 INFO sysinv.conductor.manager [-] port 53e6668d-b01c-4605-81c2-75ea9aee2dbe update attr: {'speed': None, 'sriov_vfs_pci_address': u'', 'sriov_totalvfs': u'64\n', 'sriov_vf_pdevice_id': None, 'dpdksupport': True, 'sriov_numvfs': u'0\n', 'driver': u'i40e', 'sriov_vf_driver': None} sysinv 2020-10-20 04:38:02.862 105738 INFO sysinv.conductor.manager [-] port ba7fbc63-8a10-4abc-9bb5-5638a943d84c update attr: {'speed': u'10000', 'sriov_vfs_pci_address': u'', 'sriov_totalvfs': u'32\n', 'sriov_vf_pdevice_id': None, 'dpdksupport': True, 'sriov_numvfs': u'0\n', 'driver': u'i40e', 'sriov_vf_driver': None} sysinv 2020-10-20 04:38:03.123 105738 INFO sysinv.conductor.manager [-] port 0992a3f8-b50e-4ebf-8567-a82d4de525a0 update attr: {'speed': None, 'sriov_vfs_pci_address': u'', 'sriov_totalvfs': u'32\n', 'sriov_vf_pdevice_id': None, 'dpdksupport': True, 'sriov_numvfs': u'0\n', 'driver': u'i40e', 'sriov_vf_driver': None} sysinv 2020-10-20 04:38:03.187 105738 INFO sysinv.conductor.manager [-] attr: {'sriov_numvfs': 0, 'driver': None, 'sriov_vf_driver': None, 'sriov_vf_pdevice_id': None, 'psvendor': u'Intel Corporation', 'pdevice_id': u'a1ec', 'pclass': u'Unassigned class [ff00]', 'psdevice': u'Device 0000', 'sriov_vfs_pci_address': u'', 'pvendor': u'Intel Corporation', 'pvendor_id': u'8086', 'pclass_id': u'ff0000', 'sriov_totalvfs': None} sysinv 2020-10-20 04:38:03.205 105738 INFO sysinv.conductor.manager [-] attr: {'sriov_numvfs': 0, 'driver': None, 'sriov_vf_driver': None, 'sriov_vf_pdevice_id': None, 'psvendor': u'Intel Corporation', 'pdevice_id': u'a1ed', 'pclass': u'Unassigned class [ff00]', 'psdevice': u'Device 35ce', 'sriov_vfs_pci_address': u'', 'pvendor': u'Intel Corporation', 'pvendor_id': u'8086', 'pclass_id': u'ff0000', 'sriov_totalvfs': None} sysinv 2020-10-20 04:38:03.225 105738 INFO sysinv.conductor.manager [-] attr: {'sriov_numvfs': 0, 'driver': u'ahci', 'sriov_vf_driver': None, 'sriov_vf_pdevice_id': None, 'psvendor': u'-p01', 'pdevice_id': u'a1d2', 'pclass': u'SATA controller', 'psdevice': u'Intel Corporation', 'sriov_vfs_pci_address': u'', 'pvendor': u'Intel Corporation', 'pvendor_id': u'8086', 'pclass_id': u'010601', 'sriov_totalvfs': None} sysinv 2020-10-20 04:38:03.242 105738 INFO sysinv.conductor.manager [-] attr: {'sriov_numvfs': 0, 'driver': None, 'sriov_vf_driver': None, 'sriov_vf_pdevice_id': None, 'psvendor': u'-p30', 'pdevice_id': u'a1af', 'pclass': u'USB controller', 'psdevice': u'Intel Corporation', 'sriov_vfs_pci_address': u'', 'pvendor': u'Intel Corporation', 'pvendor_id': u'8086', 'pclass_id': u'0c0330', 'sriov_totalvfs': None} sysinv 2020-10-20 04:38:03.260 105738 INFO sysinv.conductor.manager [-] attr: {'sriov_numvfs': 0, 'driver': None, 'sriov_vf_driver': None, 'sriov_vf_pdevice_id': None, 'psvendor': u'Intel Corporation', 'pdevice_id': u'a1b1', 'pclass': u'Signal processing controller', 'psdevice': u'Device 35ce', 'sriov_vfs_pci_address': u'', 'pvendor': u'Intel Corporation', 'pvendor_id': u'8086', 'pclass_id': u'118000', 'sriov_totalvfs': None} sysinv 2020-10-20 04:38:03.279 105738 INFO sysinv.conductor.manager [-] attr: {'sriov_numvfs': 0, 'driver': u'mei_me', 'sriov_vf_driver': None, 'sriov_vf_pdevice_id': None, 'psvendor': u'Intel Corporation', 'pdevice_id': u'a1ba', 'pclass': u'Communication controller', 'psdevice': u'Device 35ce', 'sriov_vfs_pci_address': u'', 'pvendor': u'Intel Corporation', 'pvendor_id': u'8086', 'pclass_id': u'078000', 'sriov_totalvfs': None} sysinv 2020-10-20 04:38:03.297 105738 INFO sysinv.conductor.manager [-] attr: {'sriov_numvfs': 0, 'driver': None, 'sriov_vf_driver': None, 'sriov_vf_pdevice_id': None, 'psvendor': u'Intel Corporation', 'pdevice_id': u'a1bb', 'pclass': u'Communication controller', 'psdevice': u'Device 35ce', 'sriov_vfs_pci_address': u'', 'pvendor': u'Intel Corporation', 'pvendor_id': u'8086', 'pclass_id': u'078000', 'sriov_totalvfs': None} sysinv 2020-10-20 04:38:03.316 105738 INFO sysinv.conductor.manager [-] attr: {'sriov_numvfs': 0, 'driver': None, 'sriov_vf_driver': None, 'sriov_vf_pdevice_id': None, 'psvendor': u'Intel Corporation', 'pdevice_id': u'a1be', 'pclass': u'Communication controller', 'psdevice': u'Device 35ce', 'sriov_vfs_pci_address': u'', 'pvendor': u'Intel Corporation', 'pvendor_id': u'8086', 'pclass_id': u'078000', 'sriov_totalvfs': None} sysinv 2020-10-20 04:38:03.334 105738 INFO sysinv.conductor.manager [-] attr: {'sriov_numvfs': 0, 'driver': u'ahci', 'sriov_vf_driver': None, 'sriov_vf_pdevice_id': None, 'psvendor': u'-p01', 'pdevice_id': u'a182', 'pclass': u'SATA controller', 'psdevice': u'Intel Corporation', 'sriov_vfs_pci_address': u'', 'pvendor': u'Intel Corporation', 'pvendor_id': u'8086', 'pclass_id': u'010601', 'sriov_totalvfs': None} sysinv 2020-10-20 04:38:03.352 105738 INFO sysinv.conductor.manager [-] attr: {'sriov_numvfs': 0, 'driver': None, 'sriov_vf_driver': None, 'sriov_vf_pdevice_id': None, 'psvendor': u'Intel Corporation', 'pdevice_id': u'a1a1', 'pclass': u'Memory controller', 'psdevice': u'Device 35ce', 'sriov_vfs_pci_address': u'', 'pvendor': u'Intel Corporation', 'pvendor_id': u'8086', 'pclass_id': u'058000', 'sriov_totalvfs': None} sysinv 2020-10-20 04:38:03.372 105738 INFO sysinv.conductor.manager [-] attr: {'sriov_numvfs': 0, 'driver': u'i801_smbus', 'sriov_vf_driver': None, 'sriov_vf_pdevice_id': None, 'psvendor': u'Intel Corporation', 'pdevice_id': u'a1a3', 'pclass': u'SMBus', 'psdevice': u'Device 35ce', 'sriov_vfs_pci_address': u'', 'pvendor': u'Intel Corporation', 'pvendor_id': u'8086', 'pclass_id': u'0c0500', 'sriov_totalvfs': None} sysinv 2020-10-20 04:38:03.389 105738 INFO sysinv.conductor.manager [-] attr: {'sriov_numvfs': 0, 'driver': None, 'sriov_vf_driver': None, 'sriov_vf_pdevice_id': None, 'psvendor': u'Intel Corporation', 'pdevice_id': u'a1a4', 'pclass': u'Serial bus controller [0c80]', 'psdevice': u'Device 35ce', 'sriov_vfs_pci_address': u'', 'pvendor': u'Intel Corporation', 'pvendor_id': u'8086', 'pclass_id': u'0c8000', 'sriov_totalvfs': None} sysinv 2020-10-20 04:38:03.409 105738 INFO sysinv.conductor.manager [-] attr: {'sriov_numvfs': 0, 'driver': None, 'sriov_vf_driver': None, 'sriov_vf_pdevice_id': None, 'psvendor': u'ASPEED Technology, Inc.', 'pdevice_id': u'2000', 'pclass': u'VGA compatible controller', 'psdevice': u'ASPEED Graphics Family', 'sriov_vfs_pci_address': u'', 'pvendor': u'ASPEED Technology, Inc.', 'pvendor_id': u'1a03', 'pclass_id': u'030000', 'sriov_totalvfs': None} sysinv 2020-10-20 04:38:03.496 105738 INFO sysinv.conductor.manager [-] Already in db numa_node=0 mynuma_nodes=[0, 1] sysinv 2020-10-20 04:38:03.497 105738 INFO sysinv.conductor.manager [-] Already in db numa_node=1 mynuma_nodes=[0, 1] sysinv 2020-10-20 04:38:03.554 105738 INFO sysinv.conductor.manager [-] Logical CPU topology: host:controller-0 (controller,worker), sockets:2, cores/socket=25, threads/core=2, reference:current (unchanged) sysinv 2020-10-20 04:38:03.555 105738 INFO sysinv.conductor.manager [-] cpu_id : 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 sysinv 2020-10-20 04:38:03.555 105738 INFO sysinv.conductor.manager [-] socket_id : 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 sysinv 2020-10-20 04:38:03.555 105738 INFO sysinv.conductor.manager [-] core_id : 0 1 2 3 4 5 6 9 10 11 12 13 16 17 18 19 20 21 24 25 26 27 28 29 0 1 2 3 4 5 6 8 9 10 11 12 13 16 17 18 19 20 21 25 26 27 28 29 0 1 2 3 4 5 6 9 10 11 12 13 16 17 18 19 20 21 24 25 26 27 28 29 0 1 2 3 4 5 6 8 9 10 11 12 13 16 17 18 19 20 21 25 26 27 28 29 sysinv 2020-10-20 04:38:03.555 105738 INFO sysinv.conductor.manager [-] thread_id : 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 sysinv 2020-10-20 04:38:05.253 105738 INFO sysinv.conductor.manager [-] PV not found in Agent. uuid: 0a59633e-2b57-4509-85ff-8afb531ccbee current state: adding sysinv 2020-10-20 04:38:05.253 105738 INFO sysinv.conductor.manager [-] PV not found in Agent. uuid: 451b955c-80bd-43fb-a154-39e56c58409d current state: adding sysinv 2020-10-20 04:38:05.556 105738 INFO sysinv.conductor.manager [-] platform_interfaces host_id=1 info_list=[{'numa_node': 0, 'name': u'eno1'}] sysinv 2020-10-20 04:38:05.560 98607 INFO sysinv.agent.manager [-] Affine platform interface eno1 with cpulist 0,1 sysinv 2020-10-20 04:38:05.802 98607 INFO sysinv.agent.manager [-] /usr/bin/affine-interrupts.sh eno1 0,1 return 0 sysinv 2020-10-20 04:38:05.819 98607 INFO sysinv.agent.manager [-] _wait_for_nova_lvg: Must wait before reporting node availability. Conductor sees unprovisioned nova-local state. Would result in an invalid host aggregate assignment. sysinv 2020-10-20 04:38:05.833 98607 INFO sysinv.agent.manager [-] _wait_for_nova_lvg: Must wait before reporting node availability. Conductor sees unprovisioned nova-local state. Would result in an invalid host aggregate assignment. sysinv 2020-10-20 04:38:07.427 105738 INFO sysinv.conductor.manager [-] PV not found in Agent. uuid: 0a59633e-2b57-4509-85ff-8afb531ccbee current state: adding sysinv 2020-10-20 04:38:07.427 105738 INFO sysinv.conductor.manager [-] PV not found in Agent. uuid: 451b955c-80bd-43fb-a154-39e56c58409d current state: adding sysinv 2020-10-20 04:38:07.497 98607 INFO sysinv.agent.manager [-] Disk size for /dev/disk/by-path/pci-0000:00:11.5-ata-2.0: 476 ... large disk defaults sysinv 2020-10-20 04:38:07.534 105738 INFO sysinv.conductor.manager [-] Host FS 'scratch' already exists sysinv 2020-10-20 04:38:07.535 105738 INFO sysinv.conductor.manager [-] Host FS 'backup' already exists sysinv 2020-10-20 04:38:07.535 105738 INFO sysinv.conductor.manager [-] Host FS 'docker' already exists sysinv 2020-10-20 04:38:07.535 105738 INFO sysinv.conductor.manager [-] Host FS 'kubelet' already exists sysinv 2020-10-20 04:38:07.539 98607 INFO sysinv.agent.manager [-] Initial inventory completed host 448a679f-bf8a-4819-8602-c0123f481cdb sysinv 2020-10-20 04:38:07.557 98607 INFO sysinv.agent.manager [-] Agent config applied 9cf90f10-432f-4016-adbd-48c28c847fb2 sysinv 2020-10-20 04:38:07.567 105738 INFO sysinv.conductor.manager [-] _remove_config_from_reboot_config_list host: 448a679f-bf8a-4819-8602-c0123f481cdb,config_uuid: 9cf90f10-432f-4016-adbd-48c28c847fb2 sysinv 2020-10-20 04:38:07.579 105738 INFO sysinv.conductor.manager [-] _clear_config_from_reboot_config_list host:448a679f-bf8a-4819-8602-c0123f481cdb sysinv 2020-10-20 04:38:07.585 105738 INFO sysinv.conductor.manager [-] SYS_I Clear system config alarm: controller-0 target config 9cf90f10-432f-4016-adbd-48c28c847fb2 fmAPI.cpp(137): Connected to FM Manager. sysinv 2020-10-20 04:38:12.469 98452 INFO sysinv.fpga_agent.manager [-] Found docker login flag, continuing. sysinv 2020-10-20 04:38:12.469 98452 INFO sysinv.fpga_agent.manager [-] Resetting N3000 FPGAs. sysinv 2020-10-20 04:38:12.485 98452 INFO sysinv.fpga_agent.manager [-] Done resetting N3000 FPGAs. sysinv 2020-10-20 04:38:12.485 98452 INFO sysinv.fpga_agent.manager [-] Agent found host UUID: 448a679f-bf8a-4819-8602-c0123f481cdb sysinv 2020-10-20 04:38:14.111 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['uptime', 'task'] sysinv 2020-10-20 04:38:14.215 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2020-10-20-04-38-14 patch sysinv 2020-10-20 04:38:14.216 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_end. No changes from mtce/1.0. sysinv 2020-10-20 04:38:17.490 98452 INFO sysinv.fpga_agent.manager [-] Updating N3000 PCI info. sysinv 2020-10-20 04:38:17.542 98452 INFO sysinv.fpga_agent.manager [-] reporting FPGA inventory for host 448a679f-bf8a-4819-8602-c0123f481cdb: [] sysinv 2020-10-20 04:38:17.550 98452 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on 192.168.204.1:5672 sysinv 2020-10-20 04:38:17.552 105738 INFO sysinv.conductor.manager [-] Entering device_update_by_host 448a679f-bf8a-4819-8602-c0123f481cdb [] sysinv 2020-10-20 04:38:18.415 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2020-10-20-04-38-18 patch sysinv 2020-10-20 04:38:18.416 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['availability'] sysinv 2020-10-20 04:38:18.433 107057 INFO sysinv.api.controllers.v1.host [-] host controller-0 ihost_patch_end_2020-10-20-04-38-18 patch sysinv 2020-10-20 04:38:18.483 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['uptime', 'task'] sysinv 2020-10-20 04:38:23.423 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['uptime', 'task'] sysinv 2020-10-20 04:38:23.470 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['uptime', 'task'] sysinv 2020-10-20 04:38:23.864 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['uptime', 'task'] sysinv 2020-10-20 04:38:23.915 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2020-10-20-04-38-23 patch sysinv 2020-10-20 04:38:23.915 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['availability', 'operational'] sysinv 2020-10-20 04:38:23.949 107057 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on 192.168.204.1:5672 sysinv 2020-10-20 04:38:23.953 105738 INFO sysinv.conductor.manager [-] copied /etc/sysinv/sysinv.conf to /opt/platform/sysinv/20.12/sysinv.conf.default sysinv 2020-10-20 04:38:23.957 107057 INFO sysinv.api.controllers.v1.host [-] stage_administrative_update: provisioned successfully sysinv 2020-10-20 04:38:23.958 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 apply ihost_val {'invprovision': 'provisioned'} sysinv 2020-10-20 04:38:24.030 107057 INFO sysinv.api.controllers.v1.host [-] host controller-0 ihost_patch_end_2020-10-20-04-38-24 patch sysinv 2020-10-20 04:38:24.079 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['uptime', 'task'] sysinv 2020-10-20 04:38:29.756 105738 WARNING oslo_messaging.server [-] Possible hang: wait is waiting for stop to complete sysinv 2020-10-20 04:38:30.696 105738 INFO ceph_client [-] Request params: url=https://controller-0:7999/request?wait=1, json={'prefix': 'fsid', 'format': 'text'} sysinv 2020-10-20 04:38:30.707 105738 INFO ceph_client [-] Result: {u'waiting': [], u'has_failed': False, u'state': u'success', u'is_waiting': False, u'running': [], u'failed': [], u'finished': [{u'outb': u'b3bff1e8-4af8-406b-9b99-9dc16275bec4\n', u'outs': u'', u'command': u'fsid format=text'}], u'is_finished': True, u'id': u'140072843136656'} sysinv 2020-10-20 04:38:30.712 105738 INFO sysinv.conductor.manager [-] Ceph cluster has become responsive sysinv 2020-10-20 04:38:31.444 105738 INFO ceph_client [-] Request params: url=https://controller-0:7999/request?wait=1, json={'prefix': 'fsid', 'format': 'text'} sysinv 2020-10-20 04:38:31.453 105738 INFO ceph_client [-] Result: {u'waiting': [], u'has_failed': False, u'state': u'success', u'is_waiting': False, u'running': [], u'failed': [], u'finished': [{u'outb': u'b3bff1e8-4af8-406b-9b99-9dc16275bec4\n', u'outs': u'', u'command': u'fsid format=text'}], u'is_finished': True, u'id': u'140072843136848'} sysinv 2020-10-20 04:38:31.458 105738 INFO sysinv.conductor.ceph [-] Update cluster record: fsid=b3bff1e8-4af8-406b-9b99-9dc16275bec4. sysinv 2020-10-20 04:38:31.492 105738 INFO sysinv.common.ceph [-] ceph osd crush rule ls sysinv 2020-10-20 04:38:32.207 105738 INFO ceph_client [-] Request params: url=https://controller-0:7999/request?wait=1, json={'prefix': 'osd crush rule ls', 'format': 'json'} sysinv 2020-10-20 04:38:32.215 105738 INFO ceph_client [-] Result: {u'waiting': [], u'has_failed': False, u'state': u'success', u'is_waiting': False, u'running': [], u'failed': [], u'finished': [{u'outb': u'["storage_tier_ruleset"]', u'outs': u'', u'command': u'osd crush rule ls format=json'}], u'is_finished': True, u'id': u'140072843135184'} sysinv 2020-10-20 04:38:32.220 105738 INFO sysinv.common.ceph [-] CRUSH: 200 : sysinv 2020-10-20 04:38:34.463 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['uptime', 'task'] sysinv 2020-10-20 04:38:34.585 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2020-10-20-04-38-34 patch sysinv 2020-10-20 04:38:34.585 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_end. No changes from mtce/1.0. sysinv 2020-10-20 04:38:34.728 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2020-10-20-04-38-34 patch sysinv 2020-10-20 04:38:34.728 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['subfunction_oper', 'subfunction_avail'] sysinv 2020-10-20 04:38:34.783 107057 INFO sysinv.api.controllers.v1.host [-] host controller-0 ihost_patch_end_2020-10-20-04-38-34 patch sysinv 2020-10-20 04:38:42.655 105738 INFO sysinv.common.utils [-] ansible-playbook: PLAY [all] ********************************************************************* TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [Fail if kubernetes_version is not defined] ******************************* TASK [Create the upgrade overrides file] *************************************** changed: [localhost] TASK [Read the overrides variables] ******************************************** ok: [localhost] TASK [common/push-docker-images : Get docker registries if not in bootstap or restore mode] *** included: /usr/share/ansible/stx-ansible/playbooks/roles/common/push-docker-images/tasks/get_docker_registry.yml for localhost => (item={u'name': u'k8s_registry', u'value': {u'url': u'k8s.gcr.io'}}) included: /usr/share/ansible/stx-ansible/playbooks/roles/common/push-docker-images/tasks/get_docker_registry.yml for localhost => (item={u'name': u'gcr_registry', u'value': {u'url': u'gcr.io'}}) included: /usr/share/ansible/stx-ansible/playbooks/roles/common/push-docker-images/tasks/get_docker_registry.yml for localhost => (item={u'name': u'quay_registry', u'value': {u'url': u'quay.io'}}) included: /usr/share/ansible/stx-ansible/playbooks/roles/common/push-docker-images/tasks/get_docker_registry.yml for localhost => (item={u'name': u'docker_registry', u'value': {u'url': u'docker.io'}}) included: /usr/share/ansible/stx-ansible/playbooks/roles/common/push-docker-images/tasks/get_docker_registry.yml for localhost => (item={u'name': u'elastic_registry', u'value': {u'url': u'docker.elastic.co'}}) TASK [common/push-docker-images : Query the k8s_registry] ********************** changed: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'name': u'secure', 'value': u'False'}) ok: [localhost] => (item={'name': u'url', 'value': u'kasstxj.ka.intel.com:5000'}) TASK [common/push-docker-images : Validate k8s_registry information if it exists] *** TASK [common/push-docker-images : Set secure to bool] ************************** ok: [localhost] TASK [common/push-docker-images : Get the k8s_registry barbican secret if it's authenticated] *** TASK [common/push-docker-images : Validate k8s_registry secret] **************** TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'value': u'kasstxj.ka.intel.com:5000', 'key': u'url'}) ok: [localhost] => (item={'value': False, 'key': u'secure'}) TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : Query the gcr_registry] ********************** changed: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'name': u'secure', 'value': u'False'}) ok: [localhost] => (item={'name': u'url', 'value': u'kasstxj.ka.intel.com:5000'}) TASK [common/push-docker-images : Validate gcr_registry information if it exists] *** TASK [common/push-docker-images : Set secure to bool] ************************** ok: [localhost] TASK [common/push-docker-images : Get the gcr_registry barbican secret if it's authenticated] *** TASK [common/push-docker-images : Validate gcr_registry secret] **************** TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'value': u'kasstxj.ka.intel.com:5000', 'key': u'url'}) ok: [localhost] => (item={'value': False, 'key': u'secure'}) TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : Query the quay_registry] ********************* changed: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'name': u'secure', 'value': u'False'}) ok: [localhost] => (item={'name': u'url', 'value': u'kasstxj.ka.intel.com:5000'}) TASK [common/push-docker-images : Validate quay_registry information if it exists] *** TASK [common/push-docker-images : Set secure to bool] ************************** ok: [localhost] TASK [common/push-docker-images : Get the quay_registry barbican secret if it's authenticated] *** TASK [common/push-docker-images : Validate quay_registry secret] *************** TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'value': u'kasstxj.ka.intel.com:5000', 'key': u'url'}) ok: [localhost] => (item={'value': False, 'key': u'secure'}) TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : Query the docker_registry] ******************* changed: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'name': u'secure', 'value': u'False'}) ok: [localhost] => (item={'name': u'url', 'value': u'kasstxj.ka.intel.com:5000'}) TASK [common/push-docker-images : Validate docker_registry information if it exists] *** TASK [common/push-docker-images : Set secure to bool] ************************** ok: [localhost] TASK [common/push-docker-images : Get the docker_registry barbican secret if it's authenticated] *** TASK [common/push-docker-images : Validate docker_registry secret] ************* TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'value': u'kasstxj.ka.intel.com:5000', 'key': u'url'}) ok: [localhost] => (item={'value': False, 'key': u'secure'}) TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : Query the elastic_registry] ****************** changed: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'name': u'secure', 'value': u'False'}) ok: [localhost] => (item={'name': u'url', 'value': u'kasstxj.ka.intel.com:5000'}) TASK [common/push-docker-images : Validate elastic_registry information if it exists] *** TASK [common/push-docker-images : Set secure to bool] ************************** ok: [localhost] TASK [common/push-docker-images : Get the elastic_registry barbican secret if it's authenticated] *** TASK [common/push-docker-images : Validate elastic_registry secret] ************ TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'value': u'kasstxj.ka.intel.com:5000', 'key': u'url'}) ok: [localhost] => (item={'value': False, 'key': u'secure'}) TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : Get registry credentials if registry type is AWS ECR] *** TASK [common/load-images-information : set_fact] ******************************* TASK [common/load-images-information : Get the list of kubernetes images] ****** changed: [localhost] TASK [common/load-images-information : set_fact] ******************************* ok: [localhost] TASK [common/load-images-information : include_vars] *************************** ok: [localhost] TASK [common/load-images-information : Get the list of platform images] ******** ok: [localhost] TASK [common/push-docker-images : Set download images list] ******************** TASK [common/push-docker-images : Set download images list to static images if upgrading static images] *** ok: [localhost] TASK [common/push-docker-images : Set download images list to k8s network images if upgrading k8s networking] *** TASK [common/push-docker-images : Set download images list to kubernetes images if upgrading kubernetes] *** TASK [common/push-docker-images : Set download images list to netapp images if installing trident] *** TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : debug] *************************************** ok: [localhost] => { "download_images_list": [ "gcr.io/kubernetes-helm/tiller:v2.16.1", "quay.io/airshipit/armada:8a1638098f88d92bf799ef4934abe569789b885e-ubuntu_bionic", "docker.io/starlingx/n3000-opae:stx.4.0-v1.0.0", "quay.io/stackanetes/kubernetes-entrypoint:v0.3.1" ] } TASK [common/push-docker-images : Set registries information] ****************** ok: [localhost] => (item={u'replaced_url': u'kasstxj.ka.intel.com:5000', u'default_url': u'k8s.gcr.io'}) ok: [localhost] => (item={u'replaced_url': u'kasstxj.ka.intel.com:5000', u'default_url': u'gcr.io'}) ok: [localhost] => (item={u'replaced_url': u'kasstxj.ka.intel.com:5000', u'default_url': u'quay.io'}) ok: [localhost] => (item={u'replaced_url': u'kasstxj.ka.intel.com:5000', u'default_url': u'docker.io'}) ok: [localhost] => (item={u'replaced_url': u'kasstxj.ka.intel.com:5000', u'default_url': u'docker.elastic.co'}) TASK [common/push-docker-images : Log in k8s, gcr, quay, docker registries if credentials exist] *** TASK [common/push-docker-images : Get local registry credentials] ************** changed: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : Download images and push to local registry] *** changed: [localhost] TASK [common/push-docker-images : debug] *************************************** ok: [localhost] => { "msg": [ "Image is up to date for sha256:1f92aa902d739d544e621fe2ceaee04a4fc5b67c3e3ed8cf0b19aa2620763d3a", "Image is up to date for sha256:3061a8a540ac0dee710c1b37edad7855581dc027a18890759c91792615505f13", "Image is up to date for sha256:fb95693fe5c67fc46893c1735d85f00f462dc7f5254f5ddbcbbe85fd4ef71717", "Image is up to date for sha256:7fb3c2364b87e9241db7549bf11d42c129130f44e930d1ce36523fc693186e89", "Image download succeeded: kasstxj.ka.intel.com:5000/kubernetes-helm/tiller:v2.16.1", "Image push succeeded: registry.local:9001/gcr.io/kubernetes-helm/tiller:v2.16.1", "Image kasstxj.ka.intel.com:5000/kubernetes-helm/tiller:v2.16.1 download succeeded by containerd", "Image download succeeded: kasstxj.ka.intel.com:5000/airshipit/armada:8a1638098f88d92bf799ef4934abe569789b885e-ubuntu_bionic", "Image push succeeded: registry.local:9001/quay.io/airshipit/armada:8a1638098f88d92bf799ef4934abe569789b885e-ubuntu_bionic", "Image kasstxj.ka.intel.com:5000/airshipit/armada:8a1638098f88d92bf799ef4934abe569789b885e-ubuntu_bionic download succeeded by containerd", "Image download succeeded: kasstxj.ka.intel.com:5000/starlingx/n3000-opae:stx.4.0-v1.0.0", "Image push succeeded: registry.local:9001/docker.io/starlingx/n3000-opae:stx.4.0-v1.0.0", "Image kasstxj.ka.intel.com:5000/starlingx/n3000-opae:stx.4.0-v1.0.0 download succeeded by containerd", "Image download succeeded: kasstxj.ka.intel.com:5000/stackanetes/kubernetes-entrypoint:v0.3.1", "Image push succeeded: registry.local:9001/quay.io/stackanetes/kubernetes-entrypoint:v0.3.1", "Image kasstxj.ka.intel.com:5000/stackanetes/kubernetes-entrypoint:v0.3.1 download succeeded by containerd", "All images downloaded and pushed to the local registry in 24.8883650303 seconds" ] } TASK [common/push-docker-images : Log out of k8s, gcr, quay, docker registries if credentials exist] *** PLAY RECAP ********************************************************************* localhost : ok=50 changed=9 unreachable=0 failed=0 . sysinv 2020-10-20 04:38:42.662 105738 INFO sysinv.conductor.manager [-] _upgrade_downgrade_kube_networking executing playbook: /usr/share/ansible/stx-ansible/playbooks/upgrade-k8s-networking.yml for version v1.18.1 sysinv 2020-10-20 04:38:53.882 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2020-10-20-04-38-53 patch sysinv 2020-10-20 04:38:53.882 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['action'] sysinv 2020-10-20 04:38:53.883 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 Pending update_vim_progress_status services-enabled sysinv 2020-10-20 04:38:53.883 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 action=services-enabled ihost_val_prenotify: {} ihost_val: {} sysinv 2020-10-20 04:38:53.883 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 action_check action=services-enabled, notify_vim=False notify_mtce=False rc=True sysinv 2020-10-20 04:38:53.883 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 post action_check hostupdate action=services-enabled notify_vim=False notify_mtc=False skip_notify_mtce=False sysinv 2020-10-20 04:38:53.883 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 stage_action services-enabled sysinv 2020-10-20 04:38:53.883 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 received services-enabled task= vim_progress_status= sysinv 2020-10-20 04:38:53.884 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 Action staged: services-enabled sysinv 2020-10-20 04:38:53.884 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 post action_stage hostupdate action=services-enabled notify_vim=False notify_mtc=False skip_notify_mtce=True sysinv 2020-10-20 04:38:53.884 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 2. delta_handle ['action'] sysinv 2020-10-20 04:38:53.884 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 post delta_handle hostupdate action=services-enabled notify_vim=False notify_mtc=False skip_notify_mtce=True sysinv 2020-10-20 04:38:53.884 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 apply ihost_val {'vim_progress_status': 'services-enabled'} sysinv 2020-10-20 04:38:53.943 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 notify_availability=services-enabled sysinv 2020-10-20 04:38:53.949 105738 INFO sysinv.conductor.manager [-] Updating platform data for host: 448a679f-bf8a-4819-8602-c0123f481cdb with: {u'availability': u'services-enabled'} sysinv 2020-10-20 04:38:53.998 105738 INFO sysinv.conductor.manager [-] Evaluating app reapply of cert-manager sysinv 2020-10-20 04:38:54.175 105738 INFO sysinv.conductor.manager [-] No override change after configuration action, skipping re-apply of cert-manager sysinv 2020-10-20 04:38:54.190 107057 INFO sysinv.api.controllers.v1.host [-] host controller-0 ihost_patch_end_2020-10-20-04-38-54 patch sysinv 2020-10-20 04:38:59.715 105738 INFO sysinv.conductor.manager [-] Sending agent update request for host 1 to update (audit_lvg, audit_pv) sysinv 2020-10-20 04:38:59.722 105738 INFO sysinv.agent.rpcapi [-] AgentApi.agent_update: fanout_cast: sending update request to agent for: (audit_lvg, audit_pv) sysinv 2020-10-20 04:38:59.744 98607 INFO sysinv.agent.manager [-] _wait_for_nova_lvg: Must wait before reporting node availability. Conductor sees unprovisioned nova-local state. Would result in an invalid host aggregate assignment. sysinv 2020-10-20 04:38:59.757 98607 INFO sysinv.agent.manager [-] _wait_for_nova_lvg: Must wait before reporting node availability. Conductor sees unprovisioned nova-local state. Would result in an invalid host aggregate assignment. sysinv 2020-10-20 04:38:59.757 98607 INFO sysinv.agent.manager [-] SysInv Agent Audit force updates: (audit_lvg, audit_pv) sysinv 2020-10-20 04:39:00.030 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:39:00.032 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:39:00.348 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://192.168.204.1:5491/v1/query/ hdr:None payload:None sysinv 2020-10-20 04:39:00.698 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'pd': {}} sysinv 2020-10-20 04:39:00.699 105738 INFO sysinv.conductor.manager [-] Platform managed application platform-integ-apps: Creating... sysinv 2020-10-20 04:39:00.767 105738 INFO sysinv.common.utils [-] Checksum file is included and validated. sysinv 2020-10-20 04:39:00.769 105738 INFO sysinv.api.controllers.v1.kube_app [-] No patch required for application platform-integ-apps (1.0-9). sysinv 2020-10-20 04:39:00.862 105738 INFO sysinv.conductor.manager [-] Platform managed application platform-integ-apps: Uploading... sysinv 2020-10-20 04:39:00.863 105738 INFO sysinv.conductor.kube_app [-] Application platform-integ-apps (1.0-9) upload started. sysinv 2020-10-20 04:39:00.948 105738 INFO sysinv.conductor.kube_app [-] PluginHelper: Creating platform-integ-apps plugin directory /opt/platform/helm/20.12/platform-integ-apps/1.0-9/plugins. sysinv 2020-10-20 04:39:00.949 105738 INFO sysinv.conductor.kube_app [-] PluginHelper: Installing platform-integ-apps plugin /scratch/apps/platform-integ-apps/1.0-9/plugins/k8sapp_platform-1.0-py2.py3-none-any.whl to /opt/platform/helm/20.12/platform-integ-apps/1.0-9/plugins. sysinv 2020-10-20 04:39:01.136 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://192.168.204.1:5491/v1/query/ hdr:None payload:None sysinv 2020-10-20 04:39:01.172 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'pd': {}} sysinv 2020-10-20 04:39:01.172 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Creating... sysinv 2020-10-20 04:39:01.258 105738 INFO sysinv.common.utils [-] Checksum file is included and validated. sysinv 2020-10-20 04:39:01.260 105738 INFO sysinv.api.controllers.v1.kube_app [-] No patch required for application oidc-auth-apps (1.0-29). sysinv 2020-10-20 04:39:01.312 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Uploading... sysinv 2020-10-20 04:39:01.314 105738 INFO sysinv.conductor.kube_app [-] Application oidc-auth-apps (1.0-29) upload started. sysinv 2020-10-20 04:39:01.355 105738 INFO sysinv.conductor.kube_app [-] Copy /opt/platform/armada/20.12/platform-integ-apps to armada-api-ff8895c46-sx8c2:/tmp/manifests . sysinv 2020-10-20 04:39:01.375 105738 INFO sysinv.conductor.kube_app [-] PluginHelper: Creating oidc-auth-apps plugin directory /opt/platform/helm/20.12/oidc-auth-apps/1.0-29/plugins. sysinv 2020-10-20 04:39:01.376 105738 INFO sysinv.conductor.kube_app [-] PluginHelper: Installing oidc-auth-apps plugin /scratch/apps/oidc-auth-apps/1.0-29/plugins/k8sapp_oidc-1.0-py2.py3-none-any.whl to /opt/platform/helm/20.12/oidc-auth-apps/1.0-29/plugins. sysinv 2020-10-20 04:39:01.532 105738 INFO sysinv.conductor.manager [-] PV uuid: 0a59633e-2b57-4509-85ff-8afb531ccbee changed UUID from None to x8FhlL-aRFT-TAuB-rB4M-EsjF-A0nz-BqDER1 sysinv 2020-10-20 04:39:01.551 105738 INFO sysinv.conductor.manager [-] PV uuid: 451b955c-80bd-43fb-a154-39e56c58409d changed UUID from None to rxsX7D-SRTn-0VO4-ji2C-2DAj-mR5j-IcqwHH sysinv 2020-10-20 04:39:01.576 105738 INFO sysinv.conductor.kube_app [-] Copy /opt/platform/helm/20.12/platform-integ-apps to armada-api-ff8895c46-sx8c2:/tmp/overrides . sysinv 2020-10-20 04:39:01.587 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://192.168.204.1:5491/v1/query/ hdr:None payload:None sysinv 2020-10-20 04:39:01.624 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'pd': {}} sysinv 2020-10-20 04:39:01.625 105738 INFO sysinv.conductor.manager [-] Platform managed application rook-ceph-apps: Creating... sysinv 2020-10-20 04:39:01.632 105738 ERROR sysinv.conductor.manager [-] Failed to find an application tarball for rook-ceph-apps.: KubeAppNotFound: No application with name rook-ceph-apps. sysinv 2020-10-20 04:39:01.641 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:39:01.642 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:39:02.173 105738 INFO sysinv.conductor.kube_app [-] Armada validate command: 'armada validate /tmp/manifests/platform-integ-apps/1.0-9/platform-integ-apps-manifest.yaml' sysinv 2020-10-20 04:39:02.258 105738 INFO sysinv.conductor.manager [-] Performed drbdadm resize all sysinv 2020-10-20 04:39:02.284 105738 INFO sysinv.conductor.manager [-] LVG uuid: ab053533-c0ad-451d-9544-bd6b14fe2860 changed UUID from None to RmHXnl-wJIF-cJq0-n9M7-R5Aa-SahB-PKL5Ef sysinv 2020-10-20 04:39:02.318 98607 INFO sysinv.agent.manager [-] iscsi initiator name = iqn.1994-05.com.redhat:561fb847c sysinv 2020-10-20 04:39:02.332 105738 INFO sysinv.conductor.manager [-] drbd-overview: pgsql-20.0, platform-9.9, extension-0.96875, dc-vault-0, etcd-5.0, dockerdistribution-16.0 sysinv 2020-10-20 04:39:02.333 105738 INFO sysinv.conductor.manager [-] lvdisplay: pgsql-20.0, platform-10.0, extension-1.0, dc-vault-0, etcd-5.0, dockerdistribution-16.0 sysinv 2020-10-20 04:39:02.361 105738 INFO sysinv.conductor.kube_app [-] Copy /opt/platform/armada/20.12/oidc-auth-apps to armada-api-ff8895c46-sx8c2:/tmp/manifests . sysinv 2020-10-20 04:39:02.386 105738 INFO sysinv.conductor.manager [-] _clear_config_from_reboot_config_list host:448a679f-bf8a-4819-8602-c0123f481cdb sysinv 2020-10-20 04:39:02.389 105738 INFO sysinv.conductor.manager [-] SYS_I Clear system config alarm: controller-0 target config 9cf90f10-432f-4016-adbd-48c28c847fb2 sysinv 2020-10-20 04:39:02.545 105738 INFO sysinv.conductor.kube_app [-] Copy /opt/platform/helm/20.12/oidc-auth-apps to armada-api-ff8895c46-sx8c2:/tmp/overrides . sysinv 2020-10-20 04:39:02.730 105738 INFO sysinv.conductor.kube_app [-] Armada validate command: 'armada validate /tmp/manifests/oidc-auth-apps/1.0-29/oidc-auth-apps-manifest.yaml' sysinv 2020-10-20 04:39:02.967 105738 INFO sysinv.conductor.kube_app [-] Manifest file /manifests/platform-integ-apps/1.0-9/platform-integ-apps-manifest.yaml was successfully validated. sysinv 2020-10-20 04:39:03.036 105738 INFO sysinv.conductor.kube_app [-] Helm chart node-feature-discovery validated sysinv 2020-10-20 04:39:03.088 105738 INFO sysinv.conductor.manager [-] Updating platform data for host: 448a679f-bf8a-4819-8602-c0123f481cdb with: {u'config_applied': u'9cf90f10-432f-4016-adbd-48c28c847fb2', u'first_report': True, u'availability': u'available', u'iscsi_initiator_name': u'iqn.1994-05.com.redhat:561fb847c'} sysinv 2020-10-20 04:39:03.091 105738 INFO sysinv.conductor.kube_app [-] Helm chart ceph-pools-audit validated sysinv 2020-10-20 04:39:03.104 105738 INFO sysinv.conductor.manager [-] controller-0 updating iscsi initiator=iqn.1994-05.com.redhat:561fb847c sysinv 2020-10-20 04:39:03.151 105738 INFO sysinv.conductor.kube_app [-] Helm chart rbd-provisioner validated sysinv 2020-10-20 04:39:03.155 105738 INFO sysinv.conductor.kube_app [-] Application platform-integ-apps (1.0-9) will load charts to chart repo stx-platform sysinv 2020-10-20 04:39:03.155 105738 INFO sysinv.conductor.kube_app [-] Application platform-integ-apps (1.0-9) will disable charts [] by default sysinv 2020-10-20 04:39:03.249 105738 INFO sysinv.conductor.manager [-] State of stor: '56a94e2f-e14d-4fd1-ac3b-858cbf9587a0' is 'configuring-on-unlock', resetting to 'configured'. sysinv 2020-10-20 04:39:03.299 105738 INFO sysinv.conductor.manager [-] _remove_config_from_reboot_config_list host: 448a679f-bf8a-4819-8602-c0123f481cdb,config_uuid: 9cf90f10-432f-4016-adbd-48c28c847fb2 sysinv 2020-10-20 04:39:03.299 105738 INFO sysinv.conductor.manager [-] _clear_config_from_reboot_config_list host:448a679f-bf8a-4819-8602-c0123f481cdb sysinv 2020-10-20 04:39:03.303 105738 INFO sysinv.conductor.manager [-] SYS_I Clear system config alarm: controller-0 target config 9cf90f10-432f-4016-adbd-48c28c847fb2 sysinv 2020-10-20 04:39:03.345 105738 INFO sysinv.conductor.kube_app [-] Helm chart helm-toolkit-0.1.0.tgz uploaded sysinv 2020-10-20 04:39:03.466 105738 INFO sysinv.conductor.kube_app [-] Helm chart rbd-provisioner-0.1.0.tgz uploaded sysinv 2020-10-20 04:39:03.475 105738 INFO sysinv.conductor.kube_app [-] Manifest file /manifests/oidc-auth-apps/1.0-29/oidc-auth-apps-manifest.yaml was successfully validated. sysinv 2020-10-20 04:39:03.480 98607 INFO sysinv.agent.manager [-] Sysinv Agent platform update by host: {'config_applied': '9cf90f10-432f-4016-adbd-48c28c847fb2', 'first_report': True, 'availability': 'available', 'iscsi_initiator_name': 'iqn.1994-05.com.redhat:561fb847c'} sysinv 2020-10-20 04:39:03.554 105738 INFO sysinv.conductor.kube_app [-] Helm chart node-feature-discovery-0.3.0.tgz uploaded sysinv 2020-10-20 04:39:03.641 105738 INFO sysinv.conductor.kube_app [-] Helm chart ceph-pools-audit-0.1.0.tgz uploaded sysinv 2020-10-20 04:39:03.644 105738 INFO sysinv.conductor.kube_app [-] PluginHelper: Enabled plugin directory /opt/platform/helm/20.12/platform-integ-apps/1.0-9/plugins: created /usr/lib64/python2.7/site-packages/stx_app-platform-integ-apps-1.0-9.pth sysinv 2020-10-20 04:39:03.680 105738 INFO sysinv.conductor.kube_app [-] PluginHelper: Disabled plugin directory /opt/platform/helm/20.12/platform-integ-apps/1.0-9/plugins: removed /usr/lib64/python2.7/site-packages/stx_app-platform-integ-apps-1.0-9.pth sysinv 2020-10-20 04:39:03.680 105738 INFO sysinv.conductor.kube_app [-] PluginHelper: Disabling distributions: [u'k8sapp-platform'] sysinv 2020-10-20 04:39:03.687 105738 INFO sysinv.helm.helm [-] Removed stevedore namespace: systemconfig.helm_plugins.platform_integ_apps sysinv 2020-10-20 04:39:03.699 105738 INFO sysinv.conductor.kube_app [-] PluginHelper: Enabled plugin directory /opt/platform/helm/20.12/platform-integ-apps/1.0-9/plugins: created /usr/lib64/python2.7/site-packages/stx_app-platform-integ-apps-1.0-9.pth sysinv 2020-10-20 04:39:03.702 105738 INFO sysinv.conductor.kube_app [-] Generating application overrides to discover required images. sysinv 2020-10-20 04:39:03.775 105738 INFO sysinv.conductor.kube_app [-] Helm chart oidc-client validated sysinv 2020-10-20 04:39:03.819 105738 INFO sysinv.conductor.kube_app [-] Helm chart dex validated sysinv 2020-10-20 04:39:03.820 105738 INFO sysinv.conductor.kube_app [-] Application oidc-auth-apps (1.0-29) will load charts to chart repo stx-platform sysinv 2020-10-20 04:39:03.821 105738 INFO sysinv.conductor.kube_app [-] Application oidc-auth-apps (1.0-29) will disable charts [] by default sysinv 2020-10-20 04:39:03.902 105738 INFO sysinv.conductor.kube_app [-] Helm chart dex-0.8.0.tgz uploaded sysinv 2020-10-20 04:39:03.969 105738 INFO sysinv.conductor.kube_app [-] PluginHelper: Disabled plugin directory /opt/platform/helm/20.12/platform-integ-apps/1.0-9/plugins: removed /usr/lib64/python2.7/site-packages/stx_app-platform-integ-apps-1.0-9.pth sysinv 2020-10-20 04:39:03.969 105738 INFO sysinv.conductor.kube_app [-] PluginHelper: Disabling distributions: [u'k8sapp-platform'] sysinv 2020-10-20 04:39:03.976 105738 INFO sysinv.helm.helm [-] Removed stevedore namespace: systemconfig.helm_plugins.platform_integ_apps sysinv 2020-10-20 04:39:04.031 105738 INFO sysinv.conductor.kube_app [-] Manifest file /opt/platform/armada/20.12/platform-integ-apps/1.0-9/platform-integ-apps-manifest.yaml updated with new image tags sysinv 2020-10-20 04:39:04.033 105738 INFO sysinv.conductor.kube_app [-] Helm chart oidc-client-0.1.0.tgz uploaded sysinv 2020-10-20 04:39:04.036 105738 INFO sysinv.conductor.kube_app [-] PluginHelper: Enabled plugin directory /opt/platform/helm/20.12/oidc-auth-apps/1.0-29/plugins: created /usr/lib64/python2.7/site-packages/stx_app-oidc-auth-apps-1.0-29.pth sysinv 2020-10-20 04:39:04.082 105738 INFO sysinv.conductor.kube_app [-] PluginHelper: Disabled plugin directory /opt/platform/helm/20.12/oidc-auth-apps/1.0-29/plugins: removed /usr/lib64/python2.7/site-packages/stx_app-oidc-auth-apps-1.0-29.pth sysinv 2020-10-20 04:39:04.082 105738 INFO sysinv.conductor.kube_app [-] PluginHelper: Disabling distributions: [u'k8sapp-oidc'] sysinv 2020-10-20 04:39:04.087 105738 INFO sysinv.helm.helm [-] Couldn't find endpoint distribution located at /opt/platform/helm/20.12/oidc-auth-apps/1.0-29/plugins for sysinv 1.0 sysinv 2020-10-20 04:39:04.087 105738 INFO sysinv.helm.helm [-] Removed stevedore namespace: systemconfig.helm_plugins.oidc_auth_apps sysinv 2020-10-20 04:39:04.105 105738 INFO sysinv.conductor.kube_app [-] PluginHelper: Enabled plugin directory /opt/platform/helm/20.12/oidc-auth-apps/1.0-29/plugins: created /usr/lib64/python2.7/site-packages/stx_app-oidc-auth-apps-1.0-29.pth sysinv 2020-10-20 04:39:04.108 105738 INFO sysinv.conductor.kube_app [-] Generating application overrides to discover required images. sysinv 2020-10-20 04:39:04.164 105738 INFO sysinv.conductor.kube_app [-] Application platform-integ-apps (1.0-9) upload completed. sysinv 2020-10-20 04:39:04.245 105738 INFO sysinv.conductor.kube_app [-] PluginHelper: Disabled plugin directory /opt/platform/helm/20.12/oidc-auth-apps/1.0-29/plugins: removed /usr/lib64/python2.7/site-packages/stx_app-oidc-auth-apps-1.0-29.pth sysinv 2020-10-20 04:39:04.245 105738 INFO sysinv.conductor.kube_app [-] PluginHelper: Disabling distributions: [u'k8sapp-oidc'] sysinv 2020-10-20 04:39:04.250 105738 INFO sysinv.helm.helm [-] Couldn't find endpoint distribution located at /opt/platform/helm/20.12/oidc-auth-apps/1.0-29/plugins for sysinv 1.0 sysinv 2020-10-20 04:39:04.250 105738 INFO sysinv.helm.helm [-] Removed stevedore namespace: systemconfig.helm_plugins.oidc_auth_apps sysinv 2020-10-20 04:39:04.310 105738 INFO sysinv.conductor.kube_app [-] Manifest file /opt/platform/armada/20.12/oidc-auth-apps/1.0-29/oidc-auth-apps-manifest.yaml updated with new image tags sysinv 2020-10-20 04:39:04.337 105738 INFO sysinv.conductor.kube_app [-] Application oidc-auth-apps (1.0-29) upload completed. sysinv 2020-10-20 04:39:28.335 105738 INFO sysinv.common.utils [-] ansible-playbook: PLAY [all] ********************************************************************* TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [Fail if kubernetes_version is not defined] ******************************* TASK [Create the upgrade overrides file] *************************************** changed: [localhost] TASK [Read the overrides variables] ******************************************** ok: [localhost] TASK [Set networking facts] **************************************************** ok: [localhost] TASK [common/push-docker-images : Get docker registries if not in bootstap or restore mode] *** included: /usr/share/ansible/stx-ansible/playbooks/roles/common/push-docker-images/tasks/get_docker_registry.yml for localhost => (item={u'name': u'k8s_registry', u'value': {u'url': u'k8s.gcr.io'}}) included: /usr/share/ansible/stx-ansible/playbooks/roles/common/push-docker-images/tasks/get_docker_registry.yml for localhost => (item={u'name': u'gcr_registry', u'value': {u'url': u'gcr.io'}}) included: /usr/share/ansible/stx-ansible/playbooks/roles/common/push-docker-images/tasks/get_docker_registry.yml for localhost => (item={u'name': u'quay_registry', u'value': {u'url': u'quay.io'}}) included: /usr/share/ansible/stx-ansible/playbooks/roles/common/push-docker-images/tasks/get_docker_registry.yml for localhost => (item={u'name': u'docker_registry', u'value': {u'url': u'docker.io'}}) included: /usr/share/ansible/stx-ansible/playbooks/roles/common/push-docker-images/tasks/get_docker_registry.yml for localhost => (item={u'name': u'elastic_registry', u'value': {u'url': u'docker.elastic.co'}}) TASK [common/push-docker-images : Query the k8s_registry] ********************** changed: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'name': u'secure', 'value': u'False'}) ok: [localhost] => (item={'name': u'url', 'value': u'kasstxj.ka.intel.com:5000'}) TASK [common/push-docker-images : Validate k8s_registry information if it exists] *** TASK [common/push-docker-images : Set secure to bool] ************************** ok: [localhost] TASK [common/push-docker-images : Get the k8s_registry barbican secret if it's authenticated] *** TASK [common/push-docker-images : Validate k8s_registry secret] **************** TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'value': u'kasstxj.ka.intel.com:5000', 'key': u'url'}) ok: [localhost] => (item={'value': False, 'key': u'secure'}) TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : Query the gcr_registry] ********************** changed: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'name': u'secure', 'value': u'False'}) ok: [localhost] => (item={'name': u'url', 'value': u'kasstxj.ka.intel.com:5000'}) TASK [common/push-docker-images : Validate gcr_registry information if it exists] *** TASK [common/push-docker-images : Set secure to bool] ************************** ok: [localhost] TASK [common/push-docker-images : Get the gcr_registry barbican secret if it's authenticated] *** TASK [common/push-docker-images : Validate gcr_registry secret] **************** TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'value': u'kasstxj.ka.intel.com:5000', 'key': u'url'}) ok: [localhost] => (item={'value': False, 'key': u'secure'}) TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : Query the quay_registry] ********************* changed: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'name': u'secure', 'value': u'False'}) ok: [localhost] => (item={'name': u'url', 'value': u'kasstxj.ka.intel.com:5000'}) TASK [common/push-docker-images : Validate quay_registry information if it exists] *** TASK [common/push-docker-images : Set secure to bool] ************************** ok: [localhost] TASK [common/push-docker-images : Get the quay_registry barbican secret if it's authenticated] *** TASK [common/push-docker-images : Validate quay_registry secret] *************** TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'value': u'kasstxj.ka.intel.com:5000', 'key': u'url'}) ok: [localhost] => (item={'value': False, 'key': u'secure'}) TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : Query the docker_registry] ******************* changed: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'name': u'secure', 'value': u'False'}) ok: [localhost] => (item={'name': u'url', 'value': u'kasstxj.ka.intel.com:5000'}) TASK [common/push-docker-images : Validate docker_registry information if it exists] *** TASK [common/push-docker-images : Set secure to bool] ************************** ok: [localhost] TASK [common/push-docker-images : Get the docker_registry barbican secret if it's authenticated] *** TASK [common/push-docker-images : Validate docker_registry secret] ************* TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'value': u'kasstxj.ka.intel.com:5000', 'key': u'url'}) ok: [localhost] => (item={'value': False, 'key': u'secure'}) TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : Query the elastic_registry] ****************** changed: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'name': u'secure', 'value': u'False'}) ok: [localhost] => (item={'name': u'url', 'value': u'kasstxj.ka.intel.com:5000'}) TASK [common/push-docker-images : Validate elastic_registry information if it exists] *** TASK [common/push-docker-images : Set secure to bool] ************************** ok: [localhost] TASK [common/push-docker-images : Get the elastic_registry barbican secret if it's authenticated] *** TASK [common/push-docker-images : Validate elastic_registry secret] ************ TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] => (item={'value': u'kasstxj.ka.intel.com:5000', 'key': u'url'}) ok: [localhost] => (item={'value': False, 'key': u'secure'}) TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : Get registry credentials if registry type is AWS ECR] *** TASK [common/load-images-information : set_fact] ******************************* TASK [common/load-images-information : Get the list of kubernetes images] ****** changed: [localhost] TASK [common/load-images-information : set_fact] ******************************* ok: [localhost] TASK [common/load-images-information : include_vars] *************************** ok: [localhost] TASK [common/load-images-information : Get the list of platform images] ******** ok: [localhost] TASK [common/push-docker-images : Set download images list] ******************** TASK [common/push-docker-images : Set download images list to static images if upgrading static images] *** TASK [common/push-docker-images : Set download images list to k8s network images if upgrading k8s networking] *** ok: [localhost] TASK [common/push-docker-images : Set download images list to kubernetes images if upgrading kubernetes] *** TASK [common/push-docker-images : Set download images list to netapp images if installing trident] *** TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : debug] *************************************** ok: [localhost] => { "download_images_list": [ "quay.io/calico/cni:v3.12.0", "quay.io/calico/node:v3.12.0", "quay.io/calico/kube-controllers:v3.12.0", "quay.io/calico/pod2daemon-flexvol:v3.12.0", "docker.io/nfvpe/multus:v3.4", "docker.io/starlingx/k8s-cni-sriov:stx.3.0-v2.2", "docker.io/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae" ] } TASK [common/push-docker-images : Set registries information] ****************** ok: [localhost] => (item={u'replaced_url': u'kasstxj.ka.intel.com:5000', u'default_url': u'k8s.gcr.io'}) ok: [localhost] => (item={u'replaced_url': u'kasstxj.ka.intel.com:5000', u'default_url': u'gcr.io'}) ok: [localhost] => (item={u'replaced_url': u'kasstxj.ka.intel.com:5000', u'default_url': u'quay.io'}) ok: [localhost] => (item={u'replaced_url': u'kasstxj.ka.intel.com:5000', u'default_url': u'docker.io'}) ok: [localhost] => (item={u'replaced_url': u'kasstxj.ka.intel.com:5000', u'default_url': u'docker.elastic.co'}) TASK [common/push-docker-images : Log in k8s, gcr, quay, docker registries if credentials exist] *** TASK [common/push-docker-images : Get local registry credentials] ************** changed: [localhost] TASK [common/push-docker-images : set_fact] ************************************ ok: [localhost] TASK [common/push-docker-images : Download images and push to local registry] *** changed: [localhost] TASK [common/push-docker-images : debug] *************************************** ok: [localhost] => { "msg": [ "Image is up to date for sha256:cb6799752c46cb16c0c5bebcb355e988a1cd1b3745ce8b67e004abe9a81340a8", "Image is up to date for sha256:fc05bc4225f39e81dcbd0035457977276ed8a6054e6bde6406e39b672e9724f5", "Image is up to date for sha256:53aa421faf0acd88f8a4cb113e9db2cc65b2a2954640ed96a56c4b94233674d8", "Image is up to date for sha256:98793d0a88c823c4fc0fb1b3833d12932be270fc4b6d62bc181f0f54413fe12d", "Image is up to date for sha256:7cf8e2d1b7337338a3f977d07abdf63d80d5005458dfab3ab8962c2bab99d40d", "Image is up to date for sha256:cfba917fa8e18db8b00696adce24aa84b3d64483036aef72fd6256cff3b89da6", "Image is up to date for sha256:a2bef2b25274b1acbdfde5e2f3de432475e15d4036b2108cea2dce968b0c29ea", "Image download succeeded: kasstxj.ka.intel.com:5000/calico/cni:v3.12.0", "Image push succeeded: registry.local:9001/quay.io/calico/cni:v3.12.0", "Image kasstxj.ka.intel.com:5000/calico/cni:v3.12.0 download succeeded by containerd", "Image download succeeded: kasstxj.ka.intel.com:5000/calico/node:v3.12.0", "Image push succeeded: registry.local:9001/quay.io/calico/node:v3.12.0", "Image kasstxj.ka.intel.com:5000/calico/node:v3.12.0 download succeeded by containerd", "Image download succeeded: kasstxj.ka.intel.com:5000/calico/kube-controllers:v3.12.0", "Image push succeeded: registry.local:9001/quay.io/calico/kube-controllers:v3.12.0", "Image kasstxj.ka.intel.com:5000/calico/kube-controllers:v3.12.0 download succeeded by containerd", "Image download succeeded: kasstxj.ka.intel.com:5000/calico/pod2daemon-flexvol:v3.12.0", "Image push succeeded: registry.local:9001/quay.io/calico/pod2daemon-flexvol:v3.12.0", "Image kasstxj.ka.intel.com:5000/calico/pod2daemon-flexvol:v3.12.0 download succeeded by containerd", "Image download succeeded: kasstxj.ka.intel.com:5000/nfvpe/multus:v3.4", "Image push succeeded: registry.local:9001/docker.io/nfvpe/multus:v3.4", "Image kasstxj.ka.intel.com:5000/nfvpe/multus:v3.4 download succeeded by containerd", "Image download succeeded: kasstxj.ka.intel.com:5000/starlingx/k8s-cni-sriov:stx.3.0-v2.2", "Image push succeeded: registry.local:9001/docker.io/starlingx/k8s-cni-sriov:stx.3.0-v2.2", "Image kasstxj.ka.intel.com:5000/starlingx/k8s-cni-sriov:stx.3.0-v2.2 download succeeded by containerd", "Image download succeeded: kasstxj.ka.intel.com:5000/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae", "Image push succeeded: registry.local:9001/docker.io/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae", "Image kasstxj.ka.intel.com:5000/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae download succeeded by containerd", "All images downloaded and pushed to the local registry in 23.5054609776 seconds" ] } TASK [common/push-docker-images : Log out of k8s, gcr, quay, docker registries if credentials exist] *** TASK [Create Calico config file] *********************************************** ok: [localhost] TASK [Update Calico Networking] ************************************************ changed: [localhost] TASK [Create Multus config file] *********************************************** ok: [localhost] TASK [Update Multus Networking] ************************************************ changed: [localhost] TASK [Create SRIOV Networking config file] ************************************* ok: [localhost] TASK [Update SRIOV Networking] ************************************************* changed: [localhost] TASK [Create SRIOV device plugin config file] ********************************** ok: [localhost] TASK [Update SRIOV device plugin] ********************************************** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=59 changed=13 unreachable=0 failed=0 . sysinv 2020-10-20 04:40:59.740 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:40:59.742 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:40:59.809 105738 INFO ceph_client [-] Request params: url=https://controller-0:7999/request?wait=1, json={'prefix': 'fsid', 'format': 'text'} sysinv 2020-10-20 04:40:59.816 105738 INFO ceph_client [-] Result: {u'waiting': [], u'has_failed': False, u'state': u'success', u'is_waiting': False, u'running': [], u'failed': [], u'finished': [{u'outb': u'b3bff1e8-4af8-406b-9b99-9dc16275bec4\n', u'outs': u'', u'command': u'fsid format=text'}], u'is_finished': True, u'id': u'140072843266512'} sysinv 2020-10-20 04:40:59.820 105738 INFO ceph_client [-] Request params: url=https://controller-0:7999/request?wait=1, json={'prefix': 'status', 'format': 'json'} sysinv 2020-10-20 04:40:59.827 105738 INFO ceph_client [-] Result: {u'waiting': [], u'has_failed': False, u'state': u'success', u'is_waiting': False, u'running': [], u'failed': [], u'finished': [{u'outb': u'{"fsid":"b3bff1e8-4af8-406b-9b99-9dc16275bec4","health":{"checks":{},"status":"HEALTH_OK","overall_status":"HEALTH_WARN"},"election_epoch":3,"quorum":[0],"quorum_names":["controller-0"],"monmap":{"epoch":1,"fsid":"b3bff1e8-4af8-406b-9b99-9dc16275bec4","modified":"2020-10-20 04:31:20.280628","created":"2020-10-20 04:31:20.280628","features":{"persistent":["kraken","luminous","mimic","osdmap-prune"],"optional":[]},"mons":[{"rank":0,"name":"controller-0","addr":"192.168.204.2:6789/0","public_addr":"192.168.204.2:6789/0"}]},"osdmap":{"osdmap":{"epoch":6,"num_osds":1,"num_up_osds":1,"num_in_osds":1,"full":false,"nearfull":false,"num_remapped_pgs":0}},"pgmap":{"pgs_by_state":[],"num_pgs":0,"num_pools":0,"num_objects":0,"data_bytes":0,"bytes_used":112189440,"bytes_avail":958541803520,"bytes_total":958653992960},"fsmap":{"epoch":1,"by_rank":[]},"mgrmap":{"epoch":58,"active_gid":4135,"active_name":"controller-0","active_addr":"192.168.204.2:6804/103313","available":true,"standbys":[],"modules":["restful"],"available_modules":[{"name":"balancer","can_run":true,"error_string":""},{"name":"dashboard","can_run":false,"error_string":"Frontend assets not found: incomplete build?"},{"name":"hello","can_run":true,"error_string":""},{"name":"iostat","can_run":true,"error_string":""},{"name":"localpool","can_run":true,"error_string":""},{"name":"prometheus","can_run":true,"error_string":""},{"name":"restful","can_run":true,"error_string":""},{"name":"selftest","can_run":true,"error_string":""},{"name":"smart","can_run":true,"error_string":""},{"name":"status","can_run":true,"error_string":""},{"name":"telegraf","can_run":true,"error_string":""},{"name":"telemetry","can_run":true,"error_string":""},{"name":"zabbix","can_run":true,"error_string":""}],"services":{"restful":"https://controller-0:7999/"}},"servicemap":{"epoch":1,"modified":"0.000000","services":{}}}\n', u'outs': u'', u'command': u'status format=json'}], u'is_finished': True, u'id': u'140072842994768'} sysinv 2020-10-20 04:40:59.839 105738 INFO sysinv.conductor.manager [-] Platform managed application platform-integ-apps: Prerequisites met. sysinv 2020-10-20 04:41:00.105 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://192.168.204.1:5491/v1/query/ hdr:None payload:None sysinv 2020-10-20 04:41:00.139 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'pd': {}} sysinv 2020-10-20 04:41:00.143 105738 INFO sysinv.conductor.manager [-] Auto reapplying platform-integ-apps app sysinv 2020-10-20 04:41:00.147 105738 INFO sysinv.conductor.kube_app [-] Register the initial abort status of app platform-integ-apps sysinv 2020-10-20 04:41:00.367 105738 INFO sysinv.conductor.kube_app [-] Application platform-integ-apps (1.0-9) apply started. sysinv 2020-10-20 04:41:00.381 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 04:41:00.391 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:41:00.392 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:41:00.983 105738 INFO sysinv.conductor.kube_app [-] PluginHelper: Enabled plugin directory /opt/platform/helm/20.12/platform-integ-apps/1.0-9/plugins: created /usr/lib64/python2.7/site-packages/stx_app-platform-integ-apps-1.0-9.pth sysinv 2020-10-20 04:41:00.987 105738 INFO sysinv.helm.manifest_base [-] app_rbd_actions app: platform-integ-apps operation: apply sysinv 2020-10-20 04:41:01.056 105738 INFO sysinv.conductor.kube_app [-] Generating application overrides... sysinv 2020-10-20 04:41:01.327 105738 INFO sysinv.conductor.kube_app [-] Application overrides generated. sysinv 2020-10-20 04:41:01.363 105738 INFO sysinv.conductor.kube_app [-] Image registry.local:9001/quay.io/external_storage/rbd-provisioner:v2.1.1-k8s1.11 download started from local registry sysinv 2020-10-20 04:41:01.388 105738 INFO sysinv.conductor.kube_app [-] Image registry.local:9001/docker.io/starlingx/ceph-config-helper:v1.15.0 download started from local registry sysinv 2020-10-20 04:41:01.684 105738 INFO sysinv.conductor.kube_app [-] Image registry.local:9001/quay.io/external_storage/rbd-provisioner:v2.1.1-k8s1.11 is not available in local registry, download started from public/private registry sysinv 2020-10-20 04:41:01.704 105738 INFO sysinv.conductor.kube_app [-] Image registry.local:9001/docker.io/starlingx/ceph-config-helper:v1.15.0 is not available in local registry, download started from public/private registry sysinv 2020-10-20 04:41:22.354 105738 INFO sysinv.conductor.kube_app [-] Remove image kasstxj.ka.intel.com:5000/external_storage/rbd-provisioner:v2.1.1-k8s1.11 after push to local registry. sysinv 2020-10-20 04:41:22.624 105738 INFO sysinv.conductor.kube_app [-] Image registry.local:9001/quay.io/external_storage/rbd-provisioner:v2.1.1-k8s1.11 download succeeded in 21 seconds sysinv 2020-10-20 04:41:55.348 105738 INFO sysinv.conductor.kube_app [-] Remove image kasstxj.ka.intel.com:5000/starlingx/ceph-config-helper:v1.15.0 after push to local registry. sysinv 2020-10-20 04:41:55.823 105738 INFO sysinv.conductor.kube_app [-] Image registry.local:9001/docker.io/starlingx/ceph-config-helper:v1.15.0 download succeeded in 54 seconds sysinv 2020-10-20 04:41:55.824 105738 INFO sysinv.conductor.kube_app [-] All docker images for application platform-integ-apps were successfully downloaded in 54 seconds sysinv 2020-10-20 04:41:56.223 105738 INFO sysinv.conductor.kube_app [-] Copy /opt/platform/armada/20.12/platform-integ-apps to armada-api-ff8895c46-sx8c2:/tmp/manifests . sysinv 2020-10-20 04:41:56.398 105738 INFO sysinv.conductor.kube_app [-] Copy /opt/platform/helm/20.12/platform-integ-apps to armada-api-ff8895c46-sx8c2:/tmp/overrides . sysinv 2020-10-20 04:41:56.579 105738 INFO sysinv.conductor.kube_app [-] Armada apply command: 'armada apply --debug --enable-chart-cleanup /tmp/manifests/platform-integ-apps/1.0-9/platform-integ-apps-manifest.yaml --values /tmp/overrides/platform-integ-apps/1.0-9/kube-system-rbd-provisioner.yaml --values /tmp/overrides/platform-integ-apps/1.0-9/kube-system-ceph-pools-audit.yaml --values /tmp/overrides/platform-integ-apps/1.0-9/helm-toolkit-helm-toolkit.yaml ' sysinv 2020-10-20 04:41:56.829 105738 INFO sysinv.conductor.kube_app [-] Starting progress monitoring thread for app platform-integ-apps sysinv 2020-10-20 04:41:57.855 105738 INFO sysinv.conductor.kube_app [-] processing chart: stx-rbd-provisioner, overall completion: 50.0% sysinv 2020-10-20 04:41:59.741 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:41:59.743 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:41:59.793 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 04:41:59.801 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:41:59.802 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:42:39.794 105738 INFO sysinv.conductor.kube_app [-] processing chart: stx-ceph-pools-audit, overall completion: 100.0% sysinv 2020-10-20 04:42:41.380 105738 INFO sysinv.conductor.kube_app [-] Application manifest /manifests/platform-integ-apps/1.0-9/platform-integ-apps-manifest.yaml was successfully applied/re-applied. sysinv 2020-10-20 04:42:41.381 105738 INFO sysinv.conductor.kube_app [-] Exiting progress monitoring thread for app platform-integ-apps sysinv 2020-10-20 04:42:42.020 105738 INFO sysinv.conductor.kube_app [-] Application platform-integ-apps (1.0-9) apply completed. sysinv 2020-10-20 04:42:59.735 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:42:59.736 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:42:59.786 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 04:42:59.793 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:42:59.794 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:43:00.854 98607 INFO sysinv.agent.lldp.drivers.ovs.driver [-] Adding missing LLDP flow from lldpa144afaf-76 to eth0 sysinv 2020-10-20 04:43:00.894 98607 INFO sysinv.agent.lldp.drivers.ovs.driver [-] Adding missing LLDP flow from lldp53e6668d-b0 to eth1 sysinv 2020-10-20 04:43:00.973 105738 INFO sysinv.conductor.manager [-] Attempting to create new lldp neighbour {'host_id': 1, 'msap': u'00:04:96:b4:5b:f2,17', 'port_id': 3} on host 1 sysinv 2020-10-20 04:43:01.296 105738 INFO sysinv.conductor.manager [-] Attempting to create new LLDP agent {'status': u'rx=enabled,tx=enabled', 'host_id': 1, 'port_id': 1} on host 1 sysinv 2020-10-20 04:43:01.503 105738 INFO sysinv.conductor.manager [-] Attempting to create new LLDP agent {'status': u'rx=enabled,tx=enabled', 'host_id': 1, 'port_id': 3} on host 1 sysinv 2020-10-20 04:43:01.702 105738 INFO sysinv.conductor.manager [-] Attempting to create new LLDP agent {'status': u'rx=enabled,tx=enabled', 'host_id': 1, 'port_id': 2} on host 1 sysinv 2020-10-20 04:43:02.050 105738 INFO sysinv.conductor.manager [-] Attempting to create new LLDP agent {'status': u'rx=enabled,tx=enabled', 'host_id': 1, 'port_id': 4} on host 1 sysinv 2020-10-20 04:43:59.734 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:43:59.735 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:43:59.781 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 04:43:59.788 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:43:59.789 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:44:59.733 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:44:59.735 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:44:59.780 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 04:44:59.787 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:44:59.788 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:45:44.013 107057 INFO sysinv.common.utils [-] Checksum file is included and validated. sysinv 2020-10-20 04:45:44.015 107057 INFO sysinv.api.controllers.v1.kube_app [-] No patch required for application stx-openstack (1.0-64-centos-stable-versioned). sysinv 2020-10-20 04:45:44.799 107057 INFO sysinv.api.controllers.v1.kube_app [-] Tar file of application stx-openstack verified. sysinv 2020-10-20 04:45:44.851 105738 INFO sysinv.conductor.kube_app [-] Application stx-openstack (1.0-64-centos-stable-versioned) upload started. sysinv 2020-10-20 04:45:45.312 105738 INFO sysinv.conductor.kube_app [-] PluginHelper: Creating stx-openstack plugin directory /opt/platform/helm/20.12/stx-openstack/1.0-64-centos-stable-versioned/plugins. sysinv 2020-10-20 04:45:45.314 105738 INFO sysinv.conductor.kube_app [-] PluginHelper: Installing stx-openstack plugin /scratch/apps/stx-openstack/1.0-64-centos-stable-versioned/plugins/k8sapp_openstack-1.0-py2.py3-none-any.whl to /opt/platform/helm/20.12/stx-openstack/1.0-64-centos-stable-versioned/plugins. sysinv 2020-10-20 04:45:45.698 105738 INFO sysinv.conductor.kube_app [-] Copy /opt/platform/armada/20.12/stx-openstack to armada-api-ff8895c46-sx8c2:/tmp/manifests . sysinv 2020-10-20 04:45:45.876 105738 INFO sysinv.conductor.kube_app [-] Copy /opt/platform/helm/20.12/stx-openstack to armada-api-ff8895c46-sx8c2:/tmp/overrides . sysinv 2020-10-20 04:45:46.057 105738 INFO sysinv.conductor.kube_app [-] Armada validate command: 'armada validate /tmp/manifests/stx-openstack/1.0-64-centos-stable-versioned/stx-openstack-stx-openstack.yaml' sysinv 2020-10-20 04:45:47.071 105738 INFO sysinv.conductor.kube_app [-] Manifest file /manifests/stx-openstack/1.0-64-centos-stable-versioned/stx-openstack-stx-openstack.yaml was successfully validated. sysinv 2020-10-20 04:45:47.154 105738 INFO sysinv.conductor.kube_app [-] Helm chart garbd validated sysinv 2020-10-20 04:45:47.303 105738 INFO sysinv.conductor.kube_app [-] Helm chart aodh validated sysinv 2020-10-20 04:45:47.437 105738 INFO sysinv.conductor.kube_app [-] Helm chart ironic validated sysinv 2020-10-20 04:45:47.499 105738 INFO sysinv.conductor.kube_app [-] Helm chart rabbitmq validated sysinv 2020-10-20 04:45:47.829 105738 INFO sysinv.conductor.kube_app [-] Helm chart ceilometer validated sysinv 2020-10-20 04:45:47.926 105738 INFO sysinv.conductor.kube_app [-] Helm chart heat validated sysinv 2020-10-20 04:45:47.982 105738 INFO sysinv.conductor.kube_app [-] Helm chart openvswitch validated sysinv 2020-10-20 04:45:48.038 105738 INFO sysinv.conductor.kube_app [-] Helm chart keystone-api-proxy validated sysinv 2020-10-20 04:45:48.133 105738 INFO sysinv.conductor.kube_app [-] Helm chart panko validated sysinv 2020-10-20 04:45:48.342 105738 INFO sysinv.conductor.kube_app [-] Helm chart mariadb validated sysinv 2020-10-20 04:45:48.403 105738 INFO sysinv.conductor.kube_app [-] Helm chart fm-rest-api validated sysinv 2020-10-20 04:45:48.471 105738 INFO sysinv.conductor.kube_app [-] Helm chart magnum validated sysinv 2020-10-20 04:45:48.530 105738 INFO sysinv.conductor.kube_app [-] Helm chart libvirt validated sysinv 2020-10-20 04:45:48.585 105738 INFO sysinv.conductor.kube_app [-] Helm chart nova-api-proxy validated sysinv 2020-10-20 04:45:48.618 105738 INFO sysinv.conductor.kube_app [-] Helm chart psp-rolebinding validated sysinv 2020-10-20 04:45:48.686 105738 INFO sysinv.conductor.kube_app [-] Helm chart barbican validated sysinv 2020-10-20 04:45:49.138 105738 INFO sysinv.conductor.kube_app [-] Helm chart keystone validated sysinv 2020-10-20 04:45:49.198 105738 INFO sysinv.conductor.kube_app [-] Helm chart ceph-rgw validated sysinv 2020-10-20 04:45:49.299 105738 INFO sysinv.conductor.kube_app [-] Helm chart cinder validated sysinv 2020-10-20 04:45:49.351 105738 INFO sysinv.conductor.kube_app [-] Helm chart memcached validated sysinv 2020-10-20 04:45:50.091 105738 INFO sysinv.conductor.kube_app [-] Helm chart nova validated sysinv 2020-10-20 04:45:50.274 105738 INFO sysinv.conductor.kube_app [-] Helm chart neutron validated sysinv 2020-10-20 04:45:50.334 105738 INFO sysinv.conductor.kube_app [-] Helm chart ingress validated sysinv 2020-10-20 04:45:50.383 105738 INFO sysinv.conductor.kube_app [-] Helm chart dcdbsync validated sysinv 2020-10-20 04:45:50.471 105738 INFO sysinv.conductor.kube_app [-] Helm chart placement validated sysinv 2020-10-20 04:45:50.609 105738 INFO sysinv.conductor.kube_app [-] Helm chart gnocchi validated sysinv 2020-10-20 04:45:50.645 105738 INFO sysinv.conductor.kube_app [-] Helm chart nginx-ports-control validated sysinv 2020-10-20 04:45:50.759 105738 INFO sysinv.conductor.kube_app [-] Helm chart glance validated sysinv 2020-10-20 04:45:50.923 105738 INFO sysinv.conductor.kube_app [-] Helm chart horizon validated sysinv 2020-10-20 04:45:50.948 105738 INFO sysinv.conductor.kube_app [-] Application stx-openstack (1.0-64-centos-stable-versioned) will load charts to chart repo starlingx sysinv 2020-10-20 04:45:50.948 105738 INFO sysinv.conductor.kube_app [-] Application stx-openstack (1.0-64-centos-stable-versioned) will disable charts ['aodh', 'barbican', 'ceilometer', 'ceph-rgw', 'gnocchi', 'ironic', 'panko'] by default sysinv 2020-10-20 04:45:51.025 105738 INFO sysinv.conductor.kube_app [-] Helm chart horizon-0.1.0.tgz uploaded sysinv 2020-10-20 04:45:51.120 105738 INFO sysinv.conductor.kube_app [-] Helm chart panko-0.1.0.tgz uploaded sysinv 2020-10-20 04:45:51.217 105738 INFO sysinv.conductor.kube_app [-] Helm chart ceilometer-0.1.0.tgz uploaded sysinv 2020-10-20 04:45:51.313 105738 INFO sysinv.conductor.kube_app [-] Helm chart heat-0.1.0.tgz uploaded sysinv 2020-10-20 04:45:51.428 105738 INFO sysinv.conductor.kube_app [-] Helm chart cinder-0.1.0.tgz uploaded sysinv 2020-10-20 04:45:51.544 105738 INFO sysinv.conductor.kube_app [-] Helm chart ironic-0.1.0.tgz uploaded sysinv 2020-10-20 04:45:51.659 105738 INFO sysinv.conductor.kube_app [-] Helm chart nova-api-proxy-0.1.0.tgz uploaded sysinv 2020-10-20 04:45:51.784 105738 INFO sysinv.conductor.kube_app [-] Helm chart helm-toolkit-0.1.0.tgz uploaded sysinv 2020-10-20 04:45:51.910 105738 INFO sysinv.conductor.kube_app [-] Helm chart dcdbsync-0.1.0.tgz uploaded sysinv 2020-10-20 04:45:52.026 105738 INFO sysinv.conductor.kube_app [-] Helm chart psp-rolebinding-0.1.0.tgz uploaded sysinv 2020-10-20 04:45:52.151 105738 INFO sysinv.conductor.kube_app [-] Helm chart nginx-ports-control-0.1.0.tgz uploaded sysinv 2020-10-20 04:45:52.287 105738 INFO sysinv.conductor.kube_app [-] Helm chart neutron-0.1.0.tgz uploaded sysinv 2020-10-20 04:45:52.433 105738 INFO sysinv.conductor.kube_app [-] Helm chart ceph-rgw-0.1.0.tgz uploaded sysinv 2020-10-20 04:45:52.578 105738 INFO sysinv.conductor.kube_app [-] Helm chart glance-0.1.0.tgz uploaded sysinv 2020-10-20 04:45:52.735 105738 INFO sysinv.conductor.kube_app [-] Helm chart gnocchi-0.1.0.tgz uploaded sysinv 2020-10-20 04:45:52.891 105738 INFO sysinv.conductor.kube_app [-] Helm chart placement-0.1.0.tgz uploaded sysinv 2020-10-20 04:45:53.057 105738 INFO sysinv.conductor.kube_app [-] Helm chart garbd-0.1.0.tgz uploaded sysinv 2020-10-20 04:45:53.222 105738 INFO sysinv.conductor.kube_app [-] Helm chart magnum-0.1.0.tgz uploaded sysinv 2020-10-20 04:45:53.398 105738 INFO sysinv.conductor.kube_app [-] Helm chart nova-0.1.0.tgz uploaded sysinv 2020-10-20 04:45:53.585 105738 INFO sysinv.conductor.kube_app [-] Helm chart ingress-0.1.0.tgz uploaded sysinv 2020-10-20 04:45:53.774 105738 INFO sysinv.conductor.kube_app [-] Helm chart openvswitch-0.1.0.tgz uploaded sysinv 2020-10-20 04:45:53.962 105738 INFO sysinv.conductor.kube_app [-] Helm chart memcached-0.1.0.tgz uploaded sysinv 2020-10-20 04:45:54.150 105738 INFO sysinv.conductor.kube_app [-] Helm chart rabbitmq-0.1.0.tgz uploaded sysinv 2020-10-20 04:45:54.346 105738 INFO sysinv.conductor.kube_app [-] Helm chart aodh-0.1.0.tgz uploaded sysinv 2020-10-20 04:45:54.542 105738 INFO sysinv.conductor.kube_app [-] Helm chart libvirt-0.1.0.tgz uploaded sysinv 2020-10-20 04:45:54.749 105738 INFO sysinv.conductor.kube_app [-] Helm chart keystone-api-proxy-0.1.0.tgz uploaded sysinv 2020-10-20 04:45:54.967 105738 INFO sysinv.conductor.kube_app [-] Helm chart keystone-0.1.0.tgz uploaded sysinv 2020-10-20 04:45:55.183 105738 INFO sysinv.conductor.kube_app [-] Helm chart fm-rest-api-0.1.0.tgz uploaded sysinv 2020-10-20 04:45:55.399 105738 INFO sysinv.conductor.kube_app [-] Helm chart barbican-0.1.0.tgz uploaded sysinv 2020-10-20 04:45:55.625 105738 INFO sysinv.conductor.kube_app [-] Helm chart mariadb-0.1.0.tgz uploaded sysinv 2020-10-20 04:45:55.628 105738 INFO sysinv.conductor.kube_app [-] PluginHelper: Enabled plugin directory /opt/platform/helm/20.12/stx-openstack/1.0-64-centos-stable-versioned/plugins: created /usr/lib64/python2.7/site-packages/stx_app-stx-openstack-1.0-64-centos-stable-versioned.pth sysinv 2020-10-20 04:45:55.946 105738 INFO sysinv.conductor.kube_app [-] PluginHelper: Disabled plugin directory /opt/platform/helm/20.12/stx-openstack/1.0-64-centos-stable-versioned/plugins: removed /usr/lib64/python2.7/site-packages/stx_app-stx-openstack-1.0-64-centos-stable-versioned.pth sysinv 2020-10-20 04:45:55.946 105738 INFO sysinv.conductor.kube_app [-] PluginHelper: Disabling distributions: [u'k8sapp-openstack'] sysinv 2020-10-20 04:45:55.953 105738 INFO sysinv.helm.helm [-] Removed stevedore namespace: systemconfig.helm_plugins.stx_openstack sysinv 2020-10-20 04:45:56.339 105738 INFO sysinv.conductor.kube_app [-] PluginHelper: Enabled plugin directory /opt/platform/helm/20.12/stx-openstack/1.0-64-centos-stable-versioned/plugins: created /usr/lib64/python2.7/site-packages/stx_app-stx-openstack-1.0-64-centos-stable-versioned.pth sysinv 2020-10-20 04:45:56.347 105738 INFO sysinv.conductor.kube_app [-] Generating application overrides to discover required images. sysinv 2020-10-20 04:45:57.958 105738 INFO k8sapp_openstack.helm.neutron [-] _get_neutron_ml2_config={'ml2': {'physical_network_mtus': 'physnet0:1500,physnet1:1500'}, 'ml2_type_flat': {'flat_networks': ''}} sysinv 2020-10-20 04:45:59.107 105738 ERROR sysinv.conductor.kube_app [-] 'module' object has no attribute 'CEPH_POOL_BACKUP_PG_NUM': AttributeError: 'module' object has no attribute 'CEPH_POOL_BACKUP_PG_NUM' 2020-10-20 04:45:59.107 105738 ERROR sysinv.conductor.kube_app Traceback (most recent call last): 2020-10-20 04:45:59.107 105738 ERROR sysinv.conductor.kube_app File "/usr/lib64/python2.7/site-packages/sysinv/conductor/kube_app.py", line 1986, in perform_app_upload 2020-10-20 04:45:59.107 105738 ERROR sysinv.conductor.kube_app self._save_images_list(app) 2020-10-20 04:45:59.107 105738 ERROR sysinv.conductor.kube_app File "/usr/lib64/python2.7/site-packages/sysinv/conductor/kube_app.py", line 649, in _save_images_list 2020-10-20 04:45:59.107 105738 ERROR sysinv.conductor.kube_app armada_format=True, armada_chart_info=app.charts, combined=True) 2020-10-20 04:45:59.107 105738 ERROR sysinv.conductor.kube_app File "/usr/lib64/python2.7/site-packages/sysinv/helm/helm.py", line 52, in _wrapper 2020-10-20 04:45:59.107 105738 ERROR sysinv.conductor.kube_app return func(self, *args, **kwargs) 2020-10-20 04:45:59.107 105738 ERROR sysinv.conductor.kube_app File "/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py", line 328, in inner 2020-10-20 04:45:59.107 105738 ERROR sysinv.conductor.kube_app return f(*args, **kwargs) 2020-10-20 04:45:59.107 105738 ERROR sysinv.conductor.kube_app File "/usr/lib64/python2.7/site-packages/sysinv/helm/helm.py", line 644, in generate_helm_application_overrides 2020-10-20 04:45:59.107 105738 ERROR sysinv.conductor.kube_app cnamespace) 2020-10-20 04:45:59.107 105738 ERROR sysinv.conductor.kube_app File "/usr/lib64/python2.7/site-packages/sysinv/helm/helm.py", line 414, in _get_helm_application_overrides 2020-10-20 04:45:59.107 105738 ERROR sysinv.conductor.kube_app cnamespace)}) 2020-10-20 04:45:59.107 105738 ERROR sysinv.conductor.kube_app File "/usr/lib64/python2.7/site-packages/sysinv/helm/helm.py", line 319, in _get_helm_chart_overrides 2020-10-20 04:45:59.107 105738 ERROR sysinv.conductor.kube_app cnamespace)) 2020-10-20 04:45:59.107 105738 ERROR sysinv.conductor.kube_app File "/opt/platform/helm/20.12/stx-openstack/1.0-64-centos-stable-versioned/plugins/k8sapp_openstack/helm/cinder.py", line 60, in get_overrides 2020-10-20 04:45:59.107 105738 ERROR sysinv.conductor.kube_app 'ceph': self._get_conf_ceph_overrides(), 2020-10-20 04:45:59.107 105738 ERROR sysinv.conductor.kube_app File "/opt/platform/helm/20.12/stx-openstack/1.0-64-centos-stable-versioned/plugins/k8sapp_openstack/helm/cinder.py", line 110, in _get_conf_ceph_overrides 2020-10-20 04:45:59.107 105738 ERROR sysinv.conductor.kube_app 'chunk_size': app_constants.CEPH_POOL_BACKUP_PG_NUM, 2020-10-20 04:45:59.107 105738 ERROR sysinv.conductor.kube_app AttributeError: 'module' object has no attribute 'CEPH_POOL_BACKUP_PG_NUM' 2020-10-20 04:45:59.107 105738 ERROR sysinv.conductor.kube_app sysinv 2020-10-20 04:45:59.163 105738 ERROR sysinv.conductor.kube_app [-] Application upload aborted!. sysinv 2020-10-20 04:45:59.163 105738 ERROR sysinv.openstack.common.rpc.amqp [-] Exception during message handling: KubeAppUploadFailure: Upload of application stx-openstack (1.0-64-centos-stable-versioned) failed: 'module' object has no attribute 'CEPH_POOL_BACKUP_PG_NUM' 2020-10-20 04:45:59.163 105738 ERROR sysinv.openstack.common.rpc.amqp Traceback (most recent call last): 2020-10-20 04:45:59.163 105738 ERROR sysinv.openstack.common.rpc.amqp File "/usr/lib64/python2.7/site-packages/sysinv/openstack/common/rpc/amqp.py", line 437, in _process_data 2020-10-20 04:45:59.163 105738 ERROR sysinv.openstack.common.rpc.amqp **args) 2020-10-20 04:45:59.163 105738 ERROR sysinv.openstack.common.rpc.amqp File "/usr/lib64/python2.7/site-packages/sysinv/openstack/common/rpc/dispatcher.py", line 172, in dispatch 2020-10-20 04:45:59.163 105738 ERROR sysinv.openstack.common.rpc.amqp result = getattr(proxyobj, method)(ctxt, **kwargs) 2020-10-20 04:45:59.163 105738 ERROR sysinv.openstack.common.rpc.amqp File "/usr/lib64/python2.7/site-packages/sysinv/conductor/manager.py", line 11324, in perform_app_upload 2020-10-20 04:45:59.163 105738 ERROR sysinv.openstack.common.rpc.amqp self._app.perform_app_upload(rpc_app, tarfile) 2020-10-20 04:45:59.163 105738 ERROR sysinv.openstack.common.rpc.amqp File "/usr/lib64/python2.7/site-packages/sysinv/conductor/kube_app.py", line 2004, in perform_app_upload 2020-10-20 04:45:59.163 105738 ERROR sysinv.openstack.common.rpc.amqp name=app.name, version=app.version, reason=e) 2020-10-20 04:45:59.163 105738 ERROR sysinv.openstack.common.rpc.amqp KubeAppUploadFailure: Upload of application stx-openstack (1.0-64-centos-stable-versioned) failed: 'module' object has no attribute 'CEPH_POOL_BACKUP_PG_NUM' 2020-10-20 04:45:59.163 105738 ERROR sysinv.openstack.common.rpc.amqp sysinv 2020-10-20 04:45:59.730 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:45:59.731 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:45:59.776 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 04:45:59.785 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:45:59.786 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:46:59.733 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:46:59.734 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:46:59.779 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 04:46:59.786 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:46:59.787 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:47:59.741 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:47:59.743 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:47:59.791 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 04:47:59.798 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:47:59.799 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:48:34.677 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2020-10-20-04-48-34 patch sysinv 2020-10-20 04:48:34.677 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_end. No changes from mtce/1.0. sysinv 2020-10-20 04:48:59.744 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:48:59.745 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:48:59.797 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 04:48:59.805 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:48:59.806 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:49:59.732 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:49:59.734 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:49:59.779 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 04:49:59.787 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:49:59.788 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:50:59.730 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:50:59.732 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:50:59.778 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 04:50:59.785 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:50:59.786 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:51:59.731 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:51:59.732 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:51:59.782 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 04:51:59.790 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:51:59.791 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:52:59.732 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:52:59.733 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:52:59.778 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 04:52:59.785 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:52:59.786 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:53:34.706 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2020-10-20-04-53-34 patch sysinv 2020-10-20 04:53:34.706 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_end. No changes from mtce/1.0. sysinv 2020-10-20 04:53:59.731 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:53:59.732 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:53:59.778 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 04:53:59.785 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:53:59.786 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:54:59.733 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:54:59.734 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:54:59.779 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 04:54:59.786 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:54:59.787 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:55:59.732 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:55:59.734 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:55:59.779 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 04:55:59.786 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:55:59.787 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:56:59.731 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:56:59.732 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:56:59.778 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 04:56:59.785 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:56:59.786 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:57:59.730 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:57:59.732 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:57:59.777 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 04:57:59.785 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:57:59.785 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:58:34.765 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2020-10-20-04-58-34 patch sysinv 2020-10-20 04:58:34.765 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_end. No changes from mtce/1.0. sysinv 2020-10-20 04:58:59.738 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:58:59.739 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:58:59.786 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 04:58:59.792 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:58:59.794 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:59:59.734 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:59:59.735 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 04:59:59.783 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 04:59:59.790 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 04:59:59.792 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:00:59.733 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:00:59.734 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:00:59.780 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:00:59.787 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:00:59.788 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:01:59.743 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:01:59.745 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:01:59.795 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:02:00.001 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:02:00.002 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:02:59.741 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:02:59.742 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:02:59.789 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:02:59.796 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:02:59.796 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:03:34.835 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2020-10-20-05-03-34 patch sysinv 2020-10-20 05:03:34.836 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_end. No changes from mtce/1.0. sysinv 2020-10-20 05:03:59.742 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:03:59.744 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:03:59.789 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:03:59.796 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:03:59.797 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:04:59.740 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:04:59.741 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:04:59.787 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:04:59.793 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:04:59.794 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:05:59.746 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:05:59.748 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:05:59.794 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:05:59.801 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:05:59.802 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:06:59.751 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:06:59.753 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:06:59.805 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:06:59.813 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:06:59.814 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:07:59.741 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:07:59.743 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:07:59.790 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:07:59.797 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:07:59.798 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:08:34.839 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2020-10-20-05-08-34 patch sysinv 2020-10-20 05:08:34.839 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_end. No changes from mtce/1.0. sysinv 2020-10-20 05:08:59.891 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:08:59.892 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:08:59.937 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:08:59.944 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:08:59.945 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:09:59.740 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:09:59.741 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:09:59.789 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:09:59.796 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:09:59.798 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:10:59.741 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:10:59.742 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:10:59.787 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:10:59.794 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:10:59.795 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:11:59.740 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:11:59.741 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:11:59.789 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:11:59.795 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:11:59.796 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:12:59.741 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:12:59.742 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:12:59.788 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:12:59.797 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:12:59.798 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:13:34.901 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2020-10-20-05-13-34 patch sysinv 2020-10-20 05:13:34.901 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_end. No changes from mtce/1.0. sysinv 2020-10-20 05:13:59.740 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:13:59.741 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:13:59.787 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:13:59.794 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:13:59.795 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:14:59.737 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:14:59.738 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:14:59.784 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:14:59.791 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:14:59.792 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:15:59.740 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:15:59.742 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:15:59.787 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:15:59.794 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:15:59.795 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:16:59.740 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:16:59.742 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:16:59.787 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:16:59.794 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:16:59.795 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:17:59.740 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:17:59.741 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:17:59.787 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:17:59.794 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:17:59.795 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:18:34.898 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2020-10-20-05-18-34 patch sysinv 2020-10-20 05:18:34.898 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_end. No changes from mtce/1.0. sysinv 2020-10-20 05:18:59.738 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:18:59.740 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:18:59.785 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:18:59.792 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:18:59.794 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:19:59.738 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:19:59.739 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:19:59.784 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:19:59.791 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:19:59.792 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:20:59.738 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:20:59.740 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:20:59.784 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:20:59.791 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:20:59.792 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:21:59.733 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:21:59.734 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:21:59.788 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:21:59.795 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:21:59.797 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:22:59.733 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:22:59.735 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:22:59.785 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:22:59.792 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:22:59.793 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:23:34.956 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2020-10-20-05-23-34 patch sysinv 2020-10-20 05:23:34.956 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_end. No changes from mtce/1.0. sysinv 2020-10-20 05:23:59.733 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:23:59.735 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:23:59.787 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:23:59.794 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:23:59.795 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:24:59.735 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:24:59.737 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:24:59.786 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:24:59.794 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:24:59.795 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:25:59.736 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:25:59.737 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:25:59.787 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:25:59.794 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:25:59.795 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:26:59.735 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:26:59.737 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:26:59.786 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:26:59.794 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:26:59.795 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:27:59.736 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:27:59.737 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:27:59.786 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:27:59.793 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:27:59.794 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:28:34.962 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2020-10-20-05-28-34 patch sysinv 2020-10-20 05:28:34.962 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_end. No changes from mtce/1.0. sysinv 2020-10-20 05:28:59.944 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:28:59.946 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:28:59.993 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:29:00.001 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:29:00.002 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:30:59.735 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:30:59.736 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:30:59.782 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:30:59.789 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:30:59.790 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:31:59.735 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:31:59.736 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:31:59.784 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:31:59.791 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:31:59.792 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:32:59.735 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:32:59.737 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:32:59.783 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:32:59.790 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:32:59.791 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:33:35.020 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2020-10-20-05-33-35 patch sysinv 2020-10-20 05:33:35.020 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_end. No changes from mtce/1.0. sysinv 2020-10-20 05:33:59.736 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:33:59.737 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:33:59.784 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:33:59.791 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:33:59.792 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:34:59.739 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:34:59.740 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:34:59.789 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:34:59.797 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:34:59.798 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:35:59.735 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:35:59.736 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:35:59.785 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:35:59.792 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:35:59.793 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:36:59.734 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:36:59.735 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:36:59.782 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:36:59.790 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:36:59.790 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:37:59.733 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:37:59.735 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:37:59.782 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:37:59.789 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:37:59.790 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:38:35.045 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2020-10-20-05-38-35 patch sysinv 2020-10-20 05:38:35.046 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_end. No changes from mtce/1.0. sysinv 2020-10-20 05:38:59.734 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:38:59.735 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:38:59.780 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:38:59.787 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:38:59.788 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:39:59.736 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:39:59.738 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:39:59.785 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:39:59.792 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:39:59.793 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:40:59.735 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:40:59.736 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:40:59.781 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:40:59.788 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:40:59.789 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:41:59.735 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:41:59.736 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:41:59.781 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:41:59.788 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:41:59.789 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:42:59.735 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:42:59.737 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:42:59.784 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:42:59.935 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:42:59.937 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:43:35.013 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2020-10-20-05-43-34 patch sysinv 2020-10-20 05:43:35.013 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_end. No changes from mtce/1.0. sysinv 2020-10-20 05:43:59.739 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:43:59.740 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:43:59.788 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:43:59.795 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:43:59.796 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:44:59.737 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:44:59.738 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:44:59.786 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:44:59.793 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:44:59.794 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:45:59.738 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:45:59.740 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:45:59.786 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:45:59.793 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:45:59.794 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:46:59.739 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:46:59.740 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:46:59.787 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:46:59.794 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:46:59.795 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:47:59.737 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:47:59.738 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:47:59.785 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:47:59.793 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:47:59.794 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:48:35.044 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2020-10-20-05-48-35 patch sysinv 2020-10-20 05:48:35.044 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_end. No changes from mtce/1.0. sysinv 2020-10-20 05:48:59.740 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:48:59.742 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:48:59.789 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:48:59.796 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:48:59.797 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:49:59.737 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:49:59.739 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:49:59.785 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:49:59.792 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:49:59.793 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:50:59.743 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:50:59.744 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:50:59.792 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:50:59.799 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:50:59.800 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:51:59.742 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:51:59.744 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:51:59.789 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:51:59.796 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:51:59.797 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:52:59.738 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:52:59.740 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:52:59.788 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:52:59.794 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:52:59.795 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:53:35.074 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2020-10-20-05-53-35 patch sysinv 2020-10-20 05:53:35.074 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_end. No changes from mtce/1.0. sysinv 2020-10-20 05:53:59.738 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:53:59.739 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:53:59.788 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:53:59.795 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:53:59.796 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:54:59.738 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:54:59.740 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:54:59.785 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:54:59.792 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:54:59.793 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:55:59.735 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:55:59.736 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:55:59.784 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:55:59.793 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:55:59.794 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:56:59.740 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:56:59.741 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:56:59.787 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:56:59.794 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:56:59.795 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:57:59.736 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:57:59.737 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:57:59.784 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:57:59.791 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:57:59.792 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:58:35.140 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2020-10-20-05-58-35 patch sysinv 2020-10-20 05:58:35.141 107057 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_end. No changes from mtce/1.0. sysinv 2020-10-20 05:58:59.737 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:58:59.739 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None} sysinv 2020-10-20 05:58:59.784 105738 INFO sysinv.conductor.manager [-] Platform managed application oidc-auth-apps: Prerequisites not met. sysinv 2020-10-20 05:58:59.791 105738 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:None sysinv 2020-10-20 05:58:59.792 105738 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None}