2019-05-24 14:21:56.198 70961 INFO sysinv.agent.lldp.manager [-] Configured sysinv LLDP agent drivers: [] 2019-05-24 14:21:56.222 70961 INFO sysinv.agent.lldp.manager [-] Loaded sysinv LLDP agent drivers: [] 2019-05-24 14:21:56.222 70961 INFO sysinv.agent.lldp.manager [-] Registered sysinv LLDP agent drivers: [] 2019-05-24 14:21:56.263 70961 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds. 2019-05-24 14:21:57.264 70961 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 2019-05-24 14:21:57.272 70961 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 3 seconds. 2019-05-24 14:22:00.275 70961 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 2019-05-24 14:22:00.279 70961 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 5 seconds. 2019-05-24 14:22:05.280 70961 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 2019-05-24 14:22:05.292 70961 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on localhost:5672 2019-05-24 14:22:05.299 70961 INFO sysinv.agent.manager [-] Sysinv Agent audit running inv_get_and_report. 2019-05-24 14:22:05.866 70961 WARNING sysinv.agent.pci [-] Enabling device ens4 to query link speed 2019-05-24 14:22:05.869 70961 WARNING sysinv.agent.pci [-] ATTR speed unknown for: ens4 (flags: 0x1002) 2019-05-24 14:22:05.869 70961 WARNING sysinv.agent.pci [-] Disabling device ens4 after querying link speed 2019-05-24 14:22:06.148 70961 WARNING sysinv.agent.pci [-] Enabling device eth1000 to query link speed 2019-05-24 14:22:06.151 70961 WARNING sysinv.agent.pci [-] ATTR speed unknown for: eth1000 (flags: 0x1002) 2019-05-24 14:22:06.152 70961 WARNING sysinv.agent.pci [-] Disabling device eth1000 after querying link speed 2019-05-24 14:22:06.419 70961 WARNING sysinv.agent.pci [-] Enabling device eth1001 to query link speed 2019-05-24 14:22:06.422 70961 WARNING sysinv.agent.pci [-] ATTR speed unknown for: eth1001 (flags: 0x1002) 2019-05-24 14:22:06.423 70961 WARNING sysinv.agent.pci [-] Disabling device eth1001 after querying link speed 2019-05-24 14:22:06.447 70961 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on localhost:5672 2019-05-24 14:22:13.256 77153 INFO migrate.versioning.api [-] 0 -> 1... 2019-05-24 14:22:13.476 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:13.477 77153 INFO migrate.versioning.api [-] 1 -> 2... 2019-05-24 14:22:13.902 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:13.902 77153 INFO migrate.versioning.api [-] 2 -> 3... 2019-05-24 14:22:13.905 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:13.905 77153 INFO migrate.versioning.api [-] 3 -> 4... 2019-05-24 14:22:13.908 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:13.909 77153 INFO migrate.versioning.api [-] 4 -> 5... 2019-05-24 14:22:13.912 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:13.912 77153 INFO migrate.versioning.api [-] 5 -> 6... 2019-05-24 14:22:13.915 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:13.915 77153 INFO migrate.versioning.api [-] 6 -> 7... 2019-05-24 14:22:13.918 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:13.918 77153 INFO migrate.versioning.api [-] 7 -> 8... 2019-05-24 14:22:13.922 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:13.922 77153 INFO migrate.versioning.api [-] 8 -> 9... 2019-05-24 14:22:13.925 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:13.925 77153 INFO migrate.versioning.api [-] 9 -> 10... 2019-05-24 14:22:13.928 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:13.928 77153 INFO migrate.versioning.api [-] 10 -> 11... 2019-05-24 14:22:13.931 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:13.931 77153 INFO migrate.versioning.api [-] 11 -> 12... 2019-05-24 14:22:13.935 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:13.935 77153 INFO migrate.versioning.api [-] 12 -> 13... 2019-05-24 14:22:13.938 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:13.938 77153 INFO migrate.versioning.api [-] 13 -> 14... 2019-05-24 14:22:13.941 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:13.942 77153 INFO migrate.versioning.api [-] 14 -> 15... 2019-05-24 14:22:13.945 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:13.945 77153 INFO migrate.versioning.api [-] 15 -> 16... 2019-05-24 14:22:13.948 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:13.948 77153 INFO migrate.versioning.api [-] 16 -> 17... 2019-05-24 14:22:13.952 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:13.952 77153 INFO migrate.versioning.api [-] 17 -> 18... 2019-05-24 14:22:13.955 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:13.955 77153 INFO migrate.versioning.api [-] 18 -> 19... 2019-05-24 14:22:13.958 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:13.958 77153 INFO migrate.versioning.api [-] 19 -> 20... 2019-05-24 14:22:13.961 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:13.961 77153 INFO migrate.versioning.api [-] 20 -> 21... 2019-05-24 14:22:13.964 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:13.964 77153 INFO migrate.versioning.api [-] 21 -> 22... 2019-05-24 14:22:13.968 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:13.968 77153 INFO migrate.versioning.api [-] 22 -> 23... 2019-05-24 14:22:13.971 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:13.971 77153 INFO migrate.versioning.api [-] 23 -> 24... 2019-05-24 14:22:13.974 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:13.974 77153 INFO migrate.versioning.api [-] 24 -> 25... 2019-05-24 14:22:13.977 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:13.977 77153 INFO migrate.versioning.api [-] 25 -> 26... 2019-05-24 14:22:13.981 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:13.981 77153 INFO migrate.versioning.api [-] 26 -> 27... 2019-05-24 14:22:13.984 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:13.984 77153 INFO migrate.versioning.api [-] 27 -> 28... 2019-05-24 14:22:13.987 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:13.987 77153 INFO migrate.versioning.api [-] 28 -> 29... 2019-05-24 14:22:13.990 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:13.990 77153 INFO migrate.versioning.api [-] 29 -> 30... 2019-05-24 14:22:13.994 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:13.994 77153 INFO migrate.versioning.api [-] 30 -> 31... 2019-05-24 14:22:14.016 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:14.016 77153 INFO migrate.versioning.api [-] 31 -> 32... 2019-05-24 14:22:14.028 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:14.028 77153 INFO migrate.versioning.api [-] 32 -> 33... 2019-05-24 14:22:14.049 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:14.049 77153 INFO migrate.versioning.api [-] 33 -> 34... 2019-05-24 14:22:14.093 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:14.093 77153 INFO migrate.versioning.api [-] 34 -> 35... 2019-05-24 14:22:14.106 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:14.107 77153 INFO migrate.versioning.api [-] 35 -> 36... 2019-05-24 14:22:14.196 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:14.197 77153 INFO migrate.versioning.api [-] 36 -> 37... 2019-05-24 14:22:14.223 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:14.223 77153 INFO migrate.versioning.api [-] 37 -> 38... 2019-05-24 14:22:14.301 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:14.301 77153 INFO migrate.versioning.api [-] 38 -> 39... 2019-05-24 14:22:14.368 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:14.369 77153 INFO migrate.versioning.api [-] 39 -> 40... 2019-05-24 14:22:14.393 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:14.394 77153 INFO migrate.versioning.api [-] 40 -> 41... 2019-05-24 14:22:14.425 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:14.425 77153 INFO migrate.versioning.api [-] 41 -> 42... 2019-05-24 14:22:14.455 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:14.455 77153 INFO migrate.versioning.api [-] 42 -> 43... 2019-05-24 14:22:14.502 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:14.502 77153 INFO migrate.versioning.api [-] 43 -> 44... 2019-05-24 14:22:14.584 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:14.584 77153 INFO migrate.versioning.api [-] 44 -> 45... 2019-05-24 14:22:14.641 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:14.642 77153 INFO migrate.versioning.api [-] 45 -> 46... 2019-05-24 14:22:14.646 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:14.647 77153 INFO migrate.versioning.api [-] 46 -> 47... 2019-05-24 14:22:14.651 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:14.651 77153 INFO migrate.versioning.api [-] 47 -> 48... 2019-05-24 14:22:14.655 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:14.655 77153 INFO migrate.versioning.api [-] 48 -> 49... 2019-05-24 14:22:14.658 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:14.658 77153 INFO migrate.versioning.api [-] 49 -> 50... 2019-05-24 14:22:14.821 77153 INFO 050_consolidated_r4 [-] Migrate pv_state 2019-05-24 14:22:14.888 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:14.888 77153 INFO migrate.versioning.api [-] 50 -> 51... 2019-05-24 14:22:14.900 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:14.901 77153 INFO migrate.versioning.api [-] 51 -> 52... 2019-05-24 14:22:14.935 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:14.935 77153 INFO migrate.versioning.api [-] 52 -> 53... 2019-05-24 14:22:15.011 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:15.011 77153 INFO migrate.versioning.api [-] 53 -> 54... 2019-05-24 14:22:15.030 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:15.031 77153 INFO migrate.versioning.api [-] 54 -> 55... 2019-05-24 14:22:15.105 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:15.105 77153 INFO migrate.versioning.api [-] 55 -> 56... 2019-05-24 14:22:15.134 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:15.134 77153 INFO migrate.versioning.api [-] 56 -> 57... 2019-05-24 14:22:15.146 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:15.147 77153 INFO migrate.versioning.api [-] 57 -> 58... 2019-05-24 14:22:15.231 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:15.231 77153 INFO migrate.versioning.api [-] 58 -> 59... 2019-05-24 14:22:15.243 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:15.243 77153 INFO migrate.versioning.api [-] 59 -> 60... 2019-05-24 14:22:15.266 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:15.266 77153 INFO migrate.versioning.api [-] 60 -> 61... 2019-05-24 14:22:15.289 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:15.289 77153 INFO migrate.versioning.api [-] 61 -> 62... 2019-05-24 14:22:15.308 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:15.308 77153 INFO migrate.versioning.api [-] 62 -> 63... 2019-05-24 14:22:15.561 77153 WARNING ceph_client [-] skip checking server certificate 2019-05-24 14:22:15.989 77153 WARNING ceph_client [-] skip checking server certificate 2019-05-24 14:22:16.020 77153 WARNING ceph_client [-] skip checking server certificate 2019-05-24 14:22:16.021 77153 WARNING ceph_client [-] skip checking server certificate 2019-05-24 14:22:16.102 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:16.103 77153 INFO migrate.versioning.api [-] 63 -> 64... 2019-05-24 14:22:16.113 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:16.113 77153 INFO migrate.versioning.api [-] 64 -> 65... 2019-05-24 14:22:16.189 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:16.189 77153 INFO migrate.versioning.api [-] 65 -> 66... 2019-05-24 14:22:16.236 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:16.236 77153 INFO migrate.versioning.api [-] 66 -> 67... 2019-05-24 14:22:16.273 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:16.273 77153 INFO migrate.versioning.api [-] 67 -> 68... 2019-05-24 14:22:16.327 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:16.328 77153 INFO migrate.versioning.api [-] 68 -> 69... 2019-05-24 14:22:16.342 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:16.342 77153 INFO migrate.versioning.api [-] 69 -> 70... 2019-05-24 14:22:16.345 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:16.345 77153 INFO migrate.versioning.api [-] 70 -> 71... 2019-05-24 14:22:16.370 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:16.370 77153 INFO migrate.versioning.api [-] 71 -> 72... 2019-05-24 14:22:16.371 77153 INFO 072_remove_ceilometer_service_parameter [-] Deleting ceilometer metering_time_to_live service parameter 2019-05-24 14:22:16.384 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:16.384 77153 INFO migrate.versioning.api [-] 72 -> 73... 2019-05-24 14:22:16.397 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:16.397 77153 INFO migrate.versioning.api [-] 73 -> 74... 2019-05-24 14:22:16.419 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:16.420 77153 INFO migrate.versioning.api [-] 74 -> 75... 2019-05-24 14:22:16.438 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:16.438 77153 INFO migrate.versioning.api [-] 75 -> 76... 2019-05-24 14:22:16.478 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:16.478 77153 INFO migrate.versioning.api [-] 76 -> 77... 2019-05-24 14:22:16.541 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:16.541 77153 INFO migrate.versioning.api [-] 77 -> 78... 2019-05-24 14:22:16.583 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:16.583 77153 INFO migrate.versioning.api [-] 78 -> 79... 2019-05-24 14:22:16.605 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:16.605 77153 INFO migrate.versioning.api [-] 79 -> 80... 2019-05-24 14:22:16.644 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:16.644 77153 INFO migrate.versioning.api [-] 80 -> 81... 2019-05-24 14:22:16.657 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:16.657 77153 INFO migrate.versioning.api [-] 81 -> 82... 2019-05-24 14:22:16.668 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:16.668 77153 INFO migrate.versioning.api [-] 82 -> 83... 2019-05-24 14:22:16.713 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:16.713 77153 INFO migrate.versioning.api [-] 83 -> 84... 2019-05-24 14:22:16.825 77153 INFO migrate.versioning.api [-] done 2019-05-24 14:22:18.610 77301 WARNING ceph_client [-] skip checking server certificate 2019-05-24 14:22:19.200 77301 ERROR stevedore.extension [-] Could not load 'platform-integ-apps': No module named systemconfig.helm_plugins.platform_integ_apps 2019-05-24 14:22:19.200 77301 ERROR stevedore.extension [-] Could not load 'stx-openstack': No module named systemconfig.helm_plugins.stx_openstack 2019-05-24 14:22:19.209 77301 WARNING ceph_client [-] skip checking server certificate 2019-05-24 14:22:19.369 77301 WARNING sysinv.conductor.ceph [-] ceph_api.fsid failed: Failed to get ceph-mgr restful plugin keys. Command 'ceph restful list-keys --connect-timeout 5' returned non-zero exit status 1 2019-05-24 14:22:19.370 77301 INFO sysinv.conductor.ceph [-] Create new ceph cluster record: fsid=None. 2019-05-24 14:22:19.392 77301 INFO sysinv.conductor.ceph [-] Create primary ceph tier record. 2019-05-24 14:22:19.417 77301 ERROR stevedore.extension [-] Could not load 'platform-integ-apps': No module named systemconfig.helm_plugins.platform_integ_apps 2019-05-24 14:22:19.417 77301 ERROR stevedore.extension [-] Could not load 'stx-openstack': No module named systemconfig.helm_plugins.stx_openstack 2019-05-24 14:22:19.632 77301 ERROR sysinv.common.utils [-] Failed to update helm repo data for user wrsroot. 2019-05-24 14:22:19.632 77301 INFO sysinv.conductor.manager [-] sysinv-conductor start committed system={'system_mode': None, 'created_at': datetime.datetime(2019, 5, 24, 14, 22, 19, 29770, tzinfo=), 'uuid': u'4ea30041-b636-4189-89af-e6d74ac0c05d', 'software_version': u'19.01', 'service_project_name': None, 'system_type': None, 'name': u'c261f567-3717-4cf7-8d8b-ced73919f231', 'description': None, 'location': None, 'updated_at': None, 'capabilities': {}, 'id': 1, 'contact': None, 'security_feature': u'nopti nospectre_v2', 'services': 72, 'timezone': None, 'security_profile': u'standard', 'distributed_cloud_role': None, 'region_name': None} 2019-05-24 14:22:19.683 77301 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on localhost:5672 2019-05-24 14:23:06.507 70961 INFO sysinv.agent.manager [-] get_ihost_by_macs rpc Timeout. 2019-05-24 14:23:06.514 70961 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on localhost:5672 2019-05-24 14:23:06.538 77301 INFO sysinv.openstack.common.rpc.common [req-c47d29f6-63cc-4afb-aafc-c68229e1b8ae None None] Connected to AMQP server on localhost:5672 2019-05-24 14:23:06.549 70961 WARNING sysinv.openstack.common.loopingcall [-] task run outlasted interval by 1.249972 sec 2019-05-24 14:23:06.549 70961 INFO sysinv.agent.manager [-] Sysinv Agent audit running inv_get_and_report. 2019-05-24 14:23:07.099 70961 WARNING sysinv.agent.pci [-] Enabling device ens4 to query link speed 2019-05-24 14:23:07.102 70961 WARNING sysinv.agent.pci [-] ATTR speed unknown for: ens4 (flags: 0x1002) 2019-05-24 14:23:07.102 70961 WARNING sysinv.agent.pci [-] Disabling device ens4 after querying link speed 2019-05-24 14:23:07.410 70961 WARNING sysinv.agent.pci [-] ATTR speed unknown for: eth1000 (flags: 0x1003) 2019-05-24 14:23:07.724 70961 WARNING sysinv.agent.pci [-] Enabling device eth1001 to query link speed 2019-05-24 14:23:07.728 70961 WARNING sysinv.agent.pci [-] ATTR speed unknown for: eth1001 (flags: 0x1002) 2019-05-24 14:23:07.728 70961 WARNING sysinv.agent.pci [-] Disabling device eth1001 after querying link speed 2019-05-24 14:23:08.496 79723 WARNING ceph_client [-] skip checking server certificate 2019-05-24 14:23:08.886 79723 WARNING ceph_client [-] skip checking server certificate 2019-05-24 14:23:08.916 79723 WARNING ceph_client [-] skip checking server certificate 2019-05-24 14:23:08.917 79723 WARNING ceph_client [-] skip checking server certificate 2019-05-24 14:23:08.924 79723 WARNING oslo_config.cfg [-] Deprecated: Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S release.). Its value may be silently ignored in the future. 2019-05-24 14:23:08.925 79723 WARNING oslo_config.cfg [-] Deprecated: Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken". 2019-05-24 14:23:08.926 79723 INFO keystonemiddleware.auth_token [-] Starting Keystone auth_token middleware 2019-05-24 14:23:08.930 79723 WARNING keystonemiddleware.auth_token [-] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. 2019-05-24 14:23:08.934 79723 INFO oslo.service.wsgi [-] sysinv_api listening on 0.0.0.0:6385 2019-05-24 14:23:08.934 79723 INFO oslo_service.service [-] Starting 2 workers 2019-05-24 14:23:30.119 79794 WARNING keystonemiddleware.auth_token [-] Using the in-process token cache is deprecated as of the 4.2.0 release and may be removed in the 5.0.0 release or the 'O' development cycle. The in-process cache causes inconsistent results and high memory usage. When the feature is removed the auth_token middleware will not cache tokens by default which may result in performance issues. It is recommended to use memcache for the auth_token token cache by setting the memcached_servers option. 2019-05-24 14:23:31.069 79794 INFO sysinv.api.controllers.v1.system [-] update system mode simplex 2019-05-24 14:23:31.104 79794 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on localhost:5672 2019-05-24 14:23:31.114 77301 INFO sysinv.conductor.manager [req-7afec57b-2c46-4e3e-9291-7037a5f232c8 admin admin] _config_update_hosts config_uuid=f720f97d-3164-483a-9525-6414b251de33 2019-05-24 14:23:31.119 79794 INFO sysinv.api.controllers.v1.system [-] update system timezone to UTC 2019-05-24 14:23:31.128 77301 INFO sysinv.conductor.manager [req-7afec57b-2c46-4e3e-9291-7037a5f232c8 admin admin] _config_update_hosts config_uuid=3e12b511-c01c-4b38-975e-23c829c849ec 2019-05-24 14:23:31.129 77301 INFO sysinv.conductor.manager [req-7afec57b-2c46-4e3e-9291-7037a5f232c8 admin admin] applying runtime manifest config_uuid=3e12b511-c01c-4b38-975e-23c829c849ec 2019-05-24 14:23:31.134 77301 INFO sysinv.agent.rpcapi [req-7afec57b-2c46-4e3e-9291-7037a5f232c8 admin admin] config_apply_runtime_manifest: fanout_cast: sending config 3e12b511-c01c-4b38-975e-23c829c849ec {'force': False, 'personalities': ['worker', 'storage']} to agent 2019-05-24 14:23:31.143 77301 INFO sysinv.conductor.manager [req-7afec57b-2c46-4e3e-9291-7037a5f232c8 admin admin] _config_update_hosts config_uuid=0b303264-1528-4da6-bbfe-e85aae1ffd8d 2019-05-24 14:23:31.143 77301 INFO sysinv.conductor.manager [req-7afec57b-2c46-4e3e-9291-7037a5f232c8 admin admin] applying runtime manifest config_uuid=0b303264-1528-4da6-bbfe-e85aae1ffd8d, classes: ['openstack::horizon::runtime'] 2019-05-24 14:23:31.149 77301 INFO sysinv.agent.rpcapi [req-7afec57b-2c46-4e3e-9291-7037a5f232c8 admin admin] config_apply_runtime_manifest: fanout_cast: sending config 0b303264-1528-4da6-bbfe-e85aae1ffd8d {'classes': ['openstack::horizon::runtime'], 'force': False, 'personalities': ['controller']} to agent 2019-05-24 14:23:31.529 79795 WARNING keystonemiddleware.auth_token [-] Using the in-process token cache is deprecated as of the 4.2.0 release and may be removed in the 5.0.0 release or the 'O' development cycle. The in-process cache causes inconsistent results and high memory usage. When the feature is removed the auth_token middleware will not cache tokens by default which may result in performance issues. It is recommended to use memcache for the auth_token token cache by setting the memcached_servers option. 2019-05-24 14:23:33.548 79794 WARNING sysinv.api.controllers.v1.dns [-] dns {'uuid': u'915d5ea0-f343-4344-a026-3a6072d2e2e3', 'nameservers': u'10.248.2.1', 'created_at': datetime.datetime(2019, 5, 24, 14, 22, 19, 43075, tzinfo=), 'updated_at': None, 'action': None, 'isystem_uuid': u'4ea30041-b636-4189-89af-e6d74ac0c05d', 'id': 1, 'forisystemid': 1} 2019-05-24 14:23:33.570 77301 INFO sysinv.conductor.manager [req-8ec21261-bc69-4678-8b3b-989f3dfac161 admin admin] _config_update_hosts config_uuid=002db320-3547-4f4d-8201-56f426799461 2019-05-24 14:23:33.636 79795 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on localhost:5672 2019-05-24 14:23:33.640 77301 INFO sysinv.conductor.manager [req-087d1845-d471-40e4-8268-5a9a946d0f32 admin admin] Updating parameters configuration for service: docker 2019-05-24 14:23:33.646 77301 INFO sysinv.conductor.manager [req-087d1845-d471-40e4-8268-5a9a946d0f32 admin admin] _config_update_hosts config_uuid=29e4debc-1731-457a-a3ae-cc7ae528cc98 2019-05-24 14:23:33.680 79795 INFO sysinv.api.controllers.v1.host [-] SYS_I host controller-0 ihost_post_start_2019-05-24-14-23-33 add 2019-05-24 14:23:33.698 79795 INFO sysinv.api.controllers.v1.host [-] update_subfunctions: subfunctions not set. personality=controller 2019-05-24 14:23:33.698 79795 INFO sysinv.api.controllers.v1.host [-] bm_ip in delta=set(['tboot', 'boot_device', 'console', 'uuid', 'mgmt_ip', 'subfunctions', 'bm_password', 'hostname', 'availability', 'capabilities', 'rootfs_device', 'bm_username', 'location', 'bm_ip', 'bm_type', 'invprovision', 'operational', 'administrative', 'install_output', 'mgmt_mac', 'personality']) obm_ip= nbm_ip= 2019-05-24 14:23:33.698 79795 INFO sysinv.api.controllers.v1.host [-] controller-0 bm semantic checks for user_agent Python-httplib2/0.9.2 (gzip) passed 2019-05-24 14:23:33.723 77301 INFO sysinv.conductor.manager [req-a5484345-03fe-477e-b0e8-c7ed7995de51 admin admin] Local Region Name: RegionOne 2019-05-24 14:23:33.734 77301 INFO sysinv.conductor.manager [req-a5484345-03fe-477e-b0e8-c7ed7995de51 admin admin] Disk size : 600 ... large disk defaults 2019-05-24 14:23:33.734 77301 INFO sysinv.conductor.manager [req-a5484345-03fe-477e-b0e8-c7ed7995de51 admin admin] Creating FS:backup:backup-lv 60 2019-05-24 14:23:33.749 77301 INFO sysinv.conductor.manager [req-a5484345-03fe-477e-b0e8-c7ed7995de51 admin admin] Creating FS:cgcs:cgcs-lv 20 2019-05-24 14:23:33.757 77301 INFO sysinv.conductor.manager [req-a5484345-03fe-477e-b0e8-c7ed7995de51 admin admin] Creating FS:database:pgsql-lv 20 2019-05-24 14:23:33.763 77301 INFO sysinv.conductor.manager [req-a5484345-03fe-477e-b0e8-c7ed7995de51 admin admin] Creating FS:scratch:scratch-lv 8 2019-05-24 14:23:33.770 77301 INFO sysinv.conductor.manager [req-a5484345-03fe-477e-b0e8-c7ed7995de51 admin admin] Creating FS:extension:extension-lv 1 2019-05-24 14:23:33.777 77301 INFO sysinv.conductor.manager [req-a5484345-03fe-477e-b0e8-c7ed7995de51 admin admin] Creating FS:docker:docker-lv 30 2019-05-24 14:23:33.784 77301 INFO sysinv.conductor.manager [req-a5484345-03fe-477e-b0e8-c7ed7995de51 admin admin] Creating FS:etcd:etcd-lv 5 2019-05-24 14:23:33.790 77301 INFO sysinv.conductor.manager [req-a5484345-03fe-477e-b0e8-c7ed7995de51 admin admin] Creating FS:docker-distribution:dockerdistribution-lv 16 2019-05-24 14:23:33.839 77301 INFO sysinv.db.sqlalchemy.api [req-a5484345-03fe-477e-b0e8-c7ed7995de51 admin admin] _host_upgrade_create system version=19.01 2019-05-24 14:23:33.849 77301 INFO sysinv.common.fm [req-a5484345-03fe-477e-b0e8-c7ed7995de51 admin admin] Generating FM Customer Log {'hostid': u'controller-0', 'entity_type': 'host', 'event_id': '200.020', 'entity': u'host=controller-0.event=discovered', 'fm_severity': 'clear', 'reason_text': u"controller-0 has been 'discovered'.", 'fm_event_type': 'equipment'} 2019-05-24 14:23:33.850 77301 WARNING root [-] fm_python_extension: Failed to connect to FM manager 2019-05-24 14:23:33.850 77301 ERROR sysinv.common.fm [req-a5484345-03fe-477e-b0e8-c7ed7995de51 admin admin] Failed to generate customer log, fm_uuid=None. 2019-05-24 14:23:35.303 77301 INFO sysinv.conductor.manager [req-a5484345-03fe-477e-b0e8-c7ed7995de51 admin admin] _config_update_hosts config_uuid=61d0e009-a2e8-4e85-8d59-a701fdc5462b 2019-05-24 14:23:35.303 77301 INFO sysinv.conductor.manager [req-a5484345-03fe-477e-b0e8-c7ed7995de51 admin admin] applying runtime manifest config_uuid=61d0e009-a2e8-4e85-8d59-a701fdc5462b, classes: ['openstack::keystone::endpoint::runtime'] 2019-05-24 14:23:36.848 77301 INFO sysinv.agent.rpcapi [req-a5484345-03fe-477e-b0e8-c7ed7995de51 admin admin] config_apply_runtime_manifest: fanout_cast: sending config 61d0e009-a2e8-4e85-8d59-a701fdc5462b {'classes': ['openstack::keystone::endpoint::runtime'], 'force': True, 'personalities': ['controller'], 'host_uuids': [u'555dd65c-2edd-40fa-8dfd-af34fb4172a0']} to agent 2019-05-24 14:23:38.006 77301 INFO sysinv.conductor.manager [req-b98ffc2d-4114-4cab-86d0-81cae5cc3167 None None] Updating platform data for host: 555dd65c-2edd-40fa-8dfd-af34fb4172a0 with: {u'first_report': True, u'action_state': u'reinstalled'} 2019-05-24 14:23:38.013 77301 INFO sysinv.conductor.manager [req-b98ffc2d-4114-4cab-86d0-81cae5cc3167 None None] controller-0 updating action_state=reinstalled 2019-05-24 14:23:38.028 70961 INFO sysinv.agent.manager [-] Removed /etc/platform/.first_boot 2019-05-24 14:23:38.028 70961 INFO sysinv.agent.manager [-] Sysinv Agent platform update by host: {'first_report': True, 'action_state': 'reinstalled'} 2019-05-24 14:23:38.028 70961 INFO sysinv.agent.manager [-] Agent found matching ihost: 555dd65c-2edd-40fa-8dfd-af34fb4172a0 2019-05-24 14:23:38.212 77301 INFO sysinv.conductor.manager [req-b98ffc2d-4114-4cab-86d0-81cae5cc3167 None None] Attempting to create new port {u'dev_id': 0, u'sriov_numvfs': 0, u'link_mode': u'0', u'driver': u'e1000', 'bootp': None, u'prevision': u'-r03', u'dpdksupport': False, u'mac': u'52:54:00:ab:c9:d8', u'pname': u'ens3', 'host_id': 1, 'interface_id': 1, u'speed': u'1000', u'psvendor': u'Red Hat, Inc.', u'numa_node': u'-1', u'pclass': u'Ethernet controller', u'mtu': u'1500', u'pvendor': u'Intel Corporation', u'sriov_vfs_pci_address': u'', u'psdevice': u'QEMU Virtual Machine', u'pciaddr': u'0000:00:03.0', u'pdevice': u'82540EM Gigabit Ethernet Controller', u'sriov_totalvfs': None} on host 555dd65c-2edd-40fa-8dfd-af34fb4172a0 2019-05-24 14:23:38.329 77301 INFO sysinv.conductor.manager [req-b98ffc2d-4114-4cab-86d0-81cae5cc3167 None None] Attempting to create new port {u'dev_id': 0, u'sriov_numvfs': 0, u'link_mode': u'0', u'driver': u'e1000', 'bootp': None, u'prevision': u'-r03', u'dpdksupport': False, u'mac': u'52:54:00:2f:15:85', u'pname': u'ens4', 'host_id': 1, 'interface_id': 2, u'speed': None, u'psvendor': u'Red Hat, Inc.', u'numa_node': u'-1', u'pclass': u'Ethernet controller', u'mtu': u'1500', u'pvendor': u'Intel Corporation', u'sriov_vfs_pci_address': u'', u'psdevice': u'QEMU Virtual Machine', u'pciaddr': u'0000:00:04.0', u'pdevice': u'82540EM Gigabit Ethernet Controller', u'sriov_totalvfs': None} on host 555dd65c-2edd-40fa-8dfd-af34fb4172a0 2019-05-24 14:23:38.521 77301 INFO sysinv.conductor.manager [req-b98ffc2d-4114-4cab-86d0-81cae5cc3167 None None] Attempting to create new port {u'dev_id': 0, u'sriov_numvfs': 0, u'link_mode': u'0', u'driver': u'virtio-pci', 'bootp': None, u'prevision': u'0', u'dpdksupport': True, u'mac': u'52:54:00:52:79:52', u'pname': u'eth1000', 'host_id': 1, 'interface_id': 3, u'speed': None, u'psvendor': u'Red Hat, Inc.', u'numa_node': u'-1', u'pclass': u'Ethernet controller', u'mtu': u'1500', u'pvendor': u'Red Hat, Inc.', u'sriov_vfs_pci_address': u'', u'psdevice': u'Device 0001', u'pciaddr': u'0000:00:06.0', u'pdevice': u'Virtio network device', u'sriov_totalvfs': None} on host 555dd65c-2edd-40fa-8dfd-af34fb4172a0 2019-05-24 14:23:38.639 77301 INFO sysinv.conductor.manager [req-b98ffc2d-4114-4cab-86d0-81cae5cc3167 None None] Attempting to create new port {u'dev_id': 0, u'sriov_numvfs': 0, u'link_mode': u'0', u'driver': u'virtio-pci', 'bootp': None, u'prevision': u'0', u'dpdksupport': True, u'mac': u'52:54:00:58:9d:84', u'pname': u'eth1001', 'host_id': 1, 'interface_id': 4, u'speed': None, u'psvendor': u'Red Hat, Inc.', u'numa_node': u'-1', u'pclass': u'Ethernet controller', u'mtu': u'1500', u'pvendor': u'Red Hat, Inc.', u'sriov_vfs_pci_address': u'', u'psdevice': u'Device 0001', u'pciaddr': u'0000:00:07.0', u'pdevice': u'Virtio network device', u'sriov_totalvfs': None} on host 555dd65c-2edd-40fa-8dfd-af34fb4172a0 2019-05-24 14:23:38.687 77301 INFO sysinv.conductor.manager [req-b98ffc2d-4114-4cab-86d0-81cae5cc3167 None None] Attempting to create new device {u'sriov_numvfs': 0, u'driver': u'ata_piix', u'prevision': u'-p80', 'host_id': 1, u'psvendor': u'Red Hat, Inc.', u'extra_info': None, u'name': u'pci_0000_00_01_1', u'numa_node': u'-1', u'pdevice_id': u'7010', u'pclass': u'IDE interface', u'pvendor': u'Intel Corporation', u'sriov_vfs_pci_address': u'', u'psdevice': u'Qemu virtual machine', u'pciaddr': u'0000:00:01.1', u'pdevice': u'82371SB PIIX3 IDE [Natoma/Triton II]', u'pvendor_id': u'8086', u'pclass_id': u'010180', u'enabled': False, u'sriov_totalvfs': None} on host 1 2019-05-24 14:23:38.701 77301 INFO sysinv.conductor.manager [req-b98ffc2d-4114-4cab-86d0-81cae5cc3167 None None] Attempting to create new device {u'sriov_numvfs': 0, u'driver': u'uhci_hcd', u'prevision': u'-r01', 'host_id': 1, u'psvendor': u'Red Hat, Inc.', u'extra_info': None, u'name': u'pci_0000_00_01_2', u'numa_node': u'-1', u'pdevice_id': u'7020', u'pclass': u'USB controller', u'pvendor': u'Intel Corporation', u'sriov_vfs_pci_address': u'', u'psdevice': u'QEMU Virtual Machine', u'pciaddr': u'0000:00:01.2', u'pdevice': u'82371SB PIIX3 USB [Natoma/Triton II]', u'pvendor_id': u'8086', u'pclass_id': u'0c0300', u'enabled': False, u'sriov_totalvfs': None} on host 1 2019-05-24 14:23:38.714 77301 INFO sysinv.conductor.manager [req-b98ffc2d-4114-4cab-86d0-81cae5cc3167 None None] Attempting to create new device {u'sriov_numvfs': 0, u'driver': None, u'prevision': u'Red Hat, Inc.', 'host_id': 1, u'psvendor': u'QEMU Virtual Machine', u'extra_info': None, u'name': u'pci_0000_00_02_0', u'numa_node': u'-1', u'pdevice_id': u'00b8', u'pclass': u'VGA compatible controller', u'pvendor': u'Cirrus Logic', u'sriov_vfs_pci_address': u'', u'psdevice': u'QEMU Virtual Machine', u'pciaddr': u'0000:00:02.0', u'pdevice': u'GD 5446', u'pvendor_id': u'1013', u'pclass_id': u'030000', u'enabled': True, u'sriov_totalvfs': None} on host 1 2019-05-24 14:23:38.729 77301 INFO sysinv.conductor.manager [req-b98ffc2d-4114-4cab-86d0-81cae5cc3167 None None] Attempting to create new device {u'sriov_numvfs': 0, u'driver': u'virtio-pci', u'prevision': u'0', 'host_id': 1, u'psvendor': u'Red Hat, Inc.', u'extra_info': None, u'name': u'pci_0000_00_05_0', u'numa_node': u'-1', u'pdevice_id': u'1002', u'pclass': u'Unclassified device [00ff]', u'pvendor': u'Red Hat, Inc.', u'sriov_vfs_pci_address': u'', u'psdevice': u'Device 0005', u'pciaddr': u'0000:00:05.0', u'pdevice': u'Virtio memory balloon', u'pvendor_id': u'1af4', u'pclass_id': u'00ff00', u'enabled': False, u'sriov_totalvfs': None} on host 1 2019-05-24 14:23:38.743 77301 INFO sysinv.conductor.manager [req-b98ffc2d-4114-4cab-86d0-81cae5cc3167 None None] Attempting to create new device {u'sriov_numvfs': 0, u'driver': u'ahci', u'prevision': u'-r02', 'host_id': 1, u'psvendor': u'-p01', u'extra_info': None, u'name': u'pci_0000_00_08_0', u'numa_node': u'-1', u'pdevice_id': u'2922', u'pclass': u'SATA controller', u'pvendor': u'Intel Corporation', u'sriov_vfs_pci_address': u'', u'psdevice': u'Red Hat, Inc.', u'pciaddr': u'0000:00:08.0', u'pdevice': u'82801IR/IO/IH (ICH9R/DO/DH) 6 port SATA Controller [AHCI mode]', u'pvendor_id': u'8086', u'pclass_id': u'010601', u'enabled': False, u'sriov_totalvfs': None} on host 1 2019-05-24 14:23:39.013 77301 INFO sysinv.conductor.manager [req-b98ffc2d-4114-4cab-86d0-81cae5cc3167 None None] Logical CPU topology: host:controller-0 (controller,worker), sockets:1, cores/socket=6, threads/core=1, reference:current (initial) 2019-05-24 14:23:39.014 77301 INFO sysinv.conductor.manager [req-b98ffc2d-4114-4cab-86d0-81cae5cc3167 None None] cpu_id : 0 1 2 3 4 5 2019-05-24 14:23:39.014 77301 INFO sysinv.conductor.manager [req-b98ffc2d-4114-4cab-86d0-81cae5cc3167 None None] socket_id : 0 0 0 0 0 0 2019-05-24 14:23:39.014 77301 INFO sysinv.conductor.manager [req-b98ffc2d-4114-4cab-86d0-81cae5cc3167 None None] core_id : 0 1 2 3 4 5 2019-05-24 14:23:39.014 77301 INFO sysinv.conductor.manager [req-b98ffc2d-4114-4cab-86d0-81cae5cc3167 None None] thread_id : 0 0 0 0 0 0 2019-05-24 14:23:39.061 77301 INFO sysinv.conductor.manager [req-b98ffc2d-4114-4cab-86d0-81cae5cc3167 None None] Update CPU grub config, host_uuid (555dd65c-2edd-40fa-8dfd-af34fb4172a0), name (controller-0) 2019-05-24 14:23:39.067 77301 INFO sysinv.conductor.manager [req-b98ffc2d-4114-4cab-86d0-81cae5cc3167 None None] update_cpu_config, host uuid: (555dd65c-2edd-40fa-8dfd-af34fb4172a0), force: (False) 2019-05-24 14:23:39.082 77301 INFO sysinv.conductor.manager [req-b98ffc2d-4114-4cab-86d0-81cae5cc3167 None None] _config_update_hosts config_uuid=42c5f43f-7347-46c5-b810-442d72295cd6 2019-05-24 14:23:39.083 77301 INFO sysinv.conductor.manager [req-b98ffc2d-4114-4cab-86d0-81cae5cc3167 None None] applying runtime manifest config_uuid=42c5f43f-7347-46c5-b810-442d72295cd6, classes: ['platform::compute::grub::runtime', 'platform::compute::config::runtime'] 2019-05-24 14:23:40.642 77301 INFO sysinv.agent.rpcapi [req-b98ffc2d-4114-4cab-86d0-81cae5cc3167 None None] config_apply_runtime_manifest: fanout_cast: sending config 42c5f43f-7347-46c5-b810-442d72295cd6 {'classes': ['platform::compute::grub::runtime', 'platform::compute::config::runtime'], 'force': False, 'personalities': ['controller', 'worker'], 'host_uuids': [u'555dd65c-2edd-40fa-8dfd-af34fb4172a0']} to agent 2019-05-24 14:23:42.738 77301 INFO sysinv.conductor.manager [req-b98ffc2d-4114-4cab-86d0-81cae5cc3167 None None] Partition create on host: 1. Details: {'status': 1, 'forihostid': 1, u'device_path': u'/dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part1', u'start_mib': u'1', u'uuid': u'2a3c080a-28a0-4251-a916-f958646c1625', 'idisk_id': 1, u'type_name': u'BIOS boot partition', u'device_node': u'/dev/sda1', u'end_mib': u'2', 'idisk_uuid': u'a70ac55d-ebf4-4385-8659-bee35e9bdf97', u'type_guid': u'21686148-6449-6e6f-744e-656564454649', u'size_mib': u'1'} 2019-05-24 14:23:42.760 77301 INFO sysinv.conductor.manager [req-b98ffc2d-4114-4cab-86d0-81cae5cc3167 None None] Partition create on host: 1. Details: {'status': 1, 'forihostid': 1, u'device_path': u'/dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part2', u'start_mib': u'2', u'uuid': u'1eab4df2-55c3-44d8-afac-49269240c971', 'idisk_id': 1, u'type_name': u'Microsoft basic data', u'device_node': u'/dev/sda2', u'end_mib': u'502', 'idisk_uuid': u'a70ac55d-ebf4-4385-8659-bee35e9bdf97', u'type_guid': u'ebd0a0a2-b9e5-4433-87c0-68b6b72699c7', u'size_mib': u'500'} 2019-05-24 14:23:42.778 77301 INFO sysinv.conductor.manager [req-b98ffc2d-4114-4cab-86d0-81cae5cc3167 None None] Partition create on host: 1. Details: {'status': 1, 'forihostid': 1, u'device_path': u'/dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part3', u'start_mib': u'502', u'uuid': u'ae388e11-a8b1-4e12-9802-2c5791c69d35', 'idisk_id': 1, u'type_name': u'Microsoft basic data', u'device_node': u'/dev/sda3', u'end_mib': u'20502', 'idisk_uuid': u'a70ac55d-ebf4-4385-8659-bee35e9bdf97', u'type_guid': u'ebd0a0a2-b9e5-4433-87c0-68b6b72699c7', u'size_mib': u'20000'} 2019-05-24 14:23:42.797 77301 INFO sysinv.conductor.manager [req-b98ffc2d-4114-4cab-86d0-81cae5cc3167 None None] Partition create on host: 1. Details: {'status': 1, 'forihostid': 1, u'device_path': u'/dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part4', u'start_mib': u'20502', u'uuid': u'fd2f0f55-98b3-4283-bedd-f2b7b0df0072', 'idisk_id': 1, u'type_name': u'Linux LVM', u'device_node': u'/dev/sda4', u'end_mib': u'244758', 'idisk_uuid': u'a70ac55d-ebf4-4385-8659-bee35e9bdf97', u'type_guid': u'e6d6d379-f507-44c2-a23c-238f2a3df928', u'size_mib': u'224256'} 2019-05-24 14:23:42.881 77301 INFO sysinv.conductor.manager [req-b98ffc2d-4114-4cab-86d0-81cae5cc3167 None None] Inconsistent Data: Not adding PV: {u'lvm_pe_alloced': 5812, 'forihostid': 1, u'lvm_pe_total': 7007, u'lvm_vg_name': u'cgts-vg', u'lvm_pv_name': u'/dev/sda4', u'lvm_pv_uuid': u'LK2MWw-oe0S-orz6-10rb-eonU-EmXG-8Lik3v', u'lvm_pv_size': 235115905024} 2019-05-24 14:23:42.997 77301 INFO sysinv.conductor.manager [req-b98ffc2d-4114-4cab-86d0-81cae5cc3167 None None] platform_interfaces host_id=1 info_list=[] 2019-05-24 14:23:44.572 70961 INFO sysinv.agent.manager [req-8ec21261-bc69-4678-8b3b-989f3dfac161 admin admin] Agent config applied 002db320-3547-4f4d-8201-56f426799461 2019-05-24 14:23:44.601 70961 INFO sysinv.agent.manager [req-a5484345-03fe-477e-b0e8-c7ed7995de51 admin admin] config_apply_runtime_manifest: 61d0e009-a2e8-4e85-8d59-a701fdc5462b {u'classes': [u'openstack::keystone::endpoint::runtime'], u'force': True, u'personalities': [u'controller'], u'host_uuids': [u'555dd65c-2edd-40fa-8dfd-af34fb4172a0']} controller 2019-05-24 14:23:44.601 70961 INFO sysinv.agent.manager [req-a5484345-03fe-477e-b0e8-c7ed7995de51 admin admin] controller-active 2019-05-24 14:23:44.602 70961 INFO sysinv.agent.manager [req-a5484345-03fe-477e-b0e8-c7ed7995de51 admin admin] _apply_runtime_manifest with hieradata_path = '/opt/platform/puppet/19.01/hieradata' 2019-05-24 14:23:49.083 79794 INFO sysinv.api.controllers.v1.controller_fs [-] _get_controller_cgtsvg_limit cgtsvg0_free_mib=38240, cgtsvg1_free_mib=0 2019-05-24 14:23:49.083 79794 INFO sysinv.api.controllers.v1.controller_fs [-] SYS_I filesystem limits cgtsvg0_free_mib=38240, cgtsvg1_free_mib=0, cgtsvg_max_free_GiB=37 2019-05-24 14:23:49.083 79794 INFO sysinv.api.controllers.v1.controller_fs [-] _check_controller_fs ceph_mon_gib_new = 20 2019-05-24 14:23:49.083 79794 INFO sysinv.api.controllers.v1.controller_fs [-] _check_controller_fs cgtsvg_growth_gib = 20 2019-05-24 14:23:49.084 79794 INFO sysinv.api.controllers.v1.controller_fs [-] _check_controller_fs cgtsvg_max_free_GiB = 37 2019-05-24 14:23:49.885 79794 INFO sysinv.api.controllers.v1.controller_fs [-] _total_size_controller_fs total filesysem size 180 2019-05-24 14:23:49.885 79794 INFO sysinv.api.controllers.v1.controller_fs [-] _check_controller_fs rootfs_configured_size_GiB = 200 2019-05-24 14:23:50.065 79794 INFO sysinv.api.controllers.v1.ceph_mon [-] Creating ceph-mon DB entry for host uuid 555dd65c-2edd-40fa-8dfd-af34fb4172a0: {'forihostid': 1, 'device_path': None, 'uuid': 'f7ca038c-960c-4659-8c5b-1e559f77c1cf', 'ceph_mon_gib': 20, 'created_at': None, 'hostname': None, 'updated_at': None, 'ihost_uuid': u'555dd65c-2edd-40fa-8dfd-af34fb4172a0', 'state': u'configured', 'task': None, 'ceph_mon_dev': None, 'id': None} 2019-05-24 14:23:57.002 79794 INFO sysinv.api.controllers.v1.interface [-] Setting MAC of interface lo to 00:00:00:00:00:00; taken from None 2019-05-24 14:23:57.112 79794 INFO sysinv.api.controllers.v1.interface [-] _update_interface_datanetworks interface= datanetworks=[] pns=[] 2019-05-24 14:25:33.841 70961 INFO sysinv.agent.manager [req-a5484345-03fe-477e-b0e8-c7ed7995de51 admin admin] Runtime manifest apply completed for classes [u'openstack::keystone::endpoint::runtime']. 2019-05-24 14:25:33.841 70961 INFO sysinv.agent.manager [req-a5484345-03fe-477e-b0e8-c7ed7995de51 admin admin] Agent config applied 42c5f43f-7347-46c5-b810-442d72295cd6 2019-05-24 14:29:03.970 70961 INFO sysinv.openstack.common.service [-] Caught SIGTERM, exiting 2019-05-24 14:29:04.249 79723 INFO oslo_service.service [-] Caught SIGTERM, stopping children 2019-05-24 14:29:04.249 79723 INFO oslo.service.wsgi [-] Stopping WSGI server. 2019-05-24 14:29:04.250 79723 INFO oslo_service.service [-] Waiting on 2 children to exit 2019-05-24 14:29:04.253 79794 INFO oslo.service.wsgi [-] Stopping WSGI server. 2019-05-24 14:29:04.256 79795 INFO oslo.service.wsgi [-] Stopping WSGI server. 2019-05-24 14:29:04.270 79723 INFO oslo_service.service [-] Child 79794 exited with status 0 2019-05-24 14:29:04.270 79723 INFO oslo_service.service [-] Child 79795 exited with status 0 2019-05-24 14:29:04.579 108806 INFO sysinv.agent.lldp.manager [-] Configured sysinv LLDP agent drivers: [] 2019-05-24 14:29:04.601 108806 INFO sysinv.agent.lldp.manager [-] Loaded sysinv LLDP agent drivers: [] 2019-05-24 14:29:04.602 108806 INFO sysinv.agent.lldp.manager [-] Registered sysinv LLDP agent drivers: [] 2019-05-24 14:29:04.641 108806 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on localhost:5672 2019-05-24 14:29:04.647 108806 INFO sysinv.agent.manager [-] Sysinv Agent audit running inv_get_and_report. 2019-05-24 14:29:05.574 108806 WARNING sysinv.agent.pci [-] ATTR speed unknown for: eth1000 (flags: 0x1003) 2019-05-24 14:29:05.995 108806 WARNING sysinv.agent.pci [-] Enabling device eth1001 to query link speed 2019-05-24 14:29:06.017 108806 WARNING sysinv.agent.pci [-] ATTR speed unknown for: eth1001 (flags: 0x1002) 2019-05-24 14:29:06.017 108806 WARNING sysinv.agent.pci [-] Disabling device eth1001 after querying link speed 2019-05-24 14:29:06.045 108806 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on localhost:5672 2019-05-24 14:29:06.221 77301 INFO sysinv.conductor.manager [req-ce2cc075-d2aa-45e5-80c2-0331f940ed4e None None] Updating platform data for host: 555dd65c-2edd-40fa-8dfd-af34fb4172a0 with: {u'first_report': True} 2019-05-24 14:29:06.304 108806 INFO sysinv.agent.manager [-] Sysinv Agent platform update by host: {'first_report': True} 2019-05-24 14:29:06.304 108806 INFO sysinv.agent.manager [-] Agent found matching ihost: 555dd65c-2edd-40fa-8dfd-af34fb4172a0 2019-05-24 14:29:06.338 108936 WARNING ceph_client [-] skip checking server certificate 2019-05-24 14:29:06.922 77301 INFO sysinv.conductor.manager [req-ce2cc075-d2aa-45e5-80c2-0331f940ed4e None None] port 7ba07ee5-bc74-4808-9fd6-06c2751057cc update attr: {'sriov_numvfs': 0, 'driver': u'e1000', 'sriov_vfs_pci_address': u'', 'sriov_totalvfs': None, 'dpdksupport': False, 'speed': u'1000'} 2019-05-24 14:29:06.981 108936 WARNING ceph_client [-] skip checking server certificate 2019-05-24 14:29:07.026 108936 WARNING ceph_client [-] skip checking server certificate 2019-05-24 14:29:07.028 108936 WARNING ceph_client [-] skip checking server certificate 2019-05-24 14:29:07.039 108936 WARNING oslo_config.cfg [-] Deprecated: Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S release.). Its value may be silently ignored in the future. 2019-05-24 14:29:07.040 108936 WARNING oslo_config.cfg [-] Deprecated: Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken". 2019-05-24 14:29:07.041 108936 INFO keystonemiddleware.auth_token [-] Starting Keystone auth_token middleware 2019-05-24 14:29:07.052 108936 WARNING keystonemiddleware.auth_token [-] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. 2019-05-24 14:29:07.056 108936 INFO oslo.service.wsgi [-] sysinv_api listening on 192.168.204.2:6385 2019-05-24 14:29:07.065 108936 INFO oslo_service.service [-] Starting 2 workers 2019-05-24 14:29:07.081 77301 INFO sysinv.conductor.manager [req-ce2cc075-d2aa-45e5-80c2-0331f940ed4e None None] port 2947890b-f85a-4baf-8267-0ab34dcf8616 update attr: {'sriov_numvfs': 0, 'driver': u'e1000', 'sriov_vfs_pci_address': u'', 'sriov_totalvfs': None, 'dpdksupport': False, 'speed': u'1000'} 2019-05-24 14:29:07.252 77301 INFO sysinv.conductor.manager [req-ce2cc075-d2aa-45e5-80c2-0331f940ed4e None None] port 6449372a-482f-4b93-b0f7-f7140a7dbd6b update attr: {'sriov_numvfs': 0, 'driver': u'virtio-pci', 'sriov_vfs_pci_address': u'', 'sriov_totalvfs': None, 'dpdksupport': True, 'speed': None} 2019-05-24 14:29:07.555 77301 INFO sysinv.conductor.manager [req-ce2cc075-d2aa-45e5-80c2-0331f940ed4e None None] port 0441c1fc-0631-4b26-8355-3a2c0715d548 update attr: {'sriov_numvfs': 0, 'driver': u'virtio-pci', 'sriov_vfs_pci_address': u'', 'sriov_totalvfs': None, 'dpdksupport': True, 'speed': None} 2019-05-24 14:29:07.652 77301 INFO sysinv.conductor.manager [req-ce2cc075-d2aa-45e5-80c2-0331f940ed4e None None] attr: {'sriov_numvfs': 0, 'driver': u'ata_piix', 'psvendor': u'Red Hat, Inc.', 'pdevice_id': u'7010', 'pclass': u'IDE interface', 'psdevice': u'Qemu virtual machine', 'sriov_vfs_pci_address': u'', 'pvendor': u'Intel Corporation', 'pvendor_id': u'8086', 'pclass_id': u'010180', 'sriov_totalvfs': None} 2019-05-24 14:29:07.692 77301 INFO sysinv.conductor.manager [req-ce2cc075-d2aa-45e5-80c2-0331f940ed4e None None] attr: {'sriov_numvfs': 0, 'driver': u'uhci_hcd', 'psvendor': u'Red Hat, Inc.', 'pdevice_id': u'7020', 'pclass': u'USB controller', 'psdevice': u'QEMU Virtual Machine', 'sriov_vfs_pci_address': u'', 'pvendor': u'Intel Corporation', 'pvendor_id': u'8086', 'pclass_id': u'0c0300', 'sriov_totalvfs': None} 2019-05-24 14:29:07.732 77301 INFO sysinv.conductor.manager [req-ce2cc075-d2aa-45e5-80c2-0331f940ed4e None None] attr: {'sriov_numvfs': 0, 'driver': None, 'psvendor': u'QEMU Virtual Machine', 'pdevice_id': u'00b8', 'pclass': u'VGA compatible controller', 'psdevice': u'QEMU Virtual Machine', 'sriov_vfs_pci_address': u'', 'pvendor': u'Cirrus Logic', 'pvendor_id': u'1013', 'pclass_id': u'030000', 'sriov_totalvfs': None} 2019-05-24 14:29:07.774 77301 INFO sysinv.conductor.manager [req-ce2cc075-d2aa-45e5-80c2-0331f940ed4e None None] attr: {'sriov_numvfs': 0, 'driver': u'virtio-pci', 'psvendor': u'Red Hat, Inc.', 'pdevice_id': u'1002', 'pclass': u'Unclassified device [00ff]', 'psdevice': u'Device 0005', 'sriov_vfs_pci_address': u'', 'pvendor': u'Red Hat, Inc.', 'pvendor_id': u'1af4', 'pclass_id': u'00ff00', 'sriov_totalvfs': None} 2019-05-24 14:29:07.801 77301 INFO sysinv.conductor.manager [req-ce2cc075-d2aa-45e5-80c2-0331f940ed4e None None] attr: {'sriov_numvfs': 0, 'driver': u'ahci', 'psvendor': u'-p01', 'pdevice_id': u'2922', 'pclass': u'SATA controller', 'psdevice': u'Red Hat, Inc.', 'sriov_vfs_pci_address': u'', 'pvendor': u'Intel Corporation', 'pvendor_id': u'8086', 'pclass_id': u'010601', 'sriov_totalvfs': None} 2019-05-24 14:29:07.887 77301 INFO sysinv.conductor.manager [req-ce2cc075-d2aa-45e5-80c2-0331f940ed4e None None] Already in db numa_node=0 mynuma_nodes=[0] 2019-05-24 14:29:07.941 77301 INFO sysinv.conductor.manager [req-ce2cc075-d2aa-45e5-80c2-0331f940ed4e None None] Logical CPU topology: host:controller-0 (controller,worker), sockets:1, cores/socket=6, threads/core=1, reference:current (unchanged) 2019-05-24 14:29:07.941 77301 INFO sysinv.conductor.manager [req-ce2cc075-d2aa-45e5-80c2-0331f940ed4e None None] cpu_id : 0 1 2 3 4 5 2019-05-24 14:29:07.941 77301 INFO sysinv.conductor.manager [req-ce2cc075-d2aa-45e5-80c2-0331f940ed4e None None] socket_id : 0 0 0 0 0 0 2019-05-24 14:29:07.941 77301 INFO sysinv.conductor.manager [req-ce2cc075-d2aa-45e5-80c2-0331f940ed4e None None] core_id : 0 1 2 3 4 5 2019-05-24 14:29:07.942 77301 INFO sysinv.conductor.manager [req-ce2cc075-d2aa-45e5-80c2-0331f940ed4e None None] thread_id : 0 0 0 0 0 0 2019-05-24 14:29:07.955 77301 INFO sysinv.conductor.manager [req-ce2cc075-d2aa-45e5-80c2-0331f940ed4e None None] update_cpu_config, host uuid: (555dd65c-2edd-40fa-8dfd-af34fb4172a0), force: (False) 2019-05-24 14:29:07.985 77301 INFO sysinv.conductor.manager [req-ce2cc075-d2aa-45e5-80c2-0331f940ed4e None None] _config_update_hosts config_uuid=08896fc7-937b-416f-aa6f-c4cd86ddd713 2019-05-24 14:29:07.986 77301 INFO sysinv.conductor.manager [req-ce2cc075-d2aa-45e5-80c2-0331f940ed4e None None] applying runtime manifest config_uuid=08896fc7-937b-416f-aa6f-c4cd86ddd713, classes: ['platform::compute::grub::runtime', 'platform::compute::config::runtime'] 2019-05-24 14:29:10.660 77301 INFO sysinv.agent.rpcapi [req-ce2cc075-d2aa-45e5-80c2-0331f940ed4e None None] config_apply_runtime_manifest: fanout_cast: sending config 08896fc7-937b-416f-aa6f-c4cd86ddd713 {'classes': ['platform::compute::grub::runtime', 'platform::compute::config::runtime'], 'force': False, 'personalities': ['controller', 'worker'], 'host_uuids': [u'555dd65c-2edd-40fa-8dfd-af34fb4172a0']} to agent 2019-05-24 14:29:12.853 77301 INFO sysinv.conductor.manager [req-ce2cc075-d2aa-45e5-80c2-0331f940ed4e None None] platform_interfaces host_id=1 info_list=[] 2019-05-24 14:29:13.962 109089 WARNING keystonemiddleware.auth_token [-] Using the in-process token cache is deprecated as of the 4.2.0 release and may be removed in the 5.0.0 release or the 'O' development cycle. The in-process cache causes inconsistent results and high memory usage. When the feature is removed the auth_token middleware will not cache tokens by default which may result in performance issues. It is recommended to use memcache for the auth_token token cache by setting the memcached_servers option. 2019-05-24 14:29:14.832 108806 INFO sysinv.agent.manager [-] Agent config applied 42c5f43f-7347-46c5-b810-442d72295cd6 2019-05-24 14:29:15.203 109090 WARNING keystonemiddleware.auth_token [-] Using the in-process token cache is deprecated as of the 4.2.0 release and may be removed in the 5.0.0 release or the 'O' development cycle. The in-process cache causes inconsistent results and high memory usage. When the feature is removed the auth_token middleware will not cache tokens by default which may result in performance issues. It is recommended to use memcache for the auth_token token cache by setting the memcached_servers option. 2019-05-24 14:29:16.443 109090 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['uptime', 'task'] 2019-05-24 14:29:23.287 109089 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2019-05-24-14-29-23 patch 2019-05-24 14:29:23.287 109089 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['availability'] 2019-05-24 14:29:23.310 109089 INFO sysinv.api.controllers.v1.host [-] host controller-0 ihost_patch_end_2019-05-24-14-29-23 patch 2019-05-24 14:29:23.358 109090 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2019-05-24-14-29-23 patch 2019-05-24 14:29:23.358 109090 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['subfunction_avail'] 2019-05-24 14:29:23.379 109090 INFO sysinv.api.controllers.v1.host [-] host controller-0 ihost_patch_end_2019-05-24-14-29-23 patch 2019-05-24 14:30:20.502 109089 WARNING wsme.api [-] Client-side error: The loopback interface cannot be changed for an all-in-one simplex system 2019-05-24 14:30:24.005 109090 WARNING sysinv.api.controllers.v1.ntp [-] ntp {'uuid': u'915d5ea0-f343-4344-a026-3a6072d2e2e3', 'created_at': datetime.datetime(2019, 5, 24, 14, 22, 19, 50343, tzinfo=), 'enabled': True, 'updated_at': None, 'ntpservers': u'0.pool.ntp.org,1.pool.ntp.org', 'action': None, 'isystem_uuid': u'4ea30041-b636-4189-89af-e6d74ac0c05d', 'id': 1, 'forisystemid': 1} 2019-05-24 14:30:24.056 109090 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on localhost:5672 2019-05-24 14:30:24.077 77301 INFO sysinv.conductor.manager [req-4c42ac6c-1786-48c8-948a-fc9ddc67f95e admin admin] _config_update_hosts config_uuid=e3708635-b359-4ad6-9d15-f097de2a7f3f 2019-05-24 14:30:34.139 109089 INFO sysinv.api.controllers.v1.interface [-] _update_interface_datanetworks interface={'ifcapabilities': {}, 'ipv4_mode': 'disabled', 'sriov_numvfs': 0, 'used_by': [], 'schedpolicy': None, 'updated_at': None, 'txhashpolicy': None, 'ihost_uuid': u'555dd65c-2edd-40fa-8dfd-af34fb4172a0', 'imtu': 1500, 'uses': [], 'imac': u'52:54:00:52:79:52', 'ipv6_pool': None, 'ipv6_mode': 'disabled', 'id': 3, 'vlan_id': None, 'forihostid': 1, 'iftype': u'ethernet', 'uuid': u'19aa8ac3-4943-4b26-9019-4ee0e2d8b452', 'ipv4_pool': None, 'created_at': datetime.datetime(2019, 5, 24, 14, 23, 38, 479510, tzinfo=), 'vlan_type': None, 'ifclass': u'data', 'networks': [], 'datanetworks': [], 'networktype': u'data', 'ifname': u'data0', 'ports': None, 'aemode': 'active_standby'} datanetworks=[u'physnet0'] pns=[u'physnet0'] 2019-05-24 14:30:36.360 109089 INFO sysinv.api.controllers.v1.interface [-] _update_interface_datanetworks interface={'ifcapabilities': {}, 'ipv4_mode': 'disabled', 'sriov_numvfs': 0, 'used_by': [], 'schedpolicy': None, 'updated_at': None, 'txhashpolicy': None, 'ihost_uuid': u'555dd65c-2edd-40fa-8dfd-af34fb4172a0', 'imtu': 1500, 'uses': [], 'imac': u'52:54:00:58:9d:84', 'ipv6_pool': None, 'ipv6_mode': 'disabled', 'id': 4, 'vlan_id': None, 'forihostid': 1, 'iftype': u'ethernet', 'uuid': u'29bafa4d-b40d-4051-beb9-ef4cd7d54ad6', 'ipv4_pool': None, 'created_at': datetime.datetime(2019, 5, 24, 14, 23, 38, 593610, tzinfo=), 'vlan_type': None, 'ifclass': u'data', 'networks': [], 'datanetworks': [], 'networktype': u'data', 'ifname': u'data1', 'ports': None, 'aemode': 'active_standby'} datanetworks=[u'physnet1'] pns=[u'physnet1'] 2019-05-24 14:30:37.995 109090 INFO sysinv.api.controllers.v1.label [-] patch_data: {'openstack-control-plane': 'enabled'} 2019-05-24 14:30:38.005 77301 INFO sysinv.conductor.manager [req-570b3bb5-9fee-4a00-8107-560219fa4607 admin admin] update_kubernetes_label: label_dict={u'openstack-control-plane': u'enabled'} 2019-05-24 14:30:38.066 109090 INFO sysinv.api.controllers.v1.rest_api [-] PATCH cmd:http://localhost:30001/nfvi-plugins/v1/hosts hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:{"hostname": "controller-0", "uuid": "555dd65c-2edd-40fa-8dfd-af34fb4172a0"} 2019-05-24 14:30:38.067 109090 WARNING sysinv.api.controllers.v1.rest_api [-] URLError Error e= 2019-05-24 14:30:39.399 109089 INFO sysinv.api.controllers.v1.label [-] patch_data: {'openstack-compute-node': 'enabled'} 2019-05-24 14:30:39.437 109089 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on localhost:5672 2019-05-24 14:30:39.441 77301 INFO sysinv.conductor.manager [req-8b019e72-c306-4a42-a222-3cfc653bfaec admin admin] update_kubernetes_label: label_dict={u'openstack-compute-node': u'enabled'} 2019-05-24 14:30:39.476 109089 INFO sysinv.api.controllers.v1.rest_api [-] PATCH cmd:http://localhost:30001/nfvi-plugins/v1/hosts hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:{"hostname": "controller-0", "uuid": "555dd65c-2edd-40fa-8dfd-af34fb4172a0"} 2019-05-24 14:30:39.477 109089 WARNING sysinv.api.controllers.v1.rest_api [-] URLError Error e= 2019-05-24 14:30:40.726 109090 INFO sysinv.api.controllers.v1.label [-] patch_data: {'openvswitch': 'enabled'} 2019-05-24 14:30:40.736 77301 INFO sysinv.conductor.manager [req-9aca58a4-d1da-4088-ac51-f9130a12d80b admin admin] update_kubernetes_label: label_dict={u'openvswitch': u'enabled'} 2019-05-24 14:30:40.769 109090 INFO sysinv.api.controllers.v1.rest_api [-] PATCH cmd:http://localhost:30001/nfvi-plugins/v1/hosts hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:{"hostname": "controller-0", "uuid": "555dd65c-2edd-40fa-8dfd-af34fb4172a0"} 2019-05-24 14:30:40.769 109090 WARNING sysinv.api.controllers.v1.rest_api [-] URLError Error e= 2019-05-24 14:30:42.029 109090 INFO sysinv.api.controllers.v1.label [-] patch_data: {'sriov': 'enabled'} 2019-05-24 14:30:42.039 77301 INFO sysinv.conductor.manager [req-cf92a9a6-b50a-41ac-ba8a-c17351312a65 admin admin] update_kubernetes_label: label_dict={u'sriov': u'enabled'} 2019-05-24 14:30:42.075 109090 INFO sysinv.api.controllers.v1.rest_api [-] PATCH cmd:http://localhost:30001/nfvi-plugins/v1/hosts hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:{"hostname": "controller-0", "uuid": "555dd65c-2edd-40fa-8dfd-af34fb4172a0"} 2019-05-24 14:30:42.076 109090 WARNING sysinv.api.controllers.v1.rest_api [-] URLError Error e= 2019-05-24 14:30:47.208 77301 INFO sysinv.conductor.manager [req-0d53bde4-b976-4f83-b137-95e6c7c4719c admin admin] _config_update_hosts config_uuid=4594d522-106e-43c1-8899-84ace4b1b64c 2019-05-24 14:30:47.208 77301 INFO sysinv.conductor.manager [req-0d53bde4-b976-4f83-b137-95e6c7c4719c admin admin] applying runtime manifest config_uuid=4594d522-106e-43c1-8899-84ace4b1b64c, classes: ['platform::partitions::runtime'] 2019-05-24 14:30:49.164 77301 INFO sysinv.agent.rpcapi [req-0d53bde4-b976-4f83-b137-95e6c7c4719c admin admin] config_apply_runtime_manifest: fanout_cast: sending config 4594d522-106e-43c1-8899-84ace4b1b64c {'force': True, 'host_uuids': u'555dd65c-2edd-40fa-8dfd-af34fb4172a0', 'partition_uuid': u'df9d3a32-04ec-4666-acb6-ba1df5f5c6b0', 'report_status': 'manage_disk_partitions', 'classes': ['platform::partitions::runtime'], 'idisk_uuid': u'a70ac55d-ebf4-4385-8659-bee35e9bdf97', 'personalities': [u'controller']} to agent 2019-05-24 14:30:49.167 108806 INFO sysinv.agent.manager [req-0d53bde4-b976-4f83-b137-95e6c7c4719c admin admin] config_apply_runtime_manifest: 4594d522-106e-43c1-8899-84ace4b1b64c {u'force': True, u'host_uuids': u'555dd65c-2edd-40fa-8dfd-af34fb4172a0', u'partition_uuid': u'df9d3a32-04ec-4666-acb6-ba1df5f5c6b0', u'idisk_uuid': u'a70ac55d-ebf4-4385-8659-bee35e9bdf97', u'classes': [u'platform::partitions::runtime'], u'report_status': u'manage_disk_partitions', u'personalities': [u'controller']} controller 2019-05-24 14:30:49.167 108806 INFO sysinv.agent.manager [req-0d53bde4-b976-4f83-b137-95e6c7c4719c admin admin] controller-active 2019-05-24 14:30:49.167 108806 INFO sysinv.agent.manager [req-0d53bde4-b976-4f83-b137-95e6c7c4719c admin admin] _apply_runtime_manifest with hieradata_path = '/opt/platform/puppet/19.01/hieradata' 2019-05-24 14:30:55.556 115132 INFO manage-partitions [-] Called partition 'check' with 'None' 'None' and '[{"device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part1", "start_mib": 1, "uuid": "2a3c080a-28a0-4251-a916-f958646c1625", "device_node": "/dev/sda1", "disk_device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0", "type_guid": "21686148-6449-6e6f-744e-656564454649", "size_mib": 1}, {"device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part2", "start_mib": 2, "uuid": "1eab4df2-55c3-44d8-afac-49269240c971", "device_node": "/dev/sda2", "disk_device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0", "type_guid": "ebd0a0a2-b9e5-4433-87c0-68b6b72699c7", "size_mib": 500}, {"device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part3", "start_mib": 502, "uuid": "ae388e11-a8b1-4e12-9802-2c5791c69d35", "device_node": "/dev/sda3", "disk_device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0", "type_guid": "ebd0a0a2-b9e5-4433-87c0-68b6b72699c7", "size_mib": 20000}, {"device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part4", "start_mib": 20502, "uuid": "fd2f0f55-98b3-4283-bedd-f2b7b0df0072", "device_node": "/dev/sda4", "disk_device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0", "type_guid": "e6d6d379-f507-44c2-a23c-238f2a3df928", "size_mib": 224256}]' 2019-05-24 14:30:55.557 115132 INFO manage-partitions [-] Executing command: 'udevadm settle -E /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:30:55.561 115132 INFO manage-partitions [-] Executing command: 'parted -s /dev/disk/by-path/pci-0000:00:08.0-ata-1.0 print' 2019-05-24 14:30:55.784 115132 INFO manage-partitions [-] Executing command: 'udevadm settle -E /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:30:55.788 115132 INFO manage-partitions [-] Executing command: 'parted -s /dev/disk/by-path/pci-0000:00:08.0-ata-1.0 print' 2019-05-24 14:30:56.010 115132 INFO manage-partitions [-] Executing command: 'udevadm settle -E /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:30:56.014 115132 INFO manage-partitions [-] Executing command: 'parted -s /dev/disk/by-path/pci-0000:00:08.0-ata-1.0 print' 2019-05-24 14:30:56.234 115132 INFO manage-partitions [-] Executing command: 'udevadm settle -E /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:30:56.242 115132 INFO manage-partitions [-] Executing command: 'parted -s /dev/disk/by-path/pci-0000:00:08.0-ata-1.0 print' 2019-05-24 14:30:56.486 115132 INFO manage-partitions [-] Executing command: 'sgdisk -i 1 /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:30:56.495 115132 INFO manage-partitions [-] Executing command: 'sgdisk -i 2 /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:30:56.505 115132 INFO manage-partitions [-] Executing command: 'sgdisk -i 3 /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:30:56.523 115132 INFO manage-partitions [-] Executing command: 'sgdisk -i 4 /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:30:57.081 116258 INFO manage-partitions [-] Called partition 'create' with 'None' 'None' and '[{"ihost_uuid": "555dd65c-2edd-40fa-8dfd-af34fb4172a0", "disk_device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0", "req_size_mib": 102400, "part_device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part5", "req_guid": "ba5eba11-0000-1111-2222-000000000001", "req_uuid": "df9d3a32-04ec-4666-acb6-ba1df5f5c6b0"}]' 2019-05-24 14:30:57.082 116258 INFO manage-partitions [-] Executing command: 'udevadm settle -E /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:30:57.085 116258 INFO manage-partitions [-] Executing command: 'parted -s /dev/disk/by-path/pci-0000:00:08.0-ata-1.0 print' 2019-05-24 14:30:57.303 116258 INFO manage-partitions [-] Executing command: 'sgdisk -i 5 /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:30:57.314 116258 INFO manage-partitions [-] Executing pipe command: 'parted -s /dev/disk/by-path/pci-0000:00:08.0-ata-1.0 unit mib print free' 2019-05-24 14:30:57.547 116258 INFO manage-partitions [-] Executing pipe command: 'sgdisk -p /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:30:57.662 116258 INFO manage-partitions [-] Executing command: 'blockdev --getss /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:30:57.669 116258 INFO manage-partitions [-] Executing command: 'dd bs=512 if=/dev/zero of=/dev/disk/by-path/pci-0000:00:08.0-ata-1.0 oflag=direct count=34 seek=501264384' 2019-05-24 14:30:57.684 116258 INFO manage-partitions [-] Zero-out beginning of partition. Output: 34+0 records in 34+0 records out 17408 bytes (17 kB) copied, 0.0102987 s, 1.7 MB/s 2019-05-24 14:30:57.685 116258 INFO manage-partitions [-] Executing command: 'dd bs=512 if=/dev/zero of=/dev/disk/by-path/pci-0000:00:08.0-ata-1.0 oflag=direct count=34 seek=710979550' 2019-05-24 14:30:57.717 116258 INFO manage-partitions [-] Zero-out end of partition. Output: 34+0 records in 34+0 records out 17408 bytes (17 kB) copied, 0.0270311 s, 644 kB/s 2019-05-24 14:30:57.718 116258 INFO manage-partitions [-] Partition details: {'sector_size': 512, 'start_in_sectors': 501264384, 'size_in_sectors': 209715200, 'part_end': 710979550, 'disk_node': u'/dev/disk/by-path/pci-0000:00:08.0-ata-1.0'} 2019-05-24 14:30:57.718 116258 INFO manage-partitions [-] Executing command: 'udevadm settle -E /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:30:57.727 116258 INFO manage-partitions [-] Executing command: 'parted -s /dev/disk/by-path/pci-0000:00:08.0-ata-1.0 unit mib mkpart primary 244758 347158' 2019-05-24 14:30:57.855 116258 INFO manage-partitions [-] Executing command: 'sgdisk --typecode=5:ba5eba11-0000-1111-2222-000000000001 --change-name=5:LVM Physical Volume /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:30:58.995 116258 INFO manage-partitions [-] Executing command: 'ls /dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part5' 2019-05-24 14:30:59.302 116258 INFO manage-partitions [-] Executing command: 'ls /dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part5' 2019-05-24 14:30:59.605 116258 INFO manage-partitions [-] Executing command: 'ls /dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part5' 2019-05-24 14:30:59.609 116258 INFO manage-partitions [-] Executing command: 'sgdisk -i 5 /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:30:59.713 116258 INFO manage-partitions [-] Executing command: 'udevadm settle -E /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:30:59.717 116258 INFO manage-partitions [-] Executing pipe command: 'sgdisk -p /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:30:59.825 116258 INFO manage-partitions [-] Executing command: 'blockdev --getss /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:30:59.942 116258 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on localhost:5672 2019-05-24 14:30:59.947 77301 INFO sysinv.conductor.manager [req-20d82642-8f4d-4ebf-a16a-8bc4aceae156 None None] PART updating information for partition df9d3a32-04ec-4666-acb6-ba1df5f5c6b0 on host 555dd65c-2edd-40fa-8dfd-af34fb4172a0 was successful: {u'status': 0, u'device_path': u'/dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part5', u'start_mib': 244758.0, u'uuid': u'df9d3a32-04ec-4666-acb6-ba1df5f5c6b0', u'ihost_uuid': u'555dd65c-2edd-40fa-8dfd-af34fb4172a0', u'type_name': u'LVM Physical Volume', u'available_mib': 267240, u'end_mib': 347158.0, u'type_guid': u'ba5eba11-0000-1111-2222-000000000001', u'size_mib': 102400.0} 2019-05-24 14:31:00.287 108806 INFO sysinv.agent.manager [req-0d53bde4-b976-4f83-b137-95e6c7c4719c admin admin] Runtime manifest apply completed for classes [u'platform::partitions::runtime']. 2019-05-24 14:31:00.300 77301 INFO sysinv.conductor.manager [req-0d53bde4-b976-4f83-b137-95e6c7c4719c admin admin] PART manifest application for partition df9d3a32-04ec-4666-acb6-ba1df5f5c6b0 on host 555dd65c-2edd-40fa-8dfd-af34fb4172a0 was successful 2019-05-24 14:31:00.305 108806 INFO sysinv.agent.manager [req-0d53bde4-b976-4f83-b137-95e6c7c4719c admin admin] Agent config applied 4594d522-106e-43c1-8899-84ace4b1b64c 2019-05-24 14:31:12.436 109089 INFO sysinv.api.controllers.v1.lvg [-] Updated lvg capabilities={'concurrent_disk_operations': 2, 'instance_backing': 'image'} 2019-05-24 14:31:13.917 109089 WARNING wsme.api [-] Client-side error: No disk with id df9d3a32-04ec-4666-acb6-ba1df5f5c6b0 2019-05-24 14:31:15.507 77301 INFO sysinv.conductor.manager [req-d54c7ea2-3fa4-47de-ac66-5c4f05cd3786 admin admin] _config_update_hosts config_uuid=772641d7-a16e-4cc2-bbf1-ccf9981d8dca 2019-05-24 14:31:15.508 77301 INFO sysinv.conductor.manager [req-d54c7ea2-3fa4-47de-ac66-5c4f05cd3786 admin admin] applying runtime manifest config_uuid=772641d7-a16e-4cc2-bbf1-ccf9981d8dca, classes: ['platform::partitions::runtime'] 2019-05-24 14:31:17.422 77301 INFO sysinv.agent.rpcapi [req-d54c7ea2-3fa4-47de-ac66-5c4f05cd3786 admin admin] config_apply_runtime_manifest: fanout_cast: sending config 772641d7-a16e-4cc2-bbf1-ccf9981d8dca {'force': True, 'host_uuids': u'555dd65c-2edd-40fa-8dfd-af34fb4172a0', 'partition_uuid': u'152a2f28-7356-415d-b7cc-efca09ac3513', 'report_status': 'manage_disk_partitions', 'classes': ['platform::partitions::runtime'], 'idisk_uuid': u'a70ac55d-ebf4-4385-8659-bee35e9bdf97', 'personalities': [u'controller']} to agent 2019-05-24 14:31:17.425 108806 INFO sysinv.agent.manager [req-d54c7ea2-3fa4-47de-ac66-5c4f05cd3786 admin admin] config_apply_runtime_manifest: 772641d7-a16e-4cc2-bbf1-ccf9981d8dca {u'force': True, u'host_uuids': u'555dd65c-2edd-40fa-8dfd-af34fb4172a0', u'partition_uuid': u'152a2f28-7356-415d-b7cc-efca09ac3513', u'idisk_uuid': u'a70ac55d-ebf4-4385-8659-bee35e9bdf97', u'classes': [u'platform::partitions::runtime'], u'report_status': u'manage_disk_partitions', u'personalities': [u'controller']} controller 2019-05-24 14:31:17.426 108806 INFO sysinv.agent.manager [req-d54c7ea2-3fa4-47de-ac66-5c4f05cd3786 admin admin] controller-active 2019-05-24 14:31:17.426 108806 INFO sysinv.agent.manager [req-d54c7ea2-3fa4-47de-ac66-5c4f05cd3786 admin admin] _apply_runtime_manifest with hieradata_path = '/opt/platform/puppet/19.01/hieradata' 2019-05-24 14:31:20.027 77301 INFO sysinv.conductor.manager [-] Sending agent update request for host 1 to update (audit_lvg, audit_partition, audit_pv) 2019-05-24 14:31:20.036 77301 INFO sysinv.agent.rpcapi [-] AgentApi.agent_update: fanout_cast: sending update request to agent for: (audit_lvg, audit_partition, audit_pv) 2019-05-24 14:31:23.864 119814 INFO manage-partitions [-] Called partition 'check' with 'None' 'None' and '[{"device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part1", "start_mib": 1, "uuid": "2a3c080a-28a0-4251-a916-f958646c1625", "device_node": "/dev/sda1", "disk_device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0", "type_guid": "21686148-6449-6e6f-744e-656564454649", "size_mib": 1}, {"device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part2", "start_mib": 2, "uuid": "1eab4df2-55c3-44d8-afac-49269240c971", "device_node": "/dev/sda2", "disk_device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0", "type_guid": "ebd0a0a2-b9e5-4433-87c0-68b6b72699c7", "size_mib": 500}, {"device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part3", "start_mib": 502, "uuid": "ae388e11-a8b1-4e12-9802-2c5791c69d35", "device_node": "/dev/sda3", "disk_device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0", "type_guid": "ebd0a0a2-b9e5-4433-87c0-68b6b72699c7", "size_mib": 20000}, {"device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part4", "start_mib": 20502, "uuid": "fd2f0f55-98b3-4283-bedd-f2b7b0df0072", "device_node": "/dev/sda4", "disk_device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0", "type_guid": "e6d6d379-f507-44c2-a23c-238f2a3df928", "size_mib": 224256}, {"device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part5", "start_mib": 244758, "uuid": "df9d3a32-04ec-4666-acb6-ba1df5f5c6b0", "device_node": "/dev/sda5", "disk_device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0", "type_guid": "ba5eba11-0000-1111-2222-000000000001", "size_mib": 102400}]' 2019-05-24 14:31:23.865 119814 INFO manage-partitions [-] Executing command: 'udevadm settle -E /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:31:23.869 119814 INFO manage-partitions [-] Executing command: 'parted -s /dev/disk/by-path/pci-0000:00:08.0-ata-1.0 print' 2019-05-24 14:31:24.107 119814 INFO manage-partitions [-] Executing command: 'udevadm settle -E /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:31:24.110 119814 INFO manage-partitions [-] Executing command: 'parted -s /dev/disk/by-path/pci-0000:00:08.0-ata-1.0 print' 2019-05-24 14:31:24.347 119814 INFO manage-partitions [-] Executing command: 'udevadm settle -E /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:31:24.351 119814 INFO manage-partitions [-] Executing command: 'parted -s /dev/disk/by-path/pci-0000:00:08.0-ata-1.0 print' 2019-05-24 14:31:24.583 119814 INFO manage-partitions [-] Executing command: 'udevadm settle -E /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:31:24.591 119814 INFO manage-partitions [-] Executing command: 'parted -s /dev/disk/by-path/pci-0000:00:08.0-ata-1.0 print' 2019-05-24 14:31:24.844 119814 INFO manage-partitions [-] Executing command: 'udevadm settle -E /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:31:24.852 119814 INFO manage-partitions [-] Executing command: 'parted -s /dev/disk/by-path/pci-0000:00:08.0-ata-1.0 print' 2019-05-24 14:31:25.099 119814 INFO manage-partitions [-] Executing command: 'sgdisk -i 1 /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:31:25.109 119814 INFO manage-partitions [-] Executing command: 'sgdisk -i 2 /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:31:25.118 119814 INFO manage-partitions [-] Executing command: 'sgdisk -i 3 /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:31:25.131 119814 INFO manage-partitions [-] Executing command: 'sgdisk -i 4 /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:31:25.141 119814 INFO manage-partitions [-] Executing command: 'sgdisk -i 5 /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:31:25.721 120969 INFO manage-partitions [-] Called partition 'create' with 'None' 'None' and '[{"ihost_uuid": "555dd65c-2edd-40fa-8dfd-af34fb4172a0", "disk_device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0", "req_size_mib": 20480, "part_device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part6", "req_guid": "ba5eba11-0000-1111-2222-000000000001", "req_uuid": "152a2f28-7356-415d-b7cc-efca09ac3513"}]' 2019-05-24 14:31:25.722 120969 INFO manage-partitions [-] Executing command: 'udevadm settle -E /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:31:25.725 120969 INFO manage-partitions [-] Executing command: 'parted -s /dev/disk/by-path/pci-0000:00:08.0-ata-1.0 print' 2019-05-24 14:31:25.951 120969 INFO manage-partitions [-] Executing command: 'sgdisk -i 6 /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:31:25.963 120969 INFO manage-partitions [-] Executing pipe command: 'parted -s /dev/disk/by-path/pci-0000:00:08.0-ata-1.0 unit mib print free' 2019-05-24 14:31:26.219 120969 INFO manage-partitions [-] Executing pipe command: 'sgdisk -p /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:31:26.338 120969 INFO manage-partitions [-] Executing command: 'blockdev --getss /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:31:26.344 120969 INFO manage-partitions [-] Executing command: 'dd bs=512 if=/dev/zero of=/dev/disk/by-path/pci-0000:00:08.0-ata-1.0 oflag=direct count=34 seek=710979584' 2019-05-24 14:31:26.366 120969 INFO manage-partitions [-] Zero-out beginning of partition. Output: 34+0 records in 34+0 records out 17408 bytes (17 kB) copied, 0.0132276 s, 1.3 MB/s 2019-05-24 14:31:26.367 120969 INFO manage-partitions [-] Executing command: 'dd bs=512 if=/dev/zero of=/dev/disk/by-path/pci-0000:00:08.0-ata-1.0 oflag=direct count=34 seek=752922590' 2019-05-24 14:31:26.392 120969 INFO manage-partitions [-] Zero-out end of partition. Output: 34+0 records in 34+0 records out 17408 bytes (17 kB) copied, 0.0184719 s, 942 kB/s 2019-05-24 14:31:26.392 120969 INFO manage-partitions [-] Partition details: {'sector_size': 512, 'start_in_sectors': 710979584, 'size_in_sectors': 41943040, 'part_end': 752922590, 'disk_node': u'/dev/disk/by-path/pci-0000:00:08.0-ata-1.0'} 2019-05-24 14:31:26.392 120969 INFO manage-partitions [-] Executing command: 'udevadm settle -E /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:31:26.398 120969 INFO manage-partitions [-] Executing command: 'parted -s /dev/disk/by-path/pci-0000:00:08.0-ata-1.0 unit mib mkpart primary 347158 367638' 2019-05-24 14:31:26.529 120969 INFO manage-partitions [-] Executing command: 'sgdisk --typecode=6:ba5eba11-0000-1111-2222-000000000001 --change-name=6:LVM Physical Volume /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:31:27.675 120969 INFO manage-partitions [-] Executing command: 'ls /dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part6' 2019-05-24 14:31:27.979 120969 INFO manage-partitions [-] Executing command: 'ls /dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part6' 2019-05-24 14:31:28.285 120969 INFO manage-partitions [-] Executing command: 'ls /dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part6' 2019-05-24 14:31:28.289 120969 INFO manage-partitions [-] Executing command: 'sgdisk -i 6 /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:31:28.393 120969 INFO manage-partitions [-] Executing command: 'udevadm settle -E /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:31:28.403 120969 INFO manage-partitions [-] Executing pipe command: 'sgdisk -p /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:31:28.510 120969 INFO manage-partitions [-] Executing command: 'blockdev --getss /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:31:28.602 120969 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on localhost:5672 2019-05-24 14:31:28.606 77301 INFO sysinv.conductor.manager [req-9e3f02d8-bc2c-4fdd-a21c-c790729b5569 None None] PART updating information for partition 152a2f28-7356-415d-b7cc-efca09ac3513 on host 555dd65c-2edd-40fa-8dfd-af34fb4172a0 was successful: {u'status': 0, u'device_path': u'/dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part6', u'start_mib': 347158.0, u'uuid': u'152a2f28-7356-415d-b7cc-efca09ac3513', u'ihost_uuid': u'555dd65c-2edd-40fa-8dfd-af34fb4172a0', u'type_name': u'LVM Physical Volume', u'available_mib': 246760, u'end_mib': 367638.0, u'type_guid': u'ba5eba11-0000-1111-2222-000000000001', u'size_mib': 20480.0} 2019-05-24 14:31:28.973 108806 INFO sysinv.agent.manager [req-d54c7ea2-3fa4-47de-ac66-5c4f05cd3786 admin admin] Runtime manifest apply completed for classes [u'platform::partitions::runtime']. 2019-05-24 14:31:28.987 77301 INFO sysinv.conductor.manager [req-d54c7ea2-3fa4-47de-ac66-5c4f05cd3786 admin admin] PART manifest application for partition 152a2f28-7356-415d-b7cc-efca09ac3513 on host 555dd65c-2edd-40fa-8dfd-af34fb4172a0 was successful 2019-05-24 14:31:28.993 108806 INFO sysinv.agent.manager [req-d54c7ea2-3fa4-47de-ac66-5c4f05cd3786 admin admin] Agent config applied 772641d7-a16e-4cc2-bbf1-ccf9981d8dca 2019-05-24 14:31:30.816 77301 INFO sysinv.conductor.manager [req-4fe609d6-7d62-47f6-9a8c-6d86c4324950 None None] PV not found in Agent. uuid: 4ba88c51-5f2c-4279-b36d-24e6288e0211 current state: adding 2019-05-24 14:31:41.081 109090 WARNING wsme.api [-] Client-side error: No disk with id 152a2f28-7356-415d-b7cc-efca09ac3513 2019-05-24 14:31:44.043 77301 INFO sysinv.conductor.manager [req-b7e331a2-e9c6-453e-a6c3-bf44fd4a9f52 admin admin] _config_update_hosts config_uuid=901f3567-6088-4b28-a7bc-35a91a393ff5 2019-05-24 14:31:46.541 109089 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2019-05-24-14-31-46 patch 2019-05-24 14:31:46.541 109089 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['action'] 2019-05-24 14:31:46.554 109089 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost check_unlock_controller 2019-05-24 14:31:46.657 109089 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost check_unlock_worker 2019-05-24 14:31:47.727 109089 INFO sysinv.api.controllers.v1.host [-] Updating mem values of host(controller-0) node(1): {'vm_hugepages_nr_4K': 4394496} 2019-05-24 14:31:48.380 109089 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://192.168.204.2:5491/v1/query_hosts/ hdr:None payload:None 2019-05-24 14:31:48.381 109089 WARNING sysinv.api.controllers.v1.rest_api [-] URLError Error e= 2019-05-24 14:31:48.381 109089 WARNING sysinv.api.controllers.v1.host [-] No response from patch api controller-0 e='NoneType' object has no attribute '__getitem__' 2019-05-24 14:31:48.381 109089 INFO sysinv.api.controllers.v1.host [-] controller-0 _semantic_mtc_check_action unlock 2019-05-24 14:31:48.381 109089 INFO sysinv.api.controllers.v1.host [-] controller-0 action=unlock ihost_val_prenotify: {'ihost_action': 'unlock'} ihost_val: {'ihost_action': 'unlock', 'task': u'Unlocking'} 2019-05-24 14:31:48.381 109089 INFO sysinv.api.controllers.v1.host [-] controller-0 host.update.ihost_val_prenotify {'ihost_action': 'unlock'} 2019-05-24 14:31:48.381 109089 INFO sysinv.api.controllers.v1.host [-] controller-0 action_check action=unlock, notify_vim=False notify_mtce=True rc=True 2019-05-24 14:31:48.381 109089 INFO sysinv.api.controllers.v1.host [-] controller-0 post action_check hostupdate action=unlock notify_vim=False notify_mtc=True skip_notify_mtce=False 2019-05-24 14:31:48.382 109089 INFO sysinv.api.controllers.v1.host [-] controller-0 stage_action unlock 2019-05-24 14:31:48.382 109089 INFO sysinv.api.controllers.v1.host [-] controller-0 _handle_unlock_action 2019-05-24 14:31:48.382 109089 INFO sysinv.api.controllers.v1.host [-] controller-0 Action staged: unlock 2019-05-24 14:31:48.382 109089 INFO sysinv.api.controllers.v1.host [-] controller-0 post action_stage hostupdate action=unlock notify_vim=False notify_mtc=True skip_notify_mtce=False 2019-05-24 14:31:48.382 109089 INFO sysinv.api.controllers.v1.host [-] controller-0 2. delta_handle ['action'] 2019-05-24 14:31:48.382 109089 INFO sysinv.api.controllers.v1.host [-] controller-0 post delta_handle hostupdate action=unlock notify_vim=False notify_mtc=True skip_notify_mtce=False 2019-05-24 14:31:48.382 109089 INFO sysinv.api.controllers.v1.host [-] update ihost_val_prenotify: {'ihost_action': 'unlock'} 2019-05-24 14:31:48.399 109089 INFO sysinv.api.controllers.v1.host [-] controller-0 apply ihost_val {'ihost_action': 'unlock', 'task': u'Unlocking'} 2019-05-24 14:31:48.399 109089 INFO sysinv.api.controllers.v1.host [-] controller-0 Perform configure_ihost. 2019-05-24 14:31:50.717 77301 INFO sysinv.conductor.manager [req-24f78d2f-3a7e-4e02-9ef8-c63451e11c68 admin admin] _config_update_hosts config_uuid=4f82f7a4-bda7-4a97-b8bc-0ad20d24a125 2019-05-24 14:31:50.717 77301 INFO sysinv.conductor.manager [req-24f78d2f-3a7e-4e02-9ef8-c63451e11c68 admin admin] applying runtime manifest config_uuid=cf82f7a4-bda7-4a97-b8bc-0ad20d24a125, classes: ['platform::compute::grub::runtime', 'platform::compute::config::runtime'] 2019-05-24 14:31:52.634 77301 INFO sysinv.agent.rpcapi [req-24f78d2f-3a7e-4e02-9ef8-c63451e11c68 admin admin] config_apply_runtime_manifest: fanout_cast: sending config cf82f7a4-bda7-4a97-b8bc-0ad20d24a125 {'classes': ['platform::compute::grub::runtime', 'platform::compute::config::runtime'], 'force': True, 'personalities': ['controller'], 'host_uuids': [u'555dd65c-2edd-40fa-8dfd-af34fb4172a0']} to agent 2019-05-24 14:31:52.637 108806 INFO sysinv.agent.manager [req-24f78d2f-3a7e-4e02-9ef8-c63451e11c68 admin admin] config_apply_runtime_manifest: cf82f7a4-bda7-4a97-b8bc-0ad20d24a125 {u'classes': [u'platform::compute::grub::runtime', u'platform::compute::config::runtime'], u'force': True, u'personalities': [u'controller'], u'host_uuids': [u'555dd65c-2edd-40fa-8dfd-af34fb4172a0']} controller 2019-05-24 14:31:52.637 108806 INFO sysinv.agent.manager [req-24f78d2f-3a7e-4e02-9ef8-c63451e11c68 admin admin] controller-active 2019-05-24 14:31:52.637 108806 INFO sysinv.agent.manager [req-24f78d2f-3a7e-4e02-9ef8-c63451e11c68 admin admin] _apply_runtime_manifest with hieradata_path = '/opt/platform/puppet/19.01/hieradata' 2019-05-24 14:31:52.659 77301 INFO sysinv.conductor.manager [req-24f78d2f-3a7e-4e02-9ef8-c63451e11c68 admin admin] _config_update_hosts config_uuid=2b13195a-418c-4d7a-9344-ed8058e33f76 2019-05-24 14:31:53.572 109089 INFO sysinv.api.controllers.v1.host [-] controller-0 Action unlock perform notify_mtce 2019-05-24 14:31:53.572 109089 INFO sysinv.api.controllers.v1.mtce_api [-] host_add for controller-0 cmd=http://localhost:2112/v1/hosts/ hdr={'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload={'tboot': u'false', 'ttys_dcd': None, 'subfunctions': u'controller,worker', 'bm_ip': None, 'install_state': None, 'rootfs_device': u'/dev/disk/by-path/pci-0000:00:08.0-ata-1.0', 'bm_username': None, 'operation': 'add', 'serialid': None, 'id': 1, 'vim_progress_status': None, 'console': u'ttyS0,115200', 'uuid': u'555dd65c-2edd-40fa-8dfd-af34fb4172a0', 'mgmt_ip': u'192.168.204.3', 'software_load': u'19.01', 'config_status': None, 'hostname': u'controller-0', 'iscsi_initiator_name': None, 'capabilities': {u'stor_function': u'monitor'}, 'install_output': u'text', 'location': {}, 'availability': u'online', 'invprovision': u'provisioning', 'peer_id': None, 'administrative': u'locked', 'personality': u'controller', 'recordtype': u'standard', 'bm_mac': None, 'mtce_info': None, 'isystem_uuid': u'4ea30041-b636-4189-89af-e6d74ac0c05d', 'boot_device': u'/dev/disk/by-path/pci-0000:00:08.0-ata-1.0', 'install_state_info': None, 'mgmt_mac': u'00:00:00:00:00:00', 'subfunction_oper': u'disabled', 'target_load': u'19.01', 'vsc_controllers': None, 'operational': u'disabled', 'subfunction_avail': u'online', 'action': u'unlock', 'bm_type': None} 2019-05-24 14:31:53.572 109089 INFO sysinv.api.controllers.v1.rest_api [-] POST cmd:http://localhost:2112/v1/hosts/ hdr:{'Content-type': 'application/json', 'User-Agent': 'sysinv/1.0'} payload:{"tboot": "false", "ttys_dcd": null, "subfunctions": "controller,worker", "bm_ip": null, "install_state": null, "rootfs_device": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0", "bm_username": null, "operation": "add", "serialid": null, "id": 1, "vim_progress_status": null, "console": "ttyS0,115200", "uuid": "555dd65c-2edd-40fa-8dfd-af34fb4172a0", "mgmt_ip": "192.168.204.3", "software_load": "19.01", "config_status": null, "hostname": "controller-0", "iscsi_initiator_name": null, "capabilities": {"stor_function": "monitor"}, "install_output": "text", "location": {}, "availability": "online", "invprovision": "provisioning", "peer_id": null, "administrative": "locked", "personality": "controller", "recordtype": "standard", "bm_mac": null, "mtce_info": null, "isystem_uuid": "4ea30041-b636-4189-89af-e6d74ac0c05d", "boot_device": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0", "install_state_info": null, "mgmt_mac": "00:00:00:00:00:00", "subfunction_oper": "disabled", "target_load": "19.01", "vsc_controllers": null, "operational": "disabled", "subfunction_avail": "online", "action": "unlock", "bm_type": null} 2019-05-24 14:31:53.579 109089 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'pass'} 2019-05-24 14:31:53.610 109090 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['uptime', 'task'] 2019-05-24 14:31:53.635 109089 INFO sysinv.api.controllers.v1.host [-] stx-openstack system app not present, skipping re-apply 2019-05-24 14:31:53.635 109089 INFO sysinv.api.controllers.v1.host [-] host controller-0 ihost_patch_end_2019-05-24-14-31-53 patch 2019-05-24 14:31:59.804 108806 INFO sysinv.agent.manager [req-24f78d2f-3a7e-4e02-9ef8-c63451e11c68 admin admin] Runtime manifest apply completed for classes [u'platform::compute::grub::runtime', u'platform::compute::config::runtime']. 2019-05-24 14:31:59.805 108806 INFO sysinv.agent.manager [req-24f78d2f-3a7e-4e02-9ef8-c63451e11c68 admin admin] Agent config applied cf82f7a4-bda7-4a97-b8bc-0ad20d24a125 2019-05-24 14:31:59.843 109089 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2019-05-24-14-31-59 patch 2019-05-24 14:31:59.844 109089 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['subfunction_avail', 'administrative', 'availability'] 2019-05-24 14:31:59.844 109089 INFO sysinv.api.controllers.v1.host [-] controller-0 2. delta_handle ['administrative'] 2019-05-24 14:31:59.844 109089 INFO sysinv.api.controllers.v1.host [-] controller-0 post delta_handle hostupdate action=None notify_vim=False notify_mtc=False skip_notify_mtce=False 2019-05-24 14:31:59.875 109089 INFO sysinv.api.controllers.v1.host [-] host controller-0 ihost_patch_end_2019-05-24-14-31-59 patch 2019-05-24 14:31:59.898 109089 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['uptime', 'task'] 2019-05-24 14:32:20.005 77301 INFO sysinv.conductor.manager [-] Sending agent update request for host 1 to update (audit_lvg, audit_pv) 2019-05-24 14:32:20.011 77301 INFO sysinv.agent.rpcapi [-] AgentApi.agent_update: fanout_cast: sending update request to agent for: (audit_lvg, audit_pv) 2019-05-24 14:32:21.841 77301 INFO sysinv.conductor.manager [req-68d4d036-53b0-4f4e-95a1-5f123dc04706 None None] PV not found in Agent. uuid: 4ba88c51-5f2c-4279-b36d-24e6288e0211 current state: adding 2019-05-24 14:32:21.841 77301 INFO sysinv.conductor.manager [req-68d4d036-53b0-4f4e-95a1-5f123dc04706 None None] PV not found in Agent. uuid: e4b502f5-2a22-403e-84b3-55aa736fe773 current state: adding 2019-05-24 14:32:30.727 109089 INFO oslo_service.service [-] Child caught SIGHUP, exiting 2019-05-24 14:32:30.729 109090 INFO oslo_service.service [-] Child caught SIGHUP, exiting 2019-05-24 14:32:30.731 109090 INFO oslo.service.wsgi [-] Stopping WSGI server. 2019-05-24 14:32:30.745 109089 INFO oslo.service.wsgi [-] Stopping WSGI server. 2019-05-24 14:32:30.758 108936 INFO oslo_service.service [-] Caught SIGTERM, stopping children 2019-05-24 14:32:30.759 108936 INFO oslo.service.wsgi [-] Stopping WSGI server. 2019-05-24 14:32:30.759 108936 INFO oslo_service.service [-] Waiting on 2 children to exit 2019-05-24 14:32:30.763 109090 INFO oslo.service.wsgi [-] Stopping WSGI server. 2019-05-24 14:32:30.767 109089 INFO oslo.service.wsgi [-] Stopping WSGI server. 2019-05-24 14:32:30.807 108936 INFO oslo_service.service [-] Child 109089 exited with status 0 2019-05-24 14:32:30.807 108936 INFO oslo_service.service [-] Child 109090 exited with status 0 2019-05-24 14:32:32.503 77301 INFO sysinv.openstack.common.service [-] Caught SIGTERM, exiting 2019-05-24 14:32:34.569 108806 ERROR sysinv.openstack.common.rpc.common [-] Failed to consume message from queue: Socket closed 2019-05-24 14:32:34.569 108806 TRACE sysinv.openstack.common.rpc.common Traceback (most recent call last): 2019-05-24 14:32:34.569 108806 TRACE sysinv.openstack.common.rpc.common File "/usr/lib64/python2.7/site-packages/sysinv/openstack/common/rpc/impl_kombu.py", line 564, in ensure 2019-05-24 14:32:34.569 108806 TRACE sysinv.openstack.common.rpc.common return method(*args, **kwargs) 2019-05-24 14:32:34.569 108806 TRACE sysinv.openstack.common.rpc.common File "/usr/lib64/python2.7/site-packages/sysinv/openstack/common/rpc/impl_kombu.py", line 644, in _consume 2019-05-24 14:32:34.569 108806 TRACE sysinv.openstack.common.rpc.common return self.connection.drain_events(timeout=timeout) 2019-05-24 14:32:34.569 108806 TRACE sysinv.openstack.common.rpc.common File "/usr/lib/python2.7/site-packages/kombu/connection.py", line 301, in drain_events 2019-05-24 14:32:34.569 108806 TRACE sysinv.openstack.common.rpc.common return self.transport.drain_events(self.connection, **kwargs) 2019-05-24 14:32:34.569 108806 TRACE sysinv.openstack.common.rpc.common File "/usr/lib/python2.7/site-packages/kombu/transport/pyamqp.py", line 103, in drain_events 2019-05-24 14:32:34.569 108806 TRACE sysinv.openstack.common.rpc.common return connection.drain_events(**kwargs) 2019-05-24 14:32:34.569 108806 TRACE sysinv.openstack.common.rpc.common File "/usr/lib/python2.7/site-packages/amqp/connection.py", line 464, in drain_events 2019-05-24 14:32:34.569 108806 TRACE sysinv.openstack.common.rpc.common return self.blocking_read(timeout) 2019-05-24 14:32:34.569 108806 TRACE sysinv.openstack.common.rpc.common File "/usr/lib/python2.7/site-packages/amqp/connection.py", line 468, in blocking_read 2019-05-24 14:32:34.569 108806 TRACE sysinv.openstack.common.rpc.common frame = self.transport.read_frame() 2019-05-24 14:32:34.569 108806 TRACE sysinv.openstack.common.rpc.common File "/usr/lib/python2.7/site-packages/amqp/transport.py", line 269, in read_frame 2019-05-24 14:32:34.569 108806 TRACE sysinv.openstack.common.rpc.common frame_header = read(7, True) 2019-05-24 14:32:34.569 108806 TRACE sysinv.openstack.common.rpc.common File "/usr/lib/python2.7/site-packages/amqp/transport.py", line 417, in _read 2019-05-24 14:32:34.569 108806 TRACE sysinv.openstack.common.rpc.common raise IOError('Socket closed') 2019-05-24 14:32:34.569 108806 TRACE sysinv.openstack.common.rpc.common IOError: Socket closed 2019-05-24 14:32:34.569 108806 TRACE sysinv.openstack.common.rpc.common 2019-05-24 14:32:34.571 108806 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 2019-05-24 14:32:34.577 108806 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds. 2019-05-24 14:32:35.578 108806 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 2019-05-24 14:32:35.586 108806 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 3 seconds. 2019-05-24 14:32:38.330 108806 INFO sysinv.openstack.common.service [-] Caught SIGTERM, exiting 2019-05-24 14:36:13.420 11486 INFO sysinv.agent.lldp.manager [-] Configured sysinv LLDP agent drivers: [] 2019-05-24 14:36:13.443 11486 INFO sysinv.agent.lldp.manager [-] Loaded sysinv LLDP agent drivers: [] 2019-05-24 14:36:13.443 11486 INFO sysinv.agent.lldp.manager [-] Registered sysinv LLDP agent drivers: [] 2019-05-24 14:36:13.571 11486 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds. 2019-05-24 14:36:14.572 11486 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 2019-05-24 14:36:14.577 11486 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 3 seconds. 2019-05-24 14:36:17.580 11486 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 2019-05-24 14:36:17.584 11486 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 5 seconds. 2019-05-24 14:36:22.587 11486 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 2019-05-24 14:36:22.591 11486 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 7 seconds. 2019-05-24 14:36:29.593 11486 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 2019-05-24 14:36:29.597 11486 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 9 seconds. 2019-05-24 14:36:38.601 11486 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 2019-05-24 14:36:38.606 11486 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 11 seconds. 2019-05-24 14:36:49.613 11486 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 2019-05-24 14:36:49.617 11486 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 13 seconds. 2019-05-24 14:37:02.626 11486 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 2019-05-24 14:37:02.649 11486 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 15 seconds. 2019-05-24 14:37:13.958 80396 INFO manage-partitions [-] Called partition 'check' with 'None' 'None' and '[{"device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part1", "start_mib": 1, "uuid": "2a3c080a-28a0-4251-a916-f958646c1625", "device_node": "/dev/sda1", "disk_device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0", "type_guid": "21686148-6449-6e6f-744e-656564454649", "size_mib": 1}, {"device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part2", "start_mib": 2, "uuid": "1eab4df2-55c3-44d8-afac-49269240c971", "device_node": "/dev/sda2", "disk_device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0", "type_guid": "ebd0a0a2-b9e5-4433-87c0-68b6b72699c7", "size_mib": 500}, {"device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part3", "start_mib": 502, "uuid": "ae388e11-a8b1-4e12-9802-2c5791c69d35", "device_node": "/dev/sda3", "disk_device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0", "type_guid": "ebd0a0a2-b9e5-4433-87c0-68b6b72699c7", "size_mib": 20000}, {"device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part4", "start_mib": 20502, "uuid": "fd2f0f55-98b3-4283-bedd-f2b7b0df0072", "device_node": "/dev/sda4", "disk_device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0", "type_guid": "e6d6d379-f507-44c2-a23c-238f2a3df928", "size_mib": 224256}, {"device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part5", "start_mib": 244758, "uuid": "df9d3a32-04ec-4666-acb6-ba1df5f5c6b0", "device_node": "/dev/sda5", "disk_device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0", "type_guid": "ba5eba11-0000-1111-2222-000000000001", "size_mib": 102400}, {"device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part6", "start_mib": 347158, "uuid": "152a2f28-7356-415d-b7cc-efca09ac3513", "device_node": "/dev/sda6", "disk_device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0", "type_guid": "ba5eba11-0000-1111-2222-000000000001", "size_mib": 20480}]' 2019-05-24 14:37:13.958 80396 INFO manage-partitions [-] Executing command: 'udevadm settle -E /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:37:13.961 80396 INFO manage-partitions [-] Executing command: 'parted -s /dev/disk/by-path/pci-0000:00:08.0-ata-1.0 print' 2019-05-24 14:37:14.181 80396 INFO manage-partitions [-] Executing command: 'udevadm settle -E /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:37:14.187 80396 INFO manage-partitions [-] Executing command: 'parted -s /dev/disk/by-path/pci-0000:00:08.0-ata-1.0 print' 2019-05-24 14:37:14.427 80396 INFO manage-partitions [-] Executing command: 'udevadm settle -E /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:37:14.433 80396 INFO manage-partitions [-] Executing command: 'parted -s /dev/disk/by-path/pci-0000:00:08.0-ata-1.0 print' 2019-05-24 14:37:14.681 80396 INFO manage-partitions [-] Executing command: 'udevadm settle -E /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:37:14.689 80396 INFO manage-partitions [-] Executing command: 'parted -s /dev/disk/by-path/pci-0000:00:08.0-ata-1.0 print' 2019-05-24 14:37:14.924 80396 INFO manage-partitions [-] Executing command: 'udevadm settle -E /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:37:14.930 80396 INFO manage-partitions [-] Executing command: 'parted -s /dev/disk/by-path/pci-0000:00:08.0-ata-1.0 print' 2019-05-24 14:37:15.173 80396 INFO manage-partitions [-] Executing command: 'udevadm settle -E /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:37:15.177 80396 INFO manage-partitions [-] Executing command: 'parted -s /dev/disk/by-path/pci-0000:00:08.0-ata-1.0 print' 2019-05-24 14:37:15.402 80396 INFO manage-partitions [-] Executing command: 'sgdisk -i 1 /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:37:15.410 80396 INFO manage-partitions [-] Executing command: 'sgdisk -i 2 /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:37:15.417 80396 INFO manage-partitions [-] Executing command: 'sgdisk -i 3 /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:37:15.430 80396 INFO manage-partitions [-] Executing command: 'sgdisk -i 4 /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:37:15.438 80396 INFO manage-partitions [-] Executing command: 'sgdisk -i 5 /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:37:15.446 80396 INFO manage-partitions [-] Executing command: 'sgdisk -i 6 /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:37:17.660 11486 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 2019-05-24 14:37:17.664 11486 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 17 seconds. 2019-05-24 14:37:34.676 11486 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 2019-05-24 14:37:34.681 11486 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 19 seconds. 2019-05-24 14:37:53.689 11486 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 2019-05-24 14:37:53.693 11486 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 21 seconds. 2019-05-24 14:38:14.709 11486 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 2019-05-24 14:38:14.714 11486 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 23 seconds. 2019-05-24 14:38:37.732 11486 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 2019-05-24 14:38:37.736 11486 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 25 seconds. 2019-05-24 14:39:02.757 11486 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 2019-05-24 14:39:02.761 11486 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 27 seconds. 2019-05-24 14:39:29.783 11486 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 2019-05-24 14:39:29.788 11486 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 29 seconds. 2019-05-24 14:39:58.812 11486 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 2019-05-24 14:39:58.817 11486 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds. 2019-05-24 14:40:28.842 11486 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 2019-05-24 14:40:28.848 11486 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds. 2019-05-24 14:40:58.861 11486 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 2019-05-24 14:40:58.865 11486 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds. 2019-05-24 14:41:28.891 11486 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 2019-05-24 14:41:28.898 11486 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds. 2019-05-24 14:41:58.906 11486 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 2019-05-24 14:41:58.917 11486 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds. 2019-05-24 14:42:28.936 11486 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 2019-05-24 14:42:28.941 11486 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds. 2019-05-24 14:42:58.966 11486 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on localhost:5672 2019-05-24 14:42:58.977 11486 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds. 2019-05-24 14:43:24.520 11486 INFO sysinv.openstack.common.service [-] Caught SIGTERM, exiting 2019-05-24 14:43:25.081 92126 INFO sysinv.agent.lldp.manager [-] Configured sysinv LLDP agent drivers: ['lldpd'] 2019-05-24 14:43:25.117 92126 INFO sysinv.agent.lldp.manager [-] Loaded sysinv LLDP agent drivers: ['lldpd'] 2019-05-24 14:43:25.117 92126 INFO sysinv.agent.lldp.manager [-] Registered sysinv LLDP agent drivers: ['lldpd'] 2019-05-24 14:43:25.163 92126 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on 192.168.204.2:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds. 2019-05-24 14:43:26.166 92126 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on 192.168.204.2:5672 2019-05-24 14:43:26.170 92126 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on 192.168.204.2:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 3 seconds. 2019-05-24 14:43:29.174 92126 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on 192.168.204.2:5672 2019-05-24 14:43:29.178 92126 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on 192.168.204.2:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 5 seconds. 2019-05-24 14:43:34.181 92126 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on 192.168.204.2:5672 2019-05-24 14:43:34.185 92126 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on 192.168.204.2:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 7 seconds. 2019-05-24 14:43:41.188 92126 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on 192.168.204.2:5672 2019-05-24 14:43:41.193 92126 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on 192.168.204.2:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 9 seconds. 2019-05-24 14:43:50.198 92126 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on 192.168.204.2:5672 2019-05-24 14:43:50.205 92126 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on 192.168.204.2:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 11 seconds. 2019-05-24 14:44:01.212 92126 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on 192.168.204.2:5672 2019-05-24 14:44:01.216 92126 ERROR sysinv.openstack.common.rpc.common [-] AMQP server on 192.168.204.2:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 13 seconds. 2019-05-24 14:44:07.646 101984 WARNING ceph_client [-] skip checking server certificate 2019-05-24 14:44:09.283 101984 WARNING ceph_client [-] skip checking server certificate 2019-05-24 14:44:09.346 101984 WARNING ceph_client [-] skip checking server certificate 2019-05-24 14:44:09.347 101984 WARNING ceph_client [-] skip checking server certificate 2019-05-24 14:44:09.355 101984 WARNING oslo_config.cfg [-] Deprecated: Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S release.). Its value may be silently ignored in the future. 2019-05-24 14:44:09.356 101984 WARNING oslo_config.cfg [-] Deprecated: Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken". 2019-05-24 14:44:09.358 101984 INFO keystonemiddleware.auth_token [-] Starting Keystone auth_token middleware 2019-05-24 14:44:09.363 101984 WARNING keystonemiddleware.auth_token [-] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. 2019-05-24 14:44:09.366 101984 INFO oslo.service.wsgi [-] sysinv_api listening on 192.168.204.2:6385 2019-05-24 14:44:09.366 101984 INFO oslo_service.service [-] Starting 1 workers 2019-05-24 14:44:09.371 101984 INFO keystonemiddleware.auth_token [-] Starting Keystone auth_token middleware 2019-05-24 14:44:09.376 101984 WARNING keystonemiddleware._common.config [-] The option "user_domain_name" in conf is not known to auth_token 2019-05-24 14:44:09.376 101984 WARNING keystonemiddleware._common.config [-] The option "auth_url" in conf is not known to auth_token 2019-05-24 14:44:09.376 101984 WARNING keystonemiddleware._common.config [-] The option "project_domain_name" in conf is not known to auth_token 2019-05-24 14:44:09.376 101984 WARNING keystonemiddleware._common.config [-] The option "username" in conf is not known to auth_token 2019-05-24 14:44:09.377 101984 WARNING keystonemiddleware._common.config [-] The option "project_name" in conf is not known to auth_token 2019-05-24 14:44:09.377 101984 WARNING keystonemiddleware._common.config [-] The option "password" in conf is not known to auth_token 2019-05-24 14:44:09.378 101984 WARNING keystonemiddleware.auth_token [-] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. 2019-05-24 14:44:09.381 101984 INFO oslo.service.wsgi [-] sysinv_api_pxe listening on 169.254.202.2:6385 2019-05-24 14:44:09.381 101984 INFO oslo_service.service [-] Starting 1 workers 2019-05-24 14:44:10.761 101665 WARNING ceph_client [-] skip checking server certificate 2019-05-24 14:44:10.870 102873 WARNING keystonemiddleware.auth_token [-] Using the in-process token cache is deprecated as of the 4.2.0 release and may be removed in the 5.0.0 release or the 'O' development cycle. The in-process cache causes inconsistent results and high memory usage. When the feature is removed the auth_token middleware will not cache tokens by default which may result in performance issues. It is recommended to use memcache for the auth_token token cache by setting the memcached_servers option. 2019-05-24 14:44:12.196 101665 ERROR stevedore.extension [-] Could not load 'platform-integ-apps': No module named systemconfig.helm_plugins.platform_integ_apps 2019-05-24 14:44:12.196 101665 ERROR stevedore.extension [-] Could not load 'stx-openstack': No module named systemconfig.helm_plugins.stx_openstack 2019-05-24 14:44:12.233 101665 WARNING ceph_client [-] skip checking server certificate 2019-05-24 14:44:12.737 101665 WARNING sysinv.conductor.ceph [-] ceph_api.fsid failed: Failed to get ceph-mgr restful plugin credentials for user: admin 2019-05-24 14:44:12.764 101665 ERROR stevedore.extension [-] Could not load 'platform-integ-apps': No module named systemconfig.helm_plugins.platform_integ_apps 2019-05-24 14:44:12.764 101665 ERROR stevedore.extension [-] Could not load 'stx-openstack': No module named systemconfig.helm_plugins.stx_openstack 2019-05-24 14:44:13.531 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['uptime', 'task'] 2019-05-24 14:44:13.673 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2019-05-24-14-44-13 patch 2019-05-24 14:44:13.673 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_end. No changes from mtce/1.0. 2019-05-24 14:44:14.159 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2019-05-24-14-44-14 patch 2019-05-24 14:44:14.159 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['availability'] 2019-05-24 14:44:14.184 102873 INFO sysinv.api.controllers.v1.host [-] host controller-0 ihost_patch_end_2019-05-24-14-44-14 patch 2019-05-24 14:44:14.224 92126 INFO sysinv.openstack.common.rpc.common [-] Reconnecting to AMQP server on 192.168.204.2:5672 2019-05-24 14:44:14.242 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['uptime', 'task'] 2019-05-24 14:44:14.246 92126 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on 192.168.204.2:5672 2019-05-24 14:44:14.264 92126 INFO sysinv.agent.manager [-] Sysinv Agent audit running inv_get_and_report. 2019-05-24 14:44:15.022 92126 WARNING sysinv.agent.pci [-] Enabling device ens4 to query link speed 2019-05-24 14:44:15.025 92126 WARNING sysinv.agent.pci [-] ATTR speed unknown for: ens4 (flags: 0x1002) 2019-05-24 14:44:15.025 92126 WARNING sysinv.agent.pci [-] Disabling device ens4 after querying link speed 2019-05-24 14:44:15.386 92126 WARNING sysinv.agent.pci [-] Enabling device eth1000 to query link speed 2019-05-24 14:44:15.394 92126 WARNING sysinv.agent.pci [-] ATTR speed unknown for: eth1000 (flags: 0x1002) 2019-05-24 14:44:15.394 92126 WARNING sysinv.agent.pci [-] Disabling device eth1000 after querying link speed 2019-05-24 14:44:15.752 92126 WARNING sysinv.agent.pci [-] Enabling device eth1001 to query link speed 2019-05-24 14:44:15.757 92126 WARNING sysinv.agent.pci [-] ATTR speed unknown for: eth1001 (flags: 0x1002) 2019-05-24 14:44:15.757 92126 WARNING sysinv.agent.pci [-] Disabling device eth1001 after querying link speed 2019-05-24 14:44:15.796 92126 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on 192.168.204.2:5672 2019-05-24 14:44:19.452 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['uptime', 'task'] 2019-05-24 14:44:19.618 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['uptime', 'task'] 2019-05-24 14:44:20.156 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['uptime', 'task'] 2019-05-24 14:44:20.229 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2019-05-24-14-44-20 patch 2019-05-24 14:44:20.229 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['availability', 'operational'] 2019-05-24 14:44:20.230 102873 INFO sysinv.api.controllers.v1.host [-] stage_administrative_update: provisioned 2019-05-24 14:44:20.230 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 apply ihost_val {'invprovision': 'provisioned'} 2019-05-24 14:44:20.317 102873 INFO sysinv.api.controllers.v1.host [-] host controller-0 ihost_patch_end_2019-05-24-14-44-20 patch 2019-05-24 14:44:20.375 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['uptime', 'task'] 2019-05-24 14:44:24.048 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2019-05-24-14-44-24 patch 2019-05-24 14:44:24.049 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['availability'] 2019-05-24 14:44:24.126 102873 INFO sysinv.api.controllers.v1.host [-] host controller-0 ihost_patch_end_2019-05-24-14-44-24 patch 2019-05-24 14:44:33.145 118219 INFO manage-partitions [-] Called partition 'check' with 'None' 'None' and '[{"device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part1", "start_mib": 1, "uuid": "2a3c080a-28a0-4251-a916-f958646c1625", "device_node": "/dev/sda1", "disk_device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0", "type_guid": "21686148-6449-6e6f-744e-656564454649", "size_mib": 1}, {"device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part2", "start_mib": 2, "uuid": "1eab4df2-55c3-44d8-afac-49269240c971", "device_node": "/dev/sda2", "disk_device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0", "type_guid": "ebd0a0a2-b9e5-4433-87c0-68b6b72699c7", "size_mib": 500}, {"device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part3", "start_mib": 502, "uuid": "ae388e11-a8b1-4e12-9802-2c5791c69d35", "device_node": "/dev/sda3", "disk_device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0", "type_guid": "ebd0a0a2-b9e5-4433-87c0-68b6b72699c7", "size_mib": 20000}, {"device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part4", "start_mib": 20502, "uuid": "fd2f0f55-98b3-4283-bedd-f2b7b0df0072", "device_node": "/dev/sda4", "disk_device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0", "type_guid": "e6d6d379-f507-44c2-a23c-238f2a3df928", "size_mib": 224256}, {"device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part5", "start_mib": 244758, "uuid": "df9d3a32-04ec-4666-acb6-ba1df5f5c6b0", "device_node": "/dev/sda5", "disk_device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0", "type_guid": "ba5eba11-0000-1111-2222-000000000001", "size_mib": 102400}, {"device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0-part6", "start_mib": 347158, "uuid": "152a2f28-7356-415d-b7cc-efca09ac3513", "device_node": "/dev/sda6", "disk_device_path": "/dev/disk/by-path/pci-0000:00:08.0-ata-1.0", "type_guid": "ba5eba11-0000-1111-2222-000000000001", "size_mib": 20480}]' 2019-05-24 14:44:33.145 118219 INFO manage-partitions [-] Executing command: 'udevadm settle -E /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:44:33.148 118219 INFO manage-partitions [-] Executing command: 'parted -s /dev/disk/by-path/pci-0000:00:08.0-ata-1.0 print' 2019-05-24 14:44:33.380 118219 INFO manage-partitions [-] Executing command: 'udevadm settle -E /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:44:33.387 118219 INFO manage-partitions [-] Executing command: 'parted -s /dev/disk/by-path/pci-0000:00:08.0-ata-1.0 print' 2019-05-24 14:44:33.634 118219 INFO manage-partitions [-] Executing command: 'udevadm settle -E /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:44:33.642 118219 INFO manage-partitions [-] Executing command: 'parted -s /dev/disk/by-path/pci-0000:00:08.0-ata-1.0 print' 2019-05-24 14:44:33.899 118219 INFO manage-partitions [-] Executing command: 'udevadm settle -E /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:44:33.906 118219 INFO manage-partitions [-] Executing command: 'parted -s /dev/disk/by-path/pci-0000:00:08.0-ata-1.0 print' 2019-05-24 14:44:34.146 118219 INFO manage-partitions [-] Executing command: 'udevadm settle -E /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:44:34.149 118219 INFO manage-partitions [-] Executing command: 'parted -s /dev/disk/by-path/pci-0000:00:08.0-ata-1.0 print' 2019-05-24 14:44:34.420 118219 INFO manage-partitions [-] Executing command: 'udevadm settle -E /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:44:34.423 118219 INFO manage-partitions [-] Executing command: 'parted -s /dev/disk/by-path/pci-0000:00:08.0-ata-1.0 print' 2019-05-24 14:44:34.671 118219 INFO manage-partitions [-] Executing command: 'sgdisk -i 1 /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:44:34.676 118219 INFO manage-partitions [-] Executing command: 'sgdisk -i 2 /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:44:34.680 118219 INFO manage-partitions [-] Executing command: 'sgdisk -i 3 /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:44:34.683 118219 INFO manage-partitions [-] Executing command: 'sgdisk -i 4 /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:44:34.686 118219 INFO manage-partitions [-] Executing command: 'sgdisk -i 5 /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:44:34.700 118219 INFO manage-partitions [-] Executing command: 'sgdisk -i 6 /dev/disk/by-path/pci-0000:00:08.0-ata-1.0' 2019-05-24 14:44:58.628 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2019-05-24-14-44-58 patch 2019-05-24 14:44:58.629 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['action'] 2019-05-24 14:44:58.629 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 Pending update_vim_progress_status services-disabled 2019-05-24 14:44:58.629 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 action=services-disabled ihost_val_prenotify: {} ihost_val: {} 2019-05-24 14:44:58.629 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 action_check action=services-disabled, notify_vim=False notify_mtce=True rc=True 2019-05-24 14:44:58.629 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 post action_check hostupdate action=services-disabled notify_vim=False notify_mtc=True skip_notify_mtce=False 2019-05-24 14:44:58.629 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 stage_action services-disabled 2019-05-24 14:44:58.629 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 _handle_vim_services_disabled' 2019-05-24 14:44:58.629 102873 WARNING sysinv.api.controllers.v1.host [-] controller-0 Admin action task not Locking or Force Locking upon receipt of 'services-disabled'. 2019-05-24 14:44:58.629 102873 WARNING sysinv.api.controllers.v1.host [-] controller-0 Exit _handle_vim_services_disabled 2019-05-24 14:44:58.630 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 stage_action aborting request services-disabled ['action'] 2019-05-24 14:44:58.630 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_end stage_action rc exit_return_host 2019-05-24 14:45:15.865 92126 INFO sysinv.agent.manager [-] get_ihost_by_macs rpc Timeout. 2019-05-24 14:45:15.880 92126 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on 192.168.204.2:5672 2019-05-24 14:45:26.483 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['uptime', 'task'] 2019-05-24 14:45:26.609 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2019-05-24-14-45-26 patch 2019-05-24 14:45:26.609 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['subfunction_oper', 'subfunction_avail'] 2019-05-24 14:45:26.673 102873 INFO sysinv.api.controllers.v1.host [-] host controller-0 ihost_patch_end_2019-05-24-14-45-26 patch 2019-05-24 14:45:26.734 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2019-05-24-14-45-26 patch 2019-05-24 14:45:26.735 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_end. No changes from mtce/1.0. 2019-05-24 14:45:27.123 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2019-05-24-14-45-27 patch 2019-05-24 14:45:27.123 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['action'] 2019-05-24 14:45:27.123 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 Pending update_vim_progress_status services-enabled 2019-05-24 14:45:27.123 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 action=services-enabled ihost_val_prenotify: {} ihost_val: {} 2019-05-24 14:45:27.123 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 action_check action=services-enabled, notify_vim=False notify_mtce=False rc=True 2019-05-24 14:45:27.124 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 post action_check hostupdate action=services-enabled notify_vim=False notify_mtc=False skip_notify_mtce=False 2019-05-24 14:45:27.124 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 stage_action services-enabled 2019-05-24 14:45:27.124 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 received services-enabled task= vim_progress_status= 2019-05-24 14:45:27.124 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 Action staged: services-enabled 2019-05-24 14:45:27.124 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 post action_stage hostupdate action=services-enabled notify_vim=False notify_mtc=False skip_notify_mtce=True 2019-05-24 14:45:27.124 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 2. delta_handle ['action'] 2019-05-24 14:45:27.124 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 post delta_handle hostupdate action=services-enabled notify_vim=False notify_mtc=False skip_notify_mtce=True 2019-05-24 14:45:27.124 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 apply ihost_val {'vim_progress_status': 'services-enabled'} 2019-05-24 14:45:27.203 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 notify_availability=services-enabled 2019-05-24 14:45:27.236 102873 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on 192.168.204.2:5672 2019-05-24 14:46:15.944 92126 INFO sysinv.agent.manager [-] ilvg_get_nova_ilvg_by_ihost() Timeout. 2019-05-24 14:46:15.944 92126 WARNING sysinv.openstack.common.loopingcall [-] task run outlasted interval by 61.681121 sec 2019-05-24 14:46:15.945 92126 INFO sysinv.agent.manager [-] Sysinv Agent audit running inv_get_and_report. 2019-05-24 14:46:16.445 92126 WARNING sysinv.agent.pci [-] Enabling device ens4 to query link speed 2019-05-24 14:46:16.448 92126 WARNING sysinv.agent.pci [-] ATTR speed unknown for: ens4 (flags: 0x1002) 2019-05-24 14:46:16.448 92126 WARNING sysinv.agent.pci [-] Disabling device ens4 after querying link speed 2019-05-24 14:46:16.701 92126 WARNING sysinv.agent.pci [-] Enabling device eth1000 to query link speed 2019-05-24 14:46:16.704 92126 WARNING sysinv.agent.pci [-] ATTR speed unknown for: eth1000 (flags: 0x1002) 2019-05-24 14:46:16.704 92126 WARNING sysinv.agent.pci [-] Disabling device eth1000 after querying link speed 2019-05-24 14:46:16.953 92126 WARNING sysinv.agent.pci [-] Enabling device eth1001 to query link speed 2019-05-24 14:46:16.957 92126 WARNING sysinv.agent.pci [-] ATTR speed unknown for: eth1001 (flags: 0x1002) 2019-05-24 14:46:16.957 92126 WARNING sysinv.agent.pci [-] Disabling device eth1001 after querying link speed 2019-05-24 14:46:16.979 92126 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on 192.168.204.2:5672 2019-05-24 14:46:20.355 101665 INFO sysinv.conductor.manager [-] sysinv-conductor start committed system={'system_mode': u'simplex', 'created_at': datetime.datetime(2019, 5, 24, 14, 22, 19, 29770, tzinfo=), 'uuid': u'4ea30041-b636-4189-89af-e6d74ac0c05d', 'software_version': u'19.01', 'service_project_name': u'services', 'system_type': u'All-in-one', 'name': u'c261f567-3717-4cf7-8d8b-ced73919f231', 'description': None, 'location': None, 'updated_at': datetime.datetime(2019, 5, 24, 14, 23, 31, 65894, tzinfo=), 'capabilities': {u'shared_services': u'[]', u'sdn_enabled': False, u'vswitch_type': u'none', u'https_enabled': False, u'kubernetes_enabled': True, u'region_config': False}, 'id': 1, 'contact': None, 'security_feature': u'nopti nospectre_v2', 'services': 72, 'timezone': u'UTC', 'security_profile': u'standard', 'distributed_cloud_role': None, 'region_name': u'RegionOne'} 2019-05-24 14:46:20.401 101665 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on 192.168.204.2:5672 2019-05-24 14:46:20.568 101665 INFO sysinv.conductor.manager [-] Sending agent update request for host 1 to update (audit_lvg, audit_pv) 2019-05-24 14:46:20.575 101665 INFO sysinv.agent.rpcapi [-] AgentApi.agent_update: fanout_cast: sending update request to agent for: (audit_lvg, audit_pv) 2019-05-24 14:46:20.614 101665 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on 192.168.204.2:5672 2019-05-24 14:46:20.988 101665 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://192.168.204.2:5491/v1/query/ hdr:None payload:None 2019-05-24 14:46:21.504 101665 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'pd': {}} 2019-05-24 14:46:21.504 101665 INFO sysinv.conductor.manager [-] Platform managed application platform-integ-apps: Creating... 2019-05-24 14:46:21.534 101665 INFO sysinv.common.utils [-] Checksum file is included and validated. 2019-05-24 14:46:21.535 101665 INFO sysinv.api.controllers.v1.kube_app [-] No patch required for application platform-integ-apps (1.0-5). 2019-05-24 14:46:21.625 101665 INFO sysinv.conductor.manager [-] Platform managed application platform-integ-apps: Uploading... 2019-05-24 14:46:21.626 101665 ERROR stevedore.extension [-] Could not load 'platform-integ-apps': No module named systemconfig.helm_plugins.platform_integ_apps 2019-05-24 14:46:21.627 101665 ERROR stevedore.extension [-] Could not load 'stx-openstack': No module named systemconfig.helm_plugins.stx_openstack 2019-05-24 14:46:21.628 101665 INFO sysinv.conductor.kube_app [-] Application (platform-integ-apps) upload started. 2019-05-24 14:46:21.734 101665 INFO sysinv.conductor.kube_app [-] Starting Armada service... 2019-05-24 14:46:21.734 101665 INFO sysinv.conductor.kube_app [-] kube_config=/opt/platform/armada/19.01/admin.conf, manifests_dir=/opt/platform/armada/19.01, overrides_dir=/opt/platform/helm/19.01. 2019-05-24 14:46:21.997 101665 INFO sysinv.conductor.kube_app [-] Armada service started! 2019-05-24 14:46:22.985 101665 INFO sysinv.conductor.kube_app [-] Manifest file /manifests/platform-integ-apps-manifest.yaml was successfully validated. 2019-05-24 14:46:23.054 101665 INFO sysinv.conductor.kube_app [-] Helm chart node-feature-discovery validated 2019-05-24 14:46:23.105 101665 INFO sysinv.conductor.kube_app [-] Helm chart rbd-provisioner validated 2019-05-24 14:46:23.150 101665 INFO sysinv.conductor.kube_app [-] Helm chart ceph-pools-audit validated 2019-05-24 14:46:23.153 101665 INFO sysinv.conductor.kube_app [-] Application platform-integ-apps will load charts to chart repo stx-platform 2019-05-24 14:46:23.224 101665 INFO sysinv.conductor.kube_app [-] Helm chart ceph-pools-audit-0.1.0.tgz uploaded 2019-05-24 14:46:23.301 101665 INFO sysinv.conductor.kube_app [-] Helm chart node-feature-discovery-0.3.0.tgz uploaded 2019-05-24 14:46:23.388 101665 INFO sysinv.conductor.kube_app [-] Helm chart rbd-provisioner-0.1.0.tgz uploaded 2019-05-24 14:46:23.516 101665 INFO sysinv.conductor.kube_app [-] Helm chart helm-toolkit-0.1.0.tgz uploaded 2019-05-24 14:46:27.246 102873 ERROR wsme.api [-] Server-side error: "Timeout while waiting on RPC response - topic: "sysinv.conductor_manager", RPC method: "iplatform_update_by_ihost" info: """. Detail: Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/wsmeext/pecan.py", line 85, in callfunction result = f(self, *args, **kwargs) File "/usr/lib64/python2.7/site-packages/sysinv/api/controllers/v1/host.py", line 1734, in patch return self._patch_sys(uuid, patch, profile_uuid) File "/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py", line 274, in inner return f(*args, **kwargs) File "/usr/lib64/python2.7/site-packages/sysinv/api/controllers/v1/host.py", line 1740, in _patch_sys return self._patch(uuid, patch, profile_uuid) File "/usr/lib64/python2.7/site-packages/sysinv/api/controllers/v1/host.py", line 2094, in _patch pecan.request.context, ihost_obj['uuid'], imsg_dict) File "/usr/lib64/python2.7/site-packages/sysinv/conductor/rpcapi.py", line 443, in iplatform_update_by_ihost imsg_dict=imsg_dict)) File "/usr/lib64/python2.7/site-packages/sysinv/openstack/common/rpc/proxy.py", line 126, in call exc.info, real_topic, msg.get('method')) Timeout: Timeout while waiting on RPC response - topic: "sysinv.conductor_manager", RPC method: "iplatform_update_by_ihost" info: "" 2019-05-24 14:46:27.265 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2019-05-24-14-46-27 patch 2019-05-24 14:46:27.265 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 1. delta_handle ['availability'] 2019-05-24 14:46:27.324 102873 INFO sysinv.api.controllers.v1.host [-] host controller-0 ihost_patch_end_2019-05-24-14-46-27 patch 2019-05-24 14:47:17.042 92126 INFO sysinv.agent.manager [-] get_ihost_by_macs rpc Timeout. 2019-05-24 14:47:17.049 92126 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on 192.168.204.2:5672 2019-05-24 14:47:17.071 92126 WARNING sysinv.openstack.common.loopingcall [-] task run outlasted interval by 1.126712 sec 2019-05-24 14:47:17.072 92126 INFO sysinv.agent.manager [-] Sysinv Agent audit running inv_get_and_report. 2019-05-24 14:47:17.596 92126 WARNING sysinv.agent.pci [-] Enabling device ens4 to query link speed 2019-05-24 14:47:17.599 92126 WARNING sysinv.agent.pci [-] ATTR speed unknown for: ens4 (flags: 0x1002) 2019-05-24 14:47:17.599 92126 WARNING sysinv.agent.pci [-] Disabling device ens4 after querying link speed 2019-05-24 14:47:17.859 92126 WARNING sysinv.agent.pci [-] Enabling device eth1000 to query link speed 2019-05-24 14:47:17.862 92126 WARNING sysinv.agent.pci [-] ATTR speed unknown for: eth1000 (flags: 0x1002) 2019-05-24 14:47:17.862 92126 WARNING sysinv.agent.pci [-] Disabling device eth1000 after querying link speed 2019-05-24 14:47:18.120 92126 WARNING sysinv.agent.pci [-] Enabling device eth1001 to query link speed 2019-05-24 14:47:18.124 92126 WARNING sysinv.agent.pci [-] ATTR speed unknown for: eth1001 (flags: 0x1002) 2019-05-24 14:47:18.124 92126 WARNING sysinv.agent.pci [-] Disabling device eth1001 after querying link speed 2019-05-24 14:47:18.218 101665 INFO sysinv.conductor.manager [req-3722139f-2f3d-4960-bf54-6e6503d3df13 None None] Updating platform data for host: 555dd65c-2edd-40fa-8dfd-af34fb4172a0 with: {u'first_report': True} 2019-05-24 14:47:18.230 92126 INFO sysinv.agent.manager [-] Sysinv Agent platform update by host: {'first_report': True} 2019-05-24 14:47:18.230 92126 INFO sysinv.agent.manager [-] Agent found matching ihost: 555dd65c-2edd-40fa-8dfd-af34fb4172a0 2019-05-24 14:47:18.579 101665 INFO sysinv.conductor.manager [req-3722139f-2f3d-4960-bf54-6e6503d3df13 None None] port 7ba07ee5-bc74-4808-9fd6-06c2751057cc update attr: {'sriov_numvfs': 0, 'driver': u'e1000', 'sriov_vfs_pci_address': u'', 'sriov_totalvfs': None, 'dpdksupport': False, 'speed': u'1000'} 2019-05-24 14:47:18.785 101665 INFO sysinv.conductor.manager [req-3722139f-2f3d-4960-bf54-6e6503d3df13 None None] port 2947890b-f85a-4baf-8267-0ab34dcf8616 update attr: {'sriov_numvfs': 0, 'driver': u'e1000', 'sriov_vfs_pci_address': u'', 'sriov_totalvfs': None, 'dpdksupport': False, 'speed': None} 2019-05-24 14:47:18.897 101665 INFO sysinv.conductor.manager [req-3722139f-2f3d-4960-bf54-6e6503d3df13 None None] port 6449372a-482f-4b93-b0f7-f7140a7dbd6b update attr: {'sriov_numvfs': 0, 'driver': u'virtio-pci', 'sriov_vfs_pci_address': u'', 'sriov_totalvfs': None, 'dpdksupport': True, 'speed': None} 2019-05-24 14:47:19.002 101665 INFO sysinv.conductor.manager [req-3722139f-2f3d-4960-bf54-6e6503d3df13 None None] port 0441c1fc-0631-4b26-8355-3a2c0715d548 update attr: {'sriov_numvfs': 0, 'driver': u'virtio-pci', 'sriov_vfs_pci_address': u'', 'sriov_totalvfs': None, 'dpdksupport': True, 'speed': None} 2019-05-24 14:47:19.156 101665 INFO sysinv.conductor.manager [req-3722139f-2f3d-4960-bf54-6e6503d3df13 None None] attr: {'sriov_numvfs': 0, 'driver': u'ata_piix', 'psvendor': u'Red Hat, Inc.', 'pdevice_id': u'7010', 'pclass': u'IDE interface', 'psdevice': u'Qemu virtual machine', 'sriov_vfs_pci_address': u'', 'pvendor': u'Intel Corporation', 'pvendor_id': u'8086', 'pclass_id': u'010180', 'sriov_totalvfs': None} 2019-05-24 14:47:19.171 101665 INFO sysinv.conductor.manager [req-3722139f-2f3d-4960-bf54-6e6503d3df13 None None] attr: {'sriov_numvfs': 0, 'driver': u'uhci_hcd', 'psvendor': u'Red Hat, Inc.', 'pdevice_id': u'7020', 'pclass': u'USB controller', 'psdevice': u'QEMU Virtual Machine', 'sriov_vfs_pci_address': u'', 'pvendor': u'Intel Corporation', 'pvendor_id': u'8086', 'pclass_id': u'0c0300', 'sriov_totalvfs': None} 2019-05-24 14:47:19.185 101665 INFO sysinv.conductor.manager [req-3722139f-2f3d-4960-bf54-6e6503d3df13 None None] attr: {'sriov_numvfs': 0, 'driver': None, 'psvendor': u'QEMU Virtual Machine', 'pdevice_id': u'00b8', 'pclass': u'VGA compatible controller', 'psdevice': u'QEMU Virtual Machine', 'sriov_vfs_pci_address': u'', 'pvendor': u'Cirrus Logic', 'pvendor_id': u'1013', 'pclass_id': u'030000', 'sriov_totalvfs': None} 2019-05-24 14:47:19.198 101665 INFO sysinv.conductor.manager [req-3722139f-2f3d-4960-bf54-6e6503d3df13 None None] attr: {'sriov_numvfs': 0, 'driver': u'virtio-pci', 'psvendor': u'Red Hat, Inc.', 'pdevice_id': u'1002', 'pclass': u'Unclassified device [00ff]', 'psdevice': u'Device 0005', 'sriov_vfs_pci_address': u'', 'pvendor': u'Red Hat, Inc.', 'pvendor_id': u'1af4', 'pclass_id': u'00ff00', 'sriov_totalvfs': None} 2019-05-24 14:47:19.212 101665 INFO sysinv.conductor.manager [req-3722139f-2f3d-4960-bf54-6e6503d3df13 None None] attr: {'sriov_numvfs': 0, 'driver': u'ahci', 'psvendor': u'-p01', 'pdevice_id': u'2922', 'pclass': u'SATA controller', 'psdevice': u'Red Hat, Inc.', 'sriov_vfs_pci_address': u'', 'pvendor': u'Intel Corporation', 'pvendor_id': u'8086', 'pclass_id': u'010601', 'sriov_totalvfs': None} 2019-05-24 14:47:19.262 101665 INFO sysinv.conductor.manager [req-3722139f-2f3d-4960-bf54-6e6503d3df13 None None] Already in db numa_node=0 mynuma_nodes=[0] 2019-05-24 14:47:19.294 101665 INFO sysinv.conductor.manager [req-3722139f-2f3d-4960-bf54-6e6503d3df13 None None] Logical CPU topology: host:controller-0 (controller,worker), sockets:1, cores/socket=6, threads/core=1, reference:current (unchanged) 2019-05-24 14:47:19.294 101665 INFO sysinv.conductor.manager [req-3722139f-2f3d-4960-bf54-6e6503d3df13 None None] cpu_id : 0 1 2 3 4 5 2019-05-24 14:47:19.294 101665 INFO sysinv.conductor.manager [req-3722139f-2f3d-4960-bf54-6e6503d3df13 None None] socket_id : 0 0 0 0 0 0 2019-05-24 14:47:19.294 101665 INFO sysinv.conductor.manager [req-3722139f-2f3d-4960-bf54-6e6503d3df13 None None] core_id : 0 1 2 3 4 5 2019-05-24 14:47:19.294 101665 INFO sysinv.conductor.manager [req-3722139f-2f3d-4960-bf54-6e6503d3df13 None None] thread_id : 0 0 0 0 0 0 2019-05-24 14:47:20.514 101665 INFO sysinv.conductor.manager [-] Sending agent update request for host 1 to update (audit_lvg, audit_pv) 2019-05-24 14:47:20.521 101665 INFO sysinv.agent.rpcapi [-] AgentApi.agent_update: fanout_cast: sending update request to agent for: (audit_lvg, audit_pv) 2019-05-24 14:47:21.103 101665 INFO sysinv.conductor.manager [req-3722139f-2f3d-4960-bf54-6e6503d3df13 None None] PV uuid: 4ba88c51-5f2c-4279-b36d-24e6288e0211 changed UUID from None to TUmGrH-obFZ-Y5Sg-2z3E-unNJ-UAO4-LTbHnh 2019-05-24 14:47:21.123 101665 INFO sysinv.conductor.manager [req-3722139f-2f3d-4960-bf54-6e6503d3df13 None None] PV uuid: e4b502f5-2a22-403e-84b3-55aa736fe773 changed UUID from None to NtXOtH-uQ9v-Qgfh-PQrv-nVfe-NF8y-0VfbKV 2019-05-24 14:47:21.224 101665 INFO sysinv.conductor.manager [req-3722139f-2f3d-4960-bf54-6e6503d3df13 None None] LVG uuid: 312c33ae-f76f-4762-b4f5-c22e93216651 changed UUID from None to XgC9i3-wh4x-rcwj-X3zL-XXMj-Xefq-I6XfNE 2019-05-24 14:47:21.306 101665 INFO sysinv.conductor.manager [req-3722139f-2f3d-4960-bf54-6e6503d3df13 None None] platform_interfaces host_id=1 info_list=[] 2019-05-24 14:47:21.328 92126 INFO sysinv.agent.manager [-] iscsi initiator name = iqn.1994-05.com.redhat:d0a53fcf588f 2019-05-24 14:47:21.332 101665 INFO sysinv.conductor.manager [req-3722139f-2f3d-4960-bf54-6e6503d3df13 None None] Updating platform data for host: 555dd65c-2edd-40fa-8dfd-af34fb4172a0 with: {u'config_applied': u'ab13195a-418c-4d7a-9344-ed8058e33f76', u'first_report': True, u'availability': u'available', u'iscsi_initiator_name': u'iqn.1994-05.com.redhat:d0a53fcf588f'} 2019-05-24 14:47:21.339 101665 INFO sysinv.conductor.manager [req-3722139f-2f3d-4960-bf54-6e6503d3df13 None None] controller-0 updating iscsi initiator=iqn.1994-05.com.redhat:d0a53fcf588f 2019-05-24 14:47:21.516 101665 INFO sysinv.conductor.manager [req-3722139f-2f3d-4960-bf54-6e6503d3df13 None None] State of stor: '4b777a1d-dfeb-4157-b764-ee2b34217355' is 'configuring-on-unlock', resetting to 'configured'. 2019-05-24 14:47:21.564 101665 WARNING ceph_client [-] skip checking server certificate 2019-05-24 14:47:21.566 101665 INFO sysinv.common.ceph [req-3722139f-2f3d-4960-bf54-6e6503d3df13 None None] ceph osd crush rule ls 2019-05-24 14:47:21.993 101665 INFO ceph_client [-] Request params: url=https://controller-0:5001/request?wait=1, json={'prefix': 'osd crush rule ls', 'format': 'json'} 2019-05-24 14:47:22.008 101665 INFO ceph_client [-] Result: {u'waiting': [], u'has_failed': False, u'state': u'success', u'is_waiting': False, u'running': [], u'failed': [], u'finished': [{u'outb': u'["storage_tier_ruleset"]', u'outs': u'', u'command': u'osd crush rule ls format=json'}], u'is_finished': True, u'id': u'139701417591632'} 2019-05-24 14:47:22.019 101665 INFO sysinv.common.ceph [req-3722139f-2f3d-4960-bf54-6e6503d3df13 None None] CRUSH: 200 : 2019-05-24 14:47:22.043 101665 INFO sysinv.conductor.manager [req-3722139f-2f3d-4960-bf54-6e6503d3df13 None None] SYS_I Clear system config alarm: controller-0 target config ab13195a-418c-4d7a-9344-ed8058e33f76 2019-05-24 14:47:22.086 92126 INFO sysinv.agent.manager [-] Sysinv Agent platform update by host: {'config_applied': 'ab13195a-418c-4d7a-9344-ed8058e33f76', 'first_report': True, 'availability': 'available', 'iscsi_initiator_name': 'iqn.1994-05.com.redhat:d0a53fcf588f'} 2019-05-24 14:48:20.554 101665 WARNING sysinv.conductor.manager [-] controller-0: iconfig out of date: target 39e1abad-fc19-4794-8cc0-8129afba0a23, applied ab13195a-418c-4d7a-9344-ed8058e33f76 2019-05-24 14:48:20.555 101665 WARNING sysinv.conductor.manager [-] SYS_I Raise system config alarm: host controller-0 config applied: ab13195a-418c-4d7a-9344-ed8058e33f76 vs. target: 39e1abad-fc19-4794-8cc0-8129afba0a23. 2019-05-24 14:48:20.568 101665 INFO sysinv.conductor.manager [-] _config_update_hosts config_uuid=39e1abad-fc19-4794-8cc0-8129afba0a23 2019-05-24 14:48:20.568 101665 INFO sysinv.conductor.manager [-] applying runtime manifest config_uuid=39e1abad-fc19-4794-8cc0-8129afba0a23, classes: ['openstack::keystone::endpoint::runtime', 'platform::firewall::runtime', 'platform::sysinv::runtime'] 2019-05-24 14:48:22.817 101665 INFO sysinv.agent.rpcapi [-] config_apply_runtime_manifest: fanout_cast: sending config 39e1abad-fc19-4794-8cc0-8129afba0a23 {'classes': ['openstack::keystone::endpoint::runtime', 'platform::firewall::runtime', 'platform::sysinv::runtime'], 'force': False, 'personalities': ['controller'], 'host_uuids': u'555dd65c-2edd-40fa-8dfd-af34fb4172a0'} to agent 2019-05-24 14:48:22.825 92126 INFO sysinv.agent.manager [req-c3515b2f-8b98-411c-b7a3-1e8e91874284 admin None] config_apply_runtime_manifest: 39e1abad-fc19-4794-8cc0-8129afba0a23 {u'classes': [u'openstack::keystone::endpoint::runtime', u'platform::firewall::runtime', u'platform::sysinv::runtime'], u'force': False, u'personalities': [u'controller'], u'host_uuids': u'555dd65c-2edd-40fa-8dfd-af34fb4172a0'} controller 2019-05-24 14:48:22.825 92126 INFO sysinv.agent.manager [req-c3515b2f-8b98-411c-b7a3-1e8e91874284 admin None] controller-active 2019-05-24 14:48:22.826 92126 INFO sysinv.agent.manager [req-c3515b2f-8b98-411c-b7a3-1e8e91874284 admin None] _apply_runtime_manifest with hieradata_path = '/opt/platform/puppet/19.01/hieradata' 2019-05-24 14:48:22.834 101665 INFO sysinv.conductor.manager [-] _controller_config_active_apply about to resize the filesystem 2019-05-24 14:48:22.835 101665 WARNING sysinv.conductor.manager [-] resizing filesystems 2019-05-24 14:48:22.867 101665 INFO sysinv.conductor.manager [-] Performed drbdadm resize all 2019-05-24 14:48:23.006 101665 INFO sysinv.conductor.manager [-] drbd-overview: pgsql-40.0, cgcs-20.0, extension-0.96875, patch-vault-0, etcd-4.8, dockerdistribution-16.0 2019-05-24 14:48:23.006 101665 INFO sysinv.conductor.manager [-] lvdisplay: pgsql-40.0, cgcs-20.0, extension-1.0, patch-vault-0, etcd-5.0, dockerdistribution-16.0 2019-05-24 14:48:23.094 101665 INFO sysinv.conductor.manager [-] SYS_I Clear system config alarm: controller-0 target config ab13195a-418c-4d7a-9344-ed8058e33f76 2019-05-24 14:48:30.916 101665 INFO sysinv.conductor.kube_app [-] Generating application overrides... 2019-05-24 14:48:31.016 101665 INFO sysinv.helm.helm_toolkit [-] App platform-integ-apps is not supported. Ignore mode. 2019-05-24 14:48:31.023 101665 WARNING sysinv.conductor.kube_app [-] Chart /scratch/apps/platform-integ-apps/charts/helm-toolkit has no image tags 2019-05-24 14:48:31.067 101665 INFO sysinv.conductor.kube_app [-] Armada manifest file has no img tags for chart helm-toolkit 2019-05-24 14:48:31.070 101665 INFO sysinv.conductor.kube_app [-] Armada manifest file has no img tags for chart rbd-provisioner 2019-05-24 14:48:31.072 101665 INFO sysinv.conductor.kube_app [-] Armada manifest file has no img tags for chart ceph-pools-audit 2019-05-24 14:48:31.081 101665 INFO sysinv.conductor.kube_app [-] Manifest file /opt/platform/armada/19.01/platform-integ-apps-manifest.yaml updated with new image tags 2019-05-24 14:48:31.086 101665 INFO sysinv.conductor.kube_app [-] Application (platform-integ-apps) upload completed. 2019-05-24 14:49:21.244 101665 INFO ceph_client [-] Request params: url=https://controller-0:5001/request?wait=1, json={'prefix': 'fsid', 'format': 'text'} 2019-05-24 14:49:21.256 101665 INFO ceph_client [-] Result: {u'waiting': [], u'has_failed': False, u'state': u'success', u'is_waiting': False, u'running': [], u'failed': [], u'finished': [{u'outb': u'9f241c41-f555-47e3-8a36-69fdddc2e9cb\n', u'outs': u'', u'command': u'fsid format=text'}], u'is_finished': True, u'id': u'139701417639312'} 2019-05-24 14:49:21.267 101665 INFO ceph_client [-] Request params: url=https://controller-0:5001/request?wait=1, json={'prefix': 'status', 'format': 'json'} 2019-05-24 14:49:21.278 101665 INFO ceph_client [-] Result: {u'waiting': [], u'has_failed': False, u'state': u'success', u'is_waiting': False, u'running': [], u'failed': [], u'finished': [{u'outb': u'{"fsid":"9f241c41-f555-47e3-8a36-69fdddc2e9cb","health":{"checks":{},"status":"HEALTH_OK","overall_status":"HEALTH_WARN"},"election_epoch":3,"quorum":[0],"quorum_names":["controller-0"],"monmap":{"epoch":1,"fsid":"9f241c41-f555-47e3-8a36-69fdddc2e9cb","modified":"2019-05-24 14:40:46.039568","created":"2019-05-24 14:40:46.039568","features":{"persistent":["kraken","luminous","mimic","osdmap-prune"],"optional":[]},"mons":[{"rank":0,"name":"controller-0","addr":"192.168.204.3:6789/0","public_addr":"192.168.204.3:6789/0"}]},"osdmap":{"osdmap":{"epoch":20,"num_osds":1,"num_up_osds":1,"num_in_osds":1,"full":false,"nearfull":false,"num_remapped_pgs":0}},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":256}],"num_pgs":256,"num_pools":4,"num_objects":1132,"data_bytes":1165,"bytes_used":118185984,"bytes_avail":106129285120,"bytes_total":106247471104},"fsmap":{"epoch":1,"by_rank":[]},"mgrmap":{"epoch":22,"active_gid":4126,"active_name":"controller-0","active_addr":"192.168.204.3:6804/101227","available":true,"standbys":[],"modules":["restful"],"available_modules":[{"name":"balancer","can_run":true,"error_string":""},{"name":"dashboard","can_run":false,"error_string":"Frontend assets not found: incomplete build?"},{"name":"hello","can_run":true,"error_string":""},{"name":"iostat","can_run":true,"error_string":""},{"name":"localpool","can_run":true,"error_string":""},{"name":"prometheus","can_run":true,"error_string":""},{"name":"restful","can_run":true,"error_string":""},{"name":"selftest","can_run":true,"error_string":""},{"name":"smart","can_run":false,"error_string":""},{"name":"status","can_run":true,"error_string":""},{"name":"telegraf","can_run":true,"error_string":""},{"name":"telemetry","can_run":true,"error_string":""},{"name":"zabbix","can_run":true,"error_string":""}],"services":{"restful":"https://controller-0:5001/"}},"servicemap":{"epoch":2,"modified":"2019-05-24 14:44:06.460840","services":{"rgw":{"daemons":{"summary":"","radosgw.gateway":{"start_epoch":2,"start_stamp":"2019-05-24 14:44:05.612931","gid":4116,"addr":"192.168.204.3:0/726429064","metadata":{"arch":"x86_64","ceph_release":"mimic","ceph_version":"ceph version 13.2.2 (1b34de9275fe3383b5ce3c0d52712f51d992a1f0) mimic (stable)","ceph_version_short":"13.2.2","cpu":"Intel Core i7 9xx (Nehalem Class Core i7)","distro":"centos","distro_description":"CentOS Linux 7 (Core)","distro_version":"7","frontend_config#0":"civetweb port=192.168.204.2:7480","frontend_type#0":"civetweb","hostname":"controller-0","kernel_description":"#1 SMP PREEMPT Fri May 24 02:23:14 UTC 2019","kernel_version":"3.10.0-957.1.3.el7.1.tis.x86_64","mem_swap_kb":"0","mem_total_kb":"25555296","num_handles":"1","os":"Linux","pid":"95695","zone_id":"2828d44c-f7d4-4b55-a88c-5ad2ceb65d91","zone_name":"default","zonegroup_id":"f40d5e7a-5119-40a3-a12b-7fdd8d93855f","zonegroup_name":"default"}}}}}}}\n', u'outs': u'', u'command': u'status format=json'}], u'is_finished': True, u'id': u'139701417638352'} 2019-05-24 14:49:21.798 101665 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://192.168.204.2:5491/v1/query/ hdr:None payload:None 2019-05-24 14:49:22.032 101665 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'pd': {}} 2019-05-24 14:49:22.047 101665 INFO sysinv.conductor.manager [-] Platform managed application platform-integ-apps: Applying... 2019-05-24 14:49:22.047 101665 ERROR stevedore.extension [-] Could not load 'platform-integ-apps': No module named systemconfig.helm_plugins.platform_integ_apps 2019-05-24 14:49:22.047 101665 ERROR stevedore.extension [-] Could not load 'stx-openstack': No module named systemconfig.helm_plugins.stx_openstack 2019-05-24 14:49:22.048 101665 INFO sysinv.conductor.kube_app [-] Application (platform-integ-apps) apply started. 2019-05-24 14:49:22.156 101665 INFO sysinv.conductor.kube_app [-] Secret default-registry-key created under Namespace kube-system. 2019-05-24 14:49:22.175 101665 INFO sysinv.conductor.kube_app [-] Generating application overrides... 2019-05-24 14:49:22.286 101665 INFO sysinv.helm.helm_toolkit [-] App platform-integ-apps is not supported. Ignore mode. 2019-05-24 14:49:22.292 101665 INFO sysinv.helm.helm_toolkit [-] App platform-integ-apps is not supported. Ignore mode. 2019-05-24 14:49:22.292 101665 INFO sysinv.conductor.kube_app [-] Application overrides generated. 2019-05-24 14:49:22.329 101665 INFO sysinv.conductor.kube_app [-] Armada manifest file has no img tags for chart helm-toolkit 2019-05-24 14:49:22.350 101665 INFO sysinv.conductor.kube_app [-] Image 192.168.204.2:9001/quay.io/external_storage/rbd-provisioner:v2.1.1-k8s1.11 download started from local registry 2019-05-24 14:49:22.385 101665 INFO sysinv.conductor.kube_app [-] Image 192.168.204.2:9001/docker.io/port/ceph-config-helper:v1.10.3 download started from local registry 2019-05-24 14:49:22.464 92126 INFO sysinv.agent.manager [req-c3515b2f-8b98-411c-b7a3-1e8e91874284 admin None] Runtime manifest apply completed for classes [u'openstack::keystone::endpoint::runtime', u'platform::firewall::runtime', u'platform::sysinv::runtime']. 2019-05-24 14:49:22.465 92126 INFO sysinv.agent.manager [req-c3515b2f-8b98-411c-b7a3-1e8e91874284 admin None] Agent config applied 39e1abad-fc19-4794-8cc0-8129afba0a23 2019-05-24 14:49:22.489 101665 INFO sysinv.conductor.manager [req-c3515b2f-8b98-411c-b7a3-1e8e91874284 admin None] SYS_I Clear system config alarm: controller-0 target config 39e1abad-fc19-4794-8cc0-8129afba0a23 2019-05-24 14:49:32.642 101665 ERROR sysinv.conductor.kube_app [-] Image 192.168.204.2:9001/quay.io/external_storage/rbd-provisioner:v2.1.1-k8s1.11 download failed from local registry: 500 Server Error: Internal Server Error ("Get https://192.168.204.2:9001/v2/: net/http: TLS handshake timeout") 2019-05-24 14:49:32.661 101665 ERROR sysinv.conductor.kube_app [-] Image 192.168.204.2:9001/docker.io/port/ceph-config-helper:v1.10.3 download failed from local registry: 500 Server Error: Internal Server Error ("Get https://192.168.204.2:9001/v2/: net/http: TLS handshake timeout") 2019-05-24 14:49:32.661 101665 ERROR sysinv.conductor.kube_app [-] Deployment of application platform-integ-apps (1.0-5) failed: failed to download one or more image(s). 2019-05-24 14:49:32.661 101665 TRACE sysinv.conductor.kube_app Traceback (most recent call last): 2019-05-24 14:49:32.661 101665 TRACE sysinv.conductor.kube_app File "/usr/lib64/python2.7/site-packages/sysinv/conductor/kube_app.py", line 1197, in perform_app_apply 2019-05-24 14:49:32.661 101665 TRACE sysinv.conductor.kube_app self._download_images(app) 2019-05-24 14:49:32.661 101665 TRACE sysinv.conductor.kube_app File "/usr/lib64/python2.7/site-packages/sysinv/conductor/kube_app.py", line 534, in _download_images 2019-05-24 14:49:32.661 101665 TRACE sysinv.conductor.kube_app reason="failed to download one or more image(s).") 2019-05-24 14:49:32.661 101665 TRACE sysinv.conductor.kube_app KubeAppApplyFailure: Deployment of application platform-integ-apps (1.0-5) failed: failed to download one or more image(s). 2019-05-24 14:49:32.661 101665 TRACE sysinv.conductor.kube_app 2019-05-24 14:49:32.684 101665 ERROR sysinv.conductor.kube_app [-] Application apply aborted!. 2019-05-24 14:49:34.440 102873 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on 192.168.204.2:5672 2019-05-24 14:49:34.442 101665 ERROR stevedore.extension [-] Could not load 'platform-integ-apps': No module named systemconfig.helm_plugins.platform_integ_apps 2019-05-24 14:49:34.443 101665 ERROR stevedore.extension [-] Could not load 'stx-openstack': No module named systemconfig.helm_plugins.stx_openstack 2019-05-24 14:49:34.443 101665 ERROR stevedore.extension [-] Could not load 'platform-integ-apps': No module named systemconfig.helm_plugins.platform_integ_apps 2019-05-24 14:49:34.443 101665 ERROR stevedore.extension [-] Could not load 'stx-openstack': No module named systemconfig.helm_plugins.stx_openstack 2019-05-24 14:49:34.443 101665 INFO sysinv.conductor.kube_app [-] Application (platform-integ-apps) apply started. 2019-05-24 14:49:34.475 101665 INFO sysinv.conductor.kube_app [-] Generating application overrides... 2019-05-24 14:49:34.575 101665 INFO sysinv.helm.helm_toolkit [req-8a6e42ac-b7c5-48e4-858b-5e333f9a65a0 admin admin] App platform-integ-apps is not supported. Ignore mode. 2019-05-24 14:49:34.582 101665 INFO sysinv.helm.helm_toolkit [req-8a6e42ac-b7c5-48e4-858b-5e333f9a65a0 admin admin] App platform-integ-apps is not supported. Ignore mode. 2019-05-24 14:49:34.582 101665 INFO sysinv.conductor.kube_app [-] Application overrides generated. 2019-05-24 14:49:34.626 101665 INFO sysinv.conductor.kube_app [-] Armada manifest file has no img tags for chart helm-toolkit 2019-05-24 14:49:34.648 101665 INFO sysinv.conductor.kube_app [-] Image 192.168.204.2:9001/quay.io/external_storage/rbd-provisioner:v2.1.1-k8s1.11 download started from local registry 2019-05-24 14:49:34.685 101665 INFO sysinv.conductor.kube_app [-] Image 192.168.204.2:9001/docker.io/port/ceph-config-helper:v1.10.3 download started from local registry 2019-05-24 14:49:44.976 101665 ERROR sysinv.conductor.kube_app [-] Image 192.168.204.2:9001/docker.io/port/ceph-config-helper:v1.10.3 download failed from local registry: 500 Server Error: Internal Server Error ("Get https://192.168.204.2:9001/v2/: net/http: TLS handshake timeout") 2019-05-24 14:49:44.986 101665 ERROR sysinv.conductor.kube_app [-] Image 192.168.204.2:9001/quay.io/external_storage/rbd-provisioner:v2.1.1-k8s1.11 download failed from local registry: 500 Server Error: Internal Server Error ("Get https://192.168.204.2:9001/v2/: net/http: TLS handshake timeout") 2019-05-24 14:49:44.987 101665 ERROR sysinv.conductor.kube_app [-] Deployment of application platform-integ-apps (1.0-5) failed: failed to download one or more image(s). 2019-05-24 14:49:44.987 101665 TRACE sysinv.conductor.kube_app Traceback (most recent call last): 2019-05-24 14:49:44.987 101665 TRACE sysinv.conductor.kube_app File "/usr/lib64/python2.7/site-packages/sysinv/conductor/kube_app.py", line 1197, in perform_app_apply 2019-05-24 14:49:44.987 101665 TRACE sysinv.conductor.kube_app self._download_images(app) 2019-05-24 14:49:44.987 101665 TRACE sysinv.conductor.kube_app File "/usr/lib64/python2.7/site-packages/sysinv/conductor/kube_app.py", line 534, in _download_images 2019-05-24 14:49:44.987 101665 TRACE sysinv.conductor.kube_app reason="failed to download one or more image(s).") 2019-05-24 14:49:44.987 101665 TRACE sysinv.conductor.kube_app KubeAppApplyFailure: Deployment of application platform-integ-apps (1.0-5) failed: failed to download one or more image(s). 2019-05-24 14:49:44.987 101665 TRACE sysinv.conductor.kube_app 2019-05-24 14:49:44.995 101665 ERROR sysinv.conductor.kube_app [-] Application apply aborted!. 2019-05-24 14:49:44.995 101665 ERROR stevedore.extension [-] Could not load 'platform-integ-apps': No module named systemconfig.helm_plugins.platform_integ_apps 2019-05-24 14:49:44.996 101665 ERROR stevedore.extension [-] Could not load 'stx-openstack': No module named systemconfig.helm_plugins.stx_openstack 2019-05-24 14:52:23.021 101665 INFO sysinv.conductor.manager [req-02ea6437-b39f-4c48-bad8-c9460a5d7015 None None] Attempting to create new LLDP agent {'status': u'rx=enabled,tx=enabled', 'host_id': 1, 'port_id': 3} on host 1 2019-05-24 14:54:37.737 101665 ERROR stevedore.extension [-] Could not load 'platform-integ-apps': No module named systemconfig.helm_plugins.platform_integ_apps 2019-05-24 14:54:37.737 101665 ERROR stevedore.extension [-] Could not load 'stx-openstack': No module named systemconfig.helm_plugins.stx_openstack 2019-05-24 14:54:37.737 101665 ERROR stevedore.extension [-] Could not load 'platform-integ-apps': No module named systemconfig.helm_plugins.platform_integ_apps 2019-05-24 14:54:37.738 101665 ERROR stevedore.extension [-] Could not load 'stx-openstack': No module named systemconfig.helm_plugins.stx_openstack 2019-05-24 14:54:37.738 101665 INFO sysinv.conductor.kube_app [-] Application (platform-integ-apps) apply started. 2019-05-24 14:54:37.758 101665 INFO sysinv.conductor.kube_app [-] Generating application overrides... 2019-05-24 14:54:37.845 101665 INFO sysinv.helm.helm_toolkit [req-b4880e64-8018-4f10-aefc-bc2075c15c51 admin admin] App platform-integ-apps is not supported. Ignore mode. 2019-05-24 14:54:37.852 101665 INFO sysinv.helm.helm_toolkit [req-b4880e64-8018-4f10-aefc-bc2075c15c51 admin admin] App platform-integ-apps is not supported. Ignore mode. 2019-05-24 14:54:37.852 101665 INFO sysinv.conductor.kube_app [-] Application overrides generated. 2019-05-24 14:54:37.887 101665 INFO sysinv.conductor.kube_app [-] Armada manifest file has no img tags for chart helm-toolkit 2019-05-24 14:54:37.906 101665 INFO sysinv.conductor.kube_app [-] Image 192.168.204.2:9001/quay.io/external_storage/rbd-provisioner:v2.1.1-k8s1.11 download started from local registry 2019-05-24 14:54:37.936 101665 INFO sysinv.conductor.kube_app [-] Image 192.168.204.2:9001/docker.io/port/ceph-config-helper:v1.10.3 download started from local registry 2019-05-24 14:54:48.232 101665 ERROR sysinv.conductor.kube_app [-] Image 192.168.204.2:9001/docker.io/port/ceph-config-helper:v1.10.3 download failed from local registry: 500 Server Error: Internal Server Error ("Get https://192.168.204.2:9001/v2/: net/http: TLS handshake timeout") 2019-05-24 14:54:48.241 101665 ERROR sysinv.conductor.kube_app [-] Image 192.168.204.2:9001/quay.io/external_storage/rbd-provisioner:v2.1.1-k8s1.11 download failed from local registry: 500 Server Error: Internal Server Error ("Get https://192.168.204.2:9001/v2/: net/http: TLS handshake timeout") 2019-05-24 14:54:48.241 101665 ERROR sysinv.conductor.kube_app [-] Deployment of application platform-integ-apps (1.0-5) failed: failed to download one or more image(s). 2019-05-24 14:54:48.241 101665 TRACE sysinv.conductor.kube_app Traceback (most recent call last): 2019-05-24 14:54:48.241 101665 TRACE sysinv.conductor.kube_app File "/usr/lib64/python2.7/site-packages/sysinv/conductor/kube_app.py", line 1197, in perform_app_apply 2019-05-24 14:54:48.241 101665 TRACE sysinv.conductor.kube_app self._download_images(app) 2019-05-24 14:54:48.241 101665 TRACE sysinv.conductor.kube_app File "/usr/lib64/python2.7/site-packages/sysinv/conductor/kube_app.py", line 534, in _download_images 2019-05-24 14:54:48.241 101665 TRACE sysinv.conductor.kube_app reason="failed to download one or more image(s).") 2019-05-24 14:54:48.241 101665 TRACE sysinv.conductor.kube_app KubeAppApplyFailure: Deployment of application platform-integ-apps (1.0-5) failed: failed to download one or more image(s). 2019-05-24 14:54:48.241 101665 TRACE sysinv.conductor.kube_app 2019-05-24 14:54:48.246 101665 ERROR sysinv.conductor.kube_app [-] Application apply aborted!. 2019-05-24 14:54:48.246 101665 ERROR stevedore.extension [-] Could not load 'platform-integ-apps': No module named systemconfig.helm_plugins.platform_integ_apps 2019-05-24 14:54:48.246 101665 ERROR stevedore.extension [-] Could not load 'stx-openstack': No module named systemconfig.helm_plugins.stx_openstack 2019-05-24 14:55:26.712 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2019-05-24-14-55-26 patch 2019-05-24 14:55:26.713 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_end. No changes from mtce/1.0. 2019-05-24 14:59:40.981 101665 ERROR stevedore.extension [-] Could not load 'platform-integ-apps': No module named systemconfig.helm_plugins.platform_integ_apps 2019-05-24 14:59:40.981 101665 ERROR stevedore.extension [-] Could not load 'stx-openstack': No module named systemconfig.helm_plugins.stx_openstack 2019-05-24 14:59:40.982 101665 ERROR stevedore.extension [-] Could not load 'platform-integ-apps': No module named systemconfig.helm_plugins.platform_integ_apps 2019-05-24 14:59:40.982 101665 ERROR stevedore.extension [-] Could not load 'stx-openstack': No module named systemconfig.helm_plugins.stx_openstack 2019-05-24 14:59:40.982 101665 INFO sysinv.conductor.kube_app [-] Application (platform-integ-apps) apply started. 2019-05-24 14:59:41.018 101665 INFO sysinv.conductor.kube_app [-] Generating application overrides... 2019-05-24 14:59:41.123 101665 INFO sysinv.helm.helm_toolkit [req-b154dd3a-87da-4cfa-8eb1-16fa10b311b6 admin admin] App platform-integ-apps is not supported. Ignore mode. 2019-05-24 14:59:41.130 101665 INFO sysinv.helm.helm_toolkit [req-b154dd3a-87da-4cfa-8eb1-16fa10b311b6 admin admin] App platform-integ-apps is not supported. Ignore mode. 2019-05-24 14:59:41.130 101665 INFO sysinv.conductor.kube_app [-] Application overrides generated. 2019-05-24 14:59:41.164 101665 INFO sysinv.conductor.kube_app [-] Armada manifest file has no img tags for chart helm-toolkit 2019-05-24 14:59:41.184 101665 INFO sysinv.conductor.kube_app [-] Image 192.168.204.2:9001/quay.io/external_storage/rbd-provisioner:v2.1.1-k8s1.11 download started from local registry 2019-05-24 14:59:41.237 101665 INFO sysinv.conductor.kube_app [-] Image 192.168.204.2:9001/docker.io/port/ceph-config-helper:v1.10.3 download started from local registry 2019-05-24 14:59:51.416 101665 ERROR sysinv.conductor.kube_app [-] Image 192.168.204.2:9001/quay.io/external_storage/rbd-provisioner:v2.1.1-k8s1.11 download failed from local registry: 500 Server Error: Internal Server Error ("Get https://192.168.204.2:9001/v2/: net/http: TLS handshake timeout") 2019-05-24 14:59:51.479 101665 ERROR sysinv.conductor.kube_app [-] Image 192.168.204.2:9001/docker.io/port/ceph-config-helper:v1.10.3 download failed from local registry: 500 Server Error: Internal Server Error ("Get https://192.168.204.2:9001/v2/: net/http: TLS handshake timeout") 2019-05-24 14:59:51.480 101665 ERROR sysinv.conductor.kube_app [-] Deployment of application platform-integ-apps (1.0-5) failed: failed to download one or more image(s). 2019-05-24 14:59:51.480 101665 TRACE sysinv.conductor.kube_app Traceback (most recent call last): 2019-05-24 14:59:51.480 101665 TRACE sysinv.conductor.kube_app File "/usr/lib64/python2.7/site-packages/sysinv/conductor/kube_app.py", line 1197, in perform_app_apply 2019-05-24 14:59:51.480 101665 TRACE sysinv.conductor.kube_app self._download_images(app) 2019-05-24 14:59:51.480 101665 TRACE sysinv.conductor.kube_app File "/usr/lib64/python2.7/site-packages/sysinv/conductor/kube_app.py", line 534, in _download_images 2019-05-24 14:59:51.480 101665 TRACE sysinv.conductor.kube_app reason="failed to download one or more image(s).") 2019-05-24 14:59:51.480 101665 TRACE sysinv.conductor.kube_app KubeAppApplyFailure: Deployment of application platform-integ-apps (1.0-5) failed: failed to download one or more image(s). 2019-05-24 14:59:51.480 101665 TRACE sysinv.conductor.kube_app 2019-05-24 14:59:51.490 101665 ERROR sysinv.conductor.kube_app [-] Application apply aborted!. 2019-05-24 14:59:51.490 101665 ERROR stevedore.extension [-] Could not load 'platform-integ-apps': No module named systemconfig.helm_plugins.platform_integ_apps 2019-05-24 14:59:51.490 101665 ERROR stevedore.extension [-] Could not load 'stx-openstack': No module named systemconfig.helm_plugins.stx_openstack 2019-05-24 15:00:26.747 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2019-05-24-15-00-26 patch 2019-05-24 15:00:26.747 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_end. No changes from mtce/1.0. 2019-05-24 15:04:44.569 101665 ERROR stevedore.extension [-] Could not load 'platform-integ-apps': No module named systemconfig.helm_plugins.platform_integ_apps 2019-05-24 15:04:44.569 101665 ERROR stevedore.extension [-] Could not load 'stx-openstack': No module named systemconfig.helm_plugins.stx_openstack 2019-05-24 15:04:44.569 101665 ERROR stevedore.extension [-] Could not load 'platform-integ-apps': No module named systemconfig.helm_plugins.platform_integ_apps 2019-05-24 15:04:44.569 101665 ERROR stevedore.extension [-] Could not load 'stx-openstack': No module named systemconfig.helm_plugins.stx_openstack 2019-05-24 15:04:44.570 101665 INFO sysinv.conductor.kube_app [-] Application (platform-integ-apps) apply started. 2019-05-24 15:04:44.594 101665 INFO sysinv.conductor.kube_app [-] Generating application overrides... 2019-05-24 15:04:44.774 101665 INFO sysinv.helm.helm_toolkit [req-e6869363-f579-4d08-8c7d-c95f61e14a98 admin admin] App platform-integ-apps is not supported. Ignore mode. 2019-05-24 15:04:44.791 101665 INFO sysinv.helm.helm_toolkit [req-e6869363-f579-4d08-8c7d-c95f61e14a98 admin admin] App platform-integ-apps is not supported. Ignore mode. 2019-05-24 15:04:44.791 101665 INFO sysinv.conductor.kube_app [-] Application overrides generated. 2019-05-24 15:04:44.854 101665 INFO sysinv.conductor.kube_app [-] Armada manifest file has no img tags for chart helm-toolkit 2019-05-24 15:04:44.891 101665 INFO sysinv.conductor.kube_app [-] Image 192.168.204.2:9001/quay.io/external_storage/rbd-provisioner:v2.1.1-k8s1.11 download started from local registry 2019-05-24 15:04:44.977 101665 INFO sysinv.conductor.kube_app [-] Image 192.168.204.2:9001/docker.io/port/ceph-config-helper:v1.10.3 download started from local registry 2019-05-24 15:04:55.226 101665 ERROR sysinv.conductor.kube_app [-] Image 192.168.204.2:9001/quay.io/external_storage/rbd-provisioner:v2.1.1-k8s1.11 download failed from local registry: 500 Server Error: Internal Server Error ("Get https://192.168.204.2:9001/v2/: net/http: TLS handshake timeout") 2019-05-24 15:04:55.238 101665 ERROR sysinv.conductor.kube_app [-] Image 192.168.204.2:9001/docker.io/port/ceph-config-helper:v1.10.3 download failed from local registry: 500 Server Error: Internal Server Error ("Get https://192.168.204.2:9001/v2/: net/http: TLS handshake timeout") 2019-05-24 15:04:55.239 101665 ERROR sysinv.conductor.kube_app [-] Deployment of application platform-integ-apps (1.0-5) failed: failed to download one or more image(s). 2019-05-24 15:04:55.239 101665 TRACE sysinv.conductor.kube_app Traceback (most recent call last): 2019-05-24 15:04:55.239 101665 TRACE sysinv.conductor.kube_app File "/usr/lib64/python2.7/site-packages/sysinv/conductor/kube_app.py", line 1197, in perform_app_apply 2019-05-24 15:04:55.239 101665 TRACE sysinv.conductor.kube_app self._download_images(app) 2019-05-24 15:04:55.239 101665 TRACE sysinv.conductor.kube_app File "/usr/lib64/python2.7/site-packages/sysinv/conductor/kube_app.py", line 534, in _download_images 2019-05-24 15:04:55.239 101665 TRACE sysinv.conductor.kube_app reason="failed to download one or more image(s).") 2019-05-24 15:04:55.239 101665 TRACE sysinv.conductor.kube_app KubeAppApplyFailure: Deployment of application platform-integ-apps (1.0-5) failed: failed to download one or more image(s). 2019-05-24 15:04:55.239 101665 TRACE sysinv.conductor.kube_app 2019-05-24 15:04:55.243 101665 ERROR sysinv.conductor.kube_app [-] Application apply aborted!. 2019-05-24 15:04:55.243 101665 ERROR stevedore.extension [-] Could not load 'platform-integ-apps': No module named systemconfig.helm_plugins.platform_integ_apps 2019-05-24 15:04:55.243 101665 ERROR stevedore.extension [-] Could not load 'stx-openstack': No module named systemconfig.helm_plugins.stx_openstack 2019-05-24 15:05:26.775 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2019-05-24-15-05-26 patch 2019-05-24 15:05:26.775 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_end. No changes from mtce/1.0. 2019-05-24 15:09:48.062 101665 ERROR stevedore.extension [-] Could not load 'platform-integ-apps': No module named systemconfig.helm_plugins.platform_integ_apps 2019-05-24 15:09:48.062 101665 ERROR stevedore.extension [-] Could not load 'stx-openstack': No module named systemconfig.helm_plugins.stx_openstack 2019-05-24 15:09:48.063 101665 ERROR stevedore.extension [-] Could not load 'platform-integ-apps': No module named systemconfig.helm_plugins.platform_integ_apps 2019-05-24 15:09:48.063 101665 ERROR stevedore.extension [-] Could not load 'stx-openstack': No module named systemconfig.helm_plugins.stx_openstack 2019-05-24 15:09:48.063 101665 INFO sysinv.conductor.kube_app [-] Application (platform-integ-apps) apply started. 2019-05-24 15:09:48.091 101665 INFO sysinv.conductor.kube_app [-] Generating application overrides... 2019-05-24 15:09:48.203 101665 INFO sysinv.helm.helm_toolkit [req-b09736f4-25e1-4513-90e6-0b7cac37b6bd admin admin] App platform-integ-apps is not supported. Ignore mode. 2019-05-24 15:09:48.213 101665 INFO sysinv.helm.helm_toolkit [req-b09736f4-25e1-4513-90e6-0b7cac37b6bd admin admin] App platform-integ-apps is not supported. Ignore mode. 2019-05-24 15:09:48.213 101665 INFO sysinv.conductor.kube_app [-] Application overrides generated. 2019-05-24 15:09:48.259 101665 INFO sysinv.conductor.kube_app [-] Armada manifest file has no img tags for chart helm-toolkit 2019-05-24 15:09:48.280 101665 INFO sysinv.conductor.kube_app [-] Image 192.168.204.2:9001/quay.io/external_storage/rbd-provisioner:v2.1.1-k8s1.11 download started from local registry 2019-05-24 15:09:48.346 101665 INFO sysinv.conductor.kube_app [-] Image 192.168.204.2:9001/docker.io/port/ceph-config-helper:v1.10.3 download started from local registry 2019-05-24 15:09:58.541 101665 ERROR sysinv.conductor.kube_app [-] Image 192.168.204.2:9001/docker.io/port/ceph-config-helper:v1.10.3 download failed from local registry: 500 Server Error: Internal Server Error ("Get https://192.168.204.2:9001/v2/: net/http: TLS handshake timeout") 2019-05-24 15:09:58.591 101665 ERROR sysinv.conductor.kube_app [-] Image 192.168.204.2:9001/quay.io/external_storage/rbd-provisioner:v2.1.1-k8s1.11 download failed from local registry: 500 Server Error: Internal Server Error ("Get https://192.168.204.2:9001/v2/: net/http: TLS handshake timeout") 2019-05-24 15:09:58.591 101665 ERROR sysinv.conductor.kube_app [-] Deployment of application platform-integ-apps (1.0-5) failed: failed to download one or more image(s). 2019-05-24 15:09:58.591 101665 TRACE sysinv.conductor.kube_app Traceback (most recent call last): 2019-05-24 15:09:58.591 101665 TRACE sysinv.conductor.kube_app File "/usr/lib64/python2.7/site-packages/sysinv/conductor/kube_app.py", line 1197, in perform_app_apply 2019-05-24 15:09:58.591 101665 TRACE sysinv.conductor.kube_app self._download_images(app) 2019-05-24 15:09:58.591 101665 TRACE sysinv.conductor.kube_app File "/usr/lib64/python2.7/site-packages/sysinv/conductor/kube_app.py", line 534, in _download_images 2019-05-24 15:09:58.591 101665 TRACE sysinv.conductor.kube_app reason="failed to download one or more image(s).") 2019-05-24 15:09:58.591 101665 TRACE sysinv.conductor.kube_app KubeAppApplyFailure: Deployment of application platform-integ-apps (1.0-5) failed: failed to download one or more image(s). 2019-05-24 15:09:58.591 101665 TRACE sysinv.conductor.kube_app 2019-05-24 15:09:58.601 101665 ERROR sysinv.conductor.kube_app [-] Application apply aborted!. 2019-05-24 15:09:58.602 101665 ERROR stevedore.extension [-] Could not load 'platform-integ-apps': No module named systemconfig.helm_plugins.platform_integ_apps 2019-05-24 15:09:58.602 101665 ERROR stevedore.extension [-] Could not load 'stx-openstack': No module named systemconfig.helm_plugins.stx_openstack 2019-05-24 15:10:26.798 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_start_2019-05-24-15-10-26 patch 2019-05-24 15:10:26.798 102873 INFO sysinv.api.controllers.v1.host [-] controller-0 ihost_patch_end. No changes from mtce/1.0.