'openstack baremetal introspection data save $UUID' returns "Introspection data not found for node"

[John Fulton]

The following command is failing in TripleO's main branch:

(undercloud) [CentOS-8 - stack@undercloud podman]$ openstack baremetal introspection data save 49b59bfe-dcf2-44ab-a898-8f1db33dbacb
Introspection data not found for node 49b59bfe-dcf2-44ab-a898-8f1db33dbacb, processed=True
(undercloud) [CentOS-8 - stack@undercloud podman]$

The nodes exist and were introspected [1].

[1]
(undercloud) [CentOS-8 - stack@undercloud podman]$ openstack baremetal node list
+--------------------------------------+------------------+--------------------------------------+-------------+--------------------+-------------+
| UUID | Name | Instance UUID | Power State | Provisioning State | Maintenance |
+--------------------------------------+------------------+--------------------------------------+-------------+--------------------+-------------+
| aa71f64d-ada0-4344-b8b3-306d966dc2e1 | oc0-controller-0 | 20080a1d-211f-455e-872e-a56aaaf8fbf6 | power on | active | False |
| 36dc1728-7ad8-4982-a928-34bf2b8af557 | oc0-controller-1 | 738e73ff-efbd-4a70-ba2a-fbdc971ede9c | power on | active | False |
| 5bf545ba-32c0-4248-b0d9-6126f5274db6 | oc0-controller-2 | b2200aaa-a7c7-4acc-8df5-f0231488b88e | power on | active | False |
| 20b762a8-ff0a-4d73-b898-e633279be12f | oc0-ceph-0 | fa34211d-1ad4-49d8-904f-2af5783b1b72 | power on | active | False |
| 8c06e308-14d3-45b3-996d-dd6193107a13 | oc0-ceph-1 | ce61a19f-f537-4e72-8bda-7b0d81886f8d | power on | active | False |
| c04ce183-4e88-47d6-9a06-c6610fdc44f6 | oc0-ceph-2 | c70bcc35-8876-4abd-aeff-63d8f593ddef | power on | active | False |
| fc744466-c78a-4734-8003-80c30cd37534 | oc0-ceph-3 | None | power off | available | False |
| 49b59bfe-dcf2-44ab-a898-8f1db33dbacb | oc0-ceph-4 | None | power off | available | False |
+--------------------------------------+------------------+--------------------------------------+-------------+--------------------+-------------+
(undercloud) [CentOS-8 - stack@undercloud podman]$

[John Fulton (jfulton-org)]

The ability to run 'openstack baremetal introspection data save $UUID' was introduced in python-ironic-inspector-client 1.4.0 (Pike and newer). Prior to that you could extract the same data from Swift on the undercloud using shell commands [1].

As per [2] the data is no longer stored in swift and now should be stored in the database [3].

Perhaps the command as configured by TripleO needs to be updated to deal with the new location?

[1] https://github.com/fultonj/derived-tht-poc/blob/4eb77d4bcf080959ff5c63019d7be1357ab7216b/ironic_download.sh

[2] https://specs.openstack.org/openstack/tripleo-specs/specs/wallaby/excise-swift.html

[3] https://github.com/openstack/tripleo-heat-templates/blob/master/environments/undercloud.yaml#L140

[Rabi Mishra (rabi)]

Do you've introspection run for your nodes when doing node import with --introspect.

By default I guess it's not run with node import[1]

[1] https://github.com/openstack/tripleo-operator-ansible/blob/master/roles/tripleo_overcloud_node_import/defaults/main.yml#L12

It works for me once introspection has run for nodes.

(undercloud) [CentOS-8.3 - stack@undercloud ~]$ openstack baremetal introspection list
+--------------------------------------+---------------------+---------------------+-------+
| UUID | Started at | Finished at | Error |
+--------------------------------------+---------------------+---------------------+-------+
| 2ccefa1e-6287-483a-961a-0b0855930768 | 2021-03-19T15:16:03 | 2021-03-19T15:18:58 | None |
+--------------------------------------+---------------------+---------------------+-------+
(undercloud) [CentOS-8.3 - stack@undercloud ~]$ openstack baremetal introspection data save 2ccefa1e-6287-483a-961a-0b0855930768
{"inventory": {"interfaces": [{"name": "ens3", "mac_address": "24:42:00:a7:a3:ef", "ipv4_address": "192.168.24.101", "ipv6_address": "fe80::4dca:c185:dfcb:b85%ens3", "has_carrier": true, "lldp": [], "vendor": "0x1af4", "product": "0x0001", "client_id": null, "biosdevname": null}, {"name": "ens4", "mac_address": "24:42:00:14:fe:34", "ipv4_address": "192.168.24.102", "ipv6_address": "fe80::50a4:8368:b678:b96b%ens4", "has_carrier": true, "lldp": [], "vendor": "0x1af4", "product": "0x0001", "client_id": null, "biosdevname": null}], "cpu": {"model_name": "Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz", "frequency": "2095.076", "count": 4, "architecture": "x86_64", "flags": ["fpu", "vme", "de", "pse", "tsc", "msr", "pae", "mce", "cx8", "apic", "sep", "mtrr", "pge", "mca", "cmov", "pat", "pse36", "clflush", "mmx", "fxsr", "sse", "sse2", "ss", "syscall", "nx", "pdpe1gb", "rdtscp", "lm", "constant_tsc", "arch_perfmon", "rep_good", "nopl", "xtopology", "cpuid", "tsc_known_freq", "pni", "pclmulqdq", "vmx", "ssse3", "fma", "cx16", "pcid", "sse4_1", "sse4_2", "x2apic", "movbe", "popcnt", "tsc_deadline_timer", "aes", "xsave", "avx", "f16c", "rdrand", "hypervisor", "lahf_lm", "abm", "3dnowprefetch", "cpuid_fault", "invpcid_single", "pti", "ssbd", "ibrs", "ibpb", "stibp", "tpr_shadow", "vnmi", "flexpriority", "ept", "vpid", "ept_ad", "fsgsbase", "tsc_adjust", "bmi1", "hle", "avx2", "smep", "bmi2", "erms", "invpcid", "rtm", "mpx", "avx512f", "avx512dq", "rdseed", "adx", "smap", "clflushopt", "clwb", "avx512cd", "avx512bw", "avx512vl", "xsaveopt", "xsavec", "xgetbv1", "xsaves", "arat", "umip", "pku", "ospke", "md_clear", "arch_capabilities"]}, "disks": [{"name": "/dev/sda", "model": "QEMU HARDDISK", "size": 107374182400, "rotational": true, "wwn": null, "serial": "QM00001", "vendor": "ATA", "wwn_with_extension": null, "wwn_vendor_extension": null, "hctl": "0:0:0:0", "by_path": "/dev/disk/by-path/pci-0000:00:01.1-ata-1"}], "memory": {"total": 5938597888, "physical_mb": 0}, "bmc_address": "0.0.0.0", "bmc_v6address": "::/0", "system_vendor": {"product_name": "KVM", "serial_number": "", "manufacturer": "Red Hat"}, "boot": {"current_boot_mode": "bios", "pxe_interface": "24:42:00:a7:...

[John Fulton (jfulton-org)]

Output of `openstack baremetal introspection list` is empty for me so that must be why. I set up my undercloud using tripleo-operator-ansible which as per comment #2 doesn't import the introspection data [1]. So, this is very likely user error on my part.

I'll set myself to the assignee of the bug for now in order to tie up lose ends. I'll re-run with introspection and confirm it works and then close the bug. Thanks Rabi.

[1] https://github.com/openstack/tripleo-operator-ansible/blob/master/roles/tripleo_overcloud_node_import/defaults/main.yml#L12

[John Fulton (jfulton-org)]

User error.

Ran:

  openstack overcloud node import --introspect --provide ~/baremetal.json

note the "--introspect". Now the following works:

 openstack baremetal introspection data save 50a59716-4164-4951-bd6f-2f6515795e36