$ juju status Model Controller Cloud/Region Version SLA Timestamp bs ganso stsstack/stsstack 2.9.14 unsupported 19:27:35Z App Version Status Scale Charm Store Channel Rev OS Message cinder 14.3.1 active 1 cinder charmstore stable 317 ubuntu Unit is ready glance 18.0.1 active 1 glance charmstore stable 312 ubuntu Unit is ready keystone 15.0.1 active 1 keystone charmstore stable 330 ubuntu Application Ready mysql 5.7.20 active 1 percona-cluster charmstore stable 302 ubuntu Unit is ready neutron-api 14.4.2 active 1 neutron-api charmstore stable 302 ubuntu Unit is ready neutron-openvswitch 14.4.2 active 5 neutron-openvswitch charmstore stable 295 ubuntu Unit is ready nova-cloud-controller 19.3.2 active 1 nova-cloud-controller charmstore stable 362 ubuntu Unit is ready nova-compute 19.3.2 active 5 nova-compute charmstore stable 337 ubuntu Unit is ready rabbitmq-server 3.6.10 active 1 rabbitmq-server charmstore stable 118 ubuntu Unit is ready Unit Workload Agent Machine Public address Ports Message cinder/0* active idle 0 10.5.1.66 8776/tcp Unit is ready glance/0* active idle 1 10.5.0.237 9292/tcp Unit is ready keystone/0* active idle 2 10.5.3.106 5000/tcp Unit is ready mysql/0* active idle 3 10.5.3.134 3306/tcp Unit is ready neutron-api/0* active idle 4 10.5.2.133 9696/tcp Unit is ready nova-cloud-controller/0* active idle 5 10.5.2.38 8774/tcp,8775/tcp,8778/tcp Unit is ready nova-compute/0 active idle 6 10.5.3.173 Unit is ready neutron-openvswitch/3 active idle 10.5.3.173 Unit is ready nova-compute/1 active idle 7 10.5.1.208 Unit is ready neutron-openvswitch/1 active idle 10.5.1.208 Unit is ready nova-compute/2 active idle 8 10.5.2.140 Unit is ready neutron-openvswitch/4 active idle 10.5.2.140 Unit is ready nova-compute/3 active idle 9 10.5.0.239 Unit is ready neutron-openvswitch/2 active idle 10.5.0.239 Unit is ready nova-compute/4* active idle 10 10.5.3.79 Unit is ready neutron-openvswitch/0* active idle 10.5.3.79 Unit is ready rabbitmq-server/0* active idle 11 10.5.1.15 5672/tcp Unit is ready Machine State DNS Inst id Series AZ Message 0 started 10.5.1.66 cc50b26a-92fe-4514-b924-36b9ebfea926 bionic nova ACTIVE 1 started 10.5.0.237 85b0acab-4a8e-4504-b7d0-287a0fe14ffe bionic nova ACTIVE 2 started 10.5.3.106 f7e91b11-e237-44fe-bc0e-687712e7c083 bionic nova ACTIVE 3 started 10.5.3.134 977febc3-38f1-4cb9-8995-9a8d64bf6f12 bionic nova ACTIVE 4 started 10.5.2.133 d0b53b88-4bd2-4a73-9cd4-8e98ad40d322 bionic nova ACTIVE 5 started 10.5.2.38 06f689d9-3f9f-4841-936b-b84510b69fe9 bionic nova ACTIVE 6 started 10.5.3.173 797cbc6e-68d3-4a8f-93c3-b86d4a1932f7 bionic nova ACTIVE 7 started 10.5.1.208 e6979c1f-962c-4f35-86f2-19f790297f29 bionic nova ACTIVE 8 started 10.5.2.140 b3758a99-b50b-4b31-8ce5-09edf3b9222c bionic nova ACTIVE 9 started 10.5.0.239 ae251f05-f177-424b-b7bd-38655ace53ef bionic nova ACTIVE 10 started 10.5.3.79 59efa448-647c-4932-bd6b-8544e2c85378 bionic nova ACTIVE 11 started 10.5.1.15 fc95254f-66a7-40ee-bb19-e2457ec68c3d bionic nova ACTIVE $ juju run -a nova-compute -- "lscpu | grep Model" - Stdout: | Model: 60 Model name: Intel Core Processor (Haswell, no TSX, IBRS) UnitId: nova-compute/0 - Stdout: | Model: 60 Model name: Intel Core Processor (Haswell, no TSX, IBRS) UnitId: nova-compute/1 - Stdout: | Model: 60 Model name: Intel Core Processor (Haswell, no TSX, IBRS) UnitId: nova-compute/2 - Stdout: | Model: 60 Model name: Intel Core Processor (Haswell, no TSX, IBRS) UnitId: nova-compute/3 - Stdout: | Model: 60 Model name: Intel Core Processor (Haswell, no TSX, IBRS) UnitId: nova-compute/4 $ openstack server group create anti-aff --policy anti-affinity +----------+--------------------------------------+ | Field | Value | +----------+--------------------------------------+ | id | 53855aa0-45a0-46b3-b980-acfb3ab1cb44 | | members | | | name | anti-aff | | policies | anti-affinity | +----------+--------------------------------------+ $ openstack flavor create --vcpu 1 --ram 1024 --disk 0 --id 100 test-flavor +----------------------------+-------------+ | Field | Value | +----------------------------+-------------+ | OS-FLV-DISABLED:disabled | False | | OS-FLV-EXT-DATA:ephemeral | 0 | | description | None | | disk | 0 | | id | 100 | | name | test-flavor | | os-flavor-access:is_public | True | | properties | | | ram | 1024 | | rxtx_factor | 1.0 | | swap | | | vcpus | 1 | +----------------------------+-------------+ $ openstack volume create --image cirros --size 1 vol1 +---------------------+--------------------------------------+ | Field | Value | +---------------------+--------------------------------------+ | attachments | [] | | availability_zone | nova | | bootable | false | | consistencygroup_id | None | | created_at | 2021-11-22T19:28:36.000000 | | description | None | | encrypted | False | | id | 4b0df6be-0674-491a-a62e-d76b2192539e | | migration_status | None | | multiattach | False | | name | vol1 | | properties | | | replication_status | None | | size | 1 | | snapshot_id | None | | source_volid | None | | status | creating | | type | None | | updated_at | None | | user_id | 1f00b12b8f6546d2850027ce43fe78f4 | +---------------------+--------------------------------------+ $ openstack volume create --source vol1 --size 1 vol2 && openstack volume create --source vol1 --size 1 vol3 +---------------------+--------------------------------------+ | Field | Value | +---------------------+--------------------------------------+ | attachments | [] | | availability_zone | nova | | bootable | true | | consistencygroup_id | None | | created_at | 2021-11-22T19:29:04.000000 | | description | None | | encrypted | False | | id | d9105d0f-1ac9-4911-b4e7-d5c336dd4d43 | | migration_status | None | | multiattach | False | | name | vol2 | | properties | | | replication_status | None | | size | 1 | | snapshot_id | None | | source_volid | 4b0df6be-0674-491a-a62e-d76b2192539e | | status | creating | | type | None | | updated_at | None | | user_id | 1f00b12b8f6546d2850027ce43fe78f4 | +---------------------+--------------------------------------+ +---------------------+--------------------------------------+ | Field | Value | +---------------------+--------------------------------------+ | attachments | [] | | availability_zone | nova | | bootable | true | | consistencygroup_id | None | | created_at | 2021-11-22T19:29:08.000000 | | description | None | | encrypted | False | | id | 5e1247e5-e1d4-43fa-b8de-15f9d0e9210b | | migration_status | None | | multiattach | False | | name | vol3 | | properties | | | replication_status | None | | size | 1 | | snapshot_id | None | | source_volid | 4b0df6be-0674-491a-a62e-d76b2192539e | | status | creating | | type | None | | updated_at | None | | user_id | 1f00b12b8f6546d2850027ce43fe78f4 | +---------------------+--------------------------------------+ $ openstack volume list +--------------------------------------+------+-----------+------+-------------+ | ID | Name | Status | Size | Attached to | +--------------------------------------+------+-----------+------+-------------+ | 5e1247e5-e1d4-43fa-b8de-15f9d0e9210b | vol3 | available | 1 | | | d9105d0f-1ac9-4911-b4e7-d5c336dd4d43 | vol2 | available | 1 | | | 4b0df6be-0674-491a-a62e-d76b2192539e | vol1 | available | 1 | | +--------------------------------------+------+-----------+------+-------------+ $ GROUP_ID=$(openstack server group show anti-aff -c id -f value) $ openstack server create --network private --volume vol1 --flavor 100 --hint group=$GROUP_ID ins1 && openstack server create --network private --volume vol2 --flavor 100 --hint group=$GROUP_ID ins2 && openstack server create --network private --volume vol3 --flavor 100 --hint group=$GROUP_ID ins3 +-------------------------------------+--------------------------------------+ | Field | Value | +-------------------------------------+--------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | | | OS-EXT-SRV-ATTR:host | None | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | | OS-EXT-SRV-ATTR:instance_name | | | OS-EXT-STS:power_state | NOSTATE | | OS-EXT-STS:task_state | scheduling | | OS-EXT-STS:vm_state | building | | OS-SRV-USG:launched_at | None | | OS-SRV-USG:terminated_at | None | | accessIPv4 | | | accessIPv6 | | | addresses | | | adminPass | F9UaNrJGgats | | config_drive | | | created | 2021-11-22T19:30:32Z | | flavor | test-flavor (100) | | hostId | | | id | 24584e19-0ed7-4572-87c4-44d3735863b9 | | image | N/A (booted from volume) | | key_name | None | | name | ins1 | | progress | 0 | | project_id | 1d13409251dc4cca82f8a935452394c7 | | properties | | | security_groups | name='default' | | status | BUILD | | updated | 2021-11-22T19:30:32Z | | user_id | 1f00b12b8f6546d2850027ce43fe78f4 | | volumes_attached | | +-------------------------------------+--------------------------------------+ +-------------------------------------+--------------------------------------+ | Field | Value | +-------------------------------------+--------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | | | OS-EXT-SRV-ATTR:host | None | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | | OS-EXT-SRV-ATTR:instance_name | | | OS-EXT-STS:power_state | NOSTATE | | OS-EXT-STS:task_state | scheduling | | OS-EXT-STS:vm_state | building | | OS-SRV-USG:launched_at | None | | OS-SRV-USG:terminated_at | None | | accessIPv4 | | | accessIPv6 | | | addresses | | | adminPass | taWFD9q53Wu3 | | config_drive | | | created | 2021-11-22T19:30:39Z | | flavor | test-flavor (100) | | hostId | | | id | 9b22564f-c9c6-48b8-886d-18f83460e745 | | image | N/A (booted from volume) | | key_name | None | | name | ins2 | | progress | 0 | | project_id | 1d13409251dc4cca82f8a935452394c7 | | properties | | | security_groups | name='default' | | status | BUILD | | updated | 2021-11-22T19:30:39Z | | user_id | 1f00b12b8f6546d2850027ce43fe78f4 | | volumes_attached | | +-------------------------------------+--------------------------------------+ +-------------------------------------+--------------------------------------+ | Field | Value | +-------------------------------------+--------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | | | OS-EXT-SRV-ATTR:host | None | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | | OS-EXT-SRV-ATTR:instance_name | | | OS-EXT-STS:power_state | NOSTATE | | OS-EXT-STS:task_state | scheduling | | OS-EXT-STS:vm_state | building | | OS-SRV-USG:launched_at | None | | OS-SRV-USG:terminated_at | None | | accessIPv4 | | | accessIPv6 | | | addresses | | | adminPass | bRvUA6FKTj3N | | config_drive | | | created | 2021-11-22T19:30:48Z | | flavor | test-flavor (100) | | hostId | | | id | 04412717-0322-45f3-a81c-ce8f1a2f4fd0 | | image | N/A (booted from volume) | | key_name | None | | name | ins3 | | progress | 0 | | project_id | 1d13409251dc4cca82f8a935452394c7 | | properties | | | security_groups | name='default' | | status | BUILD | | updated | 2021-11-22T19:30:48Z | | user_id | 1f00b12b8f6546d2850027ce43fe78f4 | | volumes_attached | | +-------------------------------------+--------------------------------------+ $ openstack server list --long +--------------------------------------+------+--------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+-----------------------------+------------+ | ID | Name | Status | Task State | Power State | Networks | Image Name | Image ID | Flavor Name | Flavor ID | Availability Zone | Host | Properties | +--------------------------------------+------+--------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+-----------------------------+------------+ | 04412717-0322-45f3-a81c-ce8f1a2f4fd0 | ins3 | ACTIVE | None | Running | private=192.168.21.54 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-6.cloud.sts | | | 9b22564f-c9c6-48b8-886d-18f83460e745 | ins2 | ACTIVE | None | Running | private=192.168.21.170 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-10.cloud.sts | | | 24584e19-0ed7-4572-87c4-44d3735863b9 | ins1 | ACTIVE | None | Running | private=192.168.21.63 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-8.cloud.sts | | +--------------------------------------+------+--------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+-----------------------------+------------+ $ openstack server migrate ins1 --live-migration & openstack server migrate ins2 --live-migration & openstack server migrate ins3 --live-migration [1] 448541 [2] 448542 [1]- Done openstack server migrate ins1 --live-migration [2]+ Done openstack server migrate ins2 --live-migration $ openstack server list --long +--------------------------------------+------+--------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+----------------------------+------------+ | ID | Name | Status | Task State | Power State | Networks | Image Name | Image ID | Flavor Name | Flavor ID | Availability Zone | Host | Properties | +--------------------------------------+------+--------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+----------------------------+------------+ | 04412717-0322-45f3-a81c-ce8f1a2f4fd0 | ins3 | ACTIVE | None | Running | private=192.168.21.54 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-7.cloud.sts | | | 9b22564f-c9c6-48b8-886d-18f83460e745 | ins2 | ACTIVE | None | Running | private=192.168.21.170 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-9.cloud.sts | | | 24584e19-0ed7-4572-87c4-44d3735863b9 | ins1 | ACTIVE | None | Running | private=192.168.21.63 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-9.cloud.sts | | +--------------------------------------+------+--------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+----------------------------+------------+ $ openstack server delete ins1 ins2 ins3 $ openstack server create --network private --volume vol1 --flavor 100 --hint group=$GROUP_ID ins1 && openstack server create --network private --volume vol2 --flavor 100 --hint group=$GROUP_ID ins2 && openstack server create --network private --volume vol3 --flavor 100 --hint group=$GROUP_ID ins3 +-------------------------------------+--------------------------------------+ | Field | Value | +-------------------------------------+--------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | | | OS-EXT-SRV-ATTR:host | None | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | | OS-EXT-SRV-ATTR:instance_name | | | OS-EXT-STS:power_state | NOSTATE | | OS-EXT-STS:task_state | scheduling | | OS-EXT-STS:vm_state | building | | OS-SRV-USG:launched_at | None | | OS-SRV-USG:terminated_at | None | | accessIPv4 | | | accessIPv6 | | | addresses | | | adminPass | 47ohtDqeXiWx | | config_drive | | | created | 2021-11-22T19:59:01Z | | flavor | test-flavor (100) | | hostId | | | id | 22fd449d-9760-464f-9fbd-83b6d100c08c | | image | N/A (booted from volume) | | key_name | None | | name | ins1 | | progress | 0 | | project_id | 1d13409251dc4cca82f8a935452394c7 | | properties | | | security_groups | name='default' | | status | BUILD | | updated | 2021-11-22T19:59:01Z | | user_id | 1f00b12b8f6546d2850027ce43fe78f4 | | volumes_attached | | +-------------------------------------+--------------------------------------+ +-------------------------------------+--------------------------------------+ | Field | Value | +-------------------------------------+--------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | | | OS-EXT-SRV-ATTR:host | None | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | | OS-EXT-SRV-ATTR:instance_name | | | OS-EXT-STS:power_state | NOSTATE | | OS-EXT-STS:task_state | scheduling | | OS-EXT-STS:vm_state | building | | OS-SRV-USG:launched_at | None | | OS-SRV-USG:terminated_at | None | | accessIPv4 | | | accessIPv6 | | | addresses | | | adminPass | 4jgmacwPBTCC | | config_drive | | | created | 2021-11-22T19:59:08Z | | flavor | test-flavor (100) | | hostId | | | id | eec2616b-8a60-47a2-946a-c52483b79513 | | image | N/A (booted from volume) | | key_name | None | | name | ins2 | | progress | 0 | | project_id | 1d13409251dc4cca82f8a935452394c7 | | properties | | | security_groups | name='default' | | status | BUILD | | updated | 2021-11-22T19:59:08Z | | user_id | 1f00b12b8f6546d2850027ce43fe78f4 | | volumes_attached | | +-------------------------------------+--------------------------------------+ +-------------------------------------+--------------------------------------+ | Field | Value | +-------------------------------------+--------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | | | OS-EXT-SRV-ATTR:host | None | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | | OS-EXT-SRV-ATTR:instance_name | | | OS-EXT-STS:power_state | NOSTATE | | OS-EXT-STS:task_state | scheduling | | OS-EXT-STS:vm_state | building | | OS-SRV-USG:launched_at | None | | OS-SRV-USG:terminated_at | None | | accessIPv4 | | | accessIPv6 | | | addresses | | | adminPass | qhQZudPBp95W | | config_drive | | | created | 2021-11-22T19:59:15Z | | flavor | test-flavor (100) | | hostId | | | id | cfdf16f0-b271-49b9-8cd8-8839892df6e6 | | image | N/A (booted from volume) | | key_name | None | | name | ins3 | | progress | 0 | | project_id | 1d13409251dc4cca82f8a935452394c7 | | properties | | | security_groups | name='default' | | status | BUILD | | updated | 2021-11-22T19:59:14Z | | user_id | 1f00b12b8f6546d2850027ce43fe78f4 | | volumes_attached | | +-------------------------------------+--------------------------------------+ $ openstack server list --long +--------------------------------------+------+--------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+-----------------------------+------------+ | ID | Name | Status | Task State | Power State | Networks | Image Name | Image ID | Flavor Name | Flavor ID | Availability Zone | Host | Properties | +--------------------------------------+------+--------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+-----------------------------+------------+ | cfdf16f0-b271-49b9-8cd8-8839892df6e6 | ins3 | ACTIVE | None | Running | private=192.168.21.150 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-6.cloud.sts | | | eec2616b-8a60-47a2-946a-c52483b79513 | ins2 | ACTIVE | None | Running | private=192.168.21.30 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-10.cloud.sts | | | 22fd449d-9760-464f-9fbd-83b6d100c08c | ins1 | ACTIVE | None | Running | private=192.168.21.210 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-8.cloud.sts | | +--------------------------------------+------+--------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+-----------------------------+------------+ $ openstack server migrate ins1 & openstack server migrate ins2 & openstack server migrate ins3 [1] 449728 [2] 449729 [1]- Done openstack server migrate ins1 [2]+ Done openstack server migrate ins2 $ openstack server list --long +--------------------------------------+------+---------------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+----------------------------+------------+ | ID | Name | Status | Task State | Power State | Networks | Image Name | Image ID | Flavor Name | Flavor ID | Availability Zone | Host | Properties | +--------------------------------------+------+---------------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+----------------------------+------------+ | cfdf16f0-b271-49b9-8cd8-8839892df6e6 | ins3 | VERIFY_RESIZE | None | Running | private=192.168.21.150 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-7.cloud.sts | | | eec2616b-8a60-47a2-946a-c52483b79513 | ins2 | VERIFY_RESIZE | None | Running | private=192.168.21.30 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-9.cloud.sts | | | 22fd449d-9760-464f-9fbd-83b6d100c08c | ins1 | VERIFY_RESIZE | None | Running | private=192.168.21.210 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-9.cloud.sts | | +--------------------------------------+------+---------------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+----------------------------+------------+ $ openstack server resize confirm ins1 $ openstack server resize confirm ins2 $ openstack server resize confirm ins3 $ openstack server delete ins1 ins2 ins3 $ openstack server list $ juju run -a nova-compute -- sudo add-apt-repository -y cloud-archive:stein-proposed - Stdout: | Reading package lists... Building dependency tree... Reading state information... ubuntu-cloud-keyring is already the newest version (2018.09.18.1~18.04.2). The following package was automatically installed and is no longer required: grub-pc-bin Use 'sudo apt autoremove' to remove it. 0 upgraded, 0 newly installed, 0 to remove and 6 not upgraded. Hit:1 http://nova.clouds.archive.ubuntu.com/ubuntu bionic InRelease Get:2 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] Get:3 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] Get:4 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-updates/stein InRelease [8767 B] Get:5 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein InRelease [8769 B] Get:6 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] Get:7 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 Packages [166 kB] Fetched 436 kB in 1s (741 kB/s) Reading package lists... UnitId: nova-compute/0 - Stdout: | Reading package lists... Building dependency tree... Reading state information... ubuntu-cloud-keyring is already the newest version (2018.09.18.1~18.04.2). The following package was automatically installed and is no longer required: grub-pc-bin Use 'sudo apt autoremove' to remove it. 0 upgraded, 0 newly installed, 0 to remove and 6 not upgraded. Hit:1 http://nova.clouds.archive.ubuntu.com/ubuntu bionic InRelease Get:2 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] Get:3 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-updates/stein InRelease [8767 B] Get:4 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein InRelease [8769 B] Get:5 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] Get:6 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] Get:7 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 Packages [166 kB] Fetched 436 kB in 1s (802 kB/s) Reading package lists... UnitId: nova-compute/1 - Stdout: | Reading package lists... Building dependency tree... Reading state information... ubuntu-cloud-keyring is already the newest version (2018.09.18.1~18.04.2). The following package was automatically installed and is no longer required: grub-pc-bin Use 'sudo apt autoremove' to remove it. 0 upgraded, 0 newly installed, 0 to remove and 6 not upgraded. Hit:1 http://nova.clouds.archive.ubuntu.com/ubuntu bionic InRelease Get:2 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] Get:3 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-updates/stein InRelease [8767 B] Get:4 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein InRelease [8769 B] Get:5 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] Get:6 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] Get:7 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 Packages [166 kB] Fetched 436 kB in 1s (800 kB/s) Reading package lists... UnitId: nova-compute/3 - Stdout: | Reading package lists... Building dependency tree... Reading state information... ubuntu-cloud-keyring is already the newest version (2018.09.18.1~18.04.2). The following package was automatically installed and is no longer required: grub-pc-bin Use 'sudo apt autoremove' to remove it. 0 upgraded, 0 newly installed, 0 to remove and 6 not upgraded. Hit:1 http://nova.clouds.archive.ubuntu.com/ubuntu bionic InRelease Get:2 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] Get:3 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] Get:4 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] Get:5 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-updates/stein InRelease [8767 B] Get:6 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein InRelease [8769 B] Get:7 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 Packages [166 kB] Fetched 436 kB in 1s (453 kB/s) Reading package lists... UnitId: nova-compute/2 - Stdout: | Reading package lists... Building dependency tree... Reading state information... ubuntu-cloud-keyring is already the newest version (2018.09.18.1~18.04.2). The following package was automatically installed and is no longer required: grub-pc-bin Use 'sudo apt autoremove' to remove it. 0 upgraded, 0 newly installed, 0 to remove and 6 not upgraded. Hit:1 http://nova.clouds.archive.ubuntu.com/ubuntu bionic InRelease Get:2 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] Get:3 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] Get:4 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-updates/stein InRelease [8767 B] Get:5 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] Get:6 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein InRelease [8769 B] Get:7 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 Packages [166 kB] Fetched 436 kB in 1s (451 kB/s) Reading package lists... UnitId: nova-compute/4 $ juju run -a nova-compute -- sudo apt-get update - Stdout: | Hit:1 http://nova.clouds.archive.ubuntu.com/ubuntu bionic InRelease Get:2 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] Get:3 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] Hit:4 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-updates/stein InRelease Hit:5 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein InRelease Get:6 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] Fetched 252 kB in 1s (475 kB/s) Reading package lists... UnitId: nova-compute/3 - Stdout: | Hit:1 http://nova.clouds.archive.ubuntu.com/ubuntu bionic InRelease Get:2 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] Hit:3 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-updates/stein InRelease Hit:4 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein InRelease Get:5 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] Get:6 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] Fetched 252 kB in 1s (435 kB/s) Reading package lists... UnitId: nova-compute/0 - Stdout: | Hit:1 http://nova.clouds.archive.ubuntu.com/ubuntu bionic InRelease Get:2 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] Hit:3 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-updates/stein InRelease Hit:4 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein InRelease Get:5 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] Get:6 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] Fetched 252 kB in 1s (370 kB/s) Reading package lists... UnitId: nova-compute/1 - Stdout: | Hit:1 http://nova.clouds.archive.ubuntu.com/ubuntu bionic InRelease Get:2 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] Get:3 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] Hit:4 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-updates/stein InRelease Get:5 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] Hit:6 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein InRelease Fetched 252 kB in 1s (437 kB/s) Reading package lists... UnitId: nova-compute/2 - Stdout: | Hit:1 http://nova.clouds.archive.ubuntu.com/ubuntu bionic InRelease Get:2 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] Get:3 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] Get:4 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] Hit:5 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-updates/stein InRelease Hit:6 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein InRelease Fetched 252 kB in 1s (433 kB/s) Reading package lists... UnitId: nova-compute/4 $ juju run -a nova-compute -- sudo apt-get install nova-common - ReturnCode: 1 Stdout: | Reading package lists... Building dependency tree... Reading state information... The following package was automatically installed and is no longer required: grub-pc-bin Use 'sudo apt autoremove' to remove it. The following additional packages will be installed: nova-api-metadata nova-compute nova-compute-kvm nova-compute-libvirt python3-nova Suggested packages: guestmount multipath-tools sg3-utils sysfsutils The following packages will be upgraded: nova-api-metadata nova-common nova-compute nova-compute-kvm nova-compute-libvirt python3-nova 6 upgraded, 0 newly installed, 0 to remove and 7 not upgraded. Need to get 3411 kB of archives. After this operation, 9216 B of additional disk space will be used. Do you want to continue? [Y/n] Abort. UnitId: nova-compute/0 - ReturnCode: 1 Stdout: | Reading package lists... Building dependency tree... Reading state information... The following package was automatically installed and is no longer required: grub-pc-bin Use 'sudo apt autoremove' to remove it. The following additional packages will be installed: nova-api-metadata nova-compute nova-compute-kvm nova-compute-libvirt python3-nova Suggested packages: guestmount multipath-tools sg3-utils sysfsutils The following packages will be upgraded: nova-api-metadata nova-common nova-compute nova-compute-kvm nova-compute-libvirt python3-nova 6 upgraded, 0 newly installed, 0 to remove and 7 not upgraded. Need to get 3411 kB of archives. After this operation, 9216 B of additional disk space will be used. Do you want to continue? [Y/n] Abort. UnitId: nova-compute/2 - ReturnCode: 1 Stdout: | Reading package lists... Building dependency tree... Reading state information... The following package was automatically installed and is no longer required: grub-pc-bin Use 'sudo apt autoremove' to remove it. The following additional packages will be installed: nova-api-metadata nova-compute nova-compute-kvm nova-compute-libvirt python3-nova Suggested packages: guestmount multipath-tools sg3-utils sysfsutils The following packages will be upgraded: nova-api-metadata nova-common nova-compute nova-compute-kvm nova-compute-libvirt python3-nova 6 upgraded, 0 newly installed, 0 to remove and 7 not upgraded. Need to get 3411 kB of archives. After this operation, 9216 B of additional disk space will be used. Do you want to continue? [Y/n] Abort. UnitId: nova-compute/3 - ReturnCode: 1 Stdout: | Reading package lists... Building dependency tree... Reading state information... The following package was automatically installed and is no longer required: grub-pc-bin Use 'sudo apt autoremove' to remove it. The following additional packages will be installed: nova-api-metadata nova-compute nova-compute-kvm nova-compute-libvirt python3-nova Suggested packages: guestmount multipath-tools sg3-utils sysfsutils The following packages will be upgraded: nova-api-metadata nova-common nova-compute nova-compute-kvm nova-compute-libvirt python3-nova 6 upgraded, 0 newly installed, 0 to remove and 7 not upgraded. Need to get 3411 kB of archives. After this operation, 9216 B of additional disk space will be used. Do you want to continue? [Y/n] Abort. UnitId: nova-compute/4 - ReturnCode: 1 Stdout: | Reading package lists... Building dependency tree... Reading state information... The following package was automatically installed and is no longer required: grub-pc-bin Use 'sudo apt autoremove' to remove it. The following additional packages will be installed: nova-api-metadata nova-compute nova-compute-kvm nova-compute-libvirt python3-nova Suggested packages: guestmount multipath-tools sg3-utils sysfsutils The following packages will be upgraded: nova-api-metadata nova-common nova-compute nova-compute-kvm nova-compute-libvirt python3-nova 6 upgraded, 0 newly installed, 0 to remove and 7 not upgraded. Need to get 3411 kB of archives. After this operation, 9216 B of additional disk space will be used. Do you want to continue? [Y/n] Abort. UnitId: nova-compute/1 $ juju run -a nova-compute -- "sudo dpkg --list | grep nova-common" - Stdout: | ii nova-common 2:19.3.2-0ubuntu1~cloud1 all OpenStack Compute - common files UnitId: nova-compute/0 - Stdout: | ii nova-common 2:19.3.2-0ubuntu1~cloud1 all OpenStack Compute - common files UnitId: nova-compute/1 - Stdout: | ii nova-common 2:19.3.2-0ubuntu1~cloud1 all OpenStack Compute - common files UnitId: nova-compute/2 - Stdout: | ii nova-common 2:19.3.2-0ubuntu1~cloud1 all OpenStack Compute - common files UnitId: nova-compute/3 - Stdout: | ii nova-common 2:19.3.2-0ubuntu1~cloud1 all OpenStack Compute - common files UnitId: nova-compute/4 $ juju run -a nova-compute -- sudo apt-get install -y nova-common - Stderr: | dpkg-preconfigure: unable to re-open stdin: No such file or directory Stdout: "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following package was automatically installed and is no longer required:\n grub-pc-bin\nUse 'sudo apt autoremove' to remove it.\nThe following additional packages will be installed:\n nova-api-metadata nova-compute nova-compute-kvm nova-compute-libvirt\n \ python3-nova\nSuggested packages:\n guestmount multipath-tools sg3-utils sysfsutils\nThe following packages will be upgraded:\n nova-api-metadata nova-common nova-compute nova-compute-kvm\n nova-compute-libvirt python3-nova\n6 upgraded, 0 newly installed, 0 to remove and 7 not upgraded.\nNeed to get 3411 kB of archives.\nAfter this operation, 9216 B of additional disk space will be used.\nGet:1 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 nova-compute-kvm all 2:19.3.2-0ubuntu1~cloud2 [33.0 kB]\nGet:2 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 nova-compute all 2:19.3.2-0ubuntu1~cloud2 [36.8 kB]\nGet:3 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 nova-api-metadata all 2:19.3.2-0ubuntu1~cloud2 [36.6 kB]\nGet:4 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 python3-nova all 2:19.3.2-0ubuntu1~cloud2 [3140 kB]\nGet:5 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 nova-common all 2:19.3.2-0ubuntu1~cloud2 [132 kB]\nGet:6 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 nova-compute-libvirt all 2:19.3.2-0ubuntu1~cloud2 [33.1 kB]\nFetched 3411 kB in 0s (15.2 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 133818 files and directories currently installed.)\nPreparing to unpack .../0-nova-compute-kvm_2%3a19.3.2-0ubuntu1~cloud2_all.deb ...\nUnpacking nova-compute-kvm (2:19.3.2-0ubuntu1~cloud2) over (2:19.3.2-0ubuntu1~cloud1) ...\nPreparing to unpack .../1-nova-compute_2%3a19.3.2-0ubuntu1~cloud2_all.deb ...\nUnpacking nova-compute (2:19.3.2-0ubuntu1~cloud2) over (2:19.3.2-0ubuntu1~cloud1) ...\nPreparing to unpack .../2-nova-api-metadata_2%3a19.3.2-0ubuntu1~cloud2_all.deb ...\nUnpacking nova-api-metadata (2:19.3.2-0ubuntu1~cloud2) over (2:19.3.2-0ubuntu1~cloud1) ...\nPreparing to unpack .../3-python3-nova_2%3a19.3.2-0ubuntu1~cloud2_all.deb ...\nUnpacking python3-nova (2:19.3.2-0ubuntu1~cloud2) over (2:19.3.2-0ubuntu1~cloud1) ...\nPreparing to unpack .../4-nova-common_2%3a19.3.2-0ubuntu1~cloud2_all.deb ...\nUnpacking nova-common (2:19.3.2-0ubuntu1~cloud2) over (2:19.3.2-0ubuntu1~cloud1) ...\nPreparing to unpack .../5-nova-compute-libvirt_2%3a19.3.2-0ubuntu1~cloud2_all.deb ...\nUnpacking nova-compute-libvirt (2:19.3.2-0ubuntu1~cloud2) over (2:19.3.2-0ubuntu1~cloud1) ...\nSetting up nova-common (2:19.3.2-0ubuntu1~cloud2) ...\nSetting up python3-nova (2:19.3.2-0ubuntu1~cloud2) ...\nSetting up nova-compute-libvirt (2:19.3.2-0ubuntu1~cloud2) ...\nSetting up nova-api-metadata (2:19.3.2-0ubuntu1~cloud2) ...\nSetting up nova-compute-kvm (2:19.3.2-0ubuntu1~cloud2) ...\nSetting up nova-compute (2:19.3.2-0ubuntu1~cloud2) ...\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\nProcessing triggers for ureadahead (0.100.0-21) ...\nProcessing triggers for systemd (237-3ubuntu10.52) ...\n" UnitId: nova-compute/0 - Stderr: | dpkg-preconfigure: unable to re-open stdin: No such file or directory Stdout: "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following package was automatically installed and is no longer required:\n grub-pc-bin\nUse 'sudo apt autoremove' to remove it.\nThe following additional packages will be installed:\n nova-api-metadata nova-compute nova-compute-kvm nova-compute-libvirt\n \ python3-nova\nSuggested packages:\n guestmount multipath-tools sg3-utils sysfsutils\nThe following packages will be upgraded:\n nova-api-metadata nova-common nova-compute nova-compute-kvm\n nova-compute-libvirt python3-nova\n6 upgraded, 0 newly installed, 0 to remove and 7 not upgraded.\nNeed to get 3411 kB of archives.\nAfter this operation, 9216 B of additional disk space will be used.\nGet:1 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 nova-compute-kvm all 2:19.3.2-0ubuntu1~cloud2 [33.0 kB]\nGet:2 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 nova-compute all 2:19.3.2-0ubuntu1~cloud2 [36.8 kB]\nGet:3 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 nova-api-metadata all 2:19.3.2-0ubuntu1~cloud2 [36.6 kB]\nGet:4 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 python3-nova all 2:19.3.2-0ubuntu1~cloud2 [3140 kB]\nGet:5 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 nova-common all 2:19.3.2-0ubuntu1~cloud2 [132 kB]\nGet:6 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 nova-compute-libvirt all 2:19.3.2-0ubuntu1~cloud2 [33.1 kB]\nFetched 3411 kB in 0s (14.6 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 133818 files and directories currently installed.)\nPreparing to unpack .../0-nova-compute-kvm_2%3a19.3.2-0ubuntu1~cloud2_all.deb ...\nUnpacking nova-compute-kvm (2:19.3.2-0ubuntu1~cloud2) over (2:19.3.2-0ubuntu1~cloud1) ...\nPreparing to unpack .../1-nova-compute_2%3a19.3.2-0ubuntu1~cloud2_all.deb ...\nUnpacking nova-compute (2:19.3.2-0ubuntu1~cloud2) over (2:19.3.2-0ubuntu1~cloud1) ...\nPreparing to unpack .../2-nova-api-metadata_2%3a19.3.2-0ubuntu1~cloud2_all.deb ...\nUnpacking nova-api-metadata (2:19.3.2-0ubuntu1~cloud2) over (2:19.3.2-0ubuntu1~cloud1) ...\nPreparing to unpack .../3-python3-nova_2%3a19.3.2-0ubuntu1~cloud2_all.deb ...\nUnpacking python3-nova (2:19.3.2-0ubuntu1~cloud2) over (2:19.3.2-0ubuntu1~cloud1) ...\nPreparing to unpack .../4-nova-common_2%3a19.3.2-0ubuntu1~cloud2_all.deb ...\nUnpacking nova-common (2:19.3.2-0ubuntu1~cloud2) over (2:19.3.2-0ubuntu1~cloud1) ...\nPreparing to unpack .../5-nova-compute-libvirt_2%3a19.3.2-0ubuntu1~cloud2_all.deb ...\nUnpacking nova-compute-libvirt (2:19.3.2-0ubuntu1~cloud2) over (2:19.3.2-0ubuntu1~cloud1) ...\nSetting up nova-common (2:19.3.2-0ubuntu1~cloud2) ...\nSetting up python3-nova (2:19.3.2-0ubuntu1~cloud2) ...\nSetting up nova-compute-libvirt (2:19.3.2-0ubuntu1~cloud2) ...\nSetting up nova-api-metadata (2:19.3.2-0ubuntu1~cloud2) ...\nSetting up nova-compute-kvm (2:19.3.2-0ubuntu1~cloud2) ...\nSetting up nova-compute (2:19.3.2-0ubuntu1~cloud2) ...\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\nProcessing triggers for ureadahead (0.100.0-21) ...\nProcessing triggers for systemd (237-3ubuntu10.52) ...\n" UnitId: nova-compute/3 - Stderr: | dpkg-preconfigure: unable to re-open stdin: No such file or directory Stdout: "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following package was automatically installed and is no longer required:\n grub-pc-bin\nUse 'sudo apt autoremove' to remove it.\nThe following additional packages will be installed:\n nova-api-metadata nova-compute nova-compute-kvm nova-compute-libvirt\n \ python3-nova\nSuggested packages:\n guestmount multipath-tools sg3-utils sysfsutils\nThe following packages will be upgraded:\n nova-api-metadata nova-common nova-compute nova-compute-kvm\n nova-compute-libvirt python3-nova\n6 upgraded, 0 newly installed, 0 to remove and 7 not upgraded.\nNeed to get 3411 kB of archives.\nAfter this operation, 9216 B of additional disk space will be used.\nGet:1 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 nova-compute-kvm all 2:19.3.2-0ubuntu1~cloud2 [33.0 kB]\nGet:2 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 nova-compute all 2:19.3.2-0ubuntu1~cloud2 [36.8 kB]\nGet:3 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 nova-api-metadata all 2:19.3.2-0ubuntu1~cloud2 [36.6 kB]\nGet:4 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 python3-nova all 2:19.3.2-0ubuntu1~cloud2 [3140 kB]\nGet:5 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 nova-common all 2:19.3.2-0ubuntu1~cloud2 [132 kB]\nGet:6 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 nova-compute-libvirt all 2:19.3.2-0ubuntu1~cloud2 [33.1 kB]\nFetched 3411 kB in 3s (1224 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 133818 files and directories currently installed.)\nPreparing to unpack .../0-nova-compute-kvm_2%3a19.3.2-0ubuntu1~cloud2_all.deb ...\nUnpacking nova-compute-kvm (2:19.3.2-0ubuntu1~cloud2) over (2:19.3.2-0ubuntu1~cloud1) ...\nPreparing to unpack .../1-nova-compute_2%3a19.3.2-0ubuntu1~cloud2_all.deb ...\nUnpacking nova-compute (2:19.3.2-0ubuntu1~cloud2) over (2:19.3.2-0ubuntu1~cloud1) ...\nPreparing to unpack .../2-nova-api-metadata_2%3a19.3.2-0ubuntu1~cloud2_all.deb ...\nUnpacking nova-api-metadata (2:19.3.2-0ubuntu1~cloud2) over (2:19.3.2-0ubuntu1~cloud1) ...\nPreparing to unpack .../3-python3-nova_2%3a19.3.2-0ubuntu1~cloud2_all.deb ...\nUnpacking python3-nova (2:19.3.2-0ubuntu1~cloud2) over (2:19.3.2-0ubuntu1~cloud1) ...\nPreparing to unpack .../4-nova-common_2%3a19.3.2-0ubuntu1~cloud2_all.deb ...\nUnpacking nova-common (2:19.3.2-0ubuntu1~cloud2) over (2:19.3.2-0ubuntu1~cloud1) ...\nPreparing to unpack .../5-nova-compute-libvirt_2%3a19.3.2-0ubuntu1~cloud2_all.deb ...\nUnpacking nova-compute-libvirt (2:19.3.2-0ubuntu1~cloud2) over (2:19.3.2-0ubuntu1~cloud1) ...\nSetting up nova-common (2:19.3.2-0ubuntu1~cloud2) ...\nSetting up python3-nova (2:19.3.2-0ubuntu1~cloud2) ...\nSetting up nova-compute-libvirt (2:19.3.2-0ubuntu1~cloud2) ...\nSetting up nova-api-metadata (2:19.3.2-0ubuntu1~cloud2) ...\nSetting up nova-compute-kvm (2:19.3.2-0ubuntu1~cloud2) ...\nSetting up nova-compute (2:19.3.2-0ubuntu1~cloud2) ...\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\nProcessing triggers for ureadahead (0.100.0-21) ...\nProcessing triggers for systemd (237-3ubuntu10.52) ...\n" UnitId: nova-compute/1 - Stderr: | dpkg-preconfigure: unable to re-open stdin: No such file or directory Stdout: "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following package was automatically installed and is no longer required:\n grub-pc-bin\nUse 'sudo apt autoremove' to remove it.\nThe following additional packages will be installed:\n nova-api-metadata nova-compute nova-compute-kvm nova-compute-libvirt\n \ python3-nova\nSuggested packages:\n guestmount multipath-tools sg3-utils sysfsutils\nThe following packages will be upgraded:\n nova-api-metadata nova-common nova-compute nova-compute-kvm\n nova-compute-libvirt python3-nova\n6 upgraded, 0 newly installed, 0 to remove and 7 not upgraded.\nNeed to get 3411 kB of archives.\nAfter this operation, 9216 B of additional disk space will be used.\nGet:1 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 nova-compute-kvm all 2:19.3.2-0ubuntu1~cloud2 [33.0 kB]\nGet:2 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 nova-compute all 2:19.3.2-0ubuntu1~cloud2 [36.8 kB]\nGet:3 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 nova-api-metadata all 2:19.3.2-0ubuntu1~cloud2 [36.6 kB]\nGet:4 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 python3-nova all 2:19.3.2-0ubuntu1~cloud2 [3140 kB]\nGet:5 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 nova-common all 2:19.3.2-0ubuntu1~cloud2 [132 kB]\nGet:6 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 nova-compute-libvirt all 2:19.3.2-0ubuntu1~cloud2 [33.1 kB]\nFetched 3411 kB in 2s (1956 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 133818 files and directories currently installed.)\nPreparing to unpack .../0-nova-compute-kvm_2%3a19.3.2-0ubuntu1~cloud2_all.deb ...\nUnpacking nova-compute-kvm (2:19.3.2-0ubuntu1~cloud2) over (2:19.3.2-0ubuntu1~cloud1) ...\nPreparing to unpack .../1-nova-compute_2%3a19.3.2-0ubuntu1~cloud2_all.deb ...\nUnpacking nova-compute (2:19.3.2-0ubuntu1~cloud2) over (2:19.3.2-0ubuntu1~cloud1) ...\nPreparing to unpack .../2-nova-api-metadata_2%3a19.3.2-0ubuntu1~cloud2_all.deb ...\nUnpacking nova-api-metadata (2:19.3.2-0ubuntu1~cloud2) over (2:19.3.2-0ubuntu1~cloud1) ...\nPreparing to unpack .../3-python3-nova_2%3a19.3.2-0ubuntu1~cloud2_all.deb ...\nUnpacking python3-nova (2:19.3.2-0ubuntu1~cloud2) over (2:19.3.2-0ubuntu1~cloud1) ...\nPreparing to unpack .../4-nova-common_2%3a19.3.2-0ubuntu1~cloud2_all.deb ...\nUnpacking nova-common (2:19.3.2-0ubuntu1~cloud2) over (2:19.3.2-0ubuntu1~cloud1) ...\nPreparing to unpack .../5-nova-compute-libvirt_2%3a19.3.2-0ubuntu1~cloud2_all.deb ...\nUnpacking nova-compute-libvirt (2:19.3.2-0ubuntu1~cloud2) over (2:19.3.2-0ubuntu1~cloud1) ...\nSetting up nova-common (2:19.3.2-0ubuntu1~cloud2) ...\nSetting up python3-nova (2:19.3.2-0ubuntu1~cloud2) ...\nSetting up nova-compute-libvirt (2:19.3.2-0ubuntu1~cloud2) ...\nSetting up nova-api-metadata (2:19.3.2-0ubuntu1~cloud2) ...\nSetting up nova-compute-kvm (2:19.3.2-0ubuntu1~cloud2) ...\nSetting up nova-compute (2:19.3.2-0ubuntu1~cloud2) ...\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\nProcessing triggers for ureadahead (0.100.0-21) ...\nProcessing triggers for systemd (237-3ubuntu10.52) ...\n" UnitId: nova-compute/2 - Stderr: | dpkg-preconfigure: unable to re-open stdin: No such file or directory Stdout: "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following package was automatically installed and is no longer required:\n grub-pc-bin\nUse 'sudo apt autoremove' to remove it.\nThe following additional packages will be installed:\n nova-api-metadata nova-compute nova-compute-kvm nova-compute-libvirt\n \ python3-nova\nSuggested packages:\n guestmount multipath-tools sg3-utils sysfsutils\nThe following packages will be upgraded:\n nova-api-metadata nova-common nova-compute nova-compute-kvm\n nova-compute-libvirt python3-nova\n6 upgraded, 0 newly installed, 0 to remove and 7 not upgraded.\nNeed to get 3411 kB of archives.\nAfter this operation, 9216 B of additional disk space will be used.\nGet:1 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 nova-compute-kvm all 2:19.3.2-0ubuntu1~cloud2 [33.0 kB]\nGet:2 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 nova-compute all 2:19.3.2-0ubuntu1~cloud2 [36.8 kB]\nGet:3 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 nova-api-metadata all 2:19.3.2-0ubuntu1~cloud2 [36.6 kB]\nGet:4 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 python3-nova all 2:19.3.2-0ubuntu1~cloud2 [3140 kB]\nGet:5 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 nova-common all 2:19.3.2-0ubuntu1~cloud2 [132 kB]\nGet:6 http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-proposed/stein/main amd64 nova-compute-libvirt all 2:19.3.2-0ubuntu1~cloud2 [33.1 kB]\nFetched 3411 kB in 3s (1162 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 133818 files and directories currently installed.)\nPreparing to unpack .../0-nova-compute-kvm_2%3a19.3.2-0ubuntu1~cloud2_all.deb ...\nUnpacking nova-compute-kvm (2:19.3.2-0ubuntu1~cloud2) over (2:19.3.2-0ubuntu1~cloud1) ...\nPreparing to unpack .../1-nova-compute_2%3a19.3.2-0ubuntu1~cloud2_all.deb ...\nUnpacking nova-compute (2:19.3.2-0ubuntu1~cloud2) over (2:19.3.2-0ubuntu1~cloud1) ...\nPreparing to unpack .../2-nova-api-metadata_2%3a19.3.2-0ubuntu1~cloud2_all.deb ...\nUnpacking nova-api-metadata (2:19.3.2-0ubuntu1~cloud2) over (2:19.3.2-0ubuntu1~cloud1) ...\nPreparing to unpack .../3-python3-nova_2%3a19.3.2-0ubuntu1~cloud2_all.deb ...\nUnpacking python3-nova (2:19.3.2-0ubuntu1~cloud2) over (2:19.3.2-0ubuntu1~cloud1) ...\nPreparing to unpack .../4-nova-common_2%3a19.3.2-0ubuntu1~cloud2_all.deb ...\nUnpacking nova-common (2:19.3.2-0ubuntu1~cloud2) over (2:19.3.2-0ubuntu1~cloud1) ...\nPreparing to unpack .../5-nova-compute-libvirt_2%3a19.3.2-0ubuntu1~cloud2_all.deb ...\nUnpacking nova-compute-libvirt (2:19.3.2-0ubuntu1~cloud2) over (2:19.3.2-0ubuntu1~cloud1) ...\nSetting up nova-common (2:19.3.2-0ubuntu1~cloud2) ...\nSetting up python3-nova (2:19.3.2-0ubuntu1~cloud2) ...\nSetting up nova-compute-libvirt (2:19.3.2-0ubuntu1~cloud2) ...\nSetting up nova-api-metadata (2:19.3.2-0ubuntu1~cloud2) ...\nSetting up nova-compute-kvm (2:19.3.2-0ubuntu1~cloud2) ...\nSetting up nova-compute (2:19.3.2-0ubuntu1~cloud2) ...\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\nProcessing triggers for ureadahead (0.100.0-21) ...\nProcessing triggers for systemd (237-3ubuntu10.52) ...\n" UnitId: nova-compute/4 $ juju run -a nova-compute -- "sudo dpkg --list | grep nova-common" - Stdout: | ii nova-common 2:19.3.2-0ubuntu1~cloud2 all OpenStack Compute - common files UnitId: nova-compute/0 - Stdout: | ii nova-common 2:19.3.2-0ubuntu1~cloud2 all OpenStack Compute - common files UnitId: nova-compute/1 - Stdout: | ii nova-common 2:19.3.2-0ubuntu1~cloud2 all OpenStack Compute - common files UnitId: nova-compute/2 - Stdout: | ii nova-common 2:19.3.2-0ubuntu1~cloud2 all OpenStack Compute - common files UnitId: nova-compute/3 - Stdout: | ii nova-common 2:19.3.2-0ubuntu1~cloud2 all OpenStack Compute - common files UnitId: nova-compute/4 $ openstack server create --network private --volume vol1 --flavor 100 --hint group=$GROUP_ID ins1 && openstack server create --network private --volume vol2 --flavor 100 --hint group=$GROUP_ID ins2 && openstack server create --network private --volume vol3 --flavor 100 --hint group=$GROUP_ID ins3 +-------------------------------------+--------------------------------------+ | Field | Value | +-------------------------------------+--------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | | | OS-EXT-SRV-ATTR:host | None | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | | OS-EXT-SRV-ATTR:instance_name | | | OS-EXT-STS:power_state | NOSTATE | | OS-EXT-STS:task_state | scheduling | | OS-EXT-STS:vm_state | building | | OS-SRV-USG:launched_at | None | | OS-SRV-USG:terminated_at | None | | accessIPv4 | | | accessIPv6 | | | addresses | | | adminPass | s8nx82hmbQZT | | config_drive | | | created | 2021-11-22T20:05:17Z | | flavor | test-flavor (100) | | hostId | | | id | f742ea5d-0200-4f9d-8088-2f45af8a0928 | | image | N/A (booted from volume) | | key_name | None | | name | ins1 | | progress | 0 | | project_id | 1d13409251dc4cca82f8a935452394c7 | | properties | | | security_groups | name='default' | | status | BUILD | | updated | 2021-11-22T20:05:16Z | | user_id | 1f00b12b8f6546d2850027ce43fe78f4 | | volumes_attached | | +-------------------------------------+--------------------------------------+ +-------------------------------------+--------------------------------------+ | Field | Value | +-------------------------------------+--------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | | | OS-EXT-SRV-ATTR:host | None | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | | OS-EXT-SRV-ATTR:instance_name | | | OS-EXT-STS:power_state | NOSTATE | | OS-EXT-STS:task_state | scheduling | | OS-EXT-STS:vm_state | building | | OS-SRV-USG:launched_at | None | | OS-SRV-USG:terminated_at | None | | accessIPv4 | | | accessIPv6 | | | addresses | | | adminPass | 36wXY4bhiK4f | | config_drive | | | created | 2021-11-22T20:05:26Z | | flavor | test-flavor (100) | | hostId | | | id | 31f13414-bbcf-4b93-8cc0-b7f2a8cf9c96 | | image | N/A (booted from volume) | | key_name | None | | name | ins2 | | progress | 0 | | project_id | 1d13409251dc4cca82f8a935452394c7 | | properties | | | security_groups | name='default' | | status | BUILD | | updated | 2021-11-22T20:05:25Z | | user_id | 1f00b12b8f6546d2850027ce43fe78f4 | | volumes_attached | | +-------------------------------------+--------------------------------------+ +-------------------------------------+--------------------------------------+ | Field | Value | +-------------------------------------+--------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | | | OS-EXT-SRV-ATTR:host | None | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | | OS-EXT-SRV-ATTR:instance_name | | | OS-EXT-STS:power_state | NOSTATE | | OS-EXT-STS:task_state | scheduling | | OS-EXT-STS:vm_state | building | | OS-SRV-USG:launched_at | None | | OS-SRV-USG:terminated_at | None | | accessIPv4 | | | accessIPv6 | | | addresses | | | adminPass | khyHX3X23HtH | | config_drive | | | created | 2021-11-22T20:05:33Z | | flavor | test-flavor (100) | | hostId | | | id | 976038f6-21c1-40ea-8f86-70c7f27e9ef3 | | image | N/A (booted from volume) | | key_name | None | | name | ins3 | | progress | 0 | | project_id | 1d13409251dc4cca82f8a935452394c7 | | properties | | | security_groups | name='default' | | status | BUILD | | updated | 2021-11-22T20:05:33Z | | user_id | 1f00b12b8f6546d2850027ce43fe78f4 | | volumes_attached | | +-------------------------------------+--------------------------------------+ $ openstack server list --long +--------------------------------------+------+--------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+-----------------------------+------------+ | ID | Name | Status | Task State | Power State | Networks | Image Name | Image ID | Flavor Name | Flavor ID | Availability Zone | Host | Properties | +--------------------------------------+------+--------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+-----------------------------+------------+ | 976038f6-21c1-40ea-8f86-70c7f27e9ef3 | ins3 | ACTIVE | None | Running | private=192.168.21.220 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-6.cloud.sts | | | 31f13414-bbcf-4b93-8cc0-b7f2a8cf9c96 | ins2 | ACTIVE | None | Running | private=192.168.21.17 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-10.cloud.sts | | | f742ea5d-0200-4f9d-8088-2f45af8a0928 | ins1 | ACTIVE | None | Running | private=192.168.21.236 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-8.cloud.sts | | +--------------------------------------+------+--------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+-----------------------------+------------+ $ openstack server migrate ins1 --live-migration & openstack server migrate ins2 --live-migration & openstack server migrate ins3 --live-migration [1] 451876 [2] 451877 [1]- Done openstack server migrate ins1 --live-migration [2]+ Done openstack server migrate ins2 --live-migration $ openstack server list --long +--------------------------------------+------+--------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+-----------------------------+------------+ | ID | Name | Status | Task State | Power State | Networks | Image Name | Image ID | Flavor Name | Flavor ID | Availability Zone | Host | Properties | +--------------------------------------+------+--------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+-----------------------------+------------+ | 976038f6-21c1-40ea-8f86-70c7f27e9ef3 | ins3 | ACTIVE | None | Running | private=192.168.21.220 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-7.cloud.sts | | | 31f13414-bbcf-4b93-8cc0-b7f2a8cf9c96 | ins2 | ACTIVE | None | Running | private=192.168.21.17 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-10.cloud.sts | | | f742ea5d-0200-4f9d-8088-2f45af8a0928 | ins1 | ACTIVE | None | Running | private=192.168.21.236 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-8.cloud.sts | | +--------------------------------------+------+--------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+-----------------------------+------------+ $ $ $ $ openstack server event list f742ea5d-0200-4f9d-8088-2f45af8a0928 +------------------------------------------+--------------------------------------+----------------+----------------------------+ | Request ID | Server ID | Action | Start Time | +------------------------------------------+--------------------------------------+----------------+----------------------------+ | req-41c0084d-1d60-41cb-acc8-85db3d94a20e | f742ea5d-0200-4f9d-8088-2f45af8a0928 | live-migration | 2021-11-22T20:07:23.000000 | | req-00df939b-000c-485e-8aec-1d2436b27afe | f742ea5d-0200-4f9d-8088-2f45af8a0928 | create | 2021-11-22T20:05:16.000000 | +------------------------------------------+--------------------------------------+----------------+----------------------------+ $ openstack server event show f742ea5d-0200-4f9d-8088-2f45af8a0928 req-41c0084d-1d60-41cb-acc8-85db3d94a20e +---------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Field | Value | +---------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | action | live-migration | | events | [{'event': 'compute_rollback_live_migration_at_destination', 'start_time': '2021-11-22T20:07:28.000000', 'finish_time': '2021-11-22T20:07:32.000000', 'result': 'Success', 'traceback': None}, {'event': 'compute_pre_live_migration', 'start_time': '2021-11-22T20:07:26.000000', 'finish_time': '2021-11-22T20:07:27.000000', 'result': 'Error', 'traceback': ' File "/usr/lib/python3/dist-packages/nova/compute/utils.py", line 1346, in decorated_function\n return function(self, context, *args, **kwargs)\n File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 215, in decorated_function\n kwargs[\'instance\'], e, sys.exc_info())\n File "/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 220, in __exit__\n self.force_reraise()\n File "/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise\n six.reraise(self.type_, self.value, self.tb)\n File "/usr/lib/python3/dist-packages/six.py", line 693, in reraise\n raise value\n File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 203, in decorated_function\n return function(self, context, *args, **kwargs)\n File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 6646, in pre_live_migration\n self._validate_instance_group_policy(context, instance)\n File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 1572, in _validate_instance_group_policy\n _do_validation(context, instance, group)\n File "/usr/lib/python3/dist-packages/oslo_concurrency/lockutils.py", line 328, in inner\n return f(*args, **kwargs)\n File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 1557, in _do_validation\n reason=msg)\n'}, {'event': 'compute_live_migration', 'start_time': '2021-11-22T20:07:26.000000', 'finish_time': '2021-11-22T20:07:26.000000', 'result': 'Success', 'traceback': None}, {'event': 'compute_check_can_live_migrate_source', 'start_time': '2021-11-22T20:07:25.000000', 'finish_time': '2021-11-22T20:07:26.000000', 'result': 'Success', 'traceback': None}, {'event': 'compute_check_can_live_migrate_destination', 'start_time': '2021-11-22T20:07:25.000000', 'finish_time': '2021-11-22T20:07:26.000000', 'result': 'Success', 'traceback': None}, {'event': 'conductor_migrate_server', 'start_time': '2021-11-22T20:07:24.000000', 'finish_time': '2021-11-22T20:07:26.000000', 'result': 'Success', 'traceback': None}] | | instance_uuid | f742ea5d-0200-4f9d-8088-2f45af8a0928 | | message | Error | | project_id | 1d13409251dc4cca82f8a935452394c7 | | request_id | req-41c0084d-1d60-41cb-acc8-85db3d94a20e | | start_time | 2021-11-22T20:07:23.000000 | | user_id | 1f00b12b8f6546d2850027ce43fe78f4 | +---------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ $ openstack server event list 31f13414-bbcf-4b93-8cc0-b7f2a8cf9c96 +------------------------------------------+--------------------------------------+----------------+----------------------------+ | Request ID | Server ID | Action | Start Time | +------------------------------------------+--------------------------------------+----------------+----------------------------+ | req-ba1ee36b-2d3e-4d41-a93a-e2e9ca27df20 | 31f13414-bbcf-4b93-8cc0-b7f2a8cf9c96 | live-migration | 2021-11-22T20:07:23.000000 | | req-fc382109-b95c-452c-a478-0d6e9669e946 | 31f13414-bbcf-4b93-8cc0-b7f2a8cf9c96 | create | 2021-11-22T20:05:23.000000 | +------------------------------------------+--------------------------------------+----------------+----------------------------+ $ openstack server event show 31f13414-bbcf-4b93-8cc0-b7f2a8cf9c96 req-ba1ee36b-2d3e-4d41-a93a-e2e9ca27df20 +---------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Field | Value | +---------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | action | live-migration | | events | [{'event': 'compute_rollback_live_migration_at_destination', 'start_time': '2021-11-22T20:07:28.000000', 'finish_time': '2021-11-22T20:07:32.000000', 'result': 'Success', 'traceback': None}, {'event': 'compute_pre_live_migration', 'start_time': '2021-11-22T20:07:26.000000', 'finish_time': '2021-11-22T20:07:26.000000', 'result': 'Error', 'traceback': ' File "/usr/lib/python3/dist-packages/nova/compute/utils.py", line 1346, in decorated_function\n return function(self, context, *args, **kwargs)\n File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 215, in decorated_function\n kwargs[\'instance\'], e, sys.exc_info())\n File "/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 220, in __exit__\n self.force_reraise()\n File "/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise\n six.reraise(self.type_, self.value, self.tb)\n File "/usr/lib/python3/dist-packages/six.py", line 693, in reraise\n raise value\n File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 203, in decorated_function\n return function(self, context, *args, **kwargs)\n File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 6646, in pre_live_migration\n self._validate_instance_group_policy(context, instance)\n File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 1572, in _validate_instance_group_policy\n _do_validation(context, instance, group)\n File "/usr/lib/python3/dist-packages/oslo_concurrency/lockutils.py", line 328, in inner\n return f(*args, **kwargs)\n File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 1557, in _do_validation\n reason=msg)\n'}, {'event': 'compute_live_migration', 'start_time': '2021-11-22T20:07:26.000000', 'finish_time': '2021-11-22T20:07:26.000000', 'result': 'Success', 'traceback': None}, {'event': 'compute_check_can_live_migrate_source', 'start_time': '2021-11-22T20:07:25.000000', 'finish_time': '2021-11-22T20:07:25.000000', 'result': 'Success', 'traceback': None}, {'event': 'compute_check_can_live_migrate_destination', 'start_time': '2021-11-22T20:07:25.000000', 'finish_time': '2021-11-22T20:07:26.000000', 'result': 'Success', 'traceback': None}, {'event': 'conductor_migrate_server', 'start_time': '2021-11-22T20:07:24.000000', 'finish_time': '2021-11-22T20:07:26.000000', 'result': 'Success', 'traceback': None}] | | instance_uuid | 31f13414-bbcf-4b93-8cc0-b7f2a8cf9c96 | | message | Error | | project_id | 1d13409251dc4cca82f8a935452394c7 | | request_id | req-ba1ee36b-2d3e-4d41-a93a-e2e9ca27df20 | | start_time | 2021-11-22T20:07:23.000000 | | user_id | 1f00b12b8f6546d2850027ce43fe78f4 | +---------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ $ $ $ $ $ openstack server migrate ins1 --live-migration & openstack server migrate ins2 --live-migration & openstack server migrate ins3 --live-migration [1] 452926 [2] 452927 [2]+ Done openstack server migrate ins2 --live-migration $ openstack server list --long +--------------------------------------+------+--------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+-----------------------------+------------+ | ID | Name | Status | Task State | Power State | Networks | Image Name | Image ID | Flavor Name | Flavor ID | Availability Zone | Host | Properties | +--------------------------------------+------+--------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+-----------------------------+------------+ | 976038f6-21c1-40ea-8f86-70c7f27e9ef3 | ins3 | ACTIVE | None | Running | private=192.168.21.220 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-7.cloud.sts | | | 31f13414-bbcf-4b93-8cc0-b7f2a8cf9c96 | ins2 | ACTIVE | None | Running | private=192.168.21.17 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-10.cloud.sts | | | f742ea5d-0200-4f9d-8088-2f45af8a0928 | ins1 | ACTIVE | None | Running | private=192.168.21.236 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-9.cloud.sts | | +--------------------------------------+------+--------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+-----------------------------+------------+ [1]+ Done openstack server migrate ins1 --live-migration $ openstack server migrate ins1 --live-migration & openstack server migrate ins2 --live-migration & openstack server migrate ins3 --live-migration [1] 453167 [2] 453168 No valid host was found. There are not enough hosts available. (HTTP 400) (Request-ID: req-3d79161f-36ae-4e9f-b664-5f0d1239e305) $ No valid host was found. There are not enough hosts available. (HTTP 400) (Request-ID: req-7bbea833-dbc1-4f72-bf8c-1fe3273139d8) [1]- Done openstack server migrate ins1 --live-migration [2]+ Exit 1 openstack server migrate ins2 --live-migration $ $ $ openstack server list --long +--------------------------------------+------+--------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+-----------------------------+------------+ | ID | Name | Status | Task State | Power State | Networks | Image Name | Image ID | Flavor Name | Flavor ID | Availability Zone | Host | Properties | +--------------------------------------+------+--------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+-----------------------------+------------+ | 976038f6-21c1-40ea-8f86-70c7f27e9ef3 | ins3 | ACTIVE | None | Running | private=192.168.21.220 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-7.cloud.sts | | | 31f13414-bbcf-4b93-8cc0-b7f2a8cf9c96 | ins2 | ACTIVE | None | Running | private=192.168.21.17 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-10.cloud.sts | | | f742ea5d-0200-4f9d-8088-2f45af8a0928 | ins1 | ACTIVE | None | Running | private=192.168.21.236 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-8.cloud.sts | | +--------------------------------------+------+--------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+-----------------------------+------------+ $ openstack server event list 976038f6-21c1-40ea-8f86-70c7f27e9ef3 +------------------------------------------+--------------------------------------+----------------+----------------------------+ | Request ID | Server ID | Action | Start Time | +------------------------------------------+--------------------------------------+----------------+----------------------------+ | req-3d79161f-36ae-4e9f-b664-5f0d1239e305 | 976038f6-21c1-40ea-8f86-70c7f27e9ef3 | live-migration | 2021-11-22T20:11:38.000000 | | req-f1909deb-4483-44c8-9fed-1914028d4487 | 976038f6-21c1-40ea-8f86-70c7f27e9ef3 | live-migration | 2021-11-22T20:10:55.000000 | | req-694d4634-1c7c-402f-8f80-67971eccbbf2 | 976038f6-21c1-40ea-8f86-70c7f27e9ef3 | live-migration | 2021-11-22T20:07:27.000000 | | req-dc17d7e9-a373-45fa-8a1d-31166bdcfd5d | 976038f6-21c1-40ea-8f86-70c7f27e9ef3 | create | 2021-11-22T20:05:31.000000 | +------------------------------------------+--------------------------------------+----------------+----------------------------+ $ openstack server event show 976038f6-21c1-40ea-8f86-70c7f27e9ef3 req-3d79161f-36ae-4e9f-b664-5f0d1239e305 +---------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Field | Value | +---------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | action | live-migration | | events | [{'event': 'conductor_migrate_server', 'start_time': '2021-11-22T20:11:38.000000', 'finish_time': '2021-11-22T20:11:40.000000', 'result': 'Error', 'traceback': ' File "/usr/lib/python3/dist-packages/nova/compute/utils.py", line 1346, in decorated_function\n return function(self, context, *args, **kwargs)\n File "/usr/lib/python3/dist-packages/nova/conductor/manager.py", line 291, in migrate_server\n block_migration, disk_over_commit, request_spec)\n File "/usr/lib/python3/dist-packages/nova/conductor/manager.py", line 468, in _live_migrate\n migration.save()\n File "/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 220, in __exit__\n self.force_reraise()\n File "/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise\n six.reraise(self.type_, self.value, self.tb)\n File "/usr/lib/python3/dist-packages/six.py", line 693, in reraise\n raise value\n File "/usr/lib/python3/dist-packages/nova/conductor/manager.py", line 450, in _live_migrate\n task.execute()\n File "/usr/lib/python3/dist-packages/nova/conductor/tasks/base.py", line 27, in wrap\n self.rollback()\n File "/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 220, in __exit__\n self.force_reraise()\n File "/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise\n six.reraise(self.type_, self.value, self.tb)\n File "/usr/lib/python3/dist-packages/six.py", line 693, in reraise\n raise value\n File "/usr/lib/python3/dist-packages/nova/conductor/tasks/base.py", line 24, in wrap\n return original(self)\n File "/usr/lib/python3/dist-packages/nova/conductor/tasks/base.py", line 42, in execute\n return self._execute()\n File "/usr/lib/python3/dist-packages/nova/conductor/tasks/live_migrate.py", line 88, in _execute\n self.destination, dest_node = self._find_destination()\n File "/usr/lib/python3/dist-packages/nova/conductor/tasks/live_migrate.py", line 396, in _find_destination\n return_objects=True, return_alternates=False)\n File "/usr/lib/python3/dist-packages/nova/scheduler/client/query.py", line 42, in select_destinations\n instance_uuids, return_objects, return_alternates)\n File "/usr/lib/python3/dist-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/usr/lib/python3/dist-packages/oslo_messaging/rpc/client.py", line 178, in call\n retry=self.retry)\n File "/usr/lib/python3/dist-packages/oslo_messaging/transport.py", line 128, in _send\n retry=retry)\n File "/usr/lib/python3/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 645, in send\n call_monitor_timeout, retry=retry)\n File "/usr/lib/python3/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 636, in _send\n raise result\n'}] | | instance_uuid | 976038f6-21c1-40ea-8f86-70c7f27e9ef3 | | message | Error | | project_id | 1d13409251dc4cca82f8a935452394c7 | | request_id | req-3d79161f-36ae-4e9f-b664-5f0d1239e305 | | start_time | 2021-11-22T20:11:38.000000 | | user_id | 1f00b12b8f6546d2850027ce43fe78f4 | +---------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ $ openstack server event list 31f13414-bbcf-4b93-8cc0-b7f2a8cf9c96 +------------------------------------------+--------------------------------------+----------------+----------------------------+ | Request ID | Server ID | Action | Start Time | +------------------------------------------+--------------------------------------+----------------+----------------------------+ | req-7bbea833-dbc1-4f72-bf8c-1fe3273139d8 | 31f13414-bbcf-4b93-8cc0-b7f2a8cf9c96 | live-migration | 2021-11-22T20:11:38.000000 | | req-263ede05-03d4-4b05-a581-98b5d58800d7 | 31f13414-bbcf-4b93-8cc0-b7f2a8cf9c96 | live-migration | 2021-11-22T20:10:55.000000 | | req-ba1ee36b-2d3e-4d41-a93a-e2e9ca27df20 | 31f13414-bbcf-4b93-8cc0-b7f2a8cf9c96 | live-migration | 2021-11-22T20:07:23.000000 | | req-fc382109-b95c-452c-a478-0d6e9669e946 | 31f13414-bbcf-4b93-8cc0-b7f2a8cf9c96 | create | 2021-11-22T20:05:23.000000 | +------------------------------------------+--------------------------------------+----------------+----------------------------+ $ openstack server event show 31f13414-bbcf-4b93-8cc0-b7f2a8cf9c96 req-7bbea833-dbc1-4f72-bf8c-1fe3273139d8 +---------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Field | Value | +---------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | action | live-migration | | events | [{'event': 'compute_check_can_live_migrate_destination', 'start_time': '2021-11-22T20:11:40.000000', 'finish_time': '2021-11-22T20:11:40.000000', 'result': 'Error', 'traceback': ' File "/usr/lib/python3/dist-packages/nova/compute/utils.py", line 1346, in decorated_function\n return function(self, context, *args, **kwargs)\n File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 215, in decorated_function\n kwargs[\'instance\'], e, sys.exc_info())\n File "/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 220, in __exit__\n self.force_reraise()\n File "/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise\n six.reraise(self.type_, self.value, self.tb)\n File "/usr/lib/python3/dist-packages/six.py", line 693, in reraise\n raise value\n File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 203, in decorated_function\n return function(self, context, *args, **kwargs)\n File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 6577, in check_can_live_migrate_destination\n raise exception.MigrationPreCheckError(reason=msg)\n'}, {'event': 'conductor_migrate_server', 'start_time': '2021-11-22T20:11:38.000000', 'finish_time': '2021-11-22T20:11:41.000000', 'result': 'Error', 'traceback': ' File "/usr/lib/python3/dist-packages/nova/compute/utils.py", line 1346, in decorated_function\n return function(self, context, *args, **kwargs)\n File "/usr/lib/python3/dist-packages/nova/conductor/manager.py", line 291, in migrate_server\n block_migration, disk_over_commit, request_spec)\n File "/usr/lib/python3/dist-packages/nova/conductor/manager.py", line 468, in _live_migrate\n migration.save()\n File "/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 220, in __exit__\n self.force_reraise()\n File "/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise\n six.reraise(self.type_, self.value, self.tb)\n File "/usr/lib/python3/dist-packages/six.py", line 693, in reraise\n raise value\n File "/usr/lib/python3/dist-packages/nova/conductor/manager.py", line 450, in _live_migrate\n task.execute()\n File "/usr/lib/python3/dist-packages/nova/conductor/tasks/base.py", line 27, in wrap\n self.rollback()\n File "/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 220, in __exit__\n self.force_reraise()\n File "/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise\n six.reraise(self.type_, self.value, self.tb)\n File "/usr/lib/python3/dist-packages/six.py", line 693, in reraise\n raise value\n File "/usr/lib/python3/dist-packages/nova/conductor/tasks/base.py", line 24, in wrap\n return original(self)\n File "/usr/lib/python3/dist-packages/nova/conductor/tasks/base.py", line 42, in execute\n return self._execute()\n File "/usr/lib/python3/dist-packages/nova/conductor/tasks/live_migrate.py", line 88, in _execute\n self.destination, dest_node = self._find_destination()\n File "/usr/lib/python3/dist-packages/nova/conductor/tasks/live_migrate.py", line 396, in _find_destination\n return_objects=True, return_alternates=False)\n File "/usr/lib/python3/dist-packages/nova/scheduler/client/query.py", line 42, in select_destinations\n instance_uuids, return_objects, return_alternates)\n File "/usr/lib/python3/dist-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/usr/lib/python3/dist-packages/oslo_messaging/rpc/client.py", line 178, in call\n retry=self.retry)\n File "/usr/lib/python3/dist-packages/oslo_messaging/transport.py", line 128, in _send\n retry=retry)\n File "/usr/lib/python3/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 645, in send\n call_monitor_timeout, retry=retry)\n File "/usr/lib/python3/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 636, in _send\n raise result\n'}] | | instance_uuid | 31f13414-bbcf-4b93-8cc0-b7f2a8cf9c96 | | message | Error | | project_id | 1d13409251dc4cca82f8a935452394c7 | | request_id | req-7bbea833-dbc1-4f72-bf8c-1fe3273139d8 | | start_time | 2021-11-22T20:11:38.000000 | | user_id | 1f00b12b8f6546d2850027ce43fe78f4 | +---------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ $ juju run -a nova-compute -- "egrep -rnIi 'Pre live migration failed.*violated' /var/log/nova/nova-compute.log" - ReturnCode: 1 Stdout: "" UnitId: nova-compute/0 - Stdout: | 11162:2021-11-22 20:10:57.380 28428 ERROR nova.compute.manager [-] [instance: 976038f6-21c1-40ea-8f86-70c7f27e9ef3] Pre live migration failed at juju-de077f-bs-6.cloud.sts: nova.exception_Remote.RescheduledException_Remote: Build of instance 976038f6-21c1-40ea-8f86-70c7f27e9ef3 was re-scheduled: Anti-affinity instance group policy was violated. UnitId: nova-compute/1 - Stdout: | 10630:2021-11-22 20:07:26.583 27134 ERROR nova.compute.manager [req-269a1cfa-62eb-49b1-8d1a-291305fd6f7c - - - - -] [instance: f742ea5d-0200-4f9d-8088-2f45af8a0928] Pre live migration failed at juju-de077f-bs-9.cloud.sts: nova.exception_Remote.RescheduledException_Remote: Build of instance f742ea5d-0200-4f9d-8088-2f45af8a0928 was re-scheduled: Anti-affinity instance group policy was violated. UnitId: nova-compute/2 - ReturnCode: 1 Stdout: "" UnitId: nova-compute/3 - Stdout: | 10661:2021-11-22 20:07:26.535 24998 ERROR nova.compute.manager [req-b4c675f7-c6ad-4836-8374-59d4904a42d7 - - - - -] [instance: 31f13414-bbcf-4b93-8cc0-b7f2a8cf9c96] Pre live migration failed at juju-de077f-bs-9.cloud.sts: nova.exception_Remote.RescheduledException_Remote: Build of instance 31f13414-bbcf-4b93-8cc0-b7f2a8cf9c96 was re-scheduled: Anti-affinity instance group policy was violated. 11108:2021-11-22 20:10:57.319 24998 ERROR nova.compute.manager [-] [instance: 31f13414-bbcf-4b93-8cc0-b7f2a8cf9c96] Pre live migration failed at juju-de077f-bs-6.cloud.sts: nova.exception_Remote.RescheduledException_Remote: Build of instance 31f13414-bbcf-4b93-8cc0-b7f2a8cf9c96 was re-scheduled: Anti-affinity instance group policy was violated. UnitId: nova-compute/4 $ $ $ $ juju run -a nova-compute -- "egrep -rnIi 'MigrationPreCheckError.*violated' /var/log/nova/nova-compute.log" - ReturnCode: 1 Stdout: "" UnitId: nova-compute/0 - ReturnCode: 1 Stdout: "" UnitId: nova-compute/1 - ReturnCode: 1 Stdout: "" UnitId: nova-compute/4 - Stdout: | 9880:2021-11-22 20:11:39.701 26830 ERROR oslo_messaging.rpc.server [req-7bbea833-dbc1-4f72-bf8c-1fe3273139d8 1f00b12b8f6546d2850027ce43fe78f4 1d13409251dc4cca82f8a935452394c7 - 87eff6be6fe346ba8572ca560301df51 87eff6be6fe346ba8572ca560301df51] Exception during message handling: nova.exception.MigrationPreCheckError: Migration pre-check error: Failed to validate instance group policy due to: Build of instance 31f13414-bbcf-4b93-8cc0-b7f2a8cf9c96 was re-scheduled: Anti-affinity instance group policy was violated. 9925:2021-11-22 20:11:39.701 26830 ERROR oslo_messaging.rpc.server nova.exception.MigrationPreCheckError: Migration pre-check error: Failed to validate instance group policy due to: Build of instance 31f13414-bbcf-4b93-8cc0-b7f2a8cf9c96 was re-scheduled: Anti-affinity instance group policy was violated. UnitId: nova-compute/3 - ReturnCode: 1 Stdout: "" UnitId: nova-compute/2 $ openstack server list --long +--------------------------------------+------+--------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+-----------------------------+------------+ | ID | Name | Status | Task State | Power State | Networks | Image Name | Image ID | Flavor Name | Flavor ID | Availability Zone | Host | Properties | +--------------------------------------+------+--------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+-----------------------------+------------+ | 976038f6-21c1-40ea-8f86-70c7f27e9ef3 | ins3 | ACTIVE | None | Running | private=192.168.21.220 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-7.cloud.sts | | | 31f13414-bbcf-4b93-8cc0-b7f2a8cf9c96 | ins2 | ACTIVE | None | Running | private=192.168.21.17 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-10.cloud.sts | | | f742ea5d-0200-4f9d-8088-2f45af8a0928 | ins1 | ACTIVE | None | Running | private=192.168.21.236 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-8.cloud.sts | | +--------------------------------------+------+--------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+-----------------------------+------------+ $ openstack server migrate ins1 & openstack server migrate ins2 & openstack server migrate ins3 [1] 455600 [2] 455601 [2]+ Done openstack server migrate ins2 $ openstack server list --long +--------------------------------------+------+---------------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+----------------------------+------------+ | ID | Name | Status | Task State | Power State | Networks | Image Name | Image ID | Flavor Name | Flavor ID | Availability Zone | Host | Properties | +--------------------------------------+------+---------------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+----------------------------+------------+ | 976038f6-21c1-40ea-8f86-70c7f27e9ef3 | ins3 | VERIFY_RESIZE | None | Running | private=192.168.21.220 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-9.cloud.sts | | | 31f13414-bbcf-4b93-8cc0-b7f2a8cf9c96 | ins2 | VERIFY_RESIZE | None | Running | private=192.168.21.17 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-6.cloud.sts | | | f742ea5d-0200-4f9d-8088-2f45af8a0928 | ins1 | VERIFY_RESIZE | None | Running | private=192.168.21.236 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-9.cloud.sts | | +--------------------------------------+------+---------------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+----------------------------+------------+ [1]+ Done openstack server migrate ins1 $ openstack server resize confirm ins1 $ openstack server resize confirm ins2 $ openstack server resize confirm ins3 $ openstack server delete ins1 ins2 ins3 $ openstack server create --network private --volume vol1 --flavor 100 --hint group=$GROUP_ID ins1 && openstack server create --network private --volume vol2 --flavor 100 --hint group=$GROUP_ID ins2 && openstack server create --network private --volume vol3 --flavor 100 --hint group=$GROUP_ID ins3 +-------------------------------------+--------------------------------------+ | Field | Value | +-------------------------------------+--------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | | | OS-EXT-SRV-ATTR:host | None | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | | OS-EXT-SRV-ATTR:instance_name | | | OS-EXT-STS:power_state | NOSTATE | | OS-EXT-STS:task_state | scheduling | | OS-EXT-STS:vm_state | building | | OS-SRV-USG:launched_at | None | | OS-SRV-USG:terminated_at | None | | accessIPv4 | | | accessIPv6 | | | addresses | | | adminPass | ec5QqGQW6ccN | | config_drive | | | created | 2021-11-22T20:21:59Z | | flavor | test-flavor (100) | | hostId | | | id | ad620d96-7652-468d-8aa0-0e7e9ea3643a | | image | N/A (booted from volume) | | key_name | None | | name | ins1 | | progress | 0 | | project_id | 1d13409251dc4cca82f8a935452394c7 | | properties | | | security_groups | name='default' | | status | BUILD | | updated | 2021-11-22T20:21:58Z | | user_id | 1f00b12b8f6546d2850027ce43fe78f4 | | volumes_attached | | +-------------------------------------+--------------------------------------+ +-------------------------------------+--------------------------------------+ | Field | Value | +-------------------------------------+--------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | | | OS-EXT-SRV-ATTR:host | None | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | | OS-EXT-SRV-ATTR:instance_name | | | OS-EXT-STS:power_state | NOSTATE | | OS-EXT-STS:task_state | scheduling | | OS-EXT-STS:vm_state | building | | OS-SRV-USG:launched_at | None | | OS-SRV-USG:terminated_at | None | | accessIPv4 | | | accessIPv6 | | | addresses | | | adminPass | 4o6YhTYao6g8 | | config_drive | | | created | 2021-11-22T20:22:06Z | | flavor | test-flavor (100) | | hostId | | | id | 39cd89a4-1f00-4e99-92d5-9da26c5fb800 | | image | N/A (booted from volume) | | key_name | None | | name | ins2 | | progress | 0 | | project_id | 1d13409251dc4cca82f8a935452394c7 | | properties | | | security_groups | name='default' | | status | BUILD | | updated | 2021-11-22T20:22:06Z | | user_id | 1f00b12b8f6546d2850027ce43fe78f4 | | volumes_attached | | +-------------------------------------+--------------------------------------+ +-------------------------------------+--------------------------------------+ | Field | Value | +-------------------------------------+--------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | | | OS-EXT-SRV-ATTR:host | None | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | | OS-EXT-SRV-ATTR:instance_name | | | OS-EXT-STS:power_state | NOSTATE | | OS-EXT-STS:task_state | scheduling | | OS-EXT-STS:vm_state | building | | OS-SRV-USG:launched_at | None | | OS-SRV-USG:terminated_at | None | | accessIPv4 | | | accessIPv6 | | | addresses | | | adminPass | 569bdhAgNf5z | | config_drive | | | created | 2021-11-22T20:22:12Z | | flavor | test-flavor (100) | | hostId | | | id | 304913c6-5d8f-4290-b8e5-b0fc99f01a3b | | image | N/A (booted from volume) | | key_name | None | | name | ins3 | | progress | 0 | | project_id | 1d13409251dc4cca82f8a935452394c7 | | properties | | | security_groups | name='default' | | status | BUILD | | updated | 2021-11-22T20:22:11Z | | user_id | 1f00b12b8f6546d2850027ce43fe78f4 | | volumes_attached | | +-------------------------------------+--------------------------------------+ $ openstack server list --long +--------------------------------------+------+--------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+-----------------------------+------------+ | ID | Name | Status | Task State | Power State | Networks | Image Name | Image ID | Flavor Name | Flavor ID | Availability Zone | Host | Properties | +--------------------------------------+------+--------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+-----------------------------+------------+ | 304913c6-5d8f-4290-b8e5-b0fc99f01a3b | ins3 | ACTIVE | None | Running | private=192.168.21.114 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-6.cloud.sts | | | 39cd89a4-1f00-4e99-92d5-9da26c5fb800 | ins2 | ACTIVE | None | Running | private=192.168.21.186 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-10.cloud.sts | | | ad620d96-7652-468d-8aa0-0e7e9ea3643a | ins1 | ACTIVE | None | Running | private=192.168.21.130 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-8.cloud.sts | | +--------------------------------------+------+--------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+-----------------------------+------------+ $ openstack server migrate ins1 & openstack server migrate ins2 & openstack server migrate ins3 [1] 456737 [2] 456738 [2]+ Done openstack server migrate ins2 $ openstack server list --long +--------------------------------------+------+---------------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+----------------------------+------------+ | ID | Name | Status | Task State | Power State | Networks | Image Name | Image ID | Flavor Name | Flavor ID | Availability Zone | Host | Properties | +--------------------------------------+------+---------------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+----------------------------+------------+ | 304913c6-5d8f-4290-b8e5-b0fc99f01a3b | ins3 | VERIFY_RESIZE | None | Running | private=192.168.21.114 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-7.cloud.sts | | | 39cd89a4-1f00-4e99-92d5-9da26c5fb800 | ins2 | VERIFY_RESIZE | None | Running | private=192.168.21.186 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-9.cloud.sts | | | ad620d96-7652-468d-8aa0-0e7e9ea3643a | ins1 | ACTIVE | None | Running | private=192.168.21.130 | N/A (booted from volume) | N/A (booted from volume) | test-flavor | 100 | nova | juju-de077f-bs-8.cloud.sts | | +--------------------------------------+------+---------------+------------+-------------+------------------------+--------------------------+--------------------------+-------------+-----------+-------------------+----------------------------+------------+ [1]+ Done openstack server migrate ins1 $ openstack server event list ad620d96-7652-468d-8aa0-0e7e9ea3643a +------------------------------------------+--------------------------------------+---------+----------------------------+ | Request ID | Server ID | Action | Start Time | +------------------------------------------+--------------------------------------+---------+----------------------------+ | req-0e12d7f1-a00c-461b-ad8f-a96aad31dabe | ad620d96-7652-468d-8aa0-0e7e9ea3643a | migrate | 2021-11-22T20:23:53.000000 | | req-03a7381e-68df-4bd1-8dcc-95663430923f | ad620d96-7652-468d-8aa0-0e7e9ea3643a | create | 2021-11-22T20:21:58.000000 | +------------------------------------------+--------------------------------------+---------+----------------------------+ $ openstack server event show ad620d96-7652-468d-8aa0-0e7e9ea3643a req-0e12d7f1-a00c-461b-ad8f-a96aad31dabe +---------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Field | Value | +---------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | action | migrate | | events | [{'event': 'cold_migrate', 'start_time': '2021-11-22T20:23:55.000000', 'finish_time': None, 'result': None, 'traceback': None}, {'event': 'conductor_migrate_server', 'start_time': '2021-11-22T20:23:55.000000', 'finish_time': None, 'result': None, 'traceback': None}, {'event': 'compute_prep_resize', 'start_time': '2021-11-22T20:23:54.000000', 'finish_time': '2021-11-22T20:23:56.000000', 'result': 'Error', 'traceback': ' File "/usr/lib/python3/dist-packages/nova/compute/utils.py", line 1346, in decorated_function\n return function(self, context, *args, **kwargs)\n File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 215, in decorated_function\n kwargs[\'instance\'], e, sys.exc_info())\n File "/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 220, in __exit__\n self.force_reraise()\n File "/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise\n six.reraise(self.type_, self.value, self.tb)\n File "/usr/lib/python3/dist-packages/six.py", line 693, in reraise\n raise value\n File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 203, in decorated_function\n return function(self, context, *args, **kwargs)\n File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 4726, in prep_resize\n instance_type)\n File "/usr/lib/python3.6/contextlib.py", line 99, in __exit__\n self.gen.throw(type, value, traceback)\n File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 8644, in _error_out_instance_on_exception\n raise error.inner_exception\n File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 4706, in prep_resize\n scheduler_hints)\n File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 1572, in _validate_instance_group_policy\n _do_validation(context, instance, group)\n File "/usr/lib/python3/dist-packages/oslo_concurrency/lockutils.py", line 328, in inner\n return f(*args, **kwargs)\n File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 1557, in _do_validation\n reason=msg)\n'}, {'event': 'cold_migrate', 'start_time': '2021-11-22T20:23:53.000000', 'finish_time': '2021-11-22T20:23:56.000000', 'result': 'Error', 'traceback': ' File "/usr/lib/python3/dist-packages/nova/conductor/manager.py", line 299, in migrate_server\n host_list)\n File "/usr/lib/python3/dist-packages/nova/conductor/manager.py", line 359, in _cold_migrate\n raise exception.NoValidHost(reason=msg)\n'}, {'event': 'conductor_migrate_server', 'start_time': '2021-11-22T20:23:53.000000', 'finish_time': '2021-11-22T20:23:56.000000', 'result': 'Error', 'traceback': ' File "/usr/lib/python3/dist-packages/nova/compute/utils.py", line 1346, in decorated_function\n return function(self, context, *args, **kwargs)\n File "/usr/lib/python3/dist-packages/nova/conductor/manager.py", line 299, in migrate_server\n host_list)\n File "/usr/lib/python3/dist-packages/nova/conductor/manager.py", line 359, in _cold_migrate\n raise exception.NoValidHost(reason=msg)\n'}] | | instance_uuid | ad620d96-7652-468d-8aa0-0e7e9ea3643a | | message | Error | | project_id | 1d13409251dc4cca82f8a935452394c7 | | request_id | req-0e12d7f1-a00c-461b-ad8f-a96aad31dabe | | start_time | 2021-11-22T20:23:53.000000 | | user_id | 1f00b12b8f6546d2850027ce43fe78f4 | +---------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ $ juju run -a nova-compute -- "egrep -rnIi 'ad620d96-7652-468d-8aa0-0e7e9ea3643a.*violated' /var/log/nova/nova-compute.log" - ReturnCode: 1 Stdout: "" UnitId: nova-compute/0 - Stdout: | 12425:2021-11-22 20:23:56.234 28428 ERROR nova.compute.manager [instance: ad620d96-7652-468d-8aa0-0e7e9ea3643a] nova.exception.RescheduledException: Build of instance ad620d96-7652-468d-8aa0-0e7e9ea3643a was re-scheduled: Anti-affinity instance group policy was violated. 12432:2021-11-22 20:23:56.234 28428 ERROR nova.compute.manager [instance: ad620d96-7652-468d-8aa0-0e7e9ea3643a] nova.exception.InstanceFaultRollback: Instance rollback performed due to: Build of instance ad620d96-7652-468d-8aa0-0e7e9ea3643a was re-scheduled: Anti-affinity instance group policy was violated. 12513:2021-11-22 20:23:56.293 28428 INFO nova.compute.manager [req-0e12d7f1-a00c-461b-ad8f-a96aad31dabe 1f00b12b8f6546d2850027ce43fe78f4 1d13409251dc4cca82f8a935452394c7 - 87eff6be6fe346ba8572ca560301df51 87eff6be6fe346ba8572ca560301df51] [instance: ad620d96-7652-468d-8aa0-0e7e9ea3643a] Setting instance back to active after: Instance rollback performed due to: Build of instance ad620d96-7652-468d-8aa0-0e7e9ea3643a was re-scheduled: Anti-affinity instance group policy was violated. 12524:2021-11-22 20:23:56.466 28428 ERROR oslo_messaging.rpc.server [req-0e12d7f1-a00c-461b-ad8f-a96aad31dabe 1f00b12b8f6546d2850027ce43fe78f4 1d13409251dc4cca82f8a935452394c7 - 87eff6be6fe346ba8572ca560301df51 87eff6be6fe346ba8572ca560301df51] Exception during message handling: nova.exception.RescheduledException: Build of instance ad620d96-7652-468d-8aa0-0e7e9ea3643a was re-scheduled: Anti-affinity instance group policy was violated. 12536:2021-11-22 20:23:56.466 28428 ERROR oslo_messaging.rpc.server nova.exception.InstanceFaultRollback: Instance rollback performed due to: Build of instance ad620d96-7652-468d-8aa0-0e7e9ea3643a was re-scheduled: Anti-affinity instance group policy was violated. 12593:2021-11-22 20:23:56.466 28428 ERROR oslo_messaging.rpc.server nova.exception.RescheduledException: Build of instance ad620d96-7652-468d-8aa0-0e7e9ea3643a was re-scheduled: Anti-affinity instance group policy was violated. UnitId: nova-compute/1 - ReturnCode: 1 Stdout: "" UnitId: nova-compute/2 - ReturnCode: 1 Stdout: "" UnitId: nova-compute/3 - ReturnCode: 1 Stdout: "" UnitId: nova-compute/4 $ juju run -u mysql/0 -- mysql -u root -pREDACTED -e "select * from nova.migrations;" created_at updated_at deleted_at id source_compute dest_compute dest_host status instance_uuid old_instance_type_id new_instance_type_id source_node dest_node deleted migration_type hidden memory_total memory_processed memory_remaining disk_total disk_processed disk_remaining uuid 2021-11-22 19:56:32 2021-11-22 19:57:04 2021-11-22 19:57:41 1 juju-de077f-bs-10.cloud.sts juju-de077f-bs-9.cloud.sts NULL completed 9b22564f-c9c6-48b8-886d-18f83460e745 9 9 juju-de077f-bs-10.cloud.sts juju-de077f-bs-9.cloud.sts 1 live-migration 0 0 0 0 0 0 0 24446225-e323-47d8-ba10-d7cd51157f38 2021-11-22 19:56:33 2021-11-22 19:57:08 2021-11-22 19:57:43 2 juju-de077f-bs-8.cloud.sts juju-de077f-bs-9.cloud.sts NULL completed 24584e19-0ed7-4572-87c4-44d3735863b9 9 9 juju-de077f-bs-8.cloud.sts juju-de077f-bs-9.cloud.sts 2 live-migration 0 0 0 0 0 0 0 31634035-8947-4b53-9904-6584c285635b 2021-11-22 19:56:36 2021-11-22 19:57:08 2021-11-22 19:57:43 3 juju-de077f-bs-6.cloud.sts juju-de077f-bs-7.cloud.sts NULL completed 04412717-0322-45f3-a81c-ce8f1a2f4fd0 9 9 juju-de077f-bs-6.cloud.sts juju-de077f-bs-7.cloud.sts 3 live-migration 0 0 0 0 0 0 0 c11dd4f3-d9a2-4519-ad9a-39c1af76adfd 2021-11-22 20:00:40 2021-11-22 20:01:35 2021-11-22 20:02:00 4 juju-de077f-bs-10.cloud.sts juju-de077f-bs-9.cloud.sts 10.5.0.239 confirmed eec2616b-8a60-47a2-946a-c52483b79513 9 9 juju-de077f-bs-10.cloud.sts juju-de077f-bs-9.cloud.sts 4 migration 0 NULL NULL NULL NULL NULL NULL c30cb860-2ad3-4a5a-88a5-87d5a68cca91 2021-11-22 20:00:40 2021-11-22 20:01:30 2021-11-22 20:01:59 5 juju-de077f-bs-8.cloud.sts juju-de077f-bs-9.cloud.sts 10.5.0.239 confirmed 22fd449d-9760-464f-9fbd-83b6d100c08c 9 9 juju-de077f-bs-8.cloud.sts juju-de077f-bs-9.cloud.sts 5 migration 0 NULL NULL NULL NULL NULL NULL 8e062ee6-4e1d-4f9e-9549-01bcc8e283a2 2021-11-22 20:00:43 2021-11-22 20:01:40 2021-11-22 20:02:00 6 juju-de077f-bs-6.cloud.sts juju-de077f-bs-7.cloud.sts 10.5.1.208 confirmed cfdf16f0-b271-49b9-8cd8-8839892df6e6 9 9 juju-de077f-bs-6.cloud.sts juju-de077f-bs-7.cloud.sts 6 migration 0 NULL NULL NULL NULL NULL NULL fc133bd6-87f9-46e8-9e8f-a86c87ecf7ef 2021-11-22 20:07:24 2021-11-22 20:07:27 2021-11-22 20:21:46 7 juju-de077f-bs-10.cloud.sts juju-de077f-bs-9.cloud.sts NULL error 31f13414-bbcf-4b93-8cc0-b7f2a8cf9c96 9 9 juju-de077f-bs-10.cloud.sts juju-de077f-bs-9.cloud.sts 7 live-migration 0 NULL NULL NULL NULL NULL NULL da89b577-55dc-4a3a-92cc-fb07fd486733 2021-11-22 20:07:24 2021-11-22 20:07:27 2021-11-22 20:21:47 8 juju-de077f-bs-8.cloud.sts juju-de077f-bs-9.cloud.sts NULL error f742ea5d-0200-4f9d-8088-2f45af8a0928 9 9 juju-de077f-bs-8.cloud.sts juju-de077f-bs-9.cloud.sts 8 live-migration 0 NULL NULL NULL NULL NULL NULL 712d9c5a-ea15-4d70-a065-bf382244ae92 2021-11-22 20:07:27 2021-11-22 20:07:45 2021-11-22 20:21:46 9 juju-de077f-bs-6.cloud.sts juju-de077f-bs-7.cloud.sts NULL completed 976038f6-21c1-40ea-8f86-70c7f27e9ef3 9 9 juju-de077f-bs-6.cloud.sts juju-de077f-bs-7.cloud.sts 9 live-migration 0 0 0 0 0 0 0 8095e865-d9e4-4eaf-b7ec-8827e67c1d32 2021-11-22 20:10:55 2021-11-22 20:10:57 2021-11-22 20:21:46 10 juju-de077f-bs-10.cloud.sts juju-de077f-bs-6.cloud.sts NULL error 31f13414-bbcf-4b93-8cc0-b7f2a8cf9c96 9 9 juju-de077f-bs-10.cloud.sts juju-de077f-bs-6.cloud.sts 10 live-migration 0 NULL NULL NULL NULL NULL NULL 02593162-55b5-49b0-bb70-6af767536df3 2021-11-22 20:10:55 2021-11-22 20:10:57 2021-11-22 20:21:46 11 juju-de077f-bs-7.cloud.sts juju-de077f-bs-6.cloud.sts NULL error 976038f6-21c1-40ea-8f86-70c7f27e9ef3 9 9 juju-de077f-bs-7.cloud.sts juju-de077f-bs-6.cloud.sts 11 live-migration 0 NULL NULL NULL NULL NULL NULL 9a836c52-2dd3-42e0-891b-48688631f002 2021-11-22 20:10:58 2021-11-22 20:11:12 2021-11-22 20:21:47 12 juju-de077f-bs-8.cloud.sts juju-de077f-bs-9.cloud.sts NULL completed f742ea5d-0200-4f9d-8088-2f45af8a0928 9 9 juju-de077f-bs-8.cloud.sts juju-de077f-bs-9.cloud.sts 12 live-migration 0 0 0 0 0 0 0 2b95ae4d-2528-4385-b62c-738873e12e3c 2021-11-22 20:11:38 2021-11-22 20:11:41 2021-11-22 20:21:46 13 juju-de077f-bs-10.cloud.sts NULL NULL error 31f13414-bbcf-4b93-8cc0-b7f2a8cf9c96 9 9 NULL NULL 13 live-migration 0 NULL NULL NULL NULL NULL NULL badb30f8-1aa3-4be9-85ac-d499f7bc986c 2021-11-22 20:11:38 2021-11-22 20:11:40 2021-11-22 20:21:46 14 juju-de077f-bs-7.cloud.sts NULL NULL error 976038f6-21c1-40ea-8f86-70c7f27e9ef3 9 9 NULL NULL 14 live-migration 0 NULL NULL NULL NULL NULL NULL 673afc0d-138f-49ae-ab67-bccc3537f98e 2021-11-22 20:11:41 2021-11-22 20:12:00 2021-11-22 20:21:47 15 juju-de077f-bs-9.cloud.sts juju-de077f-bs-8.cloud.sts NULL completed f742ea5d-0200-4f9d-8088-2f45af8a0928 9 9 juju-de077f-bs-9.cloud.sts juju-de077f-bs-8.cloud.sts 15 live-migration 0 0 0 0 0 0 0 e9e4a9cf-e394-4ed3-86c2-bf88b959ea82 2021-11-22 20:20:09 2021-11-22 20:21:17 2021-11-22 20:21:46 16 juju-de077f-bs-10.cloud.sts juju-de077f-bs-6.cloud.sts 10.5.3.173 confirmed 31f13414-bbcf-4b93-8cc0-b7f2a8cf9c96 9 9 juju-de077f-bs-10.cloud.sts juju-de077f-bs-6.cloud.sts 16 migration 0 NULL NULL NULL NULL NULL NULL c7e7fc1a-37f0-45a7-af07-57a01ebedc97 2021-11-22 20:20:10 2021-11-22 20:21:24 2021-11-22 20:21:46 17 juju-de077f-bs-7.cloud.sts juju-de077f-bs-9.cloud.sts 10.5.0.239 confirmed 976038f6-21c1-40ea-8f86-70c7f27e9ef3 9 9 juju-de077f-bs-7.cloud.sts juju-de077f-bs-9.cloud.sts 17 migration 0 NULL NULL NULL NULL NULL NULL cb5fc18b-4bdb-490a-8ad9-2b2ab8870517 2021-11-22 20:20:10 2021-11-22 20:21:08 2021-11-22 20:21:47 18 juju-de077f-bs-8.cloud.sts juju-de077f-bs-9.cloud.sts 10.5.0.239 confirmed f742ea5d-0200-4f9d-8088-2f45af8a0928 9 9 juju-de077f-bs-8.cloud.sts juju-de077f-bs-9.cloud.sts 18 migration 0 NULL NULL NULL NULL NULL NULL 1c397e10-8500-4b02-8c67-64cfb5146145 2021-11-22 20:23:51 2021-11-22 20:24:08 NULL 19 juju-de077f-bs-10.cloud.sts juju-de077f-bs-9.cloud.sts 10.5.0.239 finished 39cd89a4-1f00-4e99-92d5-9da26c5fb800 9 9 juju-de077f-bs-10.cloud.sts juju-de077f-bs-9.cloud.sts 0 migration 0 NULL NULL NULL NULL NULL NULL 2f40cf4b-43c4-4709-81cc-3452d151fb1f 2021-11-22 20:23:52 2021-11-22 20:24:10 NULL 20 juju-de077f-bs-6.cloud.sts juju-de077f-bs-7.cloud.sts 10.5.1.208 finished 304913c6-5d8f-4290-b8e5-b0fc99f01a3b 9 9 juju-de077f-bs-6.cloud.sts juju-de077f-bs-7.cloud.sts 0 migration 0 NULL NULL NULL NULL NULL NULL 2e332312-189e-420c-80f1-cd5df84a5e13 2021-11-22 20:23:53 2021-11-22 20:23:56 NULL 21 juju-de077f-bs-8.cloud.sts NULL NULL error ad620d96-7652-468d-8aa0-0e7e9ea3643a 9 9 juju-de077f-bs-8.cloud.sts NULL 0 migration 0 NULL NULL NULL NULL NULL NULL 6961b0de-35c0-494e-a950-f4ebc8daf306 mysql: [Warning] Using a password on the command line interface can be insecure. $