the vms turn transient after libvirt pod restarts

Bug #1760003 reported by wind
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
R5.0
In Progress
Undecided
wind
Trunk
In Progress
Undecided
wind
openstack-helm
Fix Released
Undecided
wind

Bug Description

The vms create by NOVA should be persistent ,but after libvirt pod restarts,the vms created before turn transient. Then operate these vms ,the nova-compute will throw this exception:

| fault | {"message": "Requested operation is not valid: cannot do managed save for transient domain", "code": 500, "details": " File \"/usr/lib/python2.7/site-packages/nova/compute/manager.py\", line 207, in decorated_function |
| | File \"/usr/lib/python2.7/site-packages/nova/compute/manager.py\", line 4181, in suspend_instance |
| | File \"/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py\", line 2519, in suspend |
| | File \"/usr/lib/python2.7/site-packages/nova/virt/libvirt/guest.py\", line 489, in save_memory_state |
| | File \"/usr/lib/python2.7/site-packages/eventlet/tpool.py\", line 186, in doit |
| | result = proxy_call(self._autowrap, f, *args, **kwargs) |
| | File \"/usr/lib/python2.7/site-packages/eventlet/tpool.py\", line 144, in proxy_call |
| | rv = execute(f, *args, **kwargs) |
| | File \"/usr/lib/python2.7/site-packages/eventlet/tpool.py\", line 125, in execute |
| | six.reraise(c, e, tb) |
| | File \"/usr/lib/python2.7/site-packages/eventlet/tpool.py\", line 83, in tworker |
| | rv = meth(*args, **kwargs) |
| | File \"/usr/lib64/python2.7/site-packages/libvirt.py\", line 1404, in managedSave |
| | if ret == -1: raise libvirtError ('virDomainManagedSave() failed', dom=self) |
| | ", "created": "2018-03-15T07:13:38Z"}

This is because that the directory /etc/libivrt/qemu in pod contains vitual machines xml files and it is nonpersistent, the xmls files disappear after the pod restarts, so we mount it
to hostpath /etc/libvirt/qemu to make the directory persistent.

wind (better)
Changed in openstack-helm:
assignee: nobody → wind (better)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to openstack-helm (master)

Fix proposed to branch: master
Review: https://review.openstack.org/557889

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to openstack-helm (master)

Reviewed: https://review.openstack.org/557889
Committed: https://git.openstack.org/cgit/openstack/openstack-helm/commit/?id=0f0e696ae8d5b8b87c84fa8942c1b2c91e90b85e
Submitter: Zuul
Branch: master

commit 0f0e696ae8d5b8b87c84fa8942c1b2c91e90b85e
Author: Betterme001 <email address hidden>
Date: Fri Mar 30 11:23:52 2018 +0800

    fix the vms turn transient after libvirt pod restarts

    After libvirt pod restarts, the virtual machines created before
    turn transient ,then opetrate these vms ,nova-compute will throw
    exception. This is because that the directory /etc/libivrt/qemu
    in pod contains vitual machines xml files and it is temporary,
    the xmls files disappear after the pod restarts, so we mount it
    to hostpath /etc/libvirt/qemu.

    Change-Id: I48fd712c2b0565cb2cfe850482e8501f4e5022a4
    Closed-bug: 1760003

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/42067
Submitter: <email address hidden> (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R5.0

Review in progress for https://review.opencontrail.org/42211
Submitter: <email address hidden> (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged
Download full text (17.9 KiB)

Reviewed: https://review.opencontrail.org/42067
Committed: http://github.com/Juniper/openstack-helm/commit/dca1f14a130a46d5805aa1d267a2116a589b7db2
Submitter: Zuul v3 CI (<email address hidden>)
Branch: master

commit dca1f14a130a46d5805aa1d267a2116a589b7db2
Author: Madhukar Nayakbomman <email address hidden>
Date: Wed Apr 18 00:15:59 2018 -0700

Rebasing openstack-helm repo

Changes from below commits are been added as part of rebase

Cinder: allow Ceph RBD pool params to be tuned

This PS exposes the Ceph RBD pool params to the cinder chart, allowing
them to be tuned.

Change-Id: I615e999928948193b24cc4978efb31bd1b36f8f7

Armada check: Enable storage for OSH-infra services

This enables storage for the osh-infra services running in the
armada job

Change-Id: Ic0f11a9d161529c6fb58474e856032745b07a032

remove trailing ws

Change-Id: Ida8e4a5d072f8dff635dfffd4336d697ab1d4753

Add ldap support

This patch set adds python ldap support to keystone.

Change-Id: I420612555d92f6fb932f2f210cc36f3f7f5afc97
Signed-off-by: Tin Lam <email address hidden>

Reduce the number of workers spawned by services

This PS reduces the number of processes spawned by services, as
with Kubernetes load distribution can be better managed by a larger
number of single threaded pods (up to a certain point) and doing so
also provides both increased avilibility, leading to smoother rolling
updates. In addtion when running single replicas resource consuption
is reduced.

Change-Id: Ifb7494a0804913d843a072e10d26c6ec53c3bd16

DB-Drop-Jobs: consolidate to helm-toolkit

This PS consolidates the DB-Drop Job to helm-toolkit.

Change-Id: Ia2b035d730bf612086a9fd9b5d14aba494f56dc7

Add trustee domain

This patch set allows for searching the trustee user in a specified
domain rather than just the "default" domain.

Change-Id: I53ee6816e02c25e577244015fe5aea0870e0fd32
Signed-off-by: Tin Lam <email address hidden>

Add Makefile

This patchset adds a Makefile for each component under tools/images

Change-Id: I84d8bda0313e921f0921dfef10d14469ed26ff5c

Ingress controller service: consolidate to helm-toolkit

This PS consolidates the Ingress controller service, that is used
to resolve internal requests to public endpoints correctly, to
helm-toolkit.

Change-Id: If7c7deca1b8289a32709f7dc7c936883469aadfe

Cinder: Fix sudoers reference in configmap

The cinder_sudoers entry in the cinder configmap-etc was consuming
the neutron_sudoers entry in the values.yaml. This corrects it to
point at cinder_sudoers instead

Change-Id: I214912b3ed4185a201f4f94e82eaa50d6d321018

Cinder: Fix default uid for cinder user with loci images

This PS corrects the UID for the cinder user used with loci images
in the cinder chart.

Change-Id: I1001711928fb47e77f01c8e83f88ec317a46498e

glance-api: add dependency on message bus

without this the api starts up in a non-working state, the bootstrap
job then runs and give is images which are stuck queued

Change-Id: Ie3e03620618b1c46882c05b3a5ef8745c78af6a3

Neutron: SR-IOV support

This PS adds SR-IOV Support to OSH.

Change-Id: Ia744c6d7c4a45be7728bba3213b50f1246b897db

Cinder: add qemu profile to cinder images

This PS adds the qemu profile to cinder images...

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :
Download full text (17.9 KiB)

Reviewed: https://review.opencontrail.org/42211
Committed: http://github.com/Juniper/openstack-helm/commit/94b2d9580cfaf0efdb2f74e80d3f9f623058dc00
Submitter: Zuul v3 CI (<email address hidden>)
Branch: R5.0

commit 94b2d9580cfaf0efdb2f74e80d3f9f623058dc00
Author: Madhukar Nayakbomman <email address hidden>
Date: Wed Apr 18 00:15:59 2018 -0700

Rebasing openstack-helm repo

Changes from below commits are been added as part of rebase

Cinder: allow Ceph RBD pool params to be tuned

This PS exposes the Ceph RBD pool params to the cinder chart, allowing
them to be tuned.

Change-Id: I615e999928948193b24cc4978efb31bd1b36f8f7

Armada check: Enable storage for OSH-infra services

This enables storage for the osh-infra services running in the
armada job

Change-Id: Ic0f11a9d161529c6fb58474e856032745b07a032

remove trailing ws

Change-Id: Ida8e4a5d072f8dff635dfffd4336d697ab1d4753

Add ldap support

This patch set adds python ldap support to keystone.

Change-Id: I420612555d92f6fb932f2f210cc36f3f7f5afc97
Signed-off-by: Tin Lam <email address hidden>

Reduce the number of workers spawned by services

This PS reduces the number of processes spawned by services, as
with Kubernetes load distribution can be better managed by a larger
number of single threaded pods (up to a certain point) and doing so
also provides both increased avilibility, leading to smoother rolling
updates. In addtion when running single replicas resource consuption
is reduced.

Change-Id: Ifb7494a0804913d843a072e10d26c6ec53c3bd16

DB-Drop-Jobs: consolidate to helm-toolkit

This PS consolidates the DB-Drop Job to helm-toolkit.

Change-Id: Ia2b035d730bf612086a9fd9b5d14aba494f56dc7

Add trustee domain

This patch set allows for searching the trustee user in a specified
domain rather than just the "default" domain.

Change-Id: I53ee6816e02c25e577244015fe5aea0870e0fd32
Signed-off-by: Tin Lam <email address hidden>

Add Makefile

This patchset adds a Makefile for each component under tools/images

Change-Id: I84d8bda0313e921f0921dfef10d14469ed26ff5c

Ingress controller service: consolidate to helm-toolkit

This PS consolidates the Ingress controller service, that is used
to resolve internal requests to public endpoints correctly, to
helm-toolkit.

Change-Id: If7c7deca1b8289a32709f7dc7c936883469aadfe

Cinder: Fix sudoers reference in configmap

The cinder_sudoers entry in the cinder configmap-etc was consuming
the neutron_sudoers entry in the values.yaml. This corrects it to
point at cinder_sudoers instead

Change-Id: I214912b3ed4185a201f4f94e82eaa50d6d321018

Cinder: Fix default uid for cinder user with loci images

This PS corrects the UID for the cinder user used with loci images
in the cinder chart.

Change-Id: I1001711928fb47e77f01c8e83f88ec317a46498e

glance-api: add dependency on message bus

without this the api starts up in a non-working state, the bootstrap
job then runs and give is images which are stuck queued

Change-Id: Ie3e03620618b1c46882c05b3a5ef8745c78af6a3

Neutron: SR-IOV support

This PS adds SR-IOV Support to OSH.

Change-Id: Ia744c6d7c4a45be7728bba3213b50f1246b897db

Cinder: add qemu profile to cinder images

This PS adds the qemu profile to cinder images

...

wind (better)
Changed in openstack-helm:
status: New → Fix Committed
Gage Hugo (gagehugo)
Changed in openstack-helm:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.