NetApp NFS driver slow for creating a volume native python threads

[Felipe Rodrigues]

The NetApp NFS driver is spawning a Python native thread to
schedule image cache cleanups, which can lead to unpredictable
behavior such as thread starvation due to its hunger to preempt
other Cinder's fellow threads.

As result, the driver can be very slow for creating a volume from an image.

[Sofia Enriquez (lsofia-enriquez)]

Fix proposed to master https://review.opendev.org/c/openstack/cinder/+/853678

[Eric Harney (eharney)]

https://review.opendev.org/c/openstack/cinder/+/853678

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/cinder/+/853678
Committed: https://opendev.org/openstack/cinder/commit/a869c8e222a68af731eb72e9f8ec5f0755db0326
Submitter: "Zuul (22348)"
Branch: master

commit a869c8e222a68af731eb72e9f8ec5f0755db0326
Author: Fernando Ferraz <email address hidden>
Date: Tue Aug 16 03:48:43 2022 +0000

    Fix NetApp NFS driver to never spawn a native thread again

    The NetApp NFS driver is spawning a Python native thread to
    schedule image cache cleanups, which can lead to unpredictable
    behavior such as thread starvation due to its hunger to preempt
    other Cinder's fellow threads.

    This patch fixes it by reimplementing the NFS image cache cleanup
    task as a green thread with a customized periodic interval.

    The patch adds the configuration
    option ´netapp_nfs_image_cache_cleanup_interval´ to allow
    operators to set an interval in seconds between calls to the image
    cleanup task.

    Closes-Bug: #2008017
    Change-Id: I609a4f056d19f67aa7b8113bb38b9e9083f24124

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/cinder 22.0.0.0rc1 release candidate.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/zed
Review: https://review.opendev.org/c/openstack/cinder/+/878540

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/cinder/+/878540
Committed: https://opendev.org/openstack/cinder/commit/3dde6b7d99956b4643796025905d1150123f8d3f
Submitter: "Zuul (22348)"
Branch: stable/zed

commit 3dde6b7d99956b4643796025905d1150123f8d3f
Author: Fernando Ferraz <email address hidden>
Date: Tue Aug 16 03:48:43 2022 +0000

    Fix NetApp NFS driver to never spawn a native thread again

    The NetApp NFS driver is spawning a Python native thread to
    schedule image cache cleanups, which can lead to unpredictable
    behavior such as thread starvation due to its hunger to preempt
    other Cinder's fellow threads.

    This patch fixes it by reimplementing the NFS image cache cleanup
    task as a green thread with a customized periodic interval.

    The patch adds the configuration
    option ´netapp_nfs_image_cache_cleanup_interval´ to allow
    operators to set an interval in seconds between calls to the image
    cleanup task.

    Closes-Bug: #2008017
    Change-Id: I609a4f056d19f67aa7b8113bb38b9e9083f24124
    (cherry picked from commit a869c8e222a68af731eb72e9f8ec5f0755db0326)

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/cinder 21.2.0 release.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/yoga
Review: https://review.opendev.org/c/openstack/cinder/+/885919

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/xena
Review: https://review.opendev.org/c/openstack/cinder/+/885920

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/wallaby
Review: https://review.opendev.org/c/openstack/cinder/+/885921

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/cinder 20.3.1 release.

[OpenStack Infra (hudson-openstack)]

Change abandoned by "Elod Illes <email address hidden>" on branch: stable/wallaby
Review: https://review.opendev.org/c/openstack/cinder/+/885921
Reason: stable/wallaby branch of openstack/cinder is about to be deleted. To be able to do that, all open patches need to be abandoned. Please cherry pick the patch to unmaintained/wallaby if you want to further work on this patch.

[OpenStack Infra (hudson-openstack)]

Change abandoned by "Elod Illes <email address hidden>" on branch: stable/xena
Review: https://review.opendev.org/c/openstack/cinder/+/885920
Reason: stable/xena branch of openstack/cinder is about to be deleted. To be able to do that, all open patches need to be abandoned. Please cherry pick the patch to unmaintained/xena if you want to further work on this patch.