File system sync issues over Ganesha

[Liron Kuchlani]

Description of problem:
When trying to create a file in attached manila share that was
created from snapshot, the file is created but it's not displayed
or saved or flushed to disk.

Version-Release number of selected component (if applicable):
cephadm-16.2.8-79.el9cp.noarch

How reproducible:
100%

Steps to Reproduce:
1. Launch an instance
2. Create share
3. Allow access
4. Create snapshot from the share
5. Create share from the snapshot
6. Allow access
6. Perform ssh to instance
7. Mount share
8. Try to create a file by touch command

[manila@tempest-testsharebasicopsnfs-server-880731321 child]$ mount | grep 172.17.5.118
172.17.5.118:/volumes/_nogroup/ee22821d-217f-4448-9c0d-7affd8016c83/bbc37679-dbc0-415a-a94c-dc1b10303ec6 on /mnt/parent type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=172.17.5.193,local_lock=none,addr=172.17.5.118)
172.17.5.118:/volumes/_nogroup/55e5ae8b-8a0a-41b5-a6de-621d553a295f/5dde0706-e0e9-4067-a4c8-967e9520f617 on /mnt/child type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=172.17.5.193,local_lock=none,addr=172.17.5.118)
[manila@tempest-testsharebasicopsnfs-server-880731321 child]$ ll
total 0
[manila@tempest-testsharebasicopsnfs-server-880731321 child]$ sudo touch file1
[manila@tempest-testsharebasicopsnfs-server-880731321 child]$ ll
total 0
[manila@tempest-testsharebasicopsnfs-server-880731321 child]$ sudo touch file2
[manila@tempest-testsharebasicopsnfs-server-880731321 child]$ ll
total 0
[manila@tempest-testsharebasicopsnfs-server-880731321 child]$ sudo touch file3
[manila@tempest-testsharebasicopsnfs-server-880731321 child]$ ll
total 0

9. Create file by vi command

[manila@tempest-testsharebasicopsnfs-server-880731321 child]$ sudo vi file4
[manila@tempest-testsharebasicopsnfs-server-880731321 child]$ ll
total 0
-rw-r--r--. 1 nobody nobody 0 Aug 15 05:19 file1
-rw-r--r--. 1 nobody nobody 0 Aug 15 05:19 file2
-rw-r--r--. 1 nobody nobody 0 Aug 15 05:19 file3
-rw-r--r--. 1 nobody nobody 0 Aug 15 05:20 file4

10. Now try again to create a file by touch command

[manila@tempest-testsharebasicopsnfs-server-880731321 child]$ sudo touch file5

All created files are displayed

[manila@tempest-testsharebasicopsnfs-server-880731321 child]$ ll
total 0
-rw-r--r--. 1 nobody nobody 0 Aug 15 05:19 file1
-rw-r--r--. 1 nobody nobody 0 Aug 15 05:19 file2
-rw-r--r--. 1 nobody nobody 0 Aug 15 05:19 file3
-rw-r--r--. 1 nobody nobody 0 Aug 15 05:20 file4
-rw-r--r--. 1 nobody nobody 0 Aug 15 05:20 file5

Actual results:
The file is't displayed

Expected results:
The file should be displayed

[Goutham Pacha Ravi (gouthamr)]

Reproducible without manila: https://tracker.ceph.com/issues/57210

Since the ceph community is working on this issue; we'll use this LP bug as a tracker.

[Vida Haririan (vhariria)]

Additional comments at https://meetings.opendev.org/meetings/manila/2022/manila.2022-09-22-15.00.log.html

[Vida Haririan (vhariria)]

A fix was released for associated ceph bug https://tracker.ceph.com/issues/57210

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/c/openstack/manila-tempest-plugin/+/899080

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/manila-tempest-plugin/+/899080
Committed: https://opendev.org/openstack/manila-tempest-plugin/commit/ac3c750236d14d6ef16795d65dab98aad9417f95
Submitter: "Zuul (22348)"
Branch: master

commit ac3c750236d14d6ef16795d65dab98aad9417f95
Author: Goutham Pacha Ravi <email address hidden>
Date: Mon Oct 23 09:42:38 2023 -0700

    Stop skipping cephfs snapshot cloning test

    The scenario test
    `test_write_data_to_share_created_from_snapshot`
    was being skipped because of a bug in ceph's MDS
    service. It has now been addressed [1]

    [1] https://tracker.ceph.com/issues/57210
    Closes-Bug: #1989273

    Change-Id: I967479458038b67c7892a71ac881491e1f8c87f7
    Depends-On: Iea541d2edefc871bcac2d965997c88462fcbe521
    Signed-off-by: Goutham Pacha Ravi <email address hidden>

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/manila-tempest-plugin 2.1.0 release.