mlocate indexes swift objects

Bug #1572307 reported by Bjoern
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack-Ansible
Fix Released
Undecided
Bjoern

Bug Description

Apparently we just discovered that mlocate indexes swift object and that can be really bad for disk IO even system stability overall.

root@r1-z3-swiftstorage002:~# lsof /srv/node/disk25
COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME
updatedb. 303649 root cwd DIR 65,128 4096 3221226269 /srv/node/disk25/objects/107639
updatedb. 303649 root 11r DIR 65,128 50 32 /srv/node/disk25
updatedb. 303649 root 12r DIR 65,128 94208 35 /srv/node/disk25/objects

Hence we should add the option --prunefs xfs to updatedb.mlocate (/etc/cron.daily/mlocate)

Bjoern (bjoern-t)
Changed in openstack-ansible:
assignee: nobody → Bjoern Teipel (bjoern-teipel)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to openstack-ansible-os_swift (master)

Fix proposed to branch: master
Review: https://review.openstack.org/308036

Changed in openstack-ansible:
status: New → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to openstack-ansible-os_swift (master)

Reviewed: https://review.openstack.org/308036
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-os_swift/commit/?id=db4ad90762bd9df437a39950ad97173f65a93b64
Submitter: Jenkins
Branch: master

commit db4ad90762bd9df437a39950ad97173f65a93b64
Author: Bjoern Teipel <email address hidden>
Date: Tue Apr 19 16:03:23 2016 -0500

    Remove XFS filesystem from the daily mlocate cron job

    This fix removes the XFS filesystem from the daily cron job.
    It will help to remove unnecessary disk IO due to updatedb/mlocate
    swift object indexing inside the /srv/node folders.

    Change-Id: I8bfa92003ce06ee4f065663e054cd2d04f458ec6
    Closes-Bug: #1572307

Changed in openstack-ansible:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to openstack-ansible-os_swift (stable/mitaka)

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/310442

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to openstack-ansible (liberty)

Fix proposed to branch: liberty
Review: https://review.openstack.org/310459

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to openstack-ansible (kilo)

Fix proposed to branch: kilo
Review: https://review.openstack.org/310460

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to openstack-ansible (liberty)

Reviewed: https://review.openstack.org/310459
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible/commit/?id=d64b20f4383f7d105268bdf52d9faaa22637f74d
Submitter: Jenkins
Branch: liberty

commit d64b20f4383f7d105268bdf52d9faaa22637f74d
Author: Bjoern Teipel <email address hidden>
Date: Wed Apr 27 08:00:39 2016 -0500

    Remove XFS filesystem from the daily mlocate cron job

    This fix removes the XFS filesystem from the daily cron job.
    It will help to remove unnecessary disk IO due to updatedb/mlocate
    swift object indexing inside the /srv/node folders.

    This fix is related to https://review.openstack.org/#/c/308036/

    Change-Id: I8bfa92003ce06ee4f065663e054cd2d04f458ec6
    Closes-Bug: #1572307

tags: added: in-liberty
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to openstack-ansible (kilo)

Reviewed: https://review.openstack.org/310460
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible/commit/?id=a93d3913a0a1bf541bdbc08fdc3f41aae8051520
Submitter: Jenkins
Branch: kilo

commit a93d3913a0a1bf541bdbc08fdc3f41aae8051520
Author: Bjoern Teipel <email address hidden>
Date: Wed Apr 27 08:04:29 2016 -0500

    Remove XFS filesystem from the daily mlocate cron job

    This fix removes the XFS filesystem from the daily cron job.
    It will help to remove unnecessary disk IO due to updatedb/mlocate
    swift object indexing inside the /srv/node folders.

    This fix is related to https://review.openstack.org/#/c/308036/

    Change-Id: I8bfa92003ce06ee4f065663e054cd2d04f458ec6
    Closes-Bug: #1572307

tags: added: in-kilo
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to openstack-ansible-os_swift (stable/mitaka)

Reviewed: https://review.openstack.org/310442
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-os_swift/commit/?id=5fafb38f896d5eae1836bb06e59c6ffaf43867b8
Submitter: Jenkins
Branch: stable/mitaka

commit 5fafb38f896d5eae1836bb06e59c6ffaf43867b8
Author: Bjoern Teipel <email address hidden>
Date: Tue Apr 19 16:03:23 2016 -0500

    Remove XFS filesystem from the daily mlocate cron job

    This fix removes the XFS filesystem from the daily cron job.
    It will help to remove unnecessary disk IO due to updatedb/mlocate
    swift object indexing inside the /srv/node folders.

    Change-Id: I8bfa92003ce06ee4f065663e054cd2d04f458ec6
    Closes-Bug: #1572307
    (cherry picked from commit db4ad90762bd9df437a39950ad97173f65a93b64)

tags: added: in-stable-mitaka
Revision history for this message
Doug Hellmann (doug-hellmann) wrote : Fix included in openstack/openstack-ansible 11.2.15

This issue was fixed in the openstack/openstack-ansible 11.2.15 release.

Revision history for this message
Doug Hellmann (doug-hellmann) wrote : Fix included in openstack/openstack-ansible 12.0.12

This issue was fixed in the openstack/openstack-ansible 12.0.12 release.

Revision history for this message
Doug Hellmann (doug-hellmann) wrote : Fix included in openstack/openstack-ansible-os_swift 13.1.1

This issue was fixed in the openstack/openstack-ansible-os_swift 13.1.1 release.

Revision history for this message
Thierry Carrez (ttx) wrote : Fix included in openstack/openstack-ansible-os_swift 14.0.0.0b1

This issue was fixed in the openstack/openstack-ansible-os_swift 14.0.0.0b1 development milestone.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.