Don't scan /var/lib/ceph with updatedb

[Mykola Golub]

Ceph daemons store data in /var/lib/ceph as a big set of files. The problem is that updatedb indexes /var/lib/ceph along with everything else on the system. This /var/lib/ceph location is typically very large, and Ceph users are not supposed to go poking around at the files in there. With the default configuration when updatedb is run, significant IO slowdown may be observed.

This has already been reported to upstream:

http://tracker.ceph.com/issues/7451
https://bugzilla.redhat.com/1223582
https://bugs.launchpad.net/ubuntu/+source/mlocate/+bug/1281074
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=786433

Unless the fix is available on supported distributions, we should check on ceph nodes for /var/lib/ceph in the updatedb PRUNEPATH and add it if it is missing.

[Aleksander Mogylchenko (amogylchenko)]

Please target this bug to the milestone.

[Matthew Mosesohn (raytrac3r)]

This bug has no movement. Moving to fuel-library. We can configure updatedb.conf with Puppet.

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/197019
Committed: https://git.openstack.org/cgit/stackforge/fuel-library/commit/?id=ec045434d4075557be3c4069bfab281822aecf2e
Submitter: Jenkins
Branch: master

commit ec045434d4075557be3c4069bfab281822aecf2e
Author: Mykola Golub <email address hidden>
Date: Tue Jun 30 11:05:12 2015 +0300

    Don't scan /var/lib/ceph with updatedb

    /var/lib/ceph usually contains a big set of files and significant IO
    slowdown may be observed during indexing, which actually is useless.

    Closes-Bug: #1469993
    Change-Id: I6995334867ba486ad036d1fd32492cf78e6a9ce1

[Maksym Shalamov (mshalamov)]

Varible PRUNEPATHS into updatedb.conf which located on nodes with ceph containce path "/var/lib/ceph"

Example:
$ cat /etc/updatedb.conf
PRUNE_BIND_MOUNTS="yes"
# PRUNENAMES=".git .bzr .hg .svn"
PRUNEPATHS="/tmp /var/spool /media /home/.ecryptfs /var/lib/ceph"
PRUNEFS="NFS nfs nfs4 rpc_pipefs afs binfmt_misc proc smbfs autofs iso9660 ncpfs coda devpts ftpfs devfs mfs shfs sysfs cifs lustre tmpfs usbfs udf fuse.glusterfs fuse.sshfs curlftpfs ecryptfs fusesmb devtmpfs"

Verified on:

VERSION:
  feature_groups:
    - mirantis
  production: "docker"
  release: "8.0"
  api: "1.0"
  build_number: "569"
  build_id: "569"
  fuel-nailgun_sha: "558ca91a854cf29e395940c232911ffb851899c1"
  python-fuelclient_sha: "4f234669cfe88a9406f4e438b1e1f74f1ef484a5"
  fuel-agent_sha: "658be72c4b42d3e1436b86ac4567ab914bfb451b"
  fuel-nailgun-agent_sha: "b2bb466fd5bd92da614cdbd819d6999c510ebfb1"
  astute_sha: "b81577a5b7857c4be8748492bae1dec2fa89b446"
  fuel-library_sha: "33634ec27be77ecfb0b56b7e07497ad86d1fdcd3"
  fuel-ostf_sha: "3bc76a63a9e7d195ff34eadc29552f4235fa6c52"
  fuel-mirror_sha: "fb45b80d7bee5899d931f926e5c9512e2b442749"
  fuelmenu_sha: "78ffc73065a9674b707c081d128cb7eea611474f"
  shotgun_sha: "63645dea384a37dde5c01d4f8905566978e5d906"
  network-checker_sha: "a43cf96cd9532f10794dce736350bf5bed350e9d"
  fuel-upgrade_sha: "616a7490ec7199f69759e97e42f9b97dfc87e85b"
  fuelmain_sha: "d605bcbabf315382d56d0ce8143458be67c53434"