Create Disk Space Check and Alerts

Bug #1414249 reported by Sean Carlisle
10
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack-Ansible
Invalid
High
Andy McCrae
Juno
Fix Released
High
Kevin Carter
Trunk
Invalid
High
Andy McCrae

Bug Description

Currently we do not have monitoring for disk space. We have come across a couple of customers who had full /boot partitions due to apt's unattended upgrades installing new kernels and filling /boot (being addressed here: https://bugs.launchpad.net/openstack-ansible/+bug/1411897.) We need a check and associated alerts to proactively monitor for disks approaching certain space thresholds.

Desired features:

-Checks all mounted filesystems
-Configurable list of filesystems to exclude from check.
-Multiple thresholds for each filesystem:
         -warn on x% free
         -critical on y% free
-Configurable thresholds

Tags: impacts-doc
Revision history for this message
Bjoern (bjoern-t) wrote :

So we have the maas_cdm playbook but that covers only the rootfs, for the controller we are missing /openstack. We need to check in what state those checks are.

Changed in openstack-ansible:
status: New → Triaged
importance: Undecided → High
assignee: nobody → Andy McCrae (andrew-mccrae)
milestone: none → 10.1.2
Changed in openstack-ansible:
assignee: Andy McCrae (andrew-mccrae) → nobody
Changed in openstack-ansible:
assignee: nobody → Andy McCrae (andrew-mccrae)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to os-ansible-deployment (master)

Fix proposed to branch: master
Review: https://review.openstack.org/150371

Changed in openstack-ansible:
status: Triaged → In Progress
tags: added: impacts-doc
no longer affects: openstack-ansible/trunk
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to os-ansible-deployment (master)

Reviewed: https://review.openstack.org/150371
Committed: https://git.openstack.org/cgit/stackforge/os-ansible-deployment/commit/?id=3deb360808e1a6ae0bd97b7d154b10d96fc4eb08
Submitter: Jenkins
Branch: master

commit 3deb360808e1a6ae0bd97b7d154b10d96fc4eb08
Author: Andy McCrae <email address hidden>
Date: Tue Jan 27 11:32:54 2015 +0000

    Allow setup of specific MaaS filesystem monitors

    By default will generate a list of filesystems that are ext or xfs and
    set these up to be monitored with a specified threshold set in
    user_variables.

    Can loop through list of filesystems/thresholds specifically set in
    user_variables if needed, and the default for a server can be overridden
    in the rpc_user_config.yml per host.

    The user_variables.yml sample file, and the rpc_user_config.yml files
    have been updated to reflect these changes.

    Change-Id: I1959a630e2c603a76001f52db6b027bf71124c54
    Closes-Bug: #1414249

Changed in openstack-ansible:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to os-ansible-deployment (juno)

Fix proposed to branch: juno
Review: https://review.openstack.org/152090

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to os-ansible-deployment (juno)

Reviewed: https://review.openstack.org/152090
Committed: https://git.openstack.org/cgit/stackforge/os-ansible-deployment/commit/?id=ddb40fb76243e147aaff89fc1a6d843d5b6fe7f4
Submitter: Jenkins
Branch: juno

commit ddb40fb76243e147aaff89fc1a6d843d5b6fe7f4
Author: Andy McCrae <email address hidden>
Date: Tue Jan 27 11:32:54 2015 +0000

    Allow setup of specific MaaS filesystem monitors

    By default will generate a list of filesystems that are ext or xfs and
    set these up to be monitored with a specified threshold set in
    user_variables.

    Can loop through list of filesystems/thresholds specifically set in
    user_variables if needed, and the default for a server can be overridden
    in the rpc_user_config.yml per host.

    The user_variables.yml sample file, and the rpc_user_config.yml files
    have been updated to reflect these changes.

    Change-Id: I1959a630e2c603a76001f52db6b027bf71124c54
    Closes-Bug: #1414249
    (cherry picked from commit 3deb360808e1a6ae0bd97b7d154b10d96fc4eb08)

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.