default disk size for MongoDB is too small

Bug #1393369 reported by Matthew Mosesohn
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Invalid
Medium
Fuel Python (Deprecated)

Bug Description

The / partition on a MongoDB host should be 60gb to support MongoDB logging in debug mode. The default 16gb size is simply inadequate if the system is deployed in Debug mode and then Rally is used for testing. It will fill up well before log rotation occurs and within a few days, even rotated logs will fill the disk.

I had a conversation with Nikolay M and Vitaly K and they seemed to think this was possible to implement, although a bulletproof workflow setup is near impossible. This affects the 100 node deploy scale project, so it deserves high priority.

Revision history for this message
Dima Shulyak (dshulyak) wrote :

Currently disk partition strategy for mongo is:

"min" for os - /
"all" for mongo - /var/lib/mongo

we can add another partition, log - /var/log, with "min" allocator - 60 gb, or "all" allocator,
in case of all - space between mongo and log will be splitted
also note that it is important not to add /var partition, because we install os on a plain partition in case of ubuntu

Changed in fuel:
status: New → Triaged
Revision history for this message
Vladimir Kuklin (vkuklin) wrote :

I would say that this bug is partially a duplicate of https://bugs.launchpad.net/fuel/+bug/1393400

Changed in fuel:
milestone: 6.0 → 6.1
Revision history for this message
Roman Prykhodchenko (romcheg) wrote :

Do we still need to increase the size after logging level was reduced in https://bugs.launchpad.net/fuel/+bug/1393400 ?

Revision history for this message
Matthew Mosesohn (raytrac3r) wrote :

I guess it can be lowered in priority because it hasn't come back after reducing verbosity and rotation is far more effective now. There was another discussion about setting proportional disk sizes that are relative to the total disk space available.

Revision history for this message
Roman Prykhodchenko (romcheg) wrote :

Discussed that with some other guys and we agreed to lower its priority.

Changed in fuel:
importance: High → Medium
Dmitry Pyzhov (dpyzhov)
tags: added: feature-mongo module-volumes
Changed in fuel:
assignee: Fuel Python Team (fuel-python) → Ivan Berezovskiy (iberezovskiy)
Revision history for this message
Ivan Berezovskiy (iberezovskiy) wrote :

Logging level for Mongodb was reduced. Now it doesn't affect deploy on scale. We should discuss about setting proportional disk sizes, but it should be decided for 7.0 becuase for 6.1 it's too late (SCF is now).

Changed in fuel:
milestone: 6.1 → 7.0
assignee: Ivan Berezovskiy (iberezovskiy) → Fuel Library Team (fuel-library)
Changed in fuel:
assignee: Fuel Library Team (fuel-library) → Fuel Python Team (fuel-python)
Revision history for this message
Aleksey Kasatkin (alekseyk-ru) wrote :

Does not break deployment according to latest comments. Moving to 8.0.

Changed in fuel:
status: Triaged → Won't Fix
Dmitry Pyzhov (dpyzhov)
Changed in fuel:
milestone: 7.0 → 8.0
status: Won't Fix → Triaged
no longer affects: fuel/8.0.x
Dmitry Pyzhov (dpyzhov)
tags: added: area-python
Changed in fuel:
assignee: Fuel Python Team (fuel-python) → Alexander Rozdymakha (arozdymakha)
Changed in fuel:
assignee: Alexander Rozdymakha (arozdymakha) → nobody
Revision history for this message
Dmitry Klenov (dklenov) wrote :

@ Alexander Rozdymakha, it is the bad practice to just unassign bugs from yourself. Please always find the proper team and assign bugs to it.

Changed in fuel:
assignee: nobody → Fuel Python Team (fuel-python)
Changed in fuel:
milestone: 8.0 → 9.0
Revision history for this message
Ivan Berezovskiy (iberezovskiy) wrote :

Mongo oplog_size Mongo is 10Gb (https://github.com/openstack/fuel-library/blob/master/deployment/puppet/openstack_tasks/manifests/roles/mongo.pp#L63). So, in default configuration for base tests 16 Gb is more than enough (10Gb for oplog is a lot of more that actually needed most of the time, and 6Gb for other needs). This other space (6 Gb) will be used for user data (in the majority it's ceilometer data).
But for long-living environments fuel user should take care of disk size for mongo before deployment and set it depending openstack cluster usage (and as result how much data will be collected by ceilometer).

So, I think that bug is invalid because users have an ability to configure disk for mongo and they are motly responsible for setting it in correct way.

Changed in fuel:
status: Triaged → Invalid
Revision history for this message
Ivan Ponomarev (ivanzipfer) wrote :

Agree with @iberezovskiy

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.