Mongodb and numa warning

[Aleksey Zvyagintsev]

Mongodb runs with non-recommend params, on systems with multi-cpu:

#
root@node-2:~# mongo -u admin -p ** admin
MongoDB shell version: 2.4.6
connecting to: admin
Server has startup warnings:
Thu Mar 26 15:55:07.882 [initandlisten]
Thu Mar 26 15:55:07.882 [initandlisten] ** WARNING: You are running on a NUMA machine.
Thu Mar 26 15:55:07.882 [initandlisten] ** We suggest launching mongod like this to avoid performance problems:
Thu Mar 26 15:55:07.882 [initandlisten] ** numactl --interleave=all mongod [other options]
Thu Mar 26 15:55:07.882 [initandlisten]
#
Info
$ cat /proc/cpuinfo | grep processor |wc -l
48
$ cat /proc/cpuinfo | grep "physical id" | sort | uniq | wc -l
2
$
model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz

###
Propose:
Add if condition into puppet.

Docs:
http://docs.mongodb.org/manual/administration/production-notes/
http://greproot.com/warning-you-are-running-on-a-numa-machine-we-suggest-launching-mongod-like-this-to-avoid-performance-problems-numactl-interleaveall-mongod-other-options/

[Nastya Urlapova (aurlapova)]

Aleksey, could you provide fuel version?

[Aleksey Zvyagintsev (azvyagintsev)]

Custom version of fuel. Based on 5.1.2.

root@node-2:~# dpkg -l |grep mongo
ii libmongo-client0 0.1.4-3 Alternate C driver for the MongoDB document-oriented datastore
ii mongodb-clients 1:2.4.6-0ubuntu5~cloud1 object/document-oriented database (client apps)
ii mongodb-server 1:2.4.6-0ubuntu5~cloud1 object/document-oriented database (server package)
ii python-pymongo 2.6.3-1build1 Python interface to the MongoDB document-oriented database
ii python-pymongo-ext 2.6.3-1build1 C-coded extension to the python-pymongo package

If you need any other information- please ping me.

[Vadim Rovachev (vrovachev)]

VERSION:
  feature_groups:
    - mirantis
  production: "docker"
  release: "6.1"
  openstack_version: "2014.2.2-6.1"
  api: "1.0"
  build_number: "352"
  build_id: "2015-04-26_22-54-38"
  nailgun_sha: "f9f17fe395f3e38c27d3d484302728a37ad8012d"
  python-fuelclient_sha: "2b311b3b82a1e2df1dc3484a0f37e282273cd988"
  astute_sha: "c1793f982fda7e3fc7b937ccaa613c649be6a144"
  fuel-library_sha: "6bdf783e2bffdce80ecffcca2915e6d32a8ccdd7"
  fuel-ostf_sha: "b38602c841deaa03ddffc95c02f319360462cbe3"
  fuelmain_sha: "01288380950bc89d572cf5902141c9a393ada950"

root@node-3:~# mongo -uadmin -p*** admin
MongoDB shell version: 2.4.9
connecting to: admin
ceilometer:PRIMARY>

root@node-3:~# cat /proc/cpuinfo | grep processor |wc -l
2
root@node-3:~# cat /proc/cpuinfo | grep "physical id" | sort | uniq | wc -l
2
model name : QEMU Virtual CPU version 2.0.0

Please, pay attention that MongoDB shell version is 2.4.9. I'm going to try to reproduse this on hardware controllers. But I think this bug is invalid. Mark it as incomplete due to test on hardware.

[Dmitry Mescheryakov (dmitrymex)]

It is pretty obvious that the issue could be reproduced on real hardware only. My guess would be that any machine with multiple CPUs will make it, hence I am putting this bug back to confirmed.

I am leaving the issue as High, but it is not that critical to try to fix it in 6.1, so I am moving it to 7.0.

[Ivan Berezovskiy (iberezovskiy)]

MongoDB was updated to 2.6.10 version. Please check state of this issue

[Ivan Berezovskiy (iberezovskiy)]

Looks like issue is not reproduced anymore, so I close it as invalid