Some hosts have started to cause UNKNOWN return values in Nagios for checks on their disks. This is because these hosts are no longer reporting their disks as part of the SNMP table hrStorageTable (1.3.6.1.2.1.25.2.3.1 ) - only memory devices are being reported. The affected hosts that I have investigated received updates for SNMP:
Upgrade package libsnmp-base 5.7.3+dfsg-1.8ubuntu3.1 to 5.7.3+dfsg-1.8ubuntu3.2
Upgrade package libsnmp30 5.7.3+dfsg-1.8ubuntu3.1 to 5.7.3+dfsg-1.8ubuntu3.2
Upgrade package snmpd 5.7.3+dfsg-1.8ubuntu3.1 to 5.7.3+dfsg-1.8ubuntu3.2
It seems likely that this package update is the cause.
As debug info, you can see the difference between 2 nearly identical servers, one of which received the SNMP updates, and one which did not. You can see that the one without the update is returning disks in the SNMP output:
It has been brought to me the following:
Some hosts have started to cause UNKNOWN return values in Nagios for checks on their disks. This is because these hosts are no longer reporting their disks as part of the SNMP table hrStorageTable (1.3.6. 1.2.1.25. 2.3.1 ) - only memory devices are being reported. The affected hosts that I have investigated received updates for SNMP:
Upgrade package libsnmp-base 5.7.3+dfsg- 1.8ubuntu3. 1 to 5.7.3+dfsg- 1.8ubuntu3. 2 1.8ubuntu3. 1 to 5.7.3+dfsg- 1.8ubuntu3. 2 1.8ubuntu3. 1 to 5.7.3+dfsg- 1.8ubuntu3. 2
Upgrade package libsnmp30 5.7.3+dfsg-
Upgrade package snmpd 5.7.3+dfsg-
It seems likely that this package update is the cause.
As debug info, you can see the difference between 2 nearly identical servers, one of which received the SNMP updates, and one which did not. You can see that the one without the update is returning disks in the SNMP output:
# snmpwalk -v2c -cpublic arcprsmt01 1.3.6.1. 2.1.25. 2.3.1.3 1.2.1.25. 2.3.1.3. 1 = STRING: "Physical memory" 1.2.1.25. 2.3.1.3. 3 = STRING: "Virtual memory" 1.2.1.25. 2.3.1.3. 6 = STRING: "Memory buffers" 1.2.1.25. 2.3.1.3. 7 = STRING: "Cached memory" 1.2.1.25. 2.3.1.3. 8 = STRING: "Shared memory" 1.2.1.25. 2.3.1.3. 10 = STRING: "Swap space" 1.2.1.25. 2.3.1.3. 31 = STRING: "/" 1.2.1.25. 2.3.1.3. 37 = STRING: "/run" 1.2.1.25. 2.3.1.3. 39 = STRING: "/dev/shm" 1.2.1.25. 2.3.1.3. 40 = STRING: "/run/lock" 1.2.1.25. 2.3.1.3. 41 = STRING: "/sys/fs/cgroup" 1.2.1.25. 2.3.1.3. 67 = STRING: "/run/snapd/ns" 1.2.1.25. 2.3.1.3. 70 = STRING: "/var/lib/ docker/ containers/ 3cad3d36991b677 c37b08b374a7bfe ceddf36a6b6754e daa1ff687b00111 a6b8/mounts/ shm" 1.2.1.25. 2.3.1.3. 73 = STRING: "/var/lib/ docker/ containers/ c605c4b76dea65d 562ba024212a38e 24fb710186c4991 87b6604478b7ff6 78e9/mounts/ shm" 1.2.1.25. 2.3.1.3. 82 = STRING: "/run/user/2002" 1.2.1.25. 2.3.1.3. 253 = STRING: "/var/lib/ docker/ containers/ dc74a157fbaaa28 4e0e5b8ca4afc88 769bf625eb796d8 9a5d26f98a540ca bf35/mounts/ shm" 1.2.1.25. 2.3.1.3. 256 = STRING: "/var/lib/ docker/ containers/ 6ce6193433f9c1c 95cccbfbbe08a3f 3385bdbc4f2e3f0 baa02d11baf3866 dfd2/mounts/ shm" 1.2.1.25. 2.3.1.3. 258 = STRING: "/run/user/1000"
iso.3.6.
iso.3.6.
iso.3.6.
iso.3.6.
iso.3.6.
iso.3.6.
iso.3.6.
iso.3.6.
iso.3.6.
iso.3.6.
iso.3.6.
iso.3.6.
iso.3.6.
iso.3.6.
iso.3.6.
iso.3.6.
iso.3.6.
iso.3.6.
The other, which received SNMP updates, is returning only memory devices, such as swap and shmem:
# snmpwalk -v2c -cpublic arcprsmt02 1.3.6.1. 2.1.25. 2.3.1.3 1.2.1.25. 2.3.1.3. 1 = STRING: "Physical memory" 1.2.1.25. 2.3.1.3. 3 = STRING: "Virtual memory" 1.2.1.25. 2.3.1.3. 6 = STRING: "Memory buffers" 1.2.1.25. 2.3.1.3. 7 = STRING: "Cached memory" 1.2.1.25. 2.3.1.3. 8 = STRING: "Shared memory" 1.2.1.25. 2.3.1.3. 10 = STRING: "Swap space"
iso.3.6.
iso.3.6.
iso.3.6.
iso.3.6.
iso.3.6.
iso.3.6.