2014-01-10 08:34:38.741973 mon.0 192.168.121.3:6789/0 12 : [INF] pgmap v3: 292 pgs: 292 creating; 0 bytes data, 0 KB used, 0 KB / 0 KB avail 2014-01-10 08:34:40.432464 mon.0 192.168.121.3:6789/0 13 : [INF] osdmap e3: 0 osds: 0 up, 0 in 2014-01-10 08:34:40.436206 mon.0 192.168.121.3:6789/0 14 : [INF] pgmap v4: 392 pgs: 392 creating; 0 bytes data, 0 KB used, 0 KB / 0 KB avail 2014-01-10 08:48:13.947880 mon.0 192.168.121.3:6789/0 15 : [INF] mon.node-13 calling new monitor election 2014-01-10 08:48:15.947030 mon.1 192.168.121.4:6789/0 1 : [INF] mon.node-14 calling new monitor election 2014-01-10 08:48:18.950747 mon.0 192.168.121.3:6789/0 16 : [INF] mon.node-13@0 won leader election with quorum 0,1 2014-01-10 08:48:18.952242 mon.0 192.168.121.3:6789/0 17 : [INF] pgmap v4: 392 pgs: 392 creating; 0 bytes data, 0 KB used, 0 KB / 0 KB avail 2014-01-10 08:48:18.952296 mon.0 192.168.121.3:6789/0 18 : [INF] mdsmap e1: 0/0/1 up 2014-01-10 08:48:18.952348 mon.0 192.168.121.3:6789/0 19 : [INF] osdmap e3: 0 osds: 0 up, 0 in 2014-01-10 08:48:18.952401 mon.0 192.168.121.3:6789/0 20 : [INF] monmap e2: 2 mons at {node-13=192.168.121.3:6789/0,node-14=192.168.121.4:6789/0} 2014-01-10 09:02:03.291394 mon.0 192.168.121.3:6789/0 21 : [INF] mon.node-13 calling new monitor election 2014-01-10 09:02:03.293527 mon.1 192.168.121.4:6789/0 2 : [INF] mon.node-14 calling new monitor election 2014-01-10 09:02:08.292452 mon.0 192.168.121.3:6789/0 22 : [INF] mon.node-13@0 won leader election with quorum 0,1 2014-01-10 09:02:08.294188 mon.0 192.168.121.3:6789/0 23 : [INF] pgmap v4: 392 pgs: 392 creating; 0 bytes data, 0 KB used, 0 KB / 0 KB avail 2014-01-10 09:02:08.294230 mon.0 192.168.121.3:6789/0 24 : [INF] mdsmap e1: 0/0/1 up 2014-01-10 09:02:08.294276 mon.0 192.168.121.3:6789/0 25 : [INF] osdmap e3: 0 osds: 0 up, 0 in 2014-01-10 09:02:05.295530 mon.2 192.168.121.5:6789/0 1 : [INF] mon.node-15 calling new monitor election 2014-01-10 09:02:08.294350 mon.0 192.168.121.3:6789/0 26 : [INF] monmap e3: 3 mons at {node-13=192.168.121.3:6789/0,node-14=192.168.121.4:6789/0,node-15=192.168.121.5:6789/0} 2014-01-10 09:02:10.289882 mon.0 192.168.121.3:6789/0 27 : [INF] mon.node-13 calling new monitor election 2014-01-10 09:02:10.291290 mon.1 192.168.121.4:6789/0 3 : [INF] mon.node-14 calling new monitor election 2014-01-10 09:02:10.292839 mon.0 192.168.121.3:6789/0 28 : [INF] mon.node-13@0 won leader election with quorum 0,1,2 2014-01-10 09:02:10.294424 mon.0 192.168.121.3:6789/0 29 : [INF] pgmap v4: 392 pgs: 392 creating; 0 bytes data, 0 KB used, 0 KB / 0 KB avail 2014-01-10 09:02:10.294510 mon.0 192.168.121.3:6789/0 30 : [INF] mdsmap e1: 0/0/1 up 2014-01-10 09:02:10.294560 mon.0 192.168.121.3:6789/0 31 : [INF] osdmap e3: 0 osds: 0 up, 0 in 2014-01-10 09:02:10.294621 mon.0 192.168.121.3:6789/0 32 : [INF] monmap e3: 3 mons at {node-13=192.168.121.3:6789/0,node-14=192.168.121.4:6789/0,node-15=192.168.121.5:6789/0} 2014-01-10 09:10:41.705616 mon.0 192.168.121.3:6789/0 33 : [INF] osdmap e4: 1 osds: 0 up, 0 in 2014-01-10 09:10:41.708789 mon.0 192.168.121.3:6789/0 34 : [INF] pgmap v5: 392 pgs: 392 creating; 0 bytes data, 0 KB used, 0 KB / 0 KB avail 2014-01-10 09:10:43.263936 mon.0 192.168.121.3:6789/0 35 : [INF] osdmap e5: 2 osds: 0 up, 0 in 2014-01-10 09:10:43.265947 mon.0 192.168.121.3:6789/0 36 : [INF] pgmap v6: 392 pgs: 392 creating; 0 bytes data, 0 KB used, 0 KB / 0 KB avail 2014-01-10 09:10:44.276583 mon.0 192.168.121.3:6789/0 37 : [INF] osd.0 192.168.121.3:6800/2943 boot 2014-01-10 09:10:44.276741 mon.0 192.168.121.3:6789/0 38 : [INF] osdmap e6: 3 osds: 1 up, 1 in 2014-01-10 09:10:44.279174 mon.0 192.168.121.3:6789/0 39 : [INF] pgmap v7: 392 pgs: 392 creating; 0 bytes data, 0 KB used, 0 KB / 0 KB avail 2014-01-10 09:10:45.281526 mon.0 192.168.121.3:6789/0 40 : [INF] osd.1 192.168.121.4:6800/48476 boot 2014-01-10 09:10:45.281719 mon.0 192.168.121.3:6789/0 41 : [INF] osdmap e7: 4 osds: 2 up, 2 in 2014-01-10 09:10:45.284208 mon.0 192.168.121.3:6789/0 42 : [INF] pgmap v8: 392 pgs: 392 creating; 0 bytes data, 0 KB used, 0 KB / 0 KB avail 2014-01-10 09:10:46.287209 mon.0 192.168.121.3:6789/0 43 : [INF] osdmap e8: 4 osds: 2 up, 2 in 2014-01-10 09:10:46.291809 mon.0 192.168.121.3:6789/0 44 : [INF] pgmap v9: 392 pgs: 392 creating; 0 bytes data, 0 KB used, 0 KB / 0 KB avail 2014-01-10 09:10:47.288821 mon.0 192.168.121.3:6789/0 45 : [INF] osd.2 192.168.121.3:6802/3496 boot 2014-01-10 09:10:47.289134 mon.0 192.168.121.3:6789/0 46 : [INF] osdmap e9: 5 osds: 3 up, 3 in 2014-01-10 09:10:47.298446 mon.0 192.168.121.3:6789/0 47 : [INF] pgmap v10: 392 pgs: 392 creating; 0 bytes data, 0 KB used, 0 KB / 0 KB avail 2014-01-10 09:10:48.296167 mon.0 192.168.121.3:6789/0 48 : [INF] osd.3 192.168.121.4:6802/48993 boot 2014-01-10 09:10:48.296731 mon.0 192.168.121.3:6789/0 49 : [INF] osdmap e10: 6 osds: 4 up, 4 in 2014-01-10 09:10:48.304948 mon.0 192.168.121.3:6789/0 50 : [INF] pgmap v11: 392 pgs: 392 creating; 0 bytes data, 0 KB used, 0 KB / 0 KB avail 2014-01-10 09:10:49.306956 mon.0 192.168.121.3:6789/0 51 : [INF] osdmap e11: 6 osds: 4 up, 4 in 2014-01-10 09:10:49.311770 mon.0 192.168.121.3:6789/0 52 : [INF] pgmap v12: 392 pgs: 392 creating; 0 bytes data, 0 KB used, 0 KB / 0 KB avail 2014-01-10 09:10:50.309046 mon.0 192.168.121.3:6789/0 53 : [INF] osd.4 192.168.121.3:6804/4053 boot 2014-01-10 09:10:50.309384 mon.0 192.168.121.3:6789/0 54 : [INF] osdmap e12: 7 osds: 5 up, 5 in 2014-01-10 09:10:50.324467 mon.0 192.168.121.3:6789/0 55 : [INF] pgmap v13: 392 pgs: 267 creating, 15 active, 93 active+clean, 17 peering; 0 bytes data, 2085 MB used, 3721 GB / 3723 GB avail 2014-01-10 09:10:51.316080 mon.0 192.168.121.3:6789/0 56 : [INF] osd.5 192.168.121.4:6804/700 boot 2014-01-10 09:10:51.317169 mon.0 192.168.121.3:6789/0 57 : [INF] osdmap e13: 8 osds: 6 up, 6 in 2014-01-10 09:10:51.326606 mon.0 192.168.121.3:6789/0 58 : [INF] pgmap v14: 392 pgs: 195 creating, 15 active, 141 active+clean, 41 peering; 0 bytes data, 4171 MB used, 7442 GB / 7446 GB avail 2014-01-10 09:10:52.317898 mon.0 192.168.121.3:6789/0 59 : [INF] osdmap e14: 9 osds: 6 up, 6 in 2014-01-10 09:10:52.322012 mon.0 192.168.121.3:6789/0 60 : [INF] pgmap v15: 392 pgs: 195 creating, 15 active, 141 active+clean, 41 peering; 0 bytes data, 4171 MB used, 7442 GB / 7446 GB avail 2014-01-10 09:10:53.320045 mon.0 192.168.121.3:6789/0 61 : [INF] osd.6 192.168.121.3:6806/4667 boot 2014-01-10 09:10:53.320904 mon.0 192.168.121.3:6789/0 62 : [INF] osdmap e15: 10 osds: 7 up, 7 in 2014-01-10 09:10:53.333356 mon.0 192.168.121.3:6789/0 63 : [INF] pgmap v16: 392 pgs: 116 creating, 5 active, 202 active+clean, 69 peering; 0 bytes data, 6255 MB used, 11163 GB / 11169 GB avail 2014-01-10 09:10:54.321000 mon.0 192.168.121.3:6789/0 64 : [INF] osd.8 192.168.121.5:6800/5955 boot 2014-01-10 09:10:54.321284 mon.0 192.168.121.3:6789/0 65 : [INF] osd.7 192.168.121.4:6806/1395 boot 2014-01-10 09:10:54.321608 mon.0 192.168.121.3:6789/0 66 : [INF] osdmap e16: 12 osds: 9 up, 9 in 2014-01-10 09:10:54.337053 mon.0 192.168.121.3:6789/0 67 : [INF] pgmap v17: 392 pgs: 43 creating, 5 active, 228 active+clean, 116 peering; 0 bytes data, 8340 MB used, 14884 GB / 14892 GB avail 2014-01-10 09:10:55.322465 mon.0 192.168.121.3:6789/0 68 : [INF] osd.9 192.168.121.3:6808/5320 boot 2014-01-10 09:10:55.322919 mon.0 192.168.121.3:6789/0 69 : [INF] osdmap e17: 13 osds: 10 up, 10 in 2014-01-10 09:10:55.335513 mon.0 192.168.121.3:6789/0 70 : [INF] pgmap v18: 392 pgs: 43 creating, 5 active, 228 active+clean, 116 peering; 0 bytes data, 8340 MB used, 14884 GB / 14892 GB avail 2014-01-10 09:10:56.335937 mon.0 192.168.121.3:6789/0 71 : [INF] osdmap e18: 13 osds: 10 up, 10 in 2014-01-10 09:10:56.352708 mon.0 192.168.121.3:6789/0 72 : [INF] pgmap v19: 392 pgs: 29 creating, 5 active, 254 active+clean, 104 peering; 0 bytes data, 10424 MB used, 16743 GB / 16753 GB avail 2014-01-10 09:10:56.356916 mon.0 192.168.121.3:6789/0 73 : [INF] pgmap v20: 392 pgs: 29 creating, 5 active, 254 active+clean, 104 peering; 0 bytes data, 10424 MB used, 16743 GB / 16753 GB avail 2014-01-10 09:10:57.338503 mon.0 192.168.121.3:6789/0 74 : [INF] osd.11 192.168.121.5:6802/6473 boot 2014-01-10 09:10:57.338873 mon.0 192.168.121.3:6789/0 75 : [INF] osd.10 192.168.121.4:6808/2100 boot 2014-01-10 09:10:57.339537 mon.0 192.168.121.3:6789/0 76 : [INF] osd.12 192.168.121.3:6810/5937 boot 2014-01-10 09:10:57.340605 mon.0 192.168.121.3:6789/0 77 : [INF] osdmap e19: 15 osds: 13 up, 13 in 2014-01-10 09:10:57.365634 mon.0 192.168.121.3:6789/0 78 : [INF] pgmap v21: 392 pgs: 25 creating, 5 active, 256 active+clean, 106 peering; 0 bytes data, 12508 MB used, 18602 GB / 18614 GB avail 2014-01-10 09:10:58.340145 mon.0 192.168.121.3:6789/0 79 : [INF] osdmap e20: 15 osds: 13 up, 13 in 2014-01-10 09:10:56.356916 mon.0 192.168.121.3:6789/0 73 : [INF] pgmap v20: 392 pgs: 29 creating, 5 active, 254 active+clean, 104 peering; 0 bytes data, 10424 MB used, 16743 GB / 16753 GB avail 2014-01-10 09:10:57.338503 mon.0 192.168.121.3:6789/0 74 : [INF] osd.11 192.168.121.5:6802/6473 boot 2014-01-10 09:10:57.338873 mon.0 192.168.121.3:6789/0 75 : [INF] osd.10 192.168.121.4:6808/2100 boot 2014-01-10 09:10:57.339537 mon.0 192.168.121.3:6789/0 76 : [INF] osd.12 192.168.121.3:6810/5937 boot 2014-01-10 09:10:57.340605 mon.0 192.168.121.3:6789/0 77 : [INF] osdmap e19: 15 osds: 13 up, 13 in 2014-01-10 09:10:57.365634 mon.0 192.168.121.3:6789/0 78 : [INF] pgmap v21: 392 pgs: 25 creating, 5 active, 256 active+clean, 106 peering; 0 bytes data, 12508 MB used, 18602 GB / 18614 GB avail 2014-01-10 09:10:58.340145 mon.0 192.168.121.3:6789/0 79 : [INF] osdmap e20: 15 osds: 13 up, 13 in 2014-01-10 09:11:13.406029 mon.0 192.168.121.3:6789/0 1 : [INF] mon.node-13 calling new monitor election 2014-01-10 09:11:14.980661 mon.1 192.168.121.4:6789/0 1 : [INF] mon.node-14 calling new monitor election 2014-01-10 09:11:18.422801 mon.0 192.168.121.3:6789/0 2 : [INF] mon.node-13@0 won leader election with quorum 0,1 2014-01-10 09:11:18.424702 mon.0 192.168.121.3:6789/0 3 : [INF] pgmap v24: 392 pgs: 25 creating, 287 active+clean, 80 peering; 0 bytes data, 14592 MB used, 20460 GB / 20475 GB avail 2014-01-10 09:11:18.424751 mon.0 192.168.121.3:6789/0 4 : [INF] mdsmap e1: 0/0/1 up 2014-01-10 09:11:18.424817 mon.0 192.168.121.3:6789/0 5 : [INF] osdmap e21: 15 osds: 13 up, 13 in 2014-01-10 09:11:15.372978 mon.2 192.168.121.5:6789/0 2 : [INF] mon.node-15 calling new monitor election 2014-01-10 09:11:19.480057 mon.0 192.168.121.3:6789/0 8 : [INF] osdmap e22: 16 osds: 9 up, 14 in 2014-01-10 09:11:19.486467 mon.0 192.168.121.3:6789/0 9 : [INF] pgmap v25: 392 pgs: 25 creating, 216 active+clean, 71 stale+active+clean, 63 peering, 17 stale+peering; 0 bytes data, 14592 MB used, 20460 GB / 20475 GB avail 2014-01-10 09:11:20.367909 mon.1 192.168.121.4:6789/0 2 : [INF] mon.node-14 calling new monitor election 2014-01-10 09:11:20.368193 mon.0 192.168.121.3:6789/0 10 : [INF] mon.node-13 calling new monitor election 2014-01-10 09:11:20.371761 mon.0 192.168.121.3:6789/0 11 : [INF] mon.node-13@0 won leader election with quorum 0,1,2 2014-01-10 09:11:20.374920 mon.0 192.168.121.3:6789/0 12 : [INF] pgmap v25: 392 pgs: 25 creating, 216 active+clean, 71 stale+active+clean, 63 peering, 17 stale+peering; 0 bytes data, 14592 MB used, 20460 GB / 20475 GB avail 2014-01-10 09:11:20.375001 mon.0 192.168.121.3:6789/0 13 : [INF] mdsmap e1: 0/0/1 up 2014-01-10 09:11:20.375101 mon.0 192.168.121.3:6789/0 14 : [INF] osdmap e22: 16 osds: 9 up, 14 in 2014-01-10 09:11:20.375211 mon.0 192.168.121.3:6789/0 15 : [INF] monmap e3: 3 mons at {node-13=192.168.121.3:6789/0,node-14=192.168.121.4:6789/0,node-15=192.168.121.5:6789/0} 2014-01-10 09:11:21.295977 mon.0 192.168.121.3:6789/0 16 : [INF] pgmap v26: 392 pgs: 10 creating, 260 active+clean, 64 stale+active+clean, 48 peering, 10 stale+peering; 0 bytes data, 18759 MB used, 27903 GB / 27921 GB avail 2014-01-10 09:11:21.300612 mon.0 192.168.121.3:6789/0 17 : [INF] osd.9 192.168.121.3:6800/8471 boot 2014-01-10 09:11:21.300757 mon.0 192.168.121.3:6789/0 18 : [INF] osd.1 192.168.121.4:6800/5077 boot 2014-01-10 09:11:21.300915 mon.0 192.168.121.3:6789/0 19 : [INF] osd.6 192.168.121.3:6804/9128 boot 2014-01-10 09:11:21.301074 mon.0 192.168.121.3:6789/0 20 : [INF] osd.7 192.168.121.4:6808/6361 boot 2014-01-10 09:11:21.301232 mon.0 192.168.121.3:6789/0 21 : [INF] osd.12 192.168.121.3:6808/10150 boot 2014-01-10 09:11:21.308116 mon.0 192.168.121.3:6789/0 22 : [INF] osd.13 192.168.121.5:6804/7013 boot 2014-01-10 09:11:21.310236 mon.0 192.168.121.3:6789/0 23 : [INF] osdmap e23: 16 osds: 9 up, 15 in 2014-01-10 09:11:21.324521 mon.0 192.168.121.3:6789/0 24 : [INF] pgmap v27: 392 pgs: 10 creating, 96 active+clean, 228 stale+active+clean, 22 peering, 36 stale+peering; 0 bytes data, 18759 MB used, 27903 GB / 27921 GB avail 2014-01-10 09:11:22.301596 mon.0 192.168.121.3:6789/0 25 : [INF] osd.3 192.168.121.4:6811/7130 boot 2014-01-10 09:11:22.301770 mon.0 192.168.121.3:6789/0 26 : [INF] osd.2 192.168.121.3:6812/11548 boot 2014-01-10 09:11:22.301923 mon.0 192.168.121.3:6789/0 27 : [INF] osd.4 192.168.121.3:6814/12943 boot 2014-01-10 09:11:22.302078 mon.0 192.168.121.3:6789/0 28 : [INF] osd.10 192.168.121.4:6813/8053 boot 2014-01-10 09:11:22.302227 mon.0 192.168.121.3:6789/0 29 : [INF] osd.5 192.168.121.4:6815/9255 boot 2014-01-10 09:11:22.302385 mon.0 192.168.121.3:6789/0 30 : [INF] osd.0 192.168.121.3:6816/14498 boot 2014-01-10 09:11:22.314419 mon.0 192.168.121.3:6789/0 31 : [INF] osd.15 192.168.121.5:6806/32725 boot 2014-01-10 09:11:22.315149 mon.0 192.168.121.3:6789/0 32 : [INF] osdmap e24: 17 osds: 16 up, 16 in 2014-01-10 09:11:22.322395 mon.0 192.168.121.3:6789/0 33 : [INF] pgmap v28: 392 pgs: 10 creating, 86 active+clean, 226 stale+active+clean, 34 peering, 36 stale+peering; 0 bytes data, 20840 MB used, 29761 GB / 29782 GB avail 2014-01-10 09:11:23.313770 mon.0 192.168.121.3:6789/0 34 : [INF] osdmap e25: 17 osds: 16 up, 16 in 2014-01-10 09:11:23.327633 mon.0 192.168.121.3:6789/0 35 : [INF] pgmap v29: 392 pgs: 10 creating, 86 active+clean, 226 stale+active+clean, 34 peering, 36 stale+peering; 0 bytes data, 20840 MB used, 29761 GB / 29782 GB avail 2014-01-10 09:11:24.305040 mon.0 192.168.121.3:6789/0 36 : [INF] osdmap e26: 17 osds: 16 up, 16 in 2014-01-10 09:11:24.308162 mon.0 192.168.121.3:6789/0 37 : [INF] pgmap v30: 392 pgs: 10 creating, 86 active+clean, 226 stale+active+clean, 34 peering, 36 stale+peering; 0 bytes data, 20840 MB used, 29761 GB / 29782 GB avail 2014-01-10 09:11:25.307423 mon.0 192.168.121.3:6789/0 38 : [INF] osd.16 192.168.121.5:6808/40397 boot 2014-01-10 09:11:25.308853 mon.0 192.168.121.3:6789/0 39 : [INF] osdmap e27: 18 osds: 17 up, 17 in 2014-01-10 09:11:25.317415 mon.0 192.168.121.3:6789/0 40 : [INF] pgmap v31: 392 pgs: 10 creating, 163 active+clean, 143 stale+active+clean, 7 active+clean+replay, 50 peering, 19 stale+peering; 0 bytes data, 25003 MB used, 33479 GB / 33504 GB avail 2014-01-10 09:11:26.308379 mon.0 192.168.121.3:6789/0 41 : [INF] osdmap e28: 18 osds: 17 up, 17 in 2014-01-10 09:11:26.319630 mon.0 192.168.121.3:6789/0 42 : [INF] pgmap v32: 392 pgs: 266 active+clean, 53 stale+active+clean, 16 active+clean+replay, 52 peering, 5 stale+peering; 0 bytes data, 31245 MB used, 39056 GB / 39087 GB avail 2014-01-10 09:11:27.316953 mon.0 192.168.121.3:6789/0 43 : [INF] osdmap e29: 18 osds: 17 up, 17 in 2014-01-10 09:11:27.321417 mon.0 192.168.121.3:6789/0 44 : [INF] pgmap v33: 392 pgs: 298 active+clean, 18 stale+active+clean, 19 active+clean+replay, 52 peering, 5 stale+peering; 0 bytes data, 31242 MB used, 39056 GB / 39087 GB avail 2014-01-10 09:11:27.324186 mon.0 192.168.121.3:6789/0 45 : [INF] pgmap v34: 392 pgs: 298 active+clean, 18 stale+active+clean, 19 active+clean+replay, 52 peering, 5 stale+peering; 0 bytes data, 31242 MB used, 39056 GB / 39087 GB avail 2014-01-10 09:11:28.321978 mon.0 192.168.121.3:6789/0 46 : [INF] osd.17 192.168.121.5:6810/40980 boot 2014-01-10 09:11:28.322550 mon.0 192.168.121.3:6789/0 47 : [INF] osdmap e30: 18 osds: 18 up, 18 in 2014-01-10 09:11:28.327162 mon.0 192.168.121.3:6789/0 48 : [INF] pgmap v35: 392 pgs: 314 active+clean, 16 stale+active+clean, 20 active+clean+replay, 42 peering; 0 bytes data, 33327 MB used, 40915 GB / 40948 GB avail 2014-01-10 09:11:29.323619 mon.0 192.168.121.3:6789/0 49 : [INF] osdmap e31: 18 osds: 18 up, 18 in 2014-01-10 09:11:29.329491 mon.0 192.168.121.3:6789/0 50 : [INF] pgmap v36: 392 pgs: 314 active+clean, 16 stale+active+clean, 20 active+clean+replay, 42 peering; 0 bytes data, 33327 MB used, 40915 GB / 40948 GB avail 2014-01-10 09:11:39.331564 mon.1 192.168.121.4:6789/0 3 : [INF] mon.node-14 calling new monitor election 2014-01-10 09:11:39.333378 mon.0 192.168.121.3:6789/0 51 : [INF] mon.node-13 calling new monitor election 2014-01-10 09:11:44.333970 mon.0 192.168.121.3:6789/0 52 : [INF] mon.node-13@0 won leader election with quorum 0,1 2014-01-10 09:11:44.335739 mon.0 192.168.121.3:6789/0 53 : [INF] pgmap v36: 392 pgs: 314 active+clean, 16 stale+active+clean, 20 active+clean+replay, 42 peering; 0 bytes data, 33327 MB used, 40915 GB / 40948 GB avail 2014-01-10 09:11:44.335819 mon.0 192.168.121.3:6789/0 54 : [INF] mdsmap e1: 0/0/1 up 2014-01-10 09:11:44.335903 mon.0 192.168.121.3:6789/0 55 : [INF] osdmap e31: 18 osds: 18 up, 18 in 2014-01-10 09:11:44.335967 mon.0 192.168.121.3:6789/0 56 : [INF] monmap e3: 3 mons at {node-13=192.168.121.3:6789/0,node-14=192.168.121.4:6789/0,node-15=192.168.121.5:6789/0} 2014-01-10 09:11:44.399140 mon.0 192.168.121.3:6789/0 57 : [INF] pgmap v37: 392 pgs: 332 active+clean, 16 stale+active+clean, 20 active+clean+replay, 24 peering; 0 bytes data, 33333 MB used, 40915 GB / 40948 GB avail 2014-01-10 09:11:45.411363 mon.0 192.168.121.3:6789/0 58 : [INF] osdmap e32: 18 osds: 16 up, 18 in 2014-01-10 09:11:45.419082 mon.0 192.168.121.3:6789/0 59 : [INF] pgmap v38: 392 pgs: 248 active+clean, 100 stale+active+clean, 20 active+clean+replay, 11 peering, 13 stale+peering; 0 bytes data, 33333 MB used, 40915 GB / 40948 GB avail 2014-01-10 09:11:46.415006 mon.0 192.168.121.3:6789/0 60 : [INF] osd.11 192.168.121.5:6800/42868 boot 2014-01-10 09:11:46.415160 mon.0 192.168.121.3:6789/0 61 : [INF] osd.8 192.168.121.5:6804/44760 boot 2014-01-10 09:11:46.416461 mon.0 192.168.121.3:6789/0 62 : [INF] osdmap e33: 18 osds: 15 up, 18 in 2014-01-10 09:11:46.422626 mon.0 192.168.121.3:6789/0 63 : [INF] pgmap v39: 392 pgs: 230 active+clean, 118 stale+active+clean, 19 active+clean+replay, 1 stale+active+clean+replay, 24 stale+peering; 0 bytes data, 33333 MB used, 40915 GB / 40948 GB avail 2014-01-10 09:11:47.419864 mon.0 192.168.121.3:6789/0 64 : [INF] osd.15 192.168.121.5:6808/47558 boot 2014-01-10 09:11:47.419985 mon.0 192.168.121.3:6789/0 65 : [INF] osd.13 192.168.121.5:6812/2146 boot 2014-01-10 09:11:47.420125 mon.0 192.168.121.3:6789/0 66 : [INF] osd.16 192.168.121.5:6814/3763 boot 2014-01-10 09:11:47.421583 mon.0 192.168.121.3:6789/0 67 : [INF] osdmap e34: 18 osds: 17 up, 18 in 2014-01-10 09:11:43.999675 mon.2 192.168.121.5:6789/0 1 : [INF] mon.node-15 calling new monitor election 2014-01-10 09:11:48.424839 mon.0 192.168.121.3:6789/0 70 : [INF] osdmap e35: 18 osds: 18 up, 18 in 2014-01-10 09:11:48.430363 mon.0 192.168.121.3:6789/0 71 : [INF] pgmap v41: 392 pgs: 230 active+clean, 118 stale+active+clean, 19 active+clean+replay, 1 stale+active+clean+replay, 24 stale+peering; 0 bytes data, 33333 MB used, 40915 GB / 40948 GB avail 2014-01-10 09:11:49.007989 mon.1 192.168.121.4:6789/0 4 : [INF] mon.node-14 calling new monitor election 2014-01-10 09:11:49.008151 mon.0 192.168.121.3:6789/0 72 : [INF] mon.node-13 calling new monitor election 2014-01-10 09:11:49.010344 mon.0 192.168.121.3:6789/0 73 : [INF] mon.node-13@0 won leader election with quorum 0,1,2 2014-01-10 09:11:49.012486 mon.0 192.168.121.3:6789/0 74 : [INF] pgmap v41: 392 pgs: 230 active+clean, 118 stale+active+clean, 19 active+clean+replay, 1 stale+active+clean+replay, 24 stale+peering; 0 bytes data, 33333 MB used, 40915 GB / 40948 GB avail 2014-01-10 09:11:49.012571 mon.0 192.168.121.3:6789/0 75 : [INF] mdsmap e1: 0/0/1 up 2014-01-10 09:11:49.012672 mon.0 192.168.121.3:6789/0 76 : [INF] osdmap e35: 18 osds: 18 up, 18 in 2014-01-10 09:11:49.012786 mon.0 192.168.121.3:6789/0 77 : [INF] monmap e3: 3 mons at {node-13=192.168.121.3:6789/0,node-14=192.168.121.4:6789/0,node-15=192.168.121.5:6789/0} 2014-01-10 09:11:49.431653 mon.0 192.168.121.3:6789/0 78 : [INF] osdmap e36: 18 osds: 18 up, 18 in 2014-01-10 09:11:49.438206 mon.0 192.168.121.3:6789/0 79 : [INF] pgmap v42: 392 pgs: 230 active+clean, 118 stale+active+clean, 19 active+clean+replay, 1 stale+active+clean+replay, 24 stale+peering; 0 bytes data, 33333 MB used, 40915 GB / 40948 GB avail 2014-01-10 09:11:51.442227 mon.0 192.168.121.3:6789/0 80 : [INF] pgmap v43: 392 pgs: 328 active+clean, 35 stale+active+clean, 18 active+clean+replay, 11 stale+peering; 0 bytes data, 33328 MB used, 40915 GB / 40948 GB avail 2014-01-10 09:11:52.448136 mon.0 192.168.121.3:6789/0 81 : [INF] pgmap v44: 392 pgs: 355 active+clean, 17 stale+active+clean, 18 active+clean+replay, 2 stale+peering; 0 bytes data, 35414 MB used, 42774 GB / 42809 GB avail 2014-01-10 09:11:53.455488 mon.0 192.168.121.3:6789/0 82 : [INF] pgmap v45: 392 pgs: 374 active+clean, 18 active+clean+replay; 0 bytes data, 37501 MB used, 44633 GB / 44670 GB avail 2014-01-10 09:11:54.456082 mon.0 192.168.121.3:6789/0 83 : [INF] pgmap v46: 392 pgs: 374 active+clean, 18 active+clean+replay; 0 bytes data, 37503 MB used, 44633 GB / 44670 GB avail 2014-01-10 09:12:11.515899 mon.0 192.168.121.3:6789/0 84 : [INF] pgmap v47: 392 pgs: 376 active+clean, 16 active+clean+replay; 0 bytes data, 37503 MB used, 44633 GB / 44670 GB avail 2014-01-10 09:12:12.517888 mon.0 192.168.121.3:6789/0 85 : [INF] pgmap v48: 392 pgs: 380 active+clean, 12 active+clean+replay; 0 bytes data, 37503 MB used, 44633 GB / 44670 GB avail 2014-01-10 09:12:13.522750 mon.0 192.168.121.3:6789/0 86 : [INF] pgmap v49: 392 pgs: 388 active+clean, 4 active+clean+replay; 0 bytes data, 37503 MB used, 44633 GB / 44670 GB avail 2014-01-10 09:12:14.526775 mon.0 192.168.121.3:6789/0 87 : [INF] pgmap v50: 392 pgs: 392 active+clean; 0 bytes data, 37503 MB used, 44633 GB / 44670 GB avail 2014-01-10 09:13:12.239680 mon.0 192.168.121.3:6789/0 88 : [INF] osdmap e37: 18 osds: 18 up, 18 in 2014-01-10 09:13:12.246526 mon.0 192.168.121.3:6789/0 89 : [INF] pgmap v51: 492 pgs: 100 creating, 392 active+clean; 0 bytes data, 37503 MB used, 44633 GB / 44670 GB avail 2014-01-10 09:13:13.247990 mon.0 192.168.121.3:6789/0 90 : [INF] osdmap e38: 18 osds: 18 up, 18 in 2014-01-10 09:13:13.256986 mon.0 192.168.121.3:6789/0 91 : [INF] pgmap v52: 492 pgs: 100 creating, 392 active+clean; 0 bytes data, 37503 MB used, 44633 GB / 44670 GB avail 2014-01-10 09:13:17.338839 mon.0 192.168.121.3:6789/0 92 : [INF] pgmap v53: 492 pgs: 91 creating, 401 active+clean; 0 bytes data, 37503 MB used, 44633 GB / 44670 GB avail 2014-01-10 09:13:18.362305 mon.0 192.168.121.3:6789/0 93 : [INF] pgmap v54: 492 pgs: 492 active+clean; 0 bytes data, 37507 MB used, 44633 GB / 44670 GB avail 2014-01-10 09:13:21.605487 mon.0 192.168.121.3:6789/0 94 : [INF] osdmap e39: 18 osds: 18 up, 18 in 2014-01-10 09:13:21.607758 mon.0 192.168.121.3:6789/0 95 : [INF] pgmap v55: 492 pgs: 492 active+clean; 0 bytes data, 37507 MB used, 44633 GB / 44670 GB avail 2014-01-10 09:13:22.617050 mon.0 192.168.121.3:6789/0 96 : [INF] pgmap v56: 492 pgs: 492 active+clean; 16 bytes data, 37507 MB used, 44633 GB / 44670 GB avail; 719B/s rd, 239B/s wr, 2op/s 2014-01-10 09:13:23.629397 mon.0 192.168.121.3:6789/0 97 : [INF] pgmap v57: 492 pgs: 492 active+clean; 14464 KB data, 37517 MB used, 44633 GB / 44670 GB avail; 25000B/s rd, 7207KB/s wr, 35op/s 2014-01-10 09:13:57.484111 mon.0 192.168.121.3:6789/0 98 : [INF] pgmap v58: 492 pgs: 492 active+clean; 14464 KB data, 37517 MB used, 44633 GB / 44670 GB avail; 0B/s rd, 30B/s wr, 0op/s 2014-01-10 09:13:58.488703 mon.0 192.168.121.3:6789/0 99 : [INF] pgmap v59: 492 pgs: 492 active+clean; 14464 KB data, 37517 MB used, 44633 GB / 44670 GB avail; 88B/s rd, 29B/s wr, 0op/s 2014-01-10 09:14:12.528015 mon.0 192.168.121.3:6789/0 100 : [INF] pgmap v60: 492 pgs: 492 active+clean; 14464 KB data, 37517 MB used, 44633 GB / 44670 GB avail; 340B/s rd, 0B/s wr, 0op/s 2014-01-10 09:14:13.532773 mon.0 192.168.121.3:6789/0 101 : [INF] pgmap v61: 492 pgs: 492 active+clean; 14464 KB data, 37525 MB used, 44633 GB / 44670 GB avail; 963KB/s rd, 3op/s 2014-01-10 09:14:37.488424 mon.0 192.168.121.3:6789/0 102 : [INF] pgmap v62: 492 pgs: 492 active+clean; 14464 KB data, 37525 MB used, 44633 GB / 44670 GB avail; 580KB/s rd, 1op/s 2014-01-10 09:14:38.490516 mon.0 192.168.121.3:6789/0 103 : [INF] pgmap v63: 492 pgs: 492 active+clean; 14464 KB data, 37525 MB used, 44633 GB / 44670 GB avail; 451B/s rd, 0op/s 2014-01-10 09:14:42.949734 mon.0 192.168.121.3:6789/0 104 : [INF] pgmap v64: 492 pgs: 492 active+clean; 14464 KB data, 37525 MB used, 44633 GB / 44670 GB avail; 1876B/s rd, 2op/s 2014-01-10 09:14:52.490528 mon.0 192.168.121.3:6789/0 105 : [INF] pgmap v65: 492 pgs: 492 active+clean; 14464 KB data, 37525 MB used, 44633 GB / 44670 GB avail; 219B/s rd, 0B/s wr, 0op/s 2014-01-10 09:14:53.491956 mon.0 192.168.121.3:6789/0 106 : [INF] pgmap v66: 492 pgs: 492 active+clean; 14464 KB data, 37525 MB used, 44633 GB / 44670 GB avail; 3495B/s rd, 0B/s wr, 4op/s 2014-01-10 09:15:22.353291 mon.0 192.168.121.3:6789/0 107 : [INF] pgmap v67: 492 pgs: 492 active+clean; 14464 KB data, 37533 MB used, 44633 GB / 44670 GB avail 2014-01-10 09:15:23.358095 mon.0 192.168.121.3:6789/0 108 : [INF] pgmap v68: 492 pgs: 492 active+clean; 14464 KB data, 37542 MB used, 44633 GB / 44670 GB avail 2014-01-10 09:16:12.541447 mon.0 192.168.121.3:6789/0 109 : [INF] pgmap v69: 492 pgs: 492 active+clean; 14464 KB data, 37542 MB used, 44633 GB / 44670 GB avail 2014-01-10 09:16:52.504911 mon.0 192.168.121.3:6789/0 110 : [INF] pgmap v70: 492 pgs: 492 active+clean; 14464 KB data, 37542 MB used, 44633 GB / 44670 GB avail 2014-01-10 09:17:52.268276 mon.0 192.168.121.3:6789/0 111 : [INF] osdmap e40: 18 osds: 18 up, 18 in 2014-01-10 09:17:52.270193 mon.0 192.168.121.3:6789/0 112 : [INF] pgmap v71: 492 pgs: 492 active+clean; 14464 KB data, 37542 MB used, 44633 GB / 44670 GB avail 2014-01-10 09:17:53.290477 mon.0 192.168.121.3:6789/0 113 : [INF] pgmap v72: 492 pgs: 492 active+clean; 33856 KB data, 37550 MB used, 44633 GB / 44670 GB avail; 825B/s rd, 319KB/s wr, 1op/s 2014-01-10 09:17:57.374644 mon.0 192.168.121.3:6789/0 114 : [INF] pgmap v73: 492 pgs: 492 active+clean; 33856 KB data, 37550 MB used, 44633 GB / 44670 GB avail; 9835B/s rd, 3801KB/s wr, 14op/s 2014-01-10 09:17:58.376562 mon.0 192.168.121.3:6789/0 115 : [INF] pgmap v74: 492 pgs: 492 active+clean; 33856 KB data, 37554 MB used, 44633 GB / 44670 GB avail 2014-01-10 09:18:07.514236 mon.0 192.168.121.3:6789/0 116 : [INF] pgmap v75: 492 pgs: 492 active+clean; 33856 KB data, 37554 MB used, 44633 GB / 44670 GB avail; 807KB/s rd, 0op/s 2014-01-10 09:18:08.518986 mon.0 192.168.121.3:6789/0 117 : [INF] pgmap v76: 492 pgs: 492 active+clean; 33856 KB data, 37563 MB used, 44633 GB / 44670 GB avail; 1915KB/s rd, 4op/s 2014-01-10 09:18:13.785103 mon.0 192.168.121.3:6789/0 118 : [INF] osdmap e41: 18 osds: 18 up, 18 in 2014-01-10 09:18:13.787984 mon.0 192.168.121.3:6789/0 119 : [INF] pgmap v77: 492 pgs: 492 active+clean; 33856 KB data, 37563 MB used, 44633 GB / 44670 GB avail; 1791KB/s rd, 7op/s 2014-01-10 09:18:17.376890 mon.0 192.168.121.3:6789/0 120 : [INF] pgmap v78: 492 pgs: 492 active+clean; 33856 KB data, 37563 MB used, 44633 GB / 44670 GB avail; 346B/s rd, 0B/s wr, 0op/s 2014-01-10 09:18:18.398967 mon.0 192.168.121.3:6789/0 121 : [INF] pgmap v79: 492 pgs: 492 active+clean; 14464 KB data, 37554 MB used, 44633 GB / 44670 GB avail; 12937B/s rd, 0B/s wr, 17op/s 2014-01-10 09:20:17.397921 mon.0 192.168.121.3:6789/0 122 : [INF] pgmap v80: 492 pgs: 492 active+clean; 14464 KB data, 37554 MB used, 44633 GB / 44670 GB avail 2014-01-10 09:20:18.402620 mon.0 192.168.121.3:6789/0 123 : [INF] pgmap v81: 492 pgs: 492 active+clean; 14464 KB data, 37547 MB used, 44633 GB / 44670 GB avail 2014-01-10 09:37:17.514847 mon.0 192.168.121.3:6789/0 124 : [INF] pgmap v82: 492 pgs: 492 active+clean; 22656 KB data, 37547 MB used, 44633 GB / 44670 GB avail; 2B/s rd, 8231B/s wr, 0op/s 2014-01-10 09:37:18.521294 mon.0 192.168.121.3:6789/0 125 : [INF] pgmap v83: 492 pgs: 492 active+clean; 118 MB data, 37563 MB used, 44633 GB / 44670 GB avail; 14B/s rd, 104KB/s wr, 0op/s 2014-01-10 09:37:22.661711 mon.0 192.168.121.3:6789/0 126 : [INF] pgmap v84: 492 pgs: 492 active+clean; 134 MB data, 37627 MB used, 44633 GB / 44670 GB avail; 2387B/s rd, 22284KB/s wr, 7op/s 2014-01-10 09:37:23.099949 mon.0 192.168.121.3:6789/0 127 : [INF] osdmap e42: 18 osds: 18 up, 18 in 2014-01-10 09:37:23.104798 mon.0 192.168.121.3:6789/0 128 : [INF] pgmap v85: 492 pgs: 492 active+clean; 278 MB data, 37804 MB used, 44633 GB / 44670 GB avail; 35732KB/s wr, 4op/s 2014-01-10 09:37:24.107270 mon.0 192.168.121.3:6789/0 129 : [INF] pgmap v86: 492 pgs: 492 active+clean; 326 MB data, 37932 MB used, 44633 GB / 44670 GB avail; 133MB/s wr, 16op/s 2014-01-10 09:37:27.518167 mon.0 192.168.121.3:6789/0 130 : [INF] pgmap v87: 492 pgs: 492 active+clean; 326 MB data, 37965 MB used, 44633 GB / 44670 GB avail; 11136KB/s wr, 1op/s 2014-01-10 09:37:28.536503 mon.0 192.168.121.3:6789/0 131 : [INF] pgmap v88: 492 pgs: 492 active+clean; 326 MB data, 38168 MB used, 44632 GB / 44670 GB avail; 8119B/s rd, 144KB/s wr, 10op/s 2014-01-10 09:38:32.561368 mon.0 192.168.121.3:6789/0 132 : [INF] pgmap v89: 492 pgs: 492 active+clean; 326 MB data, 38168 MB used, 44632 GB / 44670 GB avail; 255KB/s rd, 0op/s 2014-01-10 09:38:34.112503 mon.0 192.168.121.3:6789/0 133 : [INF] pgmap v90: 492 pgs: 492 active+clean; 326 MB data, 38176 MB used, 44632 GB / 44670 GB avail; 4661KB/s rd, 2op/s 2014-01-10 09:38:37.565838 mon.0 192.168.121.3:6789/0 134 : [INF] pgmap v91: 492 pgs: 492 active+clean; 326 MB data, 38176 MB used, 44632 GB / 44670 GB avail; 58998KB/s rd, 34op/s 2014-01-10 09:38:38.592510 mon.0 192.168.121.3:6789/0 135 : [INF] pgmap v92: 492 pgs: 492 active+clean; 326 MB data, 38176 MB used, 44632 GB / 44670 GB avail; 88052KB/s rd, 10op/s 2014-01-10 09:38:42.672591 mon.0 192.168.121.3:6789/0 136 : [INF] pgmap v93: 492 pgs: 492 active+clean; 326 MB data, 38176 MB used, 44632 GB / 44670 GB avail; 88072KB/s rd, 10op/s 2014-01-10 09:38:43.675993 mon.0 192.168.121.3:6789/0 137 : [INF] pgmap v94: 492 pgs: 492 active+clean; 326 MB data, 38176 MB used, 44632 GB / 44670 GB avail; 42242KB/s rd, 5op/s 2014-01-10 09:39:27.932262 mon.0 192.168.121.3:6789/0 138 : [INF] pgmap v95: 492 pgs: 492 active+clean; 326 MB data, 38175 MB used, 44632 GB / 44670 GB avail 2014-01-10 09:40:42.981241 mon.0 192.168.121.3:6789/0 139 : [INF] pgmap v96: 492 pgs: 492 active+clean; 326 MB data, 38175 MB used, 44632 GB / 44670 GB avail 2014-01-10 09:40:43.985789 mon.0 192.168.121.3:6789/0 140 : [INF] pgmap v97: 492 pgs: 492 active+clean; 326 MB data, 38175 MB used, 44632 GB / 44670 GB avail 2014-01-10 09:41:17.576169 mon.0 192.168.121.3:6789/0 141 : [INF] pgmap v98: 492 pgs: 492 active+clean; 326 MB data, 38176 MB used, 44632 GB / 44670 GB avail; 0B/s rd, 30B/s wr, 0op/s 2014-01-10 09:41:18.577745 mon.0 192.168.121.3:6789/0 142 : [INF] pgmap v99: 492 pgs: 492 active+clean; 326 MB data, 38176 MB used, 44632 GB / 44670 GB avail; 88B/s rd, 29B/s wr, 0op/s 2014-01-10 09:41:32.987988 mon.0 192.168.121.3:6789/0 143 : [INF] pgmap v100: 492 pgs: 492 active+clean; 326 MB data, 38176 MB used, 44632 GB / 44670 GB avail; 199B/s rd, 66B/s wr, 0op/s 2014-01-10 09:41:33.989948 mon.0 192.168.121.3:6789/0 144 : [INF] pgmap v101: 492 pgs: 492 active+clean; 326 MB data, 38176 MB used, 44632 GB / 44670 GB avail; 199B/s rd, 66B/s wr, 0op/s 2014-01-10 09:41:47.730665 mon.0 192.168.121.3:6789/0 145 : [INF] pgmap v102: 492 pgs: 492 active+clean; 326 MB data, 38176 MB used, 44632 GB / 44670 GB avail; 277B/s rd, 0B/s wr, 1op/s 2014-01-10 09:41:48.732862 mon.0 192.168.121.3:6789/0 146 : [INF] pgmap v103: 492 pgs: 492 active+clean; 326 MB data, 38176 MB used, 44632 GB / 44670 GB avail; 208B/s rd, 69B/s wr, 0op/s 2014-01-10 09:42:07.818357 mon.0 192.168.121.3:6789/0 147 : [INF] pgmap v104: 492 pgs: 492 active+clean; 326 MB data, 38176 MB used, 44632 GB / 44670 GB avail; 152B/s rd, 50B/s wr, 0op/s 2014-01-10 09:42:08.822788 mon.0 192.168.121.3:6789/0 148 : [INF] pgmap v105: 492 pgs: 492 active+clean; 326 MB data, 38176 MB used, 44632 GB / 44670 GB avail; 152B/s rd, 50B/s wr, 0op/s 2014-01-10 09:42:17.560248 mon.0 192.168.121.3:6789/0 149 : [INF] pgmap v106: 492 pgs: 492 active+clean; 326 MB data, 38176 MB used, 44632 GB / 44670 GB avail; 210B/s rd, 210B/s wr, 0op/s 2014-01-10 09:42:18.564722 mon.0 192.168.121.3:6789/0 150 : [INF] pgmap v107: 492 pgs: 492 active+clean; 326 MB data, 38176 MB used, 44632 GB / 44670 GB avail; 315B/s rd, 105B/s wr, 1op/s 2014-01-10 09:42:28.171814 mon.0 192.168.121.3:6789/0 151 : [INF] pgmap v108: 492 pgs: 492 active+clean; 326 MB data, 38176 MB used, 44632 GB / 44670 GB avail; 482B/s rd, 0B/s wr, 1op/s 2014-01-10 09:42:32.820887 mon.0 192.168.121.3:6789/0 152 : [INF] pgmap v109: 492 pgs: 492 active+clean; 326 MB data, 38176 MB used, 44632 GB / 44670 GB avail; 143B/s rd, 71B/s wr, 0op/s 2014-01-10 09:42:33.822678 mon.0 192.168.121.3:6789/0 153 : [INF] pgmap v110: 492 pgs: 492 active+clean; 326 MB data, 38176 MB used, 44632 GB / 44670 GB avail; 181B/s rd, 181B/s wr, 1op/s 2014-01-10 09:42:38.004027 mon.0 192.168.121.3:6789/0 154 : [INF] pgmap v111: 492 pgs: 492 active+clean; 326 MB data, 38176 MB used, 44632 GB / 44670 GB avail; 197B/s rd, 0B/s wr, 1op/s 2014-01-10 09:42:42.702065 mon.0 192.168.121.3:6789/0 155 : [INF] pgmap v112: 492 pgs: 492 active+clean; 326 MB data, 38176 MB used, 44632 GB / 44670 GB avail 2014-01-10 09:42:43.704122 mon.0 192.168.121.3:6789/0 156 : [INF] pgmap v113: 492 pgs: 492 active+clean; 326 MB data, 38176 MB used, 44632 GB / 44670 GB avail; 538B/s rd, 179B/s wr, 2op/s 2014-01-10 09:42:52.758408 mon.0 192.168.121.3:6789/0 157 : [INF] pgmap v114: 492 pgs: 492 active+clean; 326 MB data, 38176 MB used, 44632 GB / 44670 GB avail; 305B/s rd, 203B/s wr, 1op/s 2014-01-10 09:42:53.763042 mon.0 192.168.121.3:6789/0 158 : [INF] pgmap v115: 492 pgs: 492 active+clean; 326 MB data, 38176 MB used, 44632 GB / 44670 GB avail; 305B/s rd, 101B/s wr, 1op/s 2014-01-10 09:43:07.705264 mon.0 192.168.121.3:6789/0 159 : [INF] pgmap v116: 492 pgs: 492 active+clean; 326 MB data, 38176 MB used, 44632 GB / 44670 GB avail; 274B/s rd, 0B/s wr, 1op/s 2014-01-10 09:43:08.710309 mon.0 192.168.121.3:6789/0 160 : [INF] pgmap v117: 492 pgs: 492 active+clean; 326 MB data, 38176 MB used, 44632 GB / 44670 GB avail; 205B/s rd, 68B/s wr, 0op/s 2014-01-10 09:43:17.591423 mon.0 192.168.121.3:6789/0 161 : [INF] pgmap v118: 492 pgs: 492 active+clean; 326 MB data, 38176 MB used, 44632 GB / 44670 GB avail; 207B/s rd, 103B/s wr, 0op/s 2014-01-10 09:43:23.000886 mon.0 192.168.121.3:6789/0 162 : [INF] pgmap v119: 492 pgs: 492 active+clean; 326 MB data, 38176 MB used, 44632 GB / 44670 GB avail; 71B/s rd, 0B/s wr, 0op/s 2014-01-10 09:43:24.005332 mon.0 192.168.121.3:6789/0 163 : [INF] pgmap v120: 492 pgs: 492 active+clean; 326 MB data, 38176 MB used, 44632 GB / 44670 GB avail; 479B/s rd, 159B/s wr, 1op/s 2014-01-10 09:43:33.338735 mon.0 192.168.121.3:6789/0 164 : [INF] pgmap v121: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail; 198B/s rd, 99B/s wr, 0op/s 2014-01-10 09:43:47.745511 mon.0 192.168.121.3:6789/0 165 : [INF] pgmap v122: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail 2014-01-10 09:44:17.575267 mon.0 192.168.121.3:6789/0 166 : [INF] pgmap v123: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail 2014-01-10 09:44:43.019027 mon.0 192.168.121.3:6789/0 167 : [INF] pgmap v124: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail 2014-01-10 09:44:52.773989 mon.0 192.168.121.3:6789/0 168 : [INF] pgmap v125: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail 2014-01-10 09:45:07.720332 mon.0 192.168.121.3:6789/0 169 : [INF] pgmap v126: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail 2014-01-10 09:45:08.722073 mon.0 192.168.121.3:6789/0 170 : [INF] pgmap v127: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail 2014-01-10 09:45:17.605728 mon.0 192.168.121.3:6789/0 171 : [INF] pgmap v128: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail 2014-01-10 09:45:23.193537 mon.0 192.168.121.3:6789/0 172 : [INF] pgmap v129: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail 2014-01-10 09:49:27.636304 mon.0 192.168.121.3:6789/0 173 : [INF] pgmap v130: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail; 4B/s rd, 0op/s 2014-01-10 09:49:28.637954 mon.0 192.168.121.3:6789/0 174 : [INF] pgmap v131: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail; 45B/s rd, 0op/s 2014-01-10 09:49:43.047067 mon.0 192.168.121.3:6789/0 175 : [INF] pgmap v132: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail; 730B/s rd, 0op/s 2014-01-10 09:49:44.048657 mon.0 192.168.121.3:6789/0 176 : [INF] pgmap v133: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail; 730B/s rd, 0op/s 2014-01-10 09:49:52.790987 mon.0 192.168.121.3:6789/0 177 : [INF] pgmap v134: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail; 2101B/s rd, 2op/s 2014-01-10 09:49:53.795472 mon.0 192.168.121.3:6789/0 178 : [INF] pgmap v135: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail; 1155B/s rd, 1op/s 2014-01-10 09:50:02.874131 mon.0 192.168.121.3:6789/0 179 : [INF] pgmap v136: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail; 1117B/s rd, 1op/s 2014-01-10 09:50:03.878103 mon.0 192.168.121.3:6789/0 180 : [INF] pgmap v137: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail; 1117B/s rd, 1op/s 2014-01-10 09:50:12.620492 mon.0 192.168.121.3:6789/0 181 : [INF] pgmap v138: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail; 210B/s rd, 0op/s 2014-01-10 09:50:13.625102 mon.0 192.168.121.3:6789/0 182 : [INF] pgmap v139: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail; 1155B/s rd, 1op/s 2014-01-10 09:50:22.876884 mon.0 192.168.121.3:6789/0 183 : [INF] pgmap v140: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail; 1098B/s rd, 1op/s 2014-01-10 09:50:23.878630 mon.0 192.168.121.3:6789/0 184 : [INF] pgmap v141: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail; 1098B/s rd, 1op/s 2014-01-10 09:50:33.053512 mon.0 192.168.121.3:6789/0 185 : [INF] pgmap v142: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail; 2113B/s rd, 2op/s 2014-01-10 09:50:38.221826 mon.0 192.168.121.3:6789/0 186 : [INF] pgmap v143: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail; 785B/s rd, 0op/s 2014-01-10 09:50:42.816195 mon.0 192.168.121.3:6789/0 187 : [INF] pgmap v144: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail; 104B/s rd, 0op/s 2014-01-10 09:50:43.821868 mon.0 192.168.121.3:6789/0 188 : [INF] pgmap v145: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail; 2012B/s rd, 2op/s 2014-01-10 09:50:57.761237 mon.0 192.168.121.3:6789/0 189 : [INF] pgmap v146: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail; 1370B/s rd, 1op/s 2014-01-10 09:50:58.765595 mon.0 192.168.121.3:6789/0 190 : [INF] pgmap v147: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail; 753B/s rd, 0op/s 2014-01-10 09:51:08.057150 mon.0 192.168.121.3:6789/0 191 : [INF] pgmap v148: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail; 1094B/s rd, 1op/s 2014-01-10 09:51:09.059272 mon.0 192.168.121.3:6789/0 192 : [INF] pgmap v149: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail; 1094B/s rd, 1op/s 2014-01-10 09:51:27.651502 mon.0 192.168.121.3:6789/0 193 : [INF] pgmap v150: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail; 52B/s rd, 0op/s 2014-01-10 09:51:43.398297 mon.0 192.168.121.3:6789/0 194 : [INF] pgmap v151: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail 2014-01-10 09:51:52.806434 mon.0 192.168.121.3:6789/0 195 : [INF] pgmap v152: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail 2014-01-10 09:52:12.635822 mon.0 192.168.121.3:6789/0 196 : [INF] pgmap v153: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail 2014-01-10 09:52:42.999122 mon.0 192.168.121.3:6789/0 197 : [INF] pgmap v154: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail 2014-01-10 09:52:57.775296 mon.0 192.168.121.3:6789/0 198 : [INF] pgmap v155: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail 2014-01-10 10:19:57.841945 mon.0 192.168.121.3:6789/0 199 : [INF] pgmap v156: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail; 0B/s rd, 0B/s wr, 0op/s 2014-01-10 10:19:58.846701 mon.0 192.168.121.3:6789/0 200 : [INF] pgmap v157: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail; 1B/s rd, 0B/s wr, 0op/s 2014-01-10 10:20:33.274062 mon.0 192.168.121.3:6789/0 201 : [INF] pgmap v158: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail; 0B/s rd, 29B/s wr, 0op/s 2014-01-10 10:20:34.278446 mon.0 192.168.121.3:6789/0 202 : [INF] pgmap v159: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail; 86B/s rd, 28B/s wr, 0op/s 2014-01-10 10:20:43.198913 mon.0 192.168.121.3:6789/0 203 : [INF] pgmap v160: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail; 412B/s rd, 0B/s wr, 1op/s 2014-01-10 10:20:44.203814 mon.0 192.168.121.3:6789/0 204 : [INF] pgmap v161: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail; 309B/s rd, 103B/s wr, 1op/s 2014-01-10 10:20:58.442848 mon.0 192.168.121.3:6789/0 205 : [INF] pgmap v162: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail; 335B/s rd, 134B/s wr, 1op/s 2014-01-10 10:20:59.444406 mon.0 192.168.121.3:6789/0 206 : [INF] pgmap v163: 492 pgs: 492 active+clean; 326 MB data, 38177 MB used, 44632 GB / 44670 GB avail; 201B/s rd, 67B/s wr, 0op/s 2014-01-10 10:21:13.202454 mon.0 192.168.121.3:6789/0 207 : [INF] pgmap v164: 492 pgs: 492 active+clean; 326 MB data, 38178 MB used, 44632 GB / 44670 GB avail; 0B/s rd, 69B/s wr, 0op/s 2014-01-10 10:21:14.206599 mon.0 192.168.121.3:6789/0 208 : [INF] pgmap v165: 492 pgs: 492 active+clean; 326 MB data, 38178 MB used, 44632 GB / 44670 GB avail; 208B/s rd, 69B/s wr, 0op/s 2014-01-10 10:21:53.027001 mon.0 192.168.121.3:6789/0 209 : [INF] pgmap v166: 492 pgs: 492 active+clean; 326 MB data, 38178 MB used, 44632 GB / 44670 GB avail 2014-01-10 10:21:57.855915 mon.0 192.168.121.3:6789/0 210 : [INF] pgmap v167: 492 pgs: 492 active+clean; 326 MB data, 38178 MB used, 44632 GB / 44670 GB avail 2014-01-10 10:22:43.283433 mon.0 192.168.121.3:6789/0 211 : [INF] pgmap v168: 492 pgs: 492 active+clean; 326 MB data, 38178 MB used, 44632 GB / 44670 GB avail 2014-01-10 10:22:58.588210 mon.0 192.168.121.3:6789/0 212 : [INF] pgmap v169: 492 pgs: 492 active+clean; 326 MB data, 38178 MB used, 44632 GB / 44670 GB avail 2014-01-10 10:23:13.216422 mon.0 192.168.121.3:6789/0 213 : [INF] pgmap v170: 492 pgs: 492 active+clean; 326 MB data, 38178 MB used, 44632 GB / 44670 GB avail 2014-01-10 10:23:13.216422 mon.0 192.168.121.3:6789/0 213 : [INF] pgmap v170: 492 pgs: 492 active+clean; 326 MB data, 38178 MB used, 44632 GB / 44670 GB avail 2014-01-10 11:06:05.610217 mon.0 192.168.121.3:6789/0 337 : [INF] pgmap v236: 492 pgs: 492 active+clean; 644 MB data, 26552 MB used, 29754 GB / 29780 GB avail; 2087B/s rd, 2op/s 2014-01-10 11:07:59.337319 mon.0 192.168.121.3:6789/0 338 : [INF] pgmap v237: 492 pgs: 492 active+clean; 644 MB data, 26552 MB used, 29754 GB / 29780 GB avail 2014-01-10 11:08:00.339176 mon.0 192.168.121.3:6789/0 339 : [INF] pgmap v238: 492 pgs: 492 active+clean; 644 MB data, 26552 MB used, 29754 GB / 29780 GB avail 2014-01-10 12:54:00.409096 mon.0 192.168.121.3:6789/0 340 : [INF] mon.node-13 calling new monitor election 2014-01-10 12:54:00.409294 mon.1 192.168.121.4:6789/0 1 : [INF] mon.node-14 calling new monitor election 2014-01-10 12:54:00.411182 mon.0 192.168.121.3:6789/0 341 : [INF] mon.node-13@0 won leader election with quorum 0,1,2 2014-01-10 12:54:00.412797 mon.0 192.168.121.3:6789/0 342 : [INF] pgmap v238: 492 pgs: 492 active+clean; 644 MB data, 26552 MB used, 29754 GB / 29780 GB avail 2014-01-10 12:54:00.412843 mon.0 192.168.121.3:6789/0 343 : [INF] mdsmap e1: 0/0/1 up 2014-01-10 12:54:00.412906 mon.0 192.168.121.3:6789/0 344 : [INF] osdmap e48: 18 osds: 12 up, 12 in 2014-01-10 12:54:00.413030 mon.0 192.168.121.3:6789/0 345 : [INF] monmap e3: 3 mons at {node-13=192.168.121.3:6789/0,node-14=192.168.121.4:6789/0,node-15=192.168.121.5:6789/0} 2014-01-10 12:54:01.467637 mon.0 192.168.121.3:6789/0 346 : [INF] osd.1 192.168.121.4:6800/3579 boot 2014-01-10 12:54:01.467840 mon.0 192.168.121.3:6789/0 347 : [INF] osdmap e49: 18 osds: 13 up, 13 in 2014-01-10 12:54:01.470480 mon.0 192.168.121.3:6789/0 348 : [INF] pgmap v239: 492 pgs: 492 active+clean; 644 MB data, 26552 MB used, 29754 GB / 29780 GB avail 2014-01-10 12:54:02.474463 mon.0 192.168.121.3:6789/0 349 : [INF] osd.5 192.168.121.4:6802/6015 boot 2014-01-10 12:54:02.474717 mon.0 192.168.121.3:6789/0 350 : [INF] osd.14 192.168.121.4:6804/8493 boot 2014-01-10 12:54:02.474949 mon.0 192.168.121.3:6789/0 351 : [INF] osdmap e50: 18 osds: 15 up, 15 in 2014-01-10 12:54:02.499927 mon.0 192.168.121.3:6789/0 352 : [INF] pgmap v240: 492 pgs: 492 active+clean; 644 MB data, 26552 MB used, 29754 GB / 29780 GB avail 2014-01-10 12:54:03.479803 mon.0 192.168.121.3:6789/0 353 : [INF] osd.7 192.168.121.4:6806/9878 boot 2014-01-10 12:54:03.480161 mon.0 192.168.121.3:6789/0 354 : [INF] osdmap e51: 18 osds: 16 up, 16 in 2014-01-10 12:54:03.488406 mon.0 192.168.121.3:6789/0 355 : [INF] pgmap v241: 492 pgs: 492 active+clean; 644 MB data, 26552 MB used, 29754 GB / 29780 GB avail 2014-01-10 12:54:04.480646 mon.0 192.168.121.3:6789/0 356 : [INF] osd.3 192.168.121.4:6808/10352 boot 2014-01-10 12:54:04.481007 mon.0 192.168.121.3:6789/0 357 : [INF] osdmap e52: 18 osds: 17 up, 17 in 2014-01-10 12:54:04.491223 mon.0 192.168.121.3:6789/0 358 : [INF] pgmap v242: 492 pgs: 492 active+clean; 644 MB data, 26552 MB used, 29754 GB / 29780 GB avail 2014-01-10 12:54:05.482433 mon.0 192.168.121.3:6789/0 359 : [INF] osd.10 192.168.121.4:6810/10802 boot 2014-01-10 12:54:05.482810 mon.0 192.168.121.3:6789/0 360 : [INF] osdmap e53: 18 osds: 18 up, 18 in 2014-01-10 12:54:05.492463 mon.0 192.168.121.3:6789/0 361 : [INF] pgmap v243: 492 pgs: 486 active+clean, 6 peering; 644 MB data, 26549 MB used, 29754 GB / 29780 GB avail; recovering 2 o/s, 7221KB/s, 4 key/s 2014-01-10 12:54:06.483877 mon.0 192.168.121.3:6789/0 362 : [INF] osdmap e54: 18 osds: 18 up, 18 in 2014-01-10 12:54:06.489329 mon.0 192.168.121.3:6789/0 363 : [INF] pgmap v244: 492 pgs: 486 active+clean, 6 peering; 644 MB data, 26503 MB used, 29754 GB / 29780 GB avail; recovering 6 o/s, 16463KB/s, 23 key/s 2014-01-10 12:54:07.502648 mon.0 192.168.121.3:6789/0 364 : [INF] pgmap v245: 492 pgs: 486 active+clean, 6 peering; 644 MB data, 28674 MB used, 33475 GB / 33503 GB avail; recovering 5 o/s, 14329KB/s, 15 key/s 2014-01-10 12:54:08.504091 mon.0 192.168.121.3:6789/0 365 : [INF] pgmap v246: 492 pgs: 486 active+clean, 6 peering; 644 MB data, 32967 MB used, 37192 GB / 37225 GB avail; recovering 7 o/s, 4403KB/s 2014-01-10 12:54:09.510231 mon.0 192.168.121.3:6789/0 366 : [INF] pgmap v247: 492 pgs: 486 active+clean, 6 peering; 644 MB data, 35051 MB used, 39051 GB / 39086 GB avail; recovering 10 o/s, 17699KB/s, 2 key/s 2014-01-10 12:54:10.518562 mon.0 192.168.121.3:6789/0 367 : [INF] pgmap v248: 492 pgs: 492 active+clean; 644 MB data, 37181 MB used, 42772 GB / 42809 GB avail; recovering 18 o/s, 26501KB/s, 9 key/s 2014-01-10 12:54:11.535365 mon.0 192.168.121.3:6789/0 368 : [INF] pgmap v249: 492 pgs: 492 active+clean; 644 MB data, 39106 MB used, 44631 GB / 44670 GB avail; recovering 39 o/s, 87017KB/s, 8 key/s 2014-01-10 12:56:07.011860 mon.0 192.168.121.3:6789/0 369 : [INF] pgmap v250: 492 pgs: 492 active+clean; 644 MB data, 39106 MB used, 44631 GB / 44670 GB avail 2014-01-10 12:56:08.016389 mon.0 192.168.121.3:6789/0 370 : [INF] pgmap v251: 492 pgs: 492 active+clean; 644 MB data, 39094 MB used, 44631 GB / 44670 GB avail 2014-01-10 12:56:09.036856 mon.0 192.168.121.3:6789/0 371 : [INF] pgmap v252: 492 pgs: 492 active+clean; 644 MB data, 39093 MB used, 44631 GB / 44670 GB avail 2014-01-10 12:56:10.041147 mon.0 192.168.121.3:6789/0 372 : [INF] pgmap v253: 492 pgs: 492 active+clean; 644 MB data, 39092 MB used, 44631 GB / 44670 GB avail 2014-01-10 12:56:11.045739 mon.0 192.168.121.3:6789/0 373 : [INF] pgmap v254: 492 pgs: 492 active+clean; 644 MB data, 39090 MB used, 44631 GB / 44670 GB avail 2014-01-10 12:56:12.047505 mon.0 192.168.121.3:6789/0 374 : [INF] pgmap v255: 492 pgs: 492 active+clean; 644 MB data, 39089 MB used, 44631 GB / 44670 GB avail 2014-01-10 13:03:05.382557 mon.0 192.168.121.3:6789/0 375 : [INF] pgmap v256: 492 pgs: 492 active+clean; 644 MB data, 39089 MB used, 44631 GB / 44670 GB avail; 118B/s rd, 0op/s 2014-01-10 13:03:06.386825 mon.0 192.168.121.3:6789/0 376 : [INF] pgmap v257: 492 pgs: 492 active+clean; 644 MB data, 39089 MB used, 44631 GB / 44670 GB avail; 118B/s rd, 0op/s 2014-01-10 13:03:45.467740 mon.0 192.168.121.3:6789/0 377 : [INF] pgmap v258: 492 pgs: 492 active+clean; 644 MB data, 39089 MB used, 44631 GB / 44670 GB avail 2014-01-10 13:04:00.469657 mon.0 192.168.121.3:6789/0 378 : [INF] pgmap v259: 492 pgs: 492 active+clean; 644 MB data, 39089 MB used, 44631 GB / 44670 GB avail; 189B/s rd, 0op/s 2014-01-10 13:04:01.471439 mon.0 192.168.121.3:6789/0 379 : [INF] pgmap v260: 492 pgs: 492 active+clean; 644 MB data, 39089 MB used, 44631 GB / 44670 GB avail; 703B/s rd, 0op/s 2014-01-10 13:04:09.182145 mon.0 192.168.121.3:6789/0 380 : [INF] pgmap v261: 492 pgs: 492 active+clean; 644 MB data, 39089 MB used, 44631 GB / 44670 GB avail; 117B/s rd, 0op/s 2014-01-10 13:10:30.517099 mon.0 192.168.121.3:6789/0 381 : [INF] pgmap v262: 492 pgs: 492 active+clean; 644 MB data, 39089 MB used, 44631 GB / 44670 GB avail 2014-01-10 13:10:45.289862 mon.0 192.168.121.3:6789/0 382 : [INF] pgmap v263: 492 pgs: 492 active+clean; 644 MB data, 39089 MB used, 44631 GB / 44670 GB avail 2014-01-10 13:12:09.240535 mon.0 192.168.121.3:6789/0 383 : [INF] pgmap v264: 492 pgs: 492 active+clean; 644 MB data, 39089 MB used, 44631 GB / 44670 GB avail 2014-01-10 13:12:30.538032 mon.0 192.168.121.3:6789/0 384 : [INF] pgmap v265: 492 pgs: 492 active+clean; 644 MB data, 39089 MB used, 44631 GB / 44670 GB avail 2014-01-10 13:12:45.304507 mon.0 192.168.121.3:6789/0 385 : [INF] pgmap v266: 492 pgs: 492 active+clean; 644 MB data, 39089 MB used, 44631 GB / 44670 GB avail 2014-01-10 13:58:00.868422 mon.0 192.168.121.3:6789/0 386 : [INF] pgmap v267: 492 pgs: 492 active+clean; 644 MB data, 39089 MB used, 44631 GB / 44670 GB avail; 3B/s rd, 0op/s 2014-01-10 13:58:01.872373 mon.0 192.168.121.3:6789/0 387 : [INF] pgmap v268: 492 pgs: 492 active+clean; 644 MB data, 39089 MB used, 44631 GB / 44670 GB avail; 4B/s rd, 0op/s 2014-01-10 14:14:09.680723 mon.0 192.168.121.3:6789/0 388 : [INF] pgmap v269: 492 pgs: 492 active+clean; 644 MB data, 39089 MB used, 44631 GB / 44670 GB avail 2014-01-10 14:14:11.684491 mon.0 192.168.121.3:6789/0 389 : [INF] pgmap v270: 492 pgs: 492 active+clean; 644 MB data, 39089 MB used, 44631 GB / 44670 GB avail 2014-01-10 14:16:09.695883 mon.0 192.168.121.3:6789/0 390 : [INF] pgmap v271: 492 pgs: 492 active+clean; 644 MB data, 39089 MB used, 44631 GB / 44670 GB avail 2014-01-10 14:16:11.699720 mon.0 192.168.121.3:6789/0 391 : [INF] pgmap v272: 492 pgs: 492 active+clean; 644 MB data, 39089 MB used, 44631 GB / 44670 GB avail 2014-01-10 14:39:54.201945 mon.2 192.168.121.5:6789/0 2 : [INF] mon.node-15 calling new monitor election 2014-01-10 14:39:54.203144 mon.1 192.168.121.4:6789/0 2 : [INF] mon.node-14 calling new monitor election 2014-01-10 14:39:59.204544 mon.1 192.168.121.4:6789/0 3 : [INF] mon.node-14@1 won leader election with quorum 1,2 2014-01-10 14:39:59.219023 mon.1 192.168.121.4:6789/0 4 : [INF] pgmap v272: 492 pgs: 492 active+clean; 644 MB data, 39089 MB used, 44631 GB / 44670 GB avail 2014-01-10 14:39:59.219075 mon.1 192.168.121.4:6789/0 5 : [INF] mdsmap e1: 0/0/1 up 2014-01-10 14:39:59.228896 mon.1 192.168.121.4:6789/0 6 : [INF] osdmap e54: 18 osds: 18 up, 18 in 2014-01-10 14:39:59.228976 mon.1 192.168.121.4:6789/0 7 : [INF] monmap e3: 3 mons at {node-13=192.168.121.3:6789/0,node-14=192.168.121.4:6789/0,node-15=192.168.121.5:6789/0} 2014-01-10 14:40:37.761375 mon.1 192.168.121.4:6789/0 8 : [DBG] osd.0 192.168.121.3:6816/14498 reported failed by osd.1 192.168.121.4:6800/3579 2014-01-10 14:40:37.761511 mon.1 192.168.121.4:6789/0 9 : [DBG] osd.2 192.168.121.3:6812/11548 reported failed by osd.1 192.168.121.4:6800/3579 2014-01-10 14:40:37.761677 mon.1 192.168.121.4:6789/0 10 : [DBG] osd.4 192.168.121.3:6814/12943 reported failed by osd.1 192.168.121.4:6800/3579 2014-01-10 14:40:37.761757 mon.1 192.168.121.4:6789/0 11 : [DBG] osd.12 192.168.121.3:6808/10150 reported failed by osd.1 192.168.121.4:6800/3579 2014-01-10 14:40:38.379843 mon.1 192.168.121.4:6789/0 12 : [DBG] osd.2 192.168.121.3:6812/11548 reported failed by osd.5 192.168.121.4:6802/6015 2014-01-10 14:40:38.379999 mon.1 192.168.121.4:6789/0 13 : [DBG] osd.4 192.168.121.3:6814/12943 reported failed by osd.5 192.168.121.4:6802/6015 2014-01-10 14:40:38.380117 mon.1 192.168.121.4:6789/0 14 : [DBG] osd.6 192.168.121.3:6804/9128 reported failed by osd.5 192.168.121.4:6802/6015 2014-01-10 14:40:38.380253 mon.1 192.168.121.4:6789/0 15 : [DBG] osd.9 192.168.121.3:6800/8471 reported failed by osd.5 192.168.121.4:6802/6015 2014-01-10 14:40:39.191284 mon.1 192.168.121.4:6789/0 16 : [DBG] osd.4 192.168.121.3:6814/12943 reported failed by osd.14 192.168.121.4:6804/8493 2014-01-10 14:40:39.191367 mon.1 192.168.121.4:6789/0 17 : [INF] osd.4 192.168.121.3:6814/12943 failed (3 reports from 3 peers after 53.811621 >= grace 20.000000) 2014-01-10 14:40:39.191490 mon.1 192.168.121.4:6789/0 18 : [DBG] osd.6 192.168.121.3:6804/9128 reported failed by osd.14 192.168.121.4:6804/8493 2014-01-10 14:40:39.191701 mon.1 192.168.121.4:6789/0 19 : [DBG] osd.12 192.168.121.3:6808/10150 reported failed by osd.14 192.168.121.4:6804/8493 2014-01-10 14:40:39.820860 mon.1 192.168.121.4:6789/0 20 : [INF] osdmap e55: 18 osds: 17 up, 18 in 2014-01-10 14:40:39.824617 mon.1 192.168.121.4:6789/0 21 : [INF] pgmap v273: 492 pgs: 483 active+clean, 9 stale+active+clean; 644 MB data, 39089 MB used, 44631 GB / 44670 GB avail 2014-01-10 14:40:39.824914 mon.1 192.168.121.4:6789/0 22 : [DBG] osd.0 192.168.121.3:6816/14498 reported failed by osd.15 192.168.121.5:6808/47558 2014-01-10 14:40:39.825059 mon.1 192.168.121.4:6789/0 23 : [DBG] osd.2 192.168.121.3:6812/11548 reported failed by osd.15 192.168.121.5:6808/47558 2014-01-10 14:40:39.825112 mon.1 192.168.121.4:6789/0 24 : [INF] osd.2 192.168.121.3:6812/11548 failed (3 reports from 3 peers after 54.445419 >= grace 20.000000) 2014-01-10 14:40:39.825283 mon.1 192.168.121.4:6789/0 25 : [DBG] osd.9 192.168.121.3:6800/8471 reported failed by osd.15 192.168.121.5:6808/47558 2014-01-10 14:40:39.825460 mon.1 192.168.121.4:6789/0 26 : [DBG] osd.12 192.168.121.3:6808/10150 reported failed by osd.15 192.168.121.5:6808/47558 2014-01-10 14:40:39.825510 mon.1 192.168.121.4:6789/0 27 : [INF] osd.12 192.168.121.3:6808/10150 failed (3 reports from 3 peers after 54.633868 >= grace 20.000000) 2014-01-10 14:40:40.077148 mon.1 192.168.121.4:6789/0 28 : [DBG] osd.0 192.168.121.3:6816/14498 reported failed by osd.7 192.168.121.4:6806/9878 2014-01-10 14:40:40.077212 mon.1 192.168.121.4:6789/0 29 : [INF] osd.0 192.168.121.3:6816/14498 failed (3 reports from 3 peers after 55.315994 >= grace 20.000000) 2014-01-10 14:40:40.077455 mon.1 192.168.121.4:6789/0 30 : [DBG] osd.2 192.168.121.3:6812/11548 reported failed by osd.7 192.168.121.4:6806/9878 2014-01-10 14:40:40.077603 mon.1 192.168.121.4:6789/0 31 : [DBG] osd.6 192.168.121.3:6804/9128 reported failed by osd.7 192.168.121.4:6806/9878 2014-01-10 14:40:40.077667 mon.1 192.168.121.4:6789/0 32 : [INF] osd.6 192.168.121.3:6804/9128 failed (3 reports from 3 peers after 54.697915 >= grace 20.000000) 2014-01-10 14:40:40.077887 mon.1 192.168.121.4:6789/0 33 : [DBG] osd.12 192.168.121.3:6808/10150 reported failed by osd.7 192.168.121.4:6806/9878 2014-01-10 14:40:40.786301 mon.1 192.168.121.4:6789/0 34 : [DBG] osd.6 192.168.121.3:6804/9128 reported failed by osd.16 192.168.121.5:6814/3763 2014-01-10 14:40:40.786514 mon.1 192.168.121.4:6789/0 35 : [DBG] osd.9 192.168.121.3:6800/8471 reported failed by osd.16 192.168.121.5:6814/3763 2014-01-10 14:40:40.786576 mon.1 192.168.121.4:6789/0 36 : [INF] osd.9 192.168.121.3:6800/8471 failed (3 reports from 3 peers after 55.406804 >= grace 20.000000) 2014-01-10 14:40:40.786786 mon.1 192.168.121.4:6789/0 37 : [DBG] osd.12 192.168.121.3:6808/10150 reported failed by osd.16 192.168.121.5:6814/3763 2014-01-10 14:40:40.822874 mon.1 192.168.121.4:6789/0 38 : [INF] osdmap e56: 18 osds: 12 up, 18 in 2014-01-10 14:40:40.837455 mon.1 192.168.121.4:6789/0 39 : [INF] pgmap v274: 492 pgs: 316 active+clean, 176 stale+active+clean; 644 MB data, 39089 MB used, 44631 GB / 44670 GB avail 2014-01-10 14:40:41.825073 mon.1 192.168.121.4:6789/0 40 : [INF] osdmap e57: 18 osds: 12 up, 18 in 2014-01-10 14:40:41.837926 mon.1 192.168.121.4:6789/0 41 : [INF] pgmap v275: 492 pgs: 289 active+clean, 130 stale+active+clean, 73 peering; 644 MB data, 39089 MB used, 44631 GB / 44670 GB avail 2014-01-10 14:40:42.844104 mon.1 192.168.121.4:6789/0 42 : [INF] osdmap e58: 18 osds: 12 up, 18 in 2014-01-10 14:40:42.854049 mon.1 192.168.121.4:6789/0 43 : [INF] pgmap v276: 492 pgs: 250 active+clean, 103 stale+active+clean, 139 peering; 644 MB data, 39090 MB used, 44631 GB / 44670 GB avail 2014-01-10 14:40:42.857484 mon.1 192.168.121.4:6789/0 44 : [INF] pgmap v277: 492 pgs: 250 active+clean, 103 stale+active+clean, 139 peering; 644 MB data, 39090 MB used, 44631 GB / 44670 GB avail 2014-01-10 14:40:46.129642 mon.1 192.168.121.4:6789/0 45 : [INF] pgmap v278: 492 pgs: 238 active+clean, 97 stale+active+clean, 139 peering, 18 active+degraded; 644 MB data, 39090 MB used, 44631 GB / 44670 GB avail; 10/404 degraded (2.475%) 2014-01-10 14:40:47.145174 mon.1 192.168.121.4:6789/0 46 : [INF] pgmap v279: 492 pgs: 196 active+clean, 33 stale+active+clean, 23 peering, 240 active+degraded; 644 MB data, 39095 MB used, 44631 GB / 44670 GB avail; 104/404 degraded (25.743%) 2014-01-10 14:40:48.157921 mon.1 192.168.121.4:6789/0 47 : [INF] pgmap v280: 492 pgs: 164 active+clean, 328 active+degraded; 644 MB data, 39097 MB used, 44631 GB / 44670 GB avail; 146/404 degraded (36.139%) 2014-01-10 14:42:46.143523 mon.1 192.168.121.4:6789/0 48 : [INF] pgmap v281: 492 pgs: 164 active+clean, 328 active+degraded; 644 MB data, 39097 MB used, 44631 GB / 44670 GB avail; 146/404 degraded (36.139%) 2014-01-10 14:42:47.145453 mon.1 192.168.121.4:6789/0 49 : [INF] pgmap v282: 492 pgs: 164 active+clean, 328 active+degraded; 644 MB data, 39096 MB used, 44631 GB / 44670 GB avail; 146/404 degraded (36.139%) 2014-01-10 14:42:48.149859 mon.1 192.168.121.4:6789/0 50 : [INF] pgmap v283: 492 pgs: 164 active+clean, 328 active+degraded; 644 MB data, 39096 MB used, 44631 GB / 44670 GB avail; 146/404 degraded (36.139%) 2014-01-10 14:45:44.440481 mon.1 192.168.121.4:6789/0 51 : [INF] osd.0 out (down for 303.618564) 2014-01-10 14:45:44.440536 mon.1 192.168.121.4:6789/0 52 : [INF] osd.2 out (down for 303.618564) 2014-01-10 14:45:44.440558 mon.1 192.168.121.4:6789/0 53 : [INF] osd.4 out (down for 304.620147) 2014-01-10 14:45:44.440599 mon.1 192.168.121.4:6789/0 54 : [INF] osd.6 out (down for 303.618563) 2014-01-10 14:45:44.440624 mon.1 192.168.121.4:6789/0 55 : [INF] osd.9 out (down for 303.618563) 2014-01-10 14:45:44.440646 mon.1 192.168.121.4:6789/0 56 : [INF] osd.12 out (down for 303.618563) 2014-01-10 14:45:44.443946 mon.1 192.168.121.4:6789/0 57 : [INF] osdmap e59: 18 osds: 12 up, 12 in 2014-01-10 14:45:44.447552 mon.1 192.168.121.4:6789/0 58 : [INF] pgmap v284: 492 pgs: 164 active+clean, 328 active+degraded; 644 MB data, 26042 MB used, 29754 GB / 29780 GB avail; 146/404 degraded (36.139%) 2014-01-10 14:45:45.449968 mon.1 192.168.121.4:6789/0 59 : [INF] osdmap e60: 18 osds: 12 up, 12 in 2014-01-10 14:45:45.457486 mon.1 192.168.121.4:6789/0 60 : [INF] pgmap v285: 492 pgs: 164 active+clean, 328 active+degraded; 644 MB data, 26042 MB used, 29754 GB / 29780 GB avail; 146/404 degraded (36.139%) 2014-01-10 14:45:49.602339 mon.1 192.168.121.4:6789/0 61 : [INF] pgmap v286: 492 pgs: 211 active+clean, 281 active+degraded; 644 MB data, 26037 MB used, 29754 GB / 29780 GB avail; 120/404 degraded (29.703%); recovering 5 o/s, 12654KB/s, 3 key/s 2014-01-10 14:45:50.621166 mon.1 192.168.121.4:6789/0 62 : [INF] pgmap v287: 492 pgs: 492 active+clean; 644 MB data, 26523 MB used, 29754 GB / 29780 GB avail; recovering 42 o/s, 129MB/s, 36 key/s 2014-01-10 14:47:49.612233 mon.1 192.168.121.4:6789/0 63 : [INF] pgmap v288: 492 pgs: 492 active+clean; 644 MB data, 26523 MB used, 29754 GB / 29780 GB avail