DB connection error at heavy load
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
zaqar |
Fix Released
|
Critical
|
Ozgur Akan |
Bug Description
The logs show a DB connection error at heavy loads. This causes the server to return a http 503.
Subsequent requests to the server (even light loads) throw the same error.
At the time marconi returns this exception, a test application that inserts/deletes from marconi messages collection runs without any issues.
Exception we get;
2013-08-15 23:38:36.194 16236 ERROR marconi.
2013-08-15 23:38:36.194 16236 ERROR marconi.
2013-08-15 23:38:36.195 16236 ERROR marconi.
2013-08-15 23:38:36.195 16236 TRACE marconi.
2013-08-15 23:38:36.195 16236 TRACE marconi.
2013-08-15 23:38:36.195 16236 TRACE marconi.
2013-08-15 23:38:36.195 16236 TRACE marconi.
2013-08-15 23:38:36.195 16236 TRACE marconi.
2013-08-15 23:38:36.195 16236 TRACE marconi.
2013-08-15 23:38:36.195 16236 TRACE marconi.
2013-08-15 23:38:36.195 16236 ERROR marconi.
2013-08-15 23:38:36.195 16236 TRACE marconi.
2013-08-15 23:38:36.195 16236 TRACE marconi.
2013-08-15 23:38:36.195 16236 TRACE marconi.
2013-08-15 23:38:36.195 16236 TRACE marconi.
2013-08-15 23:38:36.195 16236 TRACE marconi.
2013-08-15 23:38:36.195 16236 TRACE marconi.
2013-08-15 23:38:36.195 16236 TRACE marconi.
[pid: 16236|app: 0|req: 11691/67781] 10.183.251.3 () {54 vars in 919 bytes} [Thu Aug 15 23:38:31 2013] POST /v1/queues/
description: | updated |
Changed in marconi: | |
importance: | Undecided → High |
milestone: | none → havana-3 |
assignee: | nobody → Flavio Percoco (flaper87) |
status: | New → Incomplete |
status: | Incomplete → Confirmed |
Changed in marconi: | |
importance: | High → Critical |
Changed in marconi: | |
status: | Invalid → Fix Released |
If you repro this with the MMS agent installed, do the stats show any anomalies right before you start getting lots of connection errors?