swift-log-stats-collector can run over itself

Bug #664073 reported by clayg
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Object Storage (swift)
Won't Fix
Medium
Unassigned

Bug Description

The deployment docs recommend that log-stats-collector be run from cron once per hour. If the process get's behind it can take more than an hour to run. Only one instance of swift-log-stats-collector (LogProcessorDaemon) should be processing logs at a time. Starting a second process while one is already running will most likely result in double processing of some stats data.

Lack of native locking places extra burden on deployment as care must be taken to prevent starting a new swift-logs-stats-collector process if one is already running.

Adding a locking context manager to common.utils might be useful for other swift daemons. Alternatively, it may be possible to avoid contention by implementing stats.log_processor.LogProcessorDaemon.run_forever and start swift-log-stats-collector via init.

Tags: stats

Related branches

Chuck Thier (cthier)
Changed in swift:
milestone: none → 1.1.1
Chuck Thier (cthier)
Changed in swift:
status: New → Triaged
assignee: nobody → John Dickinson (notmyname)
Changed in swift:
assignee: John Dickinson (notmyname) → nobody
Changed in swift:
assignee: nobody → John Dickinson (notmyname)
status: Triaged → In Progress
Changed in swift:
status: In Progress → Won't Fix
assignee: John Dickinson (notmyname) → nobody
milestone: 1.1.1 → none
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.