Duplicity crashes with too many files open on CentOS 7 64bit
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Duplicity |
Fix Released
|
Medium
|
Unassigned |
Bug Description
I believe I have hit this bug which was apparently fixed a long time ago:
https:/
# duplicity --version
duplicity 0.6.24
# python --version
Python 2.7.5
# cat /etc/redhat-release
CentOS Linux release 7.2.1511 (Core)
^ Fully updated
File system: xfs
I recently started getting these cron errors reports on a CentOS 7 64bit server:
Traceback (most recent call last):
File "/bin/duplicity", line 1502, in <module>
File "/bin/duplicity", line 1496, in with_tempdir
File "/bin/duplicity", line 1345, in main
File "/bin/duplicity", line 1478, in do_backup
File "/bin/duplicity", line 633, in incremental_backup
File "/bin/duplicity", line 401, in write_multivol
File "/usr/lib64/
IOError: [Errno 24] Too many open files: '/tmp/duplicity
Traceback (most recent call last):
File "/bin/duplicity", line 1502, in <module>
File "/bin/duplicity", line 1496, in with_tempdir
File "/bin/duplicity", line 1345, in main
File "/bin/duplicity", line 1478, in do_backup
File "/bin/duplicity", line 633, in incremental_backup
File "/bin/duplicity", line 401, in write_multivol
File "/usr/lib64/
File "/usr/lib64/
File "/usr/lib64/
File "/usr/lib64/
File "/usr/lib64/
File "/usr/lib64/
File "/usr/lib64/
File "/usr/lib64/
File "/usr/lib64/
OSError: [Errno 24] Too many open files: '/root'
Traceback (most recent call last):
File "/bin/duplicity", line 1502, in <module>
File "/bin/duplicity", line 1496, in with_tempdir
File "/bin/duplicity", line 1345, in main
File "/bin/duplicity", line 1478, in do_backup
File "/bin/duplicity", line 633, in incremental_backup
File "/bin/duplicity", line 401, in write_multivol
File "/usr/lib64/
IOError: [Errno 24] Too many open files: '/tmp/duplicity
Here's the relevant collection-status:
Chain start time: Thu Sep 24 20:46:50 2015
Chain end time: Sat Mar 12 12:02:29 2016
Number of contained backup sets: 1017
Total number of contained volumes: 1017
The bug mentioned at the top the problem was due to pgp open files when there were many incrementals.
My workaround right now is setting `ulimit -n 4096` at the top of the backup script.
I will try to get the -v9 log as well.
Changed in duplicity: | |
assignee: | nobody → Kenneth Loafman (kenneth-loafman) |
importance: | Undecided → Medium |
milestone: | none → 0.7.13 |
status: | New → In Progress |
Changed in duplicity: | |
status: | Fix Committed → Fix Released |
See question #631423 for details of the fix.