Out of memory

Bug #1460621 reported by Bedlore
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Rapid Photo Downloader
Status tracked in Pyqt
Pyqt
Fix Released
Low
Damon Lynch

Bug Description

I've found downloading a large number of files results in unpassable errors. I'm trying to download my Dad's holidays pics, I'm using a USB3 SD card reader. While scanning it reached 33075 photos and 335 videos on the 32GB card.

Syslog stated

kernel: [ 8540.469580] Out of memory: Kill process 18018 (rapid-photo-dow) score 910 or sacrifice child
kernel: [ 8540.469582] Killed process 18018 (rapid-photo-dow) total-vm:15845608kB, anon-rss:7091056kB, file-rss:752kB

Any work-arounds available?

Revision history for this message
Damon Lynch (dlynch3) wrote :

That's interesting. I've tested it with that number of files myself, but my laptop has 16GB of RAM.

The first thing to try is turning off thumbnail generation, in the preferences. That should reduce memory consumption.

Another option is to set Linux to use a swapfile, so even if you run of RAM, you can page some memory to disk.

Changed in rapid:
status: New → Confirmed
importance: Undecided → Low
assignee: nobody → Damon Lynch (dlynch3)
Revision history for this message
Bedlore (brendan-dbinformatics) wrote :

I re-attempted this several times with the same result, at some point something has gone terribly terribly wrong. The USB card has been reformatted as a linux partition. It even appears to contain a debian 7.5 distro on it. I am so screwed, have I just destroyed all of my fathers holiday photos?

Revision history for this message
Damon Lynch (dlynch3) wrote :

What steps did you take to try to resolve the problem?

Revision history for this message
Bedlore (brendan-dbinformatics) wrote :

I think I've died several times from panic. I was VERY stupid and picked up the wrong SD card, I have many here. It seems that the SD card I had picked up was actually a rasbian (Debian for Rpi) card. Rapid Photo Download must of been just counting random kernel files as pictures oddly. It was reading 33075 photos and 335 videos, so I don't know how this could be.
I'm now about to re-test with what I believe is the correct cards. :( Sorry about the false reports.

Revision history for this message
Damon Lynch (dlynch3) wrote :

Rapid Photo Downloader would have been picking up anything with an extension that looked like a TIFF, jpeg, RAW, or video file. Apparently the rasbian installer has quite a few of them!

Damon Lynch (dlynch3)
Changed in rapid:
milestone: none → 0.9.0a1
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.