1.8, 1.10 Testing: Red error in Firefox - UNIQUE contraint failed

[gravy45]

Running Ubuntu MATE 15.10 64-bit. Bleachbit 1.7.7 beta, 1.8, 1.10.

Tried test #5 from this webpage:
http://bleachbit.sourceforge.net/news/bleachbit-177-beta

"Clean Firefox, and verify there are no red errors."

Received the following red error, which I believe started showing up in Bleachbit 1.6 or possibly one version prior, but not in versions earlier than that. Could be that Mozilla started putting unique constraints on tables where they didn't exist before.

UNIQUE constraint failed: moz_places.url: /home/um/.mozilla/firefox/gqrobdy0.default.places.sqlite

[Andrew Ziem (ahziem1)]

Which version of Firefox do you have?

Is "Overwrite files" enabled in the BleachBit preferences?

I do not see that error on Ubuntu 14.10 and Firefox 38.

[gravy45 (gravy45)]

It is Firefox 38.0, installed from the repository. I did and do have "Overwrite files to hide contents" checked.

I want to say that I saw that error with Ubuntu MATE 14.04 and bleachbit 1.6. I don't think I saw it with bleachbit 1.2. But I'm not 100% sure.

[Andrew Ziem (ahziem1)]

Just for troubleshooting: does the error go away if you disable "Overwrite files to hide contents"? This does affect the way sqlite files are cleaned.

[gravy45 (gravy45)]

I've been trying to duplicate the error but had to reinstall the desktop. Now testing again with 1.8 in a VM and 1.6 on the desktop haven't been able to get the error. If there is a problem in bleachbit, it will reappear. If you give me a week or two I'll have it figured out one way or another.

[gravy45 (gravy45)]

Yes, the error goes away if I disable "Overwrite files to hide contents".

[Andrew Ziem (ahziem1)]

Are you still able to reproduce the error? If so, maybe you could privately email me a copy of your place.sqlite file? It seems specific to the file and the option "overwrite files"

[gravy45 (gravy45)]

PM sent. The issue seems to be with the URL field in moz_places, moz_favicons, and moz_hosts in place.sqlite. If the length of the URL in two or more rows is the same, then the call to overwrite with zeroes with zeroblob() fails due to a unique database constraint on the tables/URL field If I'm recalling the Python code correctly, this will prevent moz_places (and at least moz_hosts) from being cleaned out.

I just ran a test where all of my history was retained (even with overwrite option set in BB) in moz_places, moz_hosts, and to some extent in moz_favicons. Even when these constraint errors weren't occurring. I was assuming that the Firefox tables would be cleaned out. If that is the intent, I can open up another bug and probably come up with some quick test cases to prove the finding.

Workaround for me is to set Firefox to never remember history, and occasionally delete the entire profile (shred the folder in the trash with Bleachbit) and start over. But I'd prefer to not have to do that.

[gravy45 (gravy45)]

If I am right about the Firefox database retaining history entries in the tables even with Bleachbit, then I think this one should be marked as High priority and hopefully someone else confirms they can reproduce it. I do want to be proved wrong on this of course!

[Andrew Ziem (ahziem1)]

Fix committed in git commit c43077d for the next release. Thank you for reporting this bug.

[Andrew Ziem (ahziem1)]

To confirm the fix, please test the fix in BleachBit 1.11 beta
https://www.bleachbit.org/news/bleachbit-1110-beta

[gravy45 (gravy45)]

I tested BleachBit 1.11 beta (source code version) on Ubuntu 16.04 and am no longer seeing the Unique constraint/Red errors for Firefox. Great work. The history in places.sqlite is not being retained except in the table moz_places where last_visit_date is NULL. These rows are the one that populate immediately upon first opening of Firefox ( or after deleting ~/.mozilla/firefox/profile.default and ~/.mozilla/firefox/profiles.ini and reopening Firefox then pausing ). I don't think it matters.