Backup fails on new backup

Bug #532197 reported by Mark Preston
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Déjà Dup
Invalid
Undecided
Unassigned

Bug Description

Output of /tmp/deja-dup.log

DUPLICITY: DEBUG 1
DUPLICITY: . Comparing ('home', 'mark', '.config', 'google-chrome', 'Default', 'Local Storage', 'http_www.pcworld.com_0.localstorage') and None

DUPLICITY: DEBUG 1
DUPLICITY: . Getting delta of (('home', 'mark', '.config', 'google-chrome', 'Default', 'Local Storage', 'http_www.pcworld.com_0.localstorage') /home/mark/.config/google-chrome/Default/Local Storage/http_www.pcworld.com_0.localstorage reg) and None

DUPLICITY: INFO 4 'home/mark/.config/google-chrome/Default/Local Storage/http_www.pcworld.com_0.localstorage'
DUPLICITY: . A home/mark/.config/google-chrome/Default/Local Storage/http_www.pcworld.com_0.localstorage

DUPLICITY: DEBUG 1
DUPLICITY: . Selecting /home/mark/.config/google-chrome/Default/Local Storage/https_www.meebo.com_0.localstorage

DUPLICITY: DEBUG 1
DUPLICITY: . Comparing ('home', 'mark', '.config', 'google-chrome', 'Default', 'Local Storage', 'https_www.meebo.com_0.localstorage') and None

DUPLICITY: DEBUG 1
DUPLICITY: . Getting delta of (('home', 'mark', '.config', 'google-chrome', 'Default', 'Local Storage', 'https_www.meebo.com_0.localstorage') /home/mark/.config/google-chrome/Default/Local Storage/https_www.meebo.com_0.localstorage reg) and None

DUPLICITY: INFO 4 'home/mark/.config/google-chrome/Default/Local Storage/https_www.meebo.com_0.localstorage'
DUPLICITY: . A home/mark/.config/google-chrome/Default/Local Storage/https_www.meebo.com_0.localstorage

DUPLICITY: DEBUG 1
DUPLICITY: . Selecting /home/mark/.config/google-chrome/Default/Preferences

DUPLICITY: DEBUG 1
DUPLICITY: . Comparing ('home', 'mark', '.config', 'google-chrome', 'Default', 'Preferences') and None

DUPLICITY: DEBUG 1
DUPLICITY: . Getting delta of (('home', 'mark', '.config', 'google-chrome', 'Default', 'Preferences') /home/mark/.config/google-chrome/Default/Preferences reg) and None

DUPLICITY: INFO 4 'home/mark/.config/google-chrome/Default/Preferences'
DUPLICITY: . A home/mark/.config/google-chrome/Default/Preferences

DUPLICITY: DEBUG 1
DUPLICITY: . Selecting /home/mark/.config/google-chrome/Default/Sync Data

DUPLICITY: DEBUG 1
DUPLICITY: . Comparing ('home', 'mark', '.config', 'google-chrome', 'Default', 'Sync Data') and None

DUPLICITY: DEBUG 1
DUPLICITY: . Getting delta of (('home', 'mark', '.config', 'google-chrome', 'Default', 'Sync Data') /home/mark/.config/google-chrome/Default/Sync Data dir) and None

DUPLICITY: INFO 4 'home/mark/.config/google-chrome/Default/Sync Data'
DUPLICITY: . A home/mark/.config/google-chrome/Default/Sync Data

DUPLICITY: DEBUG 1
DUPLICITY: . Selecting /home/mark/.config/google-chrome/Default/Sync Data/BookmarkSyncSettings.sqlite3

DUPLICITY: DEBUG 1
DUPLICITY: . Comparing ('home', 'mark', '.config', 'google-chrome', 'Default', 'Sync Data', 'BookmarkSyncSettings.sqlite3') and None

DUPLICITY: DEBUG 1
DUPLICITY: . Getting delta of (('home', 'mark', '.config', 'google-chrome', 'Default', 'Sync Data', 'BookmarkSyncSettings.sqlite3') /home/mark/.config/google-chrome/Default/Sync Data/BookmarkSyncSettings.sqlite3 reg) and None

DUPLICITY: INFO 4 'home/mark/.config/google-chrome/Default/Sync Data/BookmarkSyncSettings.sqlite3'
DUPLICITY: . A home/mark/.config/google-chrome/Default/Sync Data/BookmarkSyncSettings.sqlite3

DUPLICITY: DEBUG 1
DUPLICITY: . Selecting /home/mark/.config/google-chrome/Default/Sync Data/SyncData.sqlite3

DUPLICITY: DEBUG 1
DUPLICITY: . Comparing ('home', 'mark', '.config', 'google-chrome', 'Default', 'Sync Data', 'SyncData.sqlite3') and None

DUPLICITY: DEBUG 1
DUPLICITY: . Getting delta of (('home', 'mark', '.config', 'google-chrome', 'Default', 'Sync Data', 'SyncData.sqlite3') /home/mark/.config/google-chrome/Default/Sync Data/SyncData.sqlite3 reg) and None

DUPLICITY: INFO 4 'home/mark/.config/google-chrome/Default/Sync Data/SyncData.sqlite3'
DUPLICITY: . A home/mark/.config/google-chrome/Default/Sync Data/SyncData.sqlite3

DUPLICITY: DEBUG 1
DUPLICITY: . Selecting /home/mark/.config/google-chrome/Default/Thumbnails

DUPLICITY: DEBUG 1
DUPLICITY: . Comparing ('home', 'mark', '.config', 'google-chrome', 'Default', 'Thumbnails') and None

DUPLICITY: DEBUG 1
DUPLICITY: . Getting delta of (('home', 'mark', '.config', 'google-chrome', 'Default', 'Thumbnails') /home/mark/.config/google-chrome/Default/Thumbnails reg) and None

DUPLICITY: INFO 4 'home/mark/.config/google-chrome/Default/Thumbnails'
DUPLICITY: . A home/mark/.config/google-chrome/Default/Thumbnails

DUPLICITY: DEBUG 1
DUPLICITY: . Removing still remembered temporary file /home/mark/.cache/deja-dup/71a2b8c4563b8824964c9429f741610f/duplicity-MxA7Pi-tempdir/mktemp-JxwIkf-1

DUPLICITY: INFO 1
DUPLICITY: . Cleanup of temporary file /home/mark/.cache/deja-dup/71a2b8c4563b8824964c9429f741610f/duplicity-MxA7Pi-tempdir/mktemp-JxwIkf-1 failed

DUPLICITY: DEBUG 1
DUPLICITY: . Removing still remembered temporary file /home/mark/.cache/deja-dup/71a2b8c4563b8824964c9429f741610f/duplicity-x72GUq-tempdir/mktemp-WfpyjQ-1

DUPLICITY: INFO 1
DUPLICITY: . Cleanup of temporary file /home/mark/.cache/deja-dup/71a2b8c4563b8824964c9429f741610f/duplicity-x72GUq-tempdir/mktemp-WfpyjQ-1 failed

DUPLICITY: INFO 11
DUPLICITY: . AsyncScheduler: running task synchronously (asynchronicity disabled)

DUPLICITY: INFO 1
DUPLICITY: . Writing /media/21b533ed-dce5-4e7b-88a0-ce19450c83c9/duplicity-full.20100304T205316Z.vol1.difftar.gz

DUPLICITY: WARNING 1
DUPLICITY: . Write of '/media/21b533ed-dce5-4e7b-88a0-ce19450c83c9/duplicity-full.20100304T205316Z.vol1.difftar.gz' failed (attempt 1): Error: Error opening file '/media/21b533ed-dce5-4e7b-88a0-ce19450c83c9/duplicity-full.20100304T205316Z.vol1.difftar.gz': Permission denied

DUPLICITY: DEBUG 1
DUPLICITY: . Backtrace of previous error: Traceback (innermost last):
DUPLICITY: . File "/usr/lib/python2.6/dist-packages/duplicity/backends/giobackend.py", line 99, in copy_file
DUPLICITY: . gio.FILE_COPY_OVERWRITE | gio.FILE_COPY_NOFOLLOW_SYMLINKS)
DUPLICITY: . Error: Error opening file '/media/21b533ed-dce5-4e7b-88a0-ce19450c83c9/duplicity-full.20100304T205316Z.vol1.difftar.gz': Permission denied
DUPLICITY: .

DUPLICITY: INFO 1
DUPLICITY: . Writing /media/21b533ed-dce5-4e7b-88a0-ce19450c83c9/duplicity-full.20100304T205316Z.vol1.difftar.gz

DUPLICITY: WARNING 1
DUPLICITY: . Write of '/media/21b533ed-dce5-4e7b-88a0-ce19450c83c9/duplicity-full.20100304T205316Z.vol1.difftar.gz' failed (attempt 2): Error: Error opening file '/media/21b533ed-dce5-4e7b-88a0-ce19450c83c9/duplicity-full.20100304T205316Z.vol1.difftar.gz': Permission denied

DUPLICITY: DEBUG 1
DUPLICITY: . Backtrace of previous error: Traceback (innermost last):
DUPLICITY: . File "/usr/lib/python2.6/dist-packages/duplicity/backends/giobackend.py", line 99, in copy_file
DUPLICITY: . gio.FILE_COPY_OVERWRITE | gio.FILE_COPY_NOFOLLOW_SYMLINKS)
DUPLICITY: . Error: Error opening file '/media/21b533ed-dce5-4e7b-88a0-ce19450c83c9/duplicity-full.20100304T205316Z.vol1.difftar.gz': Permission denied
DUPLICITY: .

DUPLICITY: INFO 1
DUPLICITY: . Writing /media/21b533ed-dce5-4e7b-88a0-ce19450c83c9/duplicity-full.20100304T205316Z.vol1.difftar.gz

DUPLICITY: WARNING 1
DUPLICITY: . Write of '/media/21b533ed-dce5-4e7b-88a0-ce19450c83c9/duplicity-full.20100304T205316Z.vol1.difftar.gz' failed (attempt 3): Error: Error opening file '/media/21b533ed-dce5-4e7b-88a0-ce19450c83c9/duplicity-full.20100304T205316Z.vol1.difftar.gz': Permission denied

DUPLICITY: DEBUG 1
DUPLICITY: . Backtrace of previous error: Traceback (innermost last):
DUPLICITY: . File "/usr/lib/python2.6/dist-packages/duplicity/backends/giobackend.py", line 99, in copy_file
DUPLICITY: . gio.FILE_COPY_OVERWRITE | gio.FILE_COPY_NOFOLLOW_SYMLINKS)
DUPLICITY: . Error: Error opening file '/media/21b533ed-dce5-4e7b-88a0-ce19450c83c9/duplicity-full.20100304T205316Z.vol1.difftar.gz': Permission denied
DUPLICITY: .

DUPLICITY: INFO 1
DUPLICITY: . Writing /media/21b533ed-dce5-4e7b-88a0-ce19450c83c9/duplicity-full.20100304T205316Z.vol1.difftar.gz

DUPLICITY: WARNING 1
DUPLICITY: . Write of '/media/21b533ed-dce5-4e7b-88a0-ce19450c83c9/duplicity-full.20100304T205316Z.vol1.difftar.gz' failed (attempt 4): Error: Error opening file '/media/21b533ed-dce5-4e7b-88a0-ce19450c83c9/duplicity-full.20100304T205316Z.vol1.difftar.gz': Permission denied

DUPLICITY: DEBUG 1
DUPLICITY: . Backtrace of previous error: Traceback (innermost last):
DUPLICITY: . File "/usr/lib/python2.6/dist-packages/duplicity/backends/giobackend.py", line 99, in copy_file
DUPLICITY: . gio.FILE_COPY_OVERWRITE | gio.FILE_COPY_NOFOLLOW_SYMLINKS)
DUPLICITY: . Error: Error opening file '/media/21b533ed-dce5-4e7b-88a0-ce19450c83c9/duplicity-full.20100304T205316Z.vol1.difftar.gz': Permission denied
DUPLICITY: .

DUPLICITY: INFO 1
DUPLICITY: . Writing /media/21b533ed-dce5-4e7b-88a0-ce19450c83c9/duplicity-full.20100304T205316Z.vol1.difftar.gz

DUPLICITY: WARNING 1
DUPLICITY: . Write of '/media/21b533ed-dce5-4e7b-88a0-ce19450c83c9/duplicity-full.20100304T205316Z.vol1.difftar.gz' failed (attempt 5): Error: Error opening file '/media/21b533ed-dce5-4e7b-88a0-ce19450c83c9/duplicity-full.20100304T205316Z.vol1.difftar.gz': Permission denied

DUPLICITY: DEBUG 1
DUPLICITY: . Backtrace of previous error: Traceback (innermost last):
DUPLICITY: . File "/usr/lib/python2.6/dist-packages/duplicity/backends/giobackend.py", line 99, in copy_file
DUPLICITY: . gio.FILE_COPY_OVERWRITE | gio.FILE_COPY_NOFOLLOW_SYMLINKS)
DUPLICITY: . Error: Error opening file '/media/21b533ed-dce5-4e7b-88a0-ce19450c83c9/duplicity-full.20100304T205316Z.vol1.difftar.gz': Permission denied
DUPLICITY: .

DUPLICITY: DEBUG 1
DUPLICITY: . Removing still remembered temporary file /tmp/duplicity-uIzbnq-tempdir/mktemp-LZ30Mj-2

DUPLICITY: DEBUG 1
DUPLICITY: . Removing still remembered temporary file /tmp/duplicity-uIzbnq-tempdir/mkstemp-LlqNIm-1

DUPLICITY: INFO 1
DUPLICITY: . Backend error detail: Traceback (most recent call last):
DUPLICITY: . File "/usr/bin/duplicity", line 1236, in <module>
DUPLICITY: . with_tempdir(main)
DUPLICITY: . File "/usr/bin/duplicity", line 1229, in with_tempdir
DUPLICITY: . fn()
DUPLICITY: . File "/usr/bin/duplicity", line 1207, in main
DUPLICITY: . full_backup(col_stats)
DUPLICITY: . File "/usr/bin/duplicity", line 416, in full_backup
DUPLICITY: . globals.backend)
DUPLICITY: . File "/usr/bin/duplicity", line 315, in write_multivol
DUPLICITY: . (tdp, dest_filename)))
DUPLICITY: . File "/usr/lib/python2.6/dist-packages/duplicity/asyncscheduler.py", line 148, in schedule_task
DUPLICITY: . return self.__run_synchronously(fn, params)
DUPLICITY: . File "/usr/lib/python2.6/dist-packages/duplicity/asyncscheduler.py", line 175, in __run_synchronously
DUPLICITY: . ret = fn(*params)
DUPLICITY: . File "/usr/bin/duplicity", line 314, in <lambda>
DUPLICITY: . async_waiters.append(io_scheduler.schedule_task(lambda tdp, dest_filename: put(tdp, dest_filename),
DUPLICITY: . File "/usr/bin/duplicity", line 240, in put
DUPLICITY: . backend.put(tdp, dest_filename)
DUPLICITY: . File "/usr/lib/python2.6/dist-packages/duplicity/backends/giobackend.py", line 115, in put
DUPLICITY: . self.copy_file(source_file, target_file)
DUPLICITY: . File "/usr/lib/python2.6/dist-packages/duplicity/backends/giobackend.py", line 107, in copy_file
DUPLICITY: . target.get_parse_name()))
DUPLICITY: . BackendException: Could not copy /tmp/duplicity-uIzbnq-tempdir/mktemp-LZ30Mj-2 to /media/21b533ed-dce5-4e7b-88a0-ce19450c83c9/duplicity-full.20100304T205316Z.vol1.difftar.gz
DUPLICITY: .

DUPLICITY: ERROR 23 BackendException
DUPLICITY: . BackendException: Could not copy /tmp/duplicity-uIzbnq-tempdir/mktemp-LZ30Mj-2 to /media/21b533ed-dce5-4e7b-88a0-ce19450c83c9/duplicity-full.20100304T205316Z.vol1.difftar.gz

** (deja-dup:20296): DEBUG: DuplicityInstance.vala:449: duplicity (20490) exited with value 23

===========================
Output of:

mark@Lexington-19-Karmic:/tmp$ sudo gedit deja-dup.gconf

<gconfentryfile>
  <entrylist base="/apps/deja-dup">
    <entry>
      <key>backend</key>
      <schema_key>/schemas/apps/deja-dup/backend</schema_key>
      <value>
        <string>file</string>
      </value>
    </entry>
    <entry>
      <key>delete-after</key>
      <schema_key>/schemas/apps/deja-dup/delete-after</schema_key>
      <value>
        <int>28</int>
      </value>
    </entry>
    <entry>
      <key>encrypt</key>
      <schema_key>/schemas/apps/deja-dup/encrypt</schema_key>
      <value>
        <bool>false</bool>
      </value>
    </entry>
    <entry>
      <key>exclude-list</key>
      <schema_key>/schemas/apps/deja-dup/exclude-list</schema_key>
      <value>
        <list type="string">
        </list>
      </value>
    </entry>
    <entry>
      <key>include-list</key>
      <schema_key>/schemas/apps/deja-dup/include-list</schema_key>
      <value>
        <list type="string">
            <value>
              <string>$HOME</string>
            </value>
        </list>
      </value>
    </entry>
    <entry>
      <key>last-run</key>
      <schema_key>/schemas/apps/deja-dup/last-run</schema_key>
      <value>
        <string>2010-02-22T03:52:32.442314Z</string>
      </value>
    </entry>
    <entry>
      <key>periodic</key>
      <schema_key>/schemas/apps/deja-dup/periodic</schema_key>
      <value>
        <bool>true</bool>
      </value>
    </entry>
    <entry>
      <key>periodic-period</key>
      <schema_key>/schemas/apps/deja-dup/periodic-period</schema_key>
      <value>
        <int>7</int>
      </value>
    </entry>
    <entry>
      <key>file/path</key>
      <schema_key>/schemas/apps/deja-dup/file/path</schema_key>
      <value>
        <string>/media/21b533ed-dce5-4e7b-88a0-ce19450c83c9</string>
      </value>
    </entry>
    <entry>
      <key>s3/bucket</key>
      <schema_key>/schemas/apps/deja-dup/s3/bucket</schema_key>
    </entry>
    <entry>
      <key>s3/folder</key>
      <schema_key>/schemas/apps/deja-dup/s3/folder</schema_key>
      <value>
        <string>/</string>
      </value>
    </entry>
    <entry>
      <key>s3/id</key>
      <schema_key>/schemas/apps/deja-dup/s3/id</schema_key>
    </entry>
  </entrylist>
</gconfentryfile>

==============

mark@Lexington-19-Karmic:~$ dpkg-query -W deja-dup duplicity

deja-dup 11.1-0ubuntu0karmic1
duplicity 0.6.06-0ubuntu0karmic1

mark@Lexington-19-Karmic:~$ lsb_release -d

Description: Ubuntu 9.10

Revision history for this message
Mark Preston (emarkpreston) wrote :

I have a new backup hard disk drive. It is formatted ext3. The Karmic I have is ext4. I hope this helps, thank you.

Revision history for this message
Michael Terry (mterry) wrote :

Can you, as your normal user, create files on the external drive in nautilus? It looks at first glance like a permissions problem (though the error could be nicer if so).

Changed in deja-dup:
status: New → Incomplete
Revision history for this message
Mark Preston (emarkpreston) wrote : RE: [Bug 532197] Re: Backup fails on new backup

I looked at permission and found the partiton for Karmic to be root:root, as you suggested.
I have changed the permissions to:
mark@Lexington-19-Karmic:/media$ ls -l
drwxr--r-x 3 mark mark 4096 2010-03-03 09:22 21b533ed-dce5-4e7b-88a0-ce19450c83c
the string starting 21b533 is the (partition name?) of the drive. Coming back to DD, it ran and failed as:
Backup FailedFatal Error: The file specification ~ddtmpcannot match any files in the base directory /Useful file specifications begin with the base directory or somepattern (such as '**') which matches the base directory.
Also, attached are screenshots from just before posting the 'bug report', this morning.
I hope this is helpful.
Thanks for such a swift response, as always, Michael.

> Date: Thu, 4 Mar 2010 22:56:38 +0000
> From: <email address hidden>
> To: <email address hidden>
> Subject: [Bug 532197] Re: Backup fails on new backup
>
> Can you, as your normal user, create files on the external drive in
> nautilus? It looks at first glance like a permissions problem (though
> the error could be nicer if so).
>
> ** Changed in: deja-dup
> Status: New => Incomplete
>
> --
> Backup fails on new backup
> https://bugs.launchpad.net/bugs/532197
> You received this bug notification because you are a direct subscriber
> of the bug.

_________________________________________________________________
Hotmail: Trusted email with powerful SPAM protection.
http://clk.atdmt.com/GBL/go/201469227/direct/01/

Revision history for this message
Mark Preston (emarkpreston) wrote :

On boot (power up) March 5, 2010, before I could input my password, Deja put on screen (Gnome Desktop) an error box that reads:

Traceback (most recent call last):
  File "/usr/bin/duplicity", line 1236, in <module>
    with_tempdir(main)
  File "/usr/bin/duplicity", line 1229, in with_tempdir
    fn()
  File "/usr/bin/duplicity", line 1130, in main
    sync_archive()
  File "/usr/bin/duplicity", line 910, in sync_archive
    remlist = globals.backend.list()
  File "/usr/lib/python2.6/dist-packages/duplicity/backends/giobackend.py", line 127, in list
    gio.FILE_QUERY_INFO_NOFOLLOW_SYMLINKS)
Error: No such file or directory

Revision history for this message
Michael Terry (mterry) wrote :

The error:
"Backup FailedFatal Error: The file specification ~ddtmpcannot match any files in the base directory /Useful file specifications begin with the base directory or somepattern (such as '**') which matches the base directory."

Looks like you mistyped your temporary directory as "~ddtmp" instead of "~/ddtmp". Latest versions (13.x) of Deja Dup and Duplicity >= 0.6.07 will hopefully obsolete the need to specify a custom temporary directory (it doesn't take nearly as much temporary space anymore).

The second error:
" File "/usr/lib/python2.6/dist-packages/duplicity/backends/giobackend.py", line 127, in list
    gio.FILE_QUERY_INFO_NOFOLLOW_SYMLINKS)
Error: No such file or directory"

Looks like you are backing up to an external drive that isn't mounted or plugged in? This is also fixed in latest versions of Deja Dup (13.x). If it's plugged in, it will mount it for you. If it's not plugged in, it will warn you and wait for it to be plugged in.

Stable 14.0 should be released end of the month.

If these comments answer your issues, I'll mark this fixed released.

Revision history for this message
Mark Preston (emarkpreston) wrote :

As I have said, I'm no programmer. As such, despite these error messages, Deja had done it's backup, despite throwing these warnings. Go Figure!! I can't grok it, but cannot complain, either. So maybe I did do /ddtmp. As for the usb not being plugged-in and powered up, that's not true. Both partitions show up on my desktop.
I know Deja made a backup set because I looked at the 200 gig partition on my (brand new) external usb 2.0 drive. It's actually my old main drive (320 gig), converted to use in the usb cradle.
Sunday p.m., is my scheduled backup day for Deja. I will be sure to do /ddtmp and not ddtmp. If all goes well, you will not have more to do. I'm keeping my fingers crosses.
Please close this bug report.
Again, thank you for such swift help.
Mark Preston

_________________________________________________________________
Hotmail: Powerful Free email with security by Microsoft.
http://clk.atdmt.com/GBL/go/201469230/direct/01/

Revision history for this message
cyd (cyd) wrote :

Hi,

Deja-dup on Ubuntu 10.04 fail to backup over ssh,

i can read write on the remote drive via nautilus;

error message is the following :

BackendException: Could not copy /tmp/duplicity-NmnSB3-tempdir/mktemp-UayIs5-2 to sftp://xxxx@xxxxxxxx/duplicity-full.20100425T092212Z.vol1.difftar.gz

problem is the same without encryption

any idea ?

Revision history for this message
Michael Terry (mterry) wrote :

cyd, please file a new bug report with a log and gconf values (as prompted in the file-a-bug page). Mark's issues seem resolved, so I'm marking this bug closed.

Changed in deja-dup:
status: Incomplete → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.