duplicity 0.7.14 occasionally looping when backup up to swift object store

[Doug]

Running duplicity 0.7.14 on Ubuntu 14.04 with Python 2.7.6. From time to time, duplicity goes into a loop. This behaviour also occurred on duplicity 0.7.13.

An strace on the task shows the following:
dev-sugar-combined00:~# ps aux |grep dup
root 15328 0.0 0.0 11760 2072 pts/1 S+ 14:05 0:00 grep dup
root 24704 0.0 0.0 4460 796 ? Ss Sep01 0:00 /bin/sh -c /usr/local/bin/duplicity_backup.sh chensi7_mysql_sgr_chensi7 >> /var/log/backup/chensi7_mysql_sgr_chensi7.log 2>&1
root 24708 0.0 0.0 12476 2892 ? S Sep01 0:00 /bin/bash /usr/local/bin/duplicity_backup.sh chensi7_mysql_sgr_chensi7
root 24836 0.3 0.3 223624 30632 ? S Sep01 28:02 /usr/bin/python /usr/bin/duplicity --verbosity Notice --full-if-older-than 7D --num-retries 3 --asynchronous-upload --no-encryption --volsize 512 /var/opt/backups/sgr_chensi7 swift://dev-sugar-combined00.cloudtech.co.nz-chensi7_mysql_sgr_chensi7
dev-sugar-combined00:~# strace -p 24836
Process 24836 attached
select(0, NULL, NULL, NULL, {0, 23735}) = 0 (Timeout)
select(0, NULL, NULL, NULL, {0, 36067}) = 0 (Timeout)
select(0, NULL, NULL, NULL, {0, 1000}) = 0 (Timeout)
select(0, NULL, NULL, NULL, {0, 2000}) = 0 (Timeout)
select(0, NULL, NULL, NULL, {0, 4000}) = 0 (Timeout)
select(0, NULL, NULL, NULL, {0, 8000}) = 0 (Timeout)
select(0, NULL, NULL, NULL, {0, 16000}) = 0 (Timeout)
select(0, NULL, NULL, NULL, {0, 32000}) = 0 (Timeout)
select(0, NULL, NULL, NULL, {0, 35575}) = 0 (Timeout)
select(0, NULL, NULL, NULL, {0, 1000}) = 0 (Timeout)
select(0, NULL, NULL, NULL, {0, 2000}) = 0 (Timeout)
select(0, NULL, NULL, NULL, {0, 4000}) = 0 (Timeout)
select(0, NULL, NULL, NULL, {0, 8000}) = 0 (Timeout)
select(0, NULL, NULL, NULL, {0, 16000}) = 0 (Timeout)
select(0, NULL, NULL, NULL, {0, 32000}) = 0 (Timeout)
select(0, NULL, NULL, NULL, {0, 35583}) = 0 (Timeout)
select(0, NULL, NULL, NULL, {0, 1000}) = 0 (Timeout)
select(0, NULL, NULL, NULL, {0, 2000}) = 0 (Timeout)

[Doug (caniwi)]

Let me know what else I can provide. I am going to be increasing duplicity verbosity to info level and might get the occasion to increase to debug as well.

[Doug (caniwi)]

I can provide the following information today... coredump, some basic gdb output, the duplicity logfile at info verbosity and the crash dump.

[Kenneth Loafman (kenneth-loafman)]

Try this without --asynchronous-upload. If that does not work, I'll need
the -v9 logging done. Thanks!

On Wed, Sep 6, 2017 at 9:01 PM, Doug <email address hidden> wrote:

> ** Attachment added: "duplicity-strace-gbd-output"
> https://bugs.launchpad.net/duplicity/+bug/1715280/+
> attachment/4945631/+files/duplicity-strace-gdb.txt
>
> --
> You received this bug notification because you are subscribed to
> Duplicity.
> https://bugs.launchpad.net/bugs/1715280
>
> Title:
> duplicity 0.7.14 occasionally looping when backup up to swift object
> store
>
> Status in Duplicity:
> New
>
> Bug description:
> Running duplicity 0.7.14 on Ubuntu 14.04 with Python 2.7.6. From time
> to time, duplicity goes into a loop. This behaviour also occurred on
> duplicity 0.7.13.
>
> An strace on the task shows the following:
> dev-sugar-combined00:~# ps aux |grep dup
> root 15328 0.0 0.0 11760 2072 pts/1 S+ 14:05 0:00 grep dup
> root 24704 0.0 0.0 4460 796 ? Ss Sep01 0:00 /bin/sh
> -c /usr/local/bin/duplicity_backup.sh chensi7_mysql_sgr_chensi7 >>
> /var/log/backup/chensi7_mysql_sgr_chensi7.log 2>&1
> root 24708 0.0 0.0 12476 2892 ? S Sep01 0:00
> /bin/bash /usr/local/bin/duplicity_backup.sh chensi7_mysql_sgr_chensi7
> root 24836 0.3 0.3 223624 30632 ? S Sep01 28:02
> /usr/bin/python /usr/bin/duplicity --verbosity Notice --full-if-older-than
> 7D --num-retries 3 --asynchronous-upload --no-encryption --volsize 512
> /var/opt/backups/sgr_chensi7 swift://dev-sugar-combined00.
> cloudtech.co.nz-chensi7_mysql_sgr_chensi7
> dev-sugar-combined00:~# strace -p 24836
> Process 24836 attached
> select(0, NULL, NULL, NULL, {0, 23735}) = 0 (Timeout)
> select(0, NULL, NULL, NULL, {0, 36067}) = 0 (Timeout)
> select(0, NULL, NULL, NULL, {0, 1000}) = 0 (Timeout)
> select(0, NULL, NULL, NULL, {0, 2000}) = 0 (Timeout)
> select(0, NULL, NULL, NULL, {0, 4000}) = 0 (Timeout)
> select(0, NULL, NULL, NULL, {0, 8000}) = 0 (Timeout)
> select(0, NULL, NULL, NULL, {0, 16000}) = 0 (Timeout)
> select(0, NULL, NULL, NULL, {0, 32000}) = 0 (Timeout)
> select(0, NULL, NULL, NULL, {0, 35575}) = 0 (Timeout)
> select(0, NULL, NULL, NULL, {0, 1000}) = 0 (Timeout)
> select(0, NULL, NULL, NULL, {0, 2000}) = 0 (Timeout)
> select(0, NULL, NULL, NULL, {0, 4000}) = 0 (Timeout)
> select(0, NULL, NULL, NULL, {0, 8000}) = 0 (Timeout)
> select(0, NULL, NULL, NULL, {0, 16000}) = 0 (Timeout)
> select(0, NULL, NULL, NULL, {0, 32000}) = 0 (Timeout)
> select(0, NULL, NULL, NULL, {0, 35583}) = 0 (Timeout)
> select(0, NULL, NULL, NULL, {0, 1000}) = 0 (Timeout)
> select(0, NULL, NULL, NULL, {0, 2000}) = 0 (Timeout)
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/duplicity/+bug/1715280/+subscriptions
>

[Doug (caniwi)]

Hi,
  I have taken out the --asynchronous-upload from the backups. Will let you know how it goes.