No hint of timeout in Fetching remote repository

[Nobuto Murata]

I see continuous failures of importing from https://opendev.org/openstack/charm-ceph-mon.git to Launchpad.

https://code.launchpad.net/~openstack-charmers/charm-ceph-mon/+git/charm-ceph-mon

> [Failure] Import started on 2023-10-09 on juju-98ee42-prod-launchpad-codeimport-0 and finished on 2023-10-09 taking 1 hour — see the log
> [Failure] Import started on 2023-10-09 on juju-98ee42-prod-launchpad-codeimport-5 and finished on 2023-10-09 taking 1 hour — see the log
> [Failure] Import started on 2023-10-07 on juju-98ee42-prod-launchpad-codeimport-0 and finished on 2023-10-07 taking 1 hour — see the log
> [Failure] Import started on 2023-10-05 on juju-98ee42-prod-launchpad-codeimport-0 and finished on 2023-10-05 taking 1 hour — see the log
> [Failure] Import started on 2023-10-05 on juju-98ee42-prod-launchpad-codeimport-4 and finished on 2023-10-05 taking 1 hour — see the log
> [Failure] Import started on 2023-10-05 on juju-98ee42-prod-launchpad-codeimport-2 and finished on 2023-10-05 taking 1 hour — see the log

However, the log doesn't say much about what was going on before hitting the timeout. It would be nice if the job is run in an equivalent to `git clone --verbose` or `git fetch --verbose` to see more information where it's taking time and why.

2023-10-09 06:52:34 INFO Starting job.
2023-10-09 06:52:34 INFO Getting existing repository from hosting service.
2023-10-09 06:52:52 INFO remote: Counting objects: 100% (3189/3189)
2023-10-09 06:52:52 INFO remote: Counting objects: 100% (3189/3189), done.
2023-10-09 06:52:53 INFO remote: Compressing objects: 100% (3091/3091)
2023-10-09 06:52:53 INFO remote: Compressing objects: 100% (3091/3091), done.
2023-10-09 06:52:53 INFO Receiving objects: 99% (27243/27518), 21.46 MiB | 21.39 MiB/s
2023-10-09 06:52:53 INFO remote: Total 27518 (delta 2326), reused 122 (delta 96)
2023-10-09 06:52:53 INFO Receiving objects: 100% (27518/27518), 21.46 MiB | 21.39 MiB/s
2023-10-09 06:52:53 INFO Receiving objects: 100% (27518/27518), 21.51 MiB | 20.51 MiB/s, done.
2023-10-09 06:52:54 INFO Resolving deltas: 100% (16473/16473)
2023-10-09 06:52:54 INFO Resolving deltas: 100% (16473/16473), done.
2023-10-09 06:52:54 INFO Fetching remote repository.
Traceback (most recent call last):
  File "/srv/lp-codeimport/payloads/dfee8526b29e18a92919b26fe4a9b0587e7691ef-bionic/scripts/code-import-worker.py", line 112, in <module>
    sys.exit(script.main())
  File "/srv/lp-codeimport/payloads/dfee8526b29e18a92919b26fe4a9b0587e7691ef-bionic/scripts/code-import-worker.py", line 107, in main
    return import_worker.run()
  File "/srv/lp-codeimport/payloads/dfee8526b29e18a92919b26fe4a9b0587e7691ef-bionic/lib/lp/codehosting/codeimport/worker.py", line 581, in run
    return self._doImport()
  File "/srv/lp-codeimport/payloads/dfee8526b29e18a92919b26fe4a9b0587e7691ef-bionic/lib/lp/codehosting/codeimport/worker.py", line 1197, in _doImport
    cwd="repository")
  File "/srv/lp-codeimport/payloads/dfee8526b29e18a92919b26fe4a9b0587e7691ef-bionic/lib/lp/codehosting/codeimport/worker.py", line 1080, in _runGit
    for line in self._throttleProgress(git_process.stdout):
  File "/srv/lp-codeimport/payloads/dfee8526b29e18a92919b26fe4a9b0587e7691ef-bionic/lib/lp/codehosting/codeimport/worker.py", line 1037, in _throttleProgress
    buffered, timeout=timeout):
  File "/srv/lp-codeimport/payloads/dfee8526b29e18a92919b26fe4a9b0587e7691ef-bionic/lib/lp/codehosting/codeimport/worker.py", line 1056, in _throttleProgress
    line = next(wrapped_file)
KeyboardInterrupt
Import failed:
Traceback (most recent call last):
Failure: twisted.internet.error.TimeoutError: User timeout caused connection failure.

[Nobuto Murata (nobuto)]

I've learnt that the sync failure itself is handled in:
https://answers.launchpad.net/launchpad/+question/708106

[Colin Watson (cjwatson)]

Happy enough to land this patch, though I don't think it will particularly help given that the issue seems to be a deadlock in git.