Git Clone Over SSH Increases from 20secs to 8mins

[Mark]

It seem like since the introduction of the Ubuntu AWS Rolling Kernel https://ubuntu.com/blog/introducing-the-ubuntu-aws-rolling-kernel-2 git clone over SSH increased from roughly 20-30 seconds to 8+ mins. I don't think it's the kernel itself but rather a package that gets automatically updated by unattended-upgrades some time after boot. I have provided a log below including the packages that were to be upgraded after a successful clone by unattended-upgrades and prior to one that was taking minutes.

user@ip-10-x-x-x:~/test$ GIT_TRACE=1 git clone -v -- <email address hidden>:redacted/app.git .
06:13:45.287333 git.c:344 trace: built-in: git clone -v -- <email address hidden>:redacted/app.git .
Cloning into '.'...
...
Receiving objects: 100% (68113/68113), 126.39 MiB | 6.88 MiB/s, done.
Resolving deltas: 100% (33851/33851), done.
06:14:24.283201 run-command.c:646 trace: run_command: git rev-list --objects --stdin --not --all --quiet '--progress=Checking connectivity'
06:14:24.285584 git.c:344 trace: built-in: git rev-list --objects --stdin --not --all --quiet '--progress=Checking connectivity'

user@ip-10-x-x-x:~/test$ uname -r
5.3.0-1017-aws

user@ip-10-x-x-x:~/test$ apt list --upgradable
Listing... Done
bind9-host/bionic-updates,bionic-security 1:9.11.3+dfsg-1ubuntu1.12 amd64 [upgradable from: 1:9.11.3+dfsg-1ubuntu1.11]
dnsutils/bionic-updates,bionic-security 1:9.11.3+dfsg-1ubuntu1.12 amd64 [upgradable from: 1:9.11.3+dfsg-1ubuntu1.11]
kmod/bionic-updates 24-1ubuntu3.4 amd64 [upgradable from: 24-1ubuntu3.3]
libbind9-160/bionic-updates,bionic-security 1:9.11.3+dfsg-1ubuntu1.12 amd64 [upgradable from: 1:9.11.3+dfsg-1ubuntu1.11]
libdevmapper1.02.1/bionic-updates 2:1.02.145-4.1ubuntu3.18.04.3 amd64 [upgradable from: 2:1.02.145-4.1ubuntu3.18.04.2]
libdns1100/bionic-updates,bionic-security 1:9.11.3+dfsg-1ubuntu1.12 amd64 [upgradable from: 1:9.11.3+dfsg-1ubuntu1.11]
libirs160/bionic-updates,bionic-security 1:9.11.3+dfsg-1ubuntu1.12 amd64 [upgradable from: 1:9.11.3+dfsg-1ubuntu1.11]
libisc169/bionic-updates,bionic-security 1:9.11.3+dfsg-1ubuntu1.12 amd64 [upgradable from: 1:9.11.3+dfsg-1ubuntu1.11]
libisccc160/bionic-updates,bionic-security 1:9.11.3+dfsg-1ubuntu1.12 amd64 [upgradable from: 1:9.11.3+dfsg-1ubuntu1.11]
libisccfg160/bionic-updates,bionic-security 1:9.11.3+dfsg-1ubuntu1.12 amd64 [upgradable from: 1:9.11.3+dfsg-1ubuntu1.11]
libkmod2/bionic-updates 24-1ubuntu3.4 amd64 [upgradable from: 24-1ubuntu3.3]
liblvm2cmd2.02/bionic-updates 2.02.176-4.1ubuntu3.18.04.3 amd64 [upgradable from: 2.02.176-4.1ubuntu3.18.04.2]
liblwres160/bionic-updates,bionic-security 1:9.11.3+dfsg-1ubuntu1.12 amd64 [upgradable from: 1:9.11.3+dfsg-1ubuntu1.11]
linux-aws/bionic-updates,bionic-security 5.3.0.1019.20 amd64 [upgradable from: 5.3.0.1017.18]
linux-headers-aws/bionic-updates,bionic-security 5.3.0.1019.20 amd64 [upgradable from: 5.3.0.1017.18]
linux-image-aws/bionic-updates,bionic-security 5.3.0.1019.20 amd64 [upgradable from: 5.3.0.1017.18]
linux-libc-dev/bionic-updates,bionic-security 4.15.0-101.102 amd64 [upgradable from: 4.15.0-99.100]
lvm2/bionic-updates 2.02.176-4.1ubuntu3.18.04.3 amd64 [upgradable from: 2.02.176-4.1ubuntu3.18.04.2]
tzdata/bionic-updates,bionic-security 2020a-0ubuntu0.18.04 all [upgradable from: 2019c-0ubuntu0.18.04]

user@ip-10-x-x-x:~/test$ GIT_TRACE=1 time git clone -v -- <email address hidden>:redacted/app.git /tmp/app
07:03:41.644490 git.c:344 trace: built-in: git clone -v -- <email address hidden>:redacted/app.git /tmp/app
Cloning into '/tmp/app'...
...
remote: Total 68113 (delta 33850), reused 66160 (delta 32014)
Receiving objects: 100% (68113/68113), 126.39 MiB | 268.00 KiB/s, done.
Resolving deltas: 100% (33850/33850), done.
07:11:51.899637 run-command.c:646 trace: run_command: git rev-list --objects --stdin --not --all --quiet '--progress=Checking connectivity'
07:11:51.901531 git.c:344 trace: built-in: git rev-list --objects --stdin --not --all --quiet '--progress=Checking connectivity'

real 8m10.365s
user 0m5.643s
sys 0m1.985s
user@ip-10-x-x-x:~/test$

ProblemType: Bug
DistroRelease: Ubuntu 18.04
Package: linux-image-5.3.0-1017-aws 5.3.0-1017.18~18.04.1
ProcVersionSignature: Ubuntu 5.3.0-1017.18~18.04.1-aws 5.3.18
Uname: Linux 5.3.0-1017-aws x86_64
ApportVersion: 2.20.9-0ubuntu7.14
Architecture: amd64
Date: Thu May 21 06:56:10 2020
Ec2AMI: ami-0d1a47dc995459339
Ec2AMIManifest: (unknown)
Ec2AvailabilityZone: ap-southeast-2b
Ec2InstanceType: t3.small
Ec2Kernel: unavailable
Ec2Ramdisk: unavailable
ProcEnviron:
 TERM=xterm-256color
 PATH=(custom, no user)
 LANG=C.UTF-8
 SHELL=/bin/bash
SourcePackage: linux-aws-5.3
UpgradeStatus: No upgrade log present (probably fresh install)