All juju API calls hang on focal juju 2.9.42

[Aliaksandr Vasiuk]

Hello,

Steps to reproduce:
1. Configure lxd juju cloud
2. Bootstrap juju 2.9.42

$ juju bootstrap localhost localhost-bug --agent-version=2.9.42 --model-default default-series=focal --bootstrap-series=focal

3. Deploy juj-backup-all

$ juju deploy ch:bootstack-charmers-juju-backup-all --series=focal

4. Configure jujubackup user and provide configuration to the charm

$ juju add-user --controller localhost-bug jujubackup
$ juju change-user-password jujubackup
$ juju grant jujubackup superuser
$ juju grant jujubackup admin default
# Fill controllers.yaml and accounts.yaml with adequate data
$ cat accounts.yaml
controllers:
  localhost-bug:
    user: jujubackup
    password: kek
$ cat controllers.yaml
controllers:
    localhost-bug:
        uuid: 741da6f8-6dba-44ec-8186-f92212712ff3
        api-endpoints: ['10.57.136.143:17070']
        ca-cert: |
            -----BEGIN CERTIFICATE-----
            MIIEEjCCAnqgAwIBAgIUJk/ZMH7frD70bvk52LjKSVbh2uYwDQYJKoZIhvcNAQEL
            BQAwITENMAsGA1UEChMESnVqdTEQMA4GA1UEAxMHanVqdS1jYTAeFw0yMzA2MDIx
            MTU0MjVaFw0zMzA2MDIxMTU5MjVaMCExDTALBgNVBAoTBEp1anUxEDAOBgNVBAMT
            B2p1anUtY2EwggGiMA0GCSqGSIb3DQEBAQUAA4IBjwAwggGKAoIBgQDQWNH1+aPe
            LCCQkCgGZuAoHDdb3HGJhdksFeaXn/45bSkn2LAKvmzIeOgYTccy9cQCprjP0sXK
            udsjq8frMMsIMprOHgvFgya0HNdcHFWvE1Ryg3F9yVvkxz0KaRREfIET3LWGuT3X
            xDLBHOTEh6b0xfmL5ti5dD6RoqaAA/onJu48Sb3coYQl2yxnjITq/a2k/ZYO2fIV
            nfLLzQaUWXkpo3qOP9g/pyjDOZjYyUi1PqngZXxbniAa8V923btcp6hEAnrjuPiC
            dSc9uJbLS5FNpnWuuODDxvoUWtcNCIgFMHu1WW5U6VqiqL+gG/j2W6E/vDy/c6P1
            PlQQPQv8nb9rOUy452a63HPwghEl6X13iWl2quJJ4ZWipDSTlkHJ59NiUaUyju62
            MWJszaptXfJm+XVB48cEA8vO2CWV1CHNbIsqmTqftyLXBKVyT4CWZ91H714HMVO3
            zHWQ2NAgkjfliCeDVIp7kUxBuUXMJ0RATdsUDkDnbXc0FOgOjIzUICECAwEAAaNC
            MEAwDgYDVR0PAQH/BAQDAgKkMA8GA1UdEwEB/wQFMAMBAf8wHQYDVR0OBBYEFADz
            ZaOfoF7y1vp5HfryLQjXzH2PMA0GCSqGSIb3DQEBCwUAA4IBgQAKfzYA1fCvMpSK
            ZfOft+X7GwaTX7DCcH5u4alAhyRwm1y7jbP8Hsui3cnU5+jA0TXfM5OQ/rlDn20s
            Hzdmi0xZwTepSf6u4+mhV5vhnGbWUADc4KCaRDccuEz8mvo1n7/BZg0y2RxVEpX7
            Gra16KraPO07QzFP0HknNTep0N+dUxPdyxcZ5R+sXI+YqAxfyoFYaOX9VB2tGmlk
            LM9o2+oGNjDFVJ6Ni5un48NmkLxw3XcyomVtXYCeBkcy9uc5tbj63hVrAKabEB1d
            sU7e5KOrmmiitu5ZGBbyNbithQtKZDrlhhsxIPZtYt2HvuluAims+FDIZunXxd7p
            mukEEiYEKnjRucwJi2pDNjTmb59ywHSrq0XC0MlfOE0LiKQiLqUJHRy1Nh/TpKfp
            ujxmORHqj/BTOSgSvhb6NCX9BRv1HHTo98NHkw1pzTDs6n5tx+bBkvBU+5pwqtrR
            VNk+eNHOdWC8EeiQsiHPhU5mZ363NvR/IqG9PbGnrV17frU9e1Q=
            -----END CERTIFICATE-----
        cloud: localhost
        region: localhost
        type: lxd
        agent-version: 2.9.42
        controller-machine-count: 1
        active-controller-machine-count: 0
        machine-count: 1
current-controller: localhost-bug

$ juju config juju-backup-all <email address hidden> controller-names=localhost-bug <email address hidden>

5. Try to make a backup.
$ juju run-action --wait juju-backup-all/0 do-backup
# or also can trigger the cron job manually.

I did some debugging and figured out that the charm successfully receives creds to the cloud, and establishes a connection, but it hangs on any request to the juju controller, like "list models"

Best Regards,
Aliaksandr Vasiuk.