model upgrade tries to upgrade the lxd profile of kvms

[Andrea Ieri]

After an upgrade from 2.5.4 to 2.6.2, all my kvms are in error with a status such as:

cannot upgrade machine's lxd profile: 8/kvm/0: not found

The following can be seen in the logsink.log on the controller:

10501904-e3f6-4dca-82f3-8ac096073f4e: machine-8 2019-05-16 13:31:18 ERROR juju.worker.instancemutater mutater.go:181 cannot upgrade machine-8/kvm/0 lxd profiles: 8/kvm/0: not found
10501904-e3f6-4dca-82f3-8ac096073f4e: machine-8 2019-05-16 13:31:18 ERROR juju.worker.instancemutater mutater.go:181 cannot upgrade machine-8/kvm/1 lxd profiles: 8/kvm/1: not found
10501904-e3f6-4dca-82f3-8ac096073f4e: machine-8 2019-05-16 13:31:19 ERROR juju.worker.dependency engine.go:636 "instance-mutater" manifold worker returned unexpected error: 8/kvm/0: not found

[Heather Lanigan (hmlanigan)]

https://github.com/juju/juju/pull/10199

[Heather Lanigan (hmlanigan)]

The fix in #1 makes sure the problem won't occur again. Or will never occur if upgrading from 2.5.x to 2.6.3+.

To be done: resolve any kvm machines with a modification status of "cannot upgrade machine's lxd profile: #/kvm/#: not found"

[Heather Lanigan (hmlanigan)]

pr for upgrade step https://github.com/juju/juju/pull/10210

[Ryan Farrell (whereisrysmind)]

Hello,
This appears to be affecting me: Im using juju 2.7.6-focal-amd64, my models is version 2.7.5:

Although its a localhost/lxd model, I have manually provisioned in kvms with juju add-machine ssh:ubuntu@$kvm-ip

Machine State DNS Inst id Series AZ Message
4 error 10.132.251.90 manual:10.132.251.90 xenial cannot upgrade machine's lxd profile: 4: not found
5 error 10.132.251.43 manual:10.132.251.43 xenial cannot upgrade machine's lxd profile: 5: not found
6 error 10.132.251.37 manual:10.132.251.37 xenial cannot upgrade machine's lxd profile: 6: not found
7 error 10.132.251.168 manual:10.132.251.168 xenial cannot upgrade machine's lxd profile: 7: not found
9 error 10.132.251.7 manual:10.132.251.7 xenial cannot upgrade machine's lxd profile: 9: not found

./logsink.log:7cb1af52-6490-410d-8b43-5a88abe6a213: machine-0 2020-06-11 13:32:57 ERROR juju.worker.dependency engine.go:671 "instance-mutater" manifold worker returned unexpected error: 6: not found
./logsink.log:7cb1af52-6490-410d-8b43-5a88abe6a213: machine-0 2020-06-11 13:35:04 ERROR juju.worker.dependency engine.go:671 "instance-mutater" manifold worker returned unexpected error: 7: not found
./logsink.log:7cb1af52-6490-410d-8b43-5a88abe6a213: machine-0 2020-06-11 13:36:58 ERROR juju.worker.dependency engine.go:671 "instance-mutater" manifold worker returned unexpected error: 5: not found
./logsink.log:7cb1af52-6490-410d-8b43-5a88abe6a213: machine-0 2020-06-11 13:38:59 ERROR juju.worker.dependency engine.go:671 "instance-mutater" manifold worker returned unexpected error: 9: not found
./logsink.log:7cb1af52-6490-410d-8b43-5a88abe6a213: machine-0 2020-06-11 13:41:07 ERROR juju.worker.dependency engine.go:671 "instance-mutater" manifold worker returned unexpected error: 4: not found

[Heather Lanigan (hmlanigan)]

@whereisrysmind, thank you for reporting this. It's a new issue so I've opened a bug here: https://bugs.launchpad.net/juju/+bug/1883178 to track.