Comment 3 for bug 1938299

Ok, so on working images (v20200719 or earlier), google-guest-agent.service is running. On 20210720 or later that service is not included in the systemd boot targets for some reason.

I've checked for system ordering dependency issues which would have disabled the g-g-a.service on the "broken" images and there is nothing at fault there for some reaason it's enabled by not participating in the overall boot target. More triage needed here.

# working images have GGA.service enabled and running
ubuntu@working-image:~$ cat /etc/cloud/build.info
build_name: server
serial: 20210719
ubuntu@working-image:~$ sudo systemctl status google-guest-agent.service
● google-guest-agent.service - Google Compute Engine Guest Agent
     Loaded: loaded (/lib/systemd/system/google-guest-agent.service; enabled; vendor preset: enabled)
     Active: active (running) since Fri 2021-08-06 19:10:20 UTC; 27min ago
   Main PID: 717 (google_guest_ag)
      Tasks: 9 (limit: 8924)
     Memory: 19.1M
     CGroup: /system.slice/google-guest-agent.service
             └─717 /usr/bin/google_guest_agent

Aug 06 19:10:26 SRU-worked-gce gpasswd[1323]: user csmith added by root to group dip
Aug 06 19:10:26 SRU-worked-gce gpasswd[1329]: user csmith added by root to group video
Aug 06 19:10:26 SRU-worked-gce gpasswd[1335]: user csmith added by root to group plugdev
Aug 06 19:10:26 SRU-worked-gce gpasswd[1341]: user csmith added by root to group netdev
Aug 06 19:10:26 SRU-worked-gce gpasswd[1347]: user csmith added by root to group lxd
Aug 06 19:10:26 SRU-worked-gce gpasswd[1353]: user csmith added by root to group google-sudoers
Aug 06 19:10:26 SRU-worked-gce GCEGuestAgent[717]: 2021-08-06T19:10:26.2934Z GCEGuestAgent Info: Updating keys for user csmith.
Aug 06 19:10:26 SRU-worked-gce GCEGuestAgent[717]: 2021-08-06T19:10:26.2937Z GCEGuestAgent Info: Adding existing user ubuntu to google-sudoers group.
Aug 06 19:10:26 SRU-worked-gce gpasswd[1359]: user ubuntu added by root to group google-sudoers
Aug 06 19:10:26 SRU-worked-gce GCEGuestAgent[717]: 2021-08-06T19:10:26.3087Z GCEGuestAgent Info: Updating keys for user ubuntu.

# disabled GGA.service on July20 and later
ubuntu@broken-google-guest-image-unit:~$ cat /etc/cloud/build.info
build_name: server
serial: 20210720
ubuntu@broken-google-guest-image-unit:~$ systemctl status google-guest-agent.service
○ google-guest-agent.service - Google Compute Engine Guest Agent
     Loaded: loaded (/lib/systemd/system/google-guest-agent.service; enabled; vendor preset: enabled)
     Active: inactive (dead)