Using a hardware key during login sometimes fails asking for smart card instead

[Islam]

I'm using a Yubikey with U2F during gdm3 login which works however sometimes without a reason, gdm asks for smart card instead, ignoring the inserted key and doesn't allow me to login at all unless gdm is restarted from another TTY.

/etc/pam.d/common-auth: auth required pam_u2f.so

The workaround to avoid this issue completely was to modify the file: /etc/xdg/autostart/org.gnome.SettingsDaemon.Smartcard.desktop
and make it like that: Exec=echo "/usr/libexec/gsd-smartcard"

ProblemType: Bug
DistroRelease: Ubuntu 22.04
Package: gnome-settings-daemon 42.1-1ubuntu2.1
ProcVersionSignature: Ubuntu 5.15.0-37.39-generic 5.15.35
Uname: Linux 5.15.0-37-generic x86_64
NonfreeKernelModules: nvidia_modeset nvidia
ApportVersion: 2.20.11-0ubuntu82.1
Architecture: amd64
CasperMD5CheckResult: pass
Date: Wed Jun 15 11:05:53 2022
InstallationDate: Installed on 2022-02-03 (131 days ago)
InstallationMedia: Ubuntu 21.10 "Impish Indri" - Release amd64 (20211012)
SourcePackage: gnome-settings-daemon
UpgradeStatus: Upgraded to jammy on 2022-04-21 (54 days ago)
mtime.conffile..etc.xdg.autostart.org.gnome.SettingsDaemon.Smartcard.desktop: 2022-02-04T20:07:14.092002