I had that problem too with some languages. Try adding more input sources in System Settings->Text Entry. Then temporarily select one that isn't one of the four listed in
$ setxkbmap -query | grep layout
Ubuntu-GNOME seems to always set up the maximum of 4 layout groups and only switches between those as long as possible. I believe if you pick a language that isn't part of those yet, it is forced to reload the whole layout.
Or, you know, run
$ setxkbmap en
Not convenient, I know, but that's the best I have at the moment.
I had that problem too with some languages. Try adding more input sources in System Settings->Text Entry. Then temporarily select one that isn't one of the four listed in
$ setxkbmap -query | grep layout
Ubuntu-GNOME seems to always set up the maximum of 4 layout groups and only switches between those as long as possible. I believe if you pick a language that isn't part of those yet, it is forced to reload the whole layout.
Or, you know, run
$ setxkbmap en
Not convenient, I know, but that's the best I have at the moment.