Comment 2 for bug 1722570

I'm fairly certain that this behavior did change at some point in the 17.10 process -- I believe that I used to be able to long-press the Super key and have the numbers show up.

That being said, it should also be noted that after selecting an app, the numbers don't go away again until you press Super once more and exit from the resulting screen or press Escape.