Comment 19 for bug 222041

Not only is there the cosmetic problems of icons sticking on the desktop...
Some devices (at least my Nokia E50, S60 operating system) will actually complain if they're removed without this "eject" action being executed.

They will inform the user that the device has been unplugged incorrectly and data loss may occur.
This is not very reassuring to the user at all...