Comment 4 for bug 677209

To clarify, the retry button does not mean that you have archive administrator powers. This button is available to anyone who can upload the package.

So yes, ubuntu-drivers does have excessive privilege - something we've known for a while. (In the same way, there are a few people in e.g. developer-membership-board who are transitively members of ubuntu-core-dev but who aren't by policy permitted to use it.) Bug 174375 tracks the work to reduce this.