Why not simply only suggest the packages for removing which "sudo apt-get autoremove" would remove? It never suggested for me to remove any manufacturer-supplied printer drivers or other third-party packages.
Your suggestion to whitelist the packages which are installed without using apt does not help for printer drivers auto-installed with Jockey, as these get also installed via apt.
Why not simply only suggest the packages for removing which "sudo apt-get autoremove" would remove? It never suggested for me to remove any manufacturer- supplied printer drivers or other third-party packages.
Your suggestion to whitelist the packages which are installed without using apt does not help for printer drivers auto-installed with Jockey, as these get also installed via apt.