Comment 32 for bug 1836823

I tested the packages in the PPA on Ubuntu 16.04, 18.04, and 19.04 using the steps described at https://wiki.ubuntu.com/StableReleaseUpdates/Certbot#SRU_Verification_Process.

When testing against Let's Encrypt's ACMEv2 server (which is the default if you use the Certbot package from the PPA or you can include "--server https://acme-v02.api.letsencrypt.org/directory" on Certbot's command line if testing with the non-updated Certbot package) and starting with a clean /var/log/letsencrypt directory, you can use a command like:

grep 'GET' /var/log/letsencrypt/* | grep -v '/directory'

If this command produces any output, something has gone wrong.

To run https://wiki.ubuntu.com/StableReleaseUpdates/Certbot/TestScript, you first have to install all Certbot packages and set the environment variable CERTBOT_PREINSTALLED=1 otherwise the script will try to install from proposed-updates.

I also had to introduce an environment variable into the script to pin the version of boulder (Let's Encrypt's ACME server software) used for testing. Their most recent version has dropped support for features that are still included in Certbot and tested in the current script. The value I used here is BOULDERBRANCH="release-2019-03-11" which I believe is the most recent tag that works.

The output of dpkg-query at the end of the script about tested packages was:

On 19.04:

certbot 0.31.0-1
letsencrypt 0.31.0-1
python3-acme 0.31.0-2~ubuntu19.04.1~ppa4
python3-certbot 0.31.0-1
python3-certbot-apache 0.31.0-1
python3-certbot-nginx 0.31.0-1
python3-josepy 1.1.0-2

On 18.04:

certbot 0.27.0-1~ubuntu18.04.1~ppa3
letsencrypt 0.27.0-1~ubuntu18.04.1~ppa3
python3-acme 0.31.0-2~ubuntu18.04.1~ppa3
python3-certbot 0.27.0-1~ubuntu18.04.1~ppa3
python3-certbot-apache 0.23.0-1
python3-certbot-nginx 0.23.0-1
python3-josepy 1.1.0-1

On 16.04:

certbot 0.27.0-1~ubuntu16.04.1~ppa3
letsencrypt 0.27.0-1~ubuntu16.04.1~ppa3
python-acme 0.31.0-2~ubuntu16.04.1~ppa2
python-certbot 0.27.0-1~ubuntu16.04.1~ppa3
python-certbot-apache 0.23.0-1~ubuntu16.04.1
python-josepy 1.1.0-1~ubuntu16.04.1
python-letsencrypt 0.7.0-0ubuntu0.16.04.1
python-letsencrypt-apache 0.7.0-0ubuntu0.16.04.1