Comment 11 for bug 1837673

I tested the packages in the PPA on Ubuntu 16.04 and 18.04 using the steps described at https://wiki.ubuntu.com/StableReleaseUpdates/Certbot#SRU_Verification_Process.

When testing, if you start with a clean /var/log/letsencrypt directory and don't include any flags to change the default server such as --staging, --test-cert, --server, the following command should have no output:

grep 'acme-v01.api.letsencrypt.org' /var/log/letsencrypt/*

I successfully ran https://wiki.ubuntu.com/StableReleaseUpdates/Certbot/TestScript on each system, but if anyone else wants to do this, you first have to install all Certbot packages and set the environment variable CERTBOT_PREINSTALLED=1 otherwise the script will try to install from proposed-updates.

I also had to introduce an environment variable into the script to pin the version of boulder (Let's Encrypt's ACME server software) used for testing. Their most recent version has dropped support for features that are still included in Certbot and tested in the current script. The value I used here is BOULDERBRANCH="release-2019-03-11" which I believe is the most recent tag that works.

The output of dpkg-query at the end of the script about tested packages was:

On 18.04:

certbot 0.27.0-1~ubuntu18.04.1~ppa3
letsencrypt 0.27.0-1~ubuntu18.04.1~ppa3
python3-acme 0.31.0-2~ubuntu18.04.1~ppa3
python3-certbot 0.27.0-1~ubuntu18.04.1~ppa3
python3-certbot-apache 0.23.0-1
python3-certbot-nginx 0.23.0-1
python3-josepy 1.1.0-1

On 16.04:

certbot 0.27.0-1~ubuntu16.04.1~ppa3
letsencrypt 0.27.0-1~ubuntu16.04.1~ppa3
python-acme 0.31.0-2~ubuntu16.04.1~ppa2
python-certbot 0.27.0-1~ubuntu16.04.1~ppa3
python-certbot-apache 0.23.0-1~ubuntu16.04.1
python-josepy 1.1.0-1~ubuntu16.04.1
python-letsencrypt 0.7.0-0ubuntu0.16.04.1
python-letsencrypt-apache 0.7.0-0ubuntu0.16.04.1