Changelog
autopkgtest (3.18.1~ubuntu15.04.1) vivid-backports; urgency=medium
* No-change backport to vivid
autopkgtest (3.18.1) unstable; urgency=medium
* With --apt-pocket=POCKET=pkgname,... also include <release>-updates.
* cloud-vm-setup, adt-setup-vm: Disable /etc/cron.daily/apt.
* Detect if apt fails to download packages (as opposed to installing them),
retry up to three times, and eventually fail with exit code 16. This
avoids failing tests due to DNS/infrastructure problems and handling them
as tmpfails instead.
* Add test case for multiple Tests: with --apt-pocket=proposed=pkg
selection and nonexisting dependency.
* Properly keep track of apt pinnings across testbed resets.
* cloud-vm-setup, adt-setup-vm: Purge open-iscsi.
* Treat apt errors (exit code 100) from source download/extraction as
tmpfail.
* ssh-setup/nova: Stop adding apt sources for restricted/multiverse, as
current images now have them by default (see LP #1177432). This avoids
duplicate apt sources which cause stderr failure with some tests.
* Recognize negative architecture restrictions in test Depends:.
(LP: #1516959)
* tools/adt-buildvm-ubuntu-cloud: Counter-hack LP #1510345 harder by
checking /proc/cmdline instead of /etc/default/grub.
autopkgtest (3.18) unstable; urgency=medium
Behaviour changes/improvements:
* adt-virt-lxc: Drop --eatmydata option. Conceptually this isn't specific to
the LXC runner, it should always be used for package installation (when
available) with all runners, but never for tests.
* setup-commands/cloud-vm-setup, tools/adt-setup-vm: Install and use
eatmydata.
* Use eatmydata for --apt-upgrade and installing test dependencies, if
available.
* ssh-setup/nova: Provide custom implementation of "wait-reboot" using "nova
reboot --poll". This works more reliably on some clouds.
* ssh-setup/nova: Call "nova boot" with --debug to better be able to
diagnose failures.
* Extend --apt-pocket=POCKET option to accept an additional
"=pkgname1,src:srcname1,..." package list. An entry "src:srcname" expands
to all binary packages built by that source. If given, set up apt pinning
to use only those packages from POCKET, so that package updates in that
pocket can be tested independently from each other for better isolation.
(LP: #1503150)
* Add ssh-setup/maas: Acquire and Deploy a machine via MAAS to use as an
autopkgtest testbed. It assumes that MaaS is already set up, machines are
commissioned to it, and you added your ssh key to it.
Bug fixes:
* ssh-setup/nova: Drop "Warning: PoC", we've been using this in production
for a long time.
* tools/adt-setup-vm: Check if we already have a configuration for the
specific network interface that we are configuring, not just any
interface.
* tools/adt-buildvm-ubuntu-cloud: Counter-hack the Ubuntu livecd-rootfs
workaround for LP #1510345 by creating a configuration for ens3 and
removing the one for eth0.
autopkgtest (3.17.4) unstable; urgency=medium
* Fix --apt-pocket for apt sources with [options].
* Add tests/testarchive.py module for creating dynamic archives of mock
debs, and add a full integration test for --apt-pocket.
* Fix version in adt-run output (@version@ moved to adt_testbed.py).
* adt-setup-vm, cloud-vm-setup: Purge lxc/lxd.
* tests/testdesc: Skip Debian.test_builddeps_profiles test if dpkg is too
old to support build profiles.
autopkgtest (3.17.3) unstable; urgency=medium
* Set DEB_BUILD_OPTIONS=parallel=<#cpu> for builds and tests (as they
sometimes build packages). (LP: #1399177)
* If copying up files/artifacts through shared dir fails because of
inaccessible files, fall back to piping them through the auxverb.
* adt-build-lxc: Install dbus; a lot of software indirectly expects it
(e. g. calling systemctl as user).
* tools/adt-setup-vm, setup-commands/cloud-vm-setup: Purge
libcpan-changes-perl, it breaks some Perl autopkgtests.
* tools/adt-setup-vm, setup-commands/cloud-vm-setup: Purge git, it breaks
Ruby's autopkgtests.
* NullRunner.test_tmp_install: Explicitly require Json 1.0 GI version, to
silence warning with current pygobject.
autopkgtest (3.17.2) unstable; urgency=medium
* ssh-setup/nova: Use instance UUIDs instead of names after initial "nova
boot", to avoid name collisions. (LP: #1495788)
* adt-setup-vm: Drop "pin eth0 name" hack, this was fixed properly in
systemd 226-2.
* adt-setup-vm: Generalize ethernet ifupdown setup for net.ifnames.
* adt_binaries.py: Fix resetting of testbed (regression in 3.17).
autopkgtest (3.17.1) unstable; urgency=medium
* Add new private python modules to Makefile, to actually ship them.
* tests/adt-run: Fix test regression when $ADT_TEST* are not set.
autopkgtest (3.17) unstable; urgency=medium
* setup-commands/cloud-vm-setup: Provide fallback for Ubuntu 12.04 which
does not yet have /etc/default/grub.cfg.d/.
* adt-virt-ssh: Add --timeout-ssh option. Thanks Leo Arias for the initial
patch. (LP: #1488358)
* adt-run: Add --env option to pass arbitrary environment variables to the
test.
* adt-virt-lxc: In the auxverb, clean up leaked background processes which
share the same stdout/stderr, to avoid eternal hangs. (LP: #1488359)
* Move Testbed class and related logic into separate module
lib/adt_testbed.py, and clean up some unnecessary code interdependencies
and error handling. This will make it easier to write alternative CLI
frontents. This also handles test timeouts in a better way: There now is a
proper "summary" report as "FAIL timed out", and subsequent tests will now
run. (Closes: #741322)
* Drop the --leave-lang option. Please use the explicit option --set-lang
instead, to avoid weakly defined behaviour.
* Move Binaries class into separate module lib/adt_binaries.py.
* Testbed.execute(): Explicitly decode output of programs as UTF-8, instead
of relying on the host locale's encoding.
* tools/adt-setup-vm: Only configure eth0 in ifupdown if it actually exists,
and then make sure it does not get renamed any more.
* Add @builddeps@ build profile parsing fallback for libdpkg-perl < 1.04;
just ignore all build profiles.
* ssh-setup/nova: Add workaroud for cloud-init bug writing a wrong
/etc/hosts. (LP #1494678)
* adt-run: Log running kernel after each boot. (part of LP #1491865)
* Track initial kernel version after test bed setup and when a test/reboot
changes the running kernel version. Log these, and create a new
"testinfo.json" in the output dir with this information. (LP: #1491865)
* If --env options are specified, add these as list of name=value strings as
"custom_environment" key to testinfo.json.
* Put vserver arguments into testinfo.json.
autopkgtest (3.16.3) unstable; urgency=medium
* adt-setup-vm: Use /etc/cloud.cfg.d/ to avoid conffile prompts on upgrades.
(LP: #1477626)
* Don't invoke QEMU with -localtime. QEMU defaults to and Linux prefers the
hw clock in UTC. This avoids large time jumps when doing NTP.
* adt-setup-vm: Start autopkgtest shell after all other SysV init
scripts/facilities, to avoid a too early start of tests while boot is
still in progress.
* doc/README.package-tests.rst: Use comma separator in examples.
* VirtSubproc.check_exec(): Actually error out on stderr as documented.
* adt-virt-ssh: Verify that sudo does not write errors, as that
interferes with auxverbs and generally is a sign of host mis-configuration
(typically wrong hostname).
* ssh-setup-nova: Set hostname to "adt". This avoids overly long host names
from defaulting to nova instance names (which can be very long).
* ssh-setup/nova: Fix parsing of IP address from "nova show" to avoid
tripping over instance names containing "network". (LP: #1481574)
* Fix error message and code for "invalid test depends" errors.
* tests/pep8: Ignore E402 ("module level import not at top of file"), as
that's impossible to satisfy; we have to set sys.path before.
* ssh-setup/nova: In cleanup(), wait until the instance gets deleted. This
avoids name collisions and instance quota overflow.
* adt-run: Always show summary at the end, which is particularly helpful for
multiple tests. (LP: #1484991)
* adt-run.1: Clarify that without any logging options adt-run only logs to
stderr. (LP: #1485661)
* adt-virt-lxc: If the executed command exits with 255, translate that to
253 in the auxverb wrapper, as 255 is the exit code for failures of the
auxverb itself. This avoids considering ordinary test failures as
temporary testbed failures.
* adt-run: Show host name, to more easily identify hosts with frequent
failures.
* adt-virt-lxc: Always call lxc-stop with --kill, as the containers are not
precious and normal shutdown might hang.
* adt-virt-lxc: In cleanup, stop LXC container before removing the shared
downtmp, to ensure that we always clean up the running container. Also
don't fail on errors. (LP: #1488879)
* ssh-setup/nova: Add missing apt sources for -updates/-security
restricted/multiverse pockets.
autopkgtest (3.16.2) unstable; urgency=medium
* Exit with code 4 ("test failure") if a test times out, instead of 16
("testbed failure").
* Exit with code 12 ("erroneous package") if test dependencies are
unsatisfiable and put badpkg/blame into summary, instead of exiting with
code 20 ("other unexpected failures including bad usage").
* Exit with code 12 ("erroneous package") and a proper error message if
debian/tests/<testname> does not exist, instead of code 20 and a confusing
message about chmod failing and *-stderr missing.
* Exit with code 12 ("erroneous package") instead of 20 if test dependency
package install fails.
* adt-virt-ssh: If the executed command exits with 255, translate that to
253 in the auxverb wrapper, as 255 is ssh's (and auxverb's) exit code if
something with the connection failed. This avoids considering ordinary
test failures as temporary testbed failures. (LP: #1475679)
autopkgtest (3.16.1) unstable; urgency=medium
* setup-commands/cloud-vm-setup: Fix installation of linux-generic on
Ubuntu.
* ssh-setup/nova: Clean up userdata temp file on failed nova boot.
* If the test fails with exit code 127 (usually "command not found"),
consider this a test failure (code 4), not a testbed failure (code 16).
* doc/README.package-tests.rst: Document that "Tests:" and similar fields
can be comma separated too, like everywhere else in Debian's control
files.
* ssh-setup/nova: Show name of created nova instance, so that it's easier to
map instances to a test.
* run-from-checkout: Exec adt-run to avoid keeping the shell wrapper process
around.
* ssh-setup/snappy: Fix check whether --image and --channel are specified
together. (LP: #1474735)
* ssh-setup/nova: Allow selecting net IDs by name.
autopkgtest (3.16) unstable; urgency=medium
Behaviour changes and improvements:
* ssh-setup/nova: Re-try nova boot up to three times if it fails, and sleep
5 minutes in between. This occasionally fails due to exceeding quota or
temporary glitches.
* Drop gpg-signing local archive and mark it as [trusted=yes] instead. This
gets rid of the requirement to generate a gpg key on first run. Drop
corresponding --gnupg-home option. (LP: #1472691)
* Drop long-obsolete --tmp-dir backwards compat option.
* ssh-setup/snappy: Adjust ubuntu-device-flash arguments to new
release/channel structure from Ubuntu 15.10, and default to rolling/edge.
Add new --release option.
Bug fixes:
* ssh-setup/nova: Silence "invalid command wait-reboot" warning.
* setup-commands/cloud-vm-setup: Purge cloud-init too. It sometimes causes
longer hangs on boot and might interfere with tests in other ways, and we
only need it for first-time initialization anyway.
* adt-virt-qemu: adt-buildvm-ubuntu-cloud: Don't use -enable-kvm QEMU option
if /dev/kvm does not exist. (Closes: #790650)
* Quiesce warnings from tar. Avoids "time stamp is in the future" log spew.
(LP: #1468868)
* Move apt sources setup from setup-commands/cloud-vm-setup to
ssh-setup/nova. --apt-pocket does not work with the former as that runs
too late.
* Use Dpkg::Deps to evaluate/reduce build dependencies for expanding
"@builddeps@". This handles build profiles. (Closes: #787093)
* Resolve build profiles when installing build dependencies to build tested
package.
* Adjust NullRunner.test_tmp_install_perl test case to use
libtest-requires-perl instead of libtest-tester-perl; the latter got
removed from Debian.
autopkgtest (3.15.1) unstable; urgency=medium
* adt-buildvm-ubuntu-cloud: Fix lsb_release fallback if python3-distro-info
is not available.
* adt-buildvm-ubuntu-cloud: Don't move the uninitialized image to final
location if QEMU failed.
* adt-buildvm-ubuntu-cloud: Check availability of genisoimage and access of
/dev/kvm before downloading image. (LP: #1466486)
* Get along with dpkg-query not existing, such as in latest Ubuntu Snappy
images. Skip generation of testbed-packages artifact in that case.
(LP: #1469647)
* Adjust NullRunner.test_tmp_install test case to work with pygobject 3.16.
autopkgtest (3.15) unstable; urgency=medium
Behaviour changes and improvements:
* The specified --output-dir now must not exist or be empty. If it is
non-empty, adt-run now will refuse to use it instead of cleaning it. This
is safer, to avoid accidentally using the home directory or similarly
precious data. (LP: #1463561)
* Add --no-auto-control option to disable autodep8. (Closes: #788659)
* ssh-setup/nova: Add -e/--env option to append to /etc/environment. This is
mostly useful to configure $http_proxy and friends.
* ssh-setup/nova: Add --mirror option.
* Add setup-commands/cloud-vm-setup: --setup-commands script for cloud
instances to prepare them for running autopkgtests. This is similar to
adt-setup-vm, but won't configure serial console or networking.
Bug fixes:
* adt-setup-vm: Print a warning if calling update-grub fails, instead of
aborting. This fixes vmdebootstrap --grub, as that installs grub after
running the customization script. Adjust adt-virt-qemu.1 manpage to
recommend the --grub option of vmdebootstrap.
* testdesc.py, parse_rfc822(): Entirely ignore lines which only contain
whitespace after filtering out intra-line comments. They break
continuation line parsing in python-debian >= 0.1.23. (Closes: #784942)
* adt-setup-vm: Add inclusion of interfaces.d/ to /etc/network/interfaces.
This belongs into vmdebootstrap (#788792), but fix that locally for the
time being.
* adt-run.1: Document --testname.
autopkgtest (3.14.3) unstable; urgency=medium
* adt-virt-lxc: Don't try to set up a shared downtmp with unprivileged
(user) containers. This is full of permission errors due to the mapped
UIDs.
* tests/adt-run LxcRunner: Use $ADT_TEST_LXC as unprivileged user container
if it exists.
* adt-buildvm-ubuntu-cloud: Check at the beginning if QEMU command is
available and exit with proper error message if not. (LP: #1460066)
* If auxverb fails with exit code 126, 127, 254, or 255, consider this a
failure of auxverb/the testbed itself, not of the program run under it.
(As specified in doc/README.virtualisation-server.rst) (LP: #1462540)
autopkgtest (3.14.2) unstable; urgency=medium
* Add tests/testpkg-{simple,reboot,reboot-prepare}: Very simple stub
packages for manual testing.
* VirtSubproc, cmd_reboot(): Disconnect the backgrounded reboot command from
stdout/err, to avoid it getting killed by the ssh runner. (LP: #1454735)
autopkgtest (3.14.1) unstable; urgency=medium
* Go back to using the backgrounded reboot command as we had before 3.14.
Just calling "reboot" is prone to hangs and timeouts in case reboot is too
fast and shuts down our communication channel.
* Fix --override-control option in adt-run(1). (LP: #1453495)
* Fail with an error if --override-control file does not exist.
(LP: #1453503)
* ssh-setup/snappy: Add -b/--show-boot option to direct boot and console
messages to stdout. (LP: #1453154)
* adt-virt-qemu.1: Document --show-boot option.
* Add test case for using a @ command line include file for a virt runner.
* Strip leading and trailing space from argument lines in '@' included
command line argument files. (LP: #1453498)
autopkgtest (3.14) unstable; urgency=medium
Improvements:
* adt-virt-ssh: Add --reboot option to indicate that testbed can be
rebooted. This is useful when running without a setup script (which can
already declare capabilities).
* Simplify reboot implementation: Just call "reboot" as root in the testbed
to trigger rebooting, and replace the former hook_reboot() in adt-virt-*
with hook_wait_reboot() which merely waits for the testbed to go down and
come back up. This also replaces the "reboot" command for ssh setup
scripts to "wait-reboot" and in most cases it is not needed to implement
this at all (except for the "adb" script).
* Add /tmp/autopkgtest-reboot-prepare script for testbeds which support
rebooting. This saves the current state but leaves the actual reboot to
the test itself. This is useful if rebooting should happen with unusual
means (e. g. kexec) or as part of testing something else (like a system
upgrade). (LP: #1445819)
* Log complete command line invocation, for easier local reproduction,
comparison of log files, and clarifying which options were used.
(LP: #1449413)
Bug fixes:
* Update Vcs-Git: field for anonscm.debian.org.
* Drop obsolete XS-Testsuite: control field.
* adt-setup-vm: Fix script error if $ADT_SETUP_VM_POST_COMMAND is not set.
* README.click-tests.rst: Describe x-source manifest entry.
* Mark test dependencies as manually installed, so that they don't go away
if a test calls "apt-get autoremove".
* Set DEBIAN_FRONTEND=noninteractive for tests. This avoids stderr messages
about "unable to open stdin" and similar when tests call apt-get install.
-- Martin Pitt <email address hidden> Tue, 24 Nov 2015 10:39:42 +0100