SRU: update python3.6 to the new minor release 3.6.7

[Matthias Klose]

SRU: update python3.6 to the new minor release 3.6.7

See LP: #1792143 for the rationale, going one minor release ahead (and planning to do 3.6.8 in January, the last source release from the 3.6 branch).

[Impact]
Provide the branch updates for the stable 3.6 branch in the LTS release.

[Regression Potential]
There is regression potential, but this version is in use in 18.10, which didn't show regressions.

[Test Case]
No regressions in the Python 3.6 test suite, no regressions in the autopkg tests

Failing autopkg tests:
 - http://autopkgtest.ubuntu.com/packages/p/python-asdf/bionic/armhf
   failed before, flaky autopkg tests history, now passes in disco.
 - snapcraft: amd64 and i386 try to download some rust installation,
   which then fails to build some downloaded code. This doesn't look
   like a reliable test.
 - python-mechanicalsoup: unrelated, fails in both 2.7 and 3.6.
   Fixed in cosmic, filed LP: #1802835 for a fix anyway.
 - http://autopkgtest.ubuntu.com/packages/l/lxd/bionic/arm64
   doesn't look like a regression in the autopkg test history.
   pinged the lxd maintainers, but no response yet. LP: #1803344
   lxd now passes after giving back several times
 - ocrmypdf has a hint: adconrad:unblock ocrmypdf/6.1.2-1ubuntu1
   This does not seem to be a regression, although fixed in disco via
   a new upstream version 6.2.5.
   And now fixed by another SRU ...

[Matthias Klose (doko)]

What's New in Python 3.6.7 final?
=================================

*Release date: 2018-10-20*

There were no new changes in version 3.6.7.

What's New in Python 3.6.7 release candidate 2?
===============================================

*Release date: 2018-10-13*

Core and Builtins
-----------------

- bpo-34879: Fix a possible null pointer dereference in bytesobject.c.
  Patch by Zackery Spytz.

- bpo-34320: Fix ``dict(od)`` didn't copy iteration order of OrderedDict.

Library
-------

- bpo-34769: Fix for async generators not finalizing when event loop is in
  debug mode and garbage collector runs in another thread.

- bpo-34922: Fixed integer overflow in the :meth:`~hashlib.shake.digest()`
  and :meth:`~hashlib.shake.hexdigest()` methods for the SHAKE algorithm in
  the :mod:`hashlib` module.

- bpo-34871: Fix inspect module polluted ``sys.modules`` when parsing
  ``__text_signature__`` of callable.

- bpo-34872: Fix self-cancellation in C implementation of asyncio.Task

- bpo-34819: Use a monotonic clock to compute timeouts in
  :meth:`Executor.map` and :func:`as_completed`, in order to prevent
  timeouts from deviating when the system clock is adjusted.

- bpo-34521: Use :func:`socket.CMSG_SPACE` to calculate ancillary data size
  instead of :func:`socket.CMSG_LEN` in
  :func:`multiprocessing.reduction.recvfds` as :rfc:`3542` requires the use
  of the former for portable applications.

- bpo-34282: Fix enum members getting shadowed by parent attributes.

- bpo-34172: Fix a reference issue inside multiprocessing.Pool that caused
  the pool to remain alive if it was deleted without being closed or
  terminated explicitly.

- bpo-33729: Fixed issues with arguments parsing in :mod:`hashlib`.

Documentation
-------------

- bpo-32174: chm document displays non-ASCII charaters properly on some MBCS
  Windows systems.

Tests
-----

- bpo-32962: Fixed test_gdb when Python is compiled with flags -mcet
  -fcf-protection -O0.

macOS
-----

- bpo-34370: Revert to using the released Tk 8.6.8 with macOS installers
  instead of the Tk 8.6.x development snapshot used with 3.7.1rc1 and
  3.6.7rc1. The snapshot introduced at least one significant regression
  (bpo-34927).

C API
-----

- bpo-34910: Ensure that :c:func:`PyObject_Print` always returns ``-1`` on
  error. Patch by Zackery Spytz.

What's New in Python 3.6.7 release candidate 1?
===============================================

*Release date: 2018-09-26*

Security
--------

- bpo-17239: The xml.sax and xml.dom.minidom parsers no longer processes
  external entities by default. External DTD and ENTITY declarations no
  longer load files or create network connections.

- bpo-34623: CVE-2018-14647: The C accelerated _elementtree module now
  initializes hash randomization salt from _Py_HashSecret instead of
  libexpat's default CSPRNG.

- bpo-34405: Updated to OpenSSL 1.0.2p for Windows builds.

- bpo-33871: Fixed sending the part of the file in :func:`os.sendfile` on
  macOS. Using the *trailers* argument could cause sending more bytes from
  the input file than was specified.

- bpo-32533: Fixed thread-safety of error handling in _ssl.

Core and Builtins
-----------------

- bpo-34735: Fix...

[Łukasz Zemczak (sil2100)]

Hello Matthias, or anyone else affected,

Accepted python3.6 into cosmic-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/python3.6/3.6.7-1~18.10 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-cosmic to verification-done-cosmic. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-cosmic. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

[Łukasz Zemczak (sil2100)]

Hello Matthias, or anyone else affected,

Accepted python3.6 into bionic-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/python3.6/3.6.7-1~18.04 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-bionic to verification-done-bionic. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-bionic. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

[Łukasz Zemczak (sil2100)]

Hello Matthias, or anyone else affected,

Accepted python3-defaults into bionic-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/python3-defaults/3.6.7-1~18.04 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-bionic to verification-done-bionic. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-bionic. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

[Łukasz Zemczak (sil2100)]

Hello Matthias, or anyone else affected,

Accepted python3-defaults into cosmic-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/python3-defaults/3.6.7-1~18.10 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-cosmic to verification-done-cosmic. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-cosmic. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

[Łukasz Zemczak (sil2100)]

The python3-defaults upload lists a lot autopkgtest regression. Someone has to look through them, check if they're regressions or not and/or re-run if needed.

[Matthias Klose (doko)]

it's ongoing, but these look like all these are also in the release pocket. will summarize later

[Matthias Klose (doko)]

the bionic autopkg test failures are down to

 - partd: no regression, fix uploaded
 - python-tornado: no regression, didn't fix.
 - systemd: looks like a flaky test, fails with other triggers
   as well.

[Łukasz Zemczak (sil2100)]

The python-tornado seems like a failure happening also with the release pocket, I'll hint it for now. systemd has been confirmed by xnox to be a flaky test only. Assuming this is verification-done.

[Launchpad Janitor (janitor)]

This bug was fixed in the package python3.6 - 3.6.7-1~18.10

---------------
python3.6 (3.6.7-1~18.10) cosmic-proposed; urgency=medium

  * SRU: LP: #1799206.

python3.6 (3.6.7-1) unstable; urgency=medium

  * Python 3.6.7 release.

python3.6 (3.6.7~rc2-1) unstable; urgency=medium

  * Python 3.6.7 release candidate 2.

 -- Matthias Klose <email address hidden> Mon, 22 Oct 2018 13:32:17 +0200

[Łukasz Zemczak (sil2100)]

The verification of the Stable Release Update for python3.6 has completed successfully and the package has now been released to -updates. Subsequently, the Ubuntu Stable Release Updates Team is being unsubscribed and will not receive messages about this bug report. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

[Launchpad Janitor (janitor)]

This bug was fixed in the package python3-defaults - 3.6.7-1~18.10

---------------
python3-defaults (3.6.7-1~18.10) cosmic-proposed; urgency=medium

  * SRU: LP: #1799206.

python3-defaults (3.6.7-1) unstable; urgency=high

  * Really ship the policy in the python3 package, and update from the last
    version found in the python package. Closes: #910113.
  * Bump version to 3.6.7.

 -- Matthias Klose <email address hidden> Thu, 25 Oct 2018 13:11:00 +0200

[Matthias Klose (doko)]

summarized the failing autopkg tests in the bug description. These look like not being triggered by the 3.6 update.

[Łukasz Zemczak (sil2100)]

Thanks for the verification! I also double-checked python-asdf and it's indeed busted in release as well. I think we can proceed with releasing of the packages.

[Launchpad Janitor (janitor)]

This bug was fixed in the package python3.6 - 3.6.7-1~18.04

---------------
python3.6 (3.6.7-1~18.04) bionic-proposed; urgency=medium

  * SRU: LP: #1799206.

python3.6 (3.6.7-1) unstable; urgency=medium

  * Python 3.6.7 release.

python3.6 (3.6.7~rc2-1) unstable; urgency=medium

  * Python 3.6.7 release candidate 2.

python3.6 (3.6.7~rc1-1) unstable; urgency=medium

  * Python 3.6.7 release candidate 1.

python3.6 (3.6.6-4) unstable; urgency=medium

  * Update to 20180901 from the 3.6 branch.
  * Add idle-python3.6 to the autopkg test depends.

python3.6 (3.6.6-3) unstable; urgency=medium

  * Update to 20180828 from the 3.6 branch.
  * Disable running some tests which are not ready for Debian's OpenSSL
    defaults (test_{asyncio,ftplib,httplib,imaplib,nntplib,poplib,ssl}).
    Closes: #907215.

python3.6 (3.6.6-2) unstable; urgency=medium

  * Update to 20180820 from the 3.6 branch.
  * Avoid usage of distutils in the platform module. See issue #26544.
  * Move test/__main__.py into libpython3.6-stdlib.
  * Pass the list of the pyFPE breaks as a parameter into dpkg-gencontrol
    instead of hard-coding them in the control file.

 -- Matthias Klose <email address hidden> Mon, 22 Oct 2018 13:32:17 +0200

[Launchpad Janitor (janitor)]

This bug was fixed in the package python3-defaults - 3.6.7-1~18.04

---------------
python3-defaults (3.6.7-1~18.04) bionic-proposed; urgency=medium

  * SRU: LP: #1799206.
  * Drop python3.7 as a supported python3 version for the bionic SRU.

python3-defaults (3.6.7-1) unstable; urgency=high

  * Really ship the policy in the python3 package, and update from the last
    version found in the python package. Closes: #910113.
  * Bump version to 3.6.7.

python3-defaults (3.6.6-1) unstable; urgency=medium

  [ Matthias Klose ]
  * Fix the idle desktop file. Closes: #901096.
  * Install the policy files in the python3 package. Closes: #901486.
  * python3-minimal: Pre-Depend on python3.6-minimal. Closes: #901001.
  * Bump version to 3.6.6.

  [ Scott Kitterman ]
  * Remove myself from uploaders

 -- Matthias Klose <email address hidden> Thu, 25 Oct 2018 13:11:00 +0200

[Matthias Klose (doko)]

closing the main tasks, nothing to do for disco