autopkgtest fail

[Paride Legovini]

The python-azure autopkgtest is failing on Eoan, currently blocking the migration of:

 - python-cryptography
 - python-defaults

I had a look at the test log but it's not clear to me where the problem is. The autopkgtest history suggests that the failure is not actually caused by the two packages held in the migration queue. The python-azure autopkgtest is python3-only.

[Andreas Hasenack (ahasenack)]

I suspect the test might require internet access, but it's not clear why it worked before, since the last pass was the same exact package:

E vcr.errors.CannotOverwriteExistingCassetteException: No match for the request (<Request (POST) https://squid.internal:3128/00000000-0000-0000-0000-000000000000/services/webspaces//eastuswebspace/sites>) was found. Can't overwrite existing cassette ('/tmp/autopkgtest.STWYRh/autopkgtest_tmp/tests/recordings/test_legacy_mgmt_website.test_get_web_site.yaml') in your current record mode ('none').

Locally in lxd, and also on diglett, the dep8 tests passed, using eoan-proposed.

[Andreas Hasenack (ahasenack)]

Adding a task for python-cryptography so this bug shows up in the excuses page, even though it's not a bug in python-cryptography itself.

[Andreas Hasenack (ahasenack)]

Given the tests pass locally in a container (autopkgtest ... -- lxd ubuntu-daily;eoan), I'm trying a bileto run (https://bileto.ubuntu.com/#/ticket/3818) to see if that reproduces the test failure. If yes, then I can use that platform for troubleshooting.

[Steve Langasek (vorlon)]

the latest autopkgtest retries show that the problem is present in the release pocket, so I have hinted away the failure and am closing the tasks on the reverse-dependencies, since they will no longer be blocked.

[Andreas Hasenack (ahasenack)]

The python-azure test failed in bileto in the same way, so it can be used to further troubleshoot this issue. My first attempt would be to unset the http_proxy variable, or set it to localhost so connections fail, and see what happens.

[Brian Murray (brian-murray)]

I ran autopkgtest using squid.internal and the test failed with these errors:

=========================== short test summary info ============================
FAILED tests/test_content.py::TestContentFromStream::test_content_bad_endpoint
FAILED tests/test_content_async.py::TestContentFromStreamAsync::test_content_bad_endpoint
FAILED tests/test_identity_documents.py::TestIdDocument::test_identity_document_bad_endpoint
FAILED tests/test_identity_documents_async.py::TestIdDocumentsAsync::test_identity_document_bad_endpoint
FAILED tests/test_invoice.py::TestInvoice::test_invoice_bad_endpoint - azure....
FAILED tests/test_invoice_async.py::TestInvoiceAsync::test_invoice_bad_endpoint
FAILED tests/test_receipt.py::TestReceiptFromStream::test_receipt_bad_endpoint
FAILED tests/test_receipt_async.py::TestReceiptFromStreamAsync::test_receipt_bad_endpoint
FAILED tests/test_receipt_from_url.py::TestReceiptFromUrl::test_receipt_url_bad_endpoint
FAILED tests/test_receipt_from_url_async.py::TestReceiptFromUrlAsync::test_receipt_url_bad_endpoint
==== 10 failed, 521 passed, 38 skipped, 17 deselected in 125.03s (0:02:05) =====

The test_receipt_url_bad_endpoint attempts to contact "http://notreal.azure.com" and then compares the returned information to an "Invoice_1.pdf" included in the source package.

[Brian Murray (brian-murray)]

The following change will skip the tests that will not pass in Ubuntu's autopkgtest infrastructure:

diff -Nru python-azure-20211104+git/debian/tests/python3-tests python-azure-20211104+git/debian/tests/python3-tests
--- python-azure-20211104+git/debian/tests/python3-tests 2021-11-04 17:38:39.000000000 -0700
+++ python-azure-20211104+git/debian/tests/python3-tests 2021-12-01 15:00:46.000000000 -0800
@@ -165,6 +165,16 @@
                 --deselect=tests/test_file_system_async.py::FileSystemTest::test_undelete_dir_with_version_id \
                 --deselect=tests/test_file_system_async.py::FileSystemTest::test_undelete_file_system \
                 --deselect=tests/test_file_system_async.py::FileSystemTest::test_undelete_file_with_version_id \
+ --deselect=tests/test_content.py::TestContentFromStream::test_content_bad_endpoint \
+ --deselect=tests/test_content_async.py::TestContentFromStreamAsync::test_content_bad_endpoint \
+ --deselect=tests/test_identity_documents.py::TestIdDocument::test_identity_document_bad_endpoint \
+ --deselect=tests/test_identity_documents_async.py::TestIdDocumentsAsync::test_identity_document_bad_endpoint \
+ --deselect=tests/test_invoice.py::TestInvoice::test_invoice_bad_endpoint \
+ --deselect=tests/test_invoice_async.py::TestInvoiceAsync::test_invoice_bad_endpoint \
+ --deselect=tests/test_receipt.py::TestReceiptFromStream::test_receipt_bad_endpoint \
+ --deselect=tests/test_receipt_async.py::TestReceiptFromStreamAsync::test_receipt_bad_endpoint \
+ --deselect=tests/test_receipt_from_url.py::TestReceiptFromUrl::test_receipt_url_bad_endpoint \
+ --deselect=tests/test_receipt_from_url_async.py::TestReceiptFromUrlAsync::test_receipt_url_bad_endpoint \
                 --ignore=tests/test_certificates_client.py \
                 --ignore=tests/test_certificates_client_async.py \
                 --ignore=tests/test_examples_certificates.py \