[2.2beta1] artifact collection fails because of MAAS 2.2 API errors - TypeError: Incorrect padding

Bug #1661022 reported by Larry Michel
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
MAAS
Triaged
Critical
Newell Jensen

Bug Description

Openstack deployments with Maas 2.2 beta1 and Juju 2.1 beta4 were all timing out but artifact collection failed because of below errors that we're hitting with the MAAS API. This was error from console.txt.

https://oil-jenkins.canonical.com/job/pipeline_deploy/615687/console

2017-01-30 22:14:16,598 [INFO] oil_ci.deploy.oil_deployer: Saving deployment artifacts to: ./artifacts
2017-01-30 22:14:18,005 [ERROR] oil_ci.cli.api: Deployment failed
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/oil_ci/cli/api.py", line 151, in do_deploy
    rc = deploy.deploy()
  File "/usr/lib/python2.7/dist-packages/oil_ci/deploy/oil_deployer.py", line 219, in deploy
    self.save_artifacts(rc == 1)
  File "/usr/lib/python2.7/dist-packages/oil_ci/deploy/oil_deployer.py", line 160, in save_artifacts
    self.save_maas_install_logs()
  File "/usr/lib/python2.7/dist-packages/oil_ci/deploy/oil_deployer.py", line 146, in save_maas_install_logs
    self.save_maas_install_log(node_name)
  File "/usr/lib/python2.7/dist-packages/oil_ci/deploy/oil_deployer.py", line 129, in save_maas_install_log
    node_id)
  File "/usr/lib/python2.7/dist-packages/oil_ci/common/maas.py", line 230, in get_install_log
    decoded = b64decode(result[0]['data'])
  File "/usr/lib/python2.7/base64.py", line 78, in b64decode
    raise TypeError(msg)
TypeError: Incorrect padding
{'1': {'series': 'win2012hvr2', 'constraints': 'tags=pullman-03'}, '0': {'series': 'win2012hvr2', 'constraints': 'tags=jeannin'}, '3': {'series': 'xenial', 'constraints': 'tags=kies'}, '2': {'series': 'xenial', 'constraints': 'tags=moltres'}, '4': {'series': 'xenial', 'constraints': 'tags=ostwald'}}
++ update_build_on_error

ubuntu@maas2-production:~$ dpkg -l '*maas*'|cat
Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)
||/ Name Version Architecture Description
+++-===============================-====================================-============-=================================================
ii maas 2.2.0~beta1+bzr5675-0ubuntu1~16.04.1 all "Metal as a Service" is a physical cloud and IPAM
ii maas-cli 2.2.0~beta1+bzr5675-0ubuntu1~16.04.1 all MAAS client and command-line interface
un maas-cluster-controller <none> <none> (no description available)
ii maas-common 2.2.0~beta1+bzr5675-0ubuntu1~16.04.1 all MAAS server common files
ii maas-dhcp 2.2.0~beta1+bzr5675-0ubuntu1~16.04.1 all MAAS DHCP server
ii maas-dns 2.2.0~beta1+bzr5675-0ubuntu1~16.04.1 all MAAS DNS server
ii maas-proxy 2.2.0~beta1+bzr5675-0ubuntu1~16.04.1 all MAAS Caching Proxy
ii maas-rack-controller 2.2.0~beta1+bzr5675-0ubuntu1~16.04.1 all Rack Controller for MAAS
ii maas-region-api 2.2.0~beta1+bzr5675-0ubuntu1~16.04.1 all Region controller API service for MAAS
ii maas-region-controller 2.2.0~beta1+bzr5675-0ubuntu1~16.04.1 all Region Controller for MAAS
un maas-region-controller-min <none> <none> (no description available)
un python-django-maas <none> <none> (no description available)
un python-maas-client <none> <none> (no description available)
un python-maas-provisioningserver <none> <none> (no description available)
ii python3-django-maas 2.2.0~beta1+bzr5675-0ubuntu1~16.04.1 all MAAS server Django web framework (Python 3)
ii python3-maas-client 2.2.0~beta1+bzr5675-0ubuntu1~16.04.1 all MAAS python API client (Python 3)
ii python3-maas-provisioningserver 2.2.0~beta1+bzr5675-0ubuntu1~16.04.1 all MAAS server provisioning libraries (Python 3)

Revision history for this message
Larry Michel (lmic) wrote :
Changed in maas:
assignee: nobody → Newell Jensen (newell-jensen)
Changed in maas:
status: New → Triaged
importance: Undecided → High
importance: High → Critical
tags: removed: cdo-qa-blocker oil
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Bug attachments

Remote bug watches

Bug watches keep track of this bug in other bug trackers.