MU installation using "fuel2 update" failed due to Failed tasks: Task[pkg_upgrade/1], Task[pkg_upgrade/3], Task[pkg_upgrade/2], Task[pkg_upgrade/4], Task[pkg_upgrade/5]

[Artem Hrechanychenko]

Detailed bug description:
 MU installation using "fuel2 update" failed due to Failed tasks: Task[pkg_upgrade/1], Task[pkg_upgrade/3], Task[pkg_upgrade/2], Task[pkg_upgrade/4], Task[pkg_upgrade/5]

Steps to reproduce:
1) Deploy any 9.0 cluster
2) configure additional yum repo:http://mirror.fuel-infra.org/mos-repos/centos/mos9.0-centos7/snapshots/proposed-2016-09-01-170324/x86_64/
3)yum -y update fuel-nailgun fuel-utils python-fuelclient rubygem-astute
  bash /usr/share/fuel-utils/update-master-node.sh
4) yum install -y python-cudet
5) apply fix https://review.fuel-infra.org/#/c/25620/
6) add additional deb repo to cluster "deb http://mirror.fuel-infra.org/mos-repos/ubuntu/snapshots/9.0-2016-09-01-164323/ mos9.0-proposed main restricted" with prio = 1200
7) fuel2 update --env 1 install --restart-rabbitmq --restart-mysql

Expected results:
MU successfully installed by deployment task

Actual results:
(/Stage[main]/Osnailyfacter::Upgrade::Pkg_upgrade/Exec[do_upgrade]/returns) change from notrun to 0 failed: apt-get dist-upgrade -y -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" returned 100 instead of one of [0]

WARNING: The following packages cannot be authenticated!

E: There are problems and -y was used without --force-yes

/etc/apt/apt.conf.d/02allow-unathenticated:

APT::Get::AllowUnauthenticated 0;

[Artem Hrechanychenko (agrechanichenko)]

https://drive.google.com/a/mirantis.com/file/d/0B6hV1ZImNDRVQ0E1N08xalllVkU/view?usp=sharing

[Artem Hrechanychenko (agrechanichenko)]

root@node-1:~# apt-get dist-upgrade -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold"
Reading package lists... Done
Building dependency tree
Reading state information... Done
Calculating upgrade... Done
The following packages were automatically installed and are no longer required:
  cloud-guest-utils eatmydata python-cheetah python-oauth python-serial
  python3-pycurl python3-software-properties software-properties-common
  unattended-upgrades
Use 'apt-get autoremove' to remove them.
The following NEW packages will be installed:
  liblua5.3-0 linux-headers-3.13.0-95 linux-headers-3.13.0-95-generic
  linux-image-3.13.0-95-generic linux-image-extra-3.13.0-95-generic
The following packages will be upgraded:
  cinder-api cinder-common cinder-scheduler corosync fuel-ha-utils fuel-misc
  fuel-rabbit-fence fuel-umm glance-api glance-common glance-glare
  glance-registry haproxy heat-api heat-api-cfn heat-api-cloudwatch
  heat-common heat-docker heat-engine horizon-vendor-theme i40e-dkms keystone
  libcfg6 libcmap4 libcorosync-common4 libcpg4 libquorum5 libsam4 libtotem-pg5
  libvotequorum7 linux-headers-generic linux-headers-generic-lts-trusty
  linux-image-generic linux-image-generic-lts-trusty linux-libc-dev
  murano-glance-artifacts-plugin mysql-client-5.6 mysql-client-core-5.6
  mysql-server-wsrep-5.6 mysql-server-wsrep-core-5.6 mysql-wsrep-common-5.6
  nailgun-mcagents neutron-common neutron-dhcp-agent neutron-l3-agent
  neutron-metadata-agent neutron-openvswitch-agent neutron-server nova-api
  nova-cert nova-common nova-conductor nova-consoleauth nova-consoleproxy
  nova-scheduler ntp ntpdate openstack-dashboard openstack-dashboard-apache
  os-brick-common python-cinder python-cinderclient python-django-horizon
  python-glance python-heat python-keystone python-neutron python-neutron-lib
  python-neutronclient python-nova python-openstackclient python-os-brick
  python-oslo.concurrency python-oslo.db python-oslo.log python-oslo.messaging
  python-oslo.service python-oslo.versionedobjects python-oslo.vmware
  python-saharaclient rabbitmq-server
81 upgraded, 5 newly installed, 0 to remove and 0 not upgraded.
Need to get 2,752 kB/124 MB of archives.
After this operation, 416 MB of additional disk space will be used.
WARNING: The following packages cannot be authenticated!
  liblua5.3-0 mysql-client-core-5.6 mysql-client-5.6 mysql-server-wsrep-5.6
  mysql-server-wsrep-core-5.6 python-cinderclient python-neutronclient
  python-openstackclient neutron-server neutron-metadata-agent
  neutron-l3-agent neutron-dhcp-agent python-neutron neutron-openvswitch-agent
  neutron-common python-oslo.db python-oslo.log python-oslo.concurrency
  python-oslo.service python-oslo.messaging python-neutron-lib
  python-oslo.versionedobjects ntp ntpdate corosync libcorosync-common4
  libcfg6 libcmap4 libcpg4 libquorum5 libsam4 libtotem-pg5 libvotequorum7
  fuel-ha-utils fuel-misc rabbitmq-server fuel-rabbit-fence fuel-umm haproxy
  heat-docker heat-engine heat-api-cloudwatch heat-api-cfn python-saharaclient
  heat-api heat-common python-heat openstack-dashboard python-django-horizon
  horizon-vendor-theme i40e-dkms mysql-w...

[Artem Hrechanychenko (agrechanichenko)]

after apt-get update on node - apt-get dist-upgrade -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" works fine

[Ivan Berezovskiy (iberezovskiy)]

The problem is that new MOS packages can't be authenticated:

WARNING: The following packages cannot be authenticated!
  liblua5.3-0 mysql-client-core-5.6 mysql-client-5.6 mysql-server-wsrep-5.6
  mysql-server-wsrep-core-5.6 python-cinderclient python-neutronclient
  python-openstackclient neutron-server neutron-metadata-agent
  neutron-l3-agent neutron-dhcp-agent python-neutron neutron-openvswitch-agent
  neutron-common python-oslo.db python-oslo.log python-oslo.concurrency
  python-oslo.service python-oslo.messaging python-neutron-lib
  python-oslo.versionedobjects ntp ntpdate corosync libcorosync-common4
  libcfg6 libcmap4 libcpg4 libquorum5 libsam4 libtotem-pg5 libvotequorum7
  fuel-ha-utils fuel-misc rabbitmq-server fuel-rabbit-fence fuel-umm haproxy
  heat-docker heat-engine heat-api-cloudwatch heat-api-cfn python-saharaclient
  heat-api heat-common python-heat openstack-dashboard python-django-horizon
  horizon-vendor-theme i40e-dkms mysql-wsrep-common-5.6 nailgun-mcagents
  python-os-brick os-brick-common python-oslo.vmware cinder-scheduler
  cinder-api cinder-common python-cinder glance-registry glance-glare
  glance-api glance-common python-glance keystone python-keystone
  murano-glance-artifacts-plugin nova-scheduler nova-consoleproxy
  nova-consoleauth nova-conductor nova-cert nova-api nova-common python-nova
  openstack-dashboard-apache

I think we have problem with incorrect repository

[Ivan Berezovskiy (iberezovskiy)]

Fuel denies installation of unauthenticated packages by default:

root@node-1:~# cat /etc/apt/apt.conf.d/02allow-unathenticated
// This file is managed by Puppet. DO NOT EDIT.
APT::Get::AllowUnauthenticated 0;

[Dmitry Burmistrov (dburmistrov)]

Packages nova and fuel-library were updated during test. Just rerun the test. Make sure there are no new changes will be merged into 9.0-proposed

[Artem Hrechanychenko (agrechanichenko)]

There is another issue, decription was updated

[Roman Vyalov (r0mikiam)]

The related bug is https://bugs.launchpad.net/fuel/+bug/1594699

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/365221

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/365222

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/365222
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=124f810e12304831f9ebdee6c1e179d167dd4676
Submitter: Jenkins
Branch: stable/mitaka

commit 124f810e12304831f9ebdee6c1e179d167dd4676
Author: Maksim Malchuk <email address hidden>
Date: Sat Sep 3 10:40:09 2016 +0300

    Allow Unauthenticated packages during Upgrade

    Change-Id: I7f2143bbe9f9ab8097145a0063f4cef7cb4cfa54
    Closes-Bug: #1618746
    Signed-off-by: Maksim Malchuk <email address hidden>

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/365221
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=ce0fa83a540dae81c8742142b4df98f90ed2f521
Submitter: Jenkins
Branch: master

commit ce0fa83a540dae81c8742142b4df98f90ed2f521
Author: Maksim Malchuk <email address hidden>
Date: Sat Sep 3 10:40:09 2016 +0300

    Allow Unauthenticated packages during Upgrade

    Change-Id: I7f2143bbe9f9ab8097145a0063f4cef7cb4cfa54
    Closes-Bug: #1618746
    Signed-off-by: Maksim Malchuk <email address hidden>

[TatyanaGladysheva (tgladysheva)]

Verified on 9.1 snapshot #234.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/fuel-library 10.0.0rc1 release candidate.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/fuel-library 10.0.0 release.