Deployment with local mirror has failed on Task[glance]

[Ilya Bumarskov]

Fuel 9.2 snapshot-id #662

Scenario:
 1. Run 'fuel-mirror' to create mirror repositories
 2. Create cluster with following roles:
     - Controller
     - Compute, Cinder
 3. Run 'fuel-mirror' to replace cluster repositories
           with local mirrors
 4. Check that repositories are changed
 >>> 5. Deploy cluster <<< failed here

Observed behaviour:
Deployment has failed. All nodes are finished. Failed tasks: Task[glance/1] Stopping the deployment process!

Puppet logs:
2016-12-21 13:24:26 ERR (/Stage[main]/Glance::Api/Package[glance-api]/ensure) E: Unable to correct problems, you have held broken packages.
2016-12-21 13:24:26 ERR (/Stage[main]/Glance::Api/Package[glance-api]/ensure) glance-api : Depends: glance-common (= 2:12.0.0-4~u14.04+mos22) but it is not going to be installed

[Ivan Udovichenko (iudovichenko)]

Ilya, could you please provide more information or provide access to the env ?

Also output from below command will be very useful:
$ apt-cache policy glance-common

Provided information is not enough to debug the issue. More likely it is due to issues with repositories and not package itself.

[Ilya Bumarskov (ibumarskov)]

root@node-1:~# apt-cache policy glance-common
glance-common:
  Installed: (none)
  Candidate: 2:12.0.0-4~u14.04+mos22
  Version table:
     2:12.0.0-4~u14.04+mos22 0
       1050 http://mirror.fuel-infra.org/mos-repos/ubuntu/snapshots/9.0-2016-12-20-174323/ mos9.0-proposed/main amd64 Packages
     2:12.0.0-4~u14.04+mos12 0
       1000 http://10.109.5.2:8080/mirrors/mos-repos/ubuntu/9.0/ mos9.0-updates/main amd64 Packages
     2:12.0.0-3~u14.04+mos12 0
       1000 http://10.109.5.2:8080/mirrors/mos-repos/ubuntu/9.0/ mos9.0/main amd64 Packages

[Ivan Udovichenko (iudovichenko)]

glance-common -> python-glance -> libxml2-dev -> libicu-dev

# apt-cache policy libxml2-dev
libxml2-dev:
  Installed: (none)
  Candidate: 2.9.3+dfsg1-1~u1404+mos1
  Version table:
     2.9.3+dfsg1-1~u1404+mos1 0
       1050 http://mirror.fuel-infra.org/mos-repos/ubuntu/snapshots/9.0-2016-12-20-174323/ mos9.0-proposed/main amd64 Packages
     2.9.1+dfsg1-3ubuntu4.8 0
        500 http://10.109.5.2:8080/mirrors/ubuntu/ trusty-updates/main amd64 Packages
     2.9.1+dfsg1-3ubuntu4 0
        500 http://10.109.5.2:8080/mirrors/ubuntu/ trusty/main amd64 Packages

# apt-cache policy libicu-dev
libicu-dev:
  Installed: (none)
  Candidate: (none)
  Version table:

Looks like libicu-dev virtual package is not on local mirrors but still it exists on upstream repositories:
http://packages.ubuntu.com/trusty/libicu-dev

However its direct relation libicu52 package [1][2] is in local mirror:
# apt-cache policy libicu52
libicu52:
  Installed: 52.1-3ubuntu0.4
  Candidate: 52.1-3ubuntu0.4
  Version table:
 *** 52.1-3ubuntu0.4 0
        500 http://10.109.5.2:8080/mirrors/ubuntu/ trusty-updates/main amd64 Packages
        100 /var/lib/dpkg/status
     52.1-3 0
        500 http://10.109.5.2:8080/mirrors/ubuntu/ trusty/main amd64 Packages

[1] http://paste.openstack.org/show/593447/
[2] http://archive.ubuntu.com/ubuntu/pool/main/i/icu/icu_52.1-3ubuntu0.4.debian.tar.gz

[Ivan Udovichenko (iudovichenko)]

For some reason libicu-dev package wasn't cloned to local repository.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/415223

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/415223
Committed: https://git.openstack.org/cgit/openstack/fuel-mirror/commit/?id=7b09c67ebe2424053319a93db5614c466cfa1305
Submitter: Jenkins
Branch: stable/mitaka

commit 7b09c67ebe2424053319a93db5614c466cfa1305
Author: Vladimir Kozhukalov <email address hidden>
Date: Tue Dec 27 16:23:25 2016 +0300

    Add libicu-dev package to local mirror

    Closes-Bug: #1651761
    Change-Id: I02eb4f58d432beb53deaee687fd65bc0adf24609

[Ivan Udovichenko (iudovichenko)]

Mmerged fix works:
http://paste.openstack.org/show/593597/

[Ekaterina Shutova (eshutova)]

Verified on 9.2 snapshot #742. Deploy is finished successfully.