Generation of MapR 5.2.0 images fails on Ubuntu (wrong mapping of packages)

[Luigi Toscano]

The review https://review.openstack.org/#/c/207865/ changed the logic of _get_packages inside
elements/hadoop-mapr/resources/versions.py
so now the "all" mapping entry is always considered if found, instead of being skipped and used as fallback as before.

This means that for example that, depending on the order of analysis of the dictionary with the versions, it can happen that a package from "all" is used even if a specific version is specified. In the following excerpt, mapr-hue-base does not exist for 3.10.0:

2017-04-12 12:58:30.105876 | ++ python /tmp/in_target.d/install.d/../resources/versions.py --separator : /tmp/in_target.d/install.d/../resources/packages.json /tmp/in_target.d/install.d/../resources/spec_5.2.0_ubuntu.json
2017-04-12 12:58:30.132725 | + local 'packages=mapr-flume:1.6.0
2017-04-12 12:58:30.132768 | mapr-hive:1.2
2017-04-12 12:58:30.132789 | mapr-hivemetastore:1.2
2017-04-12 12:58:30.132807 | mapr-hiveserver2:1.2
2017-04-12 12:58:30.132828 | mapr-kafka-connect-hdfs:2.0.1
2017-04-12 12:58:30.132847 | mapr-kafka-connect-jdbc:2.0.1
2017-04-12 12:58:30.132865 | mapr-kafka-rest:2.0.1
2017-04-12 12:58:30.132925 | mapr-hue:3.10.0
2017-04-12 12:58:30.132946 | mapr-hue-base:3.10.0
2017-04-12 12:58:30.132964 | mapr-hue-livy:3.10.0
2017-04-12 12:58:30.132980 | mapr-drill:1.9.0
2017-04-12 12:58:30.132996 | mapr-pig:0.16
2017-04-12 12:58:30.133013 | mapr-mahout:0.12.0
2017-04-12 12:58:30.133029 | mapr-oozie:4.2.0
2017-04-12 12:58:30.133048 | mapr-oozie-internal:4.2.0
2017-04-12 12:58:30.133065 | mapr-spark:2.0.1
2017-04-12 12:58:30.133085 | mapr-spark-historyserver:2.0.1
2017-04-12 12:58:30.133103 | mapr-spark-master:2.0.1
2017-04-12 12:58:30.133119 | mapr-sentry:1.6.0
2017-04-12 12:58:30.133136 | mapr-httpfs:1.0
2017-04-12 12:58:30.133152 | mapr-kafka:0.9.0
2017-04-12 12:58:30.133168 | mapr-hbase:1.1.1
2017-04-12 12:58:30.133187 | mapr-hbase-internal:1.1.1
2017-04-12 12:58:30.133205 | mapr-hbase-master:1.1.1
2017-04-12 12:58:30.133225 | mapr-hbase-regionserver:1.1.1
2017-04-12 12:58:30.133243 | mapr-hbasethrift:1.1.1
2017-04-12 12:58:30.133260 | mapr-libhbase:1.1.1
2017-04-12 12:58:30.133277 | mapr-hbase-rest:1.1.1
2017-04-12 12:58:30.133296 | mapr-sqoop2-client:2.0.0
2017-04-12 12:58:30.133314 | mapr-sqoop2-server:2.0.0'

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/460006
Committed: https://git.openstack.org/cgit/openstack/sahara-image-elements/commit/?id=8ec0c00ae03b88741ea3a6669fb77d1c91795258
Submitter: Jenkins
Branch: master

commit 8ec0c00ae03b88741ea3a6669fb77d1c91795258
Author: Luigi Toscano <email address hidden>
Date: Wed Apr 26 10:44:01 2017 +0200

    MapR: do not match "all" if a specific version is available

    The "all" entry is a fallback if an entry/override for a specific
    version has not been specified.

    Change-Id: I5e57a00023cddaed691a2c701dc2e7fbd4726fe4
    Closes-Bug: #1686343

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/ocata
Review: https://review.openstack.org/460133

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/460133
Committed: https://git.openstack.org/cgit/openstack/sahara-image-elements/commit/?id=ea8c3030376bae28ce287d046832d2ef837cb269
Submitter: Jenkins
Branch: stable/ocata

commit ea8c3030376bae28ce287d046832d2ef837cb269
Author: Luigi Toscano <email address hidden>
Date: Wed Apr 26 10:44:01 2017 +0200

    MapR: do not match "all" if a specific version is available

    The "all" entry is a fallback if an entry/override for a specific
    version has not been specified.

    Change-Id: I5e57a00023cddaed691a2c701dc2e7fbd4726fe4
    Closes-Bug: #1686343
    (cherry picked from commit 8ec0c00ae03b88741ea3a6669fb77d1c91795258)

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/sahara-image-elements 7.0.0.0b2 development milestone.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/sahara-image-elements 6.0.1 release.