Generation of MapR 5.1.0 images fails (at least on centos7 and rhel7)

Bug #1675047 reported by Luigi Toscano
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Sahara
Fix Released
Undecided
Luigi Toscano

Bug Description

Even if MapR 5.1.0 is deprecated, it is still working and can be enabled. The generation of MapR 5.1 images on CentOS7 (and RHEL7) is currently broken:

(using Ocata RDO packages, sahara-image-elements-6.0.0-1.el7.noarch):

# sahara-image-create -p mapr -r 5.1.0 -i centos7 -x

++ python /tmp/in_target.d/install.d/../resources/versions.py --separator : /tmp/in_target.d/install.d/../resources/packages.json /tmp/in_target.d/install.d/../resources/spec_5.1.0.json
+ local 'packages=mapr-flume:1.5.0
mapr-flume:1.6.0
mapr-hue:3.7.0
mapr-hue-base:3.7.0
mapr-hue-livy:3.7.0
mapr-hue:3.8.1
mapr-hue-base:3.8.1
mapr-hue-livy:3.8.1
mapr-hue:3.9.0
mapr-hue-base:3.9.0
mapr-hue-livy:3.9.0
mapr-httpfs:1.0
mapr-sqoop2-client:2.0.0
mapr-sqoop2-server:2.0.0
mapr-hive:0.13
mapr-hivemetastore:0.13
mapr-hiveserver2:0.13
mapr-hive:1.0
mapr-hivemetastore:1.0
mapr-hiveserver2:1.0
mapr-hive:1.2
mapr-hivemetastore:1.2
mapr-hiveserver2:1.2
mapr-pig:0.14
mapr-pig:0.15
mapr-mahout:0.10.0
mapr-drill:1.1.0
mapr-drill:1.2.0
mapr-drill:1.4.0
mapr-oozie:4.2.0
mapr-oozie-internal:4.2.0
mapr-hbase:0.98.9
mapr-hbase-internal:0.98.9
mapr-hbase-master:0.98.9
mapr-hbase-regionserver:0.98.9
mapr-hbasethrift:0.98.9
mapr-hbase-rest:0.98.9
mapr-hbase:0.98.12
mapr-hbase-internal:0.98.12
mapr-hbase-master:0.98.12
mapr-hbase-regionserver:0.98.12
mapr-hbasethrift:0.98.12
mapr-hbase-rest:0.98.12
mapr-impala:1.4.1
mapr-impala-catalog:1.4.1
mapr-impala-server:1.4.1
mapr-impala-statestore:1.4.1
mapr-impala-udf:1.4.1
mapr-spark:1.5.2
mapr-spark-historyserver:1.5.2
mapr-spark-master:1.5.2'
+ for package in '$packages'
+ IFS=:
+ read -ra package_version
+ download_package mapr-flume 1.5.0 /opt/mapr-repository/ecosystem centos7
+ local package=mapr-flume
+ local version=1.5.0
+ local directory=/opt/mapr-repository/ecosystem
+ local distro=centos7
+ [[ centos7 == \u\b\u\n\t\u ]]
+ [[ centos7 == \c\e\n\t\o\s ]]
+ [[ centos7 == \c\e\n\t\o\s\7 ]]
+ download_yum_package mapr-flume 1.5.0 /opt/mapr-repository/ecosystem
+ local package=mapr-flume
+ local version=1.5.0
+ local directory=/opt/mapr-repository/ecosystem
+ local 'package_spec=mapr-flume-1.5.0*'
+ yumdownloader --destdir /opt/mapr-repository/ecosystem 'mapr-flume-1.5.0*'
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
 * base: centos.syn.co.il
 * extras: centos.joinweb.co.il
 * updates: centos.joinweb.co.il
+ for package in '$packages'
+ IFS=:
+ read -ra package_version
+ download_package mapr-flume 1.6.0 /opt/mapr-repository/ecosystem centos7
+ local package=mapr-flume
+ local version=1.6.0
+ local directory=/opt/mapr-repository/ecosystem
+ local distro=centos7
+ [[ centos7 == \u\b\u\n\t\u ]]
+ [[ centos7 == \c\e\n\t\o\s ]]
+ [[ centos7 == \c\e\n\t\o\s\7 ]]
+ download_yum_package mapr-flume 1.6.0 /opt/mapr-repository/ecosystem
+ local package=mapr-flume
+ local version=1.6.0
+ local directory=/opt/mapr-repository/ecosystem
+ local 'package_spec=mapr-flume-1.6.0*'
+ yumdownloader --destdir /opt/mapr-repository/ecosystem 'mapr-flume-1.6.0*'
Loaded plugins: fastestmirror

Loading mirror speeds from cached hostfile
 * base: centos.syn.co.il
 * extras: centos.joinweb.co.il
 * updates: centos.joinweb.co.il
No Presto metadata available for mapr_ecosystem
+ for package in '$packages'
+ IFS=:
+ read -ra package_version
+ download_package mapr-hue 3.7.0 /opt/mapr-repository/ecosystem centos7
+ local package=mapr-hue
+ local version=3.7.0
+ local directory=/opt/mapr-repository/ecosystem
+ local distro=centos7
+ [[ centos7 == \u\b\u\n\t\u ]]
+ [[ centos7 == \c\e\n\t\o\s ]]
+ [[ centos7 == \c\e\n\t\o\s\7 ]]
+ download_yum_package mapr-hue 3.7.0 /opt/mapr-repository/ecosystem
+ local package=mapr-hue
+ local version=3.7.0
+ local directory=/opt/mapr-repository/ecosystem
+ local 'package_spec=mapr-hue-3.7.0*'
+ yumdownloader --destdir /opt/mapr-repository/ecosystem 'mapr-hue-3.7.0*'
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
 * base: centos.syn.co.il
 * extras: centos.joinweb.co.il
 * updates: centos.joinweb.co.il
+ for package in '$packages'
+ IFS=:
+ read -ra package_version
+ download_package mapr-hue-base 3.7.0 /opt/mapr-repository/ecosystem centos7
+ local package=mapr-hue-base
+ local version=3.7.0
+ local directory=/opt/mapr-repository/ecosystem
+ local distro=centos7
+ [[ centos7 == \u\b\u\n\t\u ]]
+ [[ centos7 == \c\e\n\t\o\s ]]
+ [[ centos7 == \c\e\n\t\o\s\7 ]]
+ download_yum_package mapr-hue-base 3.7.0 /opt/mapr-repository/ecosystem
+ local package=mapr-hue-base
+ local version=3.7.0
+ local directory=/opt/mapr-repository/ecosystem
+ local 'package_spec=mapr-hue-base-3.7.0*'
+ yumdownloader --destdir /opt/mapr-repository/ecosystem 'mapr-hue-base-3.7.0*'
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
 * base: centos.syn.co.il
 * extras: centos.joinweb.co.il
 * updates: centos.joinweb.co.il
No Match for argument mapr-hue-base-3.7.0*
Nothing to download
++ /usr/share/diskimage-builder/lib/img-functions:run_in_target:66 : check_break after-error run_in_target bash

Removing "3.7.0" from the "hue" element in elements/hadoop-mapr/resources/spec_5.1.0.json fixes the issue.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to sahara-image-elements (master)

Reviewed: https://review.openstack.org/448644
Committed: https://git.openstack.org/cgit/openstack/sahara-image-elements/commit/?id=5541a5c764496f22f66bec0e0248b61244932b4e
Submitter: Jenkins
Branch: master

commit 5541a5c764496f22f66bec0e0248b61244932b4e
Author: Luigi Toscano <email address hidden>
Date: Wed Mar 22 16:25:04 2017 +0100

    MapR 5.1: remove non-existing version of hue

    The version 3.7.0 of Hue (or better, its packages) are not available
    and the build fails on CentOS 7 and RHEL7.

    Closes-Bug: #1675047
    Change-Id: Ifd5d8c96dd62cc6def8b785c932221c4987aac62

Changed in sahara:
status: New → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to sahara-image-elements (stable/ocata)

Fix proposed to branch: stable/ocata
Review: https://review.openstack.org/454569

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/sahara-image-elements 7.0.0.0b1

This issue was fixed in the openstack/sahara-image-elements 7.0.0.0b1 development milestone.

Luigi Toscano (ltoscano)
Changed in sahara:
assignee: nobody → Luigi Toscano (ltoscano)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to sahara-image-elements (stable/ocata)

Reviewed: https://review.openstack.org/454569
Committed: https://git.openstack.org/cgit/openstack/sahara-image-elements/commit/?id=cb5d9c3915410e153001cb3a6f91256b8d4b0bba
Submitter: Jenkins
Branch: stable/ocata

commit cb5d9c3915410e153001cb3a6f91256b8d4b0bba
Author: Luigi Toscano <email address hidden>
Date: Wed Mar 22 16:25:04 2017 +0100

    MapR 5.1: remove non-existing version of hue

    The version 3.7.0 of Hue (or better, its packages) are not available
    and the build fails on CentOS 7 and RHEL7.

    Closes-Bug: #1675047
    Change-Id: Ifd5d8c96dd62cc6def8b785c932221c4987aac62
    (cherry picked from commit 5541a5c764496f22f66bec0e0248b61244932b4e)

tags: added: in-stable-ocata
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/sahara-image-elements 6.0.1

This issue was fixed in the openstack/sahara-image-elements 6.0.1 release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.