[SIE] swift_hadoop element uses hardcoded values that may not be correct for all plugins and distros

[Michael McCune]

The swift_hadoop element currently hardcodes the jar name as hadoop-swift.jar, this is not correct for all plugins and distros. For example, on the vanilla plugin the jar is actually name hadoop-openstack-<version>.jar (where version is the hadoop version).

Furthermore, the directory used (/usr/share/hadoop/lib) is not appropriate for all plugins. For example, on the vanilla plugin the true location for this jar should be /opt/hadoop-<version>/share/hadoop/common/lib (where version is the hadoop version).

This element is currently failing when added to some images, although it is only enabled for spark images, it should upgraded so that we can use this jar file in a broader range of image types. This jar file is needed to enable the proxy users functionality, as well as allowing keystone v3 access.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/226854

[Peter Nordquist (pnnl-plnordquist)]

From my experience with the CDH plugin, I know the Cluster template there has configuration to set a Swift API Jar URL. I would assume the jar at that URL is downloaded and installed during cluster provisioning. Can you make sure you take that into account when you bake the jar into the images?

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/226854
Committed: https://git.openstack.org/cgit/openstack/sahara-image-elements/commit/?id=c00560e4db2f92de3f5bfe412e71e722ce484f75
Submitter: Jenkins
Branch: master

commit c00560e4db2f92de3f5bfe412e71e722ce484f75
Author: Michael McCune <email address hidden>
Date: Wed Sep 23 11:44:16 2015 -0400

    update swift_hadoop element

    This change replaces the hardcoded value for the hadoop swift jar
    filename with a variable that defaults to the old value
    "hadoop-swift.jar" but also allows redefinition.

    * add variables for hadoop swift jar file name
    * add documentation for new variable
    * correct documentation for the lib path variable
    * add more to the basic description documentation

    Change-Id: I44eaaa8b23ae30231b7b4087740d8dd5d050ec00
    Closes-Bug: 1498967

[Doug Hellmann (doug-hellmann)]

This issue was fixed in the openstack/sahara-image-elements 4.0.0.0b1 development milestone.