Embedded hadoop-swift connector in mapr plugin code

[Luigi Toscano]

The MapR plugin contains a copy of the hadoop/swift connector:

./sahara/plugins/mapr/services/swift/resources/hadoop-swift-latest.jar

It looks like the file is installed (see sahara/plugins/mapr/services/swift/swift.py) when not available on the guest image (plain image?).
On the other side, other plugins download similar resources on the fly (example: sahara/plugins/cdh/plugin_utils.py AbstractPluginUtils._configure_swift_to_inst()).

Having the file in sahara means keeping another copy that could go quickly out of sync with the other versions used elsewhere.

I think that the file, if not found already on the image, should be handled as it happens for for the other resources not found on the image.

This is partially related to https://bugs.launchpad.net/sahara/+bug/1458853

[Luigi Toscano (ltoscano)]

Moreover, hadoop-swift-latest.jar seems to be a copy of http://sahara-files.mirantis.com/hadoop-swift/hadoop-openstack-latest.jar (see http://docs.openstack.org/developer/sahara/userdoc/hadoop-swift.html ) and probably older, see the zipcmp output:

$ zipcmp hadoop-swift-latest.jar hadoop-openstack-latest.jar
--- hadoop-swift-latest.jar
+++ hadoop-openstack-latest.jar
+ 125 7106ddc1 META-INF/MANIFEST.MF
- 125 c9369f0c META-INF/MANIFEST.MF
+ 127 fe203252 META-INF/maven/org.apache.hadoop/hadoop-openstack/pom.properties
- 127 6c68ef74 META-INF/maven/org.apache.hadoop/hadoop-openstack/pom.properties
- 4968 d1f3eeae META-INF/maven/org.apache.hadoop/hadoop-openstack/pom.xml
+ 5664 52f60749 META-INF/maven/org.apache.hadoop/hadoop-openstack/pom.xml
- 1410 1123abd1 org/apache/hadoop/fs/swift/auth/ApiKeyAuthenticationRequest.class
+ 1412 80f6a390 org/apache/hadoop/fs/swift/auth/ApiKeyAuthenticationRequest.class
+ 476 a8949d20 org/apache/hadoop/fs/swift/auth/AuthenticationRequest.class
- 916 8707ccad org/apache/hadoop/fs/swift/auth/AuthenticationRequest.class
+ 961 4116a374 org/apache/hadoop/fs/swift/auth/AuthenticationRequestV2.class
+ 399 a0df9396 org/apache/hadoop/fs/swift/auth/AuthenticationRequestV3.class
+ 1658 0d506311 org/apache/hadoop/fs/swift/auth/AuthenticationResponseV3.class
+ 731 29972d4b org/apache/hadoop/fs/swift/auth/AuthenticationWrapperV3.class
- 1330 4f9f1993 org/apache/hadoop/fs/swift/auth/KeyStoneAuthRequest.class
+ 1332 4e7fcba9 org/apache/hadoop/fs/swift/auth/KeyStoneAuthRequest.class
- 1308 3225959b org/apache/hadoop/fs/swift/auth/PasswordAuthenticationRequest.class
+ 1310 71ade6ae org/apache/hadoop/fs/swift/auth/PasswordAuthenticationRequest.class
+ 1217 c9fc9fd7 org/apache/hadoop/fs/swift/auth/PasswordAuthenticationRequestV3$IdentityWrapper.class
+ 830 6e7cc684 org/apache/hadoop/fs/swift/auth/PasswordAuthenticationRequestV3$PasswordWrapper.class
+ 1172 4b72ff0c org/apache/hadoop/fs/swift/auth/PasswordAuthenticationRequestV3$ProjectWrapper.class
+ 1761 9042bced org/apache/hadoop/fs/swift/auth/PasswordAuthenticationRequestV3$ScopeWrapper.class
+ 716 98aa8711 org/apache/hadoop/fs/swift/auth/PasswordAuthenticationRequestV3$TrustWrapper.class
+ 3128 5787e906 org/apache/hadoop/fs/swift/auth/PasswordAuthenticationRequestV3.class
+ 2047 94e9a383 org/apache/hadoop/fs/swift/auth/PasswordCredentialsV3.class
+ 1172 3175c304 org/apache/hadoop/fs/swift/auth/TokenAuthenticationRequestV3$IdentityWrapper.class
+ 697 92f4b9ea org/apache/hadoop/fs/swift/auth/TokenAuthenticationRequestV3$TokenWrapper.class
+ 1228 23af1baa org/apache/hadoop/fs/swift/auth/TokenAuthenticationRequestV3.class
+ 1652 be524989 org/apache/hadoop/fs/swift/auth/TrustAuthenticationRequest.class
+ 1452 2b85b7c4 org/apache/hadoop/fs/swift/auth/entities/CatalogV3.class
+ 1318 d5ebacdd org/apache/hadoop/fs/swift/auth/entities/EndpointV3.class
- 2475 9f52db00 org/apache/hadoop/fs/swift/exceptions/SwiftInvalidResponseException.class
+ 2485 d31db695 org/apache/hadoop/fs/swif...