source contains prebuilt java object

[Thomas Goirand]

Hi,

These should be fixed, otherwise Sahara is to be considered as non-free, and therefore, not fit for an upload in either Debian or Ubuntu (and almost certainly on all other distributions).

P: sahara source: source-contains-prebuilt-java-object etc/edp-examples/edp-spark/spark-example.jar
P: sahara source: source-contains-prebuilt-java-object etc/edp-examples/edp-mapreduce/edp-mapreduce.jar
P: sahara source: source-contains-prebuilt-java-object etc/edp-examples/edp-java/edp-java.jar
P: sahara source: source-contains-prebuilt-java-object sahara/service/edp/resources/edp-spark-wrapper.jar
P: sahara source: source-contains-prebuilt-java-object sahara/service/edp/resources/edp-main-wrapper.jar
P: sahara source: source-contains-prebuilt-java-object etc/edp-examples/hadoop2/edp-java/hadoop-mapreduce-examples-2.6.0.jar
P: sahara source: source-contains-prebuilt-java-object etc/edp-examples/hadoop2/edp-java/hadoop-mapreduce-examples-2.4.1.jar
P: sahara source: source-contains-prebuilt-java-object etc/edp-examples/edp-pig/trim-spaces/udf.jar
P: sahara source: source-contains-prebuilt-java-object sahara/plugins/mapr/services/swift/resources/jackson-mapper-asl-1.9.13.jar
P: sahara source: source-contains-prebuilt-java-object sahara/plugins/mapr/services/swift/resources/jackson-core-asl-1.9.13.jar
P: sahara source: source-contains-prebuilt-java-object sahara/plugins/mapr/services/swift/resources/hadoop-swift-latest.jar

More over, Sahara is installing jar files in the wrong directory:

W: python-sahara: jar-not-in-usr-share usr/lib/python2.7/dist-packages/sahara/plugins/mapr/services/swift/resources/hadoop-swift-latest.jar
W: python-sahara: jar-not-in-usr-share usr/lib/python2.7/dist-packages/sahara/plugins/mapr/services/swift/resources/jackson-core-asl-1.9.13.jar
W: python-sahara: jar-not-in-usr-share usr/lib/python2.7/dist-packages/sahara/plugins/mapr/services/swift/resources/jackson-mapper-asl-1.9.13.jar
W: python-sahara: jar-not-in-usr-share usr/lib/python2.7/dist-packages/sahara/service/edp/resources/edp-main-wrapper.jar
W: python-sahara: jar-not-in-usr-share usr/lib/python2.7/dist-packages/sahara/service/edp/resources/edp-spark-wrapper.jar

[Thomas Goirand (thomas-goirand)]

A quick update to this bug. As of today, with the Mitaka b3 release, there's still 3 non-free .jar files in the project:

$ find . -iname '*.jar'
./sahara/plugins/mapr/services/swift/resources/hadoop-swift-latest.jar
./sahara/service/edp/resources/edp-spark-wrapper.jar
./sahara/service/edp/resources/edp-main-wrapper.jar

Please get rid of them.

[Luigi Toscano (ltoscano)]

Some of the jars have been moved to sahara-tests.

[Nikita Konovalov (nkonovalov)]

The edp-* jars are build from source under Apache 2. The source code is part of sahara-extra repository which is under OpenStack organization. So why are those considered non-free?

As for the hadoop-swift-latest is also available in sahara-extra under Apache 2. It is a fork of Swift FS implementation for Hadoop which build separately.

These jars are not supposed to be installed or run on OpenStack controllers. They are put into VMs during provisioning of Hadoop clusters or on Job launches.

[Luigi Toscano (ltoscano)]

It should be possible to build the jar during the build process and have the distributed source completely free of generated binaries. This is how it works for all distributions.