Patrick Wendell created MESOS-1203:
--------------------------------------

             Summary: Shade protobuf dependency in Mesos Java library
                 Key: MESOS-1203
                 URL: https://issues.apache.org/jira/browse/MESOS-1203
             Project: Mesos
          Issue Type: Improvement
          Components: build
            Reporter: Patrick Wendell


Mesos's Java library uses the protobuf library which is also used by Hadoop. 
Unfortunately the protobuf library does not provide binary compatiblity between 
minor versions (for code compiled against 2.4.1 and 2.5.0 cannot run together 
in a single JVM classlaoder) .

This makes use of Mesos via it's Java API, something that is required for Spark 
and I'm assuming other frameworks, fundamentally incompatible for certain 
Hadoop versions.

Mesos could shade this jar using the maven shade plug-in. Take a look at the 
Parquet project for an example of shading:

https://github.com/Parquet/parquet-mr/blob/master/pom.xml#L198

Without this fix Java users won't be able to use Mesos (< 0.17) with newer 
versions of Hadoop.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to