[ 
https://issues.apache.org/jira/browse/SPARK-18262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644501#comment-15644501
 ] 

Sean Owen commented on SPARK-18262:
-----------------------------------

{{org.json:json}} is brought in from the {{hive-exec}} dependency. It isn't 
used directly by Spark, but, the releases do end up releasing a copy of this 
JAR file as a result.

I suppose that means that one ideal way forward is to wait for Hive to fix this 
dependency issue too, then publish a new {{org.spark-project}} version of it, 
and depend on that. This could take a while, and may not help older versions 
anyway.

I looked into usages of this library in Hive itself and it's referenced in only 
a handful of places, half of which are elements that Spark probably doesn't 
ever touch, like Tez support. I tried simply excluding the dependency. While I 
got test failures, I can't seem to determine whether they're related, because 
the error changes from run to run and the one semi-persistent one does not seem 
related. 

I will try to open a PR with this change as a WIP to see what Jenkins says as a 
second opinion.

> JSON.org license is now CatX
> ----------------------------
>
>                 Key: SPARK-18262
>                 URL: https://issues.apache.org/jira/browse/SPARK-18262
>             Project: Spark
>          Issue Type: Bug
>            Reporter: Sean Busbey
>            Assignee: Sean Owen
>            Priority: Blocker
>
> per [update resolved legal|http://www.apache.org/legal/resolved.html#json]:
> {quote}
> CAN APACHE PRODUCTS INCLUDE WORKS LICENSED UNDER THE JSON LICENSE?
> No. As of 2016-11-03 this has been moved to the 'Category X' license list. 
> Prior to this, use of the JSON Java library was allowed. See Debian's page 
> for a list of alternatives.
> {quote}
> I'm not actually clear if Spark is using one of the JSON.org licensed 
> libraries. As of current master (dc4c6009) the java library gets called out 
> in the [NOTICE file for our source 
> repo|https://github.com/apache/spark/blob/dc4c60098641cf64007e2f0e36378f000ad5f6b1/NOTICE#L424]
>  but:
> 1) It doesn't say where in the source
> 2) the given url is 404 (http://www.json.org/java/index.html)
> 3) It doesn't actually say in the NOTICE what license the inclusion is under
> 4) the JSON.org license for the java {{org.json:json}} artifact (what the 
> blurb in #2 is usually referring to) doesn't show up in our LICENSE file, nor 
> in the {{licenses/}} directory
> 5) I don't see a direct reference to the {{org.json:json}} artifact in our 
> poms.
> So maybe it's just coming in transitively and we can exclude it / ping 
> whoever is bringing it in?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to