[ https://issues.apache.org/jira/browse/SPARK-18262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644501#comment-15644501 ]
Sean Owen commented on SPARK-18262: ----------------------------------- {{org.json:json}} is brought in from the {{hive-exec}} dependency. It isn't used directly by Spark, but, the releases do end up releasing a copy of this JAR file as a result. I suppose that means that one ideal way forward is to wait for Hive to fix this dependency issue too, then publish a new {{org.spark-project}} version of it, and depend on that. This could take a while, and may not help older versions anyway. I looked into usages of this library in Hive itself and it's referenced in only a handful of places, half of which are elements that Spark probably doesn't ever touch, like Tez support. I tried simply excluding the dependency. While I got test failures, I can't seem to determine whether they're related, because the error changes from run to run and the one semi-persistent one does not seem related. I will try to open a PR with this change as a WIP to see what Jenkins says as a second opinion. > JSON.org license is now CatX > ---------------------------- > > Key: SPARK-18262 > URL: https://issues.apache.org/jira/browse/SPARK-18262 > Project: Spark > Issue Type: Bug > Reporter: Sean Busbey > Assignee: Sean Owen > Priority: Blocker > > per [update resolved legal|http://www.apache.org/legal/resolved.html#json]: > {quote} > CAN APACHE PRODUCTS INCLUDE WORKS LICENSED UNDER THE JSON LICENSE? > No. As of 2016-11-03 this has been moved to the 'Category X' license list. > Prior to this, use of the JSON Java library was allowed. See Debian's page > for a list of alternatives. > {quote} > I'm not actually clear if Spark is using one of the JSON.org licensed > libraries. As of current master (dc4c6009) the java library gets called out > in the [NOTICE file for our source > repo|https://github.com/apache/spark/blob/dc4c60098641cf64007e2f0e36378f000ad5f6b1/NOTICE#L424] > but: > 1) It doesn't say where in the source > 2) the given url is 404 (http://www.json.org/java/index.html) > 3) It doesn't actually say in the NOTICE what license the inclusion is under > 4) the JSON.org license for the java {{org.json:json}} artifact (what the > blurb in #2 is usually referring to) doesn't show up in our LICENSE file, nor > in the {{licenses/}} directory > 5) I don't see a direct reference to the {{org.json:json}} artifact in our > poms. > So maybe it's just coming in transitively and we can exclude it / ping > whoever is bringing it in? -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org