Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/20037 @srowen I think we are resolving a different issue. Your PR https://github.com/apache/spark/pull/17416 is trying to resolve the issues raised by `spark-submit et al via --packages`, in which users explicitly specify the classifier. However, we still face another scenarios, the package has the external dependencies. In the dependencies, they have different classifiers. For example, [zookeeper 3.4.6](https://repo1.maven.org/maven2/org/apache/zookeeper/zookeeper/3.4.6/) has tests.jar and regular jar. In the current solution, we will download both to the same file and ivy will return an exception. ``` zookeeper-jar: {artifact=zookeeper, ext=jar, module=zookeeper, classifier=tests, organisation=org.apache.zookeeper, type=test-jar, revision=3.4.6} zookeeper-jar: {artifact=zookeeper, ext=jar, module=zookeeper, organisation=org.apache.zookeeper, type=jar, revision=3.4.6} ```
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org