Github user gatorsmile commented on the issue:

    https://github.com/apache/spark/pull/20037
  
    @srowen I think we are resolving a different issue. Your PR 
https://github.com/apache/spark/pull/17416 is trying to resolve the issues 
raised by `spark-submit et al via --packages`, in which users explicitly 
specify the classifier. 
    
    However, we still face another scenarios, the package has the external 
dependencies. In the dependencies, they have different classifiers. For 
example, [zookeeper 
3.4.6](https://repo1.maven.org/maven2/org/apache/zookeeper/zookeeper/3.4.6/) 
has tests.jar and regular jar. In the current solution, we will download both 
to the same file and ivy will return an exception. 
    ```
    zookeeper-jar: {artifact=zookeeper, ext=jar, module=zookeeper, 
classifier=tests, organisation=org.apache.zookeeper, type=test-jar, 
revision=3.4.6}
    zookeeper-jar: {artifact=zookeeper, ext=jar, module=zookeeper, 
organisation=org.apache.zookeeper, type=jar, revision=3.4.6}
    ```



---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

Reply via email to