[ https://issues.apache.org/jira/browse/SPARK-27044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16787762#comment-16787762 ]
Jungtaek Lim edited comment on SPARK-27044 at 3/8/19 10:39 AM: --------------------------------------------------------------- It's like "hive-exec" with default classifier vs "core" classifier. Former includes all transitive dependencies (without relocating) whereas latter just have itself and let Maven deal with transitive dependencies. I've some experience regarding this: if no one minds I would like to work on this. [~gsomogyi] Are you OK with this? It's perfectly OK if you already took a step on this. was (Author: kabhwan): It's like "hive-exec" with default classifier vs "core" classifier. Former includes all transitive dependencies (without relocating) whereas latter just have itself and let Maven deal with transitive dependencies. I've some experience regarding this: if no one minds I would like to work on this. [~gsomogyi] Are you OK with this? Or did you already take a step on this? > Maven dependency resolution does not support classifiers > -------------------------------------------------------- > > Key: SPARK-27044 > URL: https://issues.apache.org/jira/browse/SPARK-27044 > Project: Spark > Issue Type: Bug > Components: Spark Submit > Affects Versions: 2.4.0 > Reporter: Mathias Herberts > Priority: Major > > The spark-submit --packages option allows dependencies to be specified using > the maven syntax group:artifact:version, but it does not support specifying a > classifier as group:artifact:version:classifier > This makes it impossible to fetch 'uber' versions of packages for example as > they are usually specified using a classifier. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org