[jira] [Commented] (SPARK-27044) Maven dependency resolution does not support classifiers
[ https://issues.apache.org/jira/browse/SPARK-27044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16787834#comment-16787834 ] Gabor Somogyi commented on SPARK-27044: --- Thanks [~herberts] rebuilt shaded jar was my main use-case as well. Proceeding... > Maven dependency resolution does not support classifiers > > > Key: SPARK-27044 > URL: https://issues.apache.org/jira/browse/SPARK-27044 > Project: Spark > Issue Type: Bug > Components: Spark Submit >Affects Versions: 2.4.0 >Reporter: Mathias Herberts >Priority: Major > > The spark-submit --packages option allows dependencies to be specified using > the maven syntax group:artifact:version, but it does not support specifying a > classifier as group:artifact:version:classifier > This makes it impossible to fetch 'uber' versions of packages for example as > they are usually specified using a classifier. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-27044) Maven dependency resolution does not support classifiers
[ https://issues.apache.org/jira/browse/SPARK-27044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16787788#comment-16787788 ] Mathias Herberts commented on SPARK-27044: -- This is exactly what Jungtaek said, the ability to specify packages which have the non default classifier to fetch specific jars such as shaded/uber jars which is the most common use case. > Maven dependency resolution does not support classifiers > > > Key: SPARK-27044 > URL: https://issues.apache.org/jira/browse/SPARK-27044 > Project: Spark > Issue Type: Bug > Components: Spark Submit >Affects Versions: 2.4.0 >Reporter: Mathias Herberts >Priority: Major > > The spark-submit --packages option allows dependencies to be specified using > the maven syntax group:artifact:version, but it does not support specifying a > classifier as group:artifact:version:classifier > This makes it impossible to fetch 'uber' versions of packages for example as > they are usually specified using a classifier. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-27044) Maven dependency resolution does not support classifiers
[ https://issues.apache.org/jira/browse/SPARK-27044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16787784#comment-16787784 ] Gabor Somogyi commented on SPARK-27044: --- I've already started but wanted to double check things from usage perspective. > Maven dependency resolution does not support classifiers > > > Key: SPARK-27044 > URL: https://issues.apache.org/jira/browse/SPARK-27044 > Project: Spark > Issue Type: Bug > Components: Spark Submit >Affects Versions: 2.4.0 >Reporter: Mathias Herberts >Priority: Major > > The spark-submit --packages option allows dependencies to be specified using > the maven syntax group:artifact:version, but it does not support specifying a > classifier as group:artifact:version:classifier > This makes it impossible to fetch 'uber' versions of packages for example as > they are usually specified using a classifier. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-27044) Maven dependency resolution does not support classifiers
[ https://issues.apache.org/jira/browse/SPARK-27044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16787762#comment-16787762 ] Jungtaek Lim commented on SPARK-27044: -- It's like "hive-exec" with default classifier vs "core" classifier. Former includes all transitive dependencies (without relocating) whereas latter just have itself and let Maven deal with transitive dependencies. I've some experience regarding this: if no one minds I would like to work on this. [~gsomogyi] Are you OK with this? Or did you already take a step on this? > Maven dependency resolution does not support classifiers > > > Key: SPARK-27044 > URL: https://issues.apache.org/jira/browse/SPARK-27044 > Project: Spark > Issue Type: Bug > Components: Spark Submit >Affects Versions: 2.4.0 >Reporter: Mathias Herberts >Priority: Major > > The spark-submit --packages option allows dependencies to be specified using > the maven syntax group:artifact:version, but it does not support specifying a > classifier as group:artifact:version:classifier > This makes it impossible to fetch 'uber' versions of packages for example as > they are usually specified using a classifier. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-27044) Maven dependency resolution does not support classifiers
[
https://issues.apache.org/jira/browse/SPARK-27044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16787754#comment-16787754
]
Gabor Somogyi commented on SPARK-27044:
---
[~herberts] Could you give an example of {quote}fetch 'uber' versions of
packages{quote}?
> Maven dependency resolution does not support classifiers
>
>
> Key: SPARK-27044
> URL: https://issues.apache.org/jira/browse/SPARK-27044
> Project: Spark
> Issue Type: Bug
> Components: Spark Submit
>Affects Versions: 2.4.0
>Reporter: Mathias Herberts
>Priority: Major
>
> The spark-submit --packages option allows dependencies to be specified using
> the maven syntax group:artifact:version, but it does not support specifying a
> classifier as group:artifact:version:classifier
> This makes it impossible to fetch 'uber' versions of packages for example as
> they are usually specified using a classifier.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
