RE: Re: Spark assembly in Maven repo?

2015-12-14 Thread Xiaoyong Zhu
Thanks for the info! Xiaoyong From: Sean Owen [mailto:so...@cloudera.com] Sent: Monday, December 14, 2015 12:20 AM To: Xiaoyong Zhu Cc: user Subject: Re: Re: Spark assembly in Maven repo? Yes, though I think the Maven Central repository is more canonical. http://repo1.maven.org/maven2/org

Re: Re: Spark assembly in Maven repo?

2015-12-14 Thread Sean Owen
> > https://repository.apache.org/content/repositories/releases/org/apache/spark/spark-core_2.10/1.5.1/ > > > > Xiaoyong > > > > *From:* Sean Owen [mailto:so...@cloudera.com] > *Sent:* Saturday, December 12, 2015 12:45 AM > *To:* Xiaoyong Zhu > *Cc:* user >

RE: Re: Spark assembly in Maven repo?

2015-12-13 Thread Xiaoyong Zhu
: user Subject: Re: Re: Spark assembly in Maven repo? That's exactly what the various artifacts in the Maven repo are for. The API classes for core are in the core artifact and so on. You don't need an assembly. On Sat, Dec 12, 2015 at 12:32 AM, Xiaoyong Zhu mailto:xiaoy...@microsoft.c

Re: Re: Spark assembly in Maven repo?

2015-12-12 Thread Sean Owen
* Mark Hamstra > *Cc:* Xiaoyong Zhu ; Jeff Zhang ; > user ; Zhaomin Xu ; Joe Zhang > (SDE) > *Subject:* Re: Re: Spark assembly in Maven repo? > > > > Agree with you that assembly jar is not good to publish. However, what he > really need is to fetch > > an up

RE: Re: Spark assembly in Maven repo?

2015-12-11 Thread Xiaoyong Zhu
To: Mark Hamstra Cc: Xiaoyong Zhu ; Jeff Zhang ; user ; Zhaomin Xu ; Joe Zhang (SDE) Subject: Re: Re: Spark assembly in Maven repo? Agree with you that assembly jar is not good to publish. However, what he really need is to fetch an updatable maven jar file

Re: Re: Spark assembly in Maven repo?

2015-12-11 Thread fightf...@163.com
: Spark assembly in Maven repo? No, publishing a spark assembly jar is not fine. See the doc attached to https://issues.apache.org/jira/browse/SPARK-11157 and be aware that a likely goal of Spark 2.0 will be the elimination of assemblies. On Thu, Dec 10, 2015 at 11:19 PM, fightf...@163.com wrote

Re: RE: Spark assembly in Maven repo?

2015-12-10 Thread Mark Hamstra
No, publishing a spark assembly jar is not fine. See the doc attached to https://issues.apache.org/jira/browse/SPARK-11157 and be aware that a likely goal of Spark 2.0 will be the elimination of assemblies. On Thu, Dec 10, 2015 at 11:19 PM, fightf...@163.com wrote: > Using maven to download the

Re: RE: Spark assembly in Maven repo?

2015-12-10 Thread fightf...@163.com
Using maven to download the assembly jar is fine. I would recommend to deploy this assembly jar to your local maven repo, i.e. nexus repo, Or more likey a snapshot repository fightf...@163.com From: Xiaoyong Zhu Date: 2015-12-11 15:10 To: Jeff Zhang CC: user@spark.apache.org; Zhaomin Xu; Jo