Message
Subject: Re: spark 1.3.1 jars in repo1.maven.org Date: 2015-05-20 00:38
From: Sean Owen so...@cloudera.com To: Edward Sargisson
esa...@pobox.com Cc: user user@spark.apache.org
Yes, the published artifacts can only refer to one version of anything
(OK, modulo publishing a large
in the classloader from Spark and don't clash with
existing libraries we have.
More anon,
Cheers,
Edward
Original Message
Subject: Re: spark 1.3.1 jars in repo1.maven.org Date: 2015-05-20
00:38 From: Sean Owen so...@cloudera.com To: Edward Sargisson
esa...@pobox.com Cc: user
libraries are available in the classloader from Spark and don't clash with
existing libraries we have.
More anon,
Cheers,
Edward
Original Message
Subject: Re: spark 1.3.1 jars in repo1.maven.org Date: 2015-05-20
00:38 From: Sean Owen so...@cloudera.com To: Edward
: spark 1.3.1 jars in repo1.maven.org Date: 2015-05-20 00:38
From: Sean Owen so...@cloudera.com To: Edward Sargisson
esa...@pobox.com Cc: user user@spark.apache.org
Yes, the published artifacts can only refer to one version of anything
(OK, modulo publishing a large number of variants under
Yes, the published artifacts can only refer to one version of anything
(OK, modulo publishing a large number of variants under classifiers).
You aren't intended to rely on Spark's transitive dependencies for
anything. Compiling against the Spark API has no relation to what
version of Hadoop it
.
More anon,
Cheers,
Edward
Original Message
Subject: Re: spark 1.3.1 jars in repo1.maven.org Date: 2015-05-20 00:38
From: Sean Owen so...@cloudera.com To: Edward Sargisson
esa...@pobox.com Cc: user user@spark.apache.org
Yes, the published artifacts can only refer
libraries are available in the classloader from Spark and don't clash with
existing libraries we have.
More anon,
Cheers,
Edward
Original Message
Subject: Re: spark 1.3.1 jars in repo1.maven.org Date: 2015-05-20 00:38
From: Sean Owen so...@cloudera.com To: Edward Sargisson esa
I think your observation is correct.
e.g.
http://mvnrepository.com/artifact/org.apache.spark/spark-core_2.10/1.3.1
shows that it depends on hadoop-client
http://mvnrepository.com/artifact/org.apache.hadoop/hadoop-client from
hadoop 2.2
Cheers
On Tue, May 19, 2015 at 6:17 PM, Edward Sargisson