://apache-spark-user-list.1001560.n3.nabble.com/Issues-when-combining-Spark-and-a-third-party-java-library-tp21367p23770.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail: user
version for hadoop 2.4
and higher from the official website.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Issues-when-combining-Spark-and-a-third-party-java-library-tp21367p23770.html
Sent from the Apache Spark User List mailing list archive
)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
The application I launch through spark-submit can access data on hdfs tho,
and I launch the script with HADOOP_HOME being set.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Issues-when-combining-Spark
Also, it's worth noting that I'm using the prebuilt version for hadoop 2.4
and higher from the official website.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Issues-when-combining-Spark-and-a-third-party-java-library-tp21367p23770.html
Sent from
Spark
and Hadoop applications on his machine while using the same VM. (So all the
issues seems to pop up by just introducing a new dependency in the project).
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Issues-when-combining-Spark-and-a-third-party-java
Okay, I finally tried to change the Hadoop-client version from 2.4.0 to 2.5.2
and that mysteriously fixed everything..
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Issues-when-combining-Spark-and-a-third-party-java-library-tp21367p21387.html
Sent from
can do so by adding the dependencies for CDK:
dependency
groupIdorg.openscience.cdk/groupId
artifactIdcdk-fingerprint/artifactId
version1.5.10/version
/dependency
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Issues-when-combining-Spark-and-a-third
groupIdorg.openscience.cdk/groupId
artifactIdcdk-fingerprint/artifactId
version1.5.10/version
/dependency
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Issues-when-combining-Spark-and-a-third-party-java-library-tp21367.html
Sent from the Apache Spark User List mailing