Hey Sean,
I did find that after my post and tried it
spark.files.userClassPathFirst = true
But it is deemed in the docs as instrumental and did not work.
Monitored that additional config via the logs and it did not complain ... no
change though.
So...
Due to my timeline for a Demo
Did you use spark.files.userClassPathFirst = true? it's exactly for
this kind of problem.
On Fri, Jan 23, 2015 at 4:42 AM, William-Smith
wrote:
> I have had the same issue while using HttpClient from AWS EMR Spark Streaming
> to post to a nodejs server.
>
> I have found ... using
> Classloder.get
I have had the same issue while using HttpClient from AWS EMR Spark Streaming
to post to a nodejs server.
I have found ... using
Classloder.getResource('org/apache/http/client/HttpClient") that the
class
Is being loaded front the spark-assembly-1.1.0-hadoop2.4.0.jar.
That in itself is not t
Looks like the same issue as
http://mail-archives.apache.org/mod_mbox/spark-dev/201409.mbox/%3ccajob8btdxks-7-spjj5jmnw0xsnrjwdpcqqtjht1hun6j4z...@mail.gmail.com%3E
On Sep 20, 2014 11:09 AM, "tian zhang [via Apache Spark Developers List]" <
ml-node+s1001551n8481...@n3.nabble.com> wrote:
>
>
> Hi,
Hi, Spark experts,
I have the following issue when using aws java sdk in my spark application.
Here I narrowed down the following steps to reproduce the problem
1) I have Spark 1.1.0 with hadoop 2.4 installed on 3 nodes cluster
2) from the master node, I did the following steps.
spark-shell --
