file.
Thanks
Best Regards
On Fri, May 1, 2015 at 2:43 PM, Michael Ryabtsev (Totango)
mich...@totango.com wrote:
Hi everyone,
I have a spark application that works fine on a standalone Spark cluster
that runs on my laptop
(master and one worker), but fails when I try to run
Hi,
We've had a similar problem, but with log4j properties file.
The only working way we've found, was externally deploying the properties
file on the worker machine to the spark conf folder and configuring the
executor jvm options with:
sparkConf.set(spark.executor.extraJavaOptions,
Hi everyone,
I have a spark application that works fine on a standalone Spark cluster
that runs on my laptop
(master and one worker), but fails when I try to run in on a standalone
Spark cluster
deployed on EC2 (master and worker are on different machines).
The application structure goes in the
automatically
without you copying them manually.
Lan
On Apr 20, 2015, at 9:26 AM, Michael Ryabtsev michael...@gmail.com
wrote:
Hi all,
I need to configure spark executor log4j.properties on a standalone
cluster.
It looks like placing the relevant properties file in the spark
configuration
Hi all,
I need to configure spark executor log4j.properties on a standalone cluster.
It looks like placing the relevant properties file in the spark
configuration folder and setting the spark.executor.extraJavaOptions from
my application code:
sparkConf.set(spark.executor.extraJavaOptions,
log4j_special.properties … ,which
should transfer your log4j property file to the worker nodes automatically
without you copying them manually.
Lan
On Apr 20, 2015, at 9:26 AM, Michael Ryabtsev michael...@gmail.com
wrote:
Hi all,
I need to configure spark executor log4j.properties on a standalone
Oh, you are right, thanks.
On Mon, Apr 20, 2015 at 6:31 PM, Lan Jiang ljia...@gmail.com wrote:
Each application gets its own executor processes, so there should be no
problem running them in parallel.
Lan
On Apr 20, 2015, at 10:25 AM, Michael Ryabtsev michael...@gmail.com
wrote:
Hi
