Re: Why is the Spark Web GUI failing with JavaScript "Uncaught SyntaxError"?

nthrax.net> > wrote: > >> Thanks for the update Joshua. >> >> Let me try with Spark 1.4.1. >> >> I keep you posted. >> >> Regards >> JB >> >> On 10/13/2015 04:17 PM, Joshua Fox wrote: >> >>> * Spark 1.4.1, part of

Why is the Spark Web GUI failing with JavaScript "Uncaught SyntaxError"?

I am accessing the Spark Jobs Web GUI, running on AWS EMR. I can access this webapp (port 4040 as per default), but it only half-renders, producing "Uncaught SyntaxError: Unexpected token <" Here is a screenshot including Chrome Developer Console. [image:

Re: Why is the Spark Web GUI failing with JavaScript "Uncaught SyntaxError"?

SNAPSHOT with firefox and it works fine. > > Thanks > Regards > JB > > On 10/13/2015 02:17 PM, Joshua Fox wrote: > >> I am accessing the Spark Jobs Web GUI, running on AWS EMR. >> >> I can access this webapp (port 4040 as per default), but it only >&g

Legacy Python code

I managed to put together a first Spark application on top of my existing codebase. But I am still puzzled by the best way to deploy legacy Python code. Can't I just put my codebase in some directory on the slave machines? Existing solutions: 1. Rewrite everything in terms of Spark

Re: Why are executors on slave never used?

Thank you Hemant and Andrew, I got it working. On Mon, Sep 21, 2015 at 11:48 PM, Andrew Or wrote: > Hi Joshua, > > What cluster manager are you using, standalone or YARN? (Note that > standalone here does not mean local mode). > > If standalone, you need to do

Why are executors on slave never used?

I have a default AWS EMR cluster (1 master, 1 slave) with Spark. When I run a Spark process, it works fine -- but only on the master, as if it were standalone. The web-UI and logging code shows only 1 executor, the localhost. How can I diagnose this? (I create *SparkConf, *in Python, with