Thank you Hemant and Andrew, I got it working.
On Mon, Sep 21, 2015 at 11:48 PM, Andrew Or wrote:
> Hi Joshua,
>
> What cluster manager are you using, standalone or YARN? (Note that
> standalone here does not mean local mode).
>
> If standalone, you need to do
When you specify master as local[2], it starts the spark components in a
single jvm. You need to specify the master correctly.
I have a default AWS EMR cluster (1 master, 1 slave) with Spark. When I run
a Spark process, it works fine -- but only on the master, as if it were
standalone.
The web-UI
Hi Joshua,
What cluster manager are you using, standalone or YARN? (Note that
standalone here does not mean local mode).
If standalone, you need to do `setMaster("spark://[CLUSTER_URL]:7077")`,
where CLUSTER_URL is the machine that started the standalone Master. If
YARN, you need to do