Hello,

If you are using EMR you probably need to create a SSH tunnel so you can
access the web ports of the master instance.

https://docs.aws.amazon.com/ElasticMapReduce/latest/DeveloperGuide/emr-ssh-tunnel.html

Also verify that your EMR cluster is not behind a private VPC, in this case
you must verify also that you can correctly access the VPC and create the
tunnel or forwards to do so.

Hope it helps,
Ismaël Mejía


On Thu, Jul 21, 2016 at 10:33 PM, Jacek Laskowski <ja...@japila.pl> wrote:

> Hi,
>
> What's in the logs of spark-shell? There should be the host and port
> of web UI. what the public IP of the host where you execute
> spark-shell? Use it for 4040. I don't think you use Spark Standalone
> cluster (the other address with 8080) if you simply spark-shell
> (unless you've got spark.master in conf/spark-defaults.conf).
>
> When you're inside spark-shell, can you sc.master? Use this for Spark
> Standalone's web UI (replacing 7077 to 8080).
>
> Pozdrawiam,
> Jacek Laskowski
> ----
> https://medium.com/@jaceklaskowski/
> Mastering Apache Spark http://bit.ly/mastering-apache-spark
> Follow me at https://twitter.com/jaceklaskowski
>
>
> On Wed, Jul 20, 2016 at 10:09 PM, KhajaAsmath Mohammed
> <mdkhajaasm...@gmail.com> wrote:
> > Hi,
> >
> > I got an access to spark cluser and have intstatiated spark-shell on aws
> > using command
> > $spark-shell.
> >
> > Spark shell is started successfully but I am looking to access WebUI and
> > Master URL. does anyone know how to access that in AWS.
> >
> > I tried http://IPMaster:4040 and http://IpMaster:8080 but it didnt show
> up
> > anything.
> >
> > Thanks,
> > Asmath.
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscr...@spark.apache.org
>
>

Reply via email to