Hi Ted, I used s3://support.elasticmapreduce/spark/install-spark to install spark on my EMR cluster. It is 1.2.0. When I click on the link for history or logs it takes me to http://ip-172-31-43-116.us-west-2.compute.internal:9035/node/containerlogs/container_1424105590052_0070_01_000001/hadoop and I get -
The server at *ip-172-31-43-116.us-west-2.compute.internal* can't be found, because the DNS lookup failed. DNS is the network service that translates a website's name to its Internet address. This error is most often caused by having no connection to the Internet or a misconfigured network. It can also be caused by an unresponsive DNS server or a firewall preventing Google Chrome from accessing the network. I tried changing the address with internal to the external one , but still does not work. Thanks _roni On Tue, Mar 3, 2015 at 9:05 AM, Ted Yu <yuzhih...@gmail.com> wrote: > bq. spark UI does not work for Yarn-cluster. > > Can you be a bit more specific on the error(s) you saw ? > > What Spark release are you using ? > > Cheers > > On Tue, Mar 3, 2015 at 8:53 AM, Rohini joshi <roni.epi...@gmail.com> > wrote: > >> Sorry , for half email - here it is again in full >> Hi , >> I have 2 questions - >> >> 1. I was trying to use Resource Manager UI for my SPARK application >> using yarn cluster mode as I observed that spark UI does not work for >> Yarn-cluster. >> IS that correct or am I missing some setup? >> >> 2. when I click on Application Monitoring or history , i get re-directed >> to some linked with internal Ip address. Even if I replace that address >> with the public IP , it still does not work. What kind of setup changes >> are needed for that? >> >> Thanks >> -roni >> >> On Tue, Mar 3, 2015 at 8:45 AM, Rohini joshi <roni.epi...@gmail.com> >> wrote: >> >>> Hi , >>> I have 2 questions - >>> >>> 1. I was trying to use Resource Manager UI for my SPARK application >>> using yarn cluster mode as I observed that spark UI does not work for >>> Yarn-cluster. >>> IS that correct or am I missing some setup? >>> >>> >>> >>> >>> >> >
