Re: Running spark Java on yarn cluster

2016-08-10 Thread atulp
queries and reuse of executors across queries. Thanks, Atul -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Running-spark-Java-on-yarn-cluster-tp27504p27507.html Sent from the Apache Spark User List mailing list archive at Nabble.com

Running spark Java on yarn cluster

2016-08-10 Thread atulp
parkContext(new SparkConf().setAppName("SparkJoins").setMaster("yarn-client")); } } -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Running-spark-Java-on-yarn-cluster-tp27504.html S

Running spark Java on yarn cluster

2016-08-10 Thread Atul Phalke
Hi Team, I am new to spark and writing my first program. I have written sample program with spark master as local. To execute spark over local yarn what should be value of spark.master property? Can I point to remote yarn cluster? I would like to execute this as a java application and not