Hi All, I am trying to submit the spark application using yarn rest API. I am able to submit the application but final status shows as 'UNDEFINED.'. Couple of other observations:
User shows as Dr.who Application type is empty though I specify it as Spark Is any one had this problem before? I am creating the app id using: http://{cluster host}/ws/v1/cluster/apps/new-application Post Request Url: http://{cluster host}/ws/v1/cluster/apps Here is the request body: { "application-id":"application_1426273041023_0055", "application-name":"test", "am-container-spec": { "credentials": { "secrets": { "entry": [ { "key":"user.name", "value":"xxxxx" } ] } }, "commands": { "command":"%SPARK_HOME%/bin/spark-submit.cmd --class org.apache.spark.examples.SparkPi --conf spark.yarn.jar=hdfs://xxx/apps/spark/spark-1.2.1-hadoop2.6/spark-assembly-1.2.1-hadoop2.6.0.jar --master yarn-cluster hdfs://xxx/apps/spark/spark-1.2.1-hadoop2.6/spark-examples-1.2.1-hadoop2.6.0.jar" }, "application-type":"SPARK" }