Re: Error Invoking Spark on Yarn on using Spark Submit

2016-06-24 Thread Mich Talebzadeh
Hi Punneet, File does not exist: hdfs://localhost:8020/user/opc/.sparkStaging/application_1466711725829_0033/pipeline-lib-0.1.0-SNAPSHOT.jar indicates a YARN issue. It is trying to get that file from HDFS and copy it across to /tmp directory. 1. Check that the class is actually created at

Re: Error Invoking Spark on Yarn on using Spark Submit

2016-06-24 Thread Jeff Zhang
You might have multiple java servlet jars on your classpath. On Fri, Jun 24, 2016 at 3:31 PM, Mich Talebzadeh wrote: > can you please check the yarn log files to see what they say (both the > nodemamager and resourcemanager) > > HTH > > Dr Mich Talebzadeh > > > >

Re: Error Invoking Spark on Yarn on using Spark Submit

2016-06-24 Thread Mich Talebzadeh
can you please check the yarn log files to see what they say (both the nodemamager and resourcemanager) HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

Error Invoking Spark on Yarn on using Spark Submit

2016-06-24 Thread puneet kumar
I am getting below error thrown when I submit Spark Job using Spark Submit on Yarn. Need a quick help on what's going wrong here. 16/06/24 01:09:25 WARN AbstractLifeCycle: FAILED org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-791eb5d5: java.lang.IllegalStateException: class