Re: Where is yarn-shuffle.jar in maven?

te: > Hi, > > For dynamic allocation feature, I need spark-xxx-yarn-shuffle.jar. In my > local spark build, I can see it. But in maven central, I can’t find it. My > build script pulls all jars from maven central. The only option is to check > in this jar into git? > > T

Re: Spark 2.0.0 JaninoRuntimeException

ternalRow;)I" of class "org.apache.spark.sql. >> catalyst.expressions.GeneratedClass$SpecificOrdering" grows beyond 64 KB >> > > Unfortunately I'm not clear on how to even isolate the source of this > problem. I didn't have this problem in Spark 1.6.1. > > Any clues? > -- -Dhruve Ashar

Re: Job can not terminated in Spark 2.0 on Yarn

16/08/02 16:59:33 ERROR scheduler.LiveListenerBus: SparkListenerBus has >> already stopped! Dropping event >> SparkListenerExecutorMetricsUpdate(70,WrappedArray()) >> 16/08/02 16:59:33 WARN yarn.YarnAllocator: Expected to find pending >> requests, but found none. >> 16/08/02 16:59:33 WARN netty.Dispatcher: Message >> RemoteProcessDisconnected(17.138.53.26:55338) dropped. Could not find >> MapOutputTracker. >> >> >> >> Cheers, >> >> >> LZ >> >> > -- -Dhruve Ashar

Re: Job can not terminated in Spark 2.0 on Yarn

scheduler.LiveListenerBus: SparkListenerBus has >> already stopped! Dropping event >> SparkListenerExecutorMetricsUpdate(70,WrappedArray()) >> 16/08/02 16:59:33 WARN yarn.YarnAllocator: Expected to find pending >> requests, but found none. >> 16/08/02 16:59:33 WARN netty.Dispatcher: Message >> RemoteProcessDisconnected(17.138.53.26:55338) dropped. Could not find >> MapOutputTracker. >> >> >> >> Cheers, >> >> >> LZ >> >> > -- -Dhruve Ashar

Re: spark.driver.extraJavaOptions

nfun$validateSettings$6.apply(SparkConf.scala:454) > > > /*Please note the same works with CDH 5.4 with spark 1.3.0.*/ > > Regards, > Sam > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/spark-driver-extraJavaOptions-tp27389.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > - > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > > -- -Dhruve Ashar

Re: Spark hangs at "Removed broadcast_*"

----- > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > > -- -Dhruve Ashar

Re: Error report file is deleted automatically after spark application finished

been disabled. To enablecore dumping, try > "ulimit -c unlimited" before starting Java again”. > > > Regards > > Prateek > > > > > > On Wed, Jun 29, 2016 at 9:30 PM, dhruve ashar <dhruveas...@gmail.com> > wrote: > >> You can look at t

Re: Error report file is deleted automatically after spark application finished

1001560.n3.nabble.com/Error-report-file-is-deleted-automatically-after-spark-application-finished-tp27247.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > - > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > > -- -Dhruve Ashar

Re: spark standalone High availibilty issues

master. The >> error is related to Leader election in curator and says that noMethod found >> (getProcess) and master doesnt get started. >> >> Just wondering what could be causing the issue. >> >> I am using same zookeeper cluster for HDFS High availability and it is >> working just fine. >> >> >> Thanks >> > -- -Dhruve Ashar