> On 13 Jan 2016, at 07:15, Darin McBeath <ddmcbe...@yahoo.com.INVALID> wrote: > > Thanks. > > I already set the following in spark-defaults.conf so I don't think that is > going to fix my problem. > > spark.eventLog.dir file:///root/spark/applicationHistory > spark.eventLog.enabled true > > > I suspect my problem must be something else. > Darin. >
Step 1 has to be: is the log file there? > ________________________________ > From: Don Drake <dondr...@gmail.com> > To: Darin McBeath <ddmcbe...@yahoo.com> > Cc: User <user@spark.apache.org> > Sent: Wednesday, January 13, 2016 10:10 AM > Subject: Re: Spark 1.6 and Application History not working correctly > > > > I noticed a similar problem going from 1.5.x to 1.6.0 on YARN. > > I resolved it be setting the following command-line parameters: > > spark.eventLog.enabled=true > > spark.eventLog.dir=<PATH_TO_HISTORY_DATA> > > > -Don > > > On Wed, Jan 13, 2016 at 8:29 AM, Darin McBeath <ddmcbe...@yahoo.com.invalid> > wrote: > > I tried using Spark 1.6 in a stand-alone cluster this morning. >> >> I submitted 2 jobs (and they both executed fine). In fact, they are the >> exact same jobs with just some different parameters. >> >> I was able to view the application history for the first job. >> >> However, when I tried to view the second job, I get the following error >> message. >> >> Application history not found (app-20160113140054-0001) >> No event logs found for application SparkSync Application in >> file:///root/spark/applicationHistory. Did you specify the correct logging >> directory? >> >> >> Everything works fine with Spark 1.5. I'm able to view the application >> history for both jobs. >> >> Has anyone else noticed this issue? Any suggestions? >> >> Thanks. >> >> Darin. >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >> For additional commands, e-mail: user-h...@spark.apache.org >> >> > > > -- > > Donald Drake > Drake Consulting > http://www.drakeconsulting.com/ > https://twitter.com/dondrake > 800-733-2143 > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > > --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
