Hi Patcharee, It is an alpha feature in HDP distribution, integrating ATS with Spark history server. If you are using upstream, you can configure spark as regular without these configuration. But other related configuration are still mandatory, such as hdp.version related.
Thanks. Zhan Zhang On Mar 18, 2015, at 3:30 AM, patcharee <patcharee.thong...@uni.no> wrote: > Hi, > > I am using spark 1.3. I would like to use Spark Job History Server. I added > the following line into conf/spark-defaults.conf > > spark.yarn.services org.apache.spark.deploy.yarn.history.YarnHistoryService > spark.history.provider > org.apache.spark.deploy.yarn.history.YarnHistoryProvider > spark.yarn.historyServer.address sandbox.hortonworks.com:19888 > > But got Exception in thread "main" java.lang.ClassNotFoundException: > org.apache.spark.deploy.yarn.history.YarnHistoryProvider > > What class is really needed? How to fix it? > > Br, > Patcharee > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
