Hortonworks directly if they're suggesting you use those.
On Wed, Mar 18, 2015 at 3:30 AM, patcharee patcharee.thong...@uni.no wrote:
Hi,
I am using spark 1.3. I would like to use Spark Job History Server. I added
the following line into conf/spark-defaults.conf
spark.yarn.services
On Mar 18, 2015, at 3:30 AM, patcharee patcharee.thong...@uni.no wrote:
Hi,
I am using spark 1.3. I would like to use Spark Job History Server. I added
the following line into conf/spark-defaults.conf
spark.yarn.services org.apache.spark.deploy.yarn.history.YarnHistoryService
You can simply turn it on using:
./sbin/start-history-server.sh
Read more here http://spark.apache.org/docs/1.3.0/monitoring.html.
Thanks
Best Regards
On Wed, Mar 18, 2015 at 4:00 PM, patcharee patcharee.thong...@uni.no
wrote:
Hi,
I am using spark 1.3. I would like to use Spark Job
Spark Job History
Server. I added the following line into conf/spark-defaults.conf
spark.yarn.services
org.apache.spark.deploy.yarn.history.YarnHistoryService
spark.history.provider
org.apache.spark.deploy.yarn.history.YarnHistoryProvider
spark.yarn.historyServer.address
:
./sbin/start-history-server.sh
Read more here http://spark.apache.org/docs/1.3.0/monitoring.html.
Thanks
Best Regards
On Wed, Mar 18, 2015 at 4:00 PM, patcharee patcharee.thong...@uni.no
wrote:
Hi,
I am using spark 1.3. I would like to use Spark Job History Server. I
added
Hi,
I am using spark 1.3. I would like to use Spark Job History Server. I
added the following line into conf/spark-defaults.conf
spark.yarn.services org.apache.spark.deploy.yarn.history.YarnHistoryService
spark.history.provider
org.apache.spark.deploy.yarn.history.YarnHistoryProvider
Hi,
My spark was compiled with yarn profile, I can run spark on yarn without
problem.
For the spark job history server problem, I checked
spark-assembly-1.3.0-hadoop2.4.0.jar and found that the package
org.apache.spark.deploy.yarn.history is missing. I don't know why
BR,
Patcharee
Those classes are not part of standard Spark. You may want to contact
Hortonworks directly if they're suggesting you use those.
On Wed, Mar 18, 2015 at 3:30 AM, patcharee patcharee.thong...@uni.no wrote:
Hi,
I am using spark 1.3. I would like to use Spark Job History Server. I added