Spark stream job is take up /TMP with 100%

2016-02-19 Thread Sutanu Das
We have a Spark steaming job and when running in LOCAL mode, it takes up /TMP at 100% and Fails with error below, this doesn't happen in YARN Mode but in YARN we have performance issues. How can I re-direct Spark Local Subffle from /TMP to /other_filesystem_location (where we have lots of

RE: Spark History Server NOT showing Jobs with Hortonworks

2016-02-18 Thread Sutanu Das
Hi Mich, Community - Do I need to specify it in the properties file in my spark-submit ? From: Mich Talebzadeh [mailto:m...@peridale.co.uk] Sent: Thursday, February 18, 2016 4:28 PM To: Sutanu Das; user@spark.apache.org Subject: RE: Spark History Server NOT showing Jobs with Hortonworks

Spark History Server NOT showing Jobs with Hortonworks

2016-02-18 Thread Sutanu Das
Hi Community, Challenged with Spark issues with Hortonworks (HDP 2.3.2_Spark 1.4.1) - The Spark History Server is NOT showing the Spark Running Jobs in Local Mode The local-host:4040/app/v1 is ALSO not working How can I look at my local Spark job? # Generated by Apache Ambari. Fri Feb 5