How to disable write ahead logs?

2016-11-28 Thread Tim Harsch
Hi all, I set `spark.streaming.receiver.writeAheadLog.enable=false` and my history server confirms the property has been set. Yet, I continue to see the error: 16/11/28 15:47:04 ERROR util.FileBasedWriteAheadLog_ReceivedBlockTracker: Failed to write to write ahead log after 3 failures I

Re: Spark metrics for ganglia

2014-12-24 Thread Tim Harsch
Did you get past this issue? I¹m trying to get this to work as well. You have to compile in the spark-ganglia-lgpl artifact into your application. dependency groupIdorg.apache.spark/groupId artifactIdspark-ganglia-lgpl_2.10/artifactId

building with Hadoop 1.0.4 / where is hadoop-yarn-common:1.0.4 ?

2014-12-17 Thread Tim Harsch
I tried sending this message to the users list several hours ago, but it did not get distributed. I was just trying to build Spark, v1.1.1 with defaults. It sets hadoop.version to 1.0.4, and yarn.version to hadoop.version, the dependency entry for org.apache.hadoop:hadoop-yarn-common sets