Internal Error: Missing Template ERR_DNS_FAIL

2014-08-07 Thread hansen
There is a error message: "Internal Error: Missing Template ERR_DNS_FAIL" on my Spark cluster's web ui. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Internal-Error-Missing-Template-ERR-DNS-FAIL-tp11750.html Sent from the Apache Spark User List mailing l

How to control a spark application(executor) using memory amount per node?

2014-06-30 Thread hansen
Hi, When i send the following statements in spark-shell: val file = sc.textFile("hdfs://nameservice1/user/study/spark/data/soc-LiveJournal1.txt") val count = file.flatMap(line => line.split(" ")).map(word => (word, 1)).reduceByKey(_+_) println(count.count()) and, it throw a exception

unsubscribe

2014-05-18 Thread Terje Berg-Hansen
Andre Bois-Crettez skrev: >We never saw your exception when reading bzip2 files with spark. > >But when we wrongly compiled spark against older version of hadoop (was >default in spark), we ended up with sequential reading of bzip2 file, >not taking advantage of block splits to work in paralle