There is a error message: "Internal Error: Missing Template ERR_DNS_FAIL" on
my Spark cluster's web ui.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Internal-Error-Missing-Template-ERR-DNS-FAIL-tp11750.html
Sent from the Apache Spark User List mailing l
Hi,
When i send the following statements in spark-shell:
val file =
sc.textFile("hdfs://nameservice1/user/study/spark/data/soc-LiveJournal1.txt")
val count = file.flatMap(line => line.split(" ")).map(word => (word,
1)).reduceByKey(_+_)
println(count.count())
and, it throw a exception
Andre Bois-Crettez skrev:
>We never saw your exception when reading bzip2 files with spark.
>
>But when we wrongly compiled spark against older version of hadoop (was
>default in spark), we ended up with sequential reading of bzip2 file,
>not taking advantage of block splits to work in paralle