Writing/Saving RDD to HDFS using saveAsTextFile

Hi, I am facing issue with writing RDD[X] to HDFS file path. X is a simple case class with variable time as primitive long. When I run the driver program with - master as spark://:7077 I get this - Caused by: java.io.EOFException at java.io.ObjectInputStream$BlockDataInputStream.readFully(Ob

Re: How to Disable or do minimal Logging for apache spark client Driver program?

import ch.qos.logback.classic.Level; sc.setLogLevel(Level.INFO.levelStr); //Change the level to an appropriate level for your application. Mahendra about.me/mahendrakutare

Re: Restful WS for Spark

Try Cloudera Livy https://github.com/cloudera/livy It may be helpful for your requirement. Cheers, Mahendra about.me/mahendrakutare ~~~