Re: SparkStream saveAsTextFiles()

[anavidad]

Hi,

What kind of can't find symbol are you receiving?

On the other hand, I would try to change guava dependency version to 14.0.1. 

In Spark 1.3.0, guava version is 14.0.1 but is not included inside spark
artifact because it's marked like provided.
http://repo1.maven.org/maven2/org/apache/spark/spark-core_2.10/1.3.0/spark-core_2.10-1.3.0.pom

Spark and Guava have a long history. You just have to search a bit in
google.

Regards.



--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/SparkStream-saveAsTextFiles-tp22719p22754.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

Re: SparkStream saveAsTextFiles()

[anavidad]

Structure seems fine. Only need to type at the end of your program:

ssc.start();
ssc.awaitTermination();

Check method arguments. I advise you to check the spark java api streaming.

https://spark.apache.org/docs/1.3.0/api/java/

Regards.




--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/SparkStream-saveAsTextFiles-tp22719p22755.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

Re: SparkStream saveAsTextFiles()

[anavidad]

JavaDStream.saveAsTextFiles not exists in Spark Java Api. If you want to
persist every RDD in your JavaDStream you should do something like this:

words.foreachRDD(new Function2JavaRDDlt;String, Time, Void() {
 @Override
 public Void call(JavaRDDSparkFlumeEvent rddWords, Time arg1) throws
Exception {
  rddWords.saveAsTextFiles(arg1,arg2);
 }
});

In fact, if you look into DStream.scala 
https://github.com/apache/spark/blob/master/streaming/src/main/scala/org/apache/spark/streaming/dstream/DStream.scala
https://github.com/apache/spark/blob/master/streaming/src/main/scala/org/apache/spark/streaming/dstream/DStream.scala
 
, you can see how saveAsTextFile is implemented.




--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/SparkStream-saveAsTextFiles-tp22719p22720.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org