unsubscribe error

2016-06-18 Thread Marco Platania
Dear admin, I've tried to unsubscribe from this mailing list twice, but I'm still receiving emails. Can you please fix this? Thanks,Marco

unsubscribe

2016-06-16 Thread Marco Platania
unsubscribe

Neither previous window has value for key, nor new values found

2016-06-10 Thread Marco Platania
Hi all,  I'm running a Spark Streaming application that uses reduceByKeyAndWindow(). The window interval is 2 hours, while the slide interval is 1 hour. I have a JavaPairRDD in which both keys and values are strings. Each time the reduceByKeyAndWindow() function is called, it uses

How to carry data streams over multiple batch intervals in Spark Streaming

2016-05-21 Thread Marco Platania
Hi experts,I'm using Apache Spark Streaming 1.6.1 to write a Java application that joins two Key/Value data streams and writes the output to HDFS. The two data streams contain K/V strings and are periodically ingested in Spark from HDFS by using textFileStream(). The two data streams aren't