Re: How do I Process Streams that span multiple lines?

2015-08-04 Thread Akhil Das
Enthusiast sparkenthusi...@yahoo.in wrote: All examples of Spark Stream programming that I see assume streams of lines that are then tokenised and acted upon (like the WordCount example). How do I process Streams that span multiple lines? Are there examples that I can use?

How do I Process Streams that span multiple lines?

2015-08-03 Thread Spark Enthusiast
All  examples of Spark Stream programming that I see assume streams of lines that are then tokenised and acted upon (like the WordCount example). How do I process Streams that span multiple lines? Are there examples that I can use? 

Re: How do I Process Streams that span multiple lines?

2015-08-03 Thread Michal Čizmazia
Are you looking for RDD.wholeTextFiles? On 3 August 2015 at 10:57, Spark Enthusiast sparkenthusi...@yahoo.in wrote: All examples of Spark Stream programming that I see assume streams of lines that are then tokenised and acted upon (like the WordCount example). How do I process Streams

Re: How do I Process Streams that span multiple lines?

2015-08-03 Thread Michal Čizmazia
that I see assume streams of lines that are then tokenised and acted upon (like the WordCount example). How do I process Streams that span multiple lines? Are there examples that I can use?