Re: converting DStream[String] into RDD[String] in spark streaming [I]

2015-03-29 Thread Deenar Toraskar
(saveFunc) } Regards Deenar P.S. The mail archive on nabble does not seem to show all responses. -Original Message- From: Sean Owen [mailto:so...@cloudera.com] Sent: 22 March 2015 11:49 To: Deenar Toraskar Cc: user@spark.apache.org Subject: Re: converting DStream[String] into RDD[String

Re: FW: converting DStream[String] into RDD[String] in spark streaming [I]

2015-03-29 Thread Sean Owen
. The mail archive on nabble does not seem to show all responses. -Original Mes P.sage- From: Sean Owen [mailto:so...@cloudera.com] Sent: 22 March 2015 11:49 To: Deenar Toraskar Cc: user@spark.apache.org Subject: Re: converting DStream[String] into RDD[String] in spark streaming

Re: converting DStream[String] into RDD[String] in spark streaming

2015-03-22 Thread deenar.toraskar
as an RDD[String]. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/converting-DStream-String-into-RDD-String-in-spark-streaming-tp20253p22175.html Sent from the Apache Spark User List mailing list archive at Nabble.com

Re: converting DStream[String] into RDD[String] in spark streaming

2015-03-22 Thread Sean Owen
On Sun, Mar 22, 2015 at 8:43 AM, deenar.toraskar deenar.toras...@db.com wrote: 1) if there are no sliding window calls in this streaming context, will there just one file written per interval? As many files as there are partitions will be written in each interval. 2) if there is a sliding

converting DStream[String] into RDD[String] in spark streaming

2014-12-03 Thread Hafiz Mujadid
(Seconds(interval), Seconds(interval)).map(x = new String(x)) Now I want to convert this streams into a single RDD[String]. Any help please. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/converting-DStream-String-into-RDD-String-in-spark-streaming-tp20253

Re: converting DStream[String] into RDD[String] in spark streaming

2014-12-03 Thread Sean Owen
]. Any help please. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/converting-DStream-String-into-RDD-String-in-spark-streaming-tp20253.html Sent from the Apache Spark User List mailing list archive at Nabble.com

Re: converting DStream[String] into RDD[String] in spark streaming

2014-12-03 Thread Hafiz Mujadid
Thanks Dear, It is good to save this data to HDFS and then load back into an RDD :) -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/converting-DStream-String-into-RDD-String-in-spark-streaming-tp20253p20258.html Sent from the Apache Spark User List mailing