RE: Spark streaming: size of DStream

2014-09-09 Thread julyfire
/Spark-streaming-size-of-DStream-tp13769p13785.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h

RE: Spark streaming: size of DStream

2014-09-09 Thread Shao, Saisai
never run Can you all give me some suggestion? thanks -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-streaming-size-of-DStream-tp13769p13781.html Sent from the Apache Spark User List mailing

Re: Spark streaming: size of DStream

2014-09-09 Thread Luis Ángel Vicente Sánchez
evaluate in the beginning of running the program, so > the next statement will never run > > Can you all give me some suggestion? thanks > > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Spark-s

RE: Spark streaming: size of DStream

2014-09-09 Thread julyfire
Can you all give me some suggestion? thanks -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-streaming-size-of-DStream-tp13769p13781.html Sent from the Apache Spark User List mailing list arch

RE: Spark streaming: size of DStream

2014-09-09 Thread julyfire
e.com/Spark-streaming-size-of-DStream-tp13769p13778.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org

RE: Spark streaming: size of DStream

2014-09-09 Thread Shao, Saisai
but it returns a DStream, not a number. so is there a way to achieve this case? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-streaming-size-of-DStream-tp13769p13775.html Sent from the Apache Spark User List mailing list archive at Nabble.

Re: Spark streaming: size of DStream

2014-09-09 Thread Sean Owen
ething, if no data, do the other thing. Then I thought the > count() can give me the measure, but it returns a DStream, not a number. > so is there a way to achieve this case? > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.c

RE: Spark streaming: size of DStream

2014-09-09 Thread julyfire
a DStream, not a number. so is there a way to achieve this case? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-streaming-size-of-DStream-tp13769p13775.html Sent from the Apache Spark User List mailing list archive at Nabble.com

RE: Spark streaming: size of DStream

2014-09-09 Thread Shao, Saisai
From: julyfire [mailto:hellowe...@gmail.com] Sent: Tuesday, September 09, 2014 2:42 PM To: u...@spark.incubator.apache.org Subject: Spark streaming: size of DStream I want to implement the following logic: val stream = getFlumeStream() // a DStream if(size_of_stream > 0) // if the DStream contains

Spark streaming: size of DStream

2014-09-08 Thread julyfire
e with a number. does anyone know how to get the number of RDD in a DStream? Thanks! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-streaming-size-of-DStream-tp13769.html Sent from the Apache Spark User List mailing list archive at Na