Re: Spark Streaming: BatchDuration and Processing time

2016-01-22 Thread Lin Zhao
; >Sent: Sunday, January 17, 2016 11:32 AM >To: user@spark.apache.org >Subject: Spark Streaming: BatchDuration and Processing time > >Hi, > >If BatchDuration is set to 1 second in StreamingContext and the actual >processing time is longer than one second, then how does Spark h

Re: Spark Streaming: BatchDuration and Processing time

2016-01-18 Thread Ricardo Paiva
ens in the next batch duration? > > Thanks. > Amit > > -- > If you reply to this email, your message will be added to the discussion > below: > > http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-BatchDuration-and-Processing-time-tp

Re: Spark Streaming: BatchDuration and Processing time

2016-01-17 Thread Silvio Fiorito
g time is longer than 1 second? What happens in the next batch duration? Thanks. Amit -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-BatchDuration-and-Processing-time-tp25986.html Sent from the Apache Spark User List mailing list a

Spark Streaming: BatchDuration and Processing time

2016-01-17 Thread pyspark2555
is longer than 1 second? What happens in the next batch duration? Thanks. Amit -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-BatchDuration-and-Processing-time-tp25986.html Sent from the Apache Spark User List mailing list archive