Re: how to spark streaming application start working on next batch before completing on previous batch .

2015-12-15 Thread Mukesh Jha
fering from constantly increasing of scheduling > delay. > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/how-to-spark-streaming-application-start-working-on-next-batch-before-completing-on-previous-batch-tp25559p25707.html > Sent from t

Re: how to spark streaming application start working on next batch before completing on previous batch .

2015-12-15 Thread ikmal
The best practice is to set batch interval lesser than processing time. I'm sure your application is suffering from constantly increasing of scheduling delay. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/how-to-spark-streaming-application-start-working

Re: how to spark streaming application start working on next batch before completing on previous batch .

2015-12-15 Thread Tathagata Das
from constantly increasing of >> scheduling >> delay. >> >> >> >> -- >> View this message in context: >> http://apache-spark-user-list.1001560.n3.nabble.com/how-to-spark-streaming-application-start-working-on-next-batch-before-completing-on-previous

Re: how to spark streaming application start working on next batch before completing on previous batch .

2015-12-15 Thread Mukesh Jha
;> scheduling >>> delay. >>> >>> >>> >>> -- >>> View this message in context: >>> http://apache-spark-user-list.1001560.n3.nabble.com/how-to-spark-streaming-application-start-working-on-next-batch-before-completing-on-previous-batch-tp25559

Re: how to spark streaming application start working on next batch before completing on previous batch .

2015-12-05 Thread manasdebashiskar
process each batch as rdd in parallel. ...Manas -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/how-to-spark-streaming-application-start-working-on-next-batch-before-completing-on-previous-batch-tp25559p25581.html Sent from the Apache Spark User List mailing

how to spark streaming application start working on next batch before completing on previous batch .

2015-12-03 Thread prateek arora
-working-on-next-batch-before-completing-on-previous-batch-tp25559.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail