Re: Spark streaming: Fixed time aggregation & handling driver failures

2016-01-18 Thread Ricardo Paiva
his email, your message will be added to the discussion > below: > > http://apache-spark-user-list.1001560.n3.nabble.com/Spark-streaming-Fixed-time-aggregation-handling-driver-failures-tp25982.html > To start a new topic under Apache Spark User List, email > ml-node+s1001560n1...@n3.na

Spark streaming: Fixed time aggregation & handling driver failures

2016-01-15 Thread ffarozan
the batch interval. So the problem is - lets say if streaming job starts at 5:02, then I will get results at 5:07, 5:12, etc. and not what I want. Any suggestions? thanks, Firdousi -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-streaming-Fixed-time

Re: Spark streaming: Fixed time aggregation & handling driver failures

2016-01-15 Thread Cody Koeninger
? > > thanks, > Firdousi > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Spark-streaming-Fixed-time-aggregation-handling-driver-failures-tp25982.html >