AFAIK, it is guranteed that batch t+1 will not start processing until batch t is done.
ordeing within batch - what do you mean by that? In essence, the (mini) batch will get distributed in partitions like a normal RDD, so following rdd.zipWithIndex should give a wy to order them by the time they are received. On Sat, Jul 11, 2015 at 12:50 PM, anshu shukla <anshushuk...@gmail.com> wrote: > Hey , > > Is there any *guarantee of fix ordering among the batches/RDDs* . > > After searching a lot I found there is no ordering by default (from the > framework itself ) not only on *batch wise *but *also ordering within > batches* .But i doubt is there any change from old spark versions to > spark 1.4 in this context. > > Any Comments please !! > > -- > Thanks & Regards, > Anshu Shukla > -- Best Regards, Ayan Guha
