Conditionally do things different on the first minibatch vs subsequent minibatches in a dstream

We have some logic that we need to apply while we are processing the events in the first minibatch only. For the second, third, etc. minibatches we don't need to do this special logic. I can't just do it as a one time thing - I need to modify a field on the events in the first minibatch. One

Re: Conditionally do things different on the first minibatch vs subsequent minibatches in a dstream

Can you utilize the following method in StreamingListener ? override def onBatchStarted(batchStarted: StreamingListenerBatchStarted) { Cheers On Tue, Sep 1, 2015 at 12:36 PM, steve_ash wrote: > We have some logic that we need to apply while we are processing the events