Hi spark user I am running an spark streaming app that use receiver from a pubsub system, and the pubsub system does NOT support ack.
And I don't want the data to be lost if there is a driver failure, and by accident, the batches queue up at that time. I tested by generating some queued batches with some input (see the pic), and then quit the application. When I restart the application again, I saw there are no input for these batches. Is it as expected? Before restart [image: Inline image 1]