Hi spark user

  I am running an spark streaming app that use receiver from a pubsub
system, and the pubsub system does NOT support ack.

  And I don't want the data to be lost if there is a driver failure, and by
accident, the batches queue up at that time.

  I tested by generating some queued batches with some input (see the pic),
and then quit the application.
  When I restart the application again, I saw there are no input for these
batches.

  Is it as expected?


Before restart
[image: Inline image 1]

Reply via email to