Jose Torres created SPARK-24460: ----------------------------------- Summary: exactly-once mode Key: SPARK-24460 URL: https://issues.apache.org/jira/browse/SPARK-24460 Project: Spark Issue Type: Sub-task Components: Structured Streaming Affects Versions: 2.4.0 Reporter: Jose Torres
Major changes we know will need to be made: * Restart strategy needs to replay offsets already in the log as microbatches. * Some kind of epoch alignment - need to think about this further. We'll also need a test plan to ensure that we've actually achieved exactly once. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org