Hi all, I'd like to start the vote for SPIP: Asynchronous Offset Management in Structured Streaming.
The high level summary of the SPIP is that we propose a couple of improvements on offset management in microbatch execution to lower down processing latency, which would help for certain types of workloads. References: - JIRA ticket <https://issues.apache.org/jira/browse/SPARK-39591> - SPIP doc <https://docs.google.com/document/d/1iPiI4YoGCM0i61pBjkxcggU57gHKf2jVwD7HWMHgH-Y/edit?usp=sharing> - Discussion thread <https://lists.apache.org/thread/yv8ffr56prjr16qh12lwjyjl1q8dl7lp> Please vote on the SPIP for the next 72 hours: [ ] +1: Accept the proposal as an official SPIP [ ] +0 [ ] -1: I don’t think this is a good idea because … Thanks! Jungtaek Lim (HeartSaVioR)
