L. C. Hsieh created SPARK-33955:
-----------------------------------
Summary: Add latest offsets to source progress
Key: SPARK-33955
URL: https://issues.apache.org/jira/browse/SPARK-33955
Project: Spark
Issue Type: Improvement
Components: Structured Streaming
Affects Versions: 3.2.0
Reporter: L. C. Hsieh
Assignee: L. C. Hsieh
Currently we record start and end offsets per source in streaming process.
Latest offset is an important information for streaming process but the
progress lacks of this info. We should add latest offset to source progress.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
