Github user xuanyuanking commented on a diff in the pull request: https://github.com/apache/spark/pull/20675#discussion_r171161352 --- Diff: sql/core/src/main/java/org/apache/spark/sql/sources/v2/reader/streaming/ContinuousDataReader.java --- @@ -33,4 +33,16 @@ * as a restart checkpoint. */ PartitionOffset getOffset(); + + /** + * Set the start offset for the current record, only used in task retry. If setOffset keep + * default implementation, it means current ContinuousDataReader can't support task level retry. + * + * @param offset last offset before task retry. + */ + default void setOffset(PartitionOffset offset) { --- End diff -- Cool, that's more clearer.
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org