goutamadwant commented on issue #10225: URL: https://github.com/apache/seatunnel/issues/10225#issuecomment-5302480278
@davidzollo @DanielLeens I would like to work on this issue I checked the current file source path and BaseFileSource is still bounded. FileSourceSplitEnumerator discovers the configured files once and signals no more splits, so appended bytes are not discovered again For the first slice I propose supporting append-only LocalFile text input. The source would poll file size, emit only the newly appended byte range, and checkpoint the file identity and consumed offset so restore does not duplicate data I would keep file rotation, truncation and in-place modification outside the first slice unless you prefer those semantics to be included now Does this scope look reasonable? thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
