taowenjun commented on issue #10129: URL: https://github.com/apache/seatunnel/issues/10129#issuecomment-7001048840
Thanks @DanielLeens for the detailed guidance above. We'd like to move the ORC follow-up forward along that agreed direction, building on @chl-wxp's work in #10325 and crediting the original contribution. The proposed scope is: - Add stripe-aligned ORC splitting through the current shared FileSplitStrategyFactory, so LocalFile, HdfsFile and S3File use the same implementation, with stripe metadata read through HadoopFileSystemProxy and the connector's HadoopConf. - Preserve the projected schema when adding the split range in OrcReadStrategy, and leave FileSourceSplit serialization and legacy checkpoint handling unchanged. - Add focused stripe-boundary and split/non-split projection correctness tests, plus an existing-style LocalFile E2E with parallelism > 1 and exact row-count assertions; update both English and Chinese docs. We plan to open a fresh follow-up PR against current dev rather than revive the outdated branch. @chl-wxp, please let us know if you are already continuing this work or would like to collaborate. @DanielLeens and maintainers, are there any additional requirements or changes to the earlier guidance we should account for before preparing the PR? We will keep this scoped to ORC read splitting and link the follow-up PR here. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
