sezruby commented on issue #10377: URL: https://github.com/apache/incubator-gluten/issues/10377#issuecomment-3268149459
For writer, we have our own native writer that can't be abandoned. We integrated with it + gluten/velox. It could be a separate topic, one major comment - it should support optimized write for partitioned table to make it useful. For dv reader, we implemented something similar to iceberg, didn't touch the delta repository. It utilizes a class inherited SplitReader.cpp and extract dv info from the query plan in Gluten. And yes, it's not small change. It would be better as it would be hard to merge those changes to open source delta repo. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
