rdblue opened a new pull request #1122: URL: https://github.com/apache/iceberg/pull/1122
This is the next step to integrate the spark-3 branch into master. This PR moves classes that depend on DSv2 in Spark 2.x into the spark2 module. The `RewriteDataFilesAction` used Spark reader and writers in its implementation, so this needed to also refactor those classes. This moves writer implementations out of `Writer` to top-level classes, and removes the DSv2 interfaces so that the rewrite action can use the same reader and writer code without a dependency on a DSv2 API. This refactor is a good preparation step because this should be shared between the spark2 and spark3 modules. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
