anuragmantri commented on PR #14683:
URL: https://github.com/apache/iceberg/pull/14683#issuecomment-3752309756
Since the original author has not responded yet, let me explain this.
(@jbewing please correct me)
> It looks like the distribution and ordering code is being redone
The distribution/ordering code is not being redone. The changes
differentiate between:
- Spark ordering (for write requirements/distribution) - unchanged behavior
- Iceberg sort order (for setting sort_order_id in manifest files) - new
The new `SparkAndIcebergOrdering` class couples these together. During
writes/rewrites, it validates that the Spark sort order matches a table sort
order ID before writing it to manifests.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
