diqiu50 opened a new pull request, #11087:
URL: https://github.com/apache/gravitino/pull/11087

   ### What changes were proposed in this pull request?
   
   Improve Iceberg table lifecycle management in the Glue catalog by delegating 
operations to the Iceberg SDK GlueCatalog:
   
   - createTable: use Iceberg SDK for non-register-mode tables to write 
metadata.json to S3
   - loadTable: recover partitioning and sort orders from Iceberg metadata 
(Glue partitionKeys() is empty for Iceberg tables)
   - alterTable: use Iceberg SDK UpdateSchema/UpdateProperties; fall back to 
native Glue SDK for register-mode tables
   - Merge GlueIcebergHelper and GlueIcebergCatalogHelper into 
GlueIcebergTableHelper
   - Support partition transforms (year, month, day, hour, bucket, truncate)
   
   ### Why are the changes needed?
   
   Without Iceberg SDK integration, Glue skips writing metadata.json, making 
tables unreadable by Iceberg-native engines. loadTable also returns empty 
partitioning for Iceberg tables.
   
   Fix: #11086
   
   ### Does this PR introduce _any_ user-facing change?
   
   Yes — users can now create and alter Iceberg tables in Glue via the Iceberg 
SDK.
   
   ### How was this patch tested?
   
   - TestGlueIceberg — 10 unit tests
   - MotoGlueCatalogIT — 24 integration tests (Moto mock)
   - AwsGlueCatalogIT — 24 integration tests (real AWS Glue)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to