Limess opened a new issue, #11554: URL: https://github.com/apache/hudi/issues/11554
**Describe the problem you faced** Glue sync fails with INSERT_OVERWRITE when previous partitions are not included in new load. In our case, we have a couple of years worth of data, but only want to load the last `n` days, overwriting the old table. Deleting the old, now defunct partitions fails. **To Reproduce** Steps to reproduce the behavior: 1. Create a Hudi table in AWS Glue with partition name strings exceeding 2048 combined + additional which *will* be included in step 2 2. INSERT_OVERWRITE into the same table, excluding any previous partitions, exceeding 2048 combined 3. Observe failure **Expected behavior** Partitions are removed from AWS Glue catalog correctly. **Environment Description** * Hudi version : 0.14.1-amzn-0 * Spark version : 3.5.0 * Storage (HDFS/S3/GCS..) : S3 * Running on Docker? (yes/no) : no **Additional context** EMR 7.1.0 **Stacktrace** [stacktrace.txt](https://github.com/user-attachments/files/16072826/stacktrace.txt) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
