LsomeYeah opened a new pull request, #10587: URL: https://github.com/apache/paimon/pull/10587
### Purpose Paimon map data can contain null keys, while Spark map data does not support them. Previously, only maps with BLOB values checked for null keys. For other map types, a null key could reach Spark unsafe conversion and be interpreted as a regular default key, causing silent data corruption. Validate the actual key array for every map conversion and fail with a clear exception before creating Spark map data. The existing MAP<X, BLOB> behavior and error message are preserved. Null map values remain supported, and queries that do not read the affected map column remain unaffected. ### Tests - `SparkInternalRowTest#testMapBlobRejectsNullKey` - `SparkReadITCase#testReadOrcMapWithNullKey` - Verified with Spark 3 / Scala 2.12 on JDK 8 - Verified with Spark 4 / Scala 2.13 on JDK 17 - `spotless:check` - `git diff --check` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
