rangareddy commented on issue #17282: URL: https://github.com/apache/hudi/issues/17282#issuecomment-5365812951
This issue was reviewed as part of the JIRA-migrated backlog triage (HUDI-8311). **Findings: needs the reproduction run with a Hive metastore; not decidable from source.** The report is specific - a custom keygen combining `SimpleKeyGenerator` with `TimestampBasedKeyGenerator` produces partition values formatted `YYYY/MM/DD`, and syncing those to Hive fails. The description carries a full Scala reproduction built on the `TestSparkSqlWithCustomKeyGenerator` helpers, which is enough to run directly. Whether such a partition value round-trips through Hive depends on partition-path escaping and on how the synced Hive partition spec is constructed from the path - not something the source settles either way. **This is almost certainly the same fix as #17283 (HUDI-8312)**, which reports the identical failure for the other separator. Suggest merging them, or at least fixing them together, since a solution that handles one separator and not the other would be arbitrary. Worth also checking the other common formats (`YYYYMMDD`, `YYYY-MM-DD-HH`) in the same pass so this does not recur one separator at a time. Keeping this open. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
