cshuo opened a new pull request, #19542: URL: https://github.com/apache/hudi/pull/19542
### Describe the issue this Pull Request addresses Closes #19541. ORC conversion, Parquet binary-copy, and filesystem utilities in `hudi-hadoop-common` lacked focused coverage for type conversion, metadata reads, delegated filesystem operations, retry behavior, path caching, and variant reconstruction. This also left incorrect Avro union matching and output-stream byte accounting undetected. ### Summary and Changelog - Add synthetic Avro/ORC round-trip tests across primitive, logical, complex, union, decimal, enum, and fixed types. - Add ORC metadata, record-key filtering, position, and embedded-schema tests. - Add local-filesystem tests for wrapper delegation, create/copy/move overloads, consistency-guard timeouts, retry behavior, caching paths, and Hadoop filesystem helpers. - Add byte-level Parquet binary-copy path tests and variant reconstruction tests. - Accept Avro logical and binary representations when matching ORC union members. - Avoid double-counting bytes in `SizeAwareFSDataOutputStream.write(byte[])`. Focused local JaCoCo line coverage: | Class | Before | After | | --- | ---: | ---: | | `AvroOrcUtils` | 45% | 82.7% | | `OrcUtils` | 55% | 85.0% | | `HoodieWrapperFileSystem` | 37% | 80.4% | | `HadoopFSUtils` | 57% | 87.0% | | `HoodieParquetBinaryCopyBase` | 69% | 80.6% | | `HoodieRetryWrapperFileSystem` | 45% | 94.2% | | `CachingPath` | 21% | 86.3% | | `HoodieVariantReconstruction` | 32% | 100.0% | Validation: - 11 targeted test classes: 72 tests, 0 failures, 0 errors, 0 skipped. - Maven Checkstyle and Apache RAT checks passed. ### Impact No public API or configuration changes. Runtime behavior changes are limited to accepting the existing Avro representations for date, timestamp, bytes, and decimal union members, and reporting the correct byte count for whole-array output-stream writes. No expected performance impact. ### Risk Level Low. Most changes are focused tests; the two runtime corrections are small and directly covered by the new tests. ### Documentation Update None. ### Contributor's checklist - [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute) - [x] Enough context is provided in the sections above - [x] Adequate tests were added if applicable -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
