Davis-Zhang-Onehouse opened a new pull request, #20715:
URL: https://github.com/apache/hudi/pull/20715

   ### Describe the issue this Pull Request addresses
   
   issue: #20714
   Part of #20683, RFC-118 (#20684).
   Stacked on #20713: review only the last commit. Until the PRs below it 
merge, this PR also shows their commits.
   
   Media input interfaces of the embedding stream and image preprocessing: 
image header reading, seekable BLOB image input, a streaming PNG writer, 
prepared image payloads and the image row routing of the embedding table schema.
   
   ### Summary and Changelog
   
   - Media input interfaces and the image preprocessor: header reading across 
image providers, a seekable BLOB image input stream, a streaming PNG writer, 
prepared image payloads and handle release.
   - Embedding table schema: image rows, the output schema and page bounds of 
the embedding table's Parquet files (with its Parquet config injector).
   - Image format fixtures and 24 test classes (13 new).
   
   Two direct-writer test fixtures set snappy compression explicitly, because 
master resolves the default codec through the engine configuration. Production 
code is unchanged by that. Only files added earlier in this chain are modified. 
No code was copied from other projects.
   
   ### Impact
   
   The embedding stream can prepare image files. No change outside the new 
source.
   
   ### Risk Level
   
   low: new code paths of the new source. Verified on JDK 11 / Spark 3.5 / 
Scala 2.12 with 251 tests (none skipped), module compilation, checkstyle and 
RAT.
   
   ### Documentation Update
   
   New image settings carry their config documentation; a website page follows 
once the chain lands.
   
   ### Contributor's checklist
   
   - [x] Read through [contributor's 
guide](https://hudi.apache.org/contribute/how-to-contribute)
   - [x] Enough context is provided in the sections above
   - [x] Adequate tests were added if applicable
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

  • [PR] feat(ingest): RFC-118: ... Davis-Zhang-Onehouse (via GitHub) via commits

Reply via email to