yihua opened a new pull request, #19565:
URL: https://github.com/apache/hudi/pull/19565

   ### Describe the issue this Pull Request addresses
   
   Closes #19561
   
   ### Summary and Changelog
   
   Table creation hardcoded `hoodie.archivelog.folder` to the timeline layout 
version 2 default, `history`, whatever the table version. Tables below version 
8 use layout version 1, which reads that config to locate the archived 
timeline, so they archived into `.hoodie/history` instead of `.hoodie/archived`.
   
   The streamer, both bootstrap executors, the Spark SQL writer, and the Flink 
`StreamerUtil` now pass through only a user-configured value, so `TableBuilder` 
falls back to `archived`. `TestStreamSync` covers table versions 6 to 9 plus an 
explicitly configured path; reverting the streamer change fails the version 6 
case.
   
   ### Impact
   
   New tables below version 8 archive into `.hoodie/archived`, matching the 
metadata table. Tables at version 8 and above now record `archived` instead of 
`history`, which layout version 2 never reads (and which is the correct value 
after a downgrade, since `EightToSevenDowngradeHandler` writes to 
`.hoodie/archived`). Existing tables are not modified. No public API change.
   
   ### Risk Level
   
   low
   
   ### Documentation Update
   
   none
   
   ### Contributor's checklist
   
   - [x] Read through [contributor's 
guide](https://hudi.apache.org/contribute/how-to-contribute)
   - [x] Enough context is provided in the sections above
   - [x] Adequate tests were added if applicable
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to