yihua opened a new pull request, #20208:
URL: https://github.com/apache/hudi/pull/20208

   ### Describe the issue this Pull Request addresses
   
   issue: #20111
   part of #20064
   
   Stacked on #20112, review that first. Schema-on-read reads and the CDC read 
of a version 6 MERGE_ON_READ table still pay per-task executor overhead on 
master, so their guards cannot go into #20112.
   
   ### Summary and Changelog
   
   Adds those reads to `TestSparkReadExecutorFootprint`: a schema-on-read 
snapshot read of version 6 and current COPY_ON_WRITE and MERGE_ON_READ tables 
must not touch `.hoodie` from the tasks, and the version 6 MERGE_ON_READ CDC 
read gets the `.hoodie` and task size guards. On master the 4 schema-on-read 
rows fail (tasks look up the schema history in `.hoodie` for every file, fixed 
by #20085) and the 2 version 6 MERGE_ON_READ CDC rows fail on the driver (fixed 
by #20071). Merge after both.
   
   ### Impact
   
   Test only.
   
   ### Risk Level
   
   none
   
   ### Documentation Update
   
   none
   
   ### Contributor's checklist
   
   - [ ] Read through [contributor's 
guide](https://hudi.apache.org/contribute/how-to-contribute)
   - [ ] Enough context is provided in the sections above
   - [ ] Adequate tests were added if applicable
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to