Re: [PR] [HUDI-7816]: Add SourceProfileSupplier option to SnapshotLoadQuerySplitter [hudi]

2024-05-30 Thread via GitHub


hudi-bot commented on PR #11368:
URL: https://github.com/apache/hudi/pull/11368#issuecomment-2140858256

   
   ## CI report:
   
   * 1dde761d4147e9c1a94914759ca0bfd0f7d23ec7 UNKNOWN
   
   
   Bot commands
 @hudi-bot supports the following commands:
   
- `@hudi-bot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[PR] [HUDI-7816]: Add SourceProfileSupplier option to SnapshotLoadQuerySplitter [hudi]

2024-05-30 Thread via GitHub


mattwong949 opened a new pull request, #11368:
URL: https://github.com/apache/hudi/pull/11368

   ### Change Logs
   
   Expanding the interface of the SnapshotLoadQuerySplitter to accept 
SourceProfileSupplier option.
   
   ### Impact
   
   Some SnapshotLoadQuerySplitter implementations may want to consider a 
SourceProfileSupplier in their logic, allowing source estimations to be used 
when splitting queries.
   
   ### Risk level (write none, low medium or high below)
   
   Low, small change to the API but no logic change within hudi itself.
   
   ### Documentation Update
   
   Updated javadocs for the modified interface
   
   ### Contributor's checklist
   
   - [ ] Read through [contributor's 
guide](https://hudi.apache.org/contribute/how-to-contribute)
   - [ ] Change Logs and Impact were stated clearly
   - [ ] Adequate tests were added if applicable
   - [ ] CI passed
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org