tibrewalpratik17 opened a new pull request, #13285: URL: https://github.com/apache/pinot/pull/13285
label: `optimization` `enhancement` This patch enhances the `doTakeSnapshot` flow to not snapshot all segments in a given partition but only the ones which have been updated since last-snapshot taken. This particularly improves scenarios where the number of segments per partition is high. `doTakeSnapshot` workflow runs before new consuming segment starts consumption and directly introduces ingestion lag before starting consumption. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
