Jackie-Jiang commented on PR #13597: URL: https://github.com/apache/pinot/pull/13597#issuecomment-2231572794
@mcvsubbu We want to optimize the scenario where multiple clients trying to push segments, each with multiple segments to push, not necessary from minion. The bottleneck right now is that each segment push needs to lock the IS. The idea is to batch multiple IS changes into one to reduce the contention. The batch upload should work along with start/end replace. Currently the flow is start replace -> push, push, push, push, ... -> end replace. With the new API, we can reduce the amount of push requests -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
