9aman commented on PR #16407:
URL: https://github.com/apache/pinot/pull/16407#issuecomment-3116669617
Please correct me if I am wrong here,
This will throttle the ingestion at startup as we have the call to throttler
inside the RealtimeSegmentDataManager. Prior to this change, the state model
factory is registered and the server starts consuming at max possible rate.
1. Till what point does the server used to continue ingesting at this
unguarded rate ?
- I see that we do enable the throttle within the BaseServerStarter ?
2. Was the unrestricted ingestion only limited to initial few batches of the
ingestion ?
- The processStreamEvents is called after every message batch and that's
where the throttling happens.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
