gortiz commented on code in PR #18519:
URL: https://github.com/apache/pinot/pull/18519#discussion_r3272441024
##########
pinot-query-runtime/src/main/java/org/apache/pinot/query/mailbox/MailboxService.java:
##########
@@ -160,13 +210,18 @@ public InstanceType getInstanceType() {
* not open the underlying channel or acquire any additional resources.
Instead, it will initialize lazily when the
* data is sent for the first time.
*/
+ // TODO: Consider adding an application-level global byte budget for sender
outbound. The
+ // transport-layer WriteBufferWaterMark already caps sender direct memory
per (host, port)
+ // channel, so the OOM the original PR fixed is bounded by watermark.high ×
#peers. A global
+ // byte budget would tighten the bound to a single configurable cap across
all peers, but is
+ // unnecessary unless fan-outs hit hundreds of peers per query.
Review Comment:
I created https://github.com/apache/pinot/issues/18539. Anyway, note that
multiplying these numbers by the number of concurrent opchains and servers is
unrealistic.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]