Padma Penumarthy created DRILL-6537:
---------------------------------------
Summary: Limit the batch size for buffering operators based on how
much memory they get
Key: DRILL-6537
URL: https://issues.apache.org/jira/browse/DRILL-6537
Project: Apache Drill
Issue Type: Bug
Components: Execution - Relational Operators
Affects Versions: 1.13.0
Reporter: Padma Penumarthy
Assignee: Padma Penumarthy
Fix For: 1.14.0
we are using 16MB for output batch size for all operators by default. however,
for buffering operators, depending upon how much memory they get allocated, it
is possible that 16MB might be too much to use for output batch size, causing
them to spill sometimes.
Have output batch size to be minimum of 16 MB or 20% of the allocated memory.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
