Hi, I have been working on a design to do Output Batch Sizing in Project using the RecordBatchSizer. The main challenge lies in dealing with expressions that produce variable-length output columns. The following doc talks about a design for dealing with such variable-length output columns.
Please take a look and provide your comments https://docs.google.com/document/d/1h0WsQsen6xqqAyyYSrtiAniQpVZGmQNQqC1I2DJaxAA/edit?usp=sharing This work will be tracked by DRILL-6340<https://issues.apache.org/jira/browse/DRILL-6340> Thanks Karthik