Hi All, We’re looking at some improvements to the external sort operator, primarily to better control the amount of memory that the operator requires. DRILL-5080 is the umbrella ticket. Attached to that ticket is a design document that details both the issues we wish to address and how we propose to address them.
Please have a look at the design and offer suggestions. In particular, if any of you have experience with this operator, your insight into the revised design would be very helpful. Thanks, - Paul Jira link: https://issues.apache.org/jira/browse/DRILL-5080