Paul Rogers created DRILL-5012: ---------------------------------- Summary: External Sort Batch does not check free space before writing Key: DRILL-5012 URL: https://issues.apache.org/jira/browse/DRILL-5012 Project: Apache Drill Issue Type: Bug Affects Versions: 1.8.0 Reporter: Paul Rogers Priority: Minor
The ExternalSortBatch operator sorts data and spills to disk to control memory usage. The ESB accepts a configured set of output directories. The ESB does not check if sufficient space is available in a directory before writing to it; ESB requires that the admin ensure space is available. Desired fix: skip a directory if it does not contain space to hold the target spill file. (That is, write to the other directories if that have space.) The fix is not fail-safe: two threads may both check and both write. However, the fix reduces the chances of an out-of-disk error for the most obvious cases. -- This message was sent by Atlassian JIRA (v6.3.4#6332)