Steven Phillips created DRILL-1960: -------------------------------------- Summary: Automatically realloc buffers when vector runs out of space Key: DRILL-1960 URL: https://issues.apache.org/jira/browse/DRILL-1960 Project: Apache Drill Issue Type: Bug Reporter: Steven Phillips
When reaching the end of a buffer, the current way drill handles this is for setSafe() to return false, and then whatever operator is doing the write will send the batch, and the redo the last record. This creates a lot of difficulty, because it sometimes requires being able to "rewind" the input stream to replay the last record. The proposal is to move the handling of buffer sizing and allocation into the value vectors themselves, making it transparent to the user of the value vector. The operators will now no longer have to worry about the possibility that writing into a vector may fail due to lack of space. -- This message was sent by Atlassian JIRA (v6.3.4#6332)