Stephan Ewen created FLINK-1296: ----------------------------------- Summary: Add support for very large record for sorting Key: FLINK-1296 URL: https://issues.apache.org/jira/browse/FLINK-1296 Project: Flink Issue Type: Bug Components: Local Runtime Affects Versions: 0.8-incubating Reporter: Stephan Ewen Assignee: Stephan Ewen Fix For: 0.8-incubating
Currently, very large records (multiple hundreds of megabytes) can break the sorter if the overflow the sort buffer. Furthermore, if a merge is attempted of those records, pulling multiple of them concurrently into memory can break the machine memory. -- This message was sent by Atlassian JIRA (v6.3.4#6332)