[ https://issues.apache.org/jira/browse/DRILL-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16067438#comment-16067438 ]
Paul Rogers commented on DRILL-5154: ------------------------------------ [~rkins], this data set is too large to verify on my development machine. Please retry this test using the code from the DRILL-5601 PR. > OOM error in external sort on top of 400GB data set generated using terasort > benchamark > --------------------------------------------------------------------------------------- > > Key: DRILL-5154 > URL: https://issues.apache.org/jira/browse/DRILL-5154 > Project: Apache Drill > Issue Type: Bug > Components: Execution - Relational Operators > Affects Versions: 1.10.0 > Reporter: Rahul Challapalli > Attachments: 27a3de95-e30b-8890-6653-80fd6c49a3a1.sys.drill > > > git.commit.id.abbrev=cf2b7c7 > The below query fails with an OOM in external sort > {code} > No of drillbits : 1 > Nodes in Mapr cluster : 2 > DRILL_MAX_DIRECT_MEMORY="16G" > DRILL_MAX_HEAP="4G" > select * from (select * from > dfs.`/drill/testdata/resource-manager/terasort-data/part-m-00000.tbl` order > by columns[0]) d where d.columns[0] = 'null'; > Error: RESOURCE ERROR: One or more nodes ran out of memory while executing > the query. > Unable to allocate buffer of size 8388608 due to memory limit. Current > allocation: 8441872 > Fragment 1:6 > [Error Id: 87ede736-b480-4286-b472-7694fdd2f7da on qa-node183.qa.lab:31010] > (state=,code=0) > {code} > I attached the logs and the query profile -- This message was sent by Atlassian JIRA (v6.4.14#64029)