[ https://issues.apache.org/jira/browse/DRILL-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728330#comment-14728330 ]
Victoria Markman commented on DRILL-3691: ----------------------------------------- Hakim, I think DRILL-3673, DRILL-3684 and DRILL-3691 (this one) are all the same issue that was fixed with your commit (git.commit.id=b0e9e7c085a3106a612e400cd1732b6ec6267268) You can resolve this one as well. Vicky. Verified that this case works with: #Generated by Git-Commit-Id-Plugin #Tue Sep 01 18:18:19 UTC 2015 git.commit.id.abbrev=b0e9e7c git.commit.user.email=adene...@gmail.com git.commit.message.full=DRILL-3684\: CTAS \: Memory Leak when using CTAS with tpch sf100\n\nThis closes \#141\n git.commit.id=b0e9e7c085a3106a612e400cd1732b6ec6267268 Repro ran on a single node with 8GB direct memory with assertions disabled. {code} 0: jdbc:drill:schema=dfs> select * from sys.options where status like '%CHANGED%'; +-----------------------------------+----------+----------+----------+----------+-------------+-----------+------------+ | name | kind | type | status | num_val | string_val | bool_val | float_val | +-----------------------------------+----------+----------+----------+----------+-------------+-----------+------------+ | planner.enable_decimal_data_type | BOOLEAN | SYSTEM | CHANGED | null | null | true | null | | store.parquet.block-size | LONG | SYSTEM | CHANGED | 204800 | null | null | null | | store.parquet.block-size | LONG | SESSION | CHANGED | 1030000 | null | null | null | +-----------------------------------+----------+----------+----------+----------+-------------+-----------+------------+ 3 rows selected (0.596 seconds) n 0: jdbc:drill:schema=dfs> create table lineitem_x as select * from lineitem; +-----------+----------------------------+ | Fragment | Number of records written | +-----------+----------------------------+ | 1_15 | 9021944 | | 1_18 | 19397748 | | 1_21 | 19372179 | | 1_22 | 24339845 | | 1_19 | 24254278 | | 1_20 | 24477920 | | 1_16 | 24285361 | | 1_17 | 24552607 | | 1_8 | 25169766 | | 1_12 | 25424111 | | 1_6 | 25430604 | | 1_1 | 25485077 | | 1_5 | 25704889 | | 1_11 | 28519960 | | 1_3 | 30363826 | | 1_2 | 30318160 | | 1_0 | 30572103 | | 1_13 | 30425261 | | 1_9 | 30364369 | | 1_7 | 30603123 | | 1_10 | 30379358 | | 1_4 | 30587344 | | 1_14 | 30988069 | +-----------+----------------------------+ 23 rows selected (1888.63 seconds) 0: jdbc:drill:schema=dfs> select count(*) from lineitem_x; +------------+ | EXPR$0 | +------------+ | 600037902 | +------------+ 1 row selected (231.722 seconds) 0: jdbc:drill:schema=dfs> select count(*) from lineitem; +------------+ | EXPR$0 | +------------+ | 600037902 | +------------+ 1 row selected (1.245 seconds) {code} > CTAS Memory Leak : IllegalStateException > ---------------------------------------- > > Key: DRILL-3691 > URL: https://issues.apache.org/jira/browse/DRILL-3691 > Project: Apache Drill > Issue Type: Bug > Components: Storage - Parquet > Reporter: Rahul Challapalli > Assignee: Deneche A. Hakim > Attachments: error.log > > > git.commit.id.abbrev=55dfd0e > The below CTAS statement fails with a memory leak. The query runs on top of > Tpch SF100 data. > {code} > create table lineitem as select * from dfs.`/drill/testdata/tpch100/lineitem`; > java.sql.SQLException: SYSTEM ERROR: IllegalStateException: Failure while > closing accountor. Expected private and shared pools to be set to initial > values. However, one or more were not. Stats are > zone init allocated delta > private 1000000 1000000 0 > shared 9999000000 9998410176 589824. > Fragment 1:19 > [Error Id: ba8fedf2-be40-4488-af2e-b6034527c943 on qa-node191.qa.lab:31010] > Aborting command set because "force" is false and command failed: "create > table lineitem as select * from dfs.`/drill/testdata/tpch100/lineitem`;" > {code} > I attached the log file. I am not uploading the data as it is too large -- This message was sent by Atlassian JIRA (v6.3.4#6332)