Hey Kunal, We already have MapR 5.2 in production and we are evaluating Drill over Hive. Unfortunately MapR 5.2 supports upto Drill 1.10. If this is a known bug then I will try to request for a patch. Let me know your thoughts.
Thank you Regards Shiv > On Feb 14, 2018, at 11:13 PM, Kunal Khatua <[email protected]> wrote: > > Numerous fixes have gone into Drill since then. Can you try with Drill 1.12 ? > > -----Original Message----- > From: Siva Gudavalli [mailto:[email protected]] > Sent: Wednesday, February 14, 2018 6:23 PM > To: [email protected] > Subject: Drill 1.10 Memory Leak with CTAS + partition by > > Hello, > > I am having an issue with CTAS used along with PARTITION BY. > > I see there is memory leaked by query. Is this a known Bug? I am on Drill > 1.10.0.201707281514 > > > 0: jdbc:drill:schema=dfs> CREATE TABLE by_yr (yr, ngram, occurrances) > PARTITION BY (yr) AS SELECT columns[1] yr, columns[0] ngram, columns[2] > occurrances FROM dfs.`/tmp/googlebooks-eng-all-5gram-20120701-zo.tsv` LIMIT > 100; > Error: SYSTEM ERROR: IllegalStateException: Memory was leaked by query. > Memory leaked: (1114112) > Allocator(op:0:0:0:EasySubScan) 1000000/1114112/1114112/10000000000 > (res/actual/peak/limit) > > > Fragment 0:0 > > [Error Id: fe4e06d5-fdd8-4789-8a06-e99dc0b2566c on bossrnd113060:31010] > (state=,code=0) > 0: jdbc:drill:schema=dfs> CREATE TABLE by_yr (yr, ngram, occurrances) AS > SELECT columns[1] yr, columns[0] ngram, columns[2] occurrances FROM > dfs.`/tmp/googlebooks-eng-all-5gram-20120701-zo.tsv` LIMIT 100; > +-----------+----------------------------+ > | Fragment | Number of records written | > +-----------+----------------------------+ > | 0_0 | 100 | > +-----------+----------------------------+ > 1 row selected (0.221 seconds) > 0: jdbc:drill:schema=dfs> > > > > Please help, if I can fix this memory leak by any configuration changes. > > > Regards > > Shiv
