[jira] [Commented] (DRILL-4398) SYSTEM ERROR: IllegalStateException: Memory was leaked by query
[
https://issues.apache.org/jira/browse/DRILL-4398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124376#comment-16124376
]
Muhammad Gelbana commented on DRILL-4398:
-
Thanks [~zfong] for the response. I'll open a new issue shortly.
{noformat}
Fragment 0:0
[Error Id: 0403a63e-86cc-428e-929b-e8dcd561a6bf on iWebStitchFixDev:31010]
at
org.apache.drill.common.exceptions.UserException$Builder.build(UserException.java:543)
at
org.apache.drill.exec.work.fragment.FragmentExecutor.sendFinalState(FragmentExecutor.java:293)
at
org.apache.drill.exec.work.fragment.FragmentExecutor.cleanup(FragmentExecutor.java:160)
at
org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:262)
at
org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.drill.exec.rpc.ChannelClosedException: Channel closed
/72.55.136.6:31010 <--> /72.55.136.6:40834.
at
org.apache.drill.exec.rpc.RpcBus$ChannelClosedHandler.operationComplete(RpcBus.java:166)
at
org.apache.drill.exec.rpc.RpcBus$ChannelClosedHandler.operationComplete(RpcBus.java:146)
at
io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:680)
at
io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:603)
at
io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:563)
at
io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:406)
at
io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:82)
at
io.netty.channel.AbstractChannel$CloseFuture.setClosed(AbstractChannel.java:943)
at
io.netty.channel.AbstractChannel$AbstractUnsafe.doClose0(AbstractChannel.java:592)
at
io.netty.channel.AbstractChannel$AbstractUnsafe.close(AbstractChannel.java:584)
at
io.netty.channel.DefaultChannelPipeline$HeadContext.close(DefaultChannelPipeline.java:1099)
at
io.netty.channel.AbstractChannelHandlerContext.invokeClose(AbstractChannelHandlerContext.java:615)
at
io.netty.channel.AbstractChannelHandlerContext.close(AbstractChannelHandlerContext.java:600)
at
io.netty.channel.ChannelOutboundHandlerAdapter.close(ChannelOutboundHandlerAdapter.java:71)
at
io.netty.channel.AbstractChannelHandlerContext.invokeClose(AbstractChannelHandlerContext.java:615)
at
io.netty.channel.AbstractChannelHandlerContext.close(AbstractChannelHandlerContext.java:600)
at
io.netty.channel.AbstractChannelHandlerContext.close(AbstractChannelHandlerContext.java:466)
at
io.netty.handler.timeout.ReadTimeoutHandler.readTimedOut(ReadTimeoutHandler.java:187)
at
org.apache.drill.exec.rpc.BasicServer$LogggingReadTimeoutHandler.readTimedOut(BasicServer.java:121)
at
io.netty.handler.timeout.ReadTimeoutHandler$ReadTimeoutTask.run(ReadTimeoutHandler.java:212)
at
io.netty.util.concurrent.PromiseTask$RunnableAdapter.call(PromiseTask.java:38)
at
io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:120)
at
io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
at
io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
... 1 more
Suppressed: org.apache.drill.exec.rpc.RpcException: Failure sending
message.
at org.apache.drill.exec.rpc.RpcBus.send(RpcBus.java:126)
at
org.apache.drill.exec.rpc.user.UserServer$UserClientConnectionImpl.sendData(UserServer.java:285)
at
org.apache.drill.exec.ops.AccountingUserConnection.sendData(AccountingUserConnection.java:42)
at
org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:118)
at
org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:94)
at
org.apache.drill.exec.work.fragment.FragmentExecutor$1.run(FragmentExecutor.java:232)
at
org.apache.drill.exec.work.fragment.FragmentExecutor$1.run(FragmentExecutor.java:226)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
at
org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:226)
at
[jira] [Commented] (DRILL-4398) SYSTEM ERROR: IllegalStateException: Memory was leaked by query
[ https://issues.apache.org/jira/browse/DRILL-4398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15884846#comment-15884846 ] Zelaine Fong commented on DRILL-4398: - [~mgelbana] - can you share the stack trace from the Drillbit log when you encounter this error. Also, it might be better to log a new issue, as this original issue was reported when selecting from a JDBC data source, which is very likely a different problem. > SYSTEM ERROR: IllegalStateException: Memory was leaked by query > --- > > Key: DRILL-4398 > URL: https://issues.apache.org/jira/browse/DRILL-4398 > Project: Apache Drill > Issue Type: Bug > Components: Storage - JDBC >Affects Versions: 1.5.0 >Reporter: N Campbell >Assignee: Taras Supyk > > Several queries fail with memory leaked errors > select tjoin2.rnum, tjoin1.c1, tjoin2.c1 as c1j2, tjoin2.c2 as c2j2 from > postgres.public.tjoin1 full outer join postgres.public.tjoin2 on tjoin1.c1 = > tjoin2.c1 > select tjoin1.rnum, tjoin1.c1, tjoin2.c1 as c1j2, tjoin2.c2 from > postgres.public.tjoin1, lateral ( select tjoin2.c1, tjoin2.c2 from > postgres.public.tjoin2 where tjoin1.c1=tjoin2.c1) tjoin2 > SYSTEM ERROR: IllegalStateException: Memory was leaked by query. Memory > leaked: (40960) > Allocator(op:0:0:3:JdbcSubScan) 100/40960/135168/100 > (res/actual/peak/limit) > create table TJOIN1 (RNUM integer not null , C1 integer, C2 integer); > insert into TJOIN1 (RNUM, C1, C2) values ( 0, 10, 15); > insert into TJOIN1 (RNUM, C1, C2) values ( 1, 20, 25); > insert into TJOIN1 (RNUM, C1, C2) values ( 2, NULL, 50); > create table TJOIN2 (RNUM integer not null , C1 integer, C2 char(2)); > insert into TJOIN2 (RNUM, C1, C2) values ( 0, 10, 'BB'); > insert into TJOIN2 (RNUM, C1, C2) values ( 1, 15, 'DD'); > insert into TJOIN2 (RNUM, C1, C2) values ( 2, NULL, 'EE'); > insert into TJOIN2 (RNUM, C1, C2) values ( 3, 10, 'FF'); -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (DRILL-4398) SYSTEM ERROR: IllegalStateException: Memory was leaked by query
[
https://issues.apache.org/jira/browse/DRILL-4398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15884730#comment-15884730
]
Muhammad Gelbana commented on DRILL-4398:
-
I face this error using v1.9 after I run very simple queries such as:
{code:sql}
SELECT A1.NAME
FROM
dfs.`/parquet_file_path` A1
LIMIT 10
{code}
Would someone kindly give an update on this ? Or may be a workaround ?
> SYSTEM ERROR: IllegalStateException: Memory was leaked by query
> ---
>
> Key: DRILL-4398
> URL: https://issues.apache.org/jira/browse/DRILL-4398
> Project: Apache Drill
> Issue Type: Bug
> Components: Storage - JDBC
>Affects Versions: 1.5.0
>Reporter: N Campbell
>Assignee: Taras Supyk
>
> Several queries fail with memory leaked errors
> select tjoin2.rnum, tjoin1.c1, tjoin2.c1 as c1j2, tjoin2.c2 as c2j2 from
> postgres.public.tjoin1 full outer join postgres.public.tjoin2 on tjoin1.c1 =
> tjoin2.c1
> select tjoin1.rnum, tjoin1.c1, tjoin2.c1 as c1j2, tjoin2.c2 from
> postgres.public.tjoin1, lateral ( select tjoin2.c1, tjoin2.c2 from
> postgres.public.tjoin2 where tjoin1.c1=tjoin2.c1) tjoin2
> SYSTEM ERROR: IllegalStateException: Memory was leaked by query. Memory
> leaked: (40960)
> Allocator(op:0:0:3:JdbcSubScan) 100/40960/135168/100
> (res/actual/peak/limit)
> create table TJOIN1 (RNUM integer not null , C1 integer, C2 integer);
> insert into TJOIN1 (RNUM, C1, C2) values ( 0, 10, 15);
> insert into TJOIN1 (RNUM, C1, C2) values ( 1, 20, 25);
> insert into TJOIN1 (RNUM, C1, C2) values ( 2, NULL, 50);
> create table TJOIN2 (RNUM integer not null , C1 integer, C2 char(2));
> insert into TJOIN2 (RNUM, C1, C2) values ( 0, 10, 'BB');
> insert into TJOIN2 (RNUM, C1, C2) values ( 1, 15, 'DD');
> insert into TJOIN2 (RNUM, C1, C2) values ( 2, NULL, 'EE');
> insert into TJOIN2 (RNUM, C1, C2) values ( 3, 10, 'FF');
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (DRILL-4398) SYSTEM ERROR: IllegalStateException: Memory was leaked by query
[ https://issues.apache.org/jira/browse/DRILL-4398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15219714#comment-15219714 ] Devender Yadav commented on DRILL-4398: Observed similar issue with SQL Server. Query: select t1.num_tiny, t2.num_small from mssql.dbo.`test01` t1 join mssql.dbo.`test02` t2 on t1.num_int = t2.num_int; Error: SYSTEM ERROR: IllegalStateException: Memory was leaked by query. Memory leaked: (73728) Allocator(op:0:0:3:JdbcSubScan) 100/73728/569344/100 (res/actual/peak/limit) I want to add one more observation. If I create a different plugin with same configuration Say SQL Server plugin name is mssql. I created mssql1 with same configuration and modified query with mssql1 plugin name on 2nd table. select t1.num_tiny, t2.num_small from mssql.dbo.`test01` t1 join mssql1.dbo.`test02` t2 on t1.num_int = t2.num_int; This query returned expected output successfully. > SYSTEM ERROR: IllegalStateException: Memory was leaked by query > --- > > Key: DRILL-4398 > URL: https://issues.apache.org/jira/browse/DRILL-4398 > Project: Apache Drill > Issue Type: Bug > Components: Storage - JDBC >Affects Versions: 1.5.0 >Reporter: N Campbell >Assignee: Taras Supyk > > Several queries fail with memory leaked errors > select tjoin2.rnum, tjoin1.c1, tjoin2.c1 as c1j2, tjoin2.c2 as c2j2 from > postgres.public.tjoin1 full outer join postgres.public.tjoin2 on tjoin1.c1 = > tjoin2.c1 > select tjoin1.rnum, tjoin1.c1, tjoin2.c1 as c1j2, tjoin2.c2 from > postgres.public.tjoin1, lateral ( select tjoin2.c1, tjoin2.c2 from > postgres.public.tjoin2 where tjoin1.c1=tjoin2.c1) tjoin2 > SYSTEM ERROR: IllegalStateException: Memory was leaked by query. Memory > leaked: (40960) > Allocator(op:0:0:3:JdbcSubScan) 100/40960/135168/100 > (res/actual/peak/limit) > create table TJOIN1 (RNUM integer not null , C1 integer, C2 integer); > insert into TJOIN1 (RNUM, C1, C2) values ( 0, 10, 15); > insert into TJOIN1 (RNUM, C1, C2) values ( 1, 20, 25); > insert into TJOIN1 (RNUM, C1, C2) values ( 2, NULL, 50); > create table TJOIN2 (RNUM integer not null , C1 integer, C2 char(2)); > insert into TJOIN2 (RNUM, C1, C2) values ( 0, 10, 'BB'); > insert into TJOIN2 (RNUM, C1, C2) values ( 1, 15, 'DD'); > insert into TJOIN2 (RNUM, C1, C2) values ( 2, NULL, 'EE'); > insert into TJOIN2 (RNUM, C1, C2) values ( 3, 10, 'FF'); -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (DRILL-4398) SYSTEM ERROR: IllegalStateException: Memory was leaked by query
[ https://issues.apache.org/jira/browse/DRILL-4398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15219687#comment-15219687 ] Deneche A. Hakim commented on DRILL-4398: - although it looks similar, this is indeed a different leak. You can see the leaking allocator is different in both cases: JdbcSubScan in the original issue and ExternalSort in this one > SYSTEM ERROR: IllegalStateException: Memory was leaked by query > --- > > Key: DRILL-4398 > URL: https://issues.apache.org/jira/browse/DRILL-4398 > Project: Apache Drill > Issue Type: Bug > Components: Storage - JDBC >Affects Versions: 1.5.0 >Reporter: N Campbell >Assignee: Taras Supyk > > Several queries fail with memory leaked errors > select tjoin2.rnum, tjoin1.c1, tjoin2.c1 as c1j2, tjoin2.c2 as c2j2 from > postgres.public.tjoin1 full outer join postgres.public.tjoin2 on tjoin1.c1 = > tjoin2.c1 > select tjoin1.rnum, tjoin1.c1, tjoin2.c1 as c1j2, tjoin2.c2 from > postgres.public.tjoin1, lateral ( select tjoin2.c1, tjoin2.c2 from > postgres.public.tjoin2 where tjoin1.c1=tjoin2.c1) tjoin2 > SYSTEM ERROR: IllegalStateException: Memory was leaked by query. Memory > leaked: (40960) > Allocator(op:0:0:3:JdbcSubScan) 100/40960/135168/100 > (res/actual/peak/limit) > create table TJOIN1 (RNUM integer not null , C1 integer, C2 integer); > insert into TJOIN1 (RNUM, C1, C2) values ( 0, 10, 15); > insert into TJOIN1 (RNUM, C1, C2) values ( 1, 20, 25); > insert into TJOIN1 (RNUM, C1, C2) values ( 2, NULL, 50); > create table TJOIN2 (RNUM integer not null , C1 integer, C2 char(2)); > insert into TJOIN2 (RNUM, C1, C2) values ( 0, 10, 'BB'); > insert into TJOIN2 (RNUM, C1, C2) values ( 1, 15, 'DD'); > insert into TJOIN2 (RNUM, C1, C2) values ( 2, NULL, 'EE'); > insert into TJOIN2 (RNUM, C1, C2) values ( 3, 10, 'FF'); -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (DRILL-4398) SYSTEM ERROR: IllegalStateException: Memory was leaked by query
[ https://issues.apache.org/jira/browse/DRILL-4398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201810#comment-15201810 ] Matt Keranen commented on DRILL-4398: - Getting similar in 1.6.0 with CTAS into Parquet from csv data stored in HDFS. > SYSTEM ERROR: IllegalStateException: Memory was leaked by query > --- > > Key: DRILL-4398 > URL: https://issues.apache.org/jira/browse/DRILL-4398 > Project: Apache Drill > Issue Type: Bug > Components: Storage - JDBC >Affects Versions: 1.5.0 >Reporter: N Campbell >Assignee: Taras Supyk > > Several queries fail with memory leaked errors > select tjoin2.rnum, tjoin1.c1, tjoin2.c1 as c1j2, tjoin2.c2 as c2j2 from > postgres.public.tjoin1 full outer join postgres.public.tjoin2 on tjoin1.c1 = > tjoin2.c1 > select tjoin1.rnum, tjoin1.c1, tjoin2.c1 as c1j2, tjoin2.c2 from > postgres.public.tjoin1, lateral ( select tjoin2.c1, tjoin2.c2 from > postgres.public.tjoin2 where tjoin1.c1=tjoin2.c1) tjoin2 > SYSTEM ERROR: IllegalStateException: Memory was leaked by query. Memory > leaked: (40960) > Allocator(op:0:0:3:JdbcSubScan) 100/40960/135168/100 > (res/actual/peak/limit) > create table TJOIN1 (RNUM integer not null , C1 integer, C2 integer); > insert into TJOIN1 (RNUM, C1, C2) values ( 0, 10, 15); > insert into TJOIN1 (RNUM, C1, C2) values ( 1, 20, 25); > insert into TJOIN1 (RNUM, C1, C2) values ( 2, NULL, 50); > create table TJOIN2 (RNUM integer not null , C1 integer, C2 char(2)); > insert into TJOIN2 (RNUM, C1, C2) values ( 0, 10, 'BB'); > insert into TJOIN2 (RNUM, C1, C2) values ( 1, 15, 'DD'); > insert into TJOIN2 (RNUM, C1, C2) values ( 2, NULL, 'EE'); > insert into TJOIN2 (RNUM, C1, C2) values ( 3, 10, 'FF'); -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (DRILL-4398) SYSTEM ERROR: IllegalStateException: Memory was leaked by query
[ https://issues.apache.org/jira/browse/DRILL-4398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15175581#comment-15175581 ] Taras Supyk commented on DRILL-4398: Reproduced with oracle > SYSTEM ERROR: IllegalStateException: Memory was leaked by query > --- > > Key: DRILL-4398 > URL: https://issues.apache.org/jira/browse/DRILL-4398 > Project: Apache Drill > Issue Type: Bug > Components: Server >Affects Versions: 1.5.0 >Reporter: N Campbell >Assignee: Taras Supyk > > Several queries fail with memory leaked errors > select tjoin2.rnum, tjoin1.c1, tjoin2.c1 as c1j2, tjoin2.c2 as c2j2 from > postgres.public.tjoin1 full outer join postgres.public.tjoin2 on tjoin1.c1 = > tjoin2.c1 > select tjoin1.rnum, tjoin1.c1, tjoin2.c1 as c1j2, tjoin2.c2 from > postgres.public.tjoin1, lateral ( select tjoin2.c1, tjoin2.c2 from > postgres.public.tjoin2 where tjoin1.c1=tjoin2.c1) tjoin2 > SYSTEM ERROR: IllegalStateException: Memory was leaked by query. Memory > leaked: (40960) > Allocator(op:0:0:3:JdbcSubScan) 100/40960/135168/100 > (res/actual/peak/limit) > create table TJOIN1 (RNUM integer not null , C1 integer, C2 integer); > insert into TJOIN1 (RNUM, C1, C2) values ( 0, 10, 15); > insert into TJOIN1 (RNUM, C1, C2) values ( 1, 20, 25); > insert into TJOIN1 (RNUM, C1, C2) values ( 2, NULL, 50); > create table TJOIN2 (RNUM integer not null , C1 integer, C2 char(2)); > insert into TJOIN2 (RNUM, C1, C2) values ( 0, 10, 'BB'); > insert into TJOIN2 (RNUM, C1, C2) values ( 1, 15, 'DD'); > insert into TJOIN2 (RNUM, C1, C2) values ( 2, NULL, 'EE'); > insert into TJOIN2 (RNUM, C1, C2) values ( 3, 10, 'FF'); -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (DRILL-4398) SYSTEM ERROR: IllegalStateException: Memory was leaked by query
[ https://issues.apache.org/jira/browse/DRILL-4398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15168879#comment-15168879 ] Taras Supyk commented on DRILL-4398: Confirmed in both queries > SYSTEM ERROR: IllegalStateException: Memory was leaked by query > --- > > Key: DRILL-4398 > URL: https://issues.apache.org/jira/browse/DRILL-4398 > Project: Apache Drill > Issue Type: Bug > Components: Server >Affects Versions: 1.5.0 >Reporter: N Campbell >Assignee: Taras Supyk > > Several queries fail with memory leaked errors > select tjoin2.rnum, tjoin1.c1, tjoin2.c1 as c1j2, tjoin2.c2 as c2j2 from > postgres.public.tjoin1 full outer join postgres.public.tjoin2 on tjoin1.c1 = > tjoin2.c1 > select tjoin1.rnum, tjoin1.c1, tjoin2.c1 as c1j2, tjoin2.c2 from > postgres.public.tjoin1, lateral ( select tjoin2.c1, tjoin2.c2 from > postgres.public.tjoin2 where tjoin1.c1=tjoin2.c1) tjoin2 > SYSTEM ERROR: IllegalStateException: Memory was leaked by query. Memory > leaked: (40960) > Allocator(op:0:0:3:JdbcSubScan) 100/40960/135168/100 > (res/actual/peak/limit) > create table TJOIN1 (RNUM integer not null , C1 integer, C2 integer); > insert into TJOIN1 (RNUM, C1, C2) values ( 0, 10, 15); > insert into TJOIN1 (RNUM, C1, C2) values ( 1, 20, 25); > insert into TJOIN1 (RNUM, C1, C2) values ( 2, NULL, 50); > create table TJOIN2 (RNUM integer not null , C1 integer, C2 char(2)); > insert into TJOIN2 (RNUM, C1, C2) values ( 0, 10, 'BB'); > insert into TJOIN2 (RNUM, C1, C2) values ( 1, 15, 'DD'); > insert into TJOIN2 (RNUM, C1, C2) values ( 2, NULL, 'EE'); > insert into TJOIN2 (RNUM, C1, C2) values ( 3, 10, 'FF'); -- This message was sent by Atlassian JIRA (v6.3.4#6332)
