[
https://issues.apache.org/jira/browse/DRILL-1652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208505#comment-14208505
]
Rahul Challapalli commented on DRILL-1652:
------------------------------------------
select * fails consistently after displaying a few records
Sqlline Error
{code}
java.lang.IllegalStateException
at
org.apache.drill.exec.vector.complex.RepeatedMapVector.put(RepeatedMapVector.java:484)
at
org.apache.drill.exec.vector.complex.RepeatedMapVector.load(RepeatedMapVector.java:463)
at
org.apache.drill.exec.record.RecordBatchLoader.load(RecordBatchLoader.java:91)
at org.apache.drill.jdbc.DrillCursor.next(DrillCursor.java:102)
at
net.hydromatic.avatica.AvaticaResultSet.next(AvaticaResultSet.java:187)
at sqlline.SqlLine$IncrementalRows.hasNext(SqlLine.java:2503)
at sqlline.SqlLine$TableOutputFormat.print(SqlLine.java:2148)
at sqlline.SqlLine.print(SqlLine.java:1809)
at sqlline.SqlLine$Commands.execute(SqlLine.java:3766)
at sqlline.SqlLine$Commands.sql(SqlLine.java:3663)
at sqlline.SqlLine.dispatch(SqlLine.java:889)
at sqlline.SqlLine.begin(SqlLine.java:763)
at sqlline.SqlLine.start(SqlLine.java:498)
at sqlline.SqlLine.main(SqlLine.java:460)
{code}
Drillbit Error :
{code}
ERROR o.a.d.e.p.i.ScreenCreator$ScreenRoot - Failure while sending data to user.
org.apache.drill.exec.rpc.RpcException: java.lang.InterruptedException
at
org.apache.drill.exec.rpc.RemoteConnection.blockOnNotWritable(RemoteConnection.java:56)
[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at org.apache.drill.exec.rpc.RpcBus.send(RpcBus.java:91)
[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.rpc.user.UserServer$UserClientConnection.sendResult(UserServer.java:132)
[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:178)
[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:57)
[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:113)
[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:249)
[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_51]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_51]
at java.lang.Thread.run(Thread.java:744) [na:1.7.0_51]
Caused by: java.lang.InterruptedException: null
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1301)
~[na:1.7.0_51]
at
org.apache.drill.exec.rpc.ResettableBarrier.await(ResettableBarrier.java:70)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.rpc.RemoteConnection$WriteManager.waitForWritable(RemoteConnection.java:80)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.rpc.RemoteConnection.blockOnNotWritable(RemoteConnection.java:53)
[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
... 9 common frames omitted
2014-11-12 19:23:31,304 [1d0f4928-97e4-452c-911f-f30845969f13:frag:0:0] ERROR
o.a.d.e.p.i.ScreenCreator$ScreenRoot - Error
42297541-78de-48d4-b4cd-75785fce543f: Failure while sending fragment to client.
org.apache.drill.exec.rpc.RpcException: java.lang.InterruptedException
at
org.apache.drill.exec.rpc.RemoteConnection.blockOnNotWritable(RemoteConnection.java:56)
[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at org.apache.drill.exec.rpc.RpcBus.send(RpcBus.java:91)
[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.rpc.user.UserServer$UserClientConnection.sendResult(UserServer.java:132)
[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:178)
[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:57)
[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:113)
[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:249)
[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_51]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_51]
at java.lang.Thread.run(Thread.java:744) [na:1.7.0_51]
Caused by: java.lang.InterruptedException: null
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1301)
~[na:1.7.0_51]
at
org.apache.drill.exec.rpc.ResettableBarrier.await(ResettableBarrier.java:70)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.rpc.RemoteConnection$WriteManager.waitForWritable(RemoteConnection.java:80)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.rpc.RemoteConnection.blockOnNotWritable(RemoteConnection.java:53)
[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
... 9 common frames omitted
{code}
> flatten causing the sqlline to hang indefinitely when dealing with 0.1 GB data
> ------------------------------------------------------------------------------
>
> Key: DRILL-1652
> URL: https://issues.apache.org/jira/browse/DRILL-1652
> Project: Apache Drill
> Issue Type: Bug
> Components: Functions - Drill, Storage - JSON
> Reporter: Rahul Challapalli
> Attachments: error.log, select_star_error.log
>
>
> git.commit.id.abbrev=60aa446
> I ran the below test against the private branch of Jason which has some
> patches for bugs related to flatten which are not yet merged into the master.
> I used the below json record and copied it over 100000 times
> {code}
> {
> "uid" : 1,
> "events" : [
> { "evnt_id":"e1", "campaign_id":"c1", "event_name":"e1_name",
> "event_time":1000000},
> { "evnt_id":"e2", "campaign_id":"c1", "event_name":"e2_name",
> "event_time":2000000},
> { "evnt_id":"e3", "campaign_id":"c1", "event_name":"e3_name",
> "event_time":3000000},
> { "evnt_id":"e4", "campaign_id":"c1", "event_name":"e4_name",
> "event_time":4000000},
> { "evnt_id":"e5", "campaign_id":"c2", "event_name":"e5_name",
> "event_time":5000000},
> { "evnt_id":"e6", "campaign_id":"c1", "event_name":"e6_name",
> "event_time":6000000},
> { "evnt_id":"e7", "campaign_id":"c1", "event_name":"e7_name",
> "event_time":7000000},
> { "evnt_id":"e8", "campaign_id":"c2", "event_name":"e8_name",
> "event_time":8000000},
> { "evnt_id":"e9", "campaign_id":"c2", "event_name":"e9_name",
> "event_time":9000000}
> ],
> "transactions" : [
> { "trans_id":"t1", "amount":100, "trans_time":7777777},
> { "trans_id":"t2", "amount":100, "trans_time":8888888}
> ]
> }
> {code}
> The below query which applies a flatten function hangs after returning a few
> thousand records
> {code}
> select uid, flatten(transactions) from `json_kvgenflatten/transactions.json`;
> {code}
> Select * from the file also fails after displaying a bunch of records
> {code}
> select * from `json_kvgenflatten/transactions.json`;
> {code}
> The below query works
> {code}
> select uid from `json_kvgenflatten/transactions.json`;
> {code}
> I attached the error logs for the 2 failing queries
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
