[
https://issues.apache.org/jira/browse/DRILL-1652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208625#comment-14208625
]
Rahul Challapalli commented on DRILL-1652:
------------------------------------------
The above failure seems to be sqlline specific, since I am not hitting this
with JDBC. I submitted the same query 4 times with JDBC and it was successful
each time.
However the below query seems to be failing everytime from sqlline and jdbc
Query :
{code}
select uid, flatten(events), flatten(transactions) from
`json_kvgenflatten/transactions.json`;
{code}
Error:
{code}
java.lang.UnsupportedOperationException: null
at
org.apache.drill.exec.vector.complex.MapVector$MapTransferPair.splitAndTransfer(MapVector.java:283)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.test.generated.ProjectorGen956.projectRecords(ProjectorTemplate.java:70)
~[na:na]
at
org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.doWork(ProjectRecordBatch.java:149)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:89)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:129)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:106)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:124)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:86)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:76)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:52)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.flatten.FlattenRecordBatch.innerNext(FlattenRecordBatch.java:121)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:106)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:124)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:86)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:76)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:52)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:129)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:106)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:124)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:67)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:122)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:57)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:113)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:249)
[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_51]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_51]
at java.lang.Thread.run(Thread.java:744)
{code}
> flatten causing the sqlline to hang indefinitely when dealing with 0.1 GB data
> ------------------------------------------------------------------------------
>
> Key: DRILL-1652
> URL: https://issues.apache.org/jira/browse/DRILL-1652
> Project: Apache Drill
> Issue Type: Bug
> Components: Functions - Drill, Storage - JSON
> Reporter: Rahul Challapalli
> Attachments: error.log, select_star_error.log
>
>
> git.commit.id.abbrev=60aa446
> I ran the below test against the private branch of Jason which has some
> patches for bugs related to flatten which are not yet merged into the master.
> I used the below json record and copied it over 100000 times
> {code}
> {
> "uid" : 1,
> "events" : [
> { "evnt_id":"e1", "campaign_id":"c1", "event_name":"e1_name",
> "event_time":1000000},
> { "evnt_id":"e2", "campaign_id":"c1", "event_name":"e2_name",
> "event_time":2000000},
> { "evnt_id":"e3", "campaign_id":"c1", "event_name":"e3_name",
> "event_time":3000000},
> { "evnt_id":"e4", "campaign_id":"c1", "event_name":"e4_name",
> "event_time":4000000},
> { "evnt_id":"e5", "campaign_id":"c2", "event_name":"e5_name",
> "event_time":5000000},
> { "evnt_id":"e6", "campaign_id":"c1", "event_name":"e6_name",
> "event_time":6000000},
> { "evnt_id":"e7", "campaign_id":"c1", "event_name":"e7_name",
> "event_time":7000000},
> { "evnt_id":"e8", "campaign_id":"c2", "event_name":"e8_name",
> "event_time":8000000},
> { "evnt_id":"e9", "campaign_id":"c2", "event_name":"e9_name",
> "event_time":9000000}
> ],
> "transactions" : [
> { "trans_id":"t1", "amount":100, "trans_time":7777777},
> { "trans_id":"t2", "amount":100, "trans_time":8888888}
> ]
> }
> {code}
> The below query which applies a flatten function hangs after returning a few
> thousand records
> {code}
> select uid, flatten(transactions) from `json_kvgenflatten/transactions.json`;
> {code}
> Select * from the file also fails after displaying a bunch of records
> {code}
> select * from `json_kvgenflatten/transactions.json`;
> {code}
> The below query works
> {code}
> select uid from `json_kvgenflatten/transactions.json`;
> {code}
> I attached the error logs for the 2 failing queries
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
