[ https://issues.apache.org/jira/browse/DRILL-2835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17799618#comment-17799618 ]
ASF GitHub Bot commented on DRILL-2835: --------------------------------------- mbeckerle commented on PR #2836: URL: https://github.com/apache/drill/pull/2836#issuecomment-1867092071 This is pretty much working now, in terms of constructing drill metadata from DFDL schemas, and Daffodil delivering data to Drill. There were dozens of commits to get here, so I squashed them as they were no longer helpful. Obviously more test are needed, but the ones there show nested subrecords working. The issues like how schemas get distributed, and how Daffodil gets invoked in parallel by drill are still open. > IndexOutOfBoundsException in partition sender when doing streaming aggregate > with LIMIT > ---------------------------------------------------------------------------------------- > > Key: DRILL-2835 > URL: https://issues.apache.org/jira/browse/DRILL-2835 > Project: Apache Drill > Issue Type: Bug > Components: Execution - RPC > Affects Versions: 0.8.0 > Reporter: Aman Sinha > Assignee: Venki Korukanti > Priority: Major > Fix For: 0.9.0 > > Attachments: DRILL-2835-1.patch, DRILL-2835-2.patch > > > Following CTAS run on a TPC-DS 100GB scale factor on a 10-node cluster: > {code} > alter session set `planner.enable_hashagg` = false; > alter session set `planner.enable_multiphase_agg` = true; > create table dfs.tmp.stream9 as > select cr_call_center_sk , cr_catalog_page_sk , cr_item_sk , cr_reason_sk , > cr_refunded_addr_sk , count(*) from catalog_returns_dri100 > group by cr_call_center_sk , cr_catalog_page_sk , cr_item_sk , cr_reason_sk > , cr_refunded_addr_sk > limit 100 > ; > {code} > {code} > Caused by: java.lang.IndexOutOfBoundsException: index: 1023, length: 1 > (expected: range(0, 0)) > at io.netty.buffer.DrillBuf.checkIndexD(DrillBuf.java:200) > ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:4.0.24.Final] > at io.netty.buffer.DrillBuf.chk(DrillBuf.java:222) > ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:4.0.24.Final] > at io.netty.buffer.DrillBuf.setByte(DrillBuf.java:621) > ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:4.0.24.Final] > at > org.apache.drill.exec.vector.UInt1Vector$Mutator.set(UInt1Vector.java:342) > ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at > org.apache.drill.exec.vector.NullableBigIntVector$Mutator.set(NullableBigIntVector.java:372) > ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at > org.apache.drill.exec.vector.NullableBigIntVector.copyFrom(NullableBigIntVector.java:284) > ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT] > at > org.apache.drill.exec.test.generated.PartitionerGen4$OutgoingRecordBatch.doEval(PartitionerTemplate.java:370) > ~[na:na] > at > org.apache.drill.exec.test.generated.PartitionerGen4$OutgoingRecordBatch.copy(PartitionerTemplate.java:249) > ~[na:na] > at > org.apache.drill.exec.test.generated.PartitionerGen4.doCopy(PartitionerTemplate.java:208) > ~[na:na] > at > org.apache.drill.exec.test.generated.PartitionerGen4.partitionBatch(PartitionerTemplate.java:176) > ~[na:na] > {code} -- This message was sent by Atlassian Jira (v8.20.10#820010)