[jira] [Commented] (DRILL-4205) Simple query hit IndexOutOfBoundException
[ https://issues.apache.org/jira/browse/DRILL-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15067358#comment-15067358 ] Dechang Gu commented on DRILL-4205: --- Found the patch in the Apache Drill master repo. And tested it -- looks likes the issue is resolved. Thanks, Dechang > Simple query hit IndexOutOfBoundException > -- > > Key: DRILL-4205 > URL: https://issues.apache.org/jira/browse/DRILL-4205 > Project: Apache Drill > Issue Type: Bug > Components: Functions - Drill >Affects Versions: 1.4.0 >Reporter: Dechang Gu >Assignee: Parth Chandra > > The following query failed due to IOB: > 0: jdbc:drill:schema=wf_pigprq100> select * from > `store_sales/part-m-00073.parquet`; > Error: SYSTEM ERROR: IndexOutOfBoundsException: srcIndex: 1048587 > Fragment 0:0 > [Error Id: ad8d2bc0-259f-483c-9024-93865963541e on ucs-node4.perf.lab:31010] > (org.apache.drill.common.exceptions.DrillRuntimeException) Error in parquet > record reader. > Message: > Hadoop path: /tpcdsPigParq/SF100/store_sales/part-m-00073.parquet > Total records read: 135280 > Mock records read: 0 > Records to read: 1424 > Row group index: 0 > Records in row group: 3775712 > Parquet Metadata: ParquetMetaData{FileMetaData{schema: message pig_schema { > optional int64 ss_sold_date_sk; > optional int64 ss_sold_time_sk; > optional int64 ss_item_sk; > optional int64 ss_customer_sk; > optional int64 ss_cdemo_sk; > optional int64 ss_hdemo_sk; > optional int64 ss_addr_sk; > optional int64 ss_store_sk; > optional int64 ss_promo_sk; > optional int64 ss_ticket_number; > optional int64 ss_quantity; > optional double ss_wholesale_cost; > optional double ss_list_price; > optional double ss_sales_price; > optional double ss_ext_discount_amt; > optional double ss_ext_sales_price; > optional double ss_ext_wholesale_cost; > optional double ss_ext_list_price; > optional double ss_ext_tax; > optional double ss_coupon_amt; > optional double ss_net_paid; > optional double ss_net_paid_inc_tax; > optional double ss_net_profit; > } -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (DRILL-4205) Simple query hit IndexOutOfBoundException
[ https://issues.apache.org/jira/browse/DRILL-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15067182#comment-15067182 ] Dechang Gu commented on DRILL-4205: --- Parth, which repo is this fix ( abdfc6a ) in?I looked in your repo https://github.com/parthchandra/incubator-drill/commits/DRILL-4205 , but could not find this commit (the top commit id is aaa6bb850b9de1e86afe2e0a5afad90d753fca04 > Simple query hit IndexOutOfBoundException > -- > > Key: DRILL-4205 > URL: https://issues.apache.org/jira/browse/DRILL-4205 > Project: Apache Drill > Issue Type: Bug > Components: Functions - Drill >Affects Versions: 1.4.0 >Reporter: Dechang Gu >Assignee: Parth Chandra > > The following query failed due to IOB: > 0: jdbc:drill:schema=wf_pigprq100> select * from > `store_sales/part-m-00073.parquet`; > Error: SYSTEM ERROR: IndexOutOfBoundsException: srcIndex: 1048587 > Fragment 0:0 > [Error Id: ad8d2bc0-259f-483c-9024-93865963541e on ucs-node4.perf.lab:31010] > (org.apache.drill.common.exceptions.DrillRuntimeException) Error in parquet > record reader. > Message: > Hadoop path: /tpcdsPigParq/SF100/store_sales/part-m-00073.parquet > Total records read: 135280 > Mock records read: 0 > Records to read: 1424 > Row group index: 0 > Records in row group: 3775712 > Parquet Metadata: ParquetMetaData{FileMetaData{schema: message pig_schema { > optional int64 ss_sold_date_sk; > optional int64 ss_sold_time_sk; > optional int64 ss_item_sk; > optional int64 ss_customer_sk; > optional int64 ss_cdemo_sk; > optional int64 ss_hdemo_sk; > optional int64 ss_addr_sk; > optional int64 ss_store_sk; > optional int64 ss_promo_sk; > optional int64 ss_ticket_number; > optional int64 ss_quantity; > optional double ss_wholesale_cost; > optional double ss_list_price; > optional double ss_sales_price; > optional double ss_ext_discount_amt; > optional double ss_ext_sales_price; > optional double ss_ext_wholesale_cost; > optional double ss_ext_list_price; > optional double ss_ext_tax; > optional double ss_coupon_amt; > optional double ss_net_paid; > optional double ss_net_paid_inc_tax; > optional double ss_net_profit; > } -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (DRILL-4205) Simple query hit IndexOutOfBoundException
[ https://issues.apache.org/jira/browse/DRILL-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15063274#comment-15063274 ] ASF GitHub Bot commented on DRILL-4205: --- Github user asfgit closed the pull request at: https://github.com/apache/drill/pull/306 > Simple query hit IndexOutOfBoundException > -- > > Key: DRILL-4205 > URL: https://issues.apache.org/jira/browse/DRILL-4205 > Project: Apache Drill > Issue Type: Bug > Components: Functions - Drill >Affects Versions: 1.4.0 >Reporter: Dechang Gu >Assignee: Parth Chandra > > The following query failed due to IOB: > 0: jdbc:drill:schema=wf_pigprq100> select * from > `store_sales/part-m-00073.parquet`; > Error: SYSTEM ERROR: IndexOutOfBoundsException: srcIndex: 1048587 > Fragment 0:0 > [Error Id: ad8d2bc0-259f-483c-9024-93865963541e on ucs-node4.perf.lab:31010] > (org.apache.drill.common.exceptions.DrillRuntimeException) Error in parquet > record reader. > Message: > Hadoop path: /tpcdsPigParq/SF100/store_sales/part-m-00073.parquet > Total records read: 135280 > Mock records read: 0 > Records to read: 1424 > Row group index: 0 > Records in row group: 3775712 > Parquet Metadata: ParquetMetaData{FileMetaData{schema: message pig_schema { > optional int64 ss_sold_date_sk; > optional int64 ss_sold_time_sk; > optional int64 ss_item_sk; > optional int64 ss_customer_sk; > optional int64 ss_cdemo_sk; > optional int64 ss_hdemo_sk; > optional int64 ss_addr_sk; > optional int64 ss_store_sk; > optional int64 ss_promo_sk; > optional int64 ss_ticket_number; > optional int64 ss_quantity; > optional double ss_wholesale_cost; > optional double ss_list_price; > optional double ss_sales_price; > optional double ss_ext_discount_amt; > optional double ss_ext_sales_price; > optional double ss_ext_wholesale_cost; > optional double ss_ext_list_price; > optional double ss_ext_tax; > optional double ss_coupon_amt; > optional double ss_net_paid; > optional double ss_net_paid_inc_tax; > optional double ss_net_profit; > } -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (DRILL-4205) Simple query hit IndexOutOfBoundException
[ https://issues.apache.org/jira/browse/DRILL-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15063277#comment-15063277 ] Parth Chandra commented on DRILL-4205: -- Fixed in abdfc6a > Simple query hit IndexOutOfBoundException > -- > > Key: DRILL-4205 > URL: https://issues.apache.org/jira/browse/DRILL-4205 > Project: Apache Drill > Issue Type: Bug > Components: Functions - Drill >Affects Versions: 1.4.0 >Reporter: Dechang Gu >Assignee: Parth Chandra > > The following query failed due to IOB: > 0: jdbc:drill:schema=wf_pigprq100> select * from > `store_sales/part-m-00073.parquet`; > Error: SYSTEM ERROR: IndexOutOfBoundsException: srcIndex: 1048587 > Fragment 0:0 > [Error Id: ad8d2bc0-259f-483c-9024-93865963541e on ucs-node4.perf.lab:31010] > (org.apache.drill.common.exceptions.DrillRuntimeException) Error in parquet > record reader. > Message: > Hadoop path: /tpcdsPigParq/SF100/store_sales/part-m-00073.parquet > Total records read: 135280 > Mock records read: 0 > Records to read: 1424 > Row group index: 0 > Records in row group: 3775712 > Parquet Metadata: ParquetMetaData{FileMetaData{schema: message pig_schema { > optional int64 ss_sold_date_sk; > optional int64 ss_sold_time_sk; > optional int64 ss_item_sk; > optional int64 ss_customer_sk; > optional int64 ss_cdemo_sk; > optional int64 ss_hdemo_sk; > optional int64 ss_addr_sk; > optional int64 ss_store_sk; > optional int64 ss_promo_sk; > optional int64 ss_ticket_number; > optional int64 ss_quantity; > optional double ss_wholesale_cost; > optional double ss_list_price; > optional double ss_sales_price; > optional double ss_ext_discount_amt; > optional double ss_ext_sales_price; > optional double ss_ext_wholesale_cost; > optional double ss_ext_list_price; > optional double ss_ext_tax; > optional double ss_coupon_amt; > optional double ss_net_paid; > optional double ss_net_paid_inc_tax; > optional double ss_net_profit; > } -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (DRILL-4205) Simple query hit IndexOutOfBoundException
[ https://issues.apache.org/jira/browse/DRILL-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15063177#comment-15063177 ] ASF GitHub Bot commented on DRILL-4205: --- Github user adeneche commented on the pull request: https://github.com/apache/drill/pull/306#issuecomment-165624553 +1, LGTM We should try and add a test to the public test framework, once this PR is merged > Simple query hit IndexOutOfBoundException > -- > > Key: DRILL-4205 > URL: https://issues.apache.org/jira/browse/DRILL-4205 > Project: Apache Drill > Issue Type: Bug > Components: Functions - Drill >Affects Versions: 1.4.0 >Reporter: Dechang Gu >Assignee: Parth Chandra > > The following query failed due to IOB: > 0: jdbc:drill:schema=wf_pigprq100> select * from > `store_sales/part-m-00073.parquet`; > Error: SYSTEM ERROR: IndexOutOfBoundsException: srcIndex: 1048587 > Fragment 0:0 > [Error Id: ad8d2bc0-259f-483c-9024-93865963541e on ucs-node4.perf.lab:31010] > (org.apache.drill.common.exceptions.DrillRuntimeException) Error in parquet > record reader. > Message: > Hadoop path: /tpcdsPigParq/SF100/store_sales/part-m-00073.parquet > Total records read: 135280 > Mock records read: 0 > Records to read: 1424 > Row group index: 0 > Records in row group: 3775712 > Parquet Metadata: ParquetMetaData{FileMetaData{schema: message pig_schema { > optional int64 ss_sold_date_sk; > optional int64 ss_sold_time_sk; > optional int64 ss_item_sk; > optional int64 ss_customer_sk; > optional int64 ss_cdemo_sk; > optional int64 ss_hdemo_sk; > optional int64 ss_addr_sk; > optional int64 ss_store_sk; > optional int64 ss_promo_sk; > optional int64 ss_ticket_number; > optional int64 ss_quantity; > optional double ss_wholesale_cost; > optional double ss_list_price; > optional double ss_sales_price; > optional double ss_ext_discount_amt; > optional double ss_ext_sales_price; > optional double ss_ext_wholesale_cost; > optional double ss_ext_list_price; > optional double ss_ext_tax; > optional double ss_coupon_amt; > optional double ss_net_paid; > optional double ss_net_paid_inc_tax; > optional double ss_net_profit; > } -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (DRILL-4205) Simple query hit IndexOutOfBoundException
[ https://issues.apache.org/jira/browse/DRILL-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15063173#comment-15063173 ] ASF GitHub Bot commented on DRILL-4205: --- Github user parthchandra commented on the pull request: https://github.com/apache/drill/pull/306#issuecomment-165624400 The test file for this is 600MB which is too large for a unit test. I would recommend we add this to the regression test suite. > Simple query hit IndexOutOfBoundException > -- > > Key: DRILL-4205 > URL: https://issues.apache.org/jira/browse/DRILL-4205 > Project: Apache Drill > Issue Type: Bug > Components: Functions - Drill >Affects Versions: 1.4.0 >Reporter: Dechang Gu >Assignee: Parth Chandra > > The following query failed due to IOB: > 0: jdbc:drill:schema=wf_pigprq100> select * from > `store_sales/part-m-00073.parquet`; > Error: SYSTEM ERROR: IndexOutOfBoundsException: srcIndex: 1048587 > Fragment 0:0 > [Error Id: ad8d2bc0-259f-483c-9024-93865963541e on ucs-node4.perf.lab:31010] > (org.apache.drill.common.exceptions.DrillRuntimeException) Error in parquet > record reader. > Message: > Hadoop path: /tpcdsPigParq/SF100/store_sales/part-m-00073.parquet > Total records read: 135280 > Mock records read: 0 > Records to read: 1424 > Row group index: 0 > Records in row group: 3775712 > Parquet Metadata: ParquetMetaData{FileMetaData{schema: message pig_schema { > optional int64 ss_sold_date_sk; > optional int64 ss_sold_time_sk; > optional int64 ss_item_sk; > optional int64 ss_customer_sk; > optional int64 ss_cdemo_sk; > optional int64 ss_hdemo_sk; > optional int64 ss_addr_sk; > optional int64 ss_store_sk; > optional int64 ss_promo_sk; > optional int64 ss_ticket_number; > optional int64 ss_quantity; > optional double ss_wholesale_cost; > optional double ss_list_price; > optional double ss_sales_price; > optional double ss_ext_discount_amt; > optional double ss_ext_sales_price; > optional double ss_ext_wholesale_cost; > optional double ss_ext_list_price; > optional double ss_ext_tax; > optional double ss_coupon_amt; > optional double ss_net_paid; > optional double ss_net_paid_inc_tax; > optional double ss_net_profit; > } -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (DRILL-4205) Simple query hit IndexOutOfBoundException
[ https://issues.apache.org/jira/browse/DRILL-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062964#comment-15062964 ] ASF GitHub Bot commented on DRILL-4205: --- Github user adeneche commented on the pull request: https://github.com/apache/drill/pull/306#issuecomment-165599123 can we add a unit test ? thanks > Simple query hit IndexOutOfBoundException > -- > > Key: DRILL-4205 > URL: https://issues.apache.org/jira/browse/DRILL-4205 > Project: Apache Drill > Issue Type: Bug > Components: Functions - Drill >Affects Versions: 1.4.0 >Reporter: Dechang Gu >Assignee: Parth Chandra > > The following query failed due to IOB: > 0: jdbc:drill:schema=wf_pigprq100> select * from > `store_sales/part-m-00073.parquet`; > Error: SYSTEM ERROR: IndexOutOfBoundsException: srcIndex: 1048587 > Fragment 0:0 > [Error Id: ad8d2bc0-259f-483c-9024-93865963541e on ucs-node4.perf.lab:31010] > (org.apache.drill.common.exceptions.DrillRuntimeException) Error in parquet > record reader. > Message: > Hadoop path: /tpcdsPigParq/SF100/store_sales/part-m-00073.parquet > Total records read: 135280 > Mock records read: 0 > Records to read: 1424 > Row group index: 0 > Records in row group: 3775712 > Parquet Metadata: ParquetMetaData{FileMetaData{schema: message pig_schema { > optional int64 ss_sold_date_sk; > optional int64 ss_sold_time_sk; > optional int64 ss_item_sk; > optional int64 ss_customer_sk; > optional int64 ss_cdemo_sk; > optional int64 ss_hdemo_sk; > optional int64 ss_addr_sk; > optional int64 ss_store_sk; > optional int64 ss_promo_sk; > optional int64 ss_ticket_number; > optional int64 ss_quantity; > optional double ss_wholesale_cost; > optional double ss_list_price; > optional double ss_sales_price; > optional double ss_ext_discount_amt; > optional double ss_ext_sales_price; > optional double ss_ext_wholesale_cost; > optional double ss_ext_list_price; > optional double ss_ext_tax; > optional double ss_coupon_amt; > optional double ss_net_paid; > optional double ss_net_paid_inc_tax; > optional double ss_net_profit; > } -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (DRILL-4205) Simple query hit IndexOutOfBoundException
[ https://issues.apache.org/jira/browse/DRILL-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062693#comment-15062693 ] ASF GitHub Bot commented on DRILL-4205: --- GitHub user parthchandra opened a pull request: https://github.com/apache/drill/pull/306 DRILL-4205: Reset readStart every time a new page is read. The readStart index was not being reset every time a new page was read and caused an array index out of bounds. You can merge this pull request into a Git repository by running: $ git pull https://github.com/parthchandra/incubator-drill DRILL-4205 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/drill/pull/306.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #306 commit aaa6bb850b9de1e86afe2e0a5afad90d753fca04 Author: Parth Chandra Date: 2015-12-16T23:25:26Z DRILL-4205: Reset readStart every time a new page is read. > Simple query hit IndexOutOfBoundException > -- > > Key: DRILL-4205 > URL: https://issues.apache.org/jira/browse/DRILL-4205 > Project: Apache Drill > Issue Type: Bug > Components: Functions - Drill >Affects Versions: 1.4.0 >Reporter: Dechang Gu >Assignee: Parth Chandra > > The following query failed due to IOB: > 0: jdbc:drill:schema=wf_pigprq100> select * from > `store_sales/part-m-00073.parquet`; > Error: SYSTEM ERROR: IndexOutOfBoundsException: srcIndex: 1048587 > Fragment 0:0 > [Error Id: ad8d2bc0-259f-483c-9024-93865963541e on ucs-node4.perf.lab:31010] > (org.apache.drill.common.exceptions.DrillRuntimeException) Error in parquet > record reader. > Message: > Hadoop path: /tpcdsPigParq/SF100/store_sales/part-m-00073.parquet > Total records read: 135280 > Mock records read: 0 > Records to read: 1424 > Row group index: 0 > Records in row group: 3775712 > Parquet Metadata: ParquetMetaData{FileMetaData{schema: message pig_schema { > optional int64 ss_sold_date_sk; > optional int64 ss_sold_time_sk; > optional int64 ss_item_sk; > optional int64 ss_customer_sk; > optional int64 ss_cdemo_sk; > optional int64 ss_hdemo_sk; > optional int64 ss_addr_sk; > optional int64 ss_store_sk; > optional int64 ss_promo_sk; > optional int64 ss_ticket_number; > optional int64 ss_quantity; > optional double ss_wholesale_cost; > optional double ss_list_price; > optional double ss_sales_price; > optional double ss_ext_discount_amt; > optional double ss_ext_sales_price; > optional double ss_ext_wholesale_cost; > optional double ss_ext_list_price; > optional double ss_ext_tax; > optional double ss_coupon_amt; > optional double ss_net_paid; > optional double ss_net_paid_inc_tax; > optional double ss_net_profit; > } -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (DRILL-4205) Simple query hit IndexOutOfBoundException
[ https://issues.apache.org/jira/browse/DRILL-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060854#comment-15060854 ] Dechang Gu commented on DRILL-4205: --- The parquet file can be downloaded here: http://mapr-114551845.s3.amazonaws.com/list.html > Simple query hit IndexOutOfBoundException > -- > > Key: DRILL-4205 > URL: https://issues.apache.org/jira/browse/DRILL-4205 > Project: Apache Drill > Issue Type: Bug > Components: Functions - Drill >Affects Versions: 1.4.0 >Reporter: Dechang Gu >Assignee: Parth Chandra > > The following query failed due to IOB: > 0: jdbc:drill:schema=wf_pigprq100> select * from > `store_sales/part-m-00073.parquet`; > Error: SYSTEM ERROR: IndexOutOfBoundsException: srcIndex: 1048587 > Fragment 0:0 > [Error Id: ad8d2bc0-259f-483c-9024-93865963541e on ucs-node4.perf.lab:31010] > (org.apache.drill.common.exceptions.DrillRuntimeException) Error in parquet > record reader. > Message: > Hadoop path: /tpcdsPigParq/SF100/store_sales/part-m-00073.parquet > Total records read: 135280 > Mock records read: 0 > Records to read: 1424 > Row group index: 0 > Records in row group: 3775712 > Parquet Metadata: ParquetMetaData{FileMetaData{schema: message pig_schema { > optional int64 ss_sold_date_sk; > optional int64 ss_sold_time_sk; > optional int64 ss_item_sk; > optional int64 ss_customer_sk; > optional int64 ss_cdemo_sk; > optional int64 ss_hdemo_sk; > optional int64 ss_addr_sk; > optional int64 ss_store_sk; > optional int64 ss_promo_sk; > optional int64 ss_ticket_number; > optional int64 ss_quantity; > optional double ss_wholesale_cost; > optional double ss_list_price; > optional double ss_sales_price; > optional double ss_ext_discount_amt; > optional double ss_ext_sales_price; > optional double ss_ext_wholesale_cost; > optional double ss_ext_list_price; > optional double ss_ext_tax; > optional double ss_coupon_amt; > optional double ss_net_paid; > optional double ss_net_paid_inc_tax; > optional double ss_net_profit; > } -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (DRILL-4205) Simple query hit IndexOutOfBoundException
[ https://issues.apache.org/jira/browse/DRILL-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060539#comment-15060539 ] Jacques Nadeau commented on DRILL-4205: --- You should find a way to make the file publically available. We moved Parquet versions as part of 1.2 to 1.3 so it is likely that is the cause. However, it will be hard for the community to examine the issue unless you publicly post the file. The path provided is to an internal location that community members can't access. > Simple query hit IndexOutOfBoundException > -- > > Key: DRILL-4205 > URL: https://issues.apache.org/jira/browse/DRILL-4205 > Project: Apache Drill > Issue Type: Bug > Components: Functions - Drill >Affects Versions: 1.4.0 >Reporter: Dechang Gu >Assignee: Parth Chandra > > The following query failed due to IOB: > 0: jdbc:drill:schema=wf_pigprq100> select * from > `store_sales/part-m-00073.parquet`; > Error: SYSTEM ERROR: IndexOutOfBoundsException: srcIndex: 1048587 > Fragment 0:0 > [Error Id: ad8d2bc0-259f-483c-9024-93865963541e on ucs-node4.perf.lab:31010] > (org.apache.drill.common.exceptions.DrillRuntimeException) Error in parquet > record reader. > Message: > Hadoop path: /tpcdsPigParq/SF100/store_sales/part-m-00073.parquet > Total records read: 135280 > Mock records read: 0 > Records to read: 1424 > Row group index: 0 > Records in row group: 3775712 > Parquet Metadata: ParquetMetaData{FileMetaData{schema: message pig_schema { > optional int64 ss_sold_date_sk; > optional int64 ss_sold_time_sk; > optional int64 ss_item_sk; > optional int64 ss_customer_sk; > optional int64 ss_cdemo_sk; > optional int64 ss_hdemo_sk; > optional int64 ss_addr_sk; > optional int64 ss_store_sk; > optional int64 ss_promo_sk; > optional int64 ss_ticket_number; > optional int64 ss_quantity; > optional double ss_wholesale_cost; > optional double ss_list_price; > optional double ss_sales_price; > optional double ss_ext_discount_amt; > optional double ss_ext_sales_price; > optional double ss_ext_wholesale_cost; > optional double ss_ext_list_price; > optional double ss_ext_tax; > optional double ss_coupon_amt; > optional double ss_net_paid; > optional double ss_net_paid_inc_tax; > optional double ss_net_profit; > } -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (DRILL-4205) Simple query hit IndexOutOfBoundException
[ https://issues.apache.org/jira/browse/DRILL-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060513#comment-15060513 ] Dechang Gu commented on DRILL-4205: --- Drill 1.3.0 also shows the same failure. It works fine with Drill 1.2.0. Do this is a regression from 1.2.0 release. > Simple query hit IndexOutOfBoundException > -- > > Key: DRILL-4205 > URL: https://issues.apache.org/jira/browse/DRILL-4205 > Project: Apache Drill > Issue Type: Bug > Components: Functions - Drill >Affects Versions: 1.4.0 >Reporter: Dechang Gu >Assignee: Parth Chandra > > The following query failed due to IOB: > 0: jdbc:drill:schema=wf_pigprq100> select * from > `store_sales/part-m-00073.parquet`; > Error: SYSTEM ERROR: IndexOutOfBoundsException: srcIndex: 1048587 > Fragment 0:0 > [Error Id: ad8d2bc0-259f-483c-9024-93865963541e on ucs-node4.perf.lab:31010] > (org.apache.drill.common.exceptions.DrillRuntimeException) Error in parquet > record reader. > Message: > Hadoop path: /tpcdsPigParq/SF100/store_sales/part-m-00073.parquet > Total records read: 135280 > Mock records read: 0 > Records to read: 1424 > Row group index: 0 > Records in row group: 3775712 > Parquet Metadata: ParquetMetaData{FileMetaData{schema: message pig_schema { > optional int64 ss_sold_date_sk; > optional int64 ss_sold_time_sk; > optional int64 ss_item_sk; > optional int64 ss_customer_sk; > optional int64 ss_cdemo_sk; > optional int64 ss_hdemo_sk; > optional int64 ss_addr_sk; > optional int64 ss_store_sk; > optional int64 ss_promo_sk; > optional int64 ss_ticket_number; > optional int64 ss_quantity; > optional double ss_wholesale_cost; > optional double ss_list_price; > optional double ss_sales_price; > optional double ss_ext_discount_amt; > optional double ss_ext_sales_price; > optional double ss_ext_wholesale_cost; > optional double ss_ext_list_price; > optional double ss_ext_tax; > optional double ss_coupon_amt; > optional double ss_net_paid; > optional double ss_net_paid_inc_tax; > optional double ss_net_profit; > } -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (DRILL-4205) Simple query hit IndexOutOfBoundException
[ https://issues.apache.org/jira/browse/DRILL-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060476#comment-15060476 ] Dechang Gu commented on DRILL-4205: --- the parquet file can be found at [root@ucs-node1 drill]# ls -ltr /home/MAPRTECH/home/dgu/SF100_tpcdsPigParq/store_sales/*00073* -rw-r--r-- 1 root root 675063890 Sep 8 20:42 /home/MAPRTECH/home/dgu/SF100_tpcdsPigParq/store_sales/part-m-00073.parquet > Simple query hit IndexOutOfBoundException > -- > > Key: DRILL-4205 > URL: https://issues.apache.org/jira/browse/DRILL-4205 > Project: Apache Drill > Issue Type: Bug > Components: Functions - Drill >Affects Versions: 1.4.0 >Reporter: Dechang Gu >Assignee: Parth Chandra > > The following query failed due to IOB: > 0: jdbc:drill:schema=wf_pigprq100> select * from > `store_sales/part-m-00073.parquet`; > Error: SYSTEM ERROR: IndexOutOfBoundsException: srcIndex: 1048587 > Fragment 0:0 > [Error Id: ad8d2bc0-259f-483c-9024-93865963541e on ucs-node4.perf.lab:31010] > (org.apache.drill.common.exceptions.DrillRuntimeException) Error in parquet > record reader. > Message: > Hadoop path: /tpcdsPigParq/SF100/store_sales/part-m-00073.parquet > Total records read: 135280 > Mock records read: 0 > Records to read: 1424 > Row group index: 0 > Records in row group: 3775712 > Parquet Metadata: ParquetMetaData{FileMetaData{schema: message pig_schema { > optional int64 ss_sold_date_sk; > optional int64 ss_sold_time_sk; > optional int64 ss_item_sk; > optional int64 ss_customer_sk; > optional int64 ss_cdemo_sk; > optional int64 ss_hdemo_sk; > optional int64 ss_addr_sk; > optional int64 ss_store_sk; > optional int64 ss_promo_sk; > optional int64 ss_ticket_number; > optional int64 ss_quantity; > optional double ss_wholesale_cost; > optional double ss_list_price; > optional double ss_sales_price; > optional double ss_ext_discount_amt; > optional double ss_ext_sales_price; > optional double ss_ext_wholesale_cost; > optional double ss_ext_list_price; > optional double ss_ext_tax; > optional double ss_coupon_amt; > optional double ss_net_paid; > optional double ss_net_paid_inc_tax; > optional double ss_net_profit; > } -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (DRILL-4205) Simple query hit IndexOutOfBoundException
[ https://issues.apache.org/jira/browse/DRILL-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060473#comment-15060473 ] Dechang Gu commented on DRILL-4205: --- Error: SYSTEM ERROR: IndexOutOfBoundsException: srcIndex: 1048587 Fragment 0:0 [Error Id: ad8d2bc0-259f-483c-9024-93865963541e on ucs-node4.perf.lab:31010] (org.apache.drill.common.exceptions.DrillRuntimeException) Error in parquet record reader. Message: Hadoop path: /tpcdsPigParq/SF100/store_sales/part-m-00073.parquet Total records read: 135280 Mock records read: 0 Records to read: 1424 Row group index: 0 Records in row group: 3775712 Parquet Metadata: ParquetMetaData{FileMetaData{schema: message pig_schema { optional int64 ss_sold_date_sk; optional int64 ss_sold_time_sk; optional int64 ss_item_sk; optional int64 ss_customer_sk; optional int64 ss_cdemo_sk; optional int64 ss_hdemo_sk; optional int64 ss_addr_sk; optional int64 ss_store_sk; optional int64 ss_promo_sk; optional int64 ss_ticket_number; optional int64 ss_quantity; optional double ss_wholesale_cost; optional double ss_list_price; optional double ss_sales_price; optional double ss_ext_discount_amt; optional double ss_ext_sales_price; optional double ss_ext_wholesale_cost; optional double ss_ext_list_price; optional double ss_ext_tax; optional double ss_coupon_amt; optional double ss_net_paid; optional double ss_net_paid_inc_tax; optional double ss_net_profit; } , metadata: {pig.schema=ss_sold_date_sk: long,ss_sold_time_sk: long,ss_item_sk: long,ss_customer_sk: long,ss_cdemo_sk: long,ss_hdemo_sk: long,ss_addr_sk: long,ss_store_sk: long,ss_promo_sk: long,ss_ticket_number: long,ss_quantity: long,ss_wholesale_cost: double,ss_list_price: double,ss_sales_price: double,ss_ext_discount_amt: double,ss_ext_sales_price: double,ss_ext_wholesale_cost: double,ss_ext_list_price: double,ss_ext_tax: double,ss_coupon_amt: double,ss_net_paid: double,ss_net_paid_inc_tax: double,ss_net_profit: double}}, blocks: [BlockMetaData{3775712, 0 [ColumnMetaData{UNCOMPRESSED [ss_sold_date_sk] INT64 [], 4}, ColumnMetaData{UNCOMPRESSED [ss_sold_time_sk] INT64 [], 29267389}, ColumnMetaData{UNCOMPRESSED [ss_item_sk] INT64 [], 58537018}, ColumnMetaData{UNCOMPRESSED [ss_customer_sk] INT64 [], 88743669}, ColumnMetaData{UNCOMPRESSED [ss_cdemo_sk] INT64 [], 118014602}, ColumnMetaData{UNCOMPRESSED [ss_hdemo_sk] INT64 [], 147285963}, ColumnMetaData{UNCOMPRESSED [ss_addr_sk] INT64 [], 176556258}, ColumnMetaData{UNCOMPRESSED [ss_store_sk] INT64 [], 205824976}, ColumnMetaData{UNCOMPRESSED [ss_promo_sk] INT64 [], 235094014}, ColumnMetaData{UNCOMPRESSED [ss_ticket_number] INT64 [], 264361193}, ColumnMetaData{UNCOMPRESSED [ss_quantity] INT64 [], 294567844}, ColumnMetaData{UNCOMPRESSED [ss_wholesale_cost] DOUBLE [], 323835708}, ColumnMetaData{UNCOMPRESSED [ss_list_price] DOUBLE [], 353102398}, ColumnMetaData{UNCOMPRESSED [ss_sales_price] DOUBLE [], 382371438}, ColumnMetaData{UNCOMPRESSED [ss_ext_discount_amt] DOUBLE [], 411640889}, ColumnMetaData{UNCOMPRESSED [ss_ext_sales_price] DOUBLE [], 440911353}, ColumnMetaData{UNCOMPRESSED [ss_ext_wholesale_cost] DOUBLE [], 470180589}, ColumnMetaData{UNCOMPRESSED [ss_ext_list_price] DOUBLE [], 499448181}, ColumnMetaData{UNCOMPRESSED [ss_ext_tax] DOUBLE [], 528714378}, ColumnMetaData{UNCOMPRESSED [ss_coupon_amt] DOUBLE [], 557982761}, ColumnMetaData{UNCOMPRESSED [ss_net_paid] DOUBLE [], 587253225}, ColumnMetaData{UNCOMPRESSED [ss_net_paid_inc_tax] DOUBLE [], 616521701}, ColumnMetaData{UNCOMPRESSED [ss_net_profit] DOUBLE [], 645790652}]}]} org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.handleAndRaise():345 org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.next():447 org.apache.drill.exec.physical.impl.ScanBatch.next():191 org.apache.drill.exec.record.AbstractRecordBatch.next():119 org.apache.drill.exec.record.AbstractRecordBatch.next():109 org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext():51 org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():132 org.apache.drill.exec.record.AbstractRecordBatch.next():162 org.apache.drill.exec.physical.impl.BaseRootExec.next():104 org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext():81 org.apache.drill.exec.physical.impl.BaseRootExec.next():94 org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():256 org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():250 java.security.AccessController.doPrivileged():-2 javax.security.auth.Subject.doAs():415 org.apache.hadoop.security.UserGroupInformation.doAs():1595 org.apache.drill.exec.work.fragment.FragmentExecutor.run():250 org.apache.drill.common.SelfCleaningRunnable.run():38 java.util.concurrent.ThreadPoolExecutor.runWorker():1145 java.