[
https://issues.apache.org/jira/browse/DRILL-5495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vitalii Diravka updated DRILL-5495:
-----------------------------------
Comment: was deleted
(was: The issue is not reproduced anymore.
{code:SQL}
0: jdbc:drill:zk=local> select * from
dfs.`/home/vitalii/Downloads/temp.parquet` limit 2;
+-----------+------------------+------+---------------+----------------+------------+-------------------+--------------+
| voter_id | name | age | registration | contributions |
voterzone | create_timestamp | create_date |
+-----------+------------------+------+---------------+----------------+------------+-------------------+--------------+
| 1 | wendy van buren | 22 | republican | 168.4 | 14673
| [B@727782da | 2016-07-05 |
| 2 | sarah young | 33 | democrat | 757.74 | 13104
| [B@36430024 | 2016-04-28 |
+-----------+------------------+------+---------------+----------------+------------+-------------------+--------------+
2 rows selected (0.297 seconds)
0: jdbc:drill:zk=local> select CONVERT_FROM(create_timestamp,
'TIMESTAMP_IMPALA') from dfs.`/home/vitalii/Downloads/temp.parquet` limit 2;
+------------------------+
| EXPR$0 |
+------------------------+
| 2016-10-24 06:03:58.0 |
| 2016-12-08 22:58:14.0 |
+------------------------+
2 rows selected (0.142 seconds)
0: jdbc:drill:zk=local> set `store.parquet.reader.int96_as_timestamp` = true;
+-------+---------------------------------------------------+
| ok | summary |
+-------+---------------------------------------------------+
| true | store.parquet.reader.int96_as_timestamp updated. |
+-------+---------------------------------------------------+
1 row selected (0.06 seconds)
0: jdbc:drill:zk=local> select * from
dfs.`/home/vitalii/Downloads/temp.parquet` limit 2;
+-----------+------------------+------+---------------+----------------+------------+------------------------+--------------+
| voter_id | name | age | registration | contributions |
voterzone | create_timestamp | create_date |
+-----------+------------------+------+---------------+----------------+------------+------------------------+--------------+
| 1 | wendy van buren | 22 | republican | 168.4 | 14673
| 2016-10-24 06:03:58.0 | 2016-07-05 |
| 2 | sarah young | 33 | democrat | 757.74 | 13104
| 2016-12-08 22:58:14.0 | 2016-04-28 |
+-----------+------------------+------+---------------+----------------+------------+------------------------+--------------+
2 rows selected (0.228 seconds)
{code}
See more in DRILL-4337)
> convert_from function on top of int96 data results in
> ArrayIndexOutOfBoundsException
> ------------------------------------------------------------------------------------
>
> Key: DRILL-5495
> URL: https://issues.apache.org/jira/browse/DRILL-5495
> Project: Apache Drill
> Issue Type: Bug
> Affects Versions: 1.10.0
> Reporter: Rahul Challapalli
> Assignee: Vitalii Diravka
> Priority: Major
> Fix For: 1.14.0
>
> Attachments: 26edf56f-6bc6-1e1f-5aa4-d98aec858a4a.sys.drill,
> d4.tar.gz, drillbit.log
>
>
> git.commit.id.abbrev=1e0a14c
> The data set used is generated from spark and contains a timestamp stored as
> int96
> {code}
> [root@qa-node190 framework]# /home/parquet-tools-1.5.1-SNAPSHOT/parquet-meta
> /home/framework/framework/resources/Datasources/parquet_date/spark_generated/d4/part-r-00000-08c5c621-62ea-4fee-b690-11576eddc39c.snappy.parquet
>
> creator: parquet-mr (build 32c46643845ea8a705c35d4ec8fc654cc8ff816d)
> extra: org.apache.spark.sql.parquet.row.metadata =
> {"type":"struct","fields":[{"name":"a","type":"integer","nullable":true,"metadata":{}},{"name":"b","type":"strin
> [more]...
> file schema: spark_schema
> -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
> a: OPTIONAL INT32 R:0 D:1
> b: OPTIONAL BINARY O:UTF8 R:0 D:1
> c: OPTIONAL INT32 O:DATE R:0 D:1
> d: OPTIONAL INT96 R:0 D:1
> row group 1: RC:10000 TS:8661
> -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
> a: INT32 SNAPPY DO:0 FPO:4 SZ:2367/2571/1.09 VC:10000
> ENC:RLE,PLAIN,BIT_PACKED
> b: BINARY SNAPPY DO:0 FPO:2371 SZ:2329/2843/1.22 VC:10000
> ENC:RLE,PLAIN_DICTIONARY,BIT_PACKED
> c: INT32 SNAPPY DO:0 FPO:4700 SZ:1374/1507/1.10 VC:10000
> ENC:RLE,PLAIN,BIT_PACKED
> d: INT96 SNAPPY DO:0 FPO:6074 SZ:1597/1740/1.09 VC:10000
> ENC:RLE,PLAIN_DICTIONARY,BIT_PACKED
> {code}
> The below query fails with an ArrayIndexOutOfBoundsException
> {code}
> select convert_from(d, 'TIMESTAMP_IMPALA') from
> dfs.`/drill/testdata/resource-manager/d4`;
> Fails with below error after displaying a bunch of records
> Error: SYSTEM ERROR: ArrayIndexOutOfBoundsException: 0
> Fragment 1:0
> [Error Id: f963f6c0-3306-49a6-9d98-a193c5e7cfee on qa-node190.qa.lab:31010]
> (state=,code=0)
> {code}
> Attached the logs, profiles and data files
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
