[ 
https://issues.apache.org/jira/browse/IMPALA-9691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17146411#comment-17146411
 ] 

ASF subversion and git services commented on IMPALA-9691:
---------------------------------------------------------

Commit c7ce4fa109043ad0e0a5def73df3bedc322a6d84 in impala's branch 
refs/heads/master from wzhou-code
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=c7ce4fa ]

IMPALA-9691: Support Kudu Timestamp and Date bloom filter

Impala save timestamp as 12 bytes of structure TimestampValue with
time in nano seconds. Kudu store timestamp as 8 bytes of Unix Time
microseconds. To avoid the data truncation issue in the bloom filter,
add FunctionCallExpr with 'utc_to_unix_micros' as the root of source
expression of bloom filter to convert timestamp values to microseconds
when building timestamp bloom filter for Kudu.
Generated functional date_tbl table in Kudu format for unit-test.
Added new test cases for Kudu Timestamp and Date bloom filters.

Testing:
Passed all core tests.

Change-Id: I3c1e9bcc9fd6d79a39f25eaa3396188fc0a52a48
Reviewed-on: http://gerrit.cloudera.org:8080/16094
Reviewed-by: Thomas Tauber-Marshall <tmarsh...@cloudera.com>
Tested-by: Impala Public Jenkins <impala-public-jenk...@cloudera.com>


> Support Kudu Timestamp and Date Bloom Filter 
> ---------------------------------------------
>
>                 Key: IMPALA-9691
>                 URL: https://issues.apache.org/jira/browse/IMPALA-9691
>             Project: IMPALA
>          Issue Type: Improvement
>          Components: Backend, Frontend
>    Affects Versions: Impala 4.0
>            Reporter: Wenzhe Zhou
>            Assignee: Wenzhe Zhou
>            Priority: Major
>             Fix For: Impala 4.0
>
>
> Impala saves Timestamp as 92 bit value, while supporting Timestamp for Kudu 
> using unixtime_micros (i.e. int64).  This causes different hash values being 
> used when calling Insert() and Find() for bloom filter.
> Impala should generate timestamp bloom filters for Kudu by using 64 bit 
> unixtime_micros.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org

Reply via email to