[
https://issues.apache.org/jira/browse/HIVE-8122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191940#comment-14191940
]
Ferdinand Xu commented on HIVE-8122:
------------------------------------
I have renew the review entry.
Current limitation exists in that the data type ORC data format used is not
exactly the same as parquet. In my solution, I did it in a conservative way
that adds one more attribution "FilterPredicateType" to indicate the leaf type
instead of the "Type" ORC used.
Besides that, some data types are not supported when building predicate filter.
More detailed information can refer the FilterApi class in parquet project. In
this patch, it will neglect those data types which means no filter will be
executed on it.
Next step, more test sets should be covered to make it robust.
> Make use of SearchArgument classes for Parquet SERDE
> ----------------------------------------------------
>
> Key: HIVE-8122
> URL: https://issues.apache.org/jira/browse/HIVE-8122
> Project: Hive
> Issue Type: Sub-task
> Reporter: Brock Noland
> Assignee: Ferdinand Xu
>
> ParquetSerde could be much cleaner if we used SearchArgument and associated
> classes like ORC does:
> https://github.com/apache/hive/blob/trunk/serde/src/java/org/apache/hadoop/hive/ql/io/sarg/SearchArgument.java
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
