[
https://issues.apache.org/jira/browse/HIVE-10091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14381517#comment-14381517
]
Thejas M Nair commented on HIVE-10091:
--------------------------------------
I should have mentioned the remaining work along with the patch. Here it is -
# Handle conditions that cannot be represented using the Scan api startRow or
stopRow. This includes all conditions on partition columns that are not the
first partition column, and != and LIKE expressions on first partition column.
=, >,<,>=,<= on first partition column are handled. These unsupported
conditions need to be converted to a Filter in the Scan api call. Right now,
these unsupported conditions are treated like a 'true' boolean value.
# Handle conditions on the first partition column where the data type is not a
string type. This currently works for cases where the string representation
byte order for the type is same as the real order for the type. ie, it does not
work for types such as integer. To support this we need to change the
serialization type of the keys so that the byte order of keys is same as the
data type order. For this, I propose changing the key serialization to
BinarySortableSerde format.
bq. If I read HBaseFilterPlanUtil correctly this can handle non-boolean
expressions on initial keys right now, but not booleans
When you say boolean expressions, do you mean AND/OR expressions ? They are
supported.
> Generate Hbase execution plan for partition filter conditions in HbaseStore
> api calls - initial changes
> -------------------------------------------------------------------------------------------------------
>
> Key: HIVE-10091
> URL: https://issues.apache.org/jira/browse/HIVE-10091
> Project: Hive
> Issue Type: Sub-task
> Components: Metastore
> Reporter: Thejas M Nair
> Assignee: Thejas M Nair
> Fix For: hbase-metastore-branch
>
> Attachments: HIVE-10091.1.patch
>
>
> RawStore functions that support partition filtering are the following -
> getPartitionsByExpr
> getPartitionsByFilter (takes filter string as argument, used from hcatalog)
> We need to generate a query execution plan in terms of Hbase scan api calls
> for a given filter condition.
> NO PRECOMMIT TESTS
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
