[ 
https://issues.apache.org/jira/browse/HIVE-28200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Zhihua Deng updated HIVE-28200:
-------------------------------
    Component/s: Standalone Metastore

> Improve get_partitions_by_filter/expr when partition limit enabled
> ------------------------------------------------------------------
>
>                 Key: HIVE-28200
>                 URL: https://issues.apache.org/jira/browse/HIVE-28200
>             Project: Hive
>          Issue Type: Improvement
>          Components: Hive, Standalone Metastore
>            Reporter: Wechar
>            Assignee: Wechar
>            Priority: Major
>              Labels: hive-4.0.1-merged, hive-4.0.1-must, 
> pull-request-available
>             Fix For: 4.1.0, 4.0.1
>
>
> When {{hive.metastore.limit.partition.request}} is configured, HMS would get 
> the matching partition counts before get the real partition objects. The 
> count  could be a slow query if the input filter or expr is too complex.
> In this case, such slow filter will be executed in both counting partition 
> numbers and fetching real partition objects, which harms the performance and 
> backend DBMS.
> We can make an improvement by getting matched partition names firstly, and 
> then check limit through the size of partition names, and finally get the 
> partitions by the partition names.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to