[
https://issues.apache.org/jira/browse/HIVE-22957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049245#comment-17049245
]
Syed Shameerur Rahman edited comment on HIVE-22957 at 3/3/20 5:27 PM:
----------------------------------------------------------------------
[~prasanth_j] [~rbalamohan] [~jcamachorodriguez] Any Concerns / Suggestions
regarding the approach?
was (Author: srahman):
[~prasanth_j] [~rbalamohan] Any Concerns / Suggestions regarding the approach?
> Support For Filter Expression In MSCK Command
> ---------------------------------------------
>
> Key: HIVE-22957
> URL: https://issues.apache.org/jira/browse/HIVE-22957
> Project: Hive
> Issue Type: Improvement
> Reporter: Syed Shameerur Rahman
> Assignee: Syed Shameerur Rahman
> Priority: Major
> Fix For: 4.0.0
>
>
> Currently MSCK command supports full repair of table (all partitions) or some
> subset of partitions based on partitionSpec. The aim of this jira is to
> introduce a filterExp (=, !=, <, >, >=, <=, LIKE) in MSCK command so that a
> larger subset of partitions can be recovered (added/deleted) without firing a
> full repair might take time if the no. of partitions are huge.
> *Approach*:
> The initial approach is to add a where clause in MSCK command Eg: MCK REPAIR
> TABLE <tbl_name> ADD|DROP|SYNC PARTITIONS WHERE <pcol1> <filter_operator>
> <value> AND ....
> *Flow:*
> 1) Parse the where clause and generate filterExpression
> 2) fetch all the partitions from the metastore which matches the filter
> expression
> 3) fetch all the partition file from the filesystem
> 4) remove all the partition path which does not match with the filter
> expression
> 5) Based on ADD | DROP | SYNC do the remaining steps.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
