[
https://issues.apache.org/jira/browse/HIVE-13901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15309163#comment-15309163
]
Rajesh Balamohan edited comment on HIVE-13901 at 6/1/16 3:08 AM:
-----------------------------------------------------------------
Creating an external table (tpcds inventory/web_sales) in S3 and running msck
on it took lot longer time.
inventory (tpcds):
============
msck time taken before patch: 193.273 seconds
msck time taken after patch: 71 seconds
web_sales (tpcds):
============
msck time taken before patch: 1335.19 seconds
msck time taken after patch: 471.264 seconds
was (Author: rajesh.balamohan):
Creating an external table (tpcds inventory/web_sales) in S3 and running msck
on it took lot longer time.
inventory (tpcds):
============
msck time taken before patch:193.273 seconds
msck time taken after patch:71 seconds
web_sales (tpcds):
============
msck time taken before patch:1335.19 seconds
msck time taken after patch:471.264 seconds
> Hivemetastore add partitions can be slow depending on filesystems
> -----------------------------------------------------------------
>
> Key: HIVE-13901
> URL: https://issues.apache.org/jira/browse/HIVE-13901
> Project: Hive
> Issue Type: Improvement
> Components: Metastore
> Reporter: Rajesh Balamohan
> Priority: Minor
> Attachments: HIVE-13901.1.patch
>
>
> Depending on FS, creating external tables & adding partitions can be
> expensive (e.g msck which adds all partitions).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
