[
https://issues.apache.org/jira/browse/HIVE-14204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15370406#comment-15370406
]
Rajesh Balamohan commented on HIVE-14204:
-----------------------------------------
RB Link: https://reviews.apache.org/r/49881/diff/1#index_header
Without Patch:
============
INSERT INTO web_sales_test partition(ws_sold_date_sk) select * from
tpcds_bin_partitioned_orc_200.web_sales;
Time taken to load dynamic partitions: *309.22 seconds*
With Patch:
=========
INSERT INTO web_sales_test partition(ws_sold_date_sk) select * from
tpcds_bin_partitioned_orc_200.web_sales;
Time taken to load dynamic partitions: *52.522 seconds*
> Optimize loading loaddynamic partitions
> ----------------------------------------
>
> Key: HIVE-14204
> URL: https://issues.apache.org/jira/browse/HIVE-14204
> Project: Hive
> Issue Type: Improvement
> Reporter: Rajesh Balamohan
> Priority: Minor
>
> Lots of time is spent in sequential fashion to load dynamic partitioned
> dataset in driver side. E.g simple dynamic partitioned load as follows takes
> 300+ seconds
> {noformat}
> INSERT INTO web_sales_test partition(ws_sold_date_sk) select * from
> tpcds_bin_partitioned_orc_200.web_sales;
> Time taken to load dynamic partitions: 309.22 seconds
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
