[
https://issues.apache.org/jira/browse/HIVE-2218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13050003#comment-13050003
]
[email protected] commented on HIVE-2218:
-----------------------------------------------------
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/898/
-----------------------------------------------------------
(Updated 2011-06-15 20:24:15.631412)
Review request for hive.
Changes
-------
address Ning's comments. Did the minimum change and the performance is
acceptable. We can try to remove empty path check if in future we see the
latency is not good.
Summary
-------
speedup addInputPaths
This addresses bug HIVE-2218.
https://issues.apache.org/jira/browse/HIVE-2218
Diffs (updated)
-----
trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/ExecDriver.java 1135335
trunk/ql/src/java/org/apache/hadoop/hive/ql/io/CombineHiveInputFormat.java
1135335
Diff: https://reviews.apache.org/r/898/diff
Testing
-------
yes.
Thanks,
Yongqiang
> speedup addInputPaths
> ---------------------
>
> Key: HIVE-2218
> URL: https://issues.apache.org/jira/browse/HIVE-2218
> Project: Hive
> Issue Type: Improvement
> Reporter: He Yongqiang
> Assignee: He Yongqiang
> Attachments: HIVE-2218.1.patch
>
>
> Speedup the addInputPaths for combined symlink inputformat, and added some
> other micro optimizations which also work for normal cases.
> This can help reducing the start time of one query from 5 hours to less than
> 20 mins.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
