[
https://issues.apache.org/jira/browse/HIVE-4202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13607190#comment-13607190
]
Phabricator commented on HIVE-4202:
-----------------------------------
ashutoshc has accepted the revision "HIVE-4202 [jira] reuse Partition objects
in PTFOperator processing".
Cool trick. Query select s, avg(i) over (partition by d, b) from over100k;
has ~96K unique values for (b,d). It used to take ~35 minutes finishes in less
than 3 minutes after this patch. Running tests now, will commit if tests pass.
REVISION DETAIL
https://reviews.facebook.net/D9525
BRANCH
partition-reuse
ARCANIST PROJECT
hive
To: JIRA, ashutoshc, hbutani
> reuse Partition objects in PTFOperator processing
> -------------------------------------------------
>
> Key: HIVE-4202
> URL: https://issues.apache.org/jira/browse/HIVE-4202
> Project: Hive
> Issue Type: Bug
> Components: PTF-Windowing
> Reporter: Harish Butani
> Assignee: Harish Butani
> Attachments: HIVE-4202.D9525.1.patch
>
>
> to improve memory utilization and reduce number of files and directories
> created.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira