[
https://issues.apache.org/jira/browse/HIVE-2206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13105379#comment-13105379
]
Yin Huai commented on HIVE-2206:
--------------------------------
Yongqiang: I will change the name of optimizer. But, I'd prefer the name like
"query correlation detector" or "multi-query optimizer", because I think that
the name of "cooperative scan" limits the scope of this optimizer. Besides
shared-scan, if ReduceSinkOperators of two chained Hive-generated MapReduce
jobs share the same key(s), this optimizer can merge the second job into the
reduce phase of the first job.
I will upload a patch by this Sunday.
> add a new optimizer for query correlation discovery and optimization
> --------------------------------------------------------------------
>
> Key: HIVE-2206
> URL: https://issues.apache.org/jira/browse/HIVE-2206
> Project: Hive
> Issue Type: New Feature
> Reporter: He Yongqiang
> Assignee: Yin Huai
> Attachments: Queries, YSmartPatchForHive.patch
>
>
> reference:
> http://www.cse.ohio-state.edu/hpcs/WWW/HTML/publications/papers/TR-11-7.pdf
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
