[ 
https://issues.apache.org/jira/browse/HIVE-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13678964#comment-13678964
 ] 

Ashutosh Chauhan commented on HIVE-4606:
----------------------------------------

It probably is a good idea to use(or enhance) 
ql/src/java/org/apache/hadoop/hive/ql/util/JavaDataModel.java for estimating 
memory sizes of object than adding a new one.
                
> Implement vector group by hash spill
> ------------------------------------
>
>                 Key: HIVE-4606
>                 URL: https://issues.apache.org/jira/browse/HIVE-4606
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Query Processor
>    Affects Versions: vectorization-branch
>            Reporter: Remus Rusanu
>            Assignee: Remus Rusanu
>             Fix For: vectorization-branch
>
>         Attachments: HIVE-4606.1.patch.txt, HIVE-4606.2.patch.txt
>
>
> the row mode GBy operator is capable of spilling the hash map (by emitting it 
> into the M/R and deleting the keys emitted) to conform to emmory constraints. 
> The VGBy should be able to do the same.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to