[
https://issues.apache.org/jira/browse/TAJO-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308552#comment-14308552
]
ASF GitHub Bot commented on TAJO-1271:
--------------------------------------
Github user jinossy commented on the pull request:
https://github.com/apache/tajo/pull/329#issuecomment-73178173
This patch is not yet ready for review
> Improve memory usage in HashShuffleFileWriteExec
> ------------------------------------------------
>
> Key: TAJO-1271
> URL: https://issues.apache.org/jira/browse/TAJO-1271
> Project: Tajo
> Issue Type: Improvement
> Components: data shuffle
> Affects Versions: 0.9.0
> Reporter: Jinho Kim
> Assignee: Jinho Kim
>
> Currently, HashShuffleFileWriteExec keep the cloned tuple list. and It
> written the tulples by count. This affects the jvm memory.
> We should improve it as following :
> * Keep the tuples in off-heap and reuse the row batch
> * Asynchronously write the hash partitions
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
