[
https://issues.apache.org/jira/browse/TAJO-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jinho Kim updated TAJO-1271:
----------------------------
Description:
Currently, HashShuffleFileWriteExec keep the cloned tuple list. and It written
the tulples by count. This affects the jvm memory.
We should improve it as following :
* Keep the tuples in off-heap and reuse the row batch
* Asynchronously write the hash partitions
was:
Currently, HashShuffleFileWriteExec keep the cloned tuple list. and It written
the tulples by count. This affects the jvm memory.
We should improve it as following :
* Keep the tuples in off-heap and reuse the row batch
> Improve memory usage in HashShuffleFileWriteExec
> ------------------------------------------------
>
> Key: TAJO-1271
> URL: https://issues.apache.org/jira/browse/TAJO-1271
> Project: Tajo
> Issue Type: Improvement
> Components: data shuffle
> Affects Versions: 0.9.0
> Reporter: Jinho Kim
> Assignee: Jinho Kim
>
> Currently, HashShuffleFileWriteExec keep the cloned tuple list. and It
> written the tulples by count. This affects the jvm memory.
> We should improve it as following :
> * Keep the tuples in off-heap and reuse the row batch
> * Asynchronously write the hash partitions
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
