[
https://issues.apache.org/jira/browse/HAMA-837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Edward J. Yoon updated HAMA-837:
--------------------------------
Attachment: HAMA-837_v02.patch
This patch adds sort option and enables the DiskVerticesInfo. Each task writes
sorted files for specific partition, then merge sort finally.
Once HAMA-723 is done, I might update the patch again.
Memory usage has improved. Next step is queue.
> Add sort behaviour to runtime partitioner
> -----------------------------------------
>
> Key: HAMA-837
> URL: https://issues.apache.org/jira/browse/HAMA-837
> Project: Hama
> Issue Type: Bug
> Components: bsp core
> Reporter: Edward J. Yoon
> Assignee: Edward J. Yoon
> Fix For: 0.7.0
>
> Attachments: HAMA-837_v01.patch, HAMA-837_v02.patch
>
>
> If key is comparable and it need to be sorted by key of record,
> {code}
> if (outputPair.getKey() instanceof WritableComparable
> && conf.getBoolean(Constants.PARTITION_SORT_BY_KEY, false)) {
> {code}
> each patitions should be sorted by key. In here, we can use external merge
> sort.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
