[jira] [Commented] (MAPREDUCE-5605) Memory-centric MapReduce aiming to solve the I/O bottleneck

[ https://issues.apache.org/jira/browse/MAPREDUCE-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13817207#comment-13817207 ] Lijie Xu commented on MAPREDUCE-5605: - How to implement MapReduce-like framework

[jira] [Commented] (MAPREDUCE-5605) Memory-centric MapReduce aiming to solve the I/O bottleneck

[ https://issues.apache.org/jira/browse/MAPREDUCE-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13814504#comment-13814504 ] Lijie Xu commented on MAPREDUCE-5605: - Nice job. Ming, is there a document to

[jira] [Commented] (MAPREDUCE-5494) Hash-based MapReduce

[ https://issues.apache.org/jira/browse/MAPREDUCE-5494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13761624#comment-13761624 ] Lijie Xu commented on MAPREDUCE-5494: - Cool, Hadoop's sort-based and disk-based

[jira] [Created] (MAPREDUCE-5482) Release kvoffsets and kvindices before going to merge phase

Lijie Xu created MAPREDUCE-5482: --- Summary: Release kvoffsets and kvindices before going to merge phase Key: MAPREDUCE-5482 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5482 Project: Hadoop

[jira] [Created] (MAPREDUCE-5461) Let users be able to get latest Key in reduce()

Lijie Xu created MAPREDUCE-5461: --- Summary: Let users be able to get latest Key in reduce() Key: MAPREDUCE-5461 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5461 Project: Hadoop Map/Reduce

[jira] [Updated] (MAPREDUCE-5461) Let users be able to get latest Key in reduce()

[ https://issues.apache.org/jira/browse/MAPREDUCE-5461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Xu updated MAPREDUCE-5461: Description: Reducer generates K, List(V) for reduce(). In some cases such as SecondarySort,

[jira] [Commented] (MAPREDUCE-4883) Reducer's Maximum Shuffle Buffer Size should be enlarged for 64bit JVM

[ https://issues.apache.org/jira/browse/MAPREDUCE-4883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13563455#comment-13563455 ] Lijie Xu commented on MAPREDUCE-4883: - [~jerrychenhf]Good job! Yes,

[jira] [Commented] (MAPREDUCE-4883) Reducer's Maximum Shuffle Buffer Size should be enlarged for 64bit JVM

[ https://issues.apache.org/jira/browse/MAPREDUCE-4883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13563455#comment-13563455 ] Lijie Xu commented on MAPREDUCE-4883: - [~jerrychenhf]Good job! Yes,

[jira] [Commented] (MAPREDUCE-4882) Error in estimating the length of the output file in Spill Phase

[ https://issues.apache.org/jira/browse/MAPREDUCE-4882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13563459#comment-13563459 ] Lijie Xu commented on MAPREDUCE-4882: - [~jerrychenhf] Thanks, I checked this patch

[jira] [Commented] (MAPREDUCE-4883) Reducer's Maximum Shuffle Buffer Size should be enlarged for 64bit JVM

[ https://issues.apache.org/jira/browse/MAPREDUCE-4883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534505#comment-13534505 ] Lijie Xu commented on MAPREDUCE-4883: - [~tlipcon] Are there some other solutions?

[jira] [Commented] (MAPREDUCE-4883) Reducer's Maximum Shuffle Buffer Size should be enlarged for 64bit JVM

[ https://issues.apache.org/jira/browse/MAPREDUCE-4883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534529#comment-13534529 ] Lijie Xu commented on MAPREDUCE-4883: - Actually, when a segment(MapOutput) is

[jira] [Created] (MAPREDUCE-4882) Error in estimating the length of the output file in Spill Phase

Lijie Xu created MAPREDUCE-4882: --- Summary: Error in estimating the length of the output file in Spill Phase Key: MAPREDUCE-4882 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4882 Project: Hadoop

[jira] [Created] (MAPREDUCE-4883) Reducer's Maximum Shuffle Buffer Size should be enlarged for 64bit JVM

Lijie Xu created MAPREDUCE-4883: --- Summary: Reducer's Maximum Shuffle Buffer Size should be enlarged for 64bit JVM Key: MAPREDUCE-4883 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4883 Project: