[
https://issues.apache.org/jira/browse/HADOOP-1965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Devaraj Das updated HADOOP-1965:
--------------------------------
Status: Open (was: Patch Available)
Sorry for the late review on this one:
1) Remove sortAndSpillExceptionLock. Instead make sortAndSpillException
volatile.
2) Avoid indentation changes of existing code as far as possible (unnecessary
diffs).
> Handle map output buffers better
> --------------------------------
>
> Key: HADOOP-1965
> URL: https://issues.apache.org/jira/browse/HADOOP-1965
> Project: Hadoop
> Issue Type: Improvement
> Components: mapred
> Affects Versions: 0.16.0
> Reporter: Devaraj Das
> Assignee: Amar Kamat
> Fix For: 0.16.0
>
> Attachments: 1965_single_proc_150mb_gziped.jpeg,
> 1965_single_proc_150mb_gziped.pdf, 1965_single_proc_150mb_gziped_breakup.png,
> HADOOP-1965-1.patch, HADOOP-1965-Benchmark.patch,
> HADOOP-1965-Benchmark.patch, HADOOP-1965-Benchmark.patch,
> HADOOP-1965-Benchmark.patch, HADOOP-1965-Benchmark.patch, HADOOP-2419.patch,
> HADOOP-2419.patch, HADOOP-2419.patch
>
>
> Today, the map task stops calling the map method while sort/spill is using
> the (single instance of) map output buffer. One improvement that can be done
> to improve performance of the map task is to have another buffer for writing
> the map outputs to, while sort/spill is using the first buffer.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
