Amar, does this now need to be re-benchmarked given https://
issues.apache.org/jira/browse/HADOOP-1965#action_12552324 ?
Also, since this is an improvement, why is it now assigned to a bug
fix release?
On Dec 17, 2007, at 4:38 AM, Amar Kamat (JIRA) wrote:
[ https://issues.apache.org/jira/browse/HADOOP-1965?
page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amar Kamat updated HADOOP-1965:
-------------------------------
Fix Version/s: (was: 0.16.0)
0.15.2
Affects Version/s: (was: 0.16.0)
0.15.2
Status: Patch Available (was: Open)
Handle map output buffers better
--------------------------------
Key: HADOOP-1965
URL: https://issues.apache.org/jira/browse/
HADOOP-1965
Project: Hadoop
Issue Type: Improvement
Components: mapred
Affects Versions: 0.15.2
Reporter: Devaraj Das
Assignee: Amar Kamat
Fix For: 0.15.2
Attachments: 1965_single_proc_150mb_gziped.jpeg,
1965_single_proc_150mb_gziped.pdf,
1965_single_proc_150mb_gziped_breakup.png, HADOOP-1965-1.patch,
HADOOP-1965-Benchmark.patch, HADOOP-1965-Benchmark.patch,
HADOOP-1965-Benchmark.patch, HADOOP-1965-Benchmark.patch,
HADOOP-1965-Benchmark.patch, HADOOP-2419.patch, HADOOP-2419.patch
Today, the map task stops calling the map method while sort/spill
is using the (single instance of) map output buffer. One
improvement that can be done to improve performance of the map
task is to have another buffer for writing the map outputs to,
while sort/spill is using the first buffer.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
