[jira] [Updated] (MAPREDUCE-5906) Inconsistent configuration in property "mapreduce.reduce.shuffle.input.buffer.percent"
[ https://issues.apache.org/jira/browse/MAPREDUCE-5906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-5906: Fix Version/s: (was: 3.0.0) > Inconsistent configuration in property > "mapreduce.reduce.shuffle.input.buffer.percent" > -- > > Key: MAPREDUCE-5906 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5906 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 2.4.0 >Reporter: Akira AJISAKA >Assignee: Akira AJISAKA >Priority: Minor > Labels: newbie > Fix For: 2.6.0 > > Attachments: MAPREDUCE-5906.patch > > > In MergeManagerImpl.java, the default value of > MRJobConfig.SHUFFLE_INPUT_BUFFER_PERCENT > (=mapreduce.reduce.shuffle.input.buffer.percent) looks 0.90. > {code} > final float maxInMemCopyUse = > jobConf.getFloat(MRJobConfig.SHUFFLE_INPUT_BUFFER_PERCENT, 0.90f); > {code} > However, the actual default value is 0.70 in mapred-default.xml. > {code} > mapreduce.reduce.shuffle.input.buffer.percent > 0.70 > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (MAPREDUCE-5906) Inconsistent configuration in property "mapreduce.reduce.shuffle.input.buffer.percent"
[ https://issues.apache.org/jira/browse/MAPREDUCE-5906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-5906: Resolution: Fixed Fix Version/s: 2.6.0 3.0.0 Status: Resolved (was: Patch Available) +1. Committing to branch-2 and trunk. Thanks! > Inconsistent configuration in property > "mapreduce.reduce.shuffle.input.buffer.percent" > -- > > Key: MAPREDUCE-5906 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5906 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 2.4.0 >Reporter: Akira AJISAKA >Assignee: Akira AJISAKA >Priority: Minor > Labels: newbie > Fix For: 3.0.0, 2.6.0 > > Attachments: MAPREDUCE-5906.patch > > > In MergeManagerImpl.java, the default value of > MRJobConfig.SHUFFLE_INPUT_BUFFER_PERCENT > (=mapreduce.reduce.shuffle.input.buffer.percent) looks 0.90. > {code} > final float maxInMemCopyUse = > jobConf.getFloat(MRJobConfig.SHUFFLE_INPUT_BUFFER_PERCENT, 0.90f); > {code} > However, the actual default value is 0.70 in mapred-default.xml. > {code} > mapreduce.reduce.shuffle.input.buffer.percent > 0.70 > {code} -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (MAPREDUCE-5906) Inconsistent configuration in property "mapreduce.reduce.shuffle.input.buffer.percent"
[ https://issues.apache.org/jira/browse/MAPREDUCE-5906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated MAPREDUCE-5906: Target Version/s: 2.6.0 (was: 2.5.0) > Inconsistent configuration in property > "mapreduce.reduce.shuffle.input.buffer.percent" > -- > > Key: MAPREDUCE-5906 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5906 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 2.4.0 >Reporter: Akira AJISAKA >Assignee: Akira AJISAKA >Priority: Minor > Labels: newbie > Attachments: MAPREDUCE-5906.patch > > > In MergeManagerImpl.java, the default value of > MRJobConfig.SHUFFLE_INPUT_BUFFER_PERCENT > (=mapreduce.reduce.shuffle.input.buffer.percent) looks 0.90. > {code} > final float maxInMemCopyUse = > jobConf.getFloat(MRJobConfig.SHUFFLE_INPUT_BUFFER_PERCENT, 0.90f); > {code} > However, the actual default value is 0.70 in mapred-default.xml. > {code} > mapreduce.reduce.shuffle.input.buffer.percent > 0.70 > {code} -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (MAPREDUCE-5906) Inconsistent configuration in property "mapreduce.reduce.shuffle.input.buffer.percent"
[ https://issues.apache.org/jira/browse/MAPREDUCE-5906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated MAPREDUCE-5906: - Attachment: MAPREDUCE-5906.patch Attaching a patch to change the default value in MergeManagerImpl.java. > Inconsistent configuration in property > "mapreduce.reduce.shuffle.input.buffer.percent" > -- > > Key: MAPREDUCE-5906 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5906 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 2.4.0 >Reporter: Akira AJISAKA >Assignee: Akira AJISAKA >Priority: Minor > Labels: newbie > Attachments: MAPREDUCE-5906.patch > > > In MergeManagerImpl.java, the default value of > MRJobConfig.SHUFFLE_INPUT_BUFFER_PERCENT > (=mapreduce.reduce.shuffle.input.buffer.percent) looks 0.90. > {code} > final float maxInMemCopyUse = > jobConf.getFloat(MRJobConfig.SHUFFLE_INPUT_BUFFER_PERCENT, 0.90f); > {code} > However, the actual default value is 0.70 in mapred-default.xml. > {code} > mapreduce.reduce.shuffle.input.buffer.percent > 0.70 > {code} -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (MAPREDUCE-5906) Inconsistent configuration in property "mapreduce.reduce.shuffle.input.buffer.percent"
[ https://issues.apache.org/jira/browse/MAPREDUCE-5906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated MAPREDUCE-5906: - Target Version/s: 2.5.0 Status: Patch Available (was: Open) > Inconsistent configuration in property > "mapreduce.reduce.shuffle.input.buffer.percent" > -- > > Key: MAPREDUCE-5906 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5906 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 2.4.0 >Reporter: Akira AJISAKA >Assignee: Akira AJISAKA >Priority: Minor > Labels: newbie > Attachments: MAPREDUCE-5906.patch > > > In MergeManagerImpl.java, the default value of > MRJobConfig.SHUFFLE_INPUT_BUFFER_PERCENT > (=mapreduce.reduce.shuffle.input.buffer.percent) looks 0.90. > {code} > final float maxInMemCopyUse = > jobConf.getFloat(MRJobConfig.SHUFFLE_INPUT_BUFFER_PERCENT, 0.90f); > {code} > However, the actual default value is 0.70 in mapred-default.xml. > {code} > mapreduce.reduce.shuffle.input.buffer.percent > 0.70 > {code} -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (MAPREDUCE-5906) Inconsistent configuration in property "mapreduce.reduce.shuffle.input.buffer.percent"
[ https://issues.apache.org/jira/browse/MAPREDUCE-5906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated MAPREDUCE-5906: - Affects Version/s: 2.4.0 Labels: newbie (was: ) > Inconsistent configuration in property > "mapreduce.reduce.shuffle.input.buffer.percent" > -- > > Key: MAPREDUCE-5906 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5906 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 2.4.0 >Reporter: Akira AJISAKA >Assignee: Akira AJISAKA >Priority: Minor > Labels: newbie > > In MergeManagerImpl.java, the default value of > MRJobConfig.SHUFFLE_INPUT_BUFFER_PERCENT > (=mapreduce.reduce.shuffle.input.buffer.percent) looks 0.90. > {code} > final float maxInMemCopyUse = > jobConf.getFloat(MRJobConfig.SHUFFLE_INPUT_BUFFER_PERCENT, 0.90f); > {code} > However, the actual default value is 0.70 in mapred-default.xml. > {code} > mapreduce.reduce.shuffle.input.buffer.percent > 0.70 > {code} -- This message was sent by Atlassian JIRA (v6.2#6252)