[jira] [Updated] (MAPREDUCE-6697) Concurrent task limits should only be applied when necessary

2017-07-12 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated MAPREDUCE-6697: -- Status: Patch Available (was: Reopened) > Concurrent task limits should only be app

[jira] [Updated] (MAPREDUCE-6697) Concurrent task limits should only be applied when necessary

2017-07-12 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated MAPREDUCE-6697: -- Attachment: MAPREDUCE-6697-branch-2.8.001.patch Applies to branch-2.8 and branch-2.7

[jira] [Reopened] (MAPREDUCE-6697) Concurrent task limits should only be applied when necessary

2017-07-12 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts reopened MAPREDUCE-6697: --- Adding patch for 2.8/2.7 > Concurrent task limits should only be applied when necessa

[jira] [Commented] (MAPREDUCE-6697) Concurrent task limits should only be applied when necessary

2017-06-27 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065538#comment-16065538 ] Nathan Roberts commented on MAPREDUCE-6697: --- @aajisaka Thanks for taking a l

[jira] [Commented] (MAPREDUCE-6763) Shuffle server listen queue is too small

2016-08-19 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15428749#comment-15428749 ] Nathan Roberts commented on MAPREDUCE-6763: --- Thanks [~jlowe] for the improve

[jira] [Updated] (MAPREDUCE-6697) Concurrent task limits should only be applied when necessary

2016-06-14 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated MAPREDUCE-6697: -- Status: Patch Available (was: Open) > Concurrent task limits should only be applied

[jira] [Updated] (MAPREDUCE-6697) Concurrent task limits should only be applied when necessary

2016-06-14 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated MAPREDUCE-6697: -- Attachment: MAPREDUCE-6697-v1.patch Attaching patch. Ideally it wouldn't call getTot

[jira] [Assigned] (MAPREDUCE-6697) Concurrent task limits should only be applied when necessary

2016-05-16 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts reassigned MAPREDUCE-6697: - Assignee: Nathan Roberts > Concurrent task limits should only be applied when

[jira] [Commented] (MAPREDUCE-6678) Allow ShuffleHandler readahead without drop-behind

2016-05-09 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277018#comment-15277018 ] Nathan Roberts commented on MAPREDUCE-6678: --- bq. I recognize that it's diffi

[jira] [Moved] (MAPREDUCE-6678) Allow ShuffleHandler readahead without drop-behind

2016-04-15 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts moved YARN-4964 to MAPREDUCE-6678: - Affects Version/s: (was: 2.7.2)

[jira] [Created] (MAPREDUCE-6631) shuffle handler would benefit from per-local-dir threads

2016-02-08 Thread Nathan Roberts (JIRA)
Nathan Roberts created MAPREDUCE-6631: - Summary: shuffle handler would benefit from per-local-dir threads Key: MAPREDUCE-6631 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6631 Project: Hado

[jira] [Commented] (MAPREDUCE-2841) Task level native optimization

2014-10-15 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14172967#comment-14172967 ] Nathan Roberts commented on MAPREDUCE-2841: --- {quote} Let's let this bake in

[jira] [Commented] (MAPREDUCE-5846) Rumen doesn't understand JobQueueChangedEvent

2014-04-23 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13978946#comment-13978946 ] Nathan Roberts commented on MAPREDUCE-5846: --- verified by running org.apache.

[jira] [Updated] (MAPREDUCE-5846) Rumen doesn't understand JobQueueChangedEvent

2014-04-23 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated MAPREDUCE-5846: -- Status: Patch Available (was: Open) > Rumen doesn't understand JobQueueChangedEven

[jira] [Assigned] (MAPREDUCE-5846) Rumen doesn't understand JobQueueChangedEvent

2014-04-17 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts reassigned MAPREDUCE-5846: - Assignee: Nathan Roberts > Rumen doesn't understand JobQueueChangedEvent > --

[jira] [Updated] (MAPREDUCE-5846) Rumen doesn't understand JobQueueChangedEvent

2014-04-17 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated MAPREDUCE-5846: -- Attachment: MAPREDUCE-5846.patch > Rumen doesn't understand JobQueueChangedEvent >

[jira] [Created] (MAPREDUCE-5846) Rumen doesn't understand JobQueueChangedEvent

2014-04-17 Thread Nathan Roberts (JIRA)
Nathan Roberts created MAPREDUCE-5846: - Summary: Rumen doesn't understand JobQueueChangedEvent Key: MAPREDUCE-5846 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5846 Project: Hadoop Map/Redu

[jira] [Updated] (MAPREDUCE-5569) FloatSplitter is not generating correct splits

2013-10-09 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated MAPREDUCE-5569: -- Attachment: MAPREDUCE-5569-branch-1.patch Added a patch for branch 1. I pulled over

[jira] [Updated] (MAPREDUCE-5102) fix coverage org.apache.hadoop.mapreduce.lib.db and org.apache.hadoop.mapred.lib.db

2013-10-08 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated MAPREDUCE-5102: -- Attachment: MAPREDUCE-5102-branch-2--n5.patch MAPREDUCE-5102-trunk--

[jira] [Commented] (MAPREDUCE-5102) fix coverage org.apache.hadoop.mapreduce.lib.db and org.apache.hadoop.mapred.lib.db

2013-10-08 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13789366#comment-13789366 ] Nathan Roberts commented on MAPREDUCE-5102: --- Thanks for the updated patch. I

[jira] [Commented] (MAPREDUCE-5102) fix coverage org.apache.hadoop.mapreduce.lib.db and org.apache.hadoop.mapred.lib.db

2013-10-07 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13788447#comment-13788447 ] Nathan Roberts commented on MAPREDUCE-5102: --- Some comments: * In testDBInput

[jira] [Commented] (MAPREDUCE-5569) FloatSplitter is not generating correct splits

2013-10-07 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13788444#comment-13788444 ] Nathan Roberts commented on MAPREDUCE-5569: --- HADOOP-5102 - should have been

[jira] [Updated] (MAPREDUCE-5569) FloatSplitter is not generating correct splits

2013-10-07 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated MAPREDUCE-5569: -- Status: Patch Available (was: Open) Attached patch for trunk. Unit tests are part

[jira] [Updated] (MAPREDUCE-5569) FloatSplitter is not generating correct splits

2013-10-07 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated MAPREDUCE-5569: -- Attachment: MAPREDUCE-5569-trunk.patch > FloatSplitter is not generating correct sp

[jira] [Updated] (MAPREDUCE-5569) FloatSplitter is not generating correct splits

2013-10-07 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated MAPREDUCE-5569: -- Affects Version/s: 0.23.9 > FloatSplitter is not generating correct splits > --

[jira] [Created] (MAPREDUCE-5569) FloatSplitter is not generating correct splits

2013-10-07 Thread Nathan Roberts (JIRA)
Nathan Roberts created MAPREDUCE-5569: - Summary: FloatSplitter is not generating correct splits Key: MAPREDUCE-5569 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5569 Project: Hadoop Map/Red

[jira] [Commented] (MAPREDUCE-5102) fix coverage org.apache.hadoop.mapreduce.lib.db and org.apache.hadoop.mapred.lib.db

2013-10-03 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13785284#comment-13785284 ] Nathan Roberts commented on MAPREDUCE-5102: --- Hi Aleksey. It also looks like

[jira] [Commented] (MAPREDUCE-5102) fix coverage org.apache.hadoop.mapreduce.lib.db and org.apache.hadoop.mapred.lib.db

2013-10-02 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13784417#comment-13784417 ] Nathan Roberts commented on MAPREDUCE-5102: --- Hi Aleksey, thanks for the patc

[jira] [Commented] (MAPREDUCE-5308) Shuffling to memory can get out-of-sync when fetching multiple compressed map outputs

2013-06-07 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13678345#comment-13678345 ] Nathan Roberts commented on MAPREDUCE-5308: --- Verified fix on both trunk and

[jira] [Updated] (MAPREDUCE-5308) Shuffling to memory can get out-of-sync when fetching multiple compressed map outputs

2013-06-07 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated MAPREDUCE-5308: -- Attachment: MAPREDUCE-5308-branch-0.23.txt Patch for branch-0.23 >

[jira] [Commented] (MAPREDUCE-5308) Shuffling to memory can get out-of-sync when fetching multiple compressed map outputs

2013-06-06 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13677574#comment-13677574 ] Nathan Roberts commented on MAPREDUCE-5308: --- Patch fixes this issue by attem

[jira] [Updated] (MAPREDUCE-5308) Shuffling to memory can get out-of-sync when fetching multiple compressed map outputs

2013-06-06 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated MAPREDUCE-5308: -- Attachment: MAPREDUCE-5308.patch Patch for trunk > Shuffling to me

[jira] [Created] (MAPREDUCE-5308) Shuffling to memory can get out-of-sync when fetching multiple compressed map outputs

2013-06-06 Thread Nathan Roberts (JIRA)
Nathan Roberts created MAPREDUCE-5308: - Summary: Shuffling to memory can get out-of-sync when fetching multiple compressed map outputs Key: MAPREDUCE-5308 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5

[jira] [Updated] (MAPREDUCE-4728) Interaction between oob heartbeats and damper can cause TT to heartbeat with zero delay

2012-10-17 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated MAPREDUCE-4728: -- Attachment: MAPREDUCE-4728.patch quick patch illustrating possible approach

[jira] [Created] (MAPREDUCE-4728) Interaction between oob heartbeats and damper can cause TT to heartbeat with zero delay

2012-10-17 Thread Nathan Roberts (JIRA)
Nathan Roberts created MAPREDUCE-4728: - Summary: Interaction between oob heartbeats and damper can cause TT to heartbeat with zero delay Key: MAPREDUCE-4728 URL: https://issues.apache.org/jira/browse/MAPREDUCE

[jira] [Commented] (MAPREDUCE-4499) Looking for speculative tasks is very expensive in 1.x

2012-08-20 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13438259#comment-13438259 ] Nathan Roberts commented on MAPREDUCE-4499: --- Ideally we'd be much less aggre

[jira] [Created] (MAPREDUCE-4499) Looking for speculative tasks is very expensive in 1.x

2012-07-31 Thread Nathan Roberts (JIRA)
Nathan Roberts created MAPREDUCE-4499: - Summary: Looking for speculative tasks is very expensive in 1.x Key: MAPREDUCE-4499 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4499 Project: Hadoop

[jira] [Commented] (MAPREDUCE-4444) nodemanager fails to start when one of the local-dirs is bad

2012-07-13 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13414088#comment-13414088 ] Nathan Roberts commented on MAPREDUCE-: --- disk_fail_in_place should allow

[jira] [Created] (MAPREDUCE-4444) nodemanager fails to start when one of the local-dirs is bad

2012-07-13 Thread Nathan Roberts (JIRA)
Nathan Roberts created MAPREDUCE-: - Summary: nodemanager fails to start when one of the local-dirs is bad Key: MAPREDUCE- URL: https://issues.apache.org/jira/browse/MAPREDUCE- Project:

[jira] [Created] (MAPREDUCE-3094) org.apache.hadoop.streaming.TestUlimit.testCommandLine fails intermittantly in 20.205.0

2011-09-26 Thread Nathan Roberts (JIRA)
org.apache.hadoop.streaming.TestUlimit.testCommandLine fails intermittantly in 20.205.0 --- Key: MAPREDUCE-3094 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3094

[jira] [Commented] (MAPREDUCE-2764) Fix renewal of dfs delegation tokens

2011-09-09 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13101201#comment-13101201 ] Nathan Roberts commented on MAPREDUCE-2764: --- Owen, Have you had a chance to

[jira] [Commented] (MAPREDUCE-2764) Fix renewal of dfs delegation tokens

2011-09-01 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13095387#comment-13095387 ] Nathan Roberts commented on MAPREDUCE-2764: --- After jitendra latest comment o

[jira] [Commented] (MAPREDUCE-2764) Fix renewal of dfs delegation tokens

2011-08-31 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13094983#comment-13094983 ] Nathan Roberts commented on MAPREDUCE-2764: --- Thanks Owen. Getting closer. .

[jira] [Commented] (MAPREDUCE-2764) Fix renewal of dfs delegation tokens

2011-08-31 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13094759#comment-13094759 ] Nathan Roberts commented on MAPREDUCE-2764: --- bq. It seems to make much more

[jira] [Updated] (MAPREDUCE-1060) JT should kill running maps when all the reducers have completed

2011-07-28 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated MAPREDUCE-1060: -- Fix Version/s: (was: 0.20.205.0) Not targeting 0.20.205. > JT should kill run

[jira] [Updated] (MAPREDUCE-1060) JT should kill running maps when all the reducers have completed

2011-07-26 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated MAPREDUCE-1060: -- Fix Version/s: 0.20.205.0 > JT should kill running maps when all the reducers have

[jira] [Updated] (MAPREDUCE-2650) back-port MAPREDUCE-2238 to 0.20-security

2011-07-21 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated MAPREDUCE-2650: -- Fix Version/s: 0.20.205.0 > back-port MAPREDUCE-2238 to 0.20-security > ---

[jira] [Updated] (MAPREDUCE-2187) map tasks timeout during sorting

2011-07-21 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated MAPREDUCE-2187: -- Fix Version/s: 0.20.205.0 > map tasks timeout during sorting >

[jira] [Commented] (MAPREDUCE-2572) Throttle the deletion of data from the distributed cache

2011-06-08 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13046036#comment-13046036 ] Nathan Roberts commented on MAPREDUCE-2572: --- One option might be to just do