[jira] [Created] (MAPREDUCE-5896) Allow InputSplits to indicate which locations have the block cached in memory

2014-05-20 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5896: - Summary: Allow InputSplits to indicate which locations have the block cached in memory Key: MAPREDUCE-5896 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5896

[jira] [Created] (MAPREDUCE-5763) Warn message about httpshuffle in NM logs

2014-02-22 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5763: - Summary: Warn message about httpshuffle in NM logs Key: MAPREDUCE-5763 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5763 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-5759) Remove unnecessary conf load in Limits

2014-02-18 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5759: - Summary: Remove unnecessary conf load in Limits Key: MAPREDUCE-5759 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5759 Project: Hadoop Map/Reduce Is

[jira] [Resolved] (MAPREDUCE-5745) thread may hang forever, even after it receives all the expected data

2014-02-06 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved MAPREDUCE-5745. --- Resolution: Invalid > thread may hang forever, even after it receives all the expected da

[jira] [Created] (MAPREDUCE-5732) Report proper queue when job has been automatically placed

2014-01-21 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5732: - Summary: Report proper queue when job has been automatically placed Key: MAPREDUCE-5732 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5732 Project: Hadoop Map

[jira] [Created] (MAPREDUCE-5725) TestNetworkedJob relies on the Capacity Scheduler

2014-01-15 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5725: - Summary: TestNetworkedJob relies on the Capacity Scheduler Key: MAPREDUCE-5725 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5725 Project: Hadoop Map/Reduce

[jira] [Resolved] (MAPREDUCE-5712) Backport Fair Scheduler pool placement by secondary group

2014-01-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved MAPREDUCE-5712. --- Resolution: Fixed Assignee: Ted Malaska Hadoop Flags: Reviewed I just commi

[jira] [Resolved] (MAPREDUCE-5651) Backport Fair Scheduler queue placement policies to branch-1

2014-01-07 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved MAPREDUCE-5651. --- Resolution: Fixed Fix Version/s: 1.3.0 Hadoop Flags: Reviewed I just committe

[jira] [Created] (MAPREDUCE-5665) Add audience annotations to MiniMRYarnCluster and MiniMRCluster

2013-12-03 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5665: - Summary: Add audience annotations to MiniMRYarnCluster and MiniMRCluster Key: MAPREDUCE-5665 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5665 Project: Hado

[jira] [Created] (MAPREDUCE-5651) Backport Fair Scheduler queue placement policies to branch-1

2013-11-25 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5651: - Summary: Backport Fair Scheduler queue placement policies to branch-1 Key: MAPREDUCE-5651 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5651 Project: Hadoop

[jira] [Created] (MAPREDUCE-5619) Separate out configuration loading from QueueManager in the Fair Scheduler

2013-11-11 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5619: - Summary: Separate out configuration loading from QueueManager in the Fair Scheduler Key: MAPREDUCE-5619 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5619 Pr

[jira] [Created] (MAPREDUCE-5612) Document TaskAttemptCompletionStatuses

2013-11-07 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5612: - Summary: Document TaskAttemptCompletionStatuses Key: MAPREDUCE-5612 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5612 Project: Hadoop Map/Reduce Is

[jira] [Created] (MAPREDUCE-5608) Replace and deprecate mapred.tasktracker.indexcache.mb

2013-11-05 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5608: - Summary: Replace and deprecate mapred.tasktracker.indexcache.mb Key: MAPREDUCE-5608 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5608 Project: Hadoop Map/Red

[jira] [Created] (MAPREDUCE-5601) Fetches when reducer can't fit them result in unnecessary reads on shuffle server

2013-10-29 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5601: - Summary: Fetches when reducer can't fit them result in unnecessary reads on shuffle server Key: MAPREDUCE-5601 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5601

[jira] [Created] (MAPREDUCE-5599) JobHistoryServer unnecessarily copies all jobs on each query

2013-10-28 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5599: - Summary: JobHistoryServer unnecessarily copies all jobs on each query Key: MAPREDUCE-5599 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5599 Project: Hadoop

[jira] [Created] (MAPREDUCE-5596) Allow configuring the number of threads used to serve shuffle connections

2013-10-25 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5596: - Summary: Allow configuring the number of threads used to serve shuffle connections Key: MAPREDUCE-5596 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5596 Pro

[jira] [Created] (MAPREDUCE-5592) Backport MAPREDUCE-1119 (stack traces on task timeout) in branch-1

2013-10-23 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5592: - Summary: Backport MAPREDUCE-1119 (stack traces on task timeout) in branch-1 Key: MAPREDUCE-5592 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5592 Project: H

[jira] [Created] (MAPREDUCE-5578) Miscellaneous Fair Scheduler speedups

2013-10-11 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5578: - Summary: Miscellaneous Fair Scheduler speedups Key: MAPREDUCE-5578 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5578 Project: Hadoop Map/Reduce Iss

[jira] [Created] (MAPREDUCE-5577) Allow querying the JobHistoryServer by job arrival time

2013-10-10 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5577: - Summary: Allow querying the JobHistoryServer by job arrival time Key: MAPREDUCE-5577 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5577 Project: Hadoop Map/Re

[jira] [Created] (MAPREDUCE-5575) History files deleted from the intermediate directory never get removed from the JobListCache

2013-10-10 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5575: - Summary: History files deleted from the intermediate directory never get removed from the JobListCache Key: MAPREDUCE-5575 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5

[jira] [Created] (MAPREDUCE-5544) JobClient#getJob loads job conf twice

2013-09-26 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5544: - Summary: JobClient#getJob loads job conf twice Key: MAPREDUCE-5544 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5544 Project: Hadoop Map/Reduce Iss

[jira] [Created] (MAPREDUCE-5527) Add CONTAINERS_MILLIS_MAPS|REDUCES counters

2013-09-23 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5527: - Summary: Add CONTAINERS_MILLIS_MAPS|REDUCES counters Key: MAPREDUCE-5527 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5527 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-5487) In task processes, JobConf is unnecessarily loaded again in Limits

2013-08-29 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5487: - Summary: In task processes, JobConf is unnecessarily loaded again in Limits Key: MAPREDUCE-5487 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5487 Project: H

[jira] [Created] (MAPREDUCE-5484) YarnChild unnecessarily loads job conf twice

2013-08-28 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5484: - Summary: YarnChild unnecessarily loads job conf twice Key: MAPREDUCE-5484 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5484 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-5478) TeraInputFormat unnecessarily defines its own FileSplit subclass

2013-08-22 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5478: - Summary: TeraInputFormat unnecessarily defines its own FileSplit subclass Key: MAPREDUCE-5478 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5478 Project: Had

[jira] [Created] (MAPREDUCE-5464) Add MEM_MILLIS_MAPS and MEM_MILLIS_REDUCES counter

2013-08-15 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5464: - Summary: Add MEM_MILLIS_MAPS and MEM_MILLIS_REDUCES counter Key: MAPREDUCE-5464 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5464 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-5463) Deprecate SLOTS_MILLIS counters

2013-08-15 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5463: - Summary: Deprecate SLOTS_MILLIS counters Key: MAPREDUCE-5463 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5463 Project: Hadoop Map/Reduce Issue Typ

[jira] [Created] (MAPREDUCE-5462) In map-side sort, swap entire meta entries instead of indexes for better cache performance

2013-08-15 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5462: - Summary: In map-side sort, swap entire meta entries instead of indexes for better cache performance Key: MAPREDUCE-5462 URL: https://issues.apache.org/jira/browse/MAPREDUCE-546

[jira] [Created] (MAPREDUCE-5457) Add a KeyOnlyTextOutputFormat to enable streaming write out text files without separators

2013-08-13 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5457: - Summary: Add a KeyOnlyTextOutputFormat to enable streaming write out text files without separators Key: MAPREDUCE-5457 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5457

[jira] [Resolved] (MAPREDUCE-5450) Unnecessary Configuration instantiation in IFileInputStream slows down merge - Port to branch-1

2013-08-07 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved MAPREDUCE-5450. --- Resolution: Fixed Hadoop Flags: Reviewed > Unnecessary Configuration instantiat

[jira] [Reopened] (MAPREDUCE-5311) Remove slot millis computation logic and deprecate counter constants

2013-08-02 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reopened MAPREDUCE-5311: --- > Remove slot millis computation logic and deprecate counter constants >

[jira] [Resolved] (MAPREDUCE-5059) Job overview shows average merge time larger than for any reduce attempt

2013-07-28 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved MAPREDUCE-5059. --- Resolution: Fixed > Job overview shows average merge time larger than for any reduce

[jira] [Reopened] (MAPREDUCE-5059) Job overview shows average merge time larger than for any reduce attempt

2013-07-28 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reopened MAPREDUCE-5059: --- > Job overview shows average merge time larger than for any reduce attempt >

[jira] [Created] (MAPREDUCE-5420) Remove mapreduce.task.tmp.dir from mapred-default.xml

2013-07-25 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5420: - Summary: Remove mapreduce.task.tmp.dir from mapred-default.xml Key: MAPREDUCE-5420 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5420 Project: Hadoop Map/Redu

[jira] [Created] (MAPREDUCE-5403) Get rid of yarn.application.classpath

2013-07-18 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5403: - Summary: Get rid of yarn.application.classpath Key: MAPREDUCE-5403 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5403 Project: Hadoop Map/Reduce Iss

[jira] [Created] (MAPREDUCE-5383) Deprecate to mapreduce.jobtracker.staging.root.dir to yarn.app.mapreduce.am.staging-dir

2013-07-11 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5383: - Summary: Deprecate to mapreduce.jobtracker.staging.root.dir to yarn.app.mapreduce.am.staging-dir Key: MAPREDUCE-5383 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5383

[jira] [Created] (MAPREDUCE-5382) LocalJobRunner should use default FS for system and staging dirs by default

2013-07-11 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5382: - Summary: LocalJobRunner should use default FS for system and staging dirs by default Key: MAPREDUCE-5382 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5382 P

[jira] [Created] (MAPREDUCE-5379) Include FS delegation token ID in job conf

2013-07-09 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5379: - Summary: Include FS delegation token ID in job conf Key: MAPREDUCE-5379 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5379 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-5372) ControlledJob#getMapredJobID capitalization is inconsistent between MR1 and MR2

2013-07-02 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5372: - Summary: ControlledJob#getMapredJobID capitalization is inconsistent between MR1 and MR2 Key: MAPREDUCE-5372 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5372

[jira] [Created] (MAPREDUCE-5367) Local jobs all use same local working directory

2013-07-01 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5367: - Summary: Local jobs all use same local working directory Key: MAPREDUCE-5367 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5367 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-5365) Set mapreduce.job.classpath to true by default

2013-07-01 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5365: - Summary: Set mapreduce.job.classpath to true by default Key: MAPREDUCE-5365 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5365 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-5363) Fix doc and spelling for TaskCompletionEvent#getTaskStatus and getStatus

2013-07-01 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5363: - Summary: Fix doc and spelling for TaskCompletionEvent#getTaskStatus and getStatus Key: MAPREDUCE-5363 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5363 Proj

[jira] [Created] (MAPREDUCE-5351) JobTracker memory leak caused by CleanupQueue reopening FileSystem

2013-06-24 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5351: - Summary: JobTracker memory leak caused by CleanupQueue reopening FileSystem Key: MAPREDUCE-5351 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5351 Project: H

[jira] [Created] (MAPREDUCE-5350) Expose Fair Scheduler-specific queue metrics

2013-06-24 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5350: - Summary: Expose Fair Scheduler-specific queue metrics Key: MAPREDUCE-5350 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5350 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-5338) Bring back mapred.child.ulimit

2013-06-21 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5338: - Summary: Bring back mapred.child.ulimit Key: MAPREDUCE-5338 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5338 Project: Hadoop Map/Reduce Issue Type

[jira] [Created] (MAPREDUCE-5321) Enable better parallelism in the Fair Scheduler

2013-06-13 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5321: - Summary: Enable better parallelism in the Fair Scheduler Key: MAPREDUCE-5321 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5321 Project: Hadoop Map/Reduce

[jira] [Resolved] (MAPREDUCE-5182) LineRecordReader#getProgress throwing IOException breaks compatibility

2013-06-07 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved MAPREDUCE-5182. --- Resolution: Won't Fix > LineRecordReader#getProgress throwing IOException breaks comp

[jira] [Resolved] (MAPREDUCE-5252) Fair scheduler should use SchedulerUtils.normalizeRequest

2013-06-07 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved MAPREDUCE-5252. --- Resolution: Not A Problem This was fixed in YARN-326 > Fair scheduler sh

[jira] [Created] (MAPREDUCE-5302) NodeManager throws AvroRuntimeException on failed start

2013-06-03 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5302: - Summary: NodeManager throws AvroRuntimeException on failed start Key: MAPREDUCE-5302 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5302 Project: Hadoop Map/Re

[jira] [Created] (MAPREDUCE-5283) Over 10 different tests have near identical implementations of AppContext

2013-05-29 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5283: - Summary: Over 10 different tests have near identical implementations of AppContext Key: MAPREDUCE-5283 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5283 Pro

[jira] [Reopened] (MAPREDUCE-5036) Default shuffle handler port should not be 8080

2013-05-28 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reopened MAPREDUCE-5036: --- > Default shuffle handler port should not be 8080 > -

[jira] [Resolved] (MAPREDUCE-5236) references to JobConf.DISABLE_MEMORY_LIMIT don't make sense in the context of MR2

2013-05-16 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved MAPREDUCE-5236. --- Resolution: Duplicate > references to JobConf.DISABLE_MEMORY_LIMIT don't make sense i

[jira] [Created] (MAPREDUCE-5252) Fair scheduler should use SchedulerUtils.normalizeRequest

2013-05-15 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5252: - Summary: Fair scheduler should use SchedulerUtils.normalizeRequest Key: MAPREDUCE-5252 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5252 Project: Hadoop Map/

[jira] [Created] (MAPREDUCE-5238) TestDistCacheEmulation.testGenerateDistCacheData is failing in trunk

2013-05-10 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5238: - Summary: TestDistCacheEmulation.testGenerateDistCacheData is failing in trunk Key: MAPREDUCE-5238 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5238 Project:

[jira] [Created] (MAPREDUCE-5236) JobConf should not support disabling memory limits

2013-05-09 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5236: - Summary: JobConf should not support disabling memory limits Key: MAPREDUCE-5236 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5236 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-5220) Setter methods in TaskCompletionEvent are public in MR1 and protected in MR2

2013-05-07 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5220: - Summary: Setter methods in TaskCompletionEvent are public in MR1 and protected in MR2 Key: MAPREDUCE-5220 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5220

[jira] [Created] (MAPREDUCE-5219) JobStatus#getJobPriority changed to JobStatus#getPriority in MR2

2013-05-07 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5219: - Summary: JobStatus#getJobPriority changed to JobStatus#getPriority in MR2 Key: MAPREDUCE-5219 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5219 Project: Had

[jira] [Resolved] (MAPREDUCE-3946) If a resource requirement is higher than available on any node, job should fail early

2013-05-03 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved MAPREDUCE-3946. --- Resolution: Duplicate > If a resource requirement is higher than available on any nod

[jira] [Resolved] (MAPREDUCE-5134) Default settings cause LocalJobRunner to OOME

2013-04-29 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved MAPREDUCE-5134. --- Resolution: Not A Problem > Default settings cause LocalJobRunner to OOME > -

[jira] [Created] (MAPREDUCE-5185) When log aggregation not enabled, message should point to NM HTTP port, not IPC port

2013-04-26 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5185: - Summary: When log aggregation not enabled, message should point to NM HTTP port, not IPC port Key: MAPREDUCE-5185 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5185

[jira] [Created] (MAPREDUCE-5183) In, TaskTracker#reportProgress logging of 0.0-1.0 progress is followed by percent sign

2013-04-25 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5183: - Summary: In, TaskTracker#reportProgress logging of 0.0-1.0 progress is followed by percent sign Key: MAPREDUCE-5183 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5183

[jira] [Created] (MAPREDUCE-5182) LineRecordReader#getProgress throwing IOException breaks compatibility

2013-04-25 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5182: - Summary: LineRecordReader#getProgress throwing IOException breaks compatibility Key: MAPREDUCE-5182 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5182 Projec

[jira] [Created] (MAPREDUCE-5173) Need to specify master principal run local job in a secure setup

2013-04-22 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5173: - Summary: Need to specify master principal run local job in a secure setup Key: MAPREDUCE-5173 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5173 Project: Had

[jira] [Created] (MAPREDUCE-5172) Expose number of non-local maps in MR app metrics

2013-04-22 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5172: - Summary: Expose number of non-local maps in MR app metrics Key: MAPREDUCE-5172 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5172 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-5171) Expose info about blacklisted nodes from MR AM REST API

2013-04-22 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5171: - Summary: Expose info about blacklisted nodes from MR AM REST API Key: MAPREDUCE-5171 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5171 Project: Hadoop Map/R

[jira] [Created] (MAPREDUCE-5154) staging directory deletion fails because delegation tokens have been cancelled

2013-04-16 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5154: - Summary: staging directory deletion fails because delegation tokens have been cancelled Key: MAPREDUCE-5154 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5154

[jira] [Resolved] (MAPREDUCE-3603) Add Web UI to MR2 Fair Scheduler

2013-04-16 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved MAPREDUCE-3603. --- Resolution: Duplicate Assignee: (was: Patrick Wendell) > Add Web UI to MR2

[jira] [Reopened] (MAPREDUCE-4676) Add test for job history cleaner

2013-04-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reopened MAPREDUCE-4676: --- > Add test for job history cleaner > > >

[jira] [Created] (MAPREDUCE-5134) Default settings cause LocalJobRunner to OOME

2013-04-05 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5134: - Summary: Default settings cause LocalJobRunner to OOME Key: MAPREDUCE-5134 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5134 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-5133) TestSubmitJob.testSecureJobExecution is flaky due to job dir deletion race

2013-04-05 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5133: - Summary: TestSubmitJob.testSecureJobExecution is flaky due to job dir deletion race Key: MAPREDUCE-5133 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5133 Pr

[jira] [Created] (MAPREDUCE-5130) Add missing job config options to mapred-default.xml

2013-04-04 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5130: - Summary: Add missing job config options to mapred-default.xml Key: MAPREDUCE-5130 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5130 Project: Hadoop Map/Reduc

[jira] [Created] (MAPREDUCE-5128) mapred-default.xml is missing a bunch of history server configs

2013-04-04 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5128: - Summary: mapred-default.xml is missing a bunch of history server configs Key: MAPREDUCE-5128 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5128 Project: Hado

[jira] [Resolved] (MAPREDUCE-3951) Tasks are not evenly spread throughout cluster in MR2

2013-04-02 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved MAPREDUCE-3951. --- Resolution: Not A Problem > Tasks are not evenly spread throughout cluster in MR2 > -

[jira] [Created] (MAPREDUCE-5120) Allow app master to use tracing async dispatcher

2013-03-30 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5120: - Summary: Allow app master to use tracing async dispatcher Key: MAPREDUCE-5120 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5120 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-5111) Unnecessary RM address DNS lookup can cause unnecessary slowness on every JHS page load

2013-03-27 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5111: - Summary: Unnecessary RM address DNS lookup can cause unnecessary slowness on every JHS page load Key: MAPREDUCE-5111 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5111

[jira] [Reopened] (MAPREDUCE-5038) old API CombineFileInputFormat missing fixes that are in new API

2013-03-16 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reopened MAPREDUCE-5038: --- > old API CombineFileInputFormat missing fixes that are in new API > ---

[jira] [Created] (MAPREDUCE-5076) CombineFileInputFormat with maxSplitSize can omit data

2013-03-15 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5076: - Summary: CombineFileInputFormat with maxSplitSize can omit data Key: MAPREDUCE-5076 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5076 Project: Hadoop Map/Red

[jira] [Created] (MAPREDUCE-5073) TestJobStatusPersistency.testPersistency fails on JDK7

2013-03-14 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5073: - Summary: TestJobStatusPersistency.testPersistency fails on JDK7 Key: MAPREDUCE-5073 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5073 Project: Hadoop Map/Red

[jira] [Created] (MAPREDUCE-5072) TestDelegationTokenRenewal.testDTRenewal fails in MR1 on jdk7

2013-03-14 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5072: - Summary: TestDelegationTokenRenewal.testDTRenewal fails in MR1 on jdk7 Key: MAPREDUCE-5072 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5072 Project: Hadoop

[jira] [Created] (MAPREDUCE-5070) TestClusterStatus.testClusterMetrics fails on JDK7

2013-03-14 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5070: - Summary: TestClusterStatus.testClusterMetrics fails on JDK7 Key: MAPREDUCE-5070 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5070 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-5049) CombineFileInputFormat counts all compressed files non-splitable

2013-03-05 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5049: - Summary: CombineFileInputFormat counts all compressed files non-splitable Key: MAPREDUCE-5049 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5049 Project: Had

[jira] [Created] (MAPREDUCE-5047) keep.failed.task.files=true causes job failure on secure clusters

2013-03-05 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5047: - Summary: keep.failed.task.files=true causes job failure on secure clusters Key: MAPREDUCE-5047 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5047 Project: Ha

[jira] [Created] (MAPREDUCE-5038) mapred CombineFileInputFormat does not work on non-splittable files

2013-02-28 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5038: - Summary: mapred CombineFileInputFormat does not work on non-splittable files Key: MAPREDUCE-5038 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5038 Project:

[jira] [Resolved] (MAPREDUCE-4933) MR1 final merge asks for length of file it just wrote before flushing it

2013-02-27 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved MAPREDUCE-4933. --- Resolution: Fixed > MR1 final merge asks for length of file it just wrote before flus

[jira] [Created] (MAPREDUCE-5036) Default shuffle handler port should not be 8080

2013-02-27 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5036: - Summary: Default shuffle handler port should not be 8080 Key: MAPREDUCE-5036 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5036 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-5021) Add an addDirectoryToClassPath method DistributedCache

2013-02-21 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5021: - Summary: Add an addDirectoryToClassPath method DistributedCache Key: MAPREDUCE-5021 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5021 Project: Hadoop Map/Red

[jira] [Created] (MAPREDUCE-5013) JobStatus compatibility: MR2 missing constructors from MR1

2013-02-19 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5013: - Summary: JobStatus compatibility: MR2 missing constructors from MR1 Key: MAPREDUCE-5013 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5013 Project: Hadoop Map

[jira] [Created] (MAPREDUCE-5008) Merger progress miscounts with respect to EOF_MARKER

2013-02-15 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5008: - Summary: Merger progress miscounts with respect to EOF_MARKER Key: MAPREDUCE-5008 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5008 Project: Hadoop Map/Reduc

[jira] [Reopened] (MAPREDUCE-4994) -jt generic command line option does not work

2013-02-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reopened MAPREDUCE-4994: --- > -jt generic command line option does not work > ---

[jira] [Reopened] (MAPREDUCE-4643) Make job-history cleanup-period configurable

2013-02-12 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reopened MAPREDUCE-4643: --- > Make job-history cleanup-period configurable >

[jira] [Created] (MAPREDUCE-4997) Deprecate mapreduce.jobtracker.address

2013-02-10 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-4997: - Summary: Deprecate mapreduce.jobtracker.address Key: MAPREDUCE-4997 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4997 Project: Hadoop Map/Reduce Is

[jira] [Resolved] (MAPREDUCE-4922) Request with multiple data local nodes can cause NPE in AppSchedulingInfo

2013-02-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved MAPREDUCE-4922. --- Resolution: Won't Fix This is the expected behavior > Request with multi

[jira] [Created] (MAPREDUCE-4994) Can't submit local job with hadoop jar -jt local

2013-02-08 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-4994: - Summary: Can't submit local job with hadoop jar -jt local Key: MAPREDUCE-4994 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4994 Project: Hadoop Map/Reduce

[jira] [Resolved] (MAPREDUCE-4984) AM leaves unwanted node/rack requests after container has been assigned

2013-02-06 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved MAPREDUCE-4984. --- Resolution: Duplicate > AM leaves unwanted node/rack requests after container has bee

[jira] [Created] (MAPREDUCE-4984) AM leaves unwanted node/rack requests after container has been assigned

2013-02-06 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-4984: - Summary: AM leaves unwanted node/rack requests after container has been assigned Key: MAPREDUCE-4984 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4984 Proje

[jira] [Created] (MAPREDUCE-4970) Child tasks create security audit log files

2013-01-31 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-4970: - Summary: Child tasks create security audit log files Key: MAPREDUCE-4970 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4970 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-4965) In merge, no ordering defined for CompressAwarePath

2013-01-28 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-4965: - Summary: In merge, no ordering defined for CompressAwarePath Key: MAPREDUCE-4965 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4965 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-4962) jobdetails.jsp uses display name instead of real name to get counters

2013-01-25 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-4962: - Summary: jobdetails.jsp uses display name instead of real name to get counters Key: MAPREDUCE-4962 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4962 Project

[jira] [Resolved] (MAPREDUCE-4952) FSSchedulerNode is always instantiated with a 0 virtual core capacity

2013-01-20 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved MAPREDUCE-4952. --- Resolution: Invalid Sorry, this should be YARN JIRA - filed YARN-350 instead

[jira] [Created] (MAPREDUCE-4952) FSSchedulerNode is always instantiated with a 0 virtual core capacity

2013-01-20 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-4952: - Summary: FSSchedulerNode is always instantiated with a 0 virtual core capacity Key: MAPREDUCE-4952 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4952 Project

  1   2   >