[jira] [Commented] (MAPREDUCE-5984) native-task: upgrade lz4 to lastest version

2014-07-21 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14069837#comment-14069837 ] Chris Nauroth commented on MAPREDUCE-5984: -- Hi, [~decster]. I haven't watche

[jira] [Commented] (MAPREDUCE-5978) native-task CompressTest failure on Ubuntu

2014-07-21 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14069810#comment-14069810 ] Todd Lipcon commented on MAPREDUCE-5978: Got it. We typically don't allow fail

[jira] [Commented] (MAPREDUCE-5963) ShuffleHandler DB schema should be versioned with compatible/incompatible changes

2014-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14069764#comment-14069764 ] Hadoop QA commented on MAPREDUCE-5963: -- {color:red}-1 overall{color}. Here are t

[jira] [Created] (MAPREDUCE-5987) native-task: Unit test TestGlibCBug fails on ubuntu

2014-07-21 Thread Sean Zhong (JIRA)
Sean Zhong created MAPREDUCE-5987: - Summary: native-task: Unit test TestGlibCBug fails on ubuntu Key: MAPREDUCE-5987 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5987 Project: Hadoop Map/Reduce

[jira] [Commented] (MAPREDUCE-2841) Task level native optimization

2014-07-21 Thread Sean Zhong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14069754#comment-14069754 ] Sean Zhong commented on MAPREDUCE-2841: --- Hi Binglin, The TestGlibCBug UT fail i

[jira] [Updated] (MAPREDUCE-5963) ShuffleHandler DB schema should be versioned with compatible/incompatible changes

2014-07-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5963: -- Status: Patch Available (was: Open) > ShuffleHandler DB schema should be versioned with co

[jira] [Updated] (MAPREDUCE-5963) ShuffleHandler DB schema should be versioned with compatible/incompatible changes

2014-07-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5963: -- Attachment: MAPREDUCE-5963-v2.patch Update patch to latest trunk and do some fix on visibil

[jira] [Commented] (MAPREDUCE-5984) native-task: upgrade lz4 to lastest version

2014-07-21 Thread Sean Zhong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14069724#comment-14069724 ] Sean Zhong commented on MAPREDUCE-5984: --- Binglin, Looks good to me. Only one mi

[jira] [Commented] (MAPREDUCE-5978) native-task CompressTest failure on Ubuntu

2014-07-21 Thread Sean Zhong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14069720#comment-14069720 ] Sean Zhong commented on MAPREDUCE-5978: --- Hi Todd, This is expected. We currentl

[jira] [Commented] (MAPREDUCE-5974) Allow map output collector fallback

2014-07-21 Thread Sean Zhong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14069686#comment-14069686 ] Sean Zhong commented on MAPREDUCE-5974: --- This change is simple and compatible, +

[jira] [Commented] (MAPREDUCE-5975) Fix native-task build on Ubuntu 13.10

2014-07-21 Thread Sean Zhong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14069674#comment-14069674 ] Sean Zhong commented on MAPREDUCE-5975: --- looks good. +1 > Fix native-task build

[jira] [Commented] (MAPREDUCE-5979) MR1 FairScheduler zero weight can cause sort failures

2014-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14069670#comment-14069670 ] Hadoop QA commented on MAPREDUCE-5979: -- {color:red}-1 overall{color}. Here are t

[jira] [Updated] (MAPREDUCE-5979) MR1 FairScheduler zero weight can cause sort failures

2014-07-21 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated MAPREDUCE-5979: - Attachment: MAPREDUCE-5979.002.patch Instead of using a min weight for zero weight, a

[jira] [Created] (MAPREDUCE-5986) make TestMRJobsWithProfiler faster

2014-07-21 Thread Mit Desai (JIRA)
Mit Desai created MAPREDUCE-5986: Summary: make TestMRJobsWithProfiler faster Key: MAPREDUCE-5986 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5986 Project: Hadoop Map/Reduce Issue Ty

[jira] [Resolved] (MAPREDUCE-477) Support for reading bzip2 compressed file created using concatenation of multiple .bz2 files

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-477. Resolution: Fixed This looks fixed based on a quick read of the source tree. >

[jira] [Updated] (MAPREDUCE-347) Improve the way error messages are displayed from jobclient

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-347: --- Labels: newbie (was: ) > Improve the way error messages are displayed from jobcli

[jira] [Commented] (MAPREDUCE-164) JobHistory should also support searching with special characters

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14069405#comment-14069405 ] Allen Wittenauer commented on MAPREDUCE-164: It would be good to make sure

[jira] [Resolved] (MAPREDUCE-566) Add default port for jobtracker (mapred.job.tracker)

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-566. Resolution: Incomplete Stale at this point. > Add default port for jobtracker (

[jira] [Updated] (MAPREDUCE-164) JobHistory should also support searching with special characters

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-164: --- Labels: newbie (was: ) > JobHistory should also support searching with special ch

[jira] [Resolved] (MAPREDUCE-184) Submitted jobs on jobtracker.jsp

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-184. Resolution: Won't Fix > Submitted jobs on jobtracker.jsp > -

[jira] [Resolved] (MAPREDUCE-273) Jobs should not be initialized while the recovery is in progress

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-273. Resolution: Won't Fix > Jobs should not be initialized while the recovery is in

[jira] [Resolved] (MAPREDUCE-208) Provide an admin page displaying events in the cluster along with cluster status/health

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-208. Resolution: Won't Fix > Provide an admin page displaying events in the cluster a

[jira] [Resolved] (MAPREDUCE-145) DiskChecker$DiskErrorException when 'reduce > reduce'

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-145. Resolution: Cannot Reproduce > DiskChecker$DiskErrorException when 'reduce > red

[jira] [Resolved] (MAPREDUCE-213) Provide a way to query job tracker about its daemon thread's status

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-213. Resolution: Incomplete Closing this as stale. > Provide a way to query job trac

[jira] [Resolved] (MAPREDUCE-435) JobTracker might not accept first few jobs if restarted immediately

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-435. Resolution: Fixed Irrelevant thanks to YARN! Closing! > JobTracker might not ac

[jira] [Resolved] (MAPREDUCE-411) Inconsistent strings for job and queue related scheduling information in UI when the information is not available.

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-411. Resolution: Fixed This has all changed with yarn. closing as stale. > Inconsist

[jira] [Resolved] (MAPREDUCE-330) Log information regarding changes to job in jobtracker

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-330. Resolution: Fixed This should all be fixed now. > Log information regarding cha

[jira] [Commented] (MAPREDUCE-5756) CombineFileInputFormat.getSplits() including directories in its results

2014-07-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14069372#comment-14069372 ] Hudson commented on MAPREDUCE-5756: --- SUCCESS: Integrated in Hadoop-trunk-Commit #592

[jira] [Resolved] (MAPREDUCE-194) Split Information errors when input data volumn is trivial

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-194. Resolution: Fixed I'm going to mark this as stale. > Split Information errors w

[jira] [Resolved] (MAPREDUCE-246) Job recovery should fail or kill a job that fails ACL checks upon restart, if the job was running previously

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-246. Resolution: Fixed I'm going to close this as stale. > Job recovery should fail

[jira] [Resolved] (MAPREDUCE-652) Logging turned on by default while using distcp

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-652. Resolution: Won't Fix discpv1 is dead. > Logging turned on by default while usi

[jira] [Resolved] (MAPREDUCE-650) Add atomic move option

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-650. Resolution: Fixed Just checked, yes, atomic is supported in distcpv2. Resolving.

[jira] [Commented] (MAPREDUCE-650) Add atomic move option

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14069350#comment-14069350 ] Allen Wittenauer commented on MAPREDUCE-650: With distcpv2, is this issue c

[jira] [Resolved] (MAPREDUCE-219) JT should remember blacklisted TT after restart

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-219. Resolution: Won't Fix > JT should remember blacklisted TT after restart > --

[jira] [Resolved] (MAPREDUCE-399) Duplicate destroy of process trees in TaskMemoryManager.

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-399. Resolution: Fixed Stale. No longer relevant in 2.x > Duplicate destroy of proc

[jira] [Updated] (MAPREDUCE-399) Duplicate destroy of process trees in TaskMemoryManager.

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-399: --- Labels: newbie (was: ) > Duplicate destroy of process trees in TaskMemoryManager.

[jira] [Resolved] (MAPREDUCE-169) JobHistory should log everything when a job fails or gets killed.

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-169. Resolution: Fixed LIkely stale. > JobHistory should log everything when a job f

[jira] [Updated] (MAPREDUCE-5756) CombineFileInputFormat.getSplits() including directories in its results

2014-07-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5756: -- Resolution: Fixed Fix Version/s: 2.6.0 3.0.0 Hadoop Flags: Re

[jira] [Resolved] (MAPREDUCE-175) Sometimes, Reduce tasks hangļ¼Œ State is unassigned

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-175. Resolution: Incomplete Closing this as either stale or already fixed or whatever

[jira] [Resolved] (MAPREDUCE-431) Task left in RUNNING state even after the job completion

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-431. Resolution: Fixed Likely stale. > Task left in RUNNING state even after the job

[jira] [Commented] (MAPREDUCE-290) Extend HADOOP-3293 to MapReduce package also

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14069317#comment-14069317 ] Allen Wittenauer commented on MAPREDUCE-290: Is this something we are still

[jira] [Assigned] (MAPREDUCE-5756) CombineFileInputFormat.getSplits() including directories in its results

2014-07-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned MAPREDUCE-5756: - Assignee: Jason Dere The TestPipeApplication failure was unrelated and fixed in MAPRE

[jira] [Resolved] (MAPREDUCE-317) Submitting job information via DFS in Map/Reduce causing consistency and performance issues

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-317. Resolution: Incomplete With YARN, this isn't too relevant anymore. Closing as st

[jira] [Commented] (MAPREDUCE-50) NPE in heartbeat when the configured topology script doesn't exist

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-50?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14069293#comment-14069293 ] Allen Wittenauer commented on MAPREDUCE-50: --- We should verify if this conditio

[jira] [Updated] (MAPREDUCE-50) NPE in heartbeat when the configured topology script doesn't exist

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-50?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-50: -- Labels: newbie (was: ) > NPE in heartbeat when the configured topology script doesn'

[jira] [Resolved] (MAPREDUCE-146) Stale job files in mapred system directory

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-146. Resolution: Not a Problem With split calculations moved and job submission chang

[jira] [Resolved] (MAPREDUCE-418) JT not able to find task id while updating status

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-418. Resolution: Fixed This is likely stale. > JT not able to find task id while upd

[jira] [Resolved] (MAPREDUCE-170) JobTracker doesn't need to download job's jar file onto its local filesystem.

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-170. Resolution: Fixed Fixed! > JobTracker doesn't need to download job's jar file o

[jira] [Resolved] (MAPREDUCE-193) NPEs in JobClient when mapred.jobtracker.completeuserjobs.maximum is set to zero.

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-193. Resolution: Incomplete Probably stale. Closing. > NPEs in JobClient when mapred

[jira] [Resolved] (MAPREDUCE-161) Tasks are not scheduled even though task trackers have extra slots

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-161. Resolution: Incomplete Closing this as stale. > Tasks are not scheduled even th

[jira] [Resolved] (MAPREDUCE-509) Setting the network interface for TaskTracker connection to task tracker http server

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-509. Resolution: Not a Problem You can't. Outbound connections on most Unix platform

[jira] [Resolved] (MAPREDUCE-192) In TaskTracker, the notification for waking up the completion-events fetcher thread may be lost

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-192. Resolution: Incomplete I'm just gonna close this as stale. > In TaskTracker

[jira] [Resolved] (MAPREDUCE-346) Report Map-Reduce Framework Counters in pipeline order

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-346. Resolution: Fixed Me too. Closing as fixed. > Report Map-Reduce Framework Count

[jira] [Resolved] (MAPREDUCE-424) Unreachable code in TaskInProgress.inCompleteSubTask

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-424. Resolution: Incomplete I suspect this is stale. > Unreachable code in TaskInPro

[jira] [Resolved] (MAPREDUCE-348) A proposal to merge common functionality of various Schedulers

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-348. Resolution: Won't Fix Closing this as Won't Fix. > A proposal to merge common

[jira] [Resolved] (MAPREDUCE-132) getSetupAndCleanupTasks should return multiple tasks in a heartbeat

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-132. Resolution: Incomplete I'm must going to close this as stale. > getSetupAndClea

[jira] [Resolved] (MAPREDUCE-555) Provide an option to turn off priorities in jobs

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-555. Resolution: Fixed This was done elsewhere by a flag in the schedulers themselves

[jira] [Resolved] (MAPREDUCE-143) OOM in the TaskTracker while serving map outputs

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-143. Resolution: Incomplete Closing as stale. > OOM in the TaskTracker while serving

[jira] [Resolved] (MAPREDUCE-354) the map output servlet should only locate the index if it isn't in the cache

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-354. Resolution: Incomplete I'm going to close this as stale. > the map output servl

[jira] [Resolved] (MAPREDUCE-190) MultipleOutputs should use newer Hadoop serialization interface since 0.19

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-190. Resolution: Incomplete I'm going to close this out as stale. > MultipleOutputs

[jira] [Resolved] (MAPREDUCE-183) The description for some of the configuration entries in the default xml files are outdated and needs to be updated

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-183. Resolution: Fixed I'm going to close this as fixed, as there was a major effort

[jira] [Resolved] (MAPREDUCE-406) setting fs.default.name to an invalid URI format kills init thread in JobTracker

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-406. Resolution: Fixed closing this as fixed based upon Todd's comment. > setting fs

[jira] [Commented] (MAPREDUCE-5654) blacklist is not propagated from AM to RM

2014-07-21 Thread Gourav Khaneja (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14069057#comment-14069057 ] Gourav Khaneja commented on MAPREDUCE-5654: --- Hi. Just FYI - I've used Blackl

[jira] [Commented] (MAPREDUCE-5957) AM throws ClassNotFoundException with job classloader enabled if custom output format/committer is used

2014-07-21 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14069042#comment-14069042 ] Sangjin Lee commented on MAPREDUCE-5957: Thanks Jason! Confirming that the onl

[jira] [Resolved] (MAPREDUCE-241) JobQueueTaskScheduler could assign multiple reduces per heartbeat

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-241. Resolution: Won't Fix > JobQueueTaskScheduler could assign multiple reduces per

[jira] [Resolved] (MAPREDUCE-520) The capacity schedule must start a timer when a queue is underserved

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-520. Resolution: Won't Fix > The capacity schedule must start a timer when a queue is

[jira] [Resolved] (MAPREDUCE-519) Fix capacity scheduler's documentation

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-519. Resolution: Won't Fix It's still broken in 1.x, but not in 2.x. Closing this as

[jira] [Updated] (MAPREDUCE-5957) AM throws ClassNotFoundException with job classloader enabled if custom output format/committer is used

2014-07-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5957: -- Resolution: Fixed Fix Version/s: 2.6.0 3.0.0 Hadoop Flags: Re

[jira] [Updated] (MAPREDUCE-5957) AM throws ClassNotFoundException with job classloader enabled if custom output format/committer is used

2014-07-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5957: -- Attachment: MAPREDUCE-5957.branch-2.patch Patch had a minor conflict with branch-2, so I'm

[jira] [Resolved] (MAPREDUCE-312) Port HADOOP-4667 to the default Map-Reduce scheduler

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-312. Resolution: Won't Fix Closing this as won't fix. > Port HADOOP-4667 to the de

[jira] [Resolved] (MAPREDUCE-538) Port HADOOP-4667 to teh capacity scheduler

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-538. Resolution: Incomplete Closing this as stale. or maybe fixed. > Port HADOOP-46

[jira] [Resolved] (MAPREDUCE-3753) Reduce output data is not written to disk

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-3753. - Resolution: Incomplete I'm going to close this issue as stale. > Reduce outp

[jira] [Resolved] (MAPREDUCE-1941) Need a servlet in JobTracker to stream contents of the job history file

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-1941. - Resolution: Fixed > Need a servlet in JobTracker to stream contents of the jo

[jira] [Resolved] (MAPREDUCE-291) Optionally a separate daemon should serve JobHistory

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-291. Resolution: Fixed I'm starting to find it hilarious that we add major features t

[jira] [Commented] (MAPREDUCE-5957) AM throws ClassNotFoundException with job classloader enabled if custom output format/committer is used

2014-07-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14068923#comment-14068923 ] Hudson commented on MAPREDUCE-5957: --- FAILURE: Integrated in Hadoop-trunk-Commit #592

[jira] [Resolved] (MAPREDUCE-289) JobTracker should not expand jobs if its running low on memory

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-289. Resolution: Fixed Job submission was changed significantly in 0.20.20x timeline

[jira] [Resolved] (MAPREDUCE-331) Make jobtracker resilient to memory issues

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-331. Resolution: Fixed I'm closing this as fixed. There have been a multitude of par

[jira] [Resolved] (MAPREDUCE-154) Mapper runs out of memory

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-154. Resolution: Cannot Reproduce > Mapper runs out of memory > -

[jira] [Resolved] (MAPREDUCE-400) WebUI shows 100% Map Complete even though some maps are still running

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-400. Resolution: Incomplete Closing as stale. > WebUI shows 100% Map Complete even t

[jira] [Resolved] (MAPREDUCE-398) Task process exit with nonzero status of 134.

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-398. Resolution: Cannot Reproduce Closing as stale. > Task process exit with nonzero

[jira] [Resolved] (MAPREDUCE-5438) JavaDoc generates partially for MultithreadedMapRunner

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-5438. - Resolution: Duplicate Closing as a dupe. > JavaDoc generates partially for M

[jira] [Updated] (MAPREDUCE-2815) JavaDoc does not generate correctly for MultithreadedMapRunner

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-2815: Labels: newbie (was: ) > JavaDoc does not generate correctly for Multithreaded

[jira] [Resolved] (MAPREDUCE-147) server can't set username in JobClient.submitJob for jobs submitted on behalf of other users

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-147. Resolution: Won't Fix Closing as won't fix. > server can't set username in JobC

[jira] [Resolved] (MAPREDUCE-405) ReduceTask logs show negative values

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-405. Resolution: Fixed I haven't seen this in forever, so I'm guess it's been fixed.

[jira] [Resolved] (MAPREDUCE-189) Change Map-Reduce framework to use JAAS instead of UGI

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-189. Resolution: Incomplete I'm going to close this as stale, since it is probably to

[jira] [Resolved] (MAPREDUCE-518) Have end to end tests based on MiniMRCluster to verify correct behaviour of slot reclamation by queues.

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-518. Resolution: Incomplete Stale > Have end to end tests based on MiniMRCluster to

[jira] [Resolved] (MAPREDUCE-531) Have end to end tests based on MiniMRCluster to verify the correct behaviour of user limits

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-531. Resolution: Incomplete Closing this as stale. > Have end to end tests based

[jira] [Resolved] (MAPREDUCE-525) Have end to end tests based on MiniMRCluster to verify the correct behaviour of job priorities.

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-525. Resolution: Incomplete Closing as this as stale. > Have end to end tests based

[jira] [Resolved] (MAPREDUCE-524) Have end to end tests based on MiniMRCluster to verify the correct behaviour of job initialization.

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-524. Resolution: Incomplete How about we just close it now as stale? > Have end to e

[jira] [Resolved] (MAPREDUCE-261) Blacklisting of TaskTrackers should take into account the user-ID

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-261. Resolution: Incomplete Marking as stale. Blacklisting got a major revamp at one

[jira] [Updated] (MAPREDUCE-496) If mapred.local.dir is configured on top of dfs.data.dir, hadoop should refuse to start rather than deleting the contents of local.dir

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-496: --- Labels: newbie (was: ) > If mapred.local.dir is configured on top of dfs.data.dir

[jira] [Resolved] (MAPREDUCE-536) The information displayed by the capacity scheduler can be improved

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-536. Resolution: Incomplete Closing this as stale given the UI is completely differen

[jira] [Resolved] (MAPREDUCE-177) Hadoop performance degrades significantly as more and more jobs complete

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-177. Resolution: Won't Fix I'm going to close this as won't fix due to YARN. > Hadoo

[jira] [Resolved] (MAPREDUCE-392) streaming and pipes should reuse jvm's by default

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-392. Resolution: Won't Fix Sorry Doug, but I'm going to close this as Won't Fix becau

[jira] [Commented] (MAPREDUCE-5957) AM throws ClassNotFoundException with job classloader enabled if custom output format/committer is used

2014-07-21 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14068768#comment-14068768 ] Sangjin Lee commented on MAPREDUCE-5957: Thanks Jason for valuable feedback an

[jira] [Updated] (MAPREDUCE-294) Add Jar "lib" directory to TaskRunner's library.path setting to allow JNI libraries to be deployed via JAR file

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-294: --- Labels: newbie (was: ) > Add Jar "lib" directory to TaskRunner's library.path set

[jira] [Resolved] (MAPREDUCE-314) Avoid priority inversion that could result due to scheduling running jobs in an order sorted by priority

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-314. Resolution: Fixed I'm going to close this as fixed: # scheduling has been rewri

[jira] [Resolved] (MAPREDUCE-328) Cluster summary should have total tasks in the JT and pending tasks to run.

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-328. Resolution: Incomplete Closing this as stale. > Cluster summary should have tot

[jira] [Resolved] (MAPREDUCE-468) Let users specify -classpath for the tasks

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-468. Resolution: Fixed Fixed a while back. > Let users specify -classpath for the ta

[jira] [Resolved] (MAPREDUCE-288) Documention for using external profilers on Map-Reduce applications

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-288. Resolution: Won't Fix Closing this as stale. With MR taking a back seat... > D

  1   2   >