[jira] [Commented] (MAPREDUCE-5997) native-task: Use DirectBufferPool from Hadoop Common

2014-07-23 Thread Sean Zhong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14072900#comment-14072900 ] Sean Zhong commented on MAPREDUCE-5997: --- looks good to me, +1 > native-task: Us

[jira] [Updated] (MAPREDUCE-5997) native-task: Use DirectBufferPool from Hadoop Common

2014-07-23 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated MAPREDUCE-5997: --- Attachment: mapreduce-5997.txt Attached patch switches over to using the implementation i

[jira] [Updated] (MAPREDUCE-1380) Adaptive Scheduler

2014-07-23 Thread Anonymous (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anonymous updated MAPREDUCE-1380: - Target Version/s: 2.4.1 Affects Version/s: 2.4.1 Hadoop Flags: Incompatible chan

[jira] [Updated] (MAPREDUCE-6002) MR task should prevent report error to AM when process is shutting down

2014-07-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-6002: -- Attachment: MR-6002.patch Attached a patch for review. > MR task should prevent report err

[jira] [Updated] (MAPREDUCE-6002) MR task should prevent report error to AM when process is shutting down

2014-07-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-6002: -- Status: Patch Available (was: Open) > MR task should prevent report error to AM when proce

[jira] [Resolved] (MAPREDUCE-5996) native-task: Rename system tests into standard directory layout

2014-07-23 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved MAPREDUCE-5996. Resolution: Fixed Hadoop Flags: Reviewed Committed to branch. Thanks for reviewin

[jira] [Resolved] (MAPREDUCE-5994) native-task: TestBytesUtil fails

2014-07-23 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved MAPREDUCE-5994. Resolution: Fixed Hadoop Flags: Reviewed Committed to branch, thanks Sean. > nat

[jira] [Commented] (MAPREDUCE-5994) native-task: TestBytesUtil fails

2014-07-23 Thread Sean Zhong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14072856#comment-14072856 ] Sean Zhong commented on MAPREDUCE-5994: --- yes, thanks > native-task: TestBytesUt

[jira] [Commented] (MAPREDUCE-5996) native-task: Rename system tests into standard directory layout

2014-07-23 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14072827#comment-14072827 ] Binglin Chang commented on MAPREDUCE-5996: -- Oh I see this patch depends on MA

[jira] [Commented] (MAPREDUCE-5996) native-task: Rename system tests into standard directory layout

2014-07-23 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14072816#comment-14072816 ] Todd Lipcon commented on MAPREDUCE-5996: Hey Binglin. The patch depends on MAP

[jira] [Commented] (MAPREDUCE-5995) native-task: revert changes which expose Text internals

2014-07-23 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14072812#comment-14072812 ] Todd Lipcon commented on MAPREDUCE-5995: Oh, woops... i had this patch against

[jira] [Commented] (MAPREDUCE-5991) native-task should not run unit tests if native profile is not enabled

2014-07-23 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14072723#comment-14072723 ] Binglin Chang commented on MAPREDUCE-5991: -- Hi, Todd, the patch does not appl

[jira] [Commented] (MAPREDUCE-5996) native-task: Rename system tests into standard directory layout

2014-07-23 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14072724#comment-14072724 ] Binglin Chang commented on MAPREDUCE-5996: -- Hi, Todd, the patch does not appl

[jira] [Created] (MAPREDUCE-6002) MR task should prevent report error to AM when process is shutting down

2014-07-23 Thread Wangda Tan (JIRA)
Wangda Tan created MAPREDUCE-6002: - Summary: MR task should prevent report error to AM when process is shutting down Key: MAPREDUCE-6002 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6002 Proje

[jira] [Commented] (MAPREDUCE-5995) native-task: revert changes which expose Text internals

2014-07-23 Thread Manu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14072635#comment-14072635 ] Manu Zhang commented on MAPREDUCE-5995: --- Hi Todd, isn't the class named TextSeri

[jira] [Resolved] (MAPREDUCE-1027) jobtracker.jsp can have an html text block for announcements by admins.

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-1027. - Resolution: Won't Fix JT has been replaced. > jobtracker.jsp can have an htm

[jira] [Resolved] (MAPREDUCE-1019) Stale user directories left on TTs after MAPREDUCE-856

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-1019. - Resolution: Fixed I haven't seen this in forever, so probably fixed. Closing.

[jira] [Resolved] (MAPREDUCE-1021) mapred-default.xml does not document all framework config parameters

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-1021. - Resolution: Fixed I believe this work has been done already. Closing as stale

[jira] [Resolved] (MAPREDUCE-1015) Map-Reduce interface classification

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-1015. - Resolution: Fixed This is likely stale. > Map-Reduce interface classificatio

[jira] [Resolved] (MAPREDUCE-1013) MapReduce Project page does not show 0.20.1 documentation/release information.

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-1013. - Resolution: Fixed > MapReduce Project page does not show 0.20.1 documentatio

[jira] [Updated] (MAPREDUCE-1008) distcp needs CLI unit tests

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-1008: Component/s: test > distcp needs CLI unit tests > --- >

[jira] [Resolved] (MAPREDUCE-1005) why should not capacity sheduler jar not copied under lib during build

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-1005. - Resolution: Fixed Fixed in Hadoop 2.x > why should not capacity sheduler jar

[jira] [Resolved] (MAPREDUCE-1004) ant binary does not copy the jar files properly

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-1004. - Resolution: Fixed We switched to Maven. > ant binary does not copy the jar

[jira] [Resolved] (MAPREDUCE-1006) Making JobStoryProducer and ClusterStory pluggable in Mumak

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-1006. - Resolution: Won't Fix Mumak has been removed from Hadoop. > Making JobStoryP

[jira] [Resolved] (MAPREDUCE-1001) Reducing code duplication in Mumak

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-1001. - Resolution: Won't Fix Mumak has been removed from Hadoop. > Reducing code du

[jira] [Resolved] (MAPREDUCE-998) Wrong error message thrown when we try submit to container queue.

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-998. Resolution: Fixed This is likely stale. > Wrong error message thrown when we tr

[jira] [Resolved] (MAPREDUCE-997) Acls are not working properly when they are set to user groups

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-997. Resolution: Incomplete Closing this as stale. > Acls are not working properly w

[jira] [Resolved] (MAPREDUCE-994) bin/hadoop job -counter help options do not give information on permissible values.

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-994. Resolution: Incomplete I'm going to close this as stale. > bin/hadoop job -coun

[jira] [Resolved] (MAPREDUCE-992) bin/hadoop job -events < jobid> gives event links which does not work.

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-992. Resolution: Incomplete This is probably stale. > bin/hadoop job -events < jobid

[jira] [Commented] (MAPREDUCE-989) Allow segregation of DistributedCache for maps and reduces

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14072569#comment-14072569 ] Allen Wittenauer commented on MAPREDUCE-989: Given YARN, are we still worri

[jira] [Resolved] (MAPREDUCE-985) job -kill-task ] and -fail-task are not task-ids they are attempt ids

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-985. Resolution: Fixed fixed in hadoop 2.x > job -kill-task ] and -fail-task are no

[jira] [Resolved] (MAPREDUCE-983) bin/hadoop job -fs file:///sdsdad -list still works

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-983. Resolution: Incomplete Closing this as stale. > bin/hadoop job -fs file:///sdsd

[jira] [Resolved] (MAPREDUCE-982) Deprecated DistributedCache still used in the new apis in org.apache.hadoop.mapreduce package

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-982. Resolution: Won't Fix Likely stale. > Deprecated DistributedCache still used in

[jira] [Resolved] (MAPREDUCE-976) LinuxTaskController binary should be versioned and mapreduce should run only with a particular version

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-976. Resolution: Won't Fix task controller replaced with container executor. Closing

[jira] [Resolved] (MAPREDUCE-970) task-controller/configuration.c:get_values is broken

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-970. Resolution: Incomplete task controller has been replaced. Closing as stale. > t

[jira] [Resolved] (MAPREDUCE-965) LinuxTaskController logs some of the errors during initializeJob/initializeTask at INFO level instead of WARN/ERROR.

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-965. Resolution: Incomplete LinuxTaskController has been replaced. Closing as stale.

[jira] [Resolved] (MAPREDUCE-958) TT should bail out early when mapred.job.tracker is bound to 0:0:0:0

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-958. Resolution: Incomplete This is probably stale, especially with HARM. > TT shoul

[jira] [Resolved] (MAPREDUCE-957) Set mapred.job.name for a pipes job

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-957. Resolution: Incomplete Probably stale. > Set mapred.job.name for a pipes job >

[jira] [Commented] (MAPREDUCE-950) Clean up unsymmetrical Job-API w.r.t DistributedCache

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14072500#comment-14072500 ] Allen Wittenauer commented on MAPREDUCE-950: Ping! I suspect this is stale

[jira] [Resolved] (MAPREDUCE-940) Distcp should not use mapred.system.dir

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-940. Resolution: Fixed distcpv2 replaced all this. > Distcp should not use mapred.sy

[jira] [Resolved] (MAPREDUCE-925) Not able to run parallel instances of ant tests

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-925. Resolution: Fixed Closing this as stale. > Not able to run parallel instances o

[jira] [Resolved] (MAPREDUCE-266) Remove deprecated MultiFileInputFormat

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-266. Resolution: Won't Fix > Remove deprecated MultiFileInputFormat > ---

[jira] [Resolved] (MAPREDUCE-1603) Add a plugin class for the TaskTracker to determine available slots

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-1603. - Resolution: Won't Fix Closing as won't fix. > Add a plugin class for the Tas

[jira] [Resolved] (MAPREDUCE-922) Automatic configuration of number of map and reduce slots based on available resources for dealing with heterogenous clusters

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-922. Resolution: Won't Fix Closing as won't fix. > Automatic configuration of number

[jira] [Resolved] (MAPREDUCE-921) Map-Reduce framework should gracefully handle heterogenous clusters

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-921. Resolution: Won't Fix Closing as won't fix. > Map-Reduce framework should grace

[jira] [Resolved] (MAPREDUCE-2585) Add dumpConfiguration option in hadoop help message

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-2585. - Resolution: Not a Problem Closing this as stale. -dumpConfiguration doesn't

[jira] [Resolved] (MAPREDUCE-914) MapReduce source code has significant number of JavaDocs errors and warnings

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-914. Resolution: Fixed Likely stale. > MapReduce source code has significant number

[jira] [Resolved] (MAPREDUCE-909) Shell$ExitCodeException while killing/failing a task.

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-909. Resolution: Fixed Likely stale. > Shell$ExitCodeException while killing/failing

[jira] [Resolved] (MAPREDUCE-908) Defining test.include to run a subset of unit tests no longer works

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-908. Resolution: Fixed No more ant. > Defining test.include to run a subset of unit

[jira] [Resolved] (MAPREDUCE-902) Map output merge still uses unnecessary seeks

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-902. Resolution: Fixed Probably stale. > Map output merge still uses unnecessary see

[jira] [Resolved] (MAPREDUCE-897) Provide information captured as part of JobTrackerStatistics via the Hadoop metrics API

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-897. Resolution: Fixed This is almost certainly fixed by now. If not, it's at least

[jira] [Work stopped] (MAPREDUCE-6001) Add a 'status' command to mr-jobhistory-daemon.sh script

2014-07-23 Thread Nikunj Bansal (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on MAPREDUCE-6001 stopped by Nikunj Bansal. > Add a 'status' command to mr-jobhistory-daemon.sh script >

[jira] [Work started] (MAPREDUCE-6001) Add a 'status' command to mr-jobhistory-daemon.sh script

2014-07-23 Thread Nikunj Bansal (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on MAPREDUCE-6001 started by Nikunj Bansal. > Add a 'status' command to mr-jobhistory-daemon.sh script >

[jira] [Created] (MAPREDUCE-6001) Add a 'status' command to mr-jobhistory-daemon.sh script

2014-07-23 Thread Nikunj Bansal (JIRA)
Nikunj Bansal created MAPREDUCE-6001: Summary: Add a 'status' command to mr-jobhistory-daemon.sh script Key: MAPREDUCE-6001 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6001 Project: Hadoop

[jira] [Resolved] (MAPREDUCE-1044) Ability to automatically move machines from one MR compute cluster to another

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-1044. - Resolution: Won't Fix Closing as stale for Hadoop 2.x > Ability to automatic

[jira] [Resolved] (MAPREDUCE-892) command line tool to list all tasktrackers and their status

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-892. Resolution: Duplicate > command line tool to list all tasktrackers and their sta

[jira] [Resolved] (MAPREDUCE-974) CLI command for viewing tasktrackers should not be under "job"

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-974. Resolution: Fixed Closing this as stale for Hadoop 2.x > CLI command for viewin

[jira] [Resolved] (MAPREDUCE-886) After 4491, when task-controller exit with some error message, LinuxTaskController only ExitCodeException but does not prints the exit code of task-controller

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-886. Resolution: Fixed Stale w/hadoop 2.x. Might need to revisit container executor

[jira] [Commented] (MAPREDUCE-883) harchive: Document how to unarchive

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14072350#comment-14072350 ] Allen Wittenauer commented on MAPREDUCE-883: This should get updated for tr

[jira] [Resolved] (MAPREDUCE-866) Move all memory related parameters and their initialization out of TaskTracker.java into TaskMemoryManagerThread

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-866. Resolution: Fixed Stale w/Hadoop 2.x > Move all memory related parameters and t

[jira] [Resolved] (MAPREDUCE-863) Improve/standardize job history file content format and the management of the history files

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-863. Resolution: Fixed I'm going to close this as fixed/stale given history server, t

[jira] [Resolved] (MAPREDUCE-864) Enhance JobClient API implementations to look at history files to get information about jobs that are not in memory

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-864. Resolution: Fixed I'm going to close this as stale. > Enhance JobClient API imp

[jira] [Commented] (MAPREDUCE-851) Static job property accessors don't accept Configuration but various JobContext sub-classes

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14072335#comment-14072335 ] Allen Wittenauer commented on MAPREDUCE-851: Ping! It'd be good to get an

[jira] [Resolved] (MAPREDUCE-846) A long running init can block job queue details webpage

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-846. Resolution: Fixed Stale. > A long running init can block job queue details webp

[jira] [Resolved] (MAPREDUCE-850) PriorityScheduler should use TaskTrackerManager.killJob() instead of JobInProgress.kill()

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-850. Resolution: Fixed Stale. > PriorityScheduler should use TaskTrackerManager.kill

[jira] [Resolved] (MAPREDUCE-837) harchive fail when output directory has URI with default port of 8020

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-837. Resolution: Fixed ... then I guess I'll close this... > harchive fail when outp

[jira] [Resolved] (MAPREDUCE-829) When localizing job configuration from FS, TTs configuration on local disk is not loaded at all

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-829. Resolution: Incomplete Likely stale. > When localizing job configuration from F

[jira] [Resolved] (MAPREDUCE-835) hadoop-mapred examples,test and tools jar iles are being packaged when ant binary or bin-package is used

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-835. Resolution: Fixed No longer using ant. Closing. > hadoop-mapred examples,test a

[jira] [Resolved] (MAPREDUCE-836) Examples of hadoop pipes are not getting package a even when -Dcompile.native=yes -Dcompile.c++=yes option are used while running ant package or tar or similar comman

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-836. Resolution: Fixed No longer using ant, closing. > Examples of hadoop pipes are

[jira] [Resolved] (MAPREDUCE-823) TestCommandLineJobSubmission doesn't need MiniDFSCluster to run

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-823. Resolution: Won't Fix hadoop tests are only slow now. Closing as stale. > Te

[jira] [Resolved] (MAPREDUCE-822) Jobtracker logs should display the "job info persisted to file.." message after job's completion.

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-822. Resolution: Fixed With history server and time line server, this is sort of stal

[jira] [Resolved] (MAPREDUCE-806) WordCount example does not compile given the current instructions

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-806. Resolution: Incomplete Almost certainly stale. Please file a new jira if you are

[jira] [Resolved] (MAPREDUCE-803) Provide a command line option to clean up jobtracker system directory

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-803. Resolution: Duplicate This is pretty much YARN-2131 in modern terms. > Provide

[jira] [Resolved] (MAPREDUCE-802) Simplify the job updated event notification between Jobtracker and schedulers

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-802. Resolution: Fixed Stale for all intents and purposes. > Simplify the job update

[jira] [Resolved] (MAPREDUCE-841) Protect Job Tracker against memory exhaustion due to very large InputSplit or JobConf objects

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-841. Resolution: Fixed > Protect Job Tracker against memory exhaustion due to very la

[jira] [Resolved] (MAPREDUCE-801) MAPREDUCE framework should issue warning with too many locations for a split

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-801. Resolution: Fixed Definitely fixed, given how many times I was asked what the wa

[jira] [Resolved] (MAPREDUCE-791) Document Hadoop Map-Reduce Architecture

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-791. Resolution: Fixed Closing this as stale, given YARN. > Document Hadoop Map-Redu

[jira] [Resolved] (MAPREDUCE-786) Jobtracker history should be written aysnchronously to the filesystem

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-786. Resolution: Incomplete Closing this as stale, given how history is handled these

[jira] [Resolved] (MAPREDUCE-774) Java/C++ word count examples have different outputs

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-774. Resolution: Not a Problem > Java/C++ word count examples have different outputs

[jira] [Resolved] (MAPREDUCE-770) org.apache.hadoop.tools.TestCopyFiles may leave junk files when an assertion fails

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-770. Resolution: Fixed Stale? I'm going to stale. > org.apache.hadoop.tools.TestCopy

[jira] [Resolved] (MAPREDUCE-763) Capacity scheduler should clean up reservations if it runs tasks on nodes other than where it has made reservations

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-763. Resolution: Incomplete This is likely stale. > Capacity scheduler should clean

[jira] [Resolved] (MAPREDUCE-762) Task's process trees may not be killed if a TT is restarted

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-762. Resolution: Incomplete Closing this as stale. > Task's process trees may not be

[jira] [Resolved] (MAPREDUCE-761) Revisit MapRed logging information

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-761. Resolution: Incomplete Probably a good idea, but still closing as stale. > Revi

[jira] [Resolved] (MAPREDUCE-759) Refactor localization code in TaskTracker

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-759. Resolution: Fixed This is likely stale. > Refactor localization code in TaskTra

[jira] [Resolved] (MAPREDUCE-758) JobInProgressListener events might be garbled

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-758. Resolution: Incomplete Closing as stale. > JobInProgressListener events might b

[jira] [Resolved] (MAPREDUCE-748) In Job Tracker log map attempt failure reports, failed maps show a HOSTNAME without a rack ID.

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-748. Resolution: Incomplete Closing as stale. > In Job Tracker log map attempt failu

[jira] [Resolved] (MAPREDUCE-747) In Job Tracker logs, some host locations [either in SPLITS or in HOSTNAME subrecords] have numeric host locations

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-747. Resolution: Incomplete Likely stale. > In Job Tracker logs, some host locations

[jira] [Resolved] (MAPREDUCE-752) DistributedCache.addArchiveToClassPath doesn't work

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-752. Resolution: Fixed The reality was that 0.21 did come out but no one really used

[jira] [Resolved] (MAPREDUCE-727) Move the bin/hadoop jar command over to bin/mapred

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-727. Resolution: Fixed I'm going to close this as fixed. mapred job -submit did come

[jira] [Resolved] (MAPREDUCE-725) CapacityScheduler.TaskSchedulingMgr.hasSpeculativeTask bypasses HADOOP-2141

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-725. Resolution: Incomplete This is all very different now so closing this as stale.

[jira] [Commented] (MAPREDUCE-721) When "mapred.job.tracker.persist.jobstatus.hours" is set to x hours, the files are not getting deleted after that x hours.It gets deleted after some random hours whi

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14072138#comment-14072138 ] Allen Wittenauer commented on MAPREDUCE-721: It would appear this documenta

[jira] [Updated] (MAPREDUCE-721) When "mapred.job.tracker.persist.jobstatus.hours" is set to x hours, the files are not getting deleted after that x hours.It gets deleted after some random hours which

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-721: --- Component/s: documentation > When "mapred.job.tracker.persist.jobstatus.hours" is

[jira] [Updated] (MAPREDUCE-721) When "mapred.job.tracker.persist.jobstatus.hours" is set to x hours, the files are not getting deleted after that x hours.It gets deleted after some random hours which

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-721: --- Labels: newbie (was: ) > When "mapred.job.tracker.persist.jobstatus.hours" is set

[jira] [Resolved] (MAPREDUCE-719) Not able to run Mapred Reliability test as "other" user.

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-719. Resolution: Cannot Reproduce likely stale. > Not able to run Mapred Reliability

[jira] [Resolved] (MAPREDUCE-726) Move the mapred script to map/reduce

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-726. Resolution: Fixed Fixed > Move the mapred script to map/reduce > --

[jira] [Resolved] (MAPREDUCE-697) Jobwise list of blacklisted tasktrackers doesn't get refreshed even after restarting blacklisted tasktrackers.

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-697. Resolution: Not a Problem > Jobwise list of blacklisted tasktrackers doesn't get

[jira] [Commented] (MAPREDUCE-691) Document the features available in org.apache.hadoop.examples.pi

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14072112#comment-14072112 ] Allen Wittenauer commented on MAPREDUCE-691: I suspect there is more to do

[jira] [Updated] (MAPREDUCE-6000) native-task: Simplify ByteBufferDataReader/Writer

2014-07-23 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated MAPREDUCE-6000: --- Attachment: mapreduce-6000.txt Attached patch removes about 250 lines of code and the tes

[jira] [Commented] (MAPREDUCE-5966) MR1 FairScheduler use of custom weight adjuster is not thread safe for comparisons

2014-07-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14072100#comment-14072100 ] Hadoop QA commented on MAPREDUCE-5966: -- {color:red}-1 overall{color}. Here are t

[jira] [Resolved] (MAPREDUCE-737) High Availability support for Hadoop

2014-07-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-737. Resolution: Duplicate Closing this as a dupe at this point. > High Availability

  1   2   >