[jira] Updated: (MAPREDUCE-1671) Test scenario for "Killing Task Attempt id till job fails"

2010-04-12 Thread Iyappan Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iyappan Srinivasan updated MAPREDUCE-1671: -- Attachment: TestTaskKilling.patch TEST-org.apache.hadoop.map

[jira] Updated: (MAPREDUCE-1690) Using BuddySystem to reduce the ReduceTask's mem usage in the step of shuffle

2010-04-12 Thread luoli (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luoli updated MAPREDUCE-1690: - Attachment: mapreduce-1690.v2.patch Hi guys, Here is the v2 patch which I merged the BuddySystem code

[jira] Created: (MAPREDUCE-1697) Document the behavior of -file option in streaming

2010-04-12 Thread Amareshwari Sriramadasu (JIRA)
Document the behavior of -file option in streaming -- Key: MAPREDUCE-1697 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1697 Project: Hadoop Map/Reduce Issue Type: Bug Componen

[jira] Commented: (MAPREDUCE-813) Streaming Doc and M/R-Tutorial Doc - updates

2010-04-12 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12856302#action_12856302 ] Amareshwari Sriramadasu commented on MAPREDUCE-813: --- I ran ant docs wi

[jira] Updated: (MAPREDUCE-813) Streaming Doc and M/R-Tutorial Doc - updates

2010-04-12 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-813: -- Attachment: patch-813-0.20.txt Patch for branch 0.20. > Streaming D

[jira] Commented: (MAPREDUCE-1694) streaming documentation appears to be wrong on overriding settings w/-D

2010-04-12 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12856299#action_12856299 ] Amareshwari Sriramadasu commented on MAPREDUCE-1694: This documenta

[jira] Resolved: (MAPREDUCE-1321) Spurios logs with org.apache.hadoop.util.DiskChecker$DiskErrorException in TaskTracker

2010-04-12 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu resolved MAPREDUCE-1321. Resolution: Duplicate Fixed as part of MAPREDUCE-1635 > Spurio

[jira] Updated: (MAPREDUCE-21) NegativeArraySizeException in reducer with new api

2010-04-12 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-21?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-21: - Component/s: task > NegativeArraySizeException in reducer with new api

[jira] Updated: (MAPREDUCE-266) Remove deprecated MultiFileInputFormat

2010-04-12 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-266: -- Component/s: client > Remove deprecated MultiFileInputFormat > -

[jira] Updated: (MAPREDUCE-384) Exception thrown from pipes Map task is not handled properly

2010-04-12 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-384: -- Component/s: pipes > Exception thrown from pipes Map task is not han

[jira] Updated: (MAPREDUCE-91) task attempt failing to report status just after the intialization

2010-04-12 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-91?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-91: - Component/s: task > task attempt failing to report status just after th

[jira] Updated: (MAPREDUCE-171) TestJobTrackerRestartWithLostTracker sometimes fails while validating history.

2010-04-12 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-171: -- Component/s: jobtracker test > TestJobTrackerRestar

[jira] Updated: (MAPREDUCE-137) org.apache.hadoop.mapred.TestJobDirCleanup.testJobDirCleanup timesout occasionally

2010-04-12 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-137: -- Component/s: test > org.apache.hadoop.mapred.TestJobDirCleanup.testJ

[jira] Updated: (MAPREDUCE-424) Unreachable code in TaskInProgress.inCompleteSubTask

2010-04-12 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-424: -- Component/s: jobtracker > Unreachable code in TaskInProgress.inCompl

[jira] Updated: (MAPREDUCE-213) Provide a way to query job tracker about its daemon thread's status

2010-04-12 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-213: -- Component/s: jobtracker > Provide a way to query job tracker about i

[jira] Updated: (MAPREDUCE-431) Task left in RUNNING state even after the job completion

2010-04-12 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-431: -- Component/s: jobtracker > Task left in RUNNING state even after the

[jira] Updated: (MAPREDUCE-111) JobTracker.getSystemDir throws NPE if it is called during intialization

2010-04-12 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-111: -- Component/s: jobtracker > JobTracker.getSystemDir throws NPE if it i

[jira] Updated: (MAPREDUCE-441) TestMapReduceJobControl.testJobControlWithKillJob timedout in of the hudson runs

2010-04-12 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-441: -- Component/s: test > TestMapReduceJobControl.testJobControlWithKillJo

[jira] Commented: (MAPREDUCE-1671) Test scenario for "Killing Task Attempt id till job fails"

2010-04-12 Thread Balaji Rajagopalan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12856293#action_12856293 ] Balaji Rajagopalan commented on MAPREDUCE-1671: --- One minor comment java d

[jira] Updated: (MAPREDUCE-132) getSetupAndCleanupTasks should return multiple tasks in a heartbeat

2010-04-12 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-132: -- Component/s: jobtracker > getSetupAndCleanupTasks should return mult

[jira] Commented: (MAPREDUCE-1671) Test scenario for "Killing Task Attempt id till job fails"

2010-04-12 Thread Balaji Rajagopalan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12856292#action_12856292 ] Balaji Rajagopalan commented on MAPREDUCE-1671: --- +1 looks good to me. >

[jira] Updated: (MAPREDUCE-1696) Add current time to the job tracker web UI pages

2010-04-12 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-1696: --- Priority: Minor (was: Major) Component/s: jobtracker > Ad

[jira] Moved: (MAPREDUCE-1696) Add current time to the job tracker web UI pages

2010-04-12 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu moved HADOOP-3373 to MAPREDUCE-1696: Project: Hadoop Map/Reduce (was: Hadoop

[jira] Commented: (MAPREDUCE-1677) Test scenario for a distributed cache file behaviour when the file is private

2010-04-12 Thread Balaji Rajagopalan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12856290#action_12856290 ] Balaji Rajagopalan commented on MAPREDUCE-1677: --- The same comment try to

[jira] Commented: (MAPREDUCE-1692) Remove TestStreamedMerge from the streaming tests

2010-04-12 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12856288#action_12856288 ] Amareshwari Sriramadasu commented on MAPREDUCE-1692: +1 for removin

[jira] Updated: (MAPREDUCE-1690) Using BuddySystem to reduce the ReduceTask's mem usage in the step of shuffle

2010-04-12 Thread luoli (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luoli updated MAPREDUCE-1690: - Attachment: mapreduce-1690.v1.patch > Using BuddySystem to reduce the ReduceTask's mem usage in the s

[jira] Commented: (MAPREDUCE-1695) capacity scheduler is not included in findbugs/javadoc targets

2010-04-12 Thread Hong Tang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12856248#action_12856248 ] Hong Tang commented on MAPREDUCE-1695: -- Good point. > capacity scheduler is not i

[jira] Commented: (MAPREDUCE-1695) capacity scheduler is not included in findbugs/javadoc targets

2010-04-12 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12856245#action_12856245 ] Tom White commented on MAPREDUCE-1695: -- As noted in MAPREDUCE-1625, since the capa

[jira] Created: (MAPREDUCE-1695) capacity scheduler is not included in findbugs/javadoc targets

2010-04-12 Thread Hong Tang (JIRA)
capacity scheduler is not included in findbugs/javadoc targets -- Key: MAPREDUCE-1695 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1695 Project: Hadoop Map/Reduce Issue Type

[jira] Updated: (MAPREDUCE-1683) Remove JNI calls from ClusterStatus cstr

2010-04-12 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-1683: - Attachment: MAPREDUCE-1683_yhadoop_20_S.patch Patch for the yahoo security branch, no

[jira] Updated: (MAPREDUCE-1031) ant tar target doens't seem to compile tests in contrib projects

2010-04-12 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated MAPREDUCE-1031: - Status: Resolved (was: Patch Available) Hadoop Flags: [Reviewed] Fix Version/

[jira] Updated: (MAPREDUCE-889) binary communication formats added to Streaming by HADOOP-1722 should be documented

2010-04-12 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated MAPREDUCE-889: Status: Resolved (was: Patch Available) Hadoop Flags: [Reviewed] Fix Version/s:

[jira] Commented: (MAPREDUCE-1404) Cluster-Setup and Single-Node-Setup Docs

2010-04-12 Thread Corinne Chandel (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12856210#action_12856210 ] Corinne Chandel commented on MAPREDUCE-1404: More comments: (1) The Commo

[jira] Commented: (MAPREDUCE-1553) mapred.userlog.retain.hours is improperly renamed in MAPREDUCE-849

2010-04-12 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12856191#action_12856191 ] Tom White commented on MAPREDUCE-1553: -- With the plan to create a new 0.21 branch

[jira] Updated: (MAPREDUCE-1253) Making Mumak work with Capacity-Scheduler

2010-04-12 Thread Anirban Dasgupta (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirban Dasgupta updated MAPREDUCE-1253: Attachment: MAPREDUCE-1253-20100406.patch I am attaching a partial patch at thi

[jira] Created: (MAPREDUCE-1694) streaming documentation appears to be wrong on overriding settings w/-D

2010-04-12 Thread Allen Wittenauer (JIRA)
streaming documentation appears to be wrong on overriding settings w/-D --- Key: MAPREDUCE-1694 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1694 Project: Hadoop Map/Reduce

[jira] Updated: (MAPREDUCE-1693) Process tree clean up of either a failed task or killed task tests.

2010-04-12 Thread Vinay Kumar Thota (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay Kumar Thota updated MAPREDUCE-1693: - Attachment: taskchildskilling_1693.diff Please review it and let me know your

[jira] Created: (MAPREDUCE-1693) Process tree clean up of either a failed task or killed task tests.

2010-04-12 Thread Vinay Kumar Thota (JIRA)
Process tree clean up of either a failed task or killed task tests. --- Key: MAPREDUCE-1693 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1693 Project: Hadoop Map/Reduce

[jira] Updated: (MAPREDUCE-1635) ResourceEstimator does not work after MAPREDUCE-842

2010-04-12 Thread Vinod K V (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod K V updated MAPREDUCE-1635: - Status: Resolved (was: Patch Available) Resolution: Fixed I just committed this to t

[jira] Commented: (MAPREDUCE-1676) Create test scenario for "distributed cache file behaviour, when dfs file is modified"

2010-04-12 Thread Balaji Rajagopalan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12855932#action_12855932 ] Balaji Rajagopalan commented on MAPREDUCE-1676: --- The distributed cache mo

[jira] Updated: (MAPREDUCE-1690) Using BuddySystem to reduce the ReduceTask's mem usage in the step of shuffle

2010-04-12 Thread luoli (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luoli updated MAPREDUCE-1690: - Attachment: mapreduce-1690.v1.patch Sorry for the Unittest code interrupt, Here I update the patch fo

[jira] Commented: (MAPREDUCE-1672) Create test scenario for "distributed cache file behaviour, when dfs file is not modified"

2010-04-12 Thread Balaji Rajagopalan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12855928#action_12855928 ] Balaji Rajagopalan commented on MAPREDUCE-1672: --- Overall the code looks g

[jira] Commented: (MAPREDUCE-1635) ResourceEstimator does not work after MAPREDUCE-842

2010-04-12 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12855926#action_12855926 ] Amareshwari Sriramadasu commented on MAPREDUCE-1635: For some reaso

[jira] Commented: (MAPREDUCE-1654) Automate the job killing system test case.

2010-04-12 Thread Iyappan Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12855922#action_12855922 ] Iyappan Srinivasan commented on MAPREDUCE-1654: --- Hi Balaji, Patch looks

[jira] Updated: (MAPREDUCE-1672) Create test scenario for "distributed cache file behaviour, when dfs file is not modified"

2010-04-12 Thread Iyappan Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iyappan Srinivasan updated MAPREDUCE-1672: -- Attachment: TEST-org.apache.hadoop.mapred.TestDistributedCacheUnModifiedFil

[jira] Updated: (MAPREDUCE-1677) Test scenario for a distributed cache file behaviour when the file is private

2010-04-12 Thread Iyappan Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iyappan Srinivasan updated MAPREDUCE-1677: -- Attachment: TestDistributedCachePrivateFile.patch TEST-org.

[jira] Updated: (MAPREDUCE-1676) Create test scenario for "distributed cache file behaviour, when dfs file is modified"

2010-04-12 Thread Iyappan Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iyappan Srinivasan updated MAPREDUCE-1676: -- Attachment: TestDistributedCacheModifiedFile.patch TEST-org

[jira] Commented: (MAPREDUCE-1505) Cluster class should create the rpc client only when needed

2010-04-12 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12855887#action_12855887 ] Amareshwari Sriramadasu commented on MAPREDUCE-1505: The patch look