[jira] Updated: (MAPREDUCE-1857) Remove unused streaming configuration from src

2010-06-23 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-1857: --- Status: Resolved (was: Patch Available) Resolution: Fixed

[jira] Commented: (MAPREDUCE-577) Duplicate Mapper input when using StreamXmlRecordReader

2010-06-23 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12882070#action_12882070 ] Amareshwari Sriramadasu commented on MAPREDUCE-577: --- Some comments on

[jira] Updated: (MAPREDUCE-1699) JobHistory shouldn't be disabled for any reason

2010-06-23 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-1699: - Status: Open (was: Patch Available) This needs more work... # Remove JobHistory.dis

[jira] Commented: (MAPREDUCE-1857) Remove unused streaming configuration from src

2010-06-23 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12882066#action_12882066 ] Amareshwari Sriramadasu commented on MAPREDUCE-1857: Test failure i

[jira] Commented: (MAPREDUCE-1857) Remove unused streaming configuration from src

2010-06-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12882065#action_12882065 ] Hadoop QA commented on MAPREDUCE-1857: -- -1 overall. Here are the results of testi

[jira] Assigned: (MAPREDUCE-1888) Streaming overrides user given output key and value types.

2010-06-23 Thread Ravi Gummadi (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Gummadi reassigned MAPREDUCE-1888: --- Assignee: Ravi Gummadi > Streaming overrides user given output key and value type

[jira] Commented: (MAPREDUCE-1744) DistributedCache creates its own FileSytem instance when adding a file/archive to the path

2010-06-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12882052#action_12882052 ] Hadoop QA commented on MAPREDUCE-1744: -- -1 overall. Here are the results of testi

[jira] Commented: (MAPREDUCE-1850) Include job submit host information (name and ip) in jobconf and jobdetails display

2010-06-23 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12882041#action_12882041 ] Amareshwari Sriramadasu commented on MAPREDUCE-1850: Some comments

[jira] Updated: (MAPREDUCE-1823) Reduce the number of calls of HarFileSystem.getFileStatus in RaidNode

2010-06-23 Thread Scott Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1823: -- Status: Patch Available (was: Open) > Reduce the number of calls of HarFileSystem.getFileS

[jira] Commented: (MAPREDUCE-1823) Reduce the number of calls of HarFileSystem.getFileStatus in RaidNode

2010-06-23 Thread Scott Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12881989#action_12881989 ] Scott Chen commented on MAPREDUCE-1823: --- In the patch, when performing getFileSta

[jira] Updated: (MAPREDUCE-1823) Reduce the number of calls of HarFileSystem.getFileStatus in RaidNode

2010-06-23 Thread Scott Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1823: -- Attachment: MAPREDUCE-1823.txt > Reduce the number of calls of HarFileSystem.getFileStatus

[jira] Commented: (MAPREDUCE-1850) Include job submit host information (name and ip) in jobconf and jobdetails display

2010-06-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12881984#action_12881984 ] Hadoop QA commented on MAPREDUCE-1850: -- -1 overall. Here are the results of testi

[jira] Commented: (MAPREDUCE-1870) Harmonize MapReduce JAR library versions with Common and HDFS

2010-06-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12881974#action_12881974 ] Hadoop QA commented on MAPREDUCE-1870: -- -1 overall. Here are the results of testi

[jira] Updated: (MAPREDUCE-1887) MRAsyncDiskService does not properly absolutize volume root paths

2010-06-23 Thread Aaron Kimball (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Kimball updated MAPREDUCE-1887: - Status: Patch Available (was: Open) Trying again with Hudson, to get this result mor

[jira] Updated: (MAPREDUCE-1887) MRAsyncDiskService does not properly absolutize volume root paths

2010-06-23 Thread Aaron Kimball (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Kimball updated MAPREDUCE-1887: - Status: Open (was: Patch Available) > MRAsyncDiskService does not properly absolutiz

[jira] Updated: (MAPREDUCE-1848) Put number of speculative, data local, rack local tasks in JobTracker metrics

2010-06-23 Thread Scott Chen (JIRA)
sue Type: Improvement > Components: jobtracker >Affects Versions: 0.22.0 >Reporter: Scott Chen >Assignee: Scott Chen > Fix For: 0.22.0 > > Attachments: MAPREDUCE-1848-20100614.txt, > MAPREDUCE-1848-20100617.txt, MAPR

[jira] Updated: (MAPREDUCE-1848) Put number of speculative, data local, rack local tasks in JobTracker metrics

2010-06-23 Thread Scott Chen (JIRA)
sue Type: Improvement > Components: jobtracker >Affects Versions: 0.22.0 >Reporter: Scott Chen >Assignee: Scott Chen > Fix For: 0.22.0 > > Attachments: MAPREDUCE-1848-20100614.txt, > MAPREDUCE-1848-20100617.txt, MAPR

[jira] Created: (MAPREDUCE-1892) RaidNode can identify processed files with lesser memory usage

2010-06-23 Thread Ramkumar Vadali (JIRA)
RaidNode can identify processed files with lesser memory usage -- Key: MAPREDUCE-1892 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1892 Project: Hadoop Map/Reduce Issue Type

[jira] Updated: (MAPREDUCE-1848) Put number of speculative, data local, rack local tasks in JobTracker metrics

2010-06-23 Thread Scott Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1848: -- Attachment: MAPREDUCE-1848-20100623.txt Update. Change the metrics keys to follow the

[jira] Commented: (MAPREDUCE-220) Collecting cpu and memory usage for MapReduce tasks

2010-06-23 Thread Scott Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12881907#action_12881907 ] Scott Chen commented on MAPREDUCE-220: -- Allen: I agree. LinuxProcfsBasedProcessTree

[jira] Commented: (MAPREDUCE-1845) FairScheduler.tasksToPeempt() can return negative number

2010-06-23 Thread Scott Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12881903#action_12881903 ] Scott Chen commented on MAPREDUCE-1845: --- The failed tests are not on the code pat

[jira] Commented: (MAPREDUCE-1887) MRAsyncDiskService does not properly absolutize volume root paths

2010-06-23 Thread Aaron Kimball (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12881879#action_12881879 ] Aaron Kimball commented on MAPREDUCE-1887: -- Unfortunately, Hudson's web server

[jira] Commented: (MAPREDUCE-1887) MRAsyncDiskService does not properly absolutize volume root paths

2010-06-23 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12881875#action_12881875 ] Zheng Shao commented on MAPREDUCE-1887: --- Aaron, can you take a look at the unit t

[jira] Updated: (MAPREDUCE-1850) Include job submit host information (name and ip) in jobconf and jobdetails display

2010-06-23 Thread Krishna Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Ramachandran updated MAPREDUCE-1850: Status: Patch Available (was: Open) revised patch with only JobSubmitt

[jira] Updated: (MAPREDUCE-1850) Include job submit host information (name and ip) in jobconf and jobdetails display

2010-06-23 Thread Krishna Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Ramachandran updated MAPREDUCE-1850: Attachment: mapred-1850-3.patch I missed that. Sorry - tested with only

[jira] Updated: (MAPREDUCE-1778) CompletedJobStatusStore initialization should fail if {mapred.job.tracker.persist.jobstatus.dir} is unwritable

2010-06-23 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-1778: - Status: Resolved (was: Patch Available) Hadoop Flags: [Reviewed] Reso

[jira] Updated: (MAPREDUCE-1850) Include job submit host information (name and ip) in jobconf and jobdetails display

2010-06-23 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-1850: - Status: Open (was: Patch Available) Krishna - I don't see why you need to change bot

[jira] Updated: (MAPREDUCE-1868) Add read timeout on userlog pull

2010-06-23 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-1868: - Status: Resolved (was: Patch Available) Hadoop Flags: [Reviewed] Reso

[jira] Commented: (MAPREDUCE-1845) FairScheduler.tasksToPeempt() can return negative number

2010-06-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12881762#action_12881762 ] Hadoop QA commented on MAPREDUCE-1845: -- -1 overall. Here are the results of testi

[jira] Updated: (MAPREDUCE-1870) Harmonize MapReduce JAR library versions with Common and HDFS

2010-06-23 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated MAPREDUCE-1870: - Attachment: MAPREDUCE-1870.patch New patch to address Hemanth's feedback on HADOOP-6800. > H

[jira] Commented: (MAPREDUCE-1891) Disk io of shuffle phase may decrease if shuffled data not decompressed

2010-06-23 Thread Xiao Kang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12881719#action_12881719 ] Xiao Kang commented on MAPREDUCE-1891: -- Compression of intermidate result of map o

[jira] Updated: (MAPREDUCE-1744) DistributedCache creates its own FileSytem instance when adding a file/archive to the path

2010-06-23 Thread Krishna Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Ramachandran updated MAPREDUCE-1744: Status: Patch Available (was: Open) this is an important fix for oozie

[jira] Created: (MAPREDUCE-1891) Disk io of shuffle phase may decrease if shuffled data not decompressed

2010-06-23 Thread Xiao Kang (JIRA)
Disk io of shuffle phase may decrease if shuffled data not decompressed --- Key: MAPREDUCE-1891 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1891 Project: Hadoop Map/Reduce

[jira] Commented: (MAPREDUCE-1791) Remote cluster control functionality needs JavaDocs improvement

2010-06-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12881656#action_12881656 ] Hadoop QA commented on MAPREDUCE-1791: -- -1 overall. Here are the results of testi

[jira] Updated: (MAPREDUCE-1882) Use Jsch instead of Shell.java

2010-06-23 Thread Iyappan Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iyappan Srinivasan updated MAPREDUCE-1882: -- Attachment: RemoteExecution.patch Attachinga patch for remote execute usin

[jira] Updated: (MAPREDUCE-1890) Create automated test scenarios for decommissioning of task trackers

2010-06-23 Thread Iyappan Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iyappan Srinivasan updated MAPREDUCE-1890: -- Attachment: TestDecomissioning.patch Preliminary patch for Decommissioning

[jira] Created: (MAPREDUCE-1890) Create automated test scenarios for decommissioning of task trackers

2010-06-23 Thread Iyappan Srinivasan (JIRA)
Create automated test scenarios for decommissioning of task trackers Key: MAPREDUCE-1890 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1890 Project: Hadoop Map/Reduce

[jira] Commented: (MAPREDUCE-1864) PipeMapRed.java has uninitialized members log_ and LOGNAME

2010-06-23 Thread Ravi Gummadi (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12881619#action_12881619 ] Ravi Gummadi commented on MAPREDUCE-1864: - mapredKey_ is not set at all but ref

[jira] Commented: (MAPREDUCE-1864) PipeMapRed.java has uninitialized members log_ and LOGNAME

2010-06-23 Thread Ravi Gummadi (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12881616#action_12881616 ] Ravi Gummadi commented on MAPREDUCE-1864: - Also, I don't see a real need for th

[jira] Assigned: (MAPREDUCE-1889) [herriot] Ability to restart a single node for pushconfig

2010-06-23 Thread Balaji Rajagopalan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Rajagopalan reassigned MAPREDUCE-1889: - Assignee: Balaji Rajagopalan > [herriot] Ability to restart a single

[jira] Commented: (MAPREDUCE-1864) PipeMapRed.java has uninitialized members log_ and LOGNAME

2010-06-23 Thread Ravi Gummadi (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12881614#action_12881614 ] Ravi Gummadi commented on MAPREDUCE-1864: - One more unused member is debugFailE

[jira] Created: (MAPREDUCE-1889) [herriot] Ability to restart a single node for pushconfig

2010-06-23 Thread Balaji Rajagopalan (JIRA)
[herriot] Ability to restart a single node for pushconfig - Key: MAPREDUCE-1889 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1889 Project: Hadoop Map/Reduce Issue Type: New Feat

[jira] Assigned: (MAPREDUCE-1864) PipeMapRed.java has uninitialized members log_ and LOGNAME

2010-06-23 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu reassigned MAPREDUCE-1864: -- Assignee: Amareshwari Sriramadasu > PipeMapRed.java has uni

[jira] Commented: (MAPREDUCE-1887) MRAsyncDiskService does not properly absolutize volume root paths

2010-06-23 Thread Ravi Gummadi (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12881596#action_12881596 ] Ravi Gummadi commented on MAPREDUCE-1887: - Yes. Fine with me even if it is not

[jira] Updated: (MAPREDUCE-1851) Document configuration parameters in streaming

2010-06-23 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-1851: --- Status: Resolved (was: Patch Available) Resolution: Fixed

[jira] Updated: (MAPREDUCE-1857) Remove unused streaming configuration from src

2010-06-23 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-1857: --- Status: Patch Available (was: Open) > Remove unused streaming co

[jira] Updated: (MAPREDUCE-1857) Remove unused streaming configuration from src

2010-06-23 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-1857: --- Status: Open (was: Patch Available) > Remove unused streaming co