[jira] Commented: (MAPREDUCE-1122) streaming with custom input format does not support the new API

[ https://issues.apache.org/jira/browse/MAPREDUCE-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885482#action_12885482 ] Amareshwari Sriramadasu commented on MAPREDUCE-1122: For supporting

[jira] Updated: (MAPREDUCE-1122) streaming with custom input format does not support the new API

[ https://issues.apache.org/jira/browse/MAPREDUCE-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-1122: --- Attachment: patch-1122.txt Attaching a patch which does the follo

[jira] Updated: (MAPREDUCE-1122) streaming with custom input format does not support the new API

[ https://issues.apache.org/jira/browse/MAPREDUCE-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-1122: --- Status: Patch Available (was: Open) Hadoop Flags: [In

[jira] Commented: (MAPREDUCE-1517) streaming should support running on background

[ https://issues.apache.org/jira/browse/MAPREDUCE-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885488#action_12885488 ] Amareshwari Sriramadasu commented on MAPREDUCE-1517: Bochun, Can yo

[jira] Created: (MAPREDUCE-1916) Usage should be added to HadoopStreaming.java

Usage should be added to HadoopStreaming.java - Key: MAPREDUCE-1916 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1916 Project: Hadoop Map/Reduce Issue Type: Bug Components: contri

[jira] Resolved: (MAPREDUCE-581) slurpHadoop(Path, FileSystem) ignores result of java.io.InputStream.read(byte[], int, int)

[ https://issues.apache.org/jira/browse/MAPREDUCE-581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu resolved MAPREDUCE-581. --- Resolution: Invalid The code in question no longer exists. > slur

[jira] Resolved: (MAPREDUCE-591) TestStreamingStderr fails occassionally

[ https://issues.apache.org/jira/browse/MAPREDUCE-591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu resolved MAPREDUCE-591. --- Resolution: Cannot Reproduce Haven't seen this failure in recent t

[jira] Resolved: (MAPREDUCE-1138) Erroneous output folder handling in streaming testcases

[ https://issues.apache.org/jira/browse/MAPREDUCE-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu resolved MAPREDUCE-1138. Resolution: Duplicate Fixed by MAPREDUCE-1888 > Erroneous outp

[jira] Resolved: (MAPREDUCE-622) Streaming should include more unit tests to test more features that it provides.

[ https://issues.apache.org/jira/browse/MAPREDUCE-622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu resolved MAPREDUCE-622. --- Resolution: Invalid Currently streaming has more than 20 unit test

[jira] Updated: (MAPREDUCE-1248) Redundant memory copying in StreamKeyValUtil

[ https://issues.apache.org/jira/browse/MAPREDUCE-1248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-1248: --- Status: Patch Available (was: Open) Patch looks good. Submitting

[jira] Resolved: (MAPREDUCE-583) get rid of excessive flushes from PipeMapper/Reducer

[ https://issues.apache.org/jira/browse/MAPREDUCE-583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu resolved MAPREDUCE-583. --- Resolution: Duplicate Fixed by HADOOP-3429 > get rid of excessive

[jira] Resolved: (MAPREDUCE-615) need more unit tests for Hadoop streaming

[ https://issues.apache.org/jira/browse/MAPREDUCE-615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu resolved MAPREDUCE-615. --- Resolution: Invalid Currently streaming has more than 20 unit test

[jira] Commented: (MAPREDUCE-1122) streaming with custom input format does not support the new API

[ https://issues.apache.org/jira/browse/MAPREDUCE-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885573#action_12885573 ] Hadoop QA commented on MAPREDUCE-1122: -- -1 overall. Here are the results of testi

[jira] Updated: (MAPREDUCE-1871) Create automated test scenario for "Collect information about number of tasks succeeded / total per time unit for a tasktracker"

[ https://issues.apache.org/jira/browse/MAPREDUCE-1871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iyappan Srinivasan updated MAPREDUCE-1871: -- Attachment: 1871-ydist-security-patch.txt New patch addressing Balaji's com

[jira] Commented: (MAPREDUCE-1871) Create automated test scenario for "Collect information about number of tasks succeeded / total per time unit for a tasktracker"

[ https://issues.apache.org/jira/browse/MAPREDUCE-1871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885596#action_12885596 ] Iyappan Srinivasan commented on MAPREDUCE-1871: --- testTaskTrackerInfoAll I

[jira] Commented: (MAPREDUCE-1248) Redundant memory copying in StreamKeyValUtil

[ https://issues.apache.org/jira/browse/MAPREDUCE-1248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885598#action_12885598 ] Hadoop QA commented on MAPREDUCE-1248: -- -1 overall. Here are the results of testi

[jira] Created: (MAPREDUCE-1917) Semantics of map.input.bytes is not consistent

Semantics of map.input.bytes is not consistent -- Key: MAPREDUCE-1917 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1917 Project: Hadoop Map/Reduce Issue Type: Improvement Componen

[jira] Updated: (MAPREDUCE-1871) Create automated test scenario for "Collect information about number of tasks succeeded / total per time unit for a tasktracker"

[ https://issues.apache.org/jira/browse/MAPREDUCE-1871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iyappan Srinivasan updated MAPREDUCE-1871: -- Attachment: MAPREDUCE-1871.patch patch for trunk > Create automated test s

[jira] Updated: (MAPREDUCE-1906) Lower minimum heartbeat interval for tasktracker > Jobtracker

[ https://issues.apache.org/jira/browse/MAPREDUCE-1906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Carey updated MAPREDUCE-1906: --- Status: Patch Available (was: Open) Is it possible to consider this for 0.21? > Lower

[jira] Created: (MAPREDUCE-1918) Add documentation to Rumen

Add documentation to Rumen -- Key: MAPREDUCE-1918 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1918 Project: Hadoop Map/Reduce Issue Type: Improvement Components: tools/rumen Affects Versions: 0.

[jira] Created: (MAPREDUCE-1919) [Herriot] Test for verification of per cache file ref count.

[Herriot] Test for verification of per cache file ref count. - Key: MAPREDUCE-1919 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1919 Project: Hadoop Map/Reduce Issue Type:

[jira] Updated: (MAPREDUCE-1919) [Herriot] Test for verification of per cache file ref count.

[ https://issues.apache.org/jira/browse/MAPREDUCE-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay Kumar Thota updated MAPREDUCE-1919: - Attachment: 1919-ydist-security.patch patch for Yahoo dist security branch.

[jira] Updated: (MAPREDUCE-1919) [Herriot] Test for verification of per cache file ref count.

[ https://issues.apache.org/jira/browse/MAPREDUCE-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay Kumar Thota updated MAPREDUCE-1919: - Attachment: MAPREDUCE-1919.patch Patch for trunk. > [Herriot] Test for verif

[jira] Updated: (MAPREDUCE-1920) Job.getCounters() returns null when using a cluster

[ https://issues.apache.org/jira/browse/MAPREDUCE-1920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Kimball updated MAPREDUCE-1920: - Affects Version/s: 0.21.0 > Job.getCounters() returns null when using a cluster > ---

[jira] Commented: (MAPREDUCE-1920) Job.getCounters() returns null when using a cluster

[ https://issues.apache.org/jira/browse/MAPREDUCE-1920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885663#action_12885663 ] Aaron Kimball commented on MAPREDUCE-1920: -- The new API seems to have an issue

[jira] Created: (MAPREDUCE-1920) Job.getCounters() returns null when using a cluster

Job.getCounters() returns null when using a cluster --- Key: MAPREDUCE-1920 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1920 Project: Hadoop Map/Reduce Issue Type: Bug Repo

[jira] Updated: (MAPREDUCE-1820) InputSampler does not create a deep copy of the key object when creating a sample, which causes problems with some formats like SequenceFile

[ https://issues.apache.org/jira/browse/MAPREDUCE-1820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-1820: - Attachment: M1820-4.patch Added a unit test. Ideally, this should be in 0.21. > Inpu

[jira] Updated: (MAPREDUCE-1820) InputSampler does not create a deep copy of the key object when creating a sample, which causes problems with some formats like SequenceFile

[ https://issues.apache.org/jira/browse/MAPREDUCE-1820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-1820: - Status: Patch Available (was: Open) > InputSampler does not create a deep copy of th

[jira] Commented: (MAPREDUCE-1906) Lower minimum heartbeat interval for tasktracker > Jobtracker

[ https://issues.apache.org/jira/browse/MAPREDUCE-1906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885726#action_12885726 ] Hadoop QA commented on MAPREDUCE-1906: -- -1 overall. Here are the results of testi

[jira] Updated: (MAPREDUCE-1309) I want to change the rumen job trace generator to use a more modular internal structure, to allow for more input log formats

[ https://issues.apache.org/jira/browse/MAPREDUCE-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Tang updated MAPREDUCE-1309: - Attachment: mr-1309-yhadoop-20.10.patch patch for yahoo hadoop 20.10. not to be committed. >

[jira] Created: (MAPREDUCE-1921) IOExceptions should contain the filename of the broken input files

IOExceptions should contain the filename of the broken input files -- Key: MAPREDUCE-1921 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1921 Project: Hadoop Map/Reduce Is

[jira] Updated: (MAPREDUCE-1921) IOExceptions should contain the filename of the broken input files

[ https://issues.apache.org/jira/browse/MAPREDUCE-1921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Ramachandran updated MAPREDUCE-1921: Attachment: mapreduce-1921.patch patch to include filename in i/o excep

[jira] Commented: (MAPREDUCE-1871) Create automated test scenario for "Collect information about number of tasks succeeded / total per time unit for a tasktracker"

[ https://issues.apache.org/jira/browse/MAPREDUCE-1871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885778#action_12885778 ] Konstantin Boudnik commented on MAPREDUCE-1871: --- bq. Code is right now li

[jira] Updated: (MAPREDUCE-1921) IOExceptions should contain the filename of the broken input files

[ https://issues.apache.org/jira/browse/MAPREDUCE-1921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Ramachandran updated MAPREDUCE-1921: Status: Patch Available (was: Open) > IOExceptions should contain the

[jira] Commented: (MAPREDUCE-1730) Automate test scenario for successful/killed jobs' memory is properly removed from jobtracker after these jobs retire.

[ https://issues.apache.org/jira/browse/MAPREDUCE-1730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885784#action_12885784 ] Konstantin Boudnik commented on MAPREDUCE-1730: --- I think we have discusse

[jira] Commented: (MAPREDUCE-1889) [herriot] Ability to restart a single node for pushconfig

[ https://issues.apache.org/jira/browse/MAPREDUCE-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885787#action_12885787 ] Konstantin Boudnik commented on MAPREDUCE-1889: --- - technically, you might

[jira] Commented: (MAPREDUCE-1854) [herriot] Automate health script system test

[ https://issues.apache.org/jira/browse/MAPREDUCE-1854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885789#action_12885789 ] Konstantin Boudnik commented on MAPREDUCE-1854: --- - This script seems to b

[jira] Commented: (MAPREDUCE-1913) [Herriot] Couple of issues occurred while running the tests in a cluster with security enabled.

[ https://issues.apache.org/jira/browse/MAPREDUCE-1913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885792#action_12885792 ] Konstantin Boudnik commented on MAPREDUCE-1913: --- - For trunk, the config

[jira] Commented: (MAPREDUCE-1713) Utilities for system tests specific.

[ https://issues.apache.org/jira/browse/MAPREDUCE-1713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885794#action_12885794 ] Konstantin Boudnik commented on MAPREDUCE-1713: --- +1 patch looks good. Wer

[jira] Commented: (MAPREDUCE-1794) Test the job status of lost task trackers before and after the timeout.

[ https://issues.apache.org/jira/browse/MAPREDUCE-1794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885793#action_12885793 ] Konstantin Boudnik commented on MAPREDUCE-1794: --- In trunk tests are suppo

[jira] Commented: (MAPREDUCE-1758) Building blocks for the herriot test cases

[ https://issues.apache.org/jira/browse/MAPREDUCE-1758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885795#action_12885795 ] Konstantin Boudnik commented on MAPREDUCE-1758: --- bq. For generating the p

[jira] Created: (MAPREDUCE-1922) Counters for data-local and rack-local tasks should be replaced by bytes-read-local and bytes-read-rack

Counters for data-local and rack-local tasks should be replaced by bytes-read-local and bytes-read-rack --- Key: MAPREDUCE-1922 URL: https://issues.apache.org/jira

[jira] Created: (MAPREDUCE-1923) Support arbitrary precision in the distbbp example

Support arbitrary precision in the distbbp example -- Key: MAPREDUCE-1923 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1923 Project: Hadoop Map/Reduce Issue Type: Improvement

[jira] Commented: (MAPREDUCE-1820) InputSampler does not create a deep copy of the key object when creating a sample, which causes problems with some formats like SequenceFile

[ https://issues.apache.org/jira/browse/MAPREDUCE-1820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885811#action_12885811 ] Hadoop QA commented on MAPREDUCE-1820: -- -1 overall. Here are the results of testi

[jira] Updated: (MAPREDUCE-1375) TestFileArgs fails intermittently

[ https://issues.apache.org/jira/browse/MAPREDUCE-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-1375: --- Component/s: contrib/streaming > TestFileArgs fails intermittentl

[jira] Commented: (MAPREDUCE-1920) Job.getCounters() returns null when using a cluster

[ https://issues.apache.org/jira/browse/MAPREDUCE-1920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885817#action_12885817 ] Amareshwari Sriramadasu commented on MAPREDUCE-1920: Are you sure t

[jira] Commented: (MAPREDUCE-1122) streaming with custom input format does not support the new API

[ https://issues.apache.org/jira/browse/MAPREDUCE-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885819#action_12885819 ] Amareshwari Sriramadasu commented on MAPREDUCE-1122: bq. -1 contrib

[jira] Commented: (MAPREDUCE-1248) Redundant memory copying in StreamKeyValUtil

[ https://issues.apache.org/jira/browse/MAPREDUCE-1248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885821#action_12885821 ] Amareshwari Sriramadasu commented on MAPREDUCE-1248: bq. -1 contrib

[jira] Commented: (MAPREDUCE-1713) Utilities for system tests specific.

[ https://issues.apache.org/jira/browse/MAPREDUCE-1713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885824#action_12885824 ] Vinay Kumar Thota commented on MAPREDUCE-1713: -- Cos, we have already opene

[jira] Updated: (MAPREDUCE-1741) Automate the test scenario of job related files are moved from history directory to done directory

[ https://issues.apache.org/jira/browse/MAPREDUCE-1741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iyappan Srinivasan updated MAPREDUCE-1741: -- Attachment: TestJobHistoryLocation-ydist-security-patch.txt Remove the asse

[jira] Updated: (MAPREDUCE-1741) Automate the test scenario of job related files are moved from history directory to done directory

[ https://issues.apache.org/jira/browse/MAPREDUCE-1741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iyappan Srinivasan updated MAPREDUCE-1741: -- Attachment: MAPREDUCE-1741.patch patch for trunk > Automate the test scena

[jira] Commented: (MAPREDUCE-1854) [herriot] Automate health script system test

[ https://issues.apache.org/jira/browse/MAPREDUCE-1854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885841#action_12885841 ] Balaji Rajagopalan commented on MAPREDUCE-1854: --- how about creating src/t

[jira] Commented: (MAPREDUCE-1920) Job.getCounters() returns null when using a cluster

[ https://issues.apache.org/jira/browse/MAPREDUCE-1920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885843#action_12885843 ] Aaron Kimball commented on MAPREDUCE-1920: -- I agree that this shouldn't break