[jira] Updated: (MAPREDUCE-1334) contrib/index - test - TestIndexUpdater fails due to an additional presence of file _SUCCESS in hdfs
[ https://issues.apache.org/jira/browse/MAPREDUCE-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1334: --- Fix Version/s: 0.22.0 (was: 0.21.0) Priority: Major (was: Critical) > contrib/index - test - TestIndexUpdater fails due to an additional presence > of file _SUCCESS in hdfs > - > > Key: MAPREDUCE-1334 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1334 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: contrib/index >Reporter: Kay Kay > Fix For: 0.22.0 > > Attachments: MAPREDUCE-1334.patch > > > $ cd src/contrib/index > $ ant clean test > This fails the test TestIndexUpdater due to a mismatch in the - doneFileNames > - data structure, when it is being run with different parameters. > (ArrayIndexOutOfBoundsException raised when inserting elements in > doneFileNames, array ). > Debugging further - there seems to be an additional file called as - > hdfs://localhost:36021/myoutput/_SUCCESS , taken into consideration in > addition to those that begins with done* . The presence of the extra file > causes the error. > Attaching a patch that would circumvent this by increasing the array length > of shards by 1 . > But longer term the test fixtures need to be probably revisited to see if the > presence of _SUCCESS as a file is a good thing to begin with before we even > get to this test case. > Any comments / suggestions on the same welcome. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Created: (MAPREDUCE-1643) HTable - delete / put unnecessary sync.
HTable - delete / put unnecessary sync. Key: MAPREDUCE-1643 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1643 Project: Hadoop Map/Reduce Issue Type: New Feature Reporter: Kay Kay HTable is not thread-safe , but some of the methods seem to have a synchronized block (put/delete) etc. It might as well be better to remove them altogether. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1320) StringBuffer -> StringBuilder occurence
[ https://issues.apache.org/jira/browse/MAPREDUCE-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12845710#action_12845710 ] Kay Kay commented on MAPREDUCE-1320: org.apache.hadoop.security.TestMapredGroupMappingServiceRefresh.testGroupMappingRefresh (from TestMapredGroupMappingServiceRefresh) java.lang.IllegalArgumentException: port out of range:-1 at java.net.InetSocketAddress.(InetSocketAddress.java:118) at org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.java:385) at org.apache.hadoop.hdfs.server.namenode.NameNode.activate(NameNode.java:323) at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:310) at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:430) at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:418) at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1333) at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:278) at org.apache.hadoop.security.TestMapredGroupMappingServiceRefresh.setUp(TestMapredGroupMappingServiceRefresh.java:85) Does not seem to do with this patch though. > StringBuffer -> StringBuilder occurence > > > Key: MAPREDUCE-1320 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1320 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 0.22.0 >Reporter: Kay Kay > Fix For: 0.22.0 > > Attachments: MAPREDUCE-1320.patch, MAPREDUCE-1320.patch > > > A good number of toString() implementations use StringBuffer when the > reference clearly does not go out of scope of the method and no concurrency > is needed. Patch contains replacing those occurences from StringBuffer to > StringBuilder. > Created against map/reduce project trunk . -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1320) StringBuffer -> StringBuilder occurence
[ https://issues.apache.org/jira/browse/MAPREDUCE-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1320: --- Status: Open (was: Patch Available) > StringBuffer -> StringBuilder occurence > > > Key: MAPREDUCE-1320 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1320 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 0.22.0 >Reporter: Kay Kay > Fix For: 0.22.0 > > Attachments: MAPREDUCE-1320.patch, MAPREDUCE-1320.patch > > > A good number of toString() implementations use StringBuffer when the > reference clearly does not go out of scope of the method and no concurrency > is needed. Patch contains replacing those occurences from StringBuffer to > StringBuilder. > Created against map/reduce project trunk . -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1320) StringBuffer -> StringBuilder occurence
[ https://issues.apache.org/jira/browse/MAPREDUCE-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1320: --- Status: Patch Available (was: Open) > StringBuffer -> StringBuilder occurence > > > Key: MAPREDUCE-1320 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1320 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 0.22.0 >Reporter: Kay Kay > Fix For: 0.22.0 > > Attachments: MAPREDUCE-1320.patch, MAPREDUCE-1320.patch > > > A good number of toString() implementations use StringBuffer when the > reference clearly does not go out of scope of the method and no concurrency > is needed. Patch contains replacing those occurences from StringBuffer to > StringBuilder. > Created against map/reduce project trunk . -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1320) StringBuffer -> StringBuilder occurence
[ https://issues.apache.org/jira/browse/MAPREDUCE-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1320: --- Attachment: MAPREDUCE-1320.patch > StringBuffer -> StringBuilder occurence > > > Key: MAPREDUCE-1320 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1320 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 0.22.0 >Reporter: Kay Kay > Fix For: 0.22.0 > > Attachments: MAPREDUCE-1320.patch, MAPREDUCE-1320.patch > > > A good number of toString() implementations use StringBuffer when the > reference clearly does not go out of scope of the method and no concurrency > is needed. Patch contains replacing those occurences from StringBuffer to > StringBuilder. > Created against map/reduce project trunk . -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1320) StringBuffer -> StringBuilder occurence
[ https://issues.apache.org/jira/browse/MAPREDUCE-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1320: --- Status: Open (was: Patch Available) > StringBuffer -> StringBuilder occurence > > > Key: MAPREDUCE-1320 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1320 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 0.22.0 >Reporter: Kay Kay > Fix For: 0.22.0 > > Attachments: MAPREDUCE-1320.patch, MAPREDUCE-1320.patch > > > A good number of toString() implementations use StringBuffer when the > reference clearly does not go out of scope of the method and no concurrency > is needed. Patch contains replacing those occurences from StringBuffer to > StringBuilder. > Created against map/reduce project trunk . -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1320) StringBuffer -> StringBuilder occurence
[ https://issues.apache.org/jira/browse/MAPREDUCE-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1320: --- Status: Patch Available (was: Open) > StringBuffer -> StringBuilder occurence > > > Key: MAPREDUCE-1320 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1320 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 0.22.0 >Reporter: Kay Kay > Fix For: 0.22.0 > > Attachments: MAPREDUCE-1320.patch, MAPREDUCE-1320.patch > > > A good number of toString() implementations use StringBuffer when the > reference clearly does not go out of scope of the method and no concurrency > is needed. Patch contains replacing those occurences from StringBuffer to > StringBuilder. > Created against map/reduce project trunk . -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1334) contrib/index - test - TestIndexUpdater fails due to an additional presence of file _SUCCESS in hdfs
[ https://issues.apache.org/jira/browse/MAPREDUCE-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1334: --- Status: Patch Available (was: Open) > contrib/index - test - TestIndexUpdater fails due to an additional presence > of file _SUCCESS in hdfs > - > > Key: MAPREDUCE-1334 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1334 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: contrib/index >Reporter: Kay Kay >Priority: Critical > Fix For: 0.21.0 > > Attachments: MAPREDUCE-1334.patch > > > $ cd src/contrib/index > $ ant clean test > This fails the test TestIndexUpdater due to a mismatch in the - doneFileNames > - data structure, when it is being run with different parameters. > (ArrayIndexOutOfBoundsException raised when inserting elements in > doneFileNames, array ). > Debugging further - there seems to be an additional file called as - > hdfs://localhost:36021/myoutput/_SUCCESS , taken into consideration in > addition to those that begins with done* . The presence of the extra file > causes the error. > Attaching a patch that would circumvent this by increasing the array length > of shards by 1 . > But longer term the test fixtures need to be probably revisited to see if the > presence of _SUCCESS as a file is a good thing to begin with before we even > get to this test case. > Any comments / suggestions on the same welcome. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1334) contrib/index - test - TestIndexUpdater fails due to an additional presence of file _SUCCESS in hdfs
[ https://issues.apache.org/jira/browse/MAPREDUCE-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1334: --- Status: Open (was: Patch Available) > contrib/index - test - TestIndexUpdater fails due to an additional presence > of file _SUCCESS in hdfs > - > > Key: MAPREDUCE-1334 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1334 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: contrib/index >Reporter: Kay Kay >Priority: Critical > Fix For: 0.21.0 > > Attachments: MAPREDUCE-1334.patch > > > $ cd src/contrib/index > $ ant clean test > This fails the test TestIndexUpdater due to a mismatch in the - doneFileNames > - data structure, when it is being run with different parameters. > (ArrayIndexOutOfBoundsException raised when inserting elements in > doneFileNames, array ). > Debugging further - there seems to be an additional file called as - > hdfs://localhost:36021/myoutput/_SUCCESS , taken into consideration in > addition to those that begins with done* . The presence of the extra file > causes the error. > Attaching a patch that would circumvent this by increasing the array length > of shards by 1 . > But longer term the test fixtures need to be probably revisited to see if the > presence of _SUCCESS as a file is a good thing to begin with before we even > get to this test case. > Any comments / suggestions on the same welcome. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1320) StringBuffer -> StringBuilder occurence
[ https://issues.apache.org/jira/browse/MAPREDUCE-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1320: --- Status: Patch Available (was: Reopened) Workflow changes to force hudson to pick up the patch > StringBuffer -> StringBuilder occurence > > > Key: MAPREDUCE-1320 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1320 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 0.22.0 >Reporter: Kay Kay > Fix For: 0.22.0 > > Attachments: MAPREDUCE-1320.patch > > > A good number of toString() implementations use StringBuffer when the > reference clearly does not go out of scope of the method and no concurrency > is needed. Patch contains replacing those occurences from StringBuffer to > StringBuilder. > Created against map/reduce project trunk . -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Resolved: (MAPREDUCE-1320) StringBuffer -> StringBuilder occurence
[ https://issues.apache.org/jira/browse/MAPREDUCE-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay resolved MAPREDUCE-1320. Resolution: Later > StringBuffer -> StringBuilder occurence > > > Key: MAPREDUCE-1320 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1320 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 0.22.0 >Reporter: Kay Kay > Fix For: 0.22.0 > > Attachments: MAPREDUCE-1320.patch > > > A good number of toString() implementations use StringBuffer when the > reference clearly does not go out of scope of the method and no concurrency > is needed. Patch contains replacing those occurences from StringBuffer to > StringBuilder. > Created against map/reduce project trunk . -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Reopened: (MAPREDUCE-1320) StringBuffer -> StringBuilder occurence
[ https://issues.apache.org/jira/browse/MAPREDUCE-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay reopened MAPREDUCE-1320: > StringBuffer -> StringBuilder occurence > > > Key: MAPREDUCE-1320 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1320 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 0.22.0 >Reporter: Kay Kay > Fix For: 0.22.0 > > Attachments: MAPREDUCE-1320.patch > > > A good number of toString() implementations use StringBuffer when the > reference clearly does not go out of scope of the method and no concurrency > is needed. Patch contains replacing those occurences from StringBuffer to > StringBuilder. > Created against map/reduce project trunk . -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Resolved: (MAPREDUCE-1364) Hudson build of mapreduce - 0.21.0 to be green
[ https://issues.apache.org/jira/browse/MAPREDUCE-1364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay resolved MAPREDUCE-1364. Resolution: Not A Problem > Hudson build of mapreduce - 0.21.0 to be green > --- > > Key: MAPREDUCE-1364 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1364 > Project: Hadoop Map/Reduce > Issue Type: Task >Affects Versions: 0.21.0 >Reporter: Kay Kay > Fix For: 0.21.0 > > > Make hudson build of mapreduce-0.21.0 green. > http://hudson.zones.apache.org/hudson/view/Hadoop/job/Hadoop-Mapreduce-21-Build/ > > The last successful one was on Dec 11 , and the latest one seems to fail with > some classpath issue on hadoop-core ( complains about missing > o.a.h.Configuration etc. ). > Having the build to be green would be useful to understand the sanity of the > latest snapshot of branch-0.21 and understand the release schedule for the > same. > Thanks for helping. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1332) Ant tasks for job submission
[ https://issues.apache.org/jira/browse/MAPREDUCE-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12829175#action_12829175 ] Kay Kay commented on MAPREDUCE-1332: On a related note - have put up a maven hadoop mojo here at - http://github.com/akkumar/maven-hadoop . Pretty rudimentary at this point with a target for packing jar files , for submission . Hopefully , down the road should be polished more. Interested people can follow more at - http://maven-hadoop.blogspot.com/ . > Ant tasks for job submission > > > Key: MAPREDUCE-1332 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1332 > Project: Hadoop Map/Reduce > Issue Type: New Feature >Affects Versions: 0.22.0 > Environment: Both platforms, Linux and Windows >Reporter: Steve Loughran >Assignee: Steve Loughran >Priority: Minor > Attachments: JobSubmitTask.java > > Original Estimate: 168h > Remaining Estimate: 168h > > Ant tasks to make it easy to work with hadoop filesystem and submit jobs. > : uploads JAR, submits job as user, with various settings > filesystem operations: mkdir, copyin, copyout, delete > -We could maybe use Ant1.7 "resources" here, and so use hdfs as a source or > dest in Ant's own tasks > # security. Need to specify user; pick up user.name from JVM as default? > # cluster binding: namenode/job tracker (hostname,port) or url are all that > is needed? > #job conf: how to configure the job that is submitted? support a list of > children > # testing. AntUnit to generate compatible XML files > # Documentation. With an example using Ivy to fetch the JARs for the tasks > and hadoop client. > # Polling: ant task to block for a job finished? -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1336) TestStreamingExitStatus - Fix deprecated use of StreamJob submission API
[ https://issues.apache.org/jira/browse/MAPREDUCE-1336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12804629#action_12804629 ] Kay Kay commented on MAPREDUCE-1336: | Kay: as you're filing and fixing a number of streaming test issues, would you please consolidate some of them? Amortizing the cost of reviewing/committing small patches to test code is a courtesy much appreciated. Will do. Actually I came to do this because a good number of test cases were failing before Todd L stepped with a fix to a number of them. I will review them and attach as one patch soon. > TestStreamingExitStatus - Fix deprecated use of StreamJob submission API > > > Key: MAPREDUCE-1336 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1336 > Project: Hadoop Map/Reduce > Issue Type: Test >Reporter: Kay Kay > Fix For: 0.20.2 > > Attachments: MAPREDUCE-1336.patch > > > Fix deprecated API in StreamJob and executing the same. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1337) Generify StreamJob for better readability
[ https://issues.apache.org/jira/browse/MAPREDUCE-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1337: --- Status: Patch Available (was: Open) > Generify StreamJob for better readability > - > > Key: MAPREDUCE-1337 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1337 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 0.22.0 >Reporter: Kay Kay > Fix For: 0.22.0 > > Attachments: MAPREDUCE-1337.patch, MAPREDUCE-1337.patch > > > Generify some of the members of StreamJob for better readability. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1337) Generify StreamJob for better readability
[ https://issues.apache.org/jira/browse/MAPREDUCE-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1337: --- Status: Open (was: Patch Available) > Generify StreamJob for better readability > - > > Key: MAPREDUCE-1337 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1337 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 0.22.0 >Reporter: Kay Kay > Fix For: 0.22.0 > > Attachments: MAPREDUCE-1337.patch, MAPREDUCE-1337.patch > > > Generify some of the members of StreamJob for better readability. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1332) Ant tasks for job submission
[ https://issues.apache.org/jira/browse/MAPREDUCE-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12800532#action_12800532 ] Kay Kay commented on MAPREDUCE-1332: So - what is the current status / interest in this ? A non-blocking ant task would be very useful. > Ant tasks for job submission > > > Key: MAPREDUCE-1332 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1332 > Project: Hadoop Map/Reduce > Issue Type: New Feature >Affects Versions: 0.22.0 > Environment: Both platforms, Linux and Windows >Reporter: Steve Loughran >Assignee: Steve Loughran >Priority: Minor > Attachments: JobSubmitTask.java > > Original Estimate: 168h > Remaining Estimate: 168h > > Ant tasks to make it easy to work with hadoop filesystem and submit jobs. > : uploads JAR, submits job as user, with various settings > filesystem operations: mkdir, copyin, copyout, delete > -We could maybe use Ant1.7 "resources" here, and so use hdfs as a source or > dest in Ant's own tasks > # security. Need to specify user; pick up user.name from JVM as default? > # cluster binding: namenode/job tracker (hostname,port) or url are all that > is needed? > #job conf: how to configure the job that is submitted? support a list of > children > # testing. AntUnit to generate compatible XML files > # Documentation. With an example using Ivy to fetch the JARs for the tasks > and hadoop client. > # Polling: ant task to block for a job finished? -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Created: (MAPREDUCE-1364) Hudson build of mapreduce - 0.21.0 to be green
Hudson build of mapreduce - 0.21.0 to be green --- Key: MAPREDUCE-1364 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1364 Project: Hadoop Map/Reduce Issue Type: Task Affects Versions: 0.21.0 Reporter: Kay Kay Fix For: 0.21.0 Make hudson build of mapreduce-0.21.0 green. http://hudson.zones.apache.org/hudson/view/Hadoop/job/Hadoop-Mapreduce-21-Build/ The last successful one was on Dec 11 , and the latest one seems to fail with some classpath issue on hadoop-core ( complains about missing o.a.h.Configuration etc. ). Having the build to be green would be useful to understand the sanity of the latest snapshot of branch-0.21 and understand the release schedule for the same. Thanks for helping. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1352) 0.21.0 - snapshot incorrect dependency published in .pom files
[ https://issues.apache.org/jira/browse/MAPREDUCE-1352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12797665#action_12797665 ] Kay Kay commented on MAPREDUCE-1352: Thanks Giri. Looks good with the revised upload to apache mapred snapshots. The builds in hudson are failing (for branch-0.21 - mapreduce ) though . We need to make sure that is consistent - but that is not immediately affecting hbase at the moment though ( Seems like an environment / CP issue ). > 0.21.0 - snapshot incorrect dependency published in .pom files > --- > > Key: MAPREDUCE-1352 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1352 > Project: Hadoop Map/Reduce > Issue Type: Task > Components: build >Affects Versions: 0.21.0 >Reporter: Kay Kay >Assignee: Giridharan Kesavan >Priority: Critical > Fix For: 0.21.0 > > Attachments: mapreduce-1352.patch > > > The snapshot available here at - > https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-mapred/0.21.0-SNAPSHOT/ > , has an incorrect dependency specified for hadoop-core ( in the .pom file > ). > The source code ( in branch-0.21 ) refers to hadoop-core-0.21 in > ivy/libaries.properties but pom.xml published in the repository refers to > 0.22 . Please fix the same by republishing a .pom again. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1355) contrib/index - fails to build with error - " Overriding index.ivy.settings' is not allowed when using override='notallowed' "
[ https://issues.apache.org/jira/browse/MAPREDUCE-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12797424#action_12797424 ] Kay Kay commented on MAPREDUCE-1355: Thanks Aaron. Seems like an edge case quirk . Lowering the priority to minor. > contrib/index - fails to build with error - " Overriding index.ivy.settings' > is not allowed when using override='notallowed' " > > > Key: MAPREDUCE-1355 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1355 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: contrib/index >Reporter: Kay Kay >Priority: Minor > Attachments: MAPREDUCE-1355.patch > > > Checked out the trunk of mapreduce - tried to build contrib/index > $ cd contrib/index > $ ant clean compile test > Failed with the error - > mapreduce/src/contrib/build-contrib.xml:311: Overriding a previous definition > of ivy:settings with the id 'index.ivy.settings' is not allowed when using > override='notallowed' , (when in fact the override has been specified to be > 'false' ). > Bumping the ivy.version to 2.1.0 seems to be fix the issue. Marking this as > critical since it is not possible to build in the first place. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1355) contrib/index - fails to build with error - " Overriding index.ivy.settings' is not allowed when using override='notallowed' "
[ https://issues.apache.org/jira/browse/MAPREDUCE-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1355: --- Priority: Minor (was: Critical) > contrib/index - fails to build with error - " Overriding index.ivy.settings' > is not allowed when using override='notallowed' " > > > Key: MAPREDUCE-1355 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1355 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: contrib/index >Reporter: Kay Kay >Priority: Minor > Attachments: MAPREDUCE-1355.patch > > > Checked out the trunk of mapreduce - tried to build contrib/index > $ cd contrib/index > $ ant clean compile test > Failed with the error - > mapreduce/src/contrib/build-contrib.xml:311: Overriding a previous definition > of ivy:settings with the id 'index.ivy.settings' is not allowed when using > override='notallowed' , (when in fact the override has been specified to be > 'false' ). > Bumping the ivy.version to 2.1.0 seems to be fix the issue. Marking this as > critical since it is not possible to build in the first place. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1352) 0.21.0 - snapshot incorrect dependency published in .pom files
[ https://issues.apache.org/jira/browse/MAPREDUCE-1352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12797006#action_12797006 ] Kay Kay commented on MAPREDUCE-1352: @Giri / @stack - can you help with the publishing this patch to the branch / republishing artifacts to validate hbase-1433 before that patch could be taken up for consideration with hbase community. > 0.21.0 - snapshot incorrect dependency published in .pom files > --- > > Key: MAPREDUCE-1352 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1352 > Project: Hadoop Map/Reduce > Issue Type: Task > Components: build >Affects Versions: 0.21.0 >Reporter: Kay Kay >Assignee: Giridharan Kesavan >Priority: Critical > Fix For: 0.21.0 > > Attachments: mapreduce-1352.patch > > > The snapshot available here at - > https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-mapred/0.21.0-SNAPSHOT/ > , has an incorrect dependency specified for hadoop-core ( in the .pom file > ). > The source code ( in branch-0.21 ) refers to hadoop-core-0.21 in > ivy/libaries.properties but pom.xml published in the repository refers to > 0.22 . Please fix the same by republishing a .pom again. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Created: (MAPREDUCE-1357) contrib/index - As part of the hudson build
contrib/index - As part of the hudson build Key: MAPREDUCE-1357 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1357 Project: Hadoop Map/Reduce Issue Type: Task Reporter: Kay Kay As of now - it seems like contrib/index test cases do not come under the hudson build (contrib/index not being actively maintained ? ) test suite. Given that it is in the tree - might be useful to bring that in the first place. At its current state - most probably it might fail and may need to apply - MAPREDUCE-1328 and MAPREDUCE-1334 . But as the first step - we may need to bring in contrib/index ( If it is dormant - try to understand a bit of background ). -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Created: (MAPREDUCE-1355) contrib/index - fails to build with error - " Overriding index.ivy.settings' is not allowed when using override='notallowed' "
contrib/index - fails to build with error - " Overriding index.ivy.settings' is not allowed when using override='notallowed' " Key: MAPREDUCE-1355 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1355 Project: Hadoop Map/Reduce Issue Type: Bug Components: contrib/index Reporter: Kay Kay Priority: Critical Attachments: MAPREDUCE-1355.patch Checked out the trunk of mapreduce - tried to build contrib/index $ cd contrib/index $ ant clean compile test Failed with the error - mapreduce/src/contrib/build-contrib.xml:311: Overriding a previous definition of ivy:settings with the id 'index.ivy.settings' is not allowed when using override='notallowed' , (when in fact the override has been specified to be 'false' ). Bumping the ivy.version to 2.1.0 seems to be fix the issue. Marking this as critical since it is not possible to build in the first place. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1355) contrib/index - fails to build with error - " Overriding index.ivy.settings' is not allowed when using override='notallowed' "
[ https://issues.apache.org/jira/browse/MAPREDUCE-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1355: --- Attachment: MAPREDUCE-1355.patch ivy upgraded to fix ivy issue with override settings. > contrib/index - fails to build with error - " Overriding index.ivy.settings' > is not allowed when using override='notallowed' " > > > Key: MAPREDUCE-1355 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1355 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: contrib/index >Reporter: Kay Kay >Priority: Critical > Attachments: MAPREDUCE-1355.patch > > > Checked out the trunk of mapreduce - tried to build contrib/index > $ cd contrib/index > $ ant clean compile test > Failed with the error - > mapreduce/src/contrib/build-contrib.xml:311: Overriding a previous definition > of ivy:settings with the id 'index.ivy.settings' is not allowed when using > override='notallowed' , (when in fact the override has been specified to be > 'false' ). > Bumping the ivy.version to 2.1.0 seems to be fix the issue. Marking this as > critical since it is not possible to build in the first place. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1352) 0.21.0 - snapshot incorrect dependency published in .pom files
[ https://issues.apache.org/jira/browse/MAPREDUCE-1352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12796590#action_12796590 ] Kay Kay commented on MAPREDUCE-1352: It seems like the artifacts published on https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-mapred/0.21.0-SNAPSHOT/ are *not* from branch-0.21 . TODO: * Checkin the patch to branch-0.21 * Republish hadoop-mapred and hadoop-mapred-test from the same. That should resolve the dynamic link issue faced by HBASE-1433 . Thanks for taking this on a priority since it is blocking the ivy configuration of hbase. > 0.21.0 - snapshot incorrect dependency published in .pom files > --- > > Key: MAPREDUCE-1352 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1352 > Project: Hadoop Map/Reduce > Issue Type: Task > Components: build >Affects Versions: 0.21.0 >Reporter: Kay Kay >Assignee: Giridharan Kesavan >Priority: Critical > Fix For: 0.21.0 > > Attachments: mapreduce-1352.patch > > > The snapshot available here at - > https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-mapred/0.21.0-SNAPSHOT/ > , has an incorrect dependency specified for hadoop-core ( in the .pom file > ). > The source code ( in branch-0.21 ) refers to hadoop-core-0.21 in > ivy/libaries.properties but pom.xml published in the repository refers to > 0.22 . Please fix the same by republishing a .pom again. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1352) 0.21.0 - snapshot incorrect dependency published in .pom files
[ https://issues.apache.org/jira/browse/MAPREDUCE-1352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12796556#action_12796556 ] Kay Kay commented on MAPREDUCE-1352: HDFS-869 is in now and republished. @Giri: Can we help get this patch applied on branch-0.21 too . Also the most recently build on hudson for 0.21 - http://hudson.zones.apache.org/hudson/view/Hadoop/job/Hadoop-Mapreduce-21-Build/51/testReport/org.apache.hadoop.cli/TestMRCLI/testAll/ fails with the same dynamic linking error that we are facing in hbase currently. Can you help commit the patch and get a new build to see if this still persists. Thanks. > 0.21.0 - snapshot incorrect dependency published in .pom files > --- > > Key: MAPREDUCE-1352 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1352 > Project: Hadoop Map/Reduce > Issue Type: Task > Components: build >Affects Versions: 0.21.0 >Reporter: Kay Kay >Assignee: Giridharan Kesavan >Priority: Critical > Fix For: 0.21.0 > > Attachments: mapreduce-1352.patch > > > The snapshot available here at - > https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-mapred/0.21.0-SNAPSHOT/ > , has an incorrect dependency specified for hadoop-core ( in the .pom file > ). > The source code ( in branch-0.21 ) refers to hadoop-core-0.21 in > ivy/libaries.properties but pom.xml published in the repository refers to > 0.22 . Please fix the same by republishing a .pom again. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1155) Streaming tests swallow exceptions
[ https://issues.apache.org/jira/browse/MAPREDUCE-1155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12796400#action_12796400 ] Kay Kay commented on MAPREDUCE-1155: Are we waiting for more code review before this goes into the tree. If this makes the build green- when can we get this committed. thanks. > Streaming tests swallow exceptions > -- > > Key: MAPREDUCE-1155 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1155 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: contrib/streaming >Affects Versions: 0.20.1, 0.21.0, 0.22.0 >Reporter: Todd Lipcon >Assignee: Todd Lipcon >Priority: Minor > Attachments: mapreduce-1155.patch, mapreduce-1155.patch, > mapreduce-1155.txt, mapreduce-1155.txt > > > Many of the streaming tests (including TestMultipleArchiveFiles) catch > exceptions and print their stack trace rather than failing the job. This > means that tests do not fail even when the job fails. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1352) 0.21.0 - snapshot incorrect dependency published in .pom files
[ https://issues.apache.org/jira/browse/MAPREDUCE-1352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12796329#action_12796329 ] Kay Kay commented on MAPREDUCE-1352: Are we looking at the trunk ( 0.22, I guess ) or 0.21 branch. Since the 0.21 branch seems to have a quite a lot of failures - http://hudson.zones.apache.org/hudson/view/Hadoop/job/Hadoop-Mapreduce-21-Build/ . That might be because - mapreduce-0.21 , depends on hdfs-0.21 , that in turn depends on hadoop-core-0.22 by mistake and hence causing strange dynamic link issues. So - we can have this as a dependency on HDFS-869 , get a green build on hdfs trunk with revised .pom and then retry this again. > 0.21.0 - snapshot incorrect dependency published in .pom files > --- > > Key: MAPREDUCE-1352 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1352 > Project: Hadoop Map/Reduce > Issue Type: Task > Components: build >Affects Versions: 0.21.0 >Reporter: Kay Kay >Assignee: Giridharan Kesavan >Priority: Critical > Fix For: 0.21.0 > > Attachments: mapreduce-1352.patch > > > The snapshot available here at - > https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-mapred/0.21.0-SNAPSHOT/ > , has an incorrect dependency specified for hadoop-core ( in the .pom file > ). > The source code ( in branch-0.21 ) refers to hadoop-core-0.21 in > ivy/libaries.properties but pom.xml published in the repository refers to > 0.22 . Please fix the same by republishing a .pom again. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1312) TestStreamingKeyValue fails on hudson patch builds
[ https://issues.apache.org/jira/browse/MAPREDUCE-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12796313#action_12796313 ] Kay Kay commented on MAPREDUCE-1312: MAPREDUCE-1346 addresses the same issue . The failure is due to invalid test fixtures. > TestStreamingKeyValue fails on hudson patch builds > -- > > Key: MAPREDUCE-1312 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1312 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: build, test >Reporter: Amareshwari Sriramadasu > > TestStreamingKeyValue fails on hudson patch builds with FileNotFoundException. > The failure log from one of the builds is @ > http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/203/testReport/org.apache.hadoop.streaming/TestStreamingKeyValue/testCommandLine/ -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1311) TestStreamingExitStatus fails on hudson patch builds
[
https://issues.apache.org/jira/browse/MAPREDUCE-1311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12796314#action_12796314
]
Kay Kay commented on MAPREDUCE-1311:
MAPREDUCE-1346 addresses the same issue but due to invalid test fixtures of
contrib/streaming of not deleting files properly.
> TestStreamingExitStatus fails on hudson patch builds
>
>
> Key: MAPREDUCE-1311
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1311
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: test
>Reporter: Amareshwari Sriramadasu
>
> TestStreamingExitStatus fails on hudson patch builds. The logs have the
> following error :
> {noformat}
> 09/12/16 20:30:58 INFO fs.FSInputChecker: Found checksum error: b[0,
> 6]=68656c6c6f0a
> org.apache.hadoop.fs.ChecksumException: Checksum error:
> file:/grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h3.grid.sp2.yahoo.net/trunk/build/contrib/streaming/test/data/input.txt
> at 0
> at
> org.apache.hadoop.fs.FSInputChecker.verifySum(FSInputChecker.java:278)
> at
> org.apache.hadoop.fs.FSInputChecker.readChecksumChunk(FSInputChecker.java:242)
> at org.apache.hadoop.fs.FSInputChecker.read1(FSInputChecker.java:190)
> at org.apache.hadoop.fs.FSInputChecker.read(FSInputChecker.java:158)
> at java.io.DataInputStream.read(DataInputStream.java:83)
> at org.apache.hadoop.util.LineReader.readLine(LineReader.java:134)
> at
> org.apache.hadoop.mapred.LineRecordReader.next(LineRecordReader.java:180)
> at
> org.apache.hadoop.mapred.LineRecordReader.next(LineRecordReader.java:45)
> at
> org.apache.hadoop.mapred.MapTask$TrackedRecordReader.moveToNext(MapTask.java:206)
> at
> org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:191)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:48)
> at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:36)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:376)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:257)
> 09/12/16 20:30:58 INFO streaming.PipeMapRed: MRErrorThread done
> {noformat}
> The same passes on my local machine.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1346) TestStreamingExitStatus / TestStreamingKeyValue - correct text fixtures in place
[ https://issues.apache.org/jira/browse/MAPREDUCE-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12796233#action_12796233 ] Kay Kay commented on MAPREDUCE-1346: oops.yes - i meant 'test' fixtures > TestStreamingExitStatus / TestStreamingKeyValue - correct text fixtures in > place > - > > Key: MAPREDUCE-1346 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1346 > Project: Hadoop Map/Reduce > Issue Type: Bug >Affects Versions: 0.20.2 >Reporter: Kay Kay > Fix For: 0.20.2 > > Attachments: MAPREDUCE-1346.patch > > > TestStreamingExitStatus does not have the correct text fixtures , of deleting > the input / output files after the last test run. > Cleanup methods as part of setUp refactored to tearDown to accomplish that. > Because of incorrect text fixtures - subsequent test cases fail. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1352) 0.21.0 - snapshot incorrect dependency published in .pom files
[ https://issues.apache.org/jira/browse/MAPREDUCE-1352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12796090#action_12796090 ] Kay Kay commented on MAPREDUCE-1352: Marking this as critical since HBASE-1433 (ivy configuration of hbase ) is not successful because of this confusion. Also - if possible a fresh upload of the jars , along with the sources , into the maven repository would be useful. > 0.21.0 - snapshot incorrect dependency published in .pom files > --- > > Key: MAPREDUCE-1352 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1352 > Project: Hadoop Map/Reduce > Issue Type: Task > Components: build >Affects Versions: 0.21.0 >Reporter: Kay Kay >Assignee: Giridharan Kesavan >Priority: Critical > Fix For: 0.21.0 > > > The snapshot available here at - > https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-mapred/0.21.0-SNAPSHOT/ > , has an incorrect dependency specified for hadoop-core ( in the .pom file > ). > The source code ( in branch-0.21 ) refers to hadoop-core-0.21 in > ivy/libaries.properties but pom.xml published in the repository refers to > 0.22 . Please fix the same by republishing a .pom again. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1352) 0.21.0 - snapshot incorrect dependency published in .pom files
[ https://issues.apache.org/jira/browse/MAPREDUCE-1352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1352: --- Component/s: build Priority: Critical (was: Major) > 0.21.0 - snapshot incorrect dependency published in .pom files > --- > > Key: MAPREDUCE-1352 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1352 > Project: Hadoop Map/Reduce > Issue Type: Task > Components: build >Affects Versions: 0.21.0 >Reporter: Kay Kay >Priority: Critical > Fix For: 0.21.0 > > > The snapshot available here at - > https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-mapred/0.21.0-SNAPSHOT/ > , has an incorrect dependency specified for hadoop-core ( in the .pom file > ). > The source code ( in branch-0.21 ) refers to hadoop-core-0.21 in > ivy/libaries.properties but pom.xml published in the repository refers to > 0.22 . Please fix the same by republishing a .pom again. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Created: (MAPREDUCE-1352) 0.21.0 - snapshot incorrect dependency published in .pom files
0.21.0 - snapshot incorrect dependency published in .pom files --- Key: MAPREDUCE-1352 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1352 Project: Hadoop Map/Reduce Issue Type: Task Affects Versions: 0.21.0 Reporter: Kay Kay Fix For: 0.21.0 The snapshot available here at - https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-mapred/0.21.0-SNAPSHOT/ , has an incorrect dependency specified for hadoop-core ( in the .pom file ). The source code ( in branch-0.21 ) refers to hadoop-core-0.21 in ivy/libaries.properties but pom.xml published in the repository refers to 0.22 . Please fix the same by republishing a .pom again. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1334) contrib/index - test - TestIndexUpdater fails due to an additional presence of file _SUCCESS in hdfs
[ https://issues.apache.org/jira/browse/MAPREDUCE-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1334: --- Priority: Critical (was: Major) > contrib/index - test - TestIndexUpdater fails due to an additional presence > of file _SUCCESS in hdfs > - > > Key: MAPREDUCE-1334 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1334 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: contrib/index >Reporter: Kay Kay >Priority: Critical > Fix For: 0.21.0 > > Attachments: MAPREDUCE-1334.patch > > > $ cd src/contrib/index > $ ant clean test > This fails the test TestIndexUpdater due to a mismatch in the - doneFileNames > - data structure, when it is being run with different parameters. > (ArrayIndexOutOfBoundsException raised when inserting elements in > doneFileNames, array ). > Debugging further - there seems to be an additional file called as - > hdfs://localhost:36021/myoutput/_SUCCESS , taken into consideration in > addition to those that begins with done* . The presence of the extra file > causes the error. > Attaching a patch that would circumvent this by increasing the array length > of shards by 1 . > But longer term the test fixtures need to be probably revisited to see if the > presence of _SUCCESS as a file is a good thing to begin with before we even > get to this test case. > Any comments / suggestions on the same welcome. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1334) contrib/index - test - TestIndexUpdater fails due to an additional presence of file _SUCCESS in hdfs
[ https://issues.apache.org/jira/browse/MAPREDUCE-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1334: --- Component/s: (was: test) contrib/index > contrib/index - test - TestIndexUpdater fails due to an additional presence > of file _SUCCESS in hdfs > - > > Key: MAPREDUCE-1334 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1334 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: contrib/index >Reporter: Kay Kay > Fix For: 0.21.0 > > Attachments: MAPREDUCE-1334.patch > > > $ cd src/contrib/index > $ ant clean test > This fails the test TestIndexUpdater due to a mismatch in the - doneFileNames > - data structure, when it is being run with different parameters. > (ArrayIndexOutOfBoundsException raised when inserting elements in > doneFileNames, array ). > Debugging further - there seems to be an additional file called as - > hdfs://localhost:36021/myoutput/_SUCCESS , taken into consideration in > addition to those that begins with done* . The presence of the extra file > causes the error. > Attaching a patch that would circumvent this by increasing the array length > of shards by 1 . > But longer term the test fixtures need to be probably revisited to see if the > presence of _SUCCESS as a file is a good thing to begin with before we even > get to this test case. > Any comments / suggestions on the same welcome. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1328) contrib/index - modify build / ivy files as appropriate
[ https://issues.apache.org/jira/browse/MAPREDUCE-1328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1328: --- Component/s: contrib/index > contrib/index - modify build / ivy files as appropriate > - > > Key: MAPREDUCE-1328 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1328 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: contrib/index >Affects Versions: 0.20.2 >Reporter: Kay Kay > Fix For: 0.20.2 > > Attachments: MAPREDUCE-1328.patch > > > The build / ivy.xml files in its current state does not seem to launch > successfully due to missing dependencies. > Added dependency on : hadoop-core-test / hadoop-hdfs-test . > Also the junit classpath is set to include the files retrieved by ivy , > specific to the index project. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1337) Generify StreamJob for better readability
[ https://issues.apache.org/jira/browse/MAPREDUCE-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1337: --- Attachment: MAPREDUCE-1337.patch for ( T t : tlist) changes incorporated along with generics > Generify StreamJob for better readability > - > > Key: MAPREDUCE-1337 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1337 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 0.22.0 >Reporter: Kay Kay > Fix For: 0.22.0 > > Attachments: MAPREDUCE-1337.patch, MAPREDUCE-1337.patch > > > Generify some of the members of StreamJob for better readability. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1346) TestStreamingExitStatus / TestStreamingKeyValue - correct text fixtures in place
[ https://issues.apache.org/jira/browse/MAPREDUCE-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12795690#action_12795690 ] Kay Kay commented on MAPREDUCE-1346: Leaving this open to revisit text fixtures of contrib/streaming after MAPREDUCE-1155 is committed. > TestStreamingExitStatus / TestStreamingKeyValue - correct text fixtures in > place > - > > Key: MAPREDUCE-1346 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1346 > Project: Hadoop Map/Reduce > Issue Type: Bug >Affects Versions: 0.20.2 >Reporter: Kay Kay > Fix For: 0.20.2 > > Attachments: MAPREDUCE-1346.patch > > > TestStreamingExitStatus does not have the correct text fixtures , of deleting > the input / output files after the last test run. > Cleanup methods as part of setUp refactored to tearDown to accomplish that. > Because of incorrect text fixtures - subsequent test cases fail. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Created: (MAPREDUCE-1349) Create jira component - contrib/index
Create jira component - contrib/index -- Key: MAPREDUCE-1349 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1349 Project: Hadoop Map/Reduce Issue Type: Task Reporter: Kay Kay Can we have a component - contrib/index for issues related to contrib/index (in jira ) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1155) Streaming tests swallow exceptions
[ https://issues.apache.org/jira/browse/MAPREDUCE-1155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12795452#action_12795452 ] Kay Kay commented on MAPREDUCE-1155: I am willing to take the bait as I have a definite vested interest in contrib/streaming and contrib/index and I can whip up some stuff after you commit. Thanks for the help. > Streaming tests swallow exceptions > -- > > Key: MAPREDUCE-1155 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1155 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: contrib/streaming >Affects Versions: 0.20.1, 0.21.0, 0.22.0 >Reporter: Todd Lipcon >Assignee: Todd Lipcon >Priority: Minor > Attachments: mapreduce-1155.patch, mapreduce-1155.patch, > mapreduce-1155.txt, mapreduce-1155.txt > > > Many of the streaming tests (including TestMultipleArchiveFiles) catch > exceptions and print their stack trace rather than failing the job. This > means that tests do not fail even when the job fails. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1155) Streaming tests swallow exceptions
[
https://issues.apache.org/jira/browse/MAPREDUCE-1155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12795424#action_12795424
]
Kay Kay commented on MAPREDUCE-1155:
{quote}
Yes, I elected to do the cleanup in the setup method as a bandaid - I couldn't
figure out which tests were leaving junk lying around, so I did the recursive
delete at the start. I also sometimes find this technique to be handy since the
developer can investigate the state of the test directory after the test has
failed. If there's a tearDown method, the state that contained the failure is
gone by the time the developer sees that the test failed.
{quote}
I would vote for a failure of tearDown method by a given test case , so when I
see a batch of test failures , after a tearDown failure - I can make a
reasonable assumption that there is only 1 base issue that we are concerned
about , and the rest may be bogus. Case in point: I was trying to
TestStreamingExitStatus / TestStreamingKeyValue test cases. The former did not
have a proper cleanup , while the latter failed because of the same. It took me
quite a lot of time before concluding that the latter does not have any issue
by itself except for incorrect test fixture assumptions.
But as I said - this is something that can be taken up in a separate bug - but
given that this patch seems to make the build green and address the primary
issue of swallowing exceptions I would say - go ahead and commit this while we
discuss the fixtures in a separate bug altogether.
> Streaming tests swallow exceptions
> --
>
> Key: MAPREDUCE-1155
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1155
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/streaming
>Affects Versions: 0.20.1, 0.21.0, 0.22.0
>Reporter: Todd Lipcon
>Assignee: Todd Lipcon
>Priority: Minor
> Attachments: mapreduce-1155.patch, mapreduce-1155.patch,
> mapreduce-1155.txt, mapreduce-1155.txt
>
>
> Many of the streaming tests (including TestMultipleArchiveFiles) catch
> exceptions and print their stack trace rather than failing the job. This
> means that tests do not fail even when the job fails.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1155) Streaming tests swallow exceptions
[ https://issues.apache.org/jira/browse/MAPREDUCE-1155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12795413#action_12795413 ] Kay Kay commented on MAPREDUCE-1155: Quick look at a test case( TestStreamingExitStatus ) means it is doing the cleanup in the setUp() method to make sure things are ok ( like deleting directories etc.) . There is a missing tearDown() method that needs to handle the unwinding of the changes, and setUp() would probably just assert its assumptions before starting afresh. Also this patch seems to address more than one issue at hand. If this makes the build green - can we place have it committed on the trunk now and revisit piecemeal, since the trunk build has been broken for quite some time. > Streaming tests swallow exceptions > -- > > Key: MAPREDUCE-1155 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1155 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: contrib/streaming >Affects Versions: 0.20.1, 0.21.0, 0.22.0 >Reporter: Todd Lipcon >Assignee: Todd Lipcon >Priority: Minor > Attachments: mapreduce-1155.patch, mapreduce-1155.patch, > mapreduce-1155.txt, mapreduce-1155.txt > > > Many of the streaming tests (including TestMultipleArchiveFiles) catch > exceptions and print their stack trace rather than failing the job. This > means that tests do not fail even when the job fails. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1346) TestStreamingExitStatus / TestStreamingKeyValue - correct text fixtures in place
[ https://issues.apache.org/jira/browse/MAPREDUCE-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12795404#action_12795404 ] Kay Kay commented on MAPREDUCE-1346: Thanks Todd. Then - I believe this can be closed as duplicate? > TestStreamingExitStatus / TestStreamingKeyValue - correct text fixtures in > place > - > > Key: MAPREDUCE-1346 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1346 > Project: Hadoop Map/Reduce > Issue Type: Bug >Affects Versions: 0.20.2 >Reporter: Kay Kay > Fix For: 0.20.2 > > Attachments: MAPREDUCE-1346.patch > > > TestStreamingExitStatus does not have the correct text fixtures , of deleting > the input / output files after the last test run. > Cleanup methods as part of setUp refactored to tearDown to accomplish that. > Because of incorrect text fixtures - subsequent test cases fail. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1346) TestStreamingExitStatus / TestStreamingKeyValue - correct text fixtures in place
[ https://issues.apache.org/jira/browse/MAPREDUCE-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1346: --- Description: TestStreamingExitStatus does not have the correct text fixtures , of deleting the input / output files after the last test run. Cleanup methods as part of setUp refactored to tearDown to accomplish that. Because of incorrect text fixtures - subsequent test cases fail. was: TestStreamingExitStatus does not have the correct text fixtures , of deleting the input / output files after the last test run. Cleanup methods as part of setUp refactored to tearDown to accomplish that. > TestStreamingExitStatus / TestStreamingKeyValue - correct text fixtures in > place > - > > Key: MAPREDUCE-1346 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1346 > Project: Hadoop Map/Reduce > Issue Type: Bug >Affects Versions: 0.20.2 >Reporter: Kay Kay > Fix For: 0.20.2 > > Attachments: MAPREDUCE-1346.patch > > > TestStreamingExitStatus does not have the correct text fixtures , of deleting > the input / output files after the last test run. > Cleanup methods as part of setUp refactored to tearDown to accomplish that. > Because of incorrect text fixtures - subsequent test cases fail. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1346) TestStreamingExitStatus / TestStreamingKeyValue - correct text fixtures in place
[ https://issues.apache.org/jira/browse/MAPREDUCE-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12795281#action_12795281 ] Kay Kay commented on MAPREDUCE-1346: Once successful - need to revisit the test fixtures of Streaming to make sure the cleanup happens appropriately in their respective tearDown() and not as a stop-gap measure in setUp() methods. > TestStreamingExitStatus / TestStreamingKeyValue - correct text fixtures in > place > - > > Key: MAPREDUCE-1346 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1346 > Project: Hadoop Map/Reduce > Issue Type: Bug >Affects Versions: 0.20.2 >Reporter: Kay Kay > Fix For: 0.20.2 > > Attachments: MAPREDUCE-1346.patch > > > TestStreamingExitStatus does not have the correct text fixtures , of deleting > the input / output files after the last test run. > Cleanup methods as part of setUp refactored to tearDown to accomplish that. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1346) TestStreamingExitStatus / TestStreamingKeyValue - correct text fixtures in place
[ https://issues.apache.org/jira/browse/MAPREDUCE-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1346: --- Fix Version/s: 0.20.2 Status: Patch Available (was: Open) > TestStreamingExitStatus / TestStreamingKeyValue - correct text fixtures in > place > - > > Key: MAPREDUCE-1346 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1346 > Project: Hadoop Map/Reduce > Issue Type: Bug >Affects Versions: 0.20.2 >Reporter: Kay Kay > Fix For: 0.20.2 > > Attachments: MAPREDUCE-1346.patch > > > TestStreamingExitStatus does not have the correct text fixtures , of deleting > the input / output files after the last test run. > Cleanup methods as part of setUp refactored to tearDown to accomplish that. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Created: (MAPREDUCE-1346) TestStreamingExitStatus / TestStreamingKeyValue - correct text fixtures in place
TestStreamingExitStatus / TestStreamingKeyValue - correct text fixtures in place - Key: MAPREDUCE-1346 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1346 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 0.20.2 Reporter: Kay Kay Attachments: MAPREDUCE-1346.patch TestStreamingExitStatus does not have the correct text fixtures , of deleting the input / output files after the last test run. Cleanup methods as part of setUp refactored to tearDown to accomplish that. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1346) TestStreamingExitStatus / TestStreamingKeyValue - correct text fixtures in place
[ https://issues.apache.org/jira/browse/MAPREDUCE-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1346: --- Attachment: MAPREDUCE-1346.patch Fixtures in TestStreamingExitStatus properly refactored. > TestStreamingExitStatus / TestStreamingKeyValue - correct text fixtures in > place > - > > Key: MAPREDUCE-1346 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1346 > Project: Hadoop Map/Reduce > Issue Type: Bug >Affects Versions: 0.20.2 >Reporter: Kay Kay > Attachments: MAPREDUCE-1346.patch > > > TestStreamingExitStatus does not have the correct text fixtures , of deleting > the input / output files after the last test run. > Cleanup methods as part of setUp refactored to tearDown to accomplish that. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1343) Scope Change - FileOutputCommitter # SUCCESSFUL_JOB_OUTPUT_DIR_MARKER, package default to public
[
https://issues.apache.org/jira/browse/MAPREDUCE-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12795243#action_12795243
]
Kay Kay commented on MAPREDUCE-1343:
I happened to file this bug - since one of the test cases failed (
MAPREDUCE-1334 ) due to the auto-generation of _SUCCESS . While I had
submitted a patch for that , by explicitly setting the configuration property -
mapreduce.fileoutputcommitter.marksuccessfuljobs to be false- I don't think it
is a great idea for the rest of the system to exactly know the property string
name.
If package-protected has to be maintained - then may be we can add another
setter method along the lines of -
private void setMarkOutputDir(JobConf conf, boolean flag) {
conf.setBoolean(SUCCESSFUL_JOB_OUTPUT_DIR_MARKER, flag);
}
and other piece of code can use this, until we make a decision.
> Scope Change - FileOutputCommitter # SUCCESSFUL_JOB_OUTPUT_DIR_MARKER,
> package default to public
> -
>
> Key: MAPREDUCE-1343
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1343
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
>Reporter: Kay Kay
> Fix For: 0.21.0
>
> Attachments: MAPREDUCE-1343.patch
>
>
> Being a configuration property - it should be public static for apps to set
> /reset the property as opposed to hardcoding the string.
> Scope changed from package default to public.
> Also - enhanced with javadocs around the same.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1334) contrib/index - test - TestIndexUpdater fails due to an additional presence of file _SUCCESS in hdfs
[ https://issues.apache.org/jira/browse/MAPREDUCE-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1334: --- Attachment: (was: MAPREDUCE-1334.patch) > contrib/index - test - TestIndexUpdater fails due to an additional presence > of file _SUCCESS in hdfs > - > > Key: MAPREDUCE-1334 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1334 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: test >Reporter: Kay Kay > Fix For: 0.21.0 > > Attachments: MAPREDUCE-1334.patch > > > $ cd src/contrib/index > $ ant clean test > This fails the test TestIndexUpdater due to a mismatch in the - doneFileNames > - data structure, when it is being run with different parameters. > (ArrayIndexOutOfBoundsException raised when inserting elements in > doneFileNames, array ). > Debugging further - there seems to be an additional file called as - > hdfs://localhost:36021/myoutput/_SUCCESS , taken into consideration in > addition to those that begins with done* . The presence of the extra file > causes the error. > Attaching a patch that would circumvent this by increasing the array length > of shards by 1 . > But longer term the test fixtures need to be probably revisited to see if the > presence of _SUCCESS as a file is a good thing to begin with before we even > get to this test case. > Any comments / suggestions on the same welcome. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1343) Scope Change - FileOutputCommitter # SUCCESSFUL_JOB_OUTPUT_DIR_MARKER, package default to public
[ https://issues.apache.org/jira/browse/MAPREDUCE-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1343: --- Fix Version/s: 0.21.0 Summary: Scope Change - FileOutputCommitter # SUCCESSFUL_JOB_OUTPUT_DIR_MARKER, package default to public (was: Scope Change - FileOutputCommitter # SUCCESSFUL_JOB_OUTPUT_DIR_MARKER) > Scope Change - FileOutputCommitter # SUCCESSFUL_JOB_OUTPUT_DIR_MARKER, > package default to public > - > > Key: MAPREDUCE-1343 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1343 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Reporter: Kay Kay > Fix For: 0.21.0 > > Attachments: MAPREDUCE-1343.patch > > > Being a configuration property - it should be public static for apps to set > /reset the property as opposed to hardcoding the string. > Scope changed from package default to public. > Also - enhanced with javadocs around the same. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Created: (MAPREDUCE-1343) Scope Change - FileOutputCommitter # SUCCESSFUL_JOB_OUTPUT_DIR_MARKER
Scope Change - FileOutputCommitter # SUCCESSFUL_JOB_OUTPUT_DIR_MARKER - Key: MAPREDUCE-1343 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1343 Project: Hadoop Map/Reduce Issue Type: Improvement Reporter: Kay Kay Attachments: MAPREDUCE-1343.patch Being a configuration property - it should be public static for apps to set /reset the property as opposed to hardcoding the string. Scope changed from package default to public. Also - enhanced with javadocs around the same. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1343) Scope Change - FileOutputCommitter # SUCCESSFUL_JOB_OUTPUT_DIR_MARKER
[ https://issues.apache.org/jira/browse/MAPREDUCE-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1343: --- Attachment: MAPREDUCE-1343.patch > Scope Change - FileOutputCommitter # SUCCESSFUL_JOB_OUTPUT_DIR_MARKER > - > > Key: MAPREDUCE-1343 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1343 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Reporter: Kay Kay > Attachments: MAPREDUCE-1343.patch > > > Being a configuration property - it should be public static for apps to set > /reset the property as opposed to hardcoding the string. > Scope changed from package default to public. > Also - enhanced with javadocs around the same. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1343) Scope Change - FileOutputCommitter # SUCCESSFUL_JOB_OUTPUT_DIR_MARKER
[ https://issues.apache.org/jira/browse/MAPREDUCE-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1343: --- Status: Patch Available (was: Open) > Scope Change - FileOutputCommitter # SUCCESSFUL_JOB_OUTPUT_DIR_MARKER > - > > Key: MAPREDUCE-1343 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1343 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Reporter: Kay Kay > Attachments: MAPREDUCE-1343.patch > > > Being a configuration property - it should be public static for apps to set > /reset the property as opposed to hardcoding the string. > Scope changed from package default to public. > Also - enhanced with javadocs around the same. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1328) contrib/index - modify build / ivy files as appropriate
[ https://issues.apache.org/jira/browse/MAPREDUCE-1328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1328: --- Attachment: (was: MAPREDUCE-1334.patch) > contrib/index - modify build / ivy files as appropriate > - > > Key: MAPREDUCE-1328 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1328 > Project: Hadoop Map/Reduce > Issue Type: Bug >Affects Versions: 0.20.2 >Reporter: Kay Kay > Fix For: 0.20.2 > > Attachments: MAPREDUCE-1328.patch > > > The build / ivy.xml files in its current state does not seem to launch > successfully due to missing dependencies. > Added dependency on : hadoop-core-test / hadoop-hdfs-test . > Also the junit classpath is set to include the files retrieved by ivy , > specific to the index project. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1334) contrib/index - test - TestIndexUpdater fails due to an additional presence of file _SUCCESS in hdfs
[ https://issues.apache.org/jira/browse/MAPREDUCE-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1334: --- Attachment: MAPREDUCE-1334.patch Set the configuration parameter to not create _SUCCESS on the completion of the job. > contrib/index - test - TestIndexUpdater fails due to an additional presence > of file _SUCCESS in hdfs > - > > Key: MAPREDUCE-1334 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1334 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: test >Reporter: Kay Kay > Fix For: 0.21.0 > > Attachments: MAPREDUCE-1334.patch, MAPREDUCE-1334.patch > > > $ cd src/contrib/index > $ ant clean test > This fails the test TestIndexUpdater due to a mismatch in the - doneFileNames > - data structure, when it is being run with different parameters. > (ArrayIndexOutOfBoundsException raised when inserting elements in > doneFileNames, array ). > Debugging further - there seems to be an additional file called as - > hdfs://localhost:36021/myoutput/_SUCCESS , taken into consideration in > addition to those that begins with done* . The presence of the extra file > causes the error. > Attaching a patch that would circumvent this by increasing the array length > of shards by 1 . > But longer term the test fixtures need to be probably revisited to see if the > presence of _SUCCESS as a file is a good thing to begin with before we even > get to this test case. > Any comments / suggestions on the same welcome. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1328) contrib/index - modify build / ivy files as appropriate
[ https://issues.apache.org/jira/browse/MAPREDUCE-1328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1328: --- Attachment: MAPREDUCE-1334.patch Set the configuration parameter to be false, to create _SUCCESS file. > contrib/index - modify build / ivy files as appropriate > - > > Key: MAPREDUCE-1328 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1328 > Project: Hadoop Map/Reduce > Issue Type: Bug >Affects Versions: 0.20.2 >Reporter: Kay Kay > Fix For: 0.20.2 > > Attachments: MAPREDUCE-1328.patch, MAPREDUCE-1334.patch > > > The build / ivy.xml files in its current state does not seem to launch > successfully due to missing dependencies. > Added dependency on : hadoop-core-test / hadoop-hdfs-test . > Also the junit classpath is set to include the files retrieved by ivy , > specific to the index project. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1334) contrib/index - test - TestIndexUpdater fails due to an additional presence of file _SUCCESS in hdfs
[ https://issues.apache.org/jira/browse/MAPREDUCE-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12795105#action_12795105 ] Kay Kay commented on MAPREDUCE-1334: This bug ( due to the presence of an extra file , _SUCCESS ) seems to be an artifact of MAPREDUCE-947 . May be - trying with FileOutputCommitter.SUCCESSFUL_JOB_OUTPUT_DIR_MARKER to false in Configuration might help. > contrib/index - test - TestIndexUpdater fails due to an additional presence > of file _SUCCESS in hdfs > - > > Key: MAPREDUCE-1334 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1334 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: test >Reporter: Kay Kay > Fix For: 0.21.0 > > Attachments: MAPREDUCE-1334.patch > > > $ cd src/contrib/index > $ ant clean test > This fails the test TestIndexUpdater due to a mismatch in the - doneFileNames > - data structure, when it is being run with different parameters. > (ArrayIndexOutOfBoundsException raised when inserting elements in > doneFileNames, array ). > Debugging further - there seems to be an additional file called as - > hdfs://localhost:36021/myoutput/_SUCCESS , taken into consideration in > addition to those that begins with done* . The presence of the extra file > causes the error. > Attaching a patch that would circumvent this by increasing the array length > of shards by 1 . > But longer term the test fixtures need to be probably revisited to see if the > presence of _SUCCESS as a file is a good thing to begin with before we even > get to this test case. > Any comments / suggestions on the same welcome. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Created: (MAPREDUCE-1337) Generify StreamJob for better readability
Generify StreamJob for better readability - Key: MAPREDUCE-1337 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1337 Project: Hadoop Map/Reduce Issue Type: Improvement Affects Versions: 0.20.2 Reporter: Kay Kay Attachments: MAPREDUCE-1337.patch Generify some of the members of StreamJob for better readability. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1337) Generify StreamJob for better readability
[ https://issues.apache.org/jira/browse/MAPREDUCE-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1337: --- Fix Version/s: 0.20.2 Status: Patch Available (was: Open) > Generify StreamJob for better readability > - > > Key: MAPREDUCE-1337 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1337 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 0.20.2 >Reporter: Kay Kay > Fix For: 0.20.2 > > Attachments: MAPREDUCE-1337.patch > > > Generify some of the members of StreamJob for better readability. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1337) Generify StreamJob for better readability
[ https://issues.apache.org/jira/browse/MAPREDUCE-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1337: --- Attachment: MAPREDUCE-1337.patch > Generify StreamJob for better readability > - > > Key: MAPREDUCE-1337 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1337 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 0.20.2 >Reporter: Kay Kay > Fix For: 0.20.2 > > Attachments: MAPREDUCE-1337.patch > > > Generify some of the members of StreamJob for better readability. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Created: (MAPREDUCE-1336) TestStreamingExitStatus - Fix deprecated use of StreamJob submission API
TestStreamingExitStatus - Fix deprecated use of StreamJob submission API Key: MAPREDUCE-1336 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1336 Project: Hadoop Map/Reduce Issue Type: Test Reporter: Kay Kay Attachments: MAPREDUCE-1336.patch Fix deprecated API in StreamJob and executing the same. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1336) TestStreamingExitStatus - Fix deprecated use of StreamJob submission API
[ https://issues.apache.org/jira/browse/MAPREDUCE-1336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1336: --- Attachment: MAPREDUCE-1336.patch > TestStreamingExitStatus - Fix deprecated use of StreamJob submission API > > > Key: MAPREDUCE-1336 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1336 > Project: Hadoop Map/Reduce > Issue Type: Test >Reporter: Kay Kay > Fix For: 0.20.2 > > Attachments: MAPREDUCE-1336.patch > > > Fix deprecated API in StreamJob and executing the same. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1336) TestStreamingExitStatus - Fix deprecated use of StreamJob submission API
[ https://issues.apache.org/jira/browse/MAPREDUCE-1336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1336: --- Fix Version/s: 0.20.2 Status: Patch Available (was: Open) > TestStreamingExitStatus - Fix deprecated use of StreamJob submission API > > > Key: MAPREDUCE-1336 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1336 > Project: Hadoop Map/Reduce > Issue Type: Test >Reporter: Kay Kay > Fix For: 0.20.2 > > Attachments: MAPREDUCE-1336.patch > > > Fix deprecated API in StreamJob and executing the same. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1334) contrib/index - test - TestIndexUpdater fails due to an additional presence of file _SUCCESS in hdfs
[ https://issues.apache.org/jira/browse/MAPREDUCE-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12794553#action_12794553 ] Kay Kay commented on MAPREDUCE-1334: This depends on MAPREDUCE-1328 (build/ivy.xml patch ) to run successfully . > contrib/index - test - TestIndexUpdater fails due to an additional presence > of file _SUCCESS in hdfs > - > > Key: MAPREDUCE-1334 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1334 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: test >Reporter: Kay Kay > Fix For: 0.21.0 > > Attachments: MAPREDUCE-1334.patch > > > $ cd src/contrib/index > $ ant clean test > This fails the test TestIndexUpdater due to a mismatch in the - doneFileNames > - data structure, when it is being run with different parameters. > (ArrayIndexOutOfBoundsException raised when inserting elements in > doneFileNames, array ). > Debugging further - there seems to be an additional file called as - > hdfs://localhost:36021/myoutput/_SUCCESS , taken into consideration in > addition to those that begins with done* . The presence of the extra file > causes the error. > Attaching a patch that would circumvent this by increasing the array length > of shards by 1 . > But longer term the test fixtures need to be probably revisited to see if the > presence of _SUCCESS as a file is a good thing to begin with before we even > get to this test case. > Any comments / suggestions on the same welcome. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1334) contrib/index - test - TestIndexUpdater fails due to an additional presence of file _SUCCESS in hdfs
[ https://issues.apache.org/jira/browse/MAPREDUCE-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1334: --- Attachment: MAPREDUCE-1334.patch TestIndexUpdater changed to make the test case pass ( Array Index Error due to the presence of a file called as _SUCCESS ). (hdfs://localhost:36021/myoutput/_SUCCESS) . Longer term - need to revisit test fixtures before we get here. > contrib/index - test - TestIndexUpdater fails due to an additional presence > of file _SUCCESS in hdfs > - > > Key: MAPREDUCE-1334 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1334 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: test >Reporter: Kay Kay > Fix For: 0.21.0 > > Attachments: MAPREDUCE-1334.patch > > > $ cd src/contrib/index > $ ant clean test > This fails the test TestIndexUpdater due to a mismatch in the - doneFileNames > - data structure, when it is being run with different parameters. > (ArrayIndexOutOfBoundsException raised when inserting elements in > doneFileNames, array ). > Debugging further - there seems to be an additional file called as - > hdfs://localhost:36021/myoutput/_SUCCESS , taken into consideration in > addition to those that begins with done* . The presence of the extra file > causes the error. > Attaching a patch that would circumvent this by increasing the array length > of shards by 1 . > But longer term the test fixtures need to be probably revisited to see if the > presence of _SUCCESS as a file is a good thing to begin with before we even > get to this test case. > Any comments / suggestions on the same welcome. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1334) contrib/index - test - TestIndexUpdater fails due to an additional presence of file _SUCCESS in hdfs
[ https://issues.apache.org/jira/browse/MAPREDUCE-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1334: --- Status: Patch Available (was: Open) > contrib/index - test - TestIndexUpdater fails due to an additional presence > of file _SUCCESS in hdfs > - > > Key: MAPREDUCE-1334 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1334 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: test >Reporter: Kay Kay > Fix For: 0.21.0 > > Attachments: MAPREDUCE-1334.patch > > > $ cd src/contrib/index > $ ant clean test > This fails the test TestIndexUpdater due to a mismatch in the - doneFileNames > - data structure, when it is being run with different parameters. > (ArrayIndexOutOfBoundsException raised when inserting elements in > doneFileNames, array ). > Debugging further - there seems to be an additional file called as - > hdfs://localhost:36021/myoutput/_SUCCESS , taken into consideration in > addition to those that begins with done* . The presence of the extra file > causes the error. > Attaching a patch that would circumvent this by increasing the array length > of shards by 1 . > But longer term the test fixtures need to be probably revisited to see if the > presence of _SUCCESS as a file is a good thing to begin with before we even > get to this test case. > Any comments / suggestions on the same welcome. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Created: (MAPREDUCE-1334) contrib/index - test - TestIndexUpdater fails due to an additional presence of file _SUCCESS in hdfs
contrib/index - test - TestIndexUpdater fails due to an additional presence of file _SUCCESS in hdfs - Key: MAPREDUCE-1334 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1334 Project: Hadoop Map/Reduce Issue Type: Bug Components: test Reporter: Kay Kay Fix For: 0.21.0 $ cd src/contrib/index $ ant clean test This fails the test TestIndexUpdater due to a mismatch in the - doneFileNames - data structure, when it is being run with different parameters. (ArrayIndexOutOfBoundsException raised when inserting elements in doneFileNames, array ). Debugging further - there seems to be an additional file called as - hdfs://localhost:36021/myoutput/_SUCCESS , taken into consideration in addition to those that begins with done* . The presence of the extra file causes the error. Attaching a patch that would circumvent this by increasing the array length of shards by 1 . But longer term the test fixtures need to be probably revisited to see if the presence of _SUCCESS as a file is a good thing to begin with before we even get to this test case. Any comments / suggestions on the same welcome. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1328) contrib/index - modify build / ivy files as appropriate
[ https://issues.apache.org/jira/browse/MAPREDUCE-1328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1328: --- Issue Type: Bug (was: Improvement) > contrib/index - modify build / ivy files as appropriate > - > > Key: MAPREDUCE-1328 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1328 > Project: Hadoop Map/Reduce > Issue Type: Bug >Affects Versions: 0.20.2 >Reporter: Kay Kay > Fix For: 0.20.2 > > Attachments: MAPREDUCE-1328.patch > > > The build / ivy.xml files in its current state does not seem to launch > successfully due to missing dependencies. > Added dependency on : hadoop-core-test / hadoop-hdfs-test . > Also the junit classpath is set to include the files retrieved by ivy , > specific to the index project. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1328) contrib/index - modify build / ivy files as appropriate
[ https://issues.apache.org/jira/browse/MAPREDUCE-1328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1328: --- Status: In Progress (was: Patch Available) > contrib/index - modify build / ivy files as appropriate > - > > Key: MAPREDUCE-1328 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1328 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 0.20.2 >Reporter: Kay Kay > Fix For: 0.20.2 > > Attachments: MAPREDUCE-1328.patch > > > The build / ivy.xml files in its current state does not seem to launch > successfully due to missing dependencies. > Added dependency on : hadoop-core-test / hadoop-hdfs-test . > Also the junit classpath is set to include the files retrieved by ivy , > specific to the index project. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1320) StringBuffer -> StringBuilder occurence
[ https://issues.apache.org/jira/browse/MAPREDUCE-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1320: --- Status: In Progress (was: Patch Available) > StringBuffer -> StringBuilder occurence > > > Key: MAPREDUCE-1320 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1320 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 0.20.1 >Reporter: Kay Kay > Fix For: 0.20.2 > > Attachments: MAPREDUCE-1320.patch > > > A good number of toString() implementations use StringBuffer when the > reference clearly does not go out of scope of the method and no concurrency > is needed. Patch contains replacing those occurences from StringBuffer to > StringBuilder. > Created against map/reduce project trunk . -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1328) contrib/index - modify build / ivy files as appropriate
[ https://issues.apache.org/jira/browse/MAPREDUCE-1328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12793910#action_12793910 ] Kay Kay commented on MAPREDUCE-1328: Ok - The last known green build was on Dec 11 , # 171 . http://hudson.zones.apache.org/hudson/view/Hadoop/job/Hadoop-Mapreduce-trunk/ . The test failures have nothing to do with this. The trunk needs to be set to green accordingly before we can take more patches. > contrib/index - modify build / ivy files as appropriate > - > > Key: MAPREDUCE-1328 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1328 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 0.20.2 >Reporter: Kay Kay > Fix For: 0.20.2 > > Attachments: MAPREDUCE-1328.patch > > > The build / ivy.xml files in its current state does not seem to launch > successfully due to missing dependencies. > Added dependency on : hadoop-core-test / hadoop-hdfs-test . > Also the junit classpath is set to include the files retrieved by ivy , > specific to the index project. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1320) StringBuffer -> StringBuilder occurence
[ https://issues.apache.org/jira/browse/MAPREDUCE-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12793843#action_12793843 ] Kay Kay commented on MAPREDUCE-1320: On first pass - the test failures does not seem to be related to the patch but due to environmental issues , may be. Need to revisit this after we get a complete green build once on the trunk. > StringBuffer -> StringBuilder occurence > > > Key: MAPREDUCE-1320 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1320 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 0.20.1 >Reporter: Kay Kay > Fix For: 0.20.2 > > Attachments: MAPREDUCE-1320.patch > > > A good number of toString() implementations use StringBuffer when the > reference clearly does not go out of scope of the method and no concurrency > is needed. Patch contains replacing those occurences from StringBuffer to > StringBuilder. > Created against map/reduce project trunk . -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1328) contrib/index - modify build / ivy files as appropriate
[ https://issues.apache.org/jira/browse/MAPREDUCE-1328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1328: --- Fix Version/s: 0.20.2 Status: Patch Available (was: Open) > contrib/index - modify build / ivy files as appropriate > - > > Key: MAPREDUCE-1328 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1328 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 0.20.2 >Reporter: Kay Kay > Fix For: 0.20.2 > > Attachments: MAPREDUCE-1328.patch > > > The build / ivy.xml files in its current state does not seem to launch > successfully due to missing dependencies. > Added dependency on : hadoop-core-test / hadoop-hdfs-test . > Also the junit classpath is set to include the files retrieved by ivy , > specific to the index project. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1328) contrib/index - modify build / ivy files as appropriate
[ https://issues.apache.org/jira/browse/MAPREDUCE-1328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1328: --- Attachment: MAPREDUCE-1328.patch > contrib/index - modify build / ivy files as appropriate > - > > Key: MAPREDUCE-1328 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1328 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 0.20.2 >Reporter: Kay Kay > Attachments: MAPREDUCE-1328.patch > > > The build / ivy.xml files in its current state does not seem to launch > successfully due to missing dependencies. > Added dependency on : hadoop-core-test / hadoop-hdfs-test . > Also the junit classpath is set to include the files retrieved by ivy , > specific to the index project. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Created: (MAPREDUCE-1328) contrib/index - modify build / ivy files as appropriate
contrib/index - modify build / ivy files as appropriate - Key: MAPREDUCE-1328 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1328 Project: Hadoop Map/Reduce Issue Type: Improvement Affects Versions: 0.20.2 Reporter: Kay Kay The build / ivy.xml files in its current state does not seem to launch successfully due to missing dependencies. Added dependency on : hadoop-core-test / hadoop-hdfs-test . Also the junit classpath is set to include the files retrieved by ivy , specific to the index project. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1320) StringBuffer -> StringBuilder occurence
[ https://issues.apache.org/jira/browse/MAPREDUCE-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1320: --- Attachment: (was: MAPREDUCE-1320.patch) > StringBuffer -> StringBuilder occurence > > > Key: MAPREDUCE-1320 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1320 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 0.20.1 >Reporter: Kay Kay > Fix For: 0.20.2 > > Attachments: MAPREDUCE-1320.patch > > > A good number of toString() implementations use StringBuffer when the > reference clearly does not go out of scope of the method and no concurrency > is needed. Patch contains replacing those occurences from StringBuffer to > StringBuilder. > Created against map/reduce project trunk . -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1320) StringBuffer -> StringBuilder occurence
[ https://issues.apache.org/jira/browse/MAPREDUCE-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1320: --- Status: Patch Available (was: Open) > StringBuffer -> StringBuilder occurence > > > Key: MAPREDUCE-1320 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1320 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 0.20.1 >Reporter: Kay Kay > Fix For: 0.20.2 > > Attachments: MAPREDUCE-1320.patch > > > A good number of toString() implementations use StringBuffer when the > reference clearly does not go out of scope of the method and no concurrency > is needed. Patch contains replacing those occurences from StringBuffer to > StringBuilder. > Created against map/reduce project trunk . -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1320) StringBuffer -> StringBuilder occurence
[ https://issues.apache.org/jira/browse/MAPREDUCE-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1320: --- Affects Version/s: 0.20.1 Fix Version/s: (was: 0.21.0) 0.20.2 > StringBuffer -> StringBuilder occurence > > > Key: MAPREDUCE-1320 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1320 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 0.20.1 >Reporter: Kay Kay > Fix For: 0.20.2 > > Attachments: MAPREDUCE-1320.patch, MAPREDUCE-1320.patch > > > A good number of toString() implementations use StringBuffer when the > reference clearly does not go out of scope of the method and no concurrency > is needed. Patch contains replacing those occurences from StringBuffer to > StringBuilder. > Created against map/reduce project trunk . -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1320) StringBuffer -> StringBuilder occurence
[ https://issues.apache.org/jira/browse/MAPREDUCE-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1320: --- Attachment: MAPREDUCE-1320.patch > StringBuffer -> StringBuilder occurence > > > Key: MAPREDUCE-1320 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1320 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Reporter: Kay Kay > Fix For: 0.21.0 > > Attachments: MAPREDUCE-1320.patch, MAPREDUCE-1320.patch > > > A good number of toString() implementations use StringBuffer when the > reference clearly does not go out of scope of the method and no concurrency > is needed. Patch contains replacing those occurences from StringBuffer to > StringBuilder. > Created against map/reduce project trunk . -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1320) StringBuffer -> StringBuilder occurence
[ https://issues.apache.org/jira/browse/MAPREDUCE-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1320: --- Fix Version/s: 0.21.0 > StringBuffer -> StringBuilder occurence > > > Key: MAPREDUCE-1320 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1320 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Reporter: Kay Kay > Fix For: 0.21.0 > > Attachments: MAPREDUCE-1320.patch > > > A good number of toString() implementations use StringBuffer when the > reference clearly does not go out of scope of the method and no concurrency > is needed. Patch contains replacing those occurences from StringBuffer to > StringBuilder. > Created against map/reduce project trunk . -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1320) StringBuffer -> StringBuilder occurence
[ https://issues.apache.org/jira/browse/MAPREDUCE-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated MAPREDUCE-1320: --- Attachment: MAPREDUCE-1320.patch > StringBuffer -> StringBuilder occurence > > > Key: MAPREDUCE-1320 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1320 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Reporter: Kay Kay > Attachments: MAPREDUCE-1320.patch > > > A good number of toString() implementations use StringBuffer when the > reference clearly does not go out of scope of the method and no concurrency > is needed. Patch contains replacing those occurences from StringBuffer to > StringBuilder. > Created against map/reduce project trunk . -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Created: (MAPREDUCE-1320) StringBuffer -> StringBuilder occurence
StringBuffer -> StringBuilder occurence Key: MAPREDUCE-1320 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1320 Project: Hadoop Map/Reduce Issue Type: Improvement Reporter: Kay Kay Attachments: MAPREDUCE-1320.patch A good number of toString() implementations use StringBuffer when the reference clearly does not go out of scope of the method and no concurrency is needed. Patch contains replacing those occurences from StringBuffer to StringBuilder. Created against map/reduce project trunk . -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
