[jira] [Commented] (MAPREDUCE-4616) Improvement to MultipleOutputs javadocs
[ https://issues.apache.org/jira/browse/MAPREDUCE-4616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13474975#comment-13474975 ] Hudson commented on MAPREDUCE-4616: --- Integrated in Hadoop-Hdfs-trunk #1193 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1193/]) MAPREDUCE-4616. Improve javadoc for MultipleOutputs. Contributed by Tony Burton. (Revision 1397182) Result = SUCCESS acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1397182 Files : * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/lib/output/LazyOutputFormat.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/lib/output/MultipleOutputs.java Improvement to MultipleOutputs javadocs --- Key: MAPREDUCE-4616 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4616 Project: Hadoop Map/Reduce Issue Type: Improvement Components: documentation Affects Versions: 1.0.3 Reporter: Tony Burton Assignee: Tony Burton Priority: Minor Fix For: 2.0.3-alpha Attachments: MAPREDUCE-4616.patch, MAPREDUCE-4616.patch In the new API, and using MultipleOutputs it is possible to segment output into directories by using MultipleOutputs.write(KEYOUT key, VALUEOUT value, String baseOutputPath) in the Reducer to determine the output directory, and by using LazyOutputFormat at the job-level config to suppress normal output [eg use LazyOutputFormat.setOutputFormatClass(job, TextOutputFormat.class); instead of job.setOutputFormatClass(TextOutputFormat.class);] This recreates the functionality previously provided in the old API by using MultipleTextOutputFormat (etc) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4616) Improvement to MultipleOutputs javadocs
[ https://issues.apache.org/jira/browse/MAPREDUCE-4616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13475001#comment-13475001 ] Hudson commented on MAPREDUCE-4616: --- Integrated in Hadoop-Mapreduce-trunk #1224 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1224/]) MAPREDUCE-4616. Improve javadoc for MultipleOutputs. Contributed by Tony Burton. (Revision 1397182) Result = SUCCESS acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1397182 Files : * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/lib/output/LazyOutputFormat.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/lib/output/MultipleOutputs.java Improvement to MultipleOutputs javadocs --- Key: MAPREDUCE-4616 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4616 Project: Hadoop Map/Reduce Issue Type: Improvement Components: documentation Affects Versions: 1.0.3 Reporter: Tony Burton Assignee: Tony Burton Priority: Minor Fix For: 2.0.3-alpha Attachments: MAPREDUCE-4616.patch, MAPREDUCE-4616.patch In the new API, and using MultipleOutputs it is possible to segment output into directories by using MultipleOutputs.write(KEYOUT key, VALUEOUT value, String baseOutputPath) in the Reducer to determine the output directory, and by using LazyOutputFormat at the job-level config to suppress normal output [eg use LazyOutputFormat.setOutputFormatClass(job, TextOutputFormat.class); instead of job.setOutputFormatClass(TextOutputFormat.class);] This recreates the functionality previously provided in the old API by using MultipleTextOutputFormat (etc) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4616) Improvement to MultipleOutputs javadocs
[ https://issues.apache.org/jira/browse/MAPREDUCE-4616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13475100#comment-13475100 ] Harsh J commented on MAPREDUCE-4616: Thanks Arun! And sorry I missed this out after that review Tony, my apologies. Improvement to MultipleOutputs javadocs --- Key: MAPREDUCE-4616 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4616 Project: Hadoop Map/Reduce Issue Type: Improvement Components: documentation Affects Versions: 1.0.3 Reporter: Tony Burton Assignee: Tony Burton Priority: Minor Fix For: 2.0.3-alpha Attachments: MAPREDUCE-4616.patch, MAPREDUCE-4616.patch In the new API, and using MultipleOutputs it is possible to segment output into directories by using MultipleOutputs.write(KEYOUT key, VALUEOUT value, String baseOutputPath) in the Reducer to determine the output directory, and by using LazyOutputFormat at the job-level config to suppress normal output [eg use LazyOutputFormat.setOutputFormatClass(job, TextOutputFormat.class); instead of job.setOutputFormatClass(TextOutputFormat.class);] This recreates the functionality previously provided in the old API by using MultipleTextOutputFormat (etc) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4616) Improvement to MultipleOutputs javadocs
[ https://issues.apache.org/jira/browse/MAPREDUCE-4616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13474351#comment-13474351 ] Hudson commented on MAPREDUCE-4616: --- Integrated in Hadoop-Hdfs-trunk-Commit #2908 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2908/]) MAPREDUCE-4616. Improve javadoc for MultipleOutputs. Contributed by Tony Burton. (Revision 1397182) Result = SUCCESS acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1397182 Files : * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/lib/output/LazyOutputFormat.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/lib/output/MultipleOutputs.java Improvement to MultipleOutputs javadocs --- Key: MAPREDUCE-4616 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4616 Project: Hadoop Map/Reduce Issue Type: Improvement Components: documentation Affects Versions: 1.0.3 Reporter: Tony Burton Priority: Minor Fix For: 2.0.3-alpha Attachments: MAPREDUCE-4616.patch, MAPREDUCE-4616.patch In the new API, and using MultipleOutputs it is possible to segment output into directories by using MultipleOutputs.write(KEYOUT key, VALUEOUT value, String baseOutputPath) in the Reducer to determine the output directory, and by using LazyOutputFormat at the job-level config to suppress normal output [eg use LazyOutputFormat.setOutputFormatClass(job, TextOutputFormat.class); instead of job.setOutputFormatClass(TextOutputFormat.class);] This recreates the functionality previously provided in the old API by using MultipleTextOutputFormat (etc) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4616) Improvement to MultipleOutputs javadocs
[ https://issues.apache.org/jira/browse/MAPREDUCE-4616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13474353#comment-13474353 ] Hudson commented on MAPREDUCE-4616: --- Integrated in Hadoop-Common-trunk-Commit #2846 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2846/]) MAPREDUCE-4616. Improve javadoc for MultipleOutputs. Contributed by Tony Burton. (Revision 1397182) Result = SUCCESS acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1397182 Files : * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/lib/output/LazyOutputFormat.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/lib/output/MultipleOutputs.java Improvement to MultipleOutputs javadocs --- Key: MAPREDUCE-4616 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4616 Project: Hadoop Map/Reduce Issue Type: Improvement Components: documentation Affects Versions: 1.0.3 Reporter: Tony Burton Priority: Minor Fix For: 2.0.3-alpha Attachments: MAPREDUCE-4616.patch, MAPREDUCE-4616.patch In the new API, and using MultipleOutputs it is possible to segment output into directories by using MultipleOutputs.write(KEYOUT key, VALUEOUT value, String baseOutputPath) in the Reducer to determine the output directory, and by using LazyOutputFormat at the job-level config to suppress normal output [eg use LazyOutputFormat.setOutputFormatClass(job, TextOutputFormat.class); instead of job.setOutputFormatClass(TextOutputFormat.class);] This recreates the functionality previously provided in the old API by using MultipleTextOutputFormat (etc) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4616) Improvement to MultipleOutputs javadocs
[ https://issues.apache.org/jira/browse/MAPREDUCE-4616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13474403#comment-13474403 ] Hudson commented on MAPREDUCE-4616: --- Integrated in Hadoop-Mapreduce-trunk-Commit #2871 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2871/]) MAPREDUCE-4616. Improve javadoc for MultipleOutputs. Contributed by Tony Burton. (Revision 1397182) Result = FAILURE acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1397182 Files : * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/lib/output/LazyOutputFormat.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/lib/output/MultipleOutputs.java Improvement to MultipleOutputs javadocs --- Key: MAPREDUCE-4616 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4616 Project: Hadoop Map/Reduce Issue Type: Improvement Components: documentation Affects Versions: 1.0.3 Reporter: Tony Burton Priority: Minor Fix For: 2.0.3-alpha Attachments: MAPREDUCE-4616.patch, MAPREDUCE-4616.patch In the new API, and using MultipleOutputs it is possible to segment output into directories by using MultipleOutputs.write(KEYOUT key, VALUEOUT value, String baseOutputPath) in the Reducer to determine the output directory, and by using LazyOutputFormat at the job-level config to suppress normal output [eg use LazyOutputFormat.setOutputFormatClass(job, TextOutputFormat.class); instead of job.setOutputFormatClass(TextOutputFormat.class);] This recreates the functionality previously provided in the old API by using MultipleTextOutputFormat (etc) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4616) Improvement to MultipleOutputs javadocs
[ https://issues.apache.org/jira/browse/MAPREDUCE-4616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13459508#comment-13459508 ] Hadoop QA commented on MAPREDUCE-4616: -- +1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12545883/MAPREDUCE-4616.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +0 tests included. The patch appears to be a documentation patch that doesn't require tests. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 javadoc. The javadoc tool did not generate any warning messages. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core. +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2863//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2863//console This message is automatically generated. Improvement to MultipleOutputs javadocs --- Key: MAPREDUCE-4616 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4616 Project: Hadoop Map/Reduce Issue Type: Improvement Components: documentation Affects Versions: 1.0.3 Reporter: Tony Burton Priority: Minor Attachments: MAPREDUCE-4616.patch, MAPREDUCE-4616.patch In the new API, and using MultipleOutputs it is possible to segment output into directories by using MultipleOutputs.write(KEYOUT key, VALUEOUT value, String baseOutputPath) in the Reducer to determine the output directory, and by using LazyOutputFormat at the job-level config to suppress normal output [eg use LazyOutputFormat.setOutputFormatClass(job, TextOutputFormat.class); instead of job.setOutputFormatClass(TextOutputFormat.class);] This recreates the functionality previously provided in the old API by using MultipleTextOutputFormat (etc) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4616) Improvement to MultipleOutputs javadocs
[ https://issues.apache.org/jira/browse/MAPREDUCE-4616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13459025#comment-13459025 ] Harsh J commented on MAPREDUCE-4616: Thanks Tony. A few comments we may address before this gets committed (mostly nits and typos): - Use in conjuction - Useful when used in conjunction perhaps? - Use your own code in codegenerateFileName()/code. Your code sample references a generateFileName method but doesn't show an implementation. Perhaps add in a sample implementation that returns part, foo or whatever? - in your Hadoop job task-level setup. - Simpler to say in your Job configuration.? Improvement to MultipleOutputs javadocs --- Key: MAPREDUCE-4616 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4616 Project: Hadoop Map/Reduce Issue Type: Improvement Components: documentation Affects Versions: 1.0.3 Reporter: Tony Burton Priority: Minor Attachments: MAPREDUCE-4616.patch In the new API, and using MultipleOutputs it is possible to segment output into directories by using MultipleOutputs.write(KEYOUT key, VALUEOUT value, String baseOutputPath) in the Reducer to determine the output directory, and by using LazyOutputFormat at the job-level config to suppress normal output [eg use LazyOutputFormat.setOutputFormatClass(job, TextOutputFormat.class); instead of job.setOutputFormatClass(TextOutputFormat.class);] This recreates the functionality previously provided in the old API by using MultipleTextOutputFormat (etc) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4616) Improvement to MultipleOutputs javadocs
[ https://issues.apache.org/jira/browse/MAPREDUCE-4616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13453130#comment-13453130 ] Hadoop QA commented on MAPREDUCE-4616: -- +1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12544650/MAPREDUCE-4616.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +0 tests included. The patch appears to be a documentation patch that doesn't require tests. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 javadoc. The javadoc tool did not generate any warning messages. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core. +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2842//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2842//console This message is automatically generated. Improvement to MultipleOutputs javadocs --- Key: MAPREDUCE-4616 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4616 Project: Hadoop Map/Reduce Issue Type: Improvement Components: documentation Affects Versions: 1.0.3 Reporter: Tony Burton Priority: Minor Labels: hadoop, mapreduce Fix For: trunk Attachments: MAPREDUCE-4616.patch In the new API, and using MultipleOutputs it is possible to segment output into directories by using MultipleOutputs.write(KEYOUT key, VALUEOUT value, String baseOutputPath) in the Reducer to determine the output directory, and by using LazyOutputFormat at the job-level config to suppress normal output [eg use LazyOutputFormat.setOutputFormatClass(job, TextOutputFormat.class); instead of job.setOutputFormatClass(TextOutputFormat.class);] This recreates the functionality previously provided in the old API by using MultipleTextOutputFormat (etc) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4616) Improvement to MultipleOutputs javadocs
[ https://issues.apache.org/jira/browse/MAPREDUCE-4616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13445958#comment-13445958 ] Arun C Murthy commented on MAPREDUCE-4616: -- Thanks for catching this Tony. Do you mind providing a patch to fix this? Thanks! http://wiki.apache.org/hadoop/HowToContribute if you need details. Thanks again. Improvement to MultipleOutputs javadocs --- Key: MAPREDUCE-4616 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4616 Project: Hadoop Map/Reduce Issue Type: Improvement Components: documentation Affects Versions: 1.0.3 Reporter: Tony Burton Priority: Minor Labels: hadoop, mapreduce Fix For: trunk In the new API, and using MultipleOutputs it is possible to segment output into directories by using MultipleOutputs.write(KEYOUT key, VALUEOUT value, String baseOutputPath) in the Reducer to determine the output directory, and by using LazyOutputFormat at the job-level config to suppress normal output [eg use LazyOutputFormat.setOutputFormatClass(job, TextOutputFormat.class); instead of job.setOutputFormatClass(TextOutputFormat.class);] This recreates the functionality previously provided in the old API by using MultipleTextOutputFormat (etc) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
