[jira] Commented: (MAPREDUCE-1851) Document configuration parameters in streaming
[ https://issues.apache.org/jira/browse/MAPREDUCE-1851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12926104#action_12926104 ] Hudson commented on MAPREDUCE-1851: --- Integrated in Hadoop-Mapreduce-trunk-Commit #523 (See [https://hudson.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/523/]) Document configuration parameters in streaming -- Key: MAPREDUCE-1851 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1851 Project: Hadoop Map/Reduce Issue Type: Improvement Components: contrib/streaming, documentation Reporter: Amareshwari Sriramadasu Assignee: Amareshwari Sriramadasu Fix For: 0.22.0 Attachments: patch-1851-1.txt, patch-1851-2.txt, patch-1851.txt There are several streaming options such as stream.map.output.field.separator, stream.num.map.output.key.fields, stream.map.input.field.separator, stream.reduce.input.field.separator, stream.map.input.ignoreKey, stream.non.zero.exit.is.failure etc which are spread everywhere. These should be documented at single place with description and default-value. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1851) Document configuration parameters in streaming
[ https://issues.apache.org/jira/browse/MAPREDUCE-1851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12881563#action_12881563 ] Ravi Gummadi commented on MAPREDUCE-1851: - Latest patch looks good. +1 Document configuration parameters in streaming -- Key: MAPREDUCE-1851 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1851 Project: Hadoop Map/Reduce Issue Type: Improvement Components: contrib/streaming, documentation Reporter: Amareshwari Sriramadasu Assignee: Amareshwari Sriramadasu Fix For: 0.22.0 Attachments: patch-1851-1.txt, patch-1851-2.txt, patch-1851.txt There are several streaming options such as stream.map.output.field.separator, stream.num.map.output.key.fields, stream.map.input.field.separator, stream.reduce.input.field.separator, stream.map.input.ignoreKey, stream.non.zero.exit.is.failure etc which are spread everywhere. These should be documented at single place with description and default-value. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1851) Document configuration parameters in streaming
[ https://issues.apache.org/jira/browse/MAPREDUCE-1851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12881133#action_12881133 ] Ravi Gummadi commented on MAPREDUCE-1851: - The description of stream.joindelay.milli Timeout in milliseconds for error thread and output thread to die seems to be misleading if this is number of milli seconds for which the error thread and output thread are alive(time from start of thread to die). May be we should mention that this is the amount of time we wait for joining the error and output threads at the end of mapper/reducer ? Document configuration parameters in streaming -- Key: MAPREDUCE-1851 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1851 Project: Hadoop Map/Reduce Issue Type: Improvement Components: contrib/streaming, documentation Reporter: Amareshwari Sriramadasu Assignee: Amareshwari Sriramadasu Fix For: 0.22.0 Attachments: patch-1851-1.txt, patch-1851.txt There are several streaming options such as stream.map.output.field.separator, stream.num.map.output.key.fields, stream.map.input.field.separator, stream.reduce.input.field.separator, stream.map.input.ignoreKey, stream.non.zero.exit.is.failure etc which are spread everywhere. These should be documented at single place with description and default-value. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1851) Document configuration parameters in streaming
[ https://issues.apache.org/jira/browse/MAPREDUCE-1851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12879394#action_12879394 ] Hadoop QA commented on MAPREDUCE-1851: -- -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12447214/patch-1851-1.txt against trunk revision 955198. +1 @author. The patch does not contain any @author tags. +0 tests included. The patch appears to be a documentation patch that doesn't require tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed core unit tests. -1 contrib tests. The patch failed contrib unit tests. Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/248/testReport/ Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/248/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/248/artifact/trunk/build/test/checkstyle-errors.html Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/248/console This message is automatically generated. Document configuration parameters in streaming -- Key: MAPREDUCE-1851 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1851 Project: Hadoop Map/Reduce Issue Type: Improvement Components: contrib/streaming, documentation Reporter: Amareshwari Sriramadasu Assignee: Amareshwari Sriramadasu Fix For: 0.22.0 Attachments: patch-1851-1.txt, patch-1851.txt There are several streaming options such as stream.map.output.field.separator, stream.num.map.output.key.fields, stream.map.input.field.separator, stream.reduce.input.field.separator, stream.map.input.ignoreKey, stream.non.zero.exit.is.failure etc which are spread everywhere. These should be documented at single place with description and default-value. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1851) Document configuration parameters in streaming
[ https://issues.apache.org/jira/browse/MAPREDUCE-1851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12878530#action_12878530 ] Ravi Gummadi commented on MAPREDUCE-1851: - It seems stream.jobLog_ is not documented anywhere and seems to be not useful. We can remove it altogether, may be in a separate JIRA. So let us not document that here ? stream.addenvironment seems to be internal property and is not intended for hadoop streaming users. Let us not document it. We can add the config property stream.stderr.reporter.prefix with the default value reporter:. This would need changes to the questions/answers related to update status and update counter in FAQ ? Document configuration parameters in streaming -- Key: MAPREDUCE-1851 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1851 Project: Hadoop Map/Reduce Issue Type: Improvement Components: contrib/streaming, documentation Reporter: Amareshwari Sriramadasu Assignee: Amareshwari Sriramadasu Fix For: 0.22.0 Attachments: patch-1851.txt There are several streaming options such as stream.map.output.field.separator, stream.num.map.output.key.fields, stream.map.input.field.separator, stream.reduce.input.field.separator, stream.map.input.ignoreKey, stream.non.zero.exit.is.failure etc which are spread everywhere. These should be documented at single place with description and default-value. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1851) Document configuration parameters in streaming
[ https://issues.apache.org/jira/browse/MAPREDUCE-1851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12878537#action_12878537 ] Ravi Gummadi commented on MAPREDUCE-1851: - We could also specify for the 4 properties stream.map.input, stream.map.output, stream.reduce.input and stream.reduce.input that these will take the values given with -D only if -io identifier is not used. In other words, Should we say that -io identifier will replace these 4 properties with the identifier ? Document configuration parameters in streaming -- Key: MAPREDUCE-1851 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1851 Project: Hadoop Map/Reduce Issue Type: Improvement Components: contrib/streaming, documentation Reporter: Amareshwari Sriramadasu Assignee: Amareshwari Sriramadasu Fix For: 0.22.0 Attachments: patch-1851.txt There are several streaming options such as stream.map.output.field.separator, stream.num.map.output.key.fields, stream.map.input.field.separator, stream.reduce.input.field.separator, stream.map.input.ignoreKey, stream.non.zero.exit.is.failure etc which are spread everywhere. These should be documented at single place with description and default-value. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1851) Document configuration parameters in streaming
[ https://issues.apache.org/jira/browse/MAPREDUCE-1851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12877819#action_12877819 ] Hadoop QA commented on MAPREDUCE-1851: -- -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12446858/patch-1851.txt against trunk revision 953660. +1 @author. The patch does not contain any @author tags. +0 tests included. The patch appears to be a documentation patch that doesn't require tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed core unit tests. -1 contrib tests. The patch failed contrib unit tests. Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/235/testReport/ Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/235/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/235/artifact/trunk/build/test/checkstyle-errors.html Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/235/console This message is automatically generated. Document configuration parameters in streaming -- Key: MAPREDUCE-1851 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1851 Project: Hadoop Map/Reduce Issue Type: Improvement Components: contrib/streaming, documentation Reporter: Amareshwari Sriramadasu Assignee: Amareshwari Sriramadasu Fix For: 0.22.0 Attachments: patch-1851.txt There are several streaming options such as stream.map.output.field.separator, stream.num.map.output.key.fields, stream.map.input.field.separator, stream.reduce.input.field.separator, stream.map.input.ignoreKey, stream.non.zero.exit.is.failure etc which are spread everywhere. These should be documented at single place with description and default-value. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
