[jira] Commented: (MAPREDUCE-1827) [Herriot] Task Killing/Failing tests for a streaming job.
[
https://issues.apache.org/jira/browse/MAPREDUCE-1827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12893318#action_12893318
]
Konstantin Boudnik commented on MAPREDUCE-1827:
---
As has been discovered in y20 branch system tests should be explicitely
excluded from the compilation of contribs. E.g.
{noformat}
+ excludes=system/**/*.java
{noformat}
in the {{compile-test}} target.
[Herriot] Task Killing/Failing tests for a streaming job.
-
Key: MAPREDUCE-1827
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1827
Project: Hadoop Map/Reduce
Issue Type: Task
Components: test
Reporter: Vinay Kumar Thota
Assignee: Vinay Kumar Thota
Attachments: 1827-ydist-security.patch, 1827-ydist-security.patch,
MAPREDUCE-1827.patch
1. Set the sleep time for the tasks is 3 seconds and kill the task of
streaming job using SIGKILL. After that verify whether task is killed after
3 seconds or not and also verify whether job is succeeded or not.
2. Set the maximum attempts for the maps and reducers are one. make the task
to fail and verify whether task is failed or not.Also verify whether the job
is failed or not.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1827) [Herriot] Task Killing/Failing tests for a streaming job.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12891082#action_12891082 ] Balaji Rajagopalan commented on MAPREDUCE-1827: --- I see you are using toolrunner and you still need expexclude +1 [Herriot] Task Killing/Failing tests for a streaming job. - Key: MAPREDUCE-1827 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1827 Project: Hadoop Map/Reduce Issue Type: Task Components: test Reporter: Vinay Kumar Thota Assignee: Vinay Kumar Thota Attachments: 1827-ydist-security.patch, 1827-ydist-security.patch, MAPREDUCE-1827.patch 1. Set the sleep time for the tasks is 3 seconds and kill the task of streaming job using SIGKILL. After that verify whether task is killed after 3 seconds or not and also verify whether job is succeeded or not. 2. Set the maximum attempts for the maps and reducers are one. make the task to fail and verify whether task is failed or not.Also verify whether the job is failed or not. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1827) [Herriot] Task Killing/Failing tests for a streaming job.
[
https://issues.apache.org/jira/browse/MAPREDUCE-1827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12891081#action_12891081
]
Balaji Rajagopalan commented on MAPREDUCE-1827:
---
+String [] expExcludeList = {java.net.ConnectException,
+java.io.IOException};
+cluster = MRCluster.createCluster(conf);
+cluster.setExcludeExpList(expExcludeList);
You need to remove expecludelist since restart cluster is not part of this test
case.Otherwise looks good.
[Herriot] Task Killing/Failing tests for a streaming job.
-
Key: MAPREDUCE-1827
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1827
Project: Hadoop Map/Reduce
Issue Type: Task
Components: test
Reporter: Vinay Kumar Thota
Assignee: Vinay Kumar Thota
Attachments: 1827-ydist-security.patch, 1827-ydist-security.patch,
MAPREDUCE-1827.patch
1. Set the sleep time for the tasks is 3 seconds and kill the task of
streaming job using SIGKILL. After that verify whether task is killed after
3 seconds or not and also verify whether job is succeeded or not.
2. Set the maximum attempts for the maps and reducers are one. make the task
to fail and verify whether task is failed or not.Also verify whether the job
is failed or not.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1827) [Herriot] Task Killing/Failing tests for a streaming job.
[
https://issues.apache.org/jira/browse/MAPREDUCE-1827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12891330#action_12891330
]
Konstantin Boudnik commented on MAPREDUCE-1827:
---
Please use named constants for the parameters like these:
{noformat}
+String runtimeArgs [] = {
+-D, mapred.job.name=Numbers Sum,
+-D, mapred.map.tasks=1,
+-D, mapred.reduce.tasks=1,
+-D, mapred.map.max.attempts=1,
+-D, mapred.reduce.max.attempts=1};
{noformat}
Looks good otherwise.
[Herriot] Task Killing/Failing tests for a streaming job.
-
Key: MAPREDUCE-1827
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1827
Project: Hadoop Map/Reduce
Issue Type: Task
Components: test
Reporter: Vinay Kumar Thota
Assignee: Vinay Kumar Thota
Attachments: 1827-ydist-security.patch, 1827-ydist-security.patch,
MAPREDUCE-1827.patch
1. Set the sleep time for the tasks is 3 seconds and kill the task of
streaming job using SIGKILL. After that verify whether task is killed after
3 seconds or not and also verify whether job is succeeded or not.
2. Set the maximum attempts for the maps and reducers are one. make the task
to fail and verify whether task is failed or not.Also verify whether the job
is failed or not.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1827) [Herriot] Task Killing/Failing tests for a streaming job.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12887487#action_12887487 ] Konstantin Boudnik commented on MAPREDUCE-1827: --- Test looks good. However, it'd be good to have a review from someone with better MR knowledge. [Herriot] Task Killing/Failing tests for a streaming job. - Key: MAPREDUCE-1827 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1827 Project: Hadoop Map/Reduce Issue Type: Task Components: test Reporter: Vinay Kumar Thota Assignee: Vinay Kumar Thota Attachments: 1827-ydist-security.patch, 1827-ydist-security.patch, MAPREDUCE-1827.patch 1. Set the sleep time for the tasks is 3 seconds and kill the task of streaming job using SIGKILL. After that verify whether task is killed after 3 seconds or not and also verify whether job is succeeded or not. 2. Set the maximum attempts for the maps and reducers are one. make the task to fail and verify whether task is failed or not.Also verify whether the job is failed or not. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1827) [Herriot] Task Killing/Failing tests for a streaming job.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12883697#action_12883697 ] Konstantin Boudnik commented on MAPREDUCE-1827: --- Please make a patch for trunk as well. [Herriot] Task Killing/Failing tests for a streaming job. - Key: MAPREDUCE-1827 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1827 Project: Hadoop Map/Reduce Issue Type: Task Components: test Reporter: Vinay Kumar Thota Assignee: Vinay Kumar Thota Attachments: 1827-ydist-security.patch, 1827-ydist-security.patch 1. Set the sleep time for the tasks is 3 seconds and kill the task of streaming job using SIGKILL. After that verify whether task is killed after 3 seconds or not and also verify whether job is succeeded or not. 2. Set the maximum attempts for the maps and reducers are one. make the task to fail and verify whether task is failed or not.Also verify whether the job is failed or not. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1827) [Herriot] Task Killing/Failing tests for a streaming job.
[
https://issues.apache.org/jira/browse/MAPREDUCE-1827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12879747#action_12879747
]
Vinay Kumar Thota commented on MAPREDUCE-1827:
--
{quote}
does System.getProperty(user.dir) points to src/contrib/streaming during the
test execution because otherwise {[/src/test/system/scripts/StreamMapper.sh}}
will be looking for the script in a wrong place. According to build-contrib.xml
sysproperty key=user.dir value=${build.test}/data/
so please make sure your assumptions are correct.
{quote}
The above property is using for unit tests, not for system tests. System tests
have its own setup of attributes under different target.
[Herriot] Task Killing/Failing tests for a streaming job.
-
Key: MAPREDUCE-1827
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1827
Project: Hadoop Map/Reduce
Issue Type: Task
Components: test
Reporter: Vinay Kumar Thota
Assignee: Vinay Kumar Thota
Attachments: 1827-ydist-security.patch, 1827-ydist-security.patch
1. Set the sleep time for the tasks is 3 seconds and kill the task of
streaming job using SIGKILL. After that verify whether task is killed after
3 seconds or not and also verify whether job is succeeded or not.
2. Set the maximum attempts for the maps and reducers are one. make the task
to fail and verify whether task is failed or not.Also verify whether the job
is failed or not.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
