[jira] Updated: (MAPREDUCE-1890) Create automated test scenarios for decommissioning of task trackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iyappan Srinivasan updated MAPREDUCE-1890: -- Attachment: 1890-ydist-security-patch.txt Adding some exceptions and starting stale tasktracker from JT. This makes ti work in a security cluster. > Create automated test scenarios for decommissioning of task trackers > > > Key: MAPREDUCE-1890 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1890 > Project: Hadoop Map/Reduce > Issue Type: Test > Components: test >Reporter: Iyappan Srinivasan >Assignee: Iyappan Srinivasan > Attachments: 1890-ydist-security-patch.txt, > 1890-ydist-security-patch.txt, 1890-ydist-security-patch.txt, > TestDecomissioning.patch > > > Test scenarios : > 1) Put a healthy slave task tracker in the dfs.exclude file. > 2) As a valid user, decommission a node in the cluster by issuing the > command "hadoop mradmin -refreshNodes" > 3) Make sure that the node is decommissioned. > 4) Now take the task tracker out of the file. > 5) As a valid user, again issue the command "hadoop mradmin -refreshNodes" > 6) Make sure that the node is not in the decommiossion list. > 7) Bring back that node. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1890) Create automated test scenarios for decommissioning of task trackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iyappan Srinivasan updated MAPREDUCE-1890: -- Attachment: 1890-ydist-security-patch.txt Same patch with a few modifications when ran in secure cluster. > Create automated test scenarios for decommissioning of task trackers > > > Key: MAPREDUCE-1890 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1890 > Project: Hadoop Map/Reduce > Issue Type: Test > Components: test >Reporter: Iyappan Srinivasan > Attachments: 1890-ydist-security-patch.txt, > 1890-ydist-security-patch.txt, TestDecomissioning.patch > > > Test scenarios : > 1) Put a healthy slave task tracker in the dfs.exclude file. > 2) As a valid user, decommission a node in the cluster by issuing the > command "hadoop mradmin -refreshNodes" > 3) Make sure that the node is decommissioned. > 4) Now take the task tracker out of the file. > 5) As a valid user, again issue the command "hadoop mradmin -refreshNodes" > 6) Make sure that the node is not in the decommiossion list. > 7) Bring back that node. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1890) Create automated test scenarios for decommissioning of task trackers
[
https://issues.apache.org/jira/browse/MAPREDUCE-1890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Iyappan Srinivasan updated MAPREDUCE-1890:
--
Attachment: 1890-ydist-security-patch.txt
+ //String confFile = "mapred-site.xml";
+ //Hashtable prop = new Hashtable();
+ //prop.put("mapred.hosts.exclude", "/tmp/mapred.exclude");
+ //cluster.restartClusterWithNewConfig(prop, confFile);
There is bunch of commented out code, it looks like you might need the above
code to make is work correctly.
- [Iyappan] Removed the comments.
Also the code in tear down is commented out.
- [Iyappan] Removed the comments.
+ List ttClients = cluster.getTTClients();
+
+ //One slave is got
+ TTClient ttClient = (TTClient)ttClients.get(0);
I have a similar helper method, that I will check in AbstractDaemonCluster with
health script, it is better to use that helper, I will check in this code
shortly.
- [Iyappan] Any one tasktracker is got. This is a very simple one line code. No
need helper method for this.
//The client shich needs tobe decommissioned is put in the exclude path.
Fix the typo in the comment.
- [Iyappan] Fixed
One question is you were telling me that hadoopqa user is executing mradmin
refresh which requires mapred priviledge, so how is this achieved wiith this
code. If this is going to be deployment specific changes to mapred-site.xml we
should call out that dependency, so it is actionable.
-[Iyappan] There are two changes required. One with
security.admin.operations.protocol.acl in hadoop-policy.xml should be added
with "users" and the other mapreduce.cluster.administrators should be added
with "users" in mapred-site.xml. mapred-site.xml changes are done in the
testcase itself and the hadoop-policy.xml changes should be done via
deployment, till the methods available now can be enhanced to modify
hadoop-policy.xml too. I have doen a internal request for this deployment
change.
> Create automated test scenarios for decommissioning of task trackers
>
>
> Key: MAPREDUCE-1890
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1890
> Project: Hadoop Map/Reduce
> Issue Type: Test
> Components: test
>Reporter: Iyappan Srinivasan
> Attachments: 1890-ydist-security-patch.txt, TestDecomissioning.patch
>
>
> Test scenarios :
> 1) Put a healthy slave task tracker in the dfs.exclude file.
> 2) As a valid user, decommission a node in the cluster by issuing the
> command "hadoop mradmin -refreshNodes"
> 3) Make sure that the node is decommissioned.
> 4) Now take the task tracker out of the file.
> 5) As a valid user, again issue the command "hadoop mradmin -refreshNodes"
> 6) Make sure that the node is not in the decommiossion list.
> 7) Bring back that node.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1890) Create automated test scenarios for decommissioning of task trackers
[ https://issues.apache.org/jira/browse/MAPREDUCE-1890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iyappan Srinivasan updated MAPREDUCE-1890: -- Attachment: TestDecomissioning.patch Preliminary patch for Decommissioning testcase. > Create automated test scenarios for decommissioning of task trackers > > > Key: MAPREDUCE-1890 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1890 > Project: Hadoop Map/Reduce > Issue Type: Test > Components: test >Reporter: Iyappan Srinivasan > Attachments: TestDecomissioning.patch > > > Test scenarios : > 1) Put a healthy slave task tracker in the dfs.exclude file. > 2) As a valid user, decommission a node in the cluster by issuing the > command "hadoop mradmin -refreshNodes" > 3) Make sure that the node is decommissioned. > 4) Now take the task tracker out of the file. > 5) As a valid user, again issue the command "hadoop mradmin -refreshNodes" > 6) Make sure that the node is not in the decommiossion list. > 7) Bring back that node. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
