[ 
https://issues.apache.org/jira/browse/HADOOP-7599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13098537#comment-13098537
 ] 

Devaraj Das commented on HADOOP-7599:
-------------------------------------

Some comments:
1. The mapred system dir should be 700ed 
2. The -format is always called by default in hadoop-setup-hdfs. Can we make 
the formatting done based on command line option (-format) provided by the user 
running the script. I really don't want implicit namenode formatting.
3. We could let the directory /mapred be group owned by the system group.
4. The --datanodes & --tasktrackers options - could they be made optional? They 
might be already optional. Please confirm.
5. Could we live with namenode-url instead of replacing it with namenode-host 
(ditto for jobtracker-url). I also see you changed a couple of other places in 
a backward incompatible way (like HADOOP_JT_HOST, taskcontroller ownership). 
Want to avoid incompatible changes.
6. Why did we remove the call to hadoop-setup-config.sh from 
src/packages/hadoop-setup-conf.sh
7. The group is hardcoded to 'hadoop' in a couple of places. Can we avoid that?
8. I see commented-out lines in hadoop-setup-conf.sh. Please remove those.
9. I don't think we should blindly overwrite the conf files in the config 
directory. We probably should warn & exit if the conf directory already has 
some files within. The user can probably use --force if he wants to avoid the 
warning.
10. All the components in the path leading up to taskcontroller.cfg has to be 
owned by root. Have this checked.
11. Where is HADOOP_SECURE_DN_LOG_DIR used?
12. A whole lot of configuration options that you added in the *-site.xml files 
are already there in *-default.xml. We don't need those. We only need the 
security related ones. Also, we don't want to play with the non-security 
configs like mapred.tasktracker.map.tasks.maximum.

> Improve hadoop setup conf script to setup secure Hadoop cluster
> ---------------------------------------------------------------
>
>                 Key: HADOOP-7599
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7599
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: scripts
>    Affects Versions: 0.20.203.0
>         Environment: Java 6, RHEL 5.6
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>             Fix For: 0.20.205.0
>
>         Attachments: HADOOP-7599.patch
>
>
> Setting up a secure Hadoop cluster requires a lot of manual setup.  The 
> motivation of this jira is to provide setup scripts to automate setup secure 
> Hadoop cluster.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to