[
https://issues.apache.org/jira/browse/WHIRR-168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12995976#comment-12995976
]
Tibor Kiss commented on WHIRR-168:
----------------------------------
This was the old client side properties setup
{code}
- private Properties createClientSideProperties(ClusterSpec clusterSpec,
- InetAddress namenode, InetAddress jobtracker) throws IOException {
- Properties config = new Properties();
- config.setProperty("hadoop.job.ugi", "root,root");
- config.setProperty("fs.default.name", String.format("hdfs://%s:8020/",
DnsUtil.resolveAddress(namenode.getHostAddress())));
- config.setProperty("mapred.job.tracker", String.format("%s:8021",
DnsUtil.resolveAddress(jobtracker.getHostAddress())));
- config.setProperty("hadoop.socks.server", "localhost:6666");
- config.setProperty("hadoop.rpc.socket.factory.class.default",
"org.apache.hadoop.net.SocksSocketFactory");
- if (clusterSpec.getProvider().endsWith("ec2")) {
- config.setProperty("fs.s3.awsAccessKeyId", clusterSpec.getIdentity());
- config.setProperty("fs.s3.awsSecretAccessKey",
clusterSpec.getCredential());
- config.setProperty("fs.s3n.awsAccessKeyId", clusterSpec.getIdentity());
- config.setProperty("fs.s3n.awsSecretAccessKey",
clusterSpec.getCredential());
- }
{code}
and now the 3 static properties are set by the
{code}
+# Client Common
+hadoop-client-common.hadoop.job.ugi=root,root
+hadoop-client-common.hadoop.rpc.socket.factory.class.default=org.apache.hadoop.net.SocksSocketFactory
+hadoop-client-common.hadoop.socks.server=localhost:6666
{code}
it generated in core-site.xml file the following
{code}
<property>
<name>hadoop.job.ugi</name>
<value>[root, root]</value>
</property>
{code}
I'm not sure about "[" "]" simbols. What do you think?
I attach the 3 generated site.xml- files.
> Extend client side configurations and support core-site.xml, mapred-site.xml
> and hdfs-site.xml instead of hadoop-site.xml
> -------------------------------------------------------------------------------------------------------------------------
>
> Key: WHIRR-168
> URL: https://issues.apache.org/jira/browse/WHIRR-168
> Project: Whirr
> Issue Type: New Feature
> Components: core, service/hadoop
> Environment: ec2
> Reporter: Tibor Kiss
> Assignee: Tibor Kiss
> Priority: Minor
> Attachments: local-socks-proxy-address.patch, whirr-168-1.patch,
> whirr-168-2.patch, whirr-168-3.patch
>
>
> We have a generated .whirr/<hadoop-cluster-name>/hadoop-proxy.sh which
> contains a hard coded port value, the 6666.
> In order to be able to start multiple clusters from the same console I needed
> a simple mechanism to be able to parametrize this port number.
> Therefore is required to extend client side configurations, in the same way
> as WHIRR-55, to be configurable a 'whirr.hadoop-client.hadoop.socks.server'
> to something like
> whirr.hadoop-client.hadoop.socks.server=localhost:6667
> The default port will remain of course the 6666.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
