Both master and master.example.com points to the current local address. Namenode is running well.
On Tue, Dec 13, 2011 at 4:57 PM, alo alt <wget.n...@googlemail.com> wrote: > Hi, > > master.example.com? I don't think that a NN is running there ;) > And "master" are available in DNS? > > The config looks misconfigured, you have to setup a working environment. > > - Alex > > > On Tue, Dec 13, 2011 at 12:02 PM, sri ram <rsriram...@gmail.com> wrote: > > The following is the content of mapred-site.xml > > <?xml version="1.0"?> > > <?xml-stylesheet href="configuration.xsl"?> > > <configuration> > > <property> > > <name>dfs.replication</name> > > <value>1</value> > > </property> > > <property> > > <name>dfs.permissions</name> > > <value>false</value> > > </property> > > <property> > > <name>dfs.namenode.name.dir</name> > > <value>/app/tmp/name</value> > > </property> > > <property> > > <name>dfs.datanode.data.dir</name> > > <value>/app/tmp/data</value> > > </property> > > <!--kerberos--> > > <!--NAMENODE CONF--> > > <property> > > <name>dfs.block.access.token.enable</name> > > <value>true</value> > > </property> > > <property> > > <name>dfs.https.enable</name> > > <value>true</value> > > </property> > > <property> > > <name>dfs.namenode.https-address</name> > > <value>master.example.com:50470</value> > > </property> > > <property> > > <name>dfs.https.port</name> > > <value>50470</value> > > </property> > > <property> > > <name>dfs.namenode.keytab.file</name> > > <value>/etc/security/keytab/nn.service.keytab</value> > > </property> > > <property> > > <name>dfs.namenode.kerberos.principal</name> > > <value>nn/master.example....@example.com</value> > > </property> > > <property> > > <name>dfs.namenode.kerberos.https.principal</name> > > <value>host/master.example....@example.com</value> > > </property> > > <!--DATANODE CONF--> > > <property> > > <name>dfs.datanode.data.dir.perm</name> > > <value>700</value> > > </property> > > <property> > > <name>dfs.datanode.address</name> > > <value>master:1003</value> > > </property> > > > > <property> > > <name>dfs.datanode.https.address</name> > > <value>master:1005</value> > > </property> > > <property> > > <name>dfs.datanode.http.address</name> > > <value>master:1006</value> > > </property> > > > > <property> > > <name>dfs.datanode.keytab.file</name> > > <value>/etc/security/keytab/dn.service.keytab</value> > > </property> > > <property> > > <name>dfs.datanode.kerberos.principal</name> > > <value>dn/master.example....@example.com</value> > > </property> > > <property> > > <name>dfs.datanode.kerberos.https.principal</name> > > <value>host/master.example....@example.com</value> > > </property> > > > > </configuration> > > > > The following is the error log while starting datanode as root > > 2011-12-13 16:19:26,837 INFO datanode.DataNode > > (StringUtils.java:startupShutdownMessage(589)) - STARTUP_MSG: > > /************************************************************ > > STARTUP_MSG: Starting DataNode > > STARTUP_MSG: host = master.example.com/147.128.152.179 > > STARTUP_MSG: args = [] > > STARTUP_MSG: version = 0.23.0 > > STARTUP_MSG: classpath = > > > /usr/local/hadoop/conf:/usr/local/hadoop/libexec/../share/hadoop/common/lib/activation-1.1.jar:/usr/local/hadoop/libexec/../share$ > > STARTUP_MSG: build = > > git:// > devadm900.cc1.ygridcore.net/grid/0/dev/acm/hadoop-trunk/hadoop-common-project/hadoop-common > > -r d4fee83ec1462ab9824add6449320617$ > > ************************************************************/ > > 2011-12-13 16:19:26,921 WARN common.Util (Util.java:stringAsURI(63)) - > Path > > /app/tmp/data should be specified as a URI in configuration files. Please > > updat$ > > 2011-12-13 16:19:27,314 INFO security.UserGroupInformation > > (UserGroupInformation.java:loginUserFromKeytab(633)) - Login successful > for > > user dn/master.examp$ > > 2011-12-13 16:19:27,454 WARN impl.MetricsConfig > > (MetricsConfig.java:loadFirst(125)) - Cannot locate configuration: tried > > hadoop-metrics2-datanode.propertie$ > > 2011-12-13 16:19:27,548 INFO impl.MetricsSystemImpl > > (MetricsSystemImpl.java:startTimer(343)) - Scheduled snapshot period at > 10 > > second(s). > > 2011-12-13 16:19:27,548 INFO impl.MetricsSystemImpl > > (MetricsSystemImpl.java:start(182)) - DataNode metrics system started > > 2011-12-13 16:19:27,549 INFO impl.MetricsSystemImpl > > (MetricsSystemImpl.java:registerSource(244)) - Registered source > UgiMetrics > > 2011-12-13 16:19:27,572 INFO datanode.DataNode > > (DataNode.java:initDataXceiver(701)) - Opened info server at 1003 > > 2011-12-13 16:19:27,585 INFO datanode.DataNode > > (DataXceiverServer.java:<init>(77)) - Balancing bandwith is 1048576 > bytes/s > > 2011-12-13 16:19:27,617 INFO mortbay.log (Slf4jLog.java:info(67)) - > Logging > > to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via > > org.mortbay.log.Slf4j$ > > 2011-12-13 16:19:27,703 INFO http.HttpServer > > (HttpServer.java:addGlobalFilter(476)) - Added global filter 'safety' > > (class=org.apache.hadoop.http.HttpServer$ > > 2011-12-13 16:19:27,706 WARN lib.StaticUserWebFilter > > (StaticUserWebFilter.java:getUsernameFromConf(141)) - dfs.web.ugi should > not > > be used. Instead, use had$ > > 2011-12-13 16:19:27,707 INFO http.HttpServer > > (HttpServer.java:addFilter(454)) - Added filter static_user_filter > > (class=org.apache.hadoop.http.lib.StaticUse$ > > 2011-12-13 16:19:27,707 INFO http.HttpServer > > (HttpServer.java:addFilter(461)) - Added filter static_user_filter > > (class=org.apache.hadoop.http.lib.StaticUse$ > > 2011-12-13 16:19:27,708 INFO http.HttpServer > > (HttpServer.java:addFilter(461)) - Added filter static_user_filter > > (class=org.apache.hadoop.http.lib.StaticUse$ > > jetty.ssl.password : jetty.ssl.keypassword : 2011-12-13 16:19:27,732 INFO > > mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26 > > 2011-12-13 16:19:28,096 INFO mortbay.log (Slf4jLog.java:info(67)) - > Started > > SelectChannelConnector@master:1006 > > 2011-12-13 16:19:28,100 WARN mortbay.log (Slf4jLog.java:warn(76)) - > > java.lang.NullPointerException > > 2011-12-13 16:19:28,101 WARN mortbay.log (Slf4jLog.java:warn(76)) - > failed > > Krb5AndCertsSslSocketConnector@master:1005: java.io.IOException: > > !JsseListener: $ > > 2011-12-13 16:19:28,101 WARN mortbay.log (Slf4jLog.java:warn(76)) - > failed > > Server@179d854: java.io.IOException: !JsseListener: > > java.lang.NullPointerExcepti$ > > 2011-12-13 16:19:28,104 INFO mortbay.log (Slf4jLog.java:info(67)) - > Stopped > > Krb5AndCertsSslSocketConnector@master:1005 > > 2011-12-13 16:19:28,104 INFO mortbay.log (Slf4jLog.java:info(67)) - > Stopped > > SelectChannelConnector@master:1006 > > 2011-12-13 16:19:28,107 INFO datanode.DataNode > > (DataNode.java:shutdown(1741)) - Waiting for threadgroup to exit, active > > threads is 0 > > 2011-12-13 16:19:28,108 ERROR datanode.DataNode > > (DataNode.java:secureMain(2371)) - Exception in secureMain > > > > java.io.IOException: !JsseListener: java.lang.NullPointerException > > at > > > org.mortbay.jetty.security.SslSocketConnector.newServerSocket(SslSocketConnector.java:516) > > at > > > org.apache.hadoop.security.Krb5AndCertsSslSocketConnector.newServerSocket(Krb5AndCertsSslSocketConnector.java:123) > > at > > org.mortbay.jetty.bio.SocketConnector.open(SocketConnector.java:73) > > at > > org.mortbay.jetty.AbstractConnector.doStart(AbstractConnector.java:283) > > at > > org.mortbay.jetty.bio.SocketConnector.doStart(SocketConnector.java:147) > > > > at > org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) > > at org.mortbay.jetty.Server.doStart(Server.java:235) > > at > > org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) > > at org.apache.hadoop.http.HttpServer.start(HttpServer.java:639) > > at > > > org.apache.hadoop.hdfs.server.datanode.DataNode.startInfoServer(DataNode.java:575) > > at > > > org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:1501) > > at > > org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:457) > > at > > > org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2263) > > at > > > org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2196) > > at > > > org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:2219) > > at > > > org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2367) > > at > > > org.apache.hadoop.hdfs.server.datanode.SecureDataNodeStarter.start(SecureDataNodeStarter.java:108) > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > at > > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > > at > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > at java.lang.reflect.Method.invoke(Method.java:616) > > at > > > org.apache.commons.daemon.support.DaemonLoader.start(DaemonLoader.java:188) > > 2011-12-13 16:19:28,111 INFO datanode.DataNode > (StringUtils.java:run(605)) > > - SHUTDOWN_MSG: > > /************************************************************ > > SHUTDOWN_MSG: Shutting down DataNode at > master.example.com/147.128.152.179 > > > > > > > > On Tue, Dec 13, 2011 at 4:23 PM, sri ram <rsriram...@gmail.com> wrote: > >> > >> telnet master ip says "unable to connect to remote host. > >> This is my following property for datanode in secure mode > >> <property> > >> <name>dfs.datanode.https.address</name> > >> <value>master:1005</value> > >> </property> > >> > >> > >> > >> On Tue, Dec 13, 2011 at 4:18 PM, alo alt <wget.n...@googlemail.com> > wrote: > >>> > >>> Check if kerberos respond: > >>> > >>> telnet KERBEROS_IP 1005 > >>> > >>> As I know use kerberos per default ports 88, AFS token 746 (4444), > kx509 > >>> 9878 > >>> > >>> - Alex > >>> > >>> > >>> On Tue, Dec 13, 2011 at 11:39 AM, sri ram <rsriram...@gmail.com> > wrote: > >>> > Thanks for the reply, > >>> > I have tried with the ip of the individual systems > >>> > also.But > >>> > the same eroor reoccurs > >>> > > >>> > > >>> > On Tue, Dec 13, 2011 at 3:40 PM, alo alt <wget.n...@googlemail.com> > >>> > wrote: > >>> >> > >>> >> Hi, > >>> >> > >>> >> 2011-12-14 14:35:54,047 WARN mortbay.log (Slf4jLog.java:warn(76)) - > >>> >> failed Krb5AndCertsSslSocketConnector@0.0.0.0:1005: > >>> >> java.io.IOException: !JsseListener:$ > >>> >> 2011-12-14 14:35:54,048 WARN mortbay.log (Slf4jLog.java:warn(76)) - > >>> >> failed Server@1867df9: java.io.IOException: !JsseListener: > >>> >> java.lang.NullPointerExcepti$ > >>> >> 2011-12-14 14:35:54,085 INFO mortbay.log (Slf4jLog.java:info(67)) - > >>> >> Stopped Krb5AndCertsSslSocketConnector@0.0.0.0:1005 > >>> >> > >>> >> 0.0.0.0 as Kerberos - IP can't work. > >>> >> > >>> >> - Alex > >>> >> > >>> >> On Tue, Dec 13, 2011 at 10:27 AM, sri ram <rsriram...@gmail.com> > >>> >> wrote: > >>> >> > Hi, > >>> >> > I receive the following error while starting datanode in > >>> >> > secure > >>> >> > mode of hadoop 0.23 > >>> >> > > >>> >> > 2011-12-14 14:35:48,468 INFO http.HttpServer > >>> >> > (HttpServer.java:addGlobalFilter(476)) - Added global filter > >>> >> > 'safety' > >>> >> > (class=org.apache.hadoop.http.HttpServer$ > >>> >> > 2011-12-14 14:35:48,471 WARN lib.StaticUserWebFilter > >>> >> > (StaticUserWebFilter.java:getUsernameFromConf(141)) - dfs.web.ugi > >>> >> > should > >>> >> > not > >>> >> > be used. Instead, use had$ > >>> >> > 2011-12-14 14:35:48,472 INFO http.HttpServer > >>> >> > (HttpServer.java:addFilter(454)) - Added filter static_user_filter > >>> >> > (class=org.apache.hadoop.http.lib.StaticUse$ > >>> >> > 2011-12-14 14:35:48,472 INFO http.HttpServer > >>> >> > (HttpServer.java:addFilter(461)) - Added filter static_user_filter > >>> >> > (class=org.apache.hadoop.http.lib.StaticUse$ > >>> >> > 2011-12-14 14:35:48,473 INFO http.HttpServer > >>> >> > (HttpServer.java:addFilter(461)) - Added filter static_user_filter > >>> >> > (class=org.apache.hadoop.http.lib.StaticUse$ > >>> >> > jetty.ssl.password : jetty.ssl.keypassword : 2011-12-14 > 14:35:53,553 > >>> >> > INFO > >>> >> > mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26 > >>> >> > 2011-12-14 14:35:54,044 INFO mortbay.log > (Slf4jLog.java:info(67)) - > >>> >> > Started > >>> >> > SelectChannelConnector@master:1006 > >>> >> > 2011-12-14 14:35:54,047 WARN mortbay.log > (Slf4jLog.java:warn(76)) - > >>> >> > java.lang.NullPointerException > >>> >> > 2011-12-14 14:35:54,047 WARN mortbay.log > (Slf4jLog.java:warn(76)) - > >>> >> > failed > >>> >> > Krb5AndCertsSslSocketConnector@0.0.0.0:1005: java.io.IOException: > >>> >> > !JsseListener:$ > >>> >> > 2011-12-14 14:35:54,048 WARN mortbay.log > (Slf4jLog.java:warn(76)) - > >>> >> > failed > >>> >> > Server@1867df9: java.io.IOException: !JsseListener: > >>> >> > java.lang.NullPointerExcepti$ > >>> >> > 2011-12-14 14:35:54,085 INFO mortbay.log > (Slf4jLog.java:info(67)) - > >>> >> > Stopped > >>> >> > Krb5AndCertsSslSocketConnector@0.0.0.0:1005 > >>> >> > 2011-12-14 14:35:54,085 INFO mortbay.log > (Slf4jLog.java:info(67)) - > >>> >> > Stopped > >>> >> > SelectChannelConnector@master:1006 > >>> >> > 2011-12-14 14:35:54,189 INFO datanode.DataNode > >>> >> > (DataNode.java:shutdown(1741)) - Waiting for threadgroup to exit, > >>> >> > active > >>> >> > threads is 0 > >>> >> > 2011-12-14 14:35:54,190 ERROR datanode.DataNode > >>> >> > (DataNode.java:secureMain(2371)) - Exception in secureMain > >>> >> > java.io.IOException: !JsseListener: java.lang.NullPointerException > >>> >> > at > >>> >> > > >>> >> > > >>> >> > > org.mortbay.jetty.security.SslSocketConnector.newServerSocket(SslSocketConnector.java:516) > >>> >> > at > >>> >> > > >>> >> > > >>> >> > > org.apache.hadoop.security.Krb5AndCertsSslSocketConnector.newServerSocket(Krb5AndCertsSslSocketConnector.java:123) > >>> >> > at > >>> >> > > org.mortbay.jetty.bio.SocketConnector.open(SocketConnector.java:73) > >>> >> > at > >>> >> > > >>> >> > > org.mortbay.jetty.AbstractConnector.doStart(AbstractConnector.java:283) > >>> >> > at > >>> >> > > >>> >> > > org.mortbay.jetty.bio.SocketConnector.doStart(SocketConnector.java:147) > >>> >> > > >>> >> > Is there any way to resolve this??? > >>> >> > > >>> >> > >>> >> > >>> >> > >>> >> -- > >>> >> Alexander Lorenz > >>> >> http://mapredit.blogspot.com > >>> >> > >>> >> P Think of the environment: please don't print this email unless you > >>> >> really need to. > >>> > > >>> > > >>> > >>> > >>> > >>> -- > >>> Alexander Lorenz > >>> http://mapredit.blogspot.com > >>> > >>> P Think of the environment: please don't print this email unless you > >>> really need to. > >> > >> > > > > > > -- > Alexander Lorenz > http://mapredit.blogspot.com > > P Think of the environment: please don't print this email unless you > really need to. >
