Error while starting datanode in hadoop 0.23 in secure mode
Hi, I receive the following error while starting datanode in secure mode of hadoop 0.23 2011-12-14 14:35:48,468 INFO http.HttpServer (HttpServer.java:addGlobalFilter(476)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$ 2011-12-14 14:35:48,471 WARN lib.StaticUserWebFilter (StaticUserWebFilter.java:getUsernameFromConf(141)) - dfs.web.ugi should not be used. Instead, use had$ 2011-12-14 14:35:48,472 INFO http.HttpServer (HttpServer.java:addFilter(454)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUse$ 2011-12-14 14:35:48,472 INFO http.HttpServer (HttpServer.java:addFilter(461)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUse$ 2011-12-14 14:35:48,473 INFO http.HttpServer (HttpServer.java:addFilter(461)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUse$ jetty.ssl.password : jetty.ssl.keypassword : 2011-12-14 14:35:53,553 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26 2011-12-14 14:35:54,044 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@master:1006 2011-12-14 14:35:54,047 WARN mortbay.log (Slf4jLog.java:warn(76)) - java.lang.NullPointerException 2011-12-14 14:35:54,047 WARN mortbay.log (Slf4jLog.java:warn(76)) - failed Krb5AndCertsSslSocketConnector@0.0.0.0:1005: java.io.IOException: !JsseListener:$ 2011-12-14 14:35:54,048 WARN mortbay.log (Slf4jLog.java:warn(76)) - failed Server@1867df9: java.io.IOException: !JsseListener: java.lang.NullPointerExcepti$ 2011-12-14 14:35:54,085 INFO mortbay.log (Slf4jLog.java:info(67)) - Stopped Krb5AndCertsSslSocketConnector@0.0.0.0:1005 2011-12-14 14:35:54,085 INFO mortbay.log (Slf4jLog.java:info(67)) - Stopped SelectChannelConnector@master:1006 2011-12-14 14:35:54,189 INFO datanode.DataNode (DataNode.java:shutdown(1741)) - Waiting for threadgroup to exit, active threads is 0 2011-12-14 14:35:54,190 ERROR datanode.DataNode (DataNode.java:secureMain(2371)) - Exception in secureMain java.io.IOException: !JsseListener: java.lang.NullPointerException at org.mortbay.jetty.security.SslSocketConnector.newServerSocket(SslSocketConnector.java:516) at org.apache.hadoop.security.Krb5AndCertsSslSocketConnector.newServerSocket(Krb5AndCertsSslSocketConnector.java:123) at org.mortbay.jetty.bio.SocketConnector.open(SocketConnector.java:73) at org.mortbay.jetty.AbstractConnector.doStart(AbstractConnector.java:283) at org.mortbay.jetty.bio.SocketConnector.doStart(SocketConnector.java:147) Is there any way to resolve this???
Re: Error while starting datanode in hadoop 0.23 in secure mode
Hi, 2011-12-14 14:35:54,047 WARN mortbay.log (Slf4jLog.java:warn(76)) - failed Krb5AndCertsSslSocketConnector@0.0.0.0:1005: java.io.IOException: !JsseListener:$ 2011-12-14 14:35:54,048 WARN mortbay.log (Slf4jLog.java:warn(76)) - failed Server@1867df9: java.io.IOException: !JsseListener: java.lang.NullPointerExcepti$ 2011-12-14 14:35:54,085 INFO mortbay.log (Slf4jLog.java:info(67)) - Stopped Krb5AndCertsSslSocketConnector@0.0.0.0:1005 0.0.0.0 as Kerberos - IP can't work. - Alex On Tue, Dec 13, 2011 at 10:27 AM, sri ram wrote: > Hi, > I receive the following error while starting datanode in secure > mode of hadoop 0.23 > > 2011-12-14 14:35:48,468 INFO http.HttpServer > (HttpServer.java:addGlobalFilter(476)) - Added global filter 'safety' > (class=org.apache.hadoop.http.HttpServer$ > 2011-12-14 14:35:48,471 WARN lib.StaticUserWebFilter > (StaticUserWebFilter.java:getUsernameFromConf(141)) - dfs.web.ugi should not > be used. Instead, use had$ > 2011-12-14 14:35:48,472 INFO http.HttpServer > (HttpServer.java:addFilter(454)) - Added filter static_user_filter > (class=org.apache.hadoop.http.lib.StaticUse$ > 2011-12-14 14:35:48,472 INFO http.HttpServer > (HttpServer.java:addFilter(461)) - Added filter static_user_filter > (class=org.apache.hadoop.http.lib.StaticUse$ > 2011-12-14 14:35:48,473 INFO http.HttpServer > (HttpServer.java:addFilter(461)) - Added filter static_user_filter > (class=org.apache.hadoop.http.lib.StaticUse$ > jetty.ssl.password : jetty.ssl.keypassword : 2011-12-14 14:35:53,553 INFO > mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26 > 2011-12-14 14:35:54,044 INFO mortbay.log (Slf4jLog.java:info(67)) - Started > SelectChannelConnector@master:1006 > 2011-12-14 14:35:54,047 WARN mortbay.log (Slf4jLog.java:warn(76)) - > java.lang.NullPointerException > 2011-12-14 14:35:54,047 WARN mortbay.log (Slf4jLog.java:warn(76)) - failed > Krb5AndCertsSslSocketConnector@0.0.0.0:1005: java.io.IOException: > !JsseListener:$ > 2011-12-14 14:35:54,048 WARN mortbay.log (Slf4jLog.java:warn(76)) - failed > Server@1867df9: java.io.IOException: !JsseListener: > java.lang.NullPointerExcepti$ > 2011-12-14 14:35:54,085 INFO mortbay.log (Slf4jLog.java:info(67)) - Stopped > Krb5AndCertsSslSocketConnector@0.0.0.0:1005 > 2011-12-14 14:35:54,085 INFO mortbay.log (Slf4jLog.java:info(67)) - Stopped > SelectChannelConnector@master:1006 > 2011-12-14 14:35:54,189 INFO datanode.DataNode > (DataNode.java:shutdown(1741)) - Waiting for threadgroup to exit, active > threads is 0 > 2011-12-14 14:35:54,190 ERROR datanode.DataNode > (DataNode.java:secureMain(2371)) - Exception in secureMain > java.io.IOException: !JsseListener: java.lang.NullPointerException > at > org.mortbay.jetty.security.SslSocketConnector.newServerSocket(SslSocketConnector.java:516) > at > org.apache.hadoop.security.Krb5AndCertsSslSocketConnector.newServerSocket(Krb5AndCertsSslSocketConnector.java:123) > at > org.mortbay.jetty.bio.SocketConnector.open(SocketConnector.java:73) > at > org.mortbay.jetty.AbstractConnector.doStart(AbstractConnector.java:283) > at > org.mortbay.jetty.bio.SocketConnector.doStart(SocketConnector.java:147) > > Is there any way to resolve this??? > -- Alexander Lorenz http://mapredit.blogspot.com P Think of the environment: please don't print this email unless you really need to.
Re: Error while starting datanode in hadoop 0.23 in secure mode
Thanks for the reply, I have tried with the ip of the individual systems also.But the same eroor reoccurs On Tue, Dec 13, 2011 at 3:40 PM, alo alt wrote: > Hi, > > 2011-12-14 14:35:54,047 WARN mortbay.log (Slf4jLog.java:warn(76)) - > failed Krb5AndCertsSslSocketConnector@0.0.0.0:1005: > java.io.IOException: !JsseListener:$ > 2011-12-14 14:35:54,048 WARN mortbay.log (Slf4jLog.java:warn(76)) - > failed Server@1867df9: java.io.IOException: !JsseListener: > java.lang.NullPointerExcepti$ > 2011-12-14 14:35:54,085 INFO mortbay.log (Slf4jLog.java:info(67)) - > Stopped Krb5AndCertsSslSocketConnector@0.0.0.0:1005 > > 0.0.0.0 as Kerberos - IP can't work. > > - Alex > > On Tue, Dec 13, 2011 at 10:27 AM, sri ram wrote: > > Hi, > > I receive the following error while starting datanode in secure > > mode of hadoop 0.23 > > > > 2011-12-14 14:35:48,468 INFO http.HttpServer > > (HttpServer.java:addGlobalFilter(476)) - Added global filter 'safety' > > (class=org.apache.hadoop.http.HttpServer$ > > 2011-12-14 14:35:48,471 WARN lib.StaticUserWebFilter > > (StaticUserWebFilter.java:getUsernameFromConf(141)) - dfs.web.ugi should > not > > be used. Instead, use had$ > > 2011-12-14 14:35:48,472 INFO http.HttpServer > > (HttpServer.java:addFilter(454)) - Added filter static_user_filter > > (class=org.apache.hadoop.http.lib.StaticUse$ > > 2011-12-14 14:35:48,472 INFO http.HttpServer > > (HttpServer.java:addFilter(461)) - Added filter static_user_filter > > (class=org.apache.hadoop.http.lib.StaticUse$ > > 2011-12-14 14:35:48,473 INFO http.HttpServer > > (HttpServer.java:addFilter(461)) - Added filter static_user_filter > > (class=org.apache.hadoop.http.lib.StaticUse$ > > jetty.ssl.password : jetty.ssl.keypassword : 2011-12-14 14:35:53,553 INFO > > mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26 > > 2011-12-14 14:35:54,044 INFO mortbay.log (Slf4jLog.java:info(67)) - > Started > > SelectChannelConnector@master:1006 > > 2011-12-14 14:35:54,047 WARN mortbay.log (Slf4jLog.java:warn(76)) - > > java.lang.NullPointerException > > 2011-12-14 14:35:54,047 WARN mortbay.log (Slf4jLog.java:warn(76)) - > failed > > Krb5AndCertsSslSocketConnector@0.0.0.0:1005: java.io.IOException: > > !JsseListener:$ > > 2011-12-14 14:35:54,048 WARN mortbay.log (Slf4jLog.java:warn(76)) - > failed > > Server@1867df9: java.io.IOException: !JsseListener: > > java.lang.NullPointerExcepti$ > > 2011-12-14 14:35:54,085 INFO mortbay.log (Slf4jLog.java:info(67)) - > Stopped > > Krb5AndCertsSslSocketConnector@0.0.0.0:1005 > > 2011-12-14 14:35:54,085 INFO mortbay.log (Slf4jLog.java:info(67)) - > Stopped > > SelectChannelConnector@master:1006 > > 2011-12-14 14:35:54,189 INFO datanode.DataNode > > (DataNode.java:shutdown(1741)) - Waiting for threadgroup to exit, active > > threads is 0 > > 2011-12-14 14:35:54,190 ERROR datanode.DataNode > > (DataNode.java:secureMain(2371)) - Exception in secureMain > > java.io.IOException: !JsseListener: java.lang.NullPointerException > > at > > > org.mortbay.jetty.security.SslSocketConnector.newServerSocket(SslSocketConnector.java:516) > > at > > > org.apache.hadoop.security.Krb5AndCertsSslSocketConnector.newServerSocket(Krb5AndCertsSslSocketConnector.java:123) > > at > > org.mortbay.jetty.bio.SocketConnector.open(SocketConnector.java:73) > > at > > org.mortbay.jetty.AbstractConnector.doStart(AbstractConnector.java:283) > > at > > org.mortbay.jetty.bio.SocketConnector.doStart(SocketConnector.java:147) > > > > Is there any way to resolve this??? > > > > > > -- > Alexander Lorenz > http://mapredit.blogspot.com > > P Think of the environment: please don't print this email unless you > really need to. >
Re: Error while starting datanode in hadoop 0.23 in secure mode
Check if kerberos respond: telnet KERBEROS_IP 1005 As I know use kerberos per default ports 88, AFS token 746 (), kx509 9878 - Alex On Tue, Dec 13, 2011 at 11:39 AM, sri ram wrote: > Thanks for the reply, > I have tried with the ip of the individual systems also.But > the same eroor reoccurs > > > On Tue, Dec 13, 2011 at 3:40 PM, alo alt wrote: >> >> Hi, >> >> 2011-12-14 14:35:54,047 WARN mortbay.log (Slf4jLog.java:warn(76)) - >> failed Krb5AndCertsSslSocketConnector@0.0.0.0:1005: >> java.io.IOException: !JsseListener:$ >> 2011-12-14 14:35:54,048 WARN mortbay.log (Slf4jLog.java:warn(76)) - >> failed Server@1867df9: java.io.IOException: !JsseListener: >> java.lang.NullPointerExcepti$ >> 2011-12-14 14:35:54,085 INFO mortbay.log (Slf4jLog.java:info(67)) - >> Stopped Krb5AndCertsSslSocketConnector@0.0.0.0:1005 >> >> 0.0.0.0 as Kerberos - IP can't work. >> >> - Alex >> >> On Tue, Dec 13, 2011 at 10:27 AM, sri ram wrote: >> > Hi, >> > I receive the following error while starting datanode in secure >> > mode of hadoop 0.23 >> > >> > 2011-12-14 14:35:48,468 INFO http.HttpServer >> > (HttpServer.java:addGlobalFilter(476)) - Added global filter 'safety' >> > (class=org.apache.hadoop.http.HttpServer$ >> > 2011-12-14 14:35:48,471 WARN lib.StaticUserWebFilter >> > (StaticUserWebFilter.java:getUsernameFromConf(141)) - dfs.web.ugi should >> > not >> > be used. Instead, use had$ >> > 2011-12-14 14:35:48,472 INFO http.HttpServer >> > (HttpServer.java:addFilter(454)) - Added filter static_user_filter >> > (class=org.apache.hadoop.http.lib.StaticUse$ >> > 2011-12-14 14:35:48,472 INFO http.HttpServer >> > (HttpServer.java:addFilter(461)) - Added filter static_user_filter >> > (class=org.apache.hadoop.http.lib.StaticUse$ >> > 2011-12-14 14:35:48,473 INFO http.HttpServer >> > (HttpServer.java:addFilter(461)) - Added filter static_user_filter >> > (class=org.apache.hadoop.http.lib.StaticUse$ >> > jetty.ssl.password : jetty.ssl.keypassword : 2011-12-14 14:35:53,553 >> > INFO >> > mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26 >> > 2011-12-14 14:35:54,044 INFO mortbay.log (Slf4jLog.java:info(67)) - >> > Started >> > SelectChannelConnector@master:1006 >> > 2011-12-14 14:35:54,047 WARN mortbay.log (Slf4jLog.java:warn(76)) - >> > java.lang.NullPointerException >> > 2011-12-14 14:35:54,047 WARN mortbay.log (Slf4jLog.java:warn(76)) - >> > failed >> > Krb5AndCertsSslSocketConnector@0.0.0.0:1005: java.io.IOException: >> > !JsseListener:$ >> > 2011-12-14 14:35:54,048 WARN mortbay.log (Slf4jLog.java:warn(76)) - >> > failed >> > Server@1867df9: java.io.IOException: !JsseListener: >> > java.lang.NullPointerExcepti$ >> > 2011-12-14 14:35:54,085 INFO mortbay.log (Slf4jLog.java:info(67)) - >> > Stopped >> > Krb5AndCertsSslSocketConnector@0.0.0.0:1005 >> > 2011-12-14 14:35:54,085 INFO mortbay.log (Slf4jLog.java:info(67)) - >> > Stopped >> > SelectChannelConnector@master:1006 >> > 2011-12-14 14:35:54,189 INFO datanode.DataNode >> > (DataNode.java:shutdown(1741)) - Waiting for threadgroup to exit, active >> > threads is 0 >> > 2011-12-14 14:35:54,190 ERROR datanode.DataNode >> > (DataNode.java:secureMain(2371)) - Exception in secureMain >> > java.io.IOException: !JsseListener: java.lang.NullPointerException >> > at >> > >> > org.mortbay.jetty.security.SslSocketConnector.newServerSocket(SslSocketConnector.java:516) >> > at >> > >> > org.apache.hadoop.security.Krb5AndCertsSslSocketConnector.newServerSocket(Krb5AndCertsSslSocketConnector.java:123) >> > at >> > org.mortbay.jetty.bio.SocketConnector.open(SocketConnector.java:73) >> > at >> > org.mortbay.jetty.AbstractConnector.doStart(AbstractConnector.java:283) >> > at >> > org.mortbay.jetty.bio.SocketConnector.doStart(SocketConnector.java:147) >> > >> > Is there any way to resolve this??? >> > >> >> >> >> -- >> Alexander Lorenz >> http://mapredit.blogspot.com >> >> P Think of the environment: please don't print this email unless you >> really need to. > > -- Alexander Lorenz http://mapredit.blogspot.com P Think of the environment: please don't print this email unless you really need to.
Re: Error while starting datanode in hadoop 0.23 in secure mode
telnet master ip says "unable to connect to remote host. This is my following property for datanode in secure mode dfs.datanode.https.address master:1005 On Tue, Dec 13, 2011 at 4:18 PM, alo alt wrote: > Check if kerberos respond: > > telnet KERBEROS_IP 1005 > > As I know use kerberos per default ports 88, AFS token 746 (), kx509 > 9878 > > - Alex > > > On Tue, Dec 13, 2011 at 11:39 AM, sri ram wrote: > > Thanks for the reply, > >I have tried with the ip of the individual systems > also.But > > the same eroor reoccurs > > > > > > On Tue, Dec 13, 2011 at 3:40 PM, alo alt > wrote: > >> > >> Hi, > >> > >> 2011-12-14 14:35:54,047 WARN mortbay.log (Slf4jLog.java:warn(76)) - > >> failed Krb5AndCertsSslSocketConnector@0.0.0.0:1005: > >> java.io.IOException: !JsseListener:$ > >> 2011-12-14 14:35:54,048 WARN mortbay.log (Slf4jLog.java:warn(76)) - > >> failed Server@1867df9: java.io.IOException: !JsseListener: > >> java.lang.NullPointerExcepti$ > >> 2011-12-14 14:35:54,085 INFO mortbay.log (Slf4jLog.java:info(67)) - > >> Stopped Krb5AndCertsSslSocketConnector@0.0.0.0:1005 > >> > >> 0.0.0.0 as Kerberos - IP can't work. > >> > >> - Alex > >> > >> On Tue, Dec 13, 2011 at 10:27 AM, sri ram wrote: > >> > Hi, > >> > I receive the following error while starting datanode in > secure > >> > mode of hadoop 0.23 > >> > > >> > 2011-12-14 14:35:48,468 INFO http.HttpServer > >> > (HttpServer.java:addGlobalFilter(476)) - Added global filter 'safety' > >> > (class=org.apache.hadoop.http.HttpServer$ > >> > 2011-12-14 14:35:48,471 WARN lib.StaticUserWebFilter > >> > (StaticUserWebFilter.java:getUsernameFromConf(141)) - dfs.web.ugi > should > >> > not > >> > be used. Instead, use had$ > >> > 2011-12-14 14:35:48,472 INFO http.HttpServer > >> > (HttpServer.java:addFilter(454)) - Added filter static_user_filter > >> > (class=org.apache.hadoop.http.lib.StaticUse$ > >> > 2011-12-14 14:35:48,472 INFO http.HttpServer > >> > (HttpServer.java:addFilter(461)) - Added filter static_user_filter > >> > (class=org.apache.hadoop.http.lib.StaticUse$ > >> > 2011-12-14 14:35:48,473 INFO http.HttpServer > >> > (HttpServer.java:addFilter(461)) - Added filter static_user_filter > >> > (class=org.apache.hadoop.http.lib.StaticUse$ > >> > jetty.ssl.password : jetty.ssl.keypassword : 2011-12-14 14:35:53,553 > >> > INFO > >> > mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26 > >> > 2011-12-14 14:35:54,044 INFO mortbay.log (Slf4jLog.java:info(67)) - > >> > Started > >> > SelectChannelConnector@master:1006 > >> > 2011-12-14 14:35:54,047 WARN mortbay.log (Slf4jLog.java:warn(76)) - > >> > java.lang.NullPointerException > >> > 2011-12-14 14:35:54,047 WARN mortbay.log (Slf4jLog.java:warn(76)) - > >> > failed > >> > Krb5AndCertsSslSocketConnector@0.0.0.0:1005: java.io.IOException: > >> > !JsseListener:$ > >> > 2011-12-14 14:35:54,048 WARN mortbay.log (Slf4jLog.java:warn(76)) - > >> > failed > >> > Server@1867df9: java.io.IOException: !JsseListener: > >> > java.lang.NullPointerExcepti$ > >> > 2011-12-14 14:35:54,085 INFO mortbay.log (Slf4jLog.java:info(67)) - > >> > Stopped > >> > Krb5AndCertsSslSocketConnector@0.0.0.0:1005 > >> > 2011-12-14 14:35:54,085 INFO mortbay.log (Slf4jLog.java:info(67)) - > >> > Stopped > >> > SelectChannelConnector@master:1006 > >> > 2011-12-14 14:35:54,189 INFO datanode.DataNode > >> > (DataNode.java:shutdown(1741)) - Waiting for threadgroup to exit, > active > >> > threads is 0 > >> > 2011-12-14 14:35:54,190 ERROR datanode.DataNode > >> > (DataNode.java:secureMain(2371)) - Exception in secureMain > >> > java.io.IOException: !JsseListener: java.lang.NullPointerException > >> > at > >> > > >> > > org.mortbay.jetty.security.SslSocketConnector.newServerSocket(SslSocketConnector.java:516) > >> > at > >> > > >> > > org.apache.hadoop.security.Krb5AndCertsSslSocketConnector.newServerSocket(Krb5AndCertsSslSocketConnector.java:123) > >> > at > >> > org.mortbay.jetty.bio.SocketConnector.open(SocketConnector.java:73) > >> > at > >> > > org.mortbay.jetty.AbstractConnector.doStart(AbstractConnector.java:283) > >> > at > >> > > org.mortbay.jetty.bio.SocketConnector.doStart(SocketConnector.java:147) > >> > > >> > Is there any way to resolve this??? > >> > > >> > >> > >> > >> -- > >> Alexander Lorenz > >> http://mapredit.blogspot.com > >> > >> P Think of the environment: please don't print this email unless you > >> really need to. > > > > > > > > -- > Alexander Lorenz > http://mapredit.blogspot.com > > P Think of the environment: please don't print this email unless you > really need to. >
Re: Error while starting datanode in hadoop 0.23 in secure mode
The following is the content of mapred-site.xml dfs.replication 1 dfs.permissions false dfs.namenode.name.dir /app/tmp/name dfs.datanode.data.dir /app/tmp/data dfs.block.access.token.enable true dfs.https.enable true dfs.namenode.https-address master.example.com:50470 dfs.https.port 50470 dfs.namenode.keytab.file /etc/security/keytab/nn.service.keytab dfs.namenode.kerberos.principal nn/master.example@example.com dfs.namenode.kerberos.https.principal host/master.example@example.com dfs.datanode.data.dir.perm 700 dfs.datanode.address master:1003 dfs.datanode.https.address master:1005 dfs.datanode.http.address master:1006 dfs.datanode.keytab.file /etc/security/keytab/dn.service.keytab dfs.datanode.kerberos.principal dn/master.example@example.com dfs.datanode.kerberos.https.principal host/master.example@example.com The following is the error log while starting datanode as root 2011-12-13 16:19:26,837 INFO datanode.DataNode (StringUtils.java:startupShutdownMessage(589)) - STARTUP_MSG: / STARTUP_MSG: Starting DataNode STARTUP_MSG: host = master.example.com/147.128.152.179 STARTUP_MSG: args = [] STARTUP_MSG: version = 0.23.0 STARTUP_MSG: classpath = /usr/local/hadoop/conf:/usr/local/hadoop/libexec/../share/hadoop/common/lib/activation-1.1.jar:/usr/local/hadoop/libexec/../share$ STARTUP_MSG: build = git:// devadm900.cc1.ygridcore.net/grid/0/dev/acm/hadoop-trunk/hadoop-common-project/hadoop-common-r d4fee83ec1462ab9824add6449320617$ / 2011-12-13 16:19:26,921 WARN common.Util (Util.java:stringAsURI(63)) - Path /app/tmp/data should be specified as a URI in configuration files. Please updat$ 2011-12-13 16:19:27,314 INFO security.UserGroupInformation (UserGroupInformation.java:loginUserFromKeytab(633)) - Login successful for user dn/master.examp$ 2011-12-13 16:19:27,454 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(125)) - Cannot locate configuration: tried hadoop-metrics2-datanode.propertie$ 2011-12-13 16:19:27,548 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:startTimer(343)) - Scheduled snapshot period at 10 second(s). 2011-12-13 16:19:27,548 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:start(182)) - DataNode metrics system started 2011-12-13 16:19:27,549 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:registerSource(244)) - Registered source UgiMetrics 2011-12-13 16:19:27,572 INFO datanode.DataNode (DataNode.java:initDataXceiver(701)) - Opened info server at 1003 2011-12-13 16:19:27,585 INFO datanode.DataNode (DataXceiverServer.java:(77)) - Balancing bandwith is 1048576 bytes/s 2011-12-13 16:19:27,617 INFO mortbay.log (Slf4jLog.java:info(67)) - Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4j$ 2011-12-13 16:19:27,703 INFO http.HttpServer (HttpServer.java:addGlobalFilter(476)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$ 2011-12-13 16:19:27,706 WARN lib.StaticUserWebFilter (StaticUserWebFilter.java:getUsernameFromConf(141)) - dfs.web.ugi should not be used. Instead, use had$ 2011-12-13 16:19:27,707 INFO http.HttpServer (HttpServer.java:addFilter(454)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUse$ 2011-12-13 16:19:27,707 INFO http.HttpServer (HttpServer.java:addFilter(461)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUse$ 2011-12-13 16:19:27,708 INFO http.HttpServer (HttpServer.java:addFilter(461)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUse$ jetty.ssl.password : jetty.ssl.keypassword : 2011-12-13 16:19:27,732 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26 2011-12-13 16:19:28,096 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@master:1006 2011-12-13 16:19:28,100 WARN mortbay.log (Slf4jLog.java:warn(76)) - java.lang.NullPointerException 2011-12-13 16:19:28,101 WARN mortbay.log (Slf4jLog.java:warn(76)) - failed Krb5AndCertsSslSocketConnector@master:1005: java.io.IOException: !JsseListener: $ 2011-12-13 16:19:28,101 WARN mortbay.log (Slf4jLog.java:warn(76)) - failed Server@179d854: java.io.IOException: !JsseListener: java.lang.NullPointerExcepti$ 2011-12-13 16:19:28,104 INFO mortbay.log (Slf4jLog.java:info(67)) - Stopped Krb5AndCertsSslSocketConnector@master:1005 2011-12-13 16:19:28,104 INFO mortbay.log (Slf4jLog.java:info(67)) - Stopped SelectChannelConnector@master:1006 2011-12-13 16:19:28,107 INFO datanode.DataNode (DataNode.java:shutdown(1741)) - Waiting for threadgroup to exit, active threads is 0 2011-12-13 16:19:28,108 ERROR datanode.DataNode (DataNode.java:secureMain(2371)) - Exception in secureMain java.io.IOException: !JsseListener: java.lang.NullPointerException at org.mortbay.jetty.security.SslSocketConnector.newServerSocket(SslSocketConnector.java:516) at org.
Re: Error while starting datanode in hadoop 0.23 in secure mode
Hi, master.example.com? I don't think that a NN is running there ;) And "master" are available in DNS? The config looks misconfigured, you have to setup a working environment. - Alex On Tue, Dec 13, 2011 at 12:02 PM, sri ram wrote: > The following is the content of mapred-site.xml > > > > > dfs.replication > 1 > > > dfs.permissions > false > > > dfs.namenode.name.dir > /app/tmp/name > > > dfs.datanode.data.dir > /app/tmp/data > > > > > dfs.block.access.token.enable > true > > > dfs.https.enable > true > > > dfs.namenode.https-address > master.example.com:50470 > > > dfs.https.port > 50470 > > > dfs.namenode.keytab.file > /etc/security/keytab/nn.service.keytab > > > dfs.namenode.kerberos.principal > nn/master.example@example.com > > > dfs.namenode.kerberos.https.principal > host/master.example@example.com > > > > dfs.datanode.data.dir.perm > 700 > > > dfs.datanode.address > master:1003 > > > > dfs.datanode.https.address > master:1005 > > > dfs.datanode.http.address > master:1006 > > > > dfs.datanode.keytab.file > /etc/security/keytab/dn.service.keytab > > > dfs.datanode.kerberos.principal > dn/master.example@example.com > > > dfs.datanode.kerberos.https.principal > host/master.example@example.com > > > > > The following is the error log while starting datanode as root > 2011-12-13 16:19:26,837 INFO datanode.DataNode > (StringUtils.java:startupShutdownMessage(589)) - STARTUP_MSG: > / > STARTUP_MSG: Starting DataNode > STARTUP_MSG: host = master.example.com/147.128.152.179 > STARTUP_MSG: args = [] > STARTUP_MSG: version = 0.23.0 > STARTUP_MSG: classpath = > /usr/local/hadoop/conf:/usr/local/hadoop/libexec/../share/hadoop/common/lib/activation-1.1.jar:/usr/local/hadoop/libexec/../share$ > STARTUP_MSG: build = > git://devadm900.cc1.ygridcore.net/grid/0/dev/acm/hadoop-trunk/hadoop-common-project/hadoop-common > -r d4fee83ec1462ab9824add6449320617$ > / > 2011-12-13 16:19:26,921 WARN common.Util (Util.java:stringAsURI(63)) - Path > /app/tmp/data should be specified as a URI in configuration files. Please > updat$ > 2011-12-13 16:19:27,314 INFO security.UserGroupInformation > (UserGroupInformation.java:loginUserFromKeytab(633)) - Login successful for > user dn/master.examp$ > 2011-12-13 16:19:27,454 WARN impl.MetricsConfig > (MetricsConfig.java:loadFirst(125)) - Cannot locate configuration: tried > hadoop-metrics2-datanode.propertie$ > 2011-12-13 16:19:27,548 INFO impl.MetricsSystemImpl > (MetricsSystemImpl.java:startTimer(343)) - Scheduled snapshot period at 10 > second(s). > 2011-12-13 16:19:27,548 INFO impl.MetricsSystemImpl > (MetricsSystemImpl.java:start(182)) - DataNode metrics system started > 2011-12-13 16:19:27,549 INFO impl.MetricsSystemImpl > (MetricsSystemImpl.java:registerSource(244)) - Registered source UgiMetrics > 2011-12-13 16:19:27,572 INFO datanode.DataNode > (DataNode.java:initDataXceiver(701)) - Opened info server at 1003 > 2011-12-13 16:19:27,585 INFO datanode.DataNode > (DataXceiverServer.java:(77)) - Balancing bandwith is 1048576 bytes/s > 2011-12-13 16:19:27,617 INFO mortbay.log (Slf4jLog.java:info(67)) - Logging > to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via > org.mortbay.log.Slf4j$ > 2011-12-13 16:19:27,703 INFO http.HttpServer > (HttpServer.java:addGlobalFilter(476)) - Added global filter 'safety' > (class=org.apache.hadoop.http.HttpServer$ > 2011-12-13 16:19:27,706 WARN lib.StaticUserWebFilter > (StaticUserWebFilter.java:getUsernameFromConf(141)) - dfs.web.ugi should not > be used. Instead, use had$ > 2011-12-13 16:19:27,707 INFO http.HttpServer > (HttpServer.java:addFilter(454)) - Added filter static_user_filter > (class=org.apache.hadoop.http.lib.StaticUse$ > 2011-12-13 16:19:27,707 INFO http.HttpServer > (HttpServer.java:addFilter(461)) - Added filter static_user_filter > (class=org.apache.hadoop.http.lib.StaticUse$ > 2011-12-13 16:19:27,708 INFO http.HttpServer > (HttpServer.java:addFilter(461)) - Added filter static_user_filter > (class=org.apache.hadoop.http.lib.StaticUse$ > jetty.ssl.password : jetty.ssl.keypassword : 2011-12-13 16:19:27,732 INFO > mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26 > 2011-12-13 16:19:28,096 INFO mortbay.log (Slf4jLog.java:info(67)) - Started > SelectChannelConnector@master:1006 > 2011-12-13 16:19:28,100 WARN mortbay.log (Slf4jLog.java:warn(76)) - > java.lang.NullPointerException > 2011-12-13 16:19:28,101 WARN mortbay.log (Slf4jLog.java:warn(76)) - failed > Krb5AndCertsSslSocketConnector@master:1005: java.io.IOException: > !JsseListener: $ > 2011-12-13 16:19:28,101 WARN mortbay.log (Slf4jLog.java:warn(76)) - failed > Server@179d854: java.io.IOException: !JsseListener: > java.lang.NullPointerExcepti$ > 2011-12-13 16:19:28,104 INFO mortbay.log (Slf4jLog.java:info(67)) - Stopped > Krb5AndCertsSslSocketConnector@master:1005 >
Re: Error while starting datanode in hadoop 0.23 in secure mode
Both master and master.example.com points to the current local address. Namenode is running well. On Tue, Dec 13, 2011 at 4:57 PM, alo alt wrote: > Hi, > > master.example.com? I don't think that a NN is running there ;) > And "master" are available in DNS? > > The config looks misconfigured, you have to setup a working environment. > > - Alex > > > On Tue, Dec 13, 2011 at 12:02 PM, sri ram wrote: > > The following is the content of mapred-site.xml > > > > > > > > > > dfs.replication > > 1 > > > > > > dfs.permissions > > false > > > > > > dfs.namenode.name.dir > > /app/tmp/name > > > > > > dfs.datanode.data.dir > > /app/tmp/data > > > > > > > > > > dfs.block.access.token.enable > > true > > > > > > dfs.https.enable > > true > > > > > > dfs.namenode.https-address > > master.example.com:50470 > > > > > > dfs.https.port > > 50470 > > > > > > dfs.namenode.keytab.file > > /etc/security/keytab/nn.service.keytab > > > > > > dfs.namenode.kerberos.principal > > nn/master.example@example.com > > > > > > dfs.namenode.kerberos.https.principal > > host/master.example@example.com > > > > > > > > dfs.datanode.data.dir.perm > > 700 > > > > > > dfs.datanode.address > > master:1003 > > > > > > > > dfs.datanode.https.address > > master:1005 > > > > > > dfs.datanode.http.address > > master:1006 > > > > > > > > dfs.datanode.keytab.file > > /etc/security/keytab/dn.service.keytab > > > > > > dfs.datanode.kerberos.principal > > dn/master.example@example.com > > > > > > dfs.datanode.kerberos.https.principal > > host/master.example@example.com > > > > > > > > > > The following is the error log while starting datanode as root > > 2011-12-13 16:19:26,837 INFO datanode.DataNode > > (StringUtils.java:startupShutdownMessage(589)) - STARTUP_MSG: > > / > > STARTUP_MSG: Starting DataNode > > STARTUP_MSG: host = master.example.com/147.128.152.179 > > STARTUP_MSG: args = [] > > STARTUP_MSG: version = 0.23.0 > > STARTUP_MSG: classpath = > > > /usr/local/hadoop/conf:/usr/local/hadoop/libexec/../share/hadoop/common/lib/activation-1.1.jar:/usr/local/hadoop/libexec/../share$ > > STARTUP_MSG: build = > > git:// > devadm900.cc1.ygridcore.net/grid/0/dev/acm/hadoop-trunk/hadoop-common-project/hadoop-common > > -r d4fee83ec1462ab9824add6449320617$ > > / > > 2011-12-13 16:19:26,921 WARN common.Util (Util.java:stringAsURI(63)) - > Path > > /app/tmp/data should be specified as a URI in configuration files. Please > > updat$ > > 2011-12-13 16:19:27,314 INFO security.UserGroupInformation > > (UserGroupInformation.java:loginUserFromKeytab(633)) - Login successful > for > > user dn/master.examp$ > > 2011-12-13 16:19:27,454 WARN impl.MetricsConfig > > (MetricsConfig.java:loadFirst(125)) - Cannot locate configuration: tried > > hadoop-metrics2-datanode.propertie$ > > 2011-12-13 16:19:27,548 INFO impl.MetricsSystemImpl > > (MetricsSystemImpl.java:startTimer(343)) - Scheduled snapshot period at > 10 > > second(s). > > 2011-12-13 16:19:27,548 INFO impl.MetricsSystemImpl > > (MetricsSystemImpl.java:start(182)) - DataNode metrics system started > > 2011-12-13 16:19:27,549 INFO impl.MetricsSystemImpl > > (MetricsSystemImpl.java:registerSource(244)) - Registered source > UgiMetrics > > 2011-12-13 16:19:27,572 INFO datanode.DataNode > > (DataNode.java:initDataXceiver(701)) - Opened info server at 1003 > > 2011-12-13 16:19:27,585 INFO datanode.DataNode > > (DataXceiverServer.java:(77)) - Balancing bandwith is 1048576 > bytes/s > > 2011-12-13 16:19:27,617 INFO mortbay.log (Slf4jLog.java:info(67)) - > Logging > > to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via > > org.mortbay.log.Slf4j$ > > 2011-12-13 16:19:27,703 INFO http.HttpServer > > (HttpServer.java:addGlobalFilter(476)) - Added global filter 'safety' > > (class=org.apache.hadoop.http.HttpServer$ > > 2011-12-13 16:19:27,706 WARN lib.StaticUserWebFilter > > (StaticUserWebFilter.java:getUsernameFromConf(141)) - dfs.web.ugi should > not > > be used. Instead, use had$ > > 2011-12-13 16:19:27,707 INFO http.HttpServer > > (HttpServer.java:addFilter(454)) - Added filter static_user_filter > > (class=org.apache.hadoop.http.lib.StaticUse$ > > 2011-12-13 16:19:27,707 INFO http.HttpServer > > (HttpServer.java:addFilter(461)) - Added filter static_user_filter > > (class=org.apache.hadoop.http.lib.StaticUse$ > > 2011-12-13 16:19:27,708 INFO http.HttpServer > > (HttpServer.java:addFilter(461)) - Added filter static_user_filter > > (class=org.apache.hadoop.http.lib.StaticUse$ > > jetty.ssl.password : jetty.ssl.keypassword : 2011-12-13 16:19:27,732 INFO > > mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26 > > 2011-12-13 16:19:28,096 INFO mortbay.log (Slf4jLog.java:info(67)) - > Started > > SelectChannelConnector@master:1006 > > 2011-12-13 16:19:28,100 WARN mortbay.log (Slf4jLog.java:warn(76)) - > > java.lang.Null
