Error while starting datanode in hadoop 0.23 in secure mode

2011-12-13 Thread sri ram
Hi,
 I receive the following error while starting datanode in secure
mode of hadoop 0.23

2011-12-14 14:35:48,468 INFO  http.HttpServer
(HttpServer.java:addGlobalFilter(476)) - Added global filter 'safety'
(class=org.apache.hadoop.http.HttpServer$
2011-12-14 14:35:48,471 WARN  lib.StaticUserWebFilter
(StaticUserWebFilter.java:getUsernameFromConf(141)) - dfs.web.ugi should
not be used. Instead, use had$
2011-12-14 14:35:48,472 INFO  http.HttpServer
(HttpServer.java:addFilter(454)) - Added filter static_user_filter
(class=org.apache.hadoop.http.lib.StaticUse$
2011-12-14 14:35:48,472 INFO  http.HttpServer
(HttpServer.java:addFilter(461)) - Added filter static_user_filter
(class=org.apache.hadoop.http.lib.StaticUse$
2011-12-14 14:35:48,473 INFO  http.HttpServer
(HttpServer.java:addFilter(461)) - Added filter static_user_filter
(class=org.apache.hadoop.http.lib.StaticUse$
jetty.ssl.password : jetty.ssl.keypassword : 2011-12-14 14:35:53,553 INFO
mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2011-12-14 14:35:54,044 INFO  mortbay.log (Slf4jLog.java:info(67)) -
Started SelectChannelConnector@master:1006
2011-12-14 14:35:54,047 WARN  mortbay.log (Slf4jLog.java:warn(76)) -
java.lang.NullPointerException
2011-12-14 14:35:54,047 WARN  mortbay.log (Slf4jLog.java:warn(76)) - failed
Krb5AndCertsSslSocketConnector@0.0.0.0:1005: java.io.IOException:
!JsseListener:$
2011-12-14 14:35:54,048 WARN  mortbay.log (Slf4jLog.java:warn(76)) - failed
Server@1867df9: java.io.IOException: !JsseListener:
java.lang.NullPointerExcepti$
2011-12-14 14:35:54,085 INFO  mortbay.log (Slf4jLog.java:info(67)) -
Stopped Krb5AndCertsSslSocketConnector@0.0.0.0:1005
2011-12-14 14:35:54,085 INFO  mortbay.log (Slf4jLog.java:info(67)) -
Stopped SelectChannelConnector@master:1006
2011-12-14 14:35:54,189 INFO  datanode.DataNode
(DataNode.java:shutdown(1741)) - Waiting for threadgroup to exit, active
threads is 0
2011-12-14 14:35:54,190 ERROR datanode.DataNode
(DataNode.java:secureMain(2371)) - Exception in secureMain
java.io.IOException: !JsseListener: java.lang.NullPointerException
at
org.mortbay.jetty.security.SslSocketConnector.newServerSocket(SslSocketConnector.java:516)
at
org.apache.hadoop.security.Krb5AndCertsSslSocketConnector.newServerSocket(Krb5AndCertsSslSocketConnector.java:123)
at
org.mortbay.jetty.bio.SocketConnector.open(SocketConnector.java:73)
at
org.mortbay.jetty.AbstractConnector.doStart(AbstractConnector.java:283)
at
org.mortbay.jetty.bio.SocketConnector.doStart(SocketConnector.java:147)

Is there any way to resolve this???


Where do i see Sysout statements after building example ?

2011-12-13 Thread arun k
HI guys !

I have a single node set up as per
http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/
1I have put some sysout statements in Jobtracker and wordcount
(src/examples/org/..) code
2ant build
3Ran example jar with wordcount

Where do i find the sysout statements ? i have seen in logs/
datanode,tasktracker,*.out  files.

Can anyone help me out ?


Arun


Re: How Jobtracler stores tasktracker's information

2011-12-13 Thread Arun C Murthy
Moving to mapreduce-user@, bcc common-user@. Please use project specific lists. 

Take a look at JobTracker.heartbeat - *Scheduler.assignTasks.

After the scheduler 'assigns' tasks, the JT sends the corresponding 
'LaunchTaskAction' to the TaskTracker.

hth,
Arun

On Dec 13, 2011, at 12:59 AM, hadoop anis wrote:

  Anyone please tell this,
  I want to know from where Jobtracker sends task(taskid) to
 tasktarcker for scheduling.
  i.e where it creates taskid  tasktracker pairs
 
 
 
 Thanks  Regards,
 
 Mohmmadanis Moulavi
 
 Student,
 MTech (Computer Sci.  Engg.)
 Walchand college of Engg. Sangli (M.S.) India