Re: Tasktracker fails

2012-02-22 Thread Adarsh Sharma 

Any update on the below issue.

Thanks

Adarsh Sharma wrote:

Dear all,

Today I am trying  to configure hadoop-0.20.205.0 on a 4  node Cluster.
When I start my cluster , all daemons got started except tasktracker, 
don't know why task tracker fails due to following error logs.


Cluster is in private network.My /etc/hosts file contains all IP 
hostname resolution commands in all  nodes.


2012-02-21 17:48:33,056 INFO 
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source 
TaskTrackerMetrics registered.
2012-02-21 17:48:33,094 ERROR org.apache.hadoop.mapred.TaskTracker: 
Can not start task tracker because java.net.SocketException: Invalid 
argument

   at sun.nio.ch.Net.bind(Native Method)
   at 
sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:119)
   at 
sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59)

   at org.apache.hadoop.ipc.Server.bind(Server.java:225)
   at org.apache.hadoop.ipc.Server$Listener.init(Server.java:301)
   at org.apache.hadoop.ipc.Server.init(Server.java:1483)
   at org.apache.hadoop.ipc.RPC$Server.init(RPC.java:545)
   at org.apache.hadoop.ipc.RPC.getServer(RPC.java:506)
   at 
org.apache.hadoop.mapred.TaskTracker.initialize(TaskTracker.java:772)
   at 
org.apache.hadoop.mapred.TaskTracker.init(TaskTracker.java:1428)
   at 
org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:3673)


Any comments on the issue.


Thanks

Re: Tasktracker fails

2012-02-22 Thread Merto Mertek 
Hm.. I would try first to stop all the deamons wtih
$haddop_home/bin/stop-all.sh. Afterwards check that on the master and one
of the slaves no deamons are running (jps). Maybe you could try to check if
your conf on tasktrackers for the jobtracker is pointing to the right place
(mapred-site.xml). Do you see any error in the jobtracker log too?


On 22 February 2012 09:44, Adarsh Sharma adarsh.sha...@orkash.com wrote:

 Any update on the below issue.

 Thanks


 Adarsh Sharma wrote:

 Dear all,

 Today I am trying  to configure hadoop-0.20.205.0 on a 4  node Cluster.
 When I start my cluster , all daemons got started except tasktracker,
 don't know why task tracker fails due to following error logs.

 Cluster is in private network.My /etc/hosts file contains all IP hostname
 resolution commands in all  nodes.

 2012-02-21 17:48:33,056 INFO 
 org.apache.hadoop.metrics2.**impl.MetricsSourceAdapter:
 MBean for source TaskTrackerMetrics registered.
 2012-02-21 17:48:33,094 ERROR org.apache.hadoop.mapred.**TaskTracker:
 Can not start task tracker because java.net.SocketException: Invalid
 argument
   at sun.nio.ch.Net.bind(Native Method)
   at sun.nio.ch.**ServerSocketChannelImpl.bind(**
 ServerSocketChannelImpl.java:**119)
   at sun.nio.ch.**ServerSocketAdaptor.bind(**
 ServerSocketAdaptor.java:59)
   at org.apache.hadoop.ipc.Server.**bind(Server.java:225)
   at org.apache.hadoop.ipc.Server$**Listener.init(Server.java:**
 301)
   at org.apache.hadoop.ipc.Server.**init(Server.java:1483)
   at org.apache.hadoop.ipc.RPC$**Server.init(RPC.java:545)
   at org.apache.hadoop.ipc.RPC.**getServer(RPC.java:506)
   at org.apache.hadoop.mapred.**TaskTracker.initialize(**
 TaskTracker.java:772)
   at org.apache.hadoop.mapred.**TaskTracker.init(**
 TaskTracker.java:1428)
   at org.apache.hadoop.mapred.**TaskTracker.main(TaskTracker.**
 java:3673)

 Any comments on the issue.


 Thanks

Re: Tasktracker fails

2012-02-22 Thread Merto Mertek 
I do not know how the distribution and splitting of deflate files exactly
works if that is your question but probably you will find something useful
in *Codec classes, where are located implementations of few compression
formats. Deflate files are just a type of compression files that you can
use for storing files in your system. There are several others types,
depending on your needs and tradeofs you are dealing (space or time for
compressing).

 Globs I think are just a matching strategy to match files/folders together
with regular expressions..


On 22 February 2012 19:29, Jay Vyas jayunit...@gmail.com wrote:

 Hi guys !

 Im trying to understand the way globstatus / deflate files work in hdfs.  I
 cant read them using the globStatus API in the hadoop FileSystem , from
 java.  the specifics are here if anyone wants some easy stackoverflow
 points :)


 http://stackoverflow.com/questions/9400739/hadoop-globstatus-and-deflate-files

 On Wed, Feb 22, 2012 at 7:39 AM, Merto Mertek masmer...@gmail.com wrote:

  Hm.. I would try first to stop all the deamons wtih
  $haddop_home/bin/stop-all.sh. Afterwards check that on the master and one
  of the slaves no deamons are running (jps). Maybe you could try to check
 if
  your conf on tasktrackers for the jobtracker is pointing to the right
 place
  (mapred-site.xml). Do you see any error in the jobtracker log too?
 
 
  On 22 February 2012 09:44, Adarsh Sharma adarsh.sha...@orkash.com
 wrote:
 
   Any update on the below issue.
  
   Thanks
  
  
   Adarsh Sharma wrote:
  
   Dear all,
  
   Today I am trying  to configure hadoop-0.20.205.0 on a 4  node
 Cluster.
   When I start my cluster , all daemons got started except tasktracker,
   don't know why task tracker fails due to following error logs.
  
   Cluster is in private network.My /etc/hosts file contains all IP
  hostname
   resolution commands in all  nodes.
  
   2012-02-21 17:48:33,056 INFO
  org.apache.hadoop.metrics2.**impl.MetricsSourceAdapter:
   MBean for source TaskTrackerMetrics registered.
   2012-02-21 17:48:33,094 ERROR org.apache.hadoop.mapred.**TaskTracker:
   Can not start task tracker because java.net.SocketException: Invalid
   argument
 at sun.nio.ch.Net.bind(Native Method)
 at sun.nio.ch.**ServerSocketChannelImpl.bind(**
   ServerSocketChannelImpl.java:**119)
 at sun.nio.ch.**ServerSocketAdaptor.bind(**
   ServerSocketAdaptor.java:59)
 at org.apache.hadoop.ipc.Server.**bind(Server.java:225)
 at org.apache.hadoop.ipc.Server$**Listener.init(Server.java:**
   301)
 at org.apache.hadoop.ipc.Server.**init(Server.java:1483)
 at org.apache.hadoop.ipc.RPC$**Server.init(RPC.java:545)
 at org.apache.hadoop.ipc.RPC.**getServer(RPC.java:506)
 at org.apache.hadoop.mapred.**TaskTracker.initialize(**
   TaskTracker.java:772)
 at org.apache.hadoop.mapred.**TaskTracker.init(**
   TaskTracker.java:1428)
 at org.apache.hadoop.mapred.**TaskTracker.main(TaskTracker.**
   java:3673)
  
   Any comments on the issue.
  
  
   Thanks
  
  
  
 



 --
 Jay Vyas
 MMSB/UCHC

Tasktracker fails

2012-02-21 Thread Adarsh Sharma 

Dear all,

Today I am trying  to configure hadoop-0.20.205.0 on a 4  node Cluster.
When I start my cluster , all daemons got started except tasktracker, 
don't know why task tracker fails due to following error logs.


Cluster is in private network.My /etc/hosts file contains all IP 
hostname resolution commands in all  nodes.


2012-02-21 17:48:33,056 INFO 
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source 
TaskTrackerMetrics registered.
2012-02-21 17:48:33,094 ERROR org.apache.hadoop.mapred.TaskTracker: Can 
not start task tracker because java.net.SocketException: Invalid argument

   at sun.nio.ch.Net.bind(Native Method)
   at 
sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:119)

   at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59)
   at org.apache.hadoop.ipc.Server.bind(Server.java:225)
   at org.apache.hadoop.ipc.Server$Listener.init(Server.java:301)
   at org.apache.hadoop.ipc.Server.init(Server.java:1483)
   at org.apache.hadoop.ipc.RPC$Server.init(RPC.java:545)
   at org.apache.hadoop.ipc.RPC.getServer(RPC.java:506)
   at 
org.apache.hadoop.mapred.TaskTracker.initialize(TaskTracker.java:772)
   at 
org.apache.hadoop.mapred.TaskTracker.init(TaskTracker.java:1428)

   at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:3673)

Any comments on the issue.


Thanks