Re: File split query

2010-01-28 Thread .ke. sivakumar
Hadoop will take care of it. If the split is supposed to be at the middle of
the
line, then it will be extended till the end. Though the split limit will be
exceeded
by few bytes.



On Thu, Jan 28, 2010 at 7:34 PM, Udaya Lakshmi udaya...@gmail.com wrote:

 Hi,
   When framework splits a file, will it happen that some part of a
 line falls in one split and the other part in some other split? Or is
 the framework going to take care that it always splits at the end of
 the line?

 Thanks,
 Udaya.



Re: Error: INFO ipc.Client: Retrying connect to server: /192.168.100.11:8020. Already tried 0 time(s).

2009-10-08 Thread .ke. sivakumar
Hi Santosh,

Check whether all the datanodes are up and running, using
the command
'bin/hadoop dfsadmin -report'.




On Thu, Oct 8, 2009 at 4:24 AM, santosh gandham santhosh...@gmail.comwrote:

 Hi,
  I am new to Hadoop. I just configured it based on the documentation. While
 I was running example program wordcount.java, I am getting errors. When I
 gave command
  $  /bin/hadoop dfs -mkdir santhosh  , I am getting error as

  09/10/08 13:30:12 INFO ipc.Client: Retrying connect to server: /
 192.168.100.11:8020. Already tried 0 time(s).
 09/10/08 13:30:13 INFO ipc.Client: Retrying connect to server: /
 192.168.100.11:8020. Already tried 1 time(s).
 09/10/08 13:30:14 INFO ipc.Client: Retrying connect to server: /
 192.168.100.11:8020. Already tried 2 time(s).
 09/10/08 13:30:15 INFO ipc.Client: Retrying connect to server: /
 192.168.100.11:8020. Already tried 3 time(s).
 09/10/08 13:30:16 INFO ipc.Client: Retrying connect to server: /
 192.168.100.11:8020. Already tried 4 time(s).
 09/10/08 13:30:17 INFO ipc.Client: Retrying connect to server: /
 192.168.100.11:8020. Already tried 5 time(s).
 09/10/08 13:30:18 INFO ipc.Client: Retrying connect to server: /
 192.168.100.11:8020. Already tried 6 time(s).
 09/10/08 13:30:19 INFO ipc.Client: Retrying connect to server: /
 192.168.100.11:8020. Already tried 7 time(s).
 09/10/08 13:30:20 INFO ipc.Client: Retrying connect to server: /
 192.168.100.11:8020. Already tried 8 time(s).
 09/10/08 13:30:21 INFO ipc.Client: Retrying connect to server: /
 192.168.100.11:8020. Already tried 9 time(s).
 Bad connection to FS. command aborted.

 I can able to ssh to the server without any password. And I didnt get any
 error while I was formating HDFS using the command  $ bin/hadoop namenode
 -format .
 Please help me . what should I do now?. Thank you.



 --
 Gandham Santhosh