Re: unable to run wordcount example on two node cluster

Hi Latha, Please check your hadoop-site.xml files in the slaves, it should have the entries for the master datanodes. I will suggest to clean the data store anf reformat it or create a new one by specufying dir entry in the master's hadoop-site.xml file. us latha wrote: > > Hi All, > > I have

Re: Re: Hadoop 0.17.0 - lots of I/O problems and can't run small datasets?

i doubt this error was because one datanode quit during the client write,and that datanode was chosen by namenode for the client to contact to write(this was what DFSClient.DFSOutputStream.nextBlockOutputStream did). Default,client side retry 3 times and sleep total 3*xxx seconds,but NameNode ne

Re: Re: Hadoop 0.17.0 - lots of I/O problems and can't run small datasets?

ConcurrentModificationException is a java bug or? Best regards, Yongqiang He 2008-07-08 Email: [EMAIL PROTECTED] Tel: 86-10-62600966(O) Research Center for Grid and Service Computing, Institute of Computing Technology, Chinese Academy of Sciences P.O.Box 2704, 100080, Beijing, China

Re: OK to remove NN's edits file?

I also have encountered this error,i added the try catch clause out the main code(FSEditLog.loadFSEdits),and passed the unknown opcode and EOF error, Best regards, Yongqiang He 2008-07-08 Email: [EMAIL PROTECTED] Tel: 86-10-62600966(O) Research Center for Grid and Service Computing, Inst

Re: RandomTextWriter

fyi, Things seem to be playing nicer on Hadoop 0.17.1. But I'm also now running on c1.medium EC2 instances with the recommended XEN kernel. So that could be a factor as well. ckw On Jul 7, 2008, at 10:30 AM, Chris K Wensel wrote: In local mode, only one mapper succeeds, the remaining never

Re: Hadoop 0.17.0 - lots of I/O problems and can't run small datasets?

ConcurrentModificationException looks like a bug we should file a jira. Regd why the writes are failing, we need to look at more logs.. Could you attach complete log from one of the failed tasks. Also try to see if there is anything in NameNode log around that time. Raghu. C G wrote: Hi All

Re: Combiner is optional though it is specified?

Is it a large record? The combiner is not run on very large records in 0.17, as there is nothing to "combine". -C On Jul 6, 2008, at 10:30 PM, novice user wrote: I am guessing it as a bug in Hadoop-17. Because I am able to reproduce the problem. But, I am not able to figure where exactly

Re: RandomTextWriter

In local mode, only one mapper succeeds, the remaining never start. And when on a cluster, a handful of mappers die with some exception about not finding the output directory (sorry, don't have the exception handy). I'm upgrading to 0.17.1 to see if they persist. ckw On Jul 7, 2008, at 10

Re: Help regarding LoginException - CreateProcess: whoami error=2

Hello Steve, Thanks for your reply. You are right, I had cygwin installed but didn't have cygwin/bin added to the PATH variable. I fixed that and it worked. Thanks a lot for your response to my query. Regards, Rutuja On Mon, Jul 7, 2008 at 3:42 AM, Steve Loughran <[EMAIL PROTECTED]> wrote: > Ru

Re: RandomTextWriter

On Jul 7, 2008, at 9:46 AM, Chris K Wensel wrote: Hey all Has anyone had success with RandomTextWriter? I'm finding it fairly unstable on 0.16.x, haven't tried 0.17 yet though. What problems are you seeing? It seems to work fine for me... Arun

RandomTextWriter

Hey all Has anyone had success with RandomTextWriter? I'm finding it fairly unstable on 0.16.x, haven't tried 0.17 yet though. chris -- Chris K Wensel [EMAIL PROTECTED] http://chris.wensel.net/ http://www.cascading.org/

OK to remove NN's edits file?

Hello, I have Hadoop 0.16.2 running in a cluster whose Namenode seems to have a corrupt "edits" file. This causes an EOFException during NN init, which causes NN to exit immediately (exception below). What is the recommended thing to do in such a case? I don't mind losing any of the data that

Re: Help regarding LoginException - CreateProcess: whoami error=2

Rutuja Joshi wrote: Hello, I am new to Hadoop and am trying to run HadoopDfsReadWriteExample from eclipse on Windows XP. I have added following files in the bui

DistributedCache or not ?

I am using Hadoop in a recursive application, for each iteration a new job is launched and a large bunch of data, a big List variable, is passed using the job parameters in a form of a single xml string. The data is different for each iteration. My question is : is there any advantage of using

parallel mapping on single server

Hi, I am pretty naive to hadoop. I ran a modification of wordcount on almost a TB data on single server, but found that it takes too much time. Actually i found that at a time only one core is utilized even though my server is of 8 cores. I read that hadoop speeds up computation in DFS mode.But