How to debug a MapReduce application

2009-01-16 Thread Pedro Vivancos
FileOutputFormat.setOutputPath(conf, new Path("eliminar.txt")); // ejecutamos el algoritmo map-reduce para mezclar anotaciones try { JobClient.runJob(conf); } catch (IOException e) { e.printStackTrace(); System.exit(-1);

Re: How to debug a MapReduce application

2009-01-19 Thread Pedro Vivancos
org.apache.hadoop.mapred.JobShell.main(JobShell.java:68) On Mon, Jan 19, 2009 at 8:47 AM, Pedro Vivancos wrote: > Thank you very much, but actually I would like to run my application as a > standalone one. > > Anyway I tried to execute it on a pseudo distributed mode with that setup >

How to improve my map & reduce application

2009-02-27 Thread Pedro Vivancos
Dear friends, I am new at Hadoop and I must say I just want to use it as a map & reduce framework. I've developed an application to be run in a server with 8 CPU and everything seems to work properly but the performance. It doesn't use all the CPU power. I'm trying to process 200.000 documents a

Re: Mappers become less utilized as time goes on?

2009-03-04 Thread Pedro Vivancos
I have the same problem... Please let me know if you solve it and how to. Thanks. On Wed, Mar 4, 2009 at 2:49 AM, Nathan Marz wrote: > Nope... and there were no failed tasks. > > > > On Mar 3, 2009, at 5:16 PM, Runping Qi wrote: > > Were task Trackers black-listed? >> >> >> On Tue, Mar 3, 20