Re: Debugging Map-Reduce programs

2009-06-17 Thread Rakhi Khatwani
Hi, You could also use apache commons logging to write logs in your map/reduce functions which will be seen in the jobtracker UI. that's how we did debugging :) Hope it helps Regards, Raakhi On Tue, Jun 16, 2009 at 7:29 PM, jason hadoop jason.had...@gmail.comwrote: When you are running

Re: Debugging Map-Reduce programs

2009-06-16 Thread jason hadoop
When you are running in local mode you have 2 basic choices if you want to interact with a debugger. You can launch from within eclipse or other IDE, or you can setup a java debugger transport as part of the mapred.child.java.opts variable, and attach to the running jvm. By far the simplest is

Debugging Map-Reduce programs

2009-06-15 Thread bharath vissapragada
Hi all , When running hadoop in local mode .. can we use print statements to print something to the terminal ... Also iam not sure whether the program is reading my input files ... If i keep print statements it isn't displaying any .. can anyone tell me how to solve this problem. Thanks in

Re: Debugging Map-Reduce programs

2009-06-15 Thread Aaron Kimball
On Mon, Jun 15, 2009 at 10:01 AM, bharath vissapragada bhara...@students.iiit.ac.in wrote: Hi all , When running hadoop in local mode .. can we use print statements to print something to the terminal ... Yes. In distributed mode, each task will write its stdout/stderr to files which you