Re: How to print values in console while running MapReduce application

If it is for debugging purpose would advise to try Custom MR Counters ! Though you will not get it in console you will be get it from web ui for running job too. On Sun, Oct 8, 2017 at 9:24 PM, Harsh J wrote: > Consider running your job in the local mode (set config ' >

Re: How to print values in console while running MapReduce application

Consider running your job in the local mode (set config ' mapreduce.framework.name' to 'local'). Otherwise, rely on the log viewer from the (Job) History Server to check the console prints in each task (under the stdout or stderr sections). On Thu, 5 Oct 2017 at 05:15 Tanvir Rahman

Re: How to print values in console while running MapReduce application

Hello Demian, Thanks for the answer. 1. I am using Java for writing the MapReduce Application. Can you tell me how to do it in JAVA? 2. In the mapper or reducer function, which command did you use to write the output? Is it going to write it in Log folder? I have multiple nodes and

Re: How to print values in console while running MapReduce application

i did the same tutorial, i think they only way  is doing it  outside hadoop.in the command line:cat folder/* | python mapper.py | sort | python reducer El Miércoles, 4 de octubre, 2017 16:20:31, Tanvir Rahman escribió: Hello,I have a small cluster and I am

Re: How to print values in console while running MapReduce application

Hi, The easiest way is to open a new window and display the log file as follow tail -f /path/to/log/file.log Best, Sultan > On Oct 4, 2017, at 5:20 PM, Tanvir Rahman wrote: > > Hello, > I have a small cluster and I am running MapReduce WordCount application in > it.

How to print values in console while running MapReduce application

Hello, I have a small cluster and I am running MapReduce WordCount application in it. I want to print some variable values in the console(where you can see the map and reduce job progress and other job information) for debugging purpose while running the MapReduce application. What is the easiest