Re: Simple MapReduce logic using Java API

2015-04-01 Thread Ranadip Chatterjee
Eating up the IOException in the mapper looks suspicious to me. That can silently consume the input without any output. Also check in the map sysout messages for the console print output. As an aside, since you are not doing anything in the reduce, try setting number of reduces to 0. That will

Re: Simple MapReduce logic using Java API

2015-04-01 Thread Harshit Mathur
Why are you reading the files with buffered reader in map function. The problem with your code might be because of the following reason, The files in /data/path/to/file/d_20150330-1650 will be locally stored and will not be accessible to the mappers running on different nodes, and as in your

Simple MapReduce logic using Java API

2015-03-31 Thread bradford li
I'm not sure why my Mapper and Reducer have no output. The logic behind my code is, given a file of UUIDs (new line separated), I want to use `globStatus` to display all the paths to all potential files that the UUID might be in. Open and read the file. Each file contains 1-n lines of JSON. The

Re: Simple MapReduce logic using Java API

2015-03-31 Thread Shahab Yunus
What is the reason of using the queue? job.getConfiguration().set(mapred.job.queue.name, exp_dsa); Is your mapper or reducer even been called? Try adding the override annotation to the map/reduce methods as below: @Override public void map(Object key, Text value, Context context) throws