Re: Issues with Distributed Caching

2011-11-08 Thread Uma Maheswara Rao G 72686
- Original Message - From: Arko Provo Mukherjee arkoprovomukher...@gmail.com Date: Tuesday, November 8, 2011 1:26 pm Subject: Issues with Distributed Caching To: mapreduce-user@hadoop.apache.org Hello, I am having the following problem with Distributed Caching. *In the driver

Re: Never ending reduce jobs, error Error reading task outputConnection refused

2011-11-08 Thread Sudharsan Sampath
Hi, Also, please make it a point to use only hostnames in your configuration also. Hadoop works entirely on hostname configurations. Thanks Sudhan S On Fri, Nov 4, 2011 at 9:39 PM, Russell Brown misterr...@gmail.com wrote: Done so, working, Awesome and many many thanks! Cheers Russell On

Re: Issues with Distributed Caching

2011-11-08 Thread Sudharsan Sampath
Hi, We read something similar but donot use FileSystem api. Path[] cacheFiles = DistributedCache.getLocalCacheFiles(jobConf); if (cacheFiles != null) { for (Path cacheFile : cacheFiles) { FileInputStream fis = new FileInputStream(cacheFile.toString());

Re: Never ending reduce jobs, error Error reading task outputConnection refused

2011-11-08 Thread Russell Brown
On 8 Nov 2011, at 03:35, Sudharsan Sampath wrote: Hi, Also, please make it a point to use only hostnames in your configuration also. Hadoop works entirely on hostname configurations. Right, and now I know. Thanks again. This was weird in that it worked for small amounts of data, but not

Re: Combiner timing out

2011-11-08 Thread Robert Evans
Chris, I have filed MAPREDUCE-3376 https://issues.apache.org/jira/browse/MAPREDUCE-3376 for this issue. I have no idea when or if I will get around to fixing it. It looks like a fairly simple change, perhaps even a one or two line change, but reproducing the issue and testing that I