Re: Mapper processing gzipped file

2011-01-18 Thread Harsh J
I don't think it would fail, be it local/non-local for a Map-only job. AFAIK, input streams are buffered and read (from a local block, or over the network). On Wed, Jan 19, 2011 at 5:06 AM, rakesh kothari wrote: > Hi, > > There is a gzipped file that needs to be processed by a Map-only hadoop job

Mapper processing gzipped file

2011-01-18 Thread rakesh kothari
Hi, There is a gzipped file that needs to be processed by a Map-only hadoop job. If the size of this file is more than the space reserved for non-dfs use on the tasktracker host processing this file and if it's a non data local map task, would this job eventually fail ? Is hadoop jobtracker sm