Spill Failed when io.sort.mb is increased

2012-08-06 Thread Arpit Wanchoo
the possible reason fir this issue as it does not occur for lower value of io.sort.mb. Regards, Arpit Wanchoo | Sr. Software Engineer Guavus Network Systems. 6th Floor, Enkay Towers, Tower B & B1,Vanijya Nikunj, Udyog Vihar Phase - V, Gurgaon,Haryana. Mobile Number +91-9899949788

Re: Can't access filename in mapper?

2012-06-14 Thread Arpit Wanchoo
You may try using : ((FileSplit) context.getInputSplit()).getPath() Regards, Arpit On 14-Jun-2012, at 8:24 AM, Michael Parker wrote: Hi all, I'm new to Hadoop MR and decided to make a go at using only the new API. I have a series of log files (who doesn't?), where a different date is encoded in

Re: JVM reuse in Map Tasks

2012-06-05 Thread Arpit Wanchoo
would be already initialized before setup() is called i.e it is retaining its value from previously run mapper. Is this the way ? Regards, Arpit Wanchoo | Sr. Software Engineer Guavus Network Systems. 6th Floor, Enkay Towers, Tower B & B1,Vanijya Nikunj, Udyog Vihar Phase - V, Gurgaon,Har

JVM reuse in Map Tasks

2012-06-04 Thread Arpit Wanchoo
called more than once. Regards, Arpit Wanchoo | Sr. Software Engineer Guavus Network Systems. 6th Floor, Enkay Towers, Tower B & B1,Vanijya Nikunj, Udyog Vihar Phase - V, Gurgaon,Haryana. Mobile Number +91-9899949788

MapReduce combiner issue : EOFException while reading Value

2012-06-04 Thread Arpit Wanchoo
e the root cause for this or what can I do to track the root cause. Regards, Arpit Wanchoo