Re: Cygwin+Windows: Error running mapreduce unit tests

2012-09-23 Thread Sahana Bhat
Hi, I am encountering the below error when i try to run unit tests using MRUnit for mapreduce on Windows in my eclipse environment. Version of Hadoop is 0.20.2. I already have Cygwin installed and set in my PATH variable. Error:

Regarding Hadoop Log Retention for Hadoop 0.20.2

2011-12-07 Thread Sahana Bhat
Hi, We use Hadoop 0.20.2 version.The log4j.properties file has a property *hadoop.tasklog.logsRetainHours *(mentioned as 24 hours by default) * *which we have set to 12.Despite this property being set we still have old userlogs in the system.Any idea why the attempt directories (that have

Re: Regarding Hadoop Log Retention for Hadoop 0.20.2

2011-12-07 Thread Sahana Bhat
even be a bug that may have been fixed in the subsequent 0.20 releases that went out recently. On Wed, Dec 7, 2011 at 1:53 PM, Sahana Bhat sana.b...@gmail.com wrote: Hi, We use Hadoop 0.20.2 version.The log4j.properties file has a property hadoop.tasklog.logsRetainHours (mentioned

Re: Regarding Hadoop Log Retention for Hadoop 0.20.2

2011-12-07 Thread Sahana Bhat
seem to be stale too. mapred.userlog.retain.hours should work just fine as Harsh correctly mentioned. HTH, +Vinod On Dec 7, 2011, at 2:48 AM, Sahana Bhat wrote: Was my assumption that *hadoop.tasklog.logsRetainHours *in log4j.properties will do the same wrong? What is this property

setup and cleanup methods in MapReduce API

2011-09-13 Thread Sahana Bhat
Hi, In the new MapReduce API's in Hadoop 0.20.2 version, the methods setup( ) and cleanup( ) are run ONCE at the beginning and at the end of a task. How is this functionality provided in the older MapReduce API's in the 0.20.2 version of Hadoop.Can functionality similar to setup( ) be

Re: map.input.file returns null for MultipleInputs in Hadoop 0.20.2 version

2011-09-12 Thread Sahana Bhat
Hi Harsh, Guess i did make a mistake here.Works fine for me now.Sorry for the trouble :). Thanks, Sahana On Mon, Sep 12, 2011 at 3:19 PM, Sahana Bhat sana.b...@gmail.com wrote: Hi Harsh, Thanks for the approach.One problem i am facing in implementing a custom

map.input.file returns null for MultipleInputs in Hadoop 0.20.2 version

2011-09-09 Thread Sahana Bhat
Hi, I found this link https://issues.apache.org/jira/browse/MAPREDUCE-1743 related to the subject of my mail.Has this been resolved as yet or is there any workaround to get the filename while using MultipleInputs? We have a restriction to use Hadoop 0.20.2 version as the 0.21.0 version

Re: Multiple Mappers and One Reducer

2011-09-07 Thread Sahana Bhat
J ha...@cloudera.com wrote: Sahana, Yes. But, isn't that how it is normally? What makes you question this capability? On Wed, Sep 7, 2011 at 2:37 PM, Sahana Bhat sana.b...@gmail.com wrote: Hi, Is it possible to have multiple mappers where each mapper is operating