Re: Job Configuration for MAP only Jobs

2011-02-23 Thread Harsh J
Hello, On Thu, Feb 24, 2011 at 1:25 AM, Shuja Rehman wrote: > Hi > I want to configure a map only job where i need to read from hbase table 1 > and do some processing in mapper and then save to some other hbase table > and i do not need reducer for it. i have configure the job in this way. When

Re: Sequence File usage queries

2011-02-23 Thread Ted Yu
I didn't find SequenceFile metadata viewer. You need to write some code for #2 below. On Wed, Feb 23, 2011 at 4:24 PM, Mapred Learn wrote: > Thanks ! > > In this case, how can we print the metadata associated with the data > (sequence files), if user accessing this data wants to know it: > i) Is

Re: Sequence File usage queries

2011-02-23 Thread Mapred Learn
Thanks ! In this case, how can we print the metadata associated with the data (sequence files), if user accessing this data wants to know it: i) Is there any hadoop command that can do it ? ii) Or we will have to provide some interface to the user to see the metadata ? -JJ On Sat, Feb 19, 2011 a

Job Configuration for MAP only Jobs

2011-02-23 Thread Shuja Rehman
Hi I want to configure a map only job where i need to read from hbase table 1 and do some processing in mapper and then save to some other hbase table and i do not need reducer for it. i have configure the job in this way. Job job = new Job(config, "Detector"); job.setJarByClass(Driver.class);

When a map task finishes?

2011-02-23 Thread Pedro Costa
Does a map task finish after generating the map intermediate file? Thanks, -- Pedro

Re: easiest way to install hadoop

2011-02-23 Thread Eric Yang
Hi, For anyone who is interested in installing Yahoo patched hadoop 0.20.2+ ( branch-0.20-security) in rpm or debian form. There is a new option. There are proposals from Owen to standardize Hadoop deployment in https://issues.apache.org/jira/browse/HADOOP-6255. I created rpm/debian package

Re: Message in mapreduce class not logged

2011-02-23 Thread Harsh J
The logs should appear in each of the ReduceTask's log. Are they not appearing in them? On Wed, Feb 23, 2011 at 6:27 PM, Thomas Anderson wrote: > I have setup a cluster with several machines up and running. But I > encounter a problem that my mapper reducer class does not log. > > The hadoop vers

Re: easiest way to install hadoop

2011-02-23 Thread real great..
Thanks a lot.. On Wed, Feb 23, 2011 at 3:12 PM, Eric wrote: > Cloudera offers a nice distribution and decent documentation of how to > install. > When you get started, start using the "old", deprecated API as others have > pointed out before. It's most complete and most stable for now. > > 2011/

Message in mapreduce class not logged

2011-02-23 Thread Thomas Anderson
I have setup a cluster with several machines up and running. But I encounter a problem that my mapper reducer class does not log. The hadoop version I use is 0.20.2. The rootLogger in log4j.properties adds DRFA (daily rolling file appender) and RFA (rolling file appender). My map reduce class loo

Re: easiest way to install hadoop

2011-02-23 Thread Eric
Cloudera offers a nice distribution and decent documentation of how to install. When you get started, start using the "old", deprecated API as others have pointed out before. It's most complete and most stable for now. 2011/2/23 MONTMORY Alain > Hi, > > > > For my point of view it is not a triv

RE: easiest way to install hadoop

2011-02-23 Thread MONTMORY Alain
Hi, For my point of view it is not a trivial question... The latest "stable release" is 0.20.2 (embedded in cloudera CH3) (and not 0.21)... When you start with hadoop recently (end 2010 for me) you are facing "old API" depreceated, so you start with using new API... But in 0.20.2 not all the n