unable to write in hbase using mapreduce hadoop 0.20 and hbase 0.20

2009-12-04 Thread Vipul Sharma
System.exit(exitCode); } } My mapreduce job run without an error but I see no data in Table. Few more inputs that I have hbase and zookeeper jar in hadoop classpath on all servers. I can add data by hand in the table. Please let me know if I am doing anything wrong here. Than

Re: How to set identityreducer in hadoop 0.2

2009-11-10 Thread vipul sharma
thanks Tim! On Tue, Nov 10, 2009 at 11:35 AM, Tim Robertson wrote: > > http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/mapreduce/Reducer.html > > "The default implementation is an identity function." > > Cheers, > Tim > > On Tue, Nov 10, 2

How to set identityreducer in hadoop 0.2

2009-11-10 Thread vipul sharma
IdentityReducer class is deprecated in hadoop 0.2. What can I use for similar functionality? -- Vipul Sharma sharmavipul AT gmail DOT com

Re: XML input to map function

2009-11-03 Thread vipul sharma
xml >message. Thanks Amandeep! I want to use the split efficiently. If I use one split per xml file then it wont be very efficient since size of xml files is small ~ 1meg. What I want to do is to have multiple files in one split. I will update you once I am done with this. -- Vipul Sharma sharmavip

RE: Multiple Input Paths

2009-11-03 Thread vipul sharma
ot be efficient since my xml files are small. What I would want to do is to have a split that includes multiple files so that I can use one map for around 64meg of data. And do the parsing inside map. I will update you once it makes more sense to even me. -- Vipul Sharma sharmavipul AT gmail DOT com

RE: Multiple Input Paths

2009-11-02 Thread Vipul Sharma
Mark, were you able to concatenate both the xml files together. What did you do to keep the resulting xml well forned? Regards, Vipul Sharma, Cell: 281-217-0761

Re: XML input to map function

2009-11-02 Thread Vipul Sharma
hope I was more clear this time?? Regards, Vipul Sharma, Cell: 281-217-0761 On Mon, Nov 2, 2009 at 4:00 PM, Amandeep Khurana wrote: > Are the xml's in flat files or stored in Hbase? > > 1. If they are in flat files, you can use the StreamXmlRecordReader if that > works for y

XML input to map function

2009-11-02 Thread Vipul Sharma
per xml file or is there another way of doing this? Thanks for your help and time. Regards, Vipul Sharma,

A way to input xml files in mapreduce

2009-11-02 Thread VIPUL SHARMA
I am new to hadoop and still learning most of the details. I am working on an application that will take input from lots of small xml files. Each xml files has some record that I want to parse and input data in a hbase table. How should I go about parsing xml files and input in map functions. Shou