Re: Fine tunning

2014-01-17 Thread Michael Segel
In your mapreduce, in the mapper.setup() read the lookup tables in to memory and then access them as needed in your Mapper.map() method. Same for reducer... See mapper joins in Map/Reduce ... On Jan 6, 2014, at 3:23 AM, Ranjini Rathinam wrote: > Hi, > > I have a input File of 16 fields in

Re: Fine tunning

2014-01-06 Thread lars hofhansl
Hi Ranjini, can you tell more about the lookup? A lookup to another HBase table? For 13k records you would not need the complexity of HBase. -- Lars From: Ranjini Rathinam To: user@hbase.apache.org Sent: Monday, January 6, 2014 1:23 AM Subject: Fine

Fine tunning

2014-01-06 Thread Ranjini Rathinam
Hi, I have a input File of 16 fields in it. Using Mapreduce code need to load the hbase tables. The first eight has to go into one table in hbase and last eight has to got to another hbase table. The data is being loaded into hbase table in 0.11 sec , but if any lookup is being added in the map