RE: Hive HBase integration scan failing

2010-12-10 Thread Jonathan Gray
t map tasks you have per node. JG > -Original Message- > From: vlisovsky [mailto:vlisov...@gmail.com] > Sent: Thursday, December 09, 2010 10:49 PM > To: user@hbase.apache.org > Subject: Hive HBase integration scan failing > > Hi Guys, > > > Wonder if anyb

Hive HBase integration scan failing

2010-12-09 Thread vlisovsky
Hi Guys, > Wonder if anybody could shed some light on how to reduce the load on HBase > cluster when running a full scan. > The need is to dump everything I have in HBase and into a Hive table. The > HBase data size is around 500g. > The job creates 9000 mappers, after about 1000 maps things go s