Re: Pig 0.8 HBaseStorage patch

2011-01-26 Thread Corbin Hoenes
Okay I've created a JIRA and submitted the patch. It's my first patch so please educate me on proper etiquette. https://issues.apache.org/jira/browse/PIG-1825 On Wed, Jan 26, 2011 at 12:43 PM, Alan Gates wrote: > Yahoo is not a huge user of Pig and HBase together yet, so my response to > thi

Re: Pig 0.8 HBaseStorage patch

2011-01-26 Thread Alan Gates
Yahoo is not a huge user of Pig and HBase together yet, so my response to this is theoretical rather than based on my need. But if your work produces a significant improvement I would definitely say it is worth contributing. Even if it does not get checked in because we migrate the trunk

Pig 0.8 HBaseStorage patch

2011-01-24 Thread Corbin Hoenes
We've got a patch we've made to HBaseStorage which allows a caller to turn off the WriteAheadLog feature while doing bulk loads into hbase. >From the performance tuning wikipage: http://wiki.apache.org/hadoop/PerformanceTuning "To speed up the inserts in a non critical job (like an import job), yo