Re: Null Pointer Exception while using Pig 0.8 and HBase 0.90.0

2011-02-15 Thread Dmitriy Ryaboy
Matt and I got the patch to apply and work but another bug showed up. I'll see about fixing it later tonight. D On Tue, Feb 15, 2011 at 3:00 PM, Matt Davies wrote: > Dmitriy, > > Appreciate the help. We have tried against trunk and here's the output. > > > > patching file > src/org/apache/pig/b

Re: Null Pointer Exception while using Pig 0.8 and HBase 0.90.0

2011-02-15 Thread Matt Davies
Dmitriy, Appreciate the help. We have tried against trunk and here's the output. patching file src/org/apache/pig/backend/hadoop/hbase/HBaseTableInputFormat.java patching file src/org/apache/pig/backend/hadoop/hbase/HBaseStorage.java Hunk #6 FAILED at 80. Hunk #7 succeeded at 115 (offset 1 line

Re: Null Pointer Exception while using Pig 0.8 and HBase 0.90.0

2011-02-15 Thread Dmitriy Ryaboy
Thought it was against the trunk.. I did make it ignore whitespace changes, maybe there's a problem there. I'll email you another patch off-list, let's see if we can get it to work. D On Tue, Feb 15, 2011 at 2:45 PM, Matt Davies wrote: > Dmitriy, > > I saw the patch posted to PIG-1680 from last

Re: Null Pointer Exception while using Pig 0.8 and HBase 0.90.0

2011-02-15 Thread Matt Davies
Dmitriy, I saw the patch posted to PIG-1680 from last night. Thanks! We have been trying to apply it, and find that the patch can't match some of the hunks. Are you patching against trunk or a certain version? Thanks! -Matt On Mon, Feb 14, 2011 at 4:14 PM, Matt Davies wrote: > You are welcom

Re: Null Pointer Exception while using Pig 0.8 and HBase 0.90.0

2011-02-14 Thread Matt Davies
You are welcome! We did a filter before the store, and I confirmed that there weren't any nulls. Just something undocumented feature ;) On Mon, Feb 14, 2011 at 3:03 PM, jacob wrote: > Thanks for the mention. Off the top of my head I got these sorts of > errors when trying to store either null r

Re: Null Pointer Exception while using Pig 0.8 and HBase 0.90.0

2011-02-14 Thread jacob
Also, Since I encountered all of these issues when loading and storing and needed to 'get-shit-done', here's the modified version of hbase storage: https://github.com/infochimps/HbaseBulkloader that might help for now (it's not a long term solution). In it you'll find it can read full column fam

Re: Null Pointer Exception while using Pig 0.8 and HBase 0.90.0

2011-02-14 Thread jacob
Thanks for the mention. Off the top of my head I got these sorts of errors when trying to store either null records or records with null fields. What happens if you FILTER out any null values you might have. Does the problem persist? --jacob @thedatachef On Mon, 2011-02-14 at 14:57 -0700, Matt Da

Re: Null Pointer Exception while using Pig 0.8 and HBase 0.90.0

2011-02-14 Thread Matt Davies
Thank you! We are looking forward to it. On Mon, Feb 14, 2011 at 3:01 PM, Dmitriy Ryaboy wrote: > I have a fix for that, just discovered it last night myself. The patch for > 0.89 doesn't work on storage (it only works for loading). Will update > ticket > later tonight once i get some ivy uglyne

Re: Null Pointer Exception while using Pig 0.8 and HBase 0.90.0

2011-02-14 Thread Dmitriy Ryaboy
I have a fix for that, just discovered it last night myself. The patch for 0.89 doesn't work on storage (it only works for loading). Will update ticket later tonight once i get some ivy uglyness out of the way. D On Mon, Feb 14, 2011 at 1:57 PM, Matt Davies wrote: > Hey All, > > Running into a

Null Pointer Exception while using Pig 0.8 and HBase 0.90.0

2011-02-14 Thread Matt Davies
Hey All, Running into a problem storing data from a pig script storing results into HBase. We are getting the following error: java.lang.NullPointerException at org.apache.hadoop.hbase.mapreduce.TableOutputFormat$TableRecordWriter.write(TableOutputFormat.java:126) at org.apache