RE: ICV concurrency problem (?)

2010-06-13 Thread Mark Laffoon
] Sent: Friday, June 11, 2010 3:57 PM To: user@hbase.apache.org Subject: RE: ICV concurrency problem (?) Follow-up to this issue, with a test map job to demonstrate it. I created RandomInputFormat that allows you to configure the number of input splits and the size of each split. The record reader

Re: ICV concurrency problem (?)

2010-06-12 Thread Ted Yu
@gmail.com [mailto:saint@gmail.com] On Behalf Of Stack Sent: Saturday, June 12, 2010 9:59 AM To: user@hbase.apache.org Subject: Re: ICV concurrency problem (?) On Fri, Jun 11, 2010 at 4:26 PM, Mark Laffoon mlaff...@semanticresearch.com wrote: The other thing I didn't mention: I ran

RE: ICV concurrency problem (?)

2010-06-12 Thread Andrew Purtell
From: Mark Laffoon Subject: RE: ICV concurrency problem (?) 1. I have multiple clients (map/reduce task executors) hitting an HBase cluster with multiple region servers. Assuming the client code doesn't explicitly set the timestamp, which box actually generates the timestamp for a put

RE: ICV concurrency problem (?)

2010-06-11 Thread Mark Laffoon
Follow-up to this issue, with a test map job to demonstrate it. I created RandomInputFormat that allows you to configure the number of input splits and the size of each split. The record reader generates a random key (UUID) and a value that is unique to each split. For example, you can set it up

Re: ICV concurrency problem (?)

2010-06-11 Thread Todd Lipcon
On Fri, Jun 11, 2010 at 3:56 PM, Mark Laffoon mlaff...@semanticresearch.com wrote: Follow-up to this issue, with a test map job to demonstrate it. I created RandomInputFormat that allows you to configure the number of input splits and the size of each split. The record reader generates a

Re: ICV concurrency problem (?)

2010-06-11 Thread Ryan Rawson
- From: Ryan Rawson [mailto:ryano...@gmail.com] Sent: Friday, June 11, 2010 4:06 PM To: user@hbase.apache.org Subject: Re: ICV concurrency problem (?) I would tend to agree with Todd here, I have generally used 'close()' in the Hadoop 0.20 MR API to accomplish such tasks. -ryan On Fri

Re: ICV concurrency problem (?)

2010-06-11 Thread Stack
. Sometimes it works, and sometimes it doesn't sigh. Could there be an issue with data being moved around regions? Thanks, Mark -Original Message- From: Ryan Rawson [mailto:ryano...@gmail.com] Sent: Friday, June 11, 2010 4:06 PM To: user@hbase.apache.org Subject: Re: ICV concurrency

ICV concurrency problem (?)

2010-06-10 Thread mlaffoon
the breed as the key. Thus, when we're all done, it is fast and easy to get the breed counts. TIA for any hints, Mark -- View this message in context: http://old.nabble.com/ICV-concurrency-problem-%28-%29-tp28846417p28846417.html Sent from the HBase User mailing list archive at Nabble.com.

Re: ICV concurrency problem (?)

2010-06-10 Thread Ryan Rawson
that has the breed as the key. Thus, when we're all done, it is fast and easy to get the breed counts. TIA for any hints, Mark -- View this message in context: http://old.nabble.com/ICV-concurrency-problem-%28-%29-tp28846417p28846417.html Sent from the HBase User mailing list archive