My program writes changes to HBase table by issuing lots of Puts
(autoCommit turned off, flush on end) and afterwards uses ResultScanner
on whole table to read all rows and act upon them. My problem is that on
several occasions scan does not return expected rows. Either scan does
not start on t
Care to share that TestPutScan? Just attach it in a pastebin
Thx,
J-D
On Tue, May 29, 2012 at 6:13 AM, Ondřej Stašek
wrote:
> My program writes changes to HBase table by issuing lots of Puts (autoCommit
> turned off, flush on end) and afterwards uses ResultScanner on whole table
> to read all r
Here it is:
http://pastebin.com/0AgsQjur
On 29.5.2012 22:44, Jean-Daniel Cryans wrote:
Care to share that TestPutScan? Just attach it in a pastebin
Thx,
J-D
On Tue, May 29, 2012 at 6:13 AM, Ondřej Stašek
wrote:
My program writes changes to HBase table by issuing lots of Puts (autoCommit
t
I'm running it here, but I just remembered about this issue:
"HTable.ClientScanner needs to clone the Scan object"
https://issues.apache.org/jira/browse/HBASE-4891
And since you are reusing that Scan object, you could definitely hit this issue.
J-D
On Tue, May 29, 2012 at 11:37 PM, Ondřej Staše
There you go:
12/05/30 18:54:17 DEBUG client.MetaScanner: Scanning .META. starting
at row=testtable,,00 for max=10 rows using
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@f593af
12/05/30 18:54:17 DEBUG
client.HConnectionManager$HConnectionImplementation:
Hallo J-D.
Thanks for reply. I've modified my code to use scanner copies -
table.getScanner(new Scan(scan)) and run it again. Even after that I got
an error:
12/05/31 10:42:39 INFO hbase.TestPutScan: Run 5 put 100 rows
12/05/31 10:44:09 INFO hbase.TestPutScan: Run 5 scan + del every 10t
There's concurrent thread on the mailing list that refers to
atomicity issues in 0.90 and issues with scans, may I suggest you run
the test on 0.92.1 or 0.94.0? I did my testing on 0.94 and didn't get
any issues after fixing the scanner.
J-D
On Thu, May 31, 2012 at 3:05 AM, Ondřej Stašek
wrote:
Hallo J-D.
I'm currently tied to 0.90.6-cdh3u4. And this 1-row-skip seems to be the
result of some strange RS restart. My test job is running now for
several hours without error. I'll try to investigate it further and come
up with some result.
Regards
Ondrej Stasek
On 31.5.2012 19:45, Je
