Let's say I have one client on each of my regionservers. Each client needs
to do a full scan on the same table. The order in which the rows are
scanned by clients does not matter.
Is it possible to have each client start at a random (or better, the first
row located on the local rs) point in
://hbase.apache.org/apidocs/org/apache/hadoop/hbase/KeyValue.html#getBuffer%28%29
.
In my case the value returned by myKV.getBuffer().length is greater than
myKV.getLength(). What possibly went wrong?
TIA
Kim.
--
Robert Dyer
rd...@iastate.edu
see anything. Not in the region server, and not in the
datanode.
Also, to check with HDFS level logs whether the checksum meta file is
getting read to the DFS client, I'm not really sure how to acheive
that.
JM
2013/2/1, Robert Dyer rd...@iastate.edu:
Ok grepping the RS logs I see
Not trying to hijack your thread here...
But can you verify via logs that the shortcircuit is working? Because I
enabled shortcircuit but I sure didn't see any performance increase.
I haven't tried enabling hbase checksum yet but I'd like to be able to
verify that works too.
On Thu, Jan 31,
locality? Region movements
across RSs can break the full data locality.
-Anoop-
From: Robert Dyer [psyb...@gmail.com]
Sent: Friday, February 01, 2013 11:10 AM
To: Hbase-User
Subject: Re: HBase Checksum
Not trying to hijack your thread here
:
New issue, the other one is too old.
Thx!
J-D
On Mon, Dec 17, 2012 at 6:39 PM, Robert Dyer rd...@iastate.edu wrote:
Seems plausible. A simple grep reveals this:
mapreduce/TableInputFormatBase.java: hostName =
DNS.reverseDns(ipAddress, this.nameServer);
which is not doing
which is fixed by 7214.
Also, I will recommand you to disable the DEBUG level for this class
if you can't migrate to 0.94.4
JM
2013/1/27, Ted Yu yuzhih...@gmail.com:
This should have been fixed by HBASE-7214 which is in 0.94.4
Cheers
On Sun, Jan 27, 2013 at 5:51 PM, Robert Dyer psyb
That's what I thought too. Except I am running 0.94.2 and this fix was
released in 0.90.4.
On Mon, Dec 17, 2012 at 5:11 PM, Stack st...@duboce.net wrote:
On Sun, Dec 16, 2012 at 1:16 AM, Robert Dyer psyb...@gmail.com wrote:
I recently enabled reverse DNS on my test cluster. Now when I run
?
On Mon, Dec 17, 2012 at 8:21 PM, Jean-Daniel Cryans jdcry...@apache.orgwrote:
Maybe TableInputFormatBase.getSplits is missing something similar to
HBASE-4109?
J-D
On Mon, Dec 17, 2012 at 5:26 PM, Robert Dyer psyb...@gmail.com wrote:
That's what I thought too. Except I am running 0.94.2
I recently enabled reverse DNS on my test cluster. Now when I run a MR
job, the HBase input split locations are all adding a period to the end.
For example:
/default-rack/foo-1.
/default-rack/foo-2.
Yet the machine locations are still correct:
/default-rack/foo-1
/default-rack/foo-2
Since
someone point me to the right classes to look at to implement
the solution 2?
Thanks,
JM
--
Robert Dyer
rd...@iastate.edu
into it ;) It's a quick
and dirty PerformanceBalancer. It's not a CPULoadBalencer.
Anyway, I will give more details over the week-end, but there is
absolutly nothing extraordinaire with it.
JM
2012/12/8, Robert Dyer rd...@iastate.edu:
I too am interested in this custom load
12 matches
Mail list logo
