On Thu, Mar 3, 2011 at 10:19 PM, Aditya Sharma wrote:
>
> Since we are using EC2 Large instances, it seems unlikely that network or
> some other virtualization related resources crunch are affecting our
> performance measurement.
>
>
You are guaranteed to see large variance in results when benchma
On Thu, Mar 3, 2011 at 10:21 PM, Gaojinchao wrote:
> Hbase version : 0.90.1
> Hdfs verison : 0.20.1( that don't have append feature)
>
Fixing the above, using an hadoop w/ append, would help.
Did you crash out your regionservers?
> 1497 inconsistencies detected.
> Status: INCONSISTENT
How man
It was quite variable, as I said earlier, but in one sort of representative
READs only benchmark, it was 115 READs per second. For a READ + WRITE
benchmark, it was 90 operations per second (with some primitive caching
thrown in).
Aditya
On Fri, Mar 4, 2011 at 11:54 AM, Ted Dunning wrote:
> Wha
Hi,
I would like to use HBase to read from a csv file. is there any sample java
code that i could use. Any tutorial also would be welcome.
--
With Regards,
Jr.
What kinds of speeds are you seeing?
On Thu, Mar 3, 2011 at 10:19 PM, Aditya Sharma wrote:
> Hi All,
>
> I am working on benchmarking different data stores to find the best fit for
> our use case. I would like to know views and suggestions of the HBase user
> and developer community on some of my
Which hbase version did you use ?
On Thu, Mar 3, 2011 at 10:19 PM, Aditya Sharma wrote:
> Hi All,
>
> I am working on benchmarking different data stores to find the best fit for
> our use case. I would like to know views and suggestions of the HBase user
> and developer community on some of my fi
Hbase version : 0.90.1
Hdfs verison : 0.20.1( that don't have append feature)
How can I fix this lost regions ?
I use hbck checking
Log as:
Summary:
-ROOT- is okay.
Number of regions: 1
Deployed on: c3s7.site:60020
.META. is okay.
Number of regions: 1
Deployed on: c3s2.site
Hi All,
I am working on benchmarking different data stores to find the best fit for
our use case. I would like to know views and suggestions of the HBase user
and developer community on some of my findings as the results I am getting
are highly variable.
My HBase Setup has two EC2 Large hosts (ea
Master: http://pastebin.com/kv3Guz71
RS: http://pastebin.com/9EixG9GB
Thanks,
Murali Krishna
From: Jean-Daniel Cryans
To: user@hbase.apache.org
Sent: Fri, 4 March, 2011 12:23:06 AM
Subject: Re: Log rolling failed with ioe
The mailing list strips the attachem
What about adding a simple message box using bash's whiptail?
For example:
rs=$(cat ${HBASE_CONF_DIR}/regionservers | xargs)
if ( whiptail --yesno "Do you want to shutdown the cluster with the
following regionserver $rs\n[y/n]" 10 40 )
then
# proceed with the shutdown
else
# e
Yeah... but I think that stopping the last master shouldn't kill the cluster
either.
On Thu, Mar 3, 2011 at 4:17 PM, Ryan Rawson wrote:
> with multiple masters, shutting down a master should NOT cause a
> cluster death!
>
> I ran in to this once, sucked.
>
> I have previously commented, I though
with multiple masters, shutting down a master should NOT cause a
cluster death!
I ran in to this once, sucked.
I have previously commented, I thought we had removed the 'master exit
= cluster death' but I'm not sure.
-ryan
On Thu, Mar 3, 2011 at 4:14 PM, Ted Dunning wrote:
> I think that the p
I think that the proposal on the table is to actually simplify things a bit
by making the shutdown of the master
not cause the shutdown of the regions. Less coupling is simpler.
On Thu, Mar 3, 2011 at 2:47 PM, M. C. Srivas wrote:
> To tell you the truth, I really like the simplicity that exists
Hi,
Sorry for not getting back to you earlier. I haven't had any chance to run
HBase since then, but for this weekend , I will. I'll let you know the result
soon.
Thanks,
--
Tatsuya Kawano
Tokyo, Japan
On Feb 24, 2011, at 8:25 PM, 陈加俊 wrote:
> Thank you ! HBase version is 0.20.6
>
> O
To tell you the truth, I really like the simplicity that exists today in
launching a hbase cluster
- start the master somewhere
- start the RS's wherever you like
And it just works! Very nice.
Perhaps adding an acl on the master in is order to prevent the unexpected
shutdown (or extra maste
Here it is: https://issues.apache.org/jira/browse/HBASE-3597
I think we'll have the opportunity to test out cluster replication and provide
feedback soon.
Otis
Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch
Lucene ecosystem search :: http://search-lucene.com/
- Original Me
Yep, it just occurred to me while answering you :) I'm the only dev
who worked on the replication stuff, any contribution or just testing
out the software is really appreciated.
J-D
On Thu, Mar 3, 2011 at 12:10 PM, Otis Gospodnetic
wrote:
> Aha, so the fact that the age doesn't change when repli
Aha, so the fact that the age doesn't change when replication keeps retrying is
really a bug?
Otis
- Original Message
> From: Jean-Daniel Cryans
> To: user@hbase.apache.org
> Sent: Thu, March 3, 2011 2:17:08 PM
> Subject: Re: Questions about HBase Cluster Replication
>
> No it's th
And there is
http://blog.sematext.com/2010/08/30/hbase-case-study-using-hbasetestingutility-for-local-testing-development/
St.Ack
On Thu, Mar 3, 2011 at 10:48 AM, Weishung Chung wrote:
> Bill, thank you for the clarification.
> Ted, good info, i will iterate the map backwards then :)
>
> Another
No it's the age in ms:
ageOfLastAppliedOp.set(System.currentTimeMillis() - timestamp);
And the timestamp is the one given to the HLogEdit, not the timestamp
of the cell.
J-D
On Thu, Mar 3, 2011 at 11:13 AM, Otis Gospodnetic
wrote:
> Is that really the *age* really the *timestamp* of last succe
Is that really the *age* really the *timestamp* of last successful log shipment?
If so, one could calculate the real age with age = now() -
ageOfLastShippedOnWhichIsReallyTimestamp . And that would be useful to have.
Otis
Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch
Lucene ecos
src/test/java/org/apache/hadoop/hbase/MiniHBaseCluster.java is used in many
tests.
You can call the following HBaseAdmin method to create table with multiple
regions:
public void createTable(HTableDescriptor desc, byte [] startKey,
byte [] endKey, int numRegions)
On Thu, Mar 3, 2011 at 1
The mailing list strips the attachements, can you pastebin them or
host them on a web server?
Thx,
J-D
On Thu, Mar 3, 2011 at 10:49 AM, Murali Krishna. P
wrote:
> No exceptions before that, sending few lines before them in the log file.
> Also there was a similar retry error in master log also
No exceptions before that, sending few lines before them in the log file. Also
there was a similar retry error in master log also just before this. Attached
both master and rs log
Thanks,
Murali Krishna
From: Jean-Daniel Cryans
To: user@hbase.apache.org
Sen
Bill, thank you for the clarification.
Ted, good info, i will iterate the map backwards then :)
Another question I have is about unit testing in HBase, any recommendation
about the best way to simulate the cluster, I read about the built in mini
cluster. Also, how to change the region size to simu
Stack writes:
>
> You saw my previous set of questions about your issue? ('Wed, Mar 2,
> 2011 at 10:39 AM')
> St>Ack
>
I went back and checked my previous post and could not find your response. Could
you please post the questions again?
We are able to bulk load several other tables, but one
>> Would these region infos be sorted according to the keys?
Yes.
>> If so, I would just get the last region info from the last element in the
map. (trying to get last row)
If your table is created with multiple regions, the last region may not
contain any row. You can iterate the map backwards.
It's a work in progress, that information is currently published by
every region server in the master cluster (since it's push
replication, not pull) through JMX under the name
"ageOfLastShippedOp". It's really not perfect though, since if it
fails to replicate and starts retrying then the age won'
Actually, how far behind replication is w.r.t. edit logs is different
than how out of sync they are, but you get the idea.
On Thu, Mar 3, 2011 at 9:07 AM, Bill Graham wrote:
> One more question for the FAQ:
>
> 6. Is it possible for an admin to tell just how out of sync the two
> clusters are? So
One more question for the FAQ:
6. Is it possible for an admin to tell just how out of sync the two
clusters are? Something like Seconds_Behind_Master in MySQL's SHOW
SLAVE STATUS?
On Wed, Mar 2, 2011 at 9:32 PM, Jean-Daniel Cryans wrote:
> Although, I would add that this feature is still experi
This first region starts with an empty byte[] and the last region ends
with one. Those in between have non-empy byte[]s to specify their
boundaries.
On Thu, Mar 3, 2011 at 7:18 AM, Weishung Chung wrote:
> Thanks, Stack!
>
> Got a few more questions.
>
> Does every region start with an empty byte[
Ted, one thing to point out though is that in the scenario I
described, the same thing would happen if you didn't call
start-hbase.sh. The start/stop behaviors I described are independent
of each other so you can stop the cluster remotely even without the
second master running.
This is because sto
That's just what I need. Thanks Stack
On Wed, Mar 2, 2011 at 8:38 PM, Stack wrote:
> Sorry about the broken links. We changed site generation systems
> recently and we are still chasing down differences. Should be fixed
> now. Meantime, this probably what you want:
> http://hbase.apache.org/a
On Thu, Mar 3, 2011 at 2:31 AM, David Pérez wrote:
> I have installed a standalone version of HBase 0.20.6 into a Linux machine.
> The web interface works ok.
>
Please use our current stable offering, 0.90.1.
> Now with a basic Java client from another machine, I can successfully create
> a tabl
You saw my previous set of questions about your issue? ('Wed, Mar 2,
2011 at 10:39 AM')
St>Ack
On Thu, Mar 3, 2011 at 7:48 AM, Shaheen Bahauddin
wrote:
>
>
> Hi
>
> I am facing a problem where I used Hbase 0.89 version
> HFileOutputFormat api to convert the sequence data files into HFiles
> form
Hi
I am facing a problem where I used Hbase 0.89 version
HFileOutputFormat api to convert the sequence data files into HFiles
format and then used LoadIncrementalHFiles (completebulkload) to load
the Hfiles into an existing table. I do see the data when I cat the
region server files but can't
Thanks, Stack!
Got a few more questions.
Does every region start with an empty byte[] and end with one too? Also, if
i get all the region infos using
Map map = table.getRegionsInfo();
Would these region infos be sorted according to the keys? If so, I would
just get the last region info from the l
Anything that comes before that? More exceptions? Can you see what's
at the beginning of them? I'm more interested in the symptoms rather
than the side effects.
Thx,
J-D
On Thu, Mar 3, 2011 at 5:49 AM, Murali Krishna. P
wrote:
> Hi,
> I get following error frequently (twice in a day atleast) an
Hi,
I get following error frequently (twice in a day atleast) and the region server
closes and exits after this. I am on 0.20.6 and we are stuck with this for some
time. Will be upgrading to 0.90.0 later, but right now, would be great if we
can
have a workaround. Let me know if you need more in
Hi,
I'm quite newbie into the HBase world, and I'm having basic problems.
I have installed a standalone version of HBase 0.20.6 into a Linux machine.
The web interface works ok.
Now with a basic Java client from another machine, I can successfully create
a table and some families.
I can also s
40 matches
Mail list logo
