Hi
I am trying to monitor HBase using JMX.
I enabled JMX using *$HABASE_HOME/conf/hbase-env.sh* configuration file by
adding the following lines:
*export HBASE_JMX_BASE="-Dcom.sun.management.jmxremote.ssl=false**
-Dcom.sun.management.jmxremote.authenticate=false"**export
HBASE_M
hi，I got a metaLogRoller bug can make regionserver abort，and now I use a conf
named hbase.regionserver.logroll.errors.tolerated to ignore the problem I don't
now how to solve it directly，please help meHBASE-13566 ： As hbase run
MetaLogRoller thread for writting meta hlog, I got
ould you please help me with suggestions on whether i should use
1) Hive
2) HBase
3) Hive over HBase
4) Pig over HBase
Thanks
Vivek
Apologies. The Subject was supposed to be *Hbase Monitoring using JMX*
On Wed, Jun 12, 2013 at 1:00 PM, Hanish Bansal <
hanish.bansal.agar...@gmail.com> wrote:
> Hi
>
> I am trying to monitor HBase using JMX.
>
> I enabled JMX using *$HABASE_HOME/conf/hbase-env.sh* co
Hello,
Has anyone done any work towards making HBase work with Castle? (looks like
negative: http://search-hadoop.com/?q=castle&fc_project=HBase )
Here's why I'm asking:
http://www.acunu.com/blogs/richard-low/cassandra-under-heavy-write-load-part-ii/
http://www.acunu.com/blo
Has anyone tried installing the patch for search?
If yes can you give me how to install and use it?
https://issues.apache.org/jira/browse/HBASE-3529
I am using Cloudera HBase distribution ( hbase-0.90.3-cdh3u1).
Thanks & Regards
- Abhay
Hi,
Does anyone know or have any guesses about which HBase versions are being
used the most?
I'd love to know what percentage of HBase clusters out there are still
using 0.94.x or below?
Are there more users using 0.94.x and below or 0.96.x and above?
Any educated guesses?
Thanks,
I'm going through the overiew-summary instructions for setting up and running
hbase. Right now I'm running hbase in pseudo-distributed mode, and looking to
go fully-distributed on 25 nodes.
Every time I restart hbase, I get:
Couldn't start ZK at requested address of "n
I would like to get specified value from the table which don't mind its family
and column.
I used ValueFilter to make it ,but i get nothing .
My code is :
try
{
HTable htable = new
HTable(hconf,Bytes.toBytes(tablename));
Hi,
When I run a program including some basic operations on HBase tables for
several hours,Hbase stops.My hadoop version is 0.20.203.0 and Hbase
version is 0.90.4.
The Hbase log is as follows:
2012-04-25 00:03:44,190 DEBUG org.apache.hadoop.hbase.master.HMaster: Not
running balancer because 2
Hi,
What is the latest version of HBase? I see in the download page that it's
version 2.2.0, but I see in the documentations "version 3.0.0-SNAPSHOT".
Please advise,
Thanks,
Ido
I want to be hbase contributor, Thanks!
Excuse me sir, Why When i run hbase from github in my computer the Hmaster
stop a few second when i start the hbase?
like this photo sir
re: "30 million records."
We're obviously pro-HBase on this dist-list but one of the challenges of
HBase (and Hadoop in general) is that the architecture can tend to be
overkill on smaller datasets. That doesn't mean you shouldn't try HBase,
but expectations should
Vivek,
Can you elaborate on 4? Storing data in HDFS directly does not give you the
option of updating it. However, that's not a good enough reason to use
HBase. Do you need random reads/writes outside of just the selective
increments? Can you store the increments in a separate file and then
Thanks Doug.
30 million is the size to start with, growth rate is about 1 million per
week
You mention HBase being used to generate summaies into an RDBMS, i am not
quite sure i understood this approach very well.
How would you generate the summaries from raw HBase data & update into a
R
;
> Can you elaborate on 4? Storing data in HDFS directly does not give you the
> option of updating it. However, that's not a good enough reason to use
> HBase. Do you need random reads/writes outside of just the selective
> increments? Can you store the increments in a separate f
It would look something like this...
http://hbase.apache.org/book.html#mapreduce.example.summary
... Except your output would be to an RDBMS, instead of HBase.
On 10/27/11 2:51 PM, "viva v" wrote:
>Thanks Doug.
>
>30 million is the size to start with, growth rate is
Hi guys,
I'm new on Hbase, and I've notice a strange problem during an Hbase filter
scan.
I tried to start one insert process, that insert continually many record
into one table. So, during that, I tried to launch a second process for
querying the DB with a filtered scan. So.d
Dear all,
I set up my HBase server in standalone mode.
Can HBase Client (from another machine) connect to this HBase server?
How can I do that?
A lot of people have the same question. But I did not find correct answer.
Thank a lot for support.
Is this exception seen in the client side? Was your HBase still running
fine at that moment?
How many connections do you open in your client? Which HBase version is it?
Thanks,
Jimmy
On Wed, Apr 3, 2013 at 1:47 AM, Dhanasekaran Anbalagan
wrote:
> Hi Guys,
>
> I trying to run hb
Since the exception came from zookeeper, please check zookeeper log(s) on
the quorum.
Thanks
On Wed, Apr 3, 2013 at 8:43 AM, Jimmy Xiang wrote:
> Is this exception seen in the client side? Was your HBase still running
> fine at that moment?
>
> How many connections do you open in
Hi everybody,
I want to upgrade my HBase cluster (currently running 0.90.2) to 0.94.
Is it possible to upgrade right away or do I need to install 0.92 first ?
If anyone already did this kind of upgrade, do you have some tips and key
notes ?
Thanks,
Amit.
Hello,
I came across this ticket for multiple table scans via and their use in
Map/Reduce jobs:
https://issues.apache.org/jira/browse/HBASE-3996
https://reviews.apache.org/r/4411/diff/7/
There is a patch for this now and it is mentioned in the comments that the
functionality could be useful for
I even move /hbase to hbase2, and create a new dir /hbase1, modify
hbase-site.xml to:
hbase.rootdir
hdfs://Hadoop48:54310/hbase1
zookeeper.znode.parent
/hbase1
But the error message still KeeperErrorCode = NoNode for /hbase
Any body can give any help?
Thanks!
Andy zhou
Hello list,
Although the issue <https://issues.apache.org/jira/browse/HBASE-7693> has
been fixed, it looks like i'm hitting it.
*Environment :*
hadoop-1.1.2
hbase-0.94.9
OS X 10.8.4 (12E55)
I'd really appreciate if somebody could throw some light.
Here is the trace I see when
Hi,
Let's see where we are! :)
1-question poll:
http://blog.sematext.com/2015/03/11/hbase-poll-version/
Btw:
6 months ago the guess was that HBase version usage distribution was:
60% 0.94
30% 0.96
10% 0.98
Another person said:
*Now that 0.96 has been EOL'd you should see users mi
I saw the acunu guy at oscon data, and from what I could tell is they
completely rewrote Cassandra to get out of java land...
On Sep 5, 2011 1:50 PM, "Otis Gospodnetic"
wrote:
> Hello,
>
> Has anyone done any work towards making HBase work with Castle? (looks
like nega
c"
>
> wrote:
>> Hello,
>>
>> Has anyone done any work towards making HBase work with Castle? (looks
> like negative: http://search-hadoop.com/?q=castle&fc_project=HBase )
>>
>>
>> Here's why I'm asking:
>>
> http
Hi Otis,
HBase 0.94 is there for a while and wildly used. However, it's open source.
So there is no number of who's using what.
I will say that 0.94 is most probably sill the most used version. Followed
by 0.96 probaly close to 0.98... Numbers? Without any scientific value and
with no
Jean-Marc Spaggiari <
jean-m...@spaggiari.org> wrote:
> Hi Otis,
>
> HBase 0.94 is there for a while and wildly used. However, it's open source.
> So there is no number of who's using what.
>
> I will say that 0.94 is most probably sill the most used version. F
i have cloudera cluster,
i am exploring spark with HBase,
after going through this blog
http://blog.cloudera.com/blog/2014/11/how-to-do-near-real-time-sessionization-with-spark-streaming-and-apache-hadoop/
i found two options for using Spark with HBase,
Cloudera's Spark on HBase or
A
Hi,
I'm looking for some guidance as our security team is requiring us to
implement encryption of our HBase data at rest and in motion. I'm reading
the docs and doing research and the choice seems to be between doing it at
the HBase level or the more general HDFS level.
I am leaning to
Hi,
We are looking into migrating from HBase 1.2.x to HBase 2.1.x (on Cloudera
CDH).
It seems like HBase 2 is slower than HBase 1 for both reading and writing.
I did a simple test, using HBase 1.6.0 and HBase 2.2.4 (the standard OSS
versions), running in local mode (no HDFS) on my computer
What version of HBase are you using - 0.20.x or 0.89 ?
On Mon, Sep 13, 2010 at 2:41 AM, fitman_82 wrote:
>
> Hi guys,
> I'm new on Hbase, and I've notice a strange problem during an Hbase filter
> scan.
> I tried to start one insert process, that insert continually man
place hbase-site.xml with two parameters in you classpath.
hbase.zookeeper.quorum=your host
hbase.zookeeper.property.clientPort=2181 (this parameter is optional)
another way, create Configuration and set this parameters from any sources
you like
(i use for example jndi in some of my apps).
c
wrote:
> place hbase-site.xml with two parameters in you classpath.
>
> hbase.zookeeper.quorum=your host
> hbase.zookeeper.property.clientPort=2181 (this parameter is optional)
>
> another way, create Configuration and set this parameters from any sources
> you like
> (i use
Are HBase and client on the same machine?
2010/12/23 King JKing
> But still error...
> 10/12/23 14:26:06 INFO ipc.HbaseRPC: Server at /127.0.0.1:45369 could not
> be
> reached after 1 tries, giving up.
> 10/12/23 14:26:07 INFO ipc.HbaseRPC: Server at /127.0.0.1:45369 could not
HBase and client are on the different machine
On Thu, Dec 23, 2010 at 2:32 PM, Andrey Stepachev wrote:
> Are HBase and client on the same machine?
>
> 2010/12/23 King JKing
>
> > But still error...
> > 10/12/23 14:26:06 INFO ipc.HbaseRPC: Server at /127.0.0.1:
Hi,
Here is the code I use to connect to a remote HBase. You'll note most of
the connection information is in the m_configuration.set methods.
/**
* Method setupHBaseConnection
*
* If production has a problem connecting make sure the
* hbase-0.89.20100924+28-tests.jar i
Looks like in zookeeper stored wrong region server address. Try to specify
real address in hbase config
(hbase-site.xml in conf dir of hbase installation).
something like this.
hbase.zookeeper.quorum
you_host_or_ip
Comma separated list of servers in the ZooKeeper Quorum
I had already config this parameter. But still error
On Thu, Dec 23, 2010 at 2:48 PM, Andrey Stepachev wrote:
> Looks like in zookeeper stored wrong region server address. Try to specify
> real address in hbase config
> (hbase-site.xml in conf dir of hbase installation).
>
> some
>
> > Looks like in zookeeper stored wrong region server address. Try to
> specify
> > real address in hbase config
> > (hbase-site.xml in conf dir of hbase installation).
> >
> > something like this.
> >
> >
> > hbase.zookeeper.quorum
>
No. When I add your code to hbase-site.xml and restart HBase Server. When I
run HBase Client, client hang up.
Here is some information on HBase server
[r...@me-182 conf]# netstat -an|grep 6
tcp0 0 :::127.0.0.1:6 :::*
LISTEN
tcp0 0 :::127.0.0.1:18965
Wey strange. Can you post
http://you_hbase_server:60010/zk.jsp<http://mars.nkb:60010/zk.jsp> (or
zk_dump from hbase shell)
2010/12/23 King JKing
> No. When I add your code to hbase-site.xml and restart HBase Server. When I
> run HBase Client, client hang up.
>
> Here is s
after 1 tries, giving up.
On Thu, Dec 23, 2010 at 3:24 PM, King JKing wrote:
> No. When I add your code to hbase-site.xml and restart HBase Server. When I
> run HBase Client, client hang up.
>
> Here is some information on HBase server
>
> [r...@me-182 conf]# netstat -an|grep 60
HBase tree in ZooKeeper is rooted at /hbase
Cluster up? true
Master address: 127.0.0.1:6
Region server holding ROOT: 127.0.0.1:15587
Region servers:
- 127.0.0.1:15587
Quorum Server Statistics:
- 10.30.12.182:2181
Zookeeper version: 3.3.1-942149, built on 05/07/2010 17
. check you dns.
2010/12/23 King JKing
> HBase tree in ZooKeeper is rooted at /hbase
> Cluster up? true
> Master address: 127.0.0.1:6
> Region server holding ROOT: 127.0.0.1:15587
> Region servers:
>- 127.0.0.1:15587
> Quorum Server Statistics:
>- 10.30
My HBase is running in standalone mode. Can HBase Client connect to a remote
HBase (running in standalone mode)?
On Thu, Dec 23, 2010 at 3:44 PM, Andrey Stepachev wrote:
> As you see, Region servers and master reigsted on 127.0.0.1, so clients
> can't reach them.
> Why it is i c
I encountered same issue, if you use /etc/hosts file check if your
machine name is associated with 127.0.0.1. At limit, comment any line
containing 127.0.0.1 and restart hbase then retry.
On 12/23/2010 10:44 AM, Andrey Stepachev wrote:
As you see, Region servers and master reigsted on
2010/12/23 King JKing
> My HBase is running in standalone mode. Can HBase Client connect to a
> remote
> HBase (running in standalone mode)?
>
Yes. Propblem is in incorrect dns/hosts configuration. Remote client can't
reach your server,
because HBase uses incorrect address.
&
When I comment any line contain 127.0.0.1, HBase server can not run :(
On Thu, Dec 23, 2010 at 4:21 PM, Andrey Stepachev wrote:
> 2010/12/23 King JKing
>
> > My HBase is running in standalone mode. Can HBase Client connect to a
> > remote
> > HBase (running in stand
Please note that there is an issue with a test config file in the
hbase-test.jar that overrides the configuration. Can you make sure you
do not have the hbase-test.jar on your client's classpath?
Lars
On Thu, Dec 23, 2010 at 9:34 AM, King JKing wrote:
> When I comment any line
I've deleted this file. But error still :(
Here is my zk_dump value
HBase tree in ZooKeeper is rooted at /hbase
Cluster up? true
Master address: 127.0.0.1:6
Region server holding ROOT: 127.0.0.1:50752
Region servers:
- 127.0.0.1:50752
Quorum Server Statistics:
- 10.30.1
Thank everybody,
I can connect to remote HBase by HBase Client :)
I just comment line
127.0.0.1mypc
on hosts and add line
10.199.25.23mypc
More
http://db.tmtec.biz/blogs/index.phAfterreadp/get-hadoop-up-and-running-without-dns,
*master *
::1 localhost6.localdomain6 localhost6
I see you have ipv6 hosts defined in there too. For HBase, you should
disable ipv6 if possible to prevent performance problems.
2010/12/23 King JKing
> Thank everybody,
>
> I can connect to remote HBase by HBase Client :)
>
> I just comment line
> 127.0.0.1mypc
>
Hello guys.
I just have installed hbase on my hadoop cluster.
HMaster,HRegionServer,HQuorum Peer all are working fine.. as I can see these
processes running through JPS.
Is there any way to know which regionservers are running right and not ?
I mean is there some kind of hbase web UI or anyway
On 16/04/12 16:49, Alex Baranau wrote:
> Here's some code that worked for me [1]. You may also find useful to look
> at the pom's dependencies [2].
Thanks, Your cluster initialization is certainly more elegant than what
I had. However it still gives me the same error as I reported. Moreover,
I've
Just tried to do a clean clone, then
$ mvn -Dtest=TestHBaseHutCps test
went well [1].
How long does it take for test to fail when you run it?
Some sanity checks:
1) make sure you don't have 127.0.1.1 in your /etc/hosts (only 127.0.0.1)
2) make sure there are no hbase/hadoop processes ru
On 16/04/12 16:49, Alex Baranau wrote:
> Here's some code that worked for me [1]. You may also find useful to look
> at the pom's dependencies [2].
Thanks, Your cluster initialization is certainly more elegant than what
I had. However it still gives me the same error as I reported. Moreover,
I've
Are you going to use rolling upgrade ?
Cheers
On Mon, May 28, 2012 at 6:56 AM, Amit Sela wrote:
> Hi everybody,
>
> I want to upgrade my HBase cluster (currently running 0.90.2) to 0.94.
>
> Is it possible to upgrade right away or do I need to install 0.92 first ?
>
>
>From what I read a rolling restart from 90 to 94 is not expected to work...
I was thinking of a shutdown & restart.
If anyone did it, I'd be happy to get some pointers of what I should (and
shouldn't) do.
By the way, I'm currently running HBase with hadoop 0.20.3 - shoul
From 0.92.2 to 0.94, you can´t use rolling upgrade,because the wire
protocol changed in these versions.
So, yo have to shutdown the cluster, install the new version, update the
HBase classpath and start the cluster with
the new version
On 05/28/2012 11:16 AM, Amit Sela wrote:
From what I
If my memory is correct, there're a few items that Stack pointed out which
are still outstanding for
HBASE-3996<https://issues.apache.org/jira/browse/HBASE-3996>
.
Cheers
On Tue, Jul 17, 2012 at 1:39 PM, David Koch wrote:
> Hello,
>
> I came across this ticket for multiple
Hi Ted,
Thank you for your reply. You are right, the ticket has not been closed
yet. At this point, I am mainly trying to understand how
MultiTableInputCollection
can be used to do Joins between HBase tables, if possible with an example.
Thanks,
/David
On Tue, Jul 17, 2012 at 11:07 PM, Ted Yu
Hi,
The issue is in ZooKeeper, not directly HBase. It seems its data is
corrupted, so it cannot start. You can configure zookeeper to another
data directory to make it start.
N.
On Thu, Aug 2, 2012 at 11:11 AM, abloz...@gmail.com wrote:
> I even move /hbase to hbase2, and create a new
Thank you, Keywal and Mohammad.
I also think the data is corrupted, but the zookeeper is inner of Hbase, I
don't know how to change the zookeeper data directory. I'll try this way.
So if kill java process rudely, there may be corrupted of data. But
sometimes, stop shell script wil
The problem resolved. it caused by the zookeeper data corrupted. so I
modified zookeeper data dir to another directory on hbase-site.xml and
restart hbase again.
hbase.zookeeper.property.dataDir
/home/zhouhh/myhadoop/zk
Property from ZooKeeper's config zo
At work we are attempting to do the following:
- Run Elastic MapReduce jobs via Amazon, which freezes Hadoop at version
0.20.205
- Write output to HBase running on EC2, specifically, 0.92.1-cdh4.0.1 from
Cloudera
What I've discovered so far is my WordCount test appears to work when I
pa
Looking at ./src/core/org/apache/hadoop/net/DNS.java in hadoop branch-1,
here is line 79 :
String hostname = attribute.get("PTR").get().toString();
It is not clear which part was null.
Reading HBASE-7693 once more, it says:
PTR records contain a trailing period, which then shows
oop branch-1,
> here is line 79 :
>
> String hostname = attribute.get("PTR").get().toString();
>
> It is not clear which part was null.
>
> Reading HBASE-7693 once more, it says:
>
> PTR records contain a trailing period, which then shows up in the input
&g
Hi All,
We are thinking of running HBase(we have JVM heaps larger than 25 GB) with
JDK7 to use G1 garbage collection, but as a precaution we would like HBase
to be certified with JDK7. I see this ticket for same:
https://issues.apache.org/jira/browse/HBASE-5261
Above havent had any activity from
on 0.98) or they
are in the process to move to HBase 1.0
cheers,
esteban.
--
Cloudera, Inc.
On Thu, Mar 12, 2015 at 7:45 AM, Otis Gospodnetic <
otis.gospodne...@gmail.com> wrote:
> Hi,
>
> Let's see where we are! :)
>
> 1-question poll:
> http://blog.semat
rsday, March 12, 2015 7:45 AM
Subject: Poll: HBase usage by HBase version
Hi,
Let's see where we are! :)
1-question poll:
http://blog.sematext.com/2015/03/11/hbase-poll-version/
Btw:
6 months ago the guess was that HBase version usage distribution was:
60% 0.94
30% 0.96
10% 0.98
Anothe
easily. But your vote does not
> count as much as somebody who's running 1000 machines.
> -- Lars
> From: Otis Gospodnetic
> To: "user@hbase.apache.org"
> Sent: Thursday, March 12, 2015 7:45 AM
> Subject: Poll: HBase usage by HBase version
>
> Hi,
>
If you haven't already seen it - take a look at the bridge at
https://issues.apache.org/jira/browse/HBASE-12814
We're using it to go through the process now.
Dave
On Wed, Mar 18, 2015 at 5:46 PM, Bryan Beaudreault wrote:
> My only complaint about this poll is the labels: &qu
Super useful, thanks Dave!
On Wed, Mar 18, 2015 at 11:25 PM, Dave Latham wrote:
> If you haven't already seen it - take a look at the bridge at
> https://issues.apache.org/jira/browse/HBASE-12814
> We're using it to go through the process now.
>
> Dave
>
> On Wed,
poor labeling. I
didn't mean to imply things with that, but it looks like I inadvertently
did.
Lars, true but we'll leave that for another poll :)
In the mean time, people, a few more votes, please:
http://blog.sematext.com/2015/03/11/hbase-poll-version/
Thanks,
Otis
--
Monitor
Hi,
I promised the results. Here they are, along with a short commentary:
http://blog.sematext.com/2015/03/23/poll-results-hbase-version-distribution/
Otis
--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr & Elasticsearch Support * http://sematext.com/
On Thu,
HI All,
I am new to hbase shell and don't know this is normal or not.
When I run a hbase command it return all kind of information like java libs etc
before a result was return. Please see screen shot. Thank you very much.
Garry
[cid:image001.png@01D066D7.0610A3E0]
Hi,
We are planning to move our cluster from hbase 0.94.14 to 0.98.2.
Our query is -
If we have backup taken(using snapshots) on hbase 0.94.14, can we restore
the same backup on newer version of hbase 0.98.2?
Thanks
oc.tsdb
Hi all,
Is it possible to run CopyTable from a CDH5 Hbase cluster to copy data from a
CDH4 hbase cluster?
Thanks,
Libo
So Hbase-spark is a continuation of the spark on hbase project, but within
the Hbase project.
They are not any significant differences apart from the fact that Spark on
hbase is not updated.
Dependent on the version you are using it would be more beneficial to use
Hbase-Spark
Kay
On 5 Apr 2016 9
There are some outstanding bug fixes, e.g. HBASE-15333, for hbase-spark
module.
FYI
On Tue, Apr 5, 2016 at 2:36 PM, Nkechi Achara
wrote:
> So Hbase-spark is a continuation of the spark on hbase project, but within
> the Hbase project.
> They are not any significant differences apart
Thank you for the reply,
i am having trouble in finding out the dependency in maven repository, the
only dependency i can find is
org.apache.hbase
hbase-spark
1.2.0-cdh5.7.0
from cloudera maven repository,
dependency specified in this page, was not able to resolve
http
he
> only dependency i can find is
>
>
> org.apache.hbase
> hbase-spark
> 1.2.0-cdh5.7.0
>
>
> from cloudera maven repository,
>
> dependency specified in this page, was not able to resolve
>
> http://hbase.apache.org/hbase-spark/dependency-in
Please see the 'Hadoop 2.6.x' bullet under
http://hbase.apache.org/book.html#hadoop
FYI
On Fri, Aug 18, 2017 at 10:25 AM, Saad Mufti wrote:
> Hi,
>
> I'm looking for some guidance as our security team is requiring us to
> implement encryption of our HBase data
adoop 2.6.x' bullet under
http://hbase.apache.org/book.html#hadoop
FYI
On Fri, Aug 18, 2017 at 10:25 AM, Saad Mufti wrote:
Hi,
I'm looking for some guidance as our security team is requiring us to
implement encryption of our HBase data at rest and in motion. I'm reading
the docs an
t;>
>> Please see the 'Hadoop 2.6.x' bullet under
>> http://hbase.apache.org/book.html#hadoop
>>
>> FYI
>>
>> On Fri, Aug 18, 2017 at 10:25 AM, Saad Mufti wrote:
>>
>>> Hi,
>>>
>>> I'm looking for some guidance as
.
On Fri, Aug 18, 2017 at 10:25 AM, Saad Mufti wrote:
> Hi,
>
> I'm looking for some guidance as our security team is requiring us to
> implement encryption of our HBase data at rest and in motion. I'm reading
> the docs and doing research and the choice seems to be
Hi,
> >
> > I'm looking for some guidance as our security team is requiring us to
> > implement encryption of our HBase data at rest and in motion. I'm reading
> > the docs and doing research and the choice seems to be between doing it
> at
> > the HBase
Curious if the HBase Spark Connector
<https://github.com/apache/hbase-connectors/tree/master/spark> is expected
to work with HBase 1.x. I see a dependency on HBase 2.2.2 but curious if
HBase 1.x support is available. Otherwise, should I stick to using the
connector provided by Hortonworks
while hbase1 is pure java
socket. You can set the rpc client to BlockingRpcClient to see if the
performance is back.
On Mon, May 18, 2020 at 7:58 PM Bruno Dumon wrote:
>
> Hi,
>
> We are looking into migrating from HBase 1.2.x to HBase 2.1.x (on Cloudera
> CDH).
>
> It
in a loop. On HBase 2.2.4 with the
BlockingRpcClient this takes on average 9 seconds, with HBase 1.6 it takes
4.75 seconds.
On Wed, May 20, 2020 at 9:27 AM Debraj Manna
wrote:
> I cross-posted this in slack channel as I was also observing something
> quite similar. This is the sugges
Just saw that your tests were on local mode...
Local mode is not for production so I do not see any related issues for
improving the performance for hbase in local mode. Maybe we just have more
threads in HBase 2 by default which makes it slow on a single machine, not
sure...
Could you please
improvements in
hbase 2 in other areas which will compensate partly the impact of what I
notice in this narrow test, but still I found these results remarkable
enough.
On Wed, May 20, 2020 at 4:33 PM 张铎(Duo Zhang) wrote:
> Just saw that your tests were on local mode...
>
> Local mode is not for p
peed of iterating over cells of a single region served from the
> block cache. I started testing this way after noticing slow down on a real
> installation. I can imagine that there have been various improvements in
> hbase 2 in other areas which will compensate partly the impact of what I
&g
I've refrained from commenting here so far because I cannot share much/any
data but I can also report that we've seen worse performance with HBase 2
(similar/same settings and same workload, same hardware). This is on a 40+
node cluster.
Unfortunately, I wasn't tasked with debuggin
not share much/any
> data but I can also report that we've seen worse performance with HBase 2
> (similar/same settings and same workload, same hardware). This is on a 40+
> node cluster.
> Unfortunately, I wasn't tasked with debugging. The customer decided to stay
> on 1.
ere I used the same number of
cells, but spread over much less rows, in total 1500 rows of each 10K
(small) cells. In that test, the difference in the scan speed is much lower
(HBase 2.2.4 being only about 10% slower). This suggests that the slowdown
in HBase 2 might be due to things that happen pe
1 - 100 of 2729 matches
Mail list logo
