What is proper way to make a hbase connection? using HTable (conf,tbl) or createConnection? Zookeeper session run out.

Hello, I am using HBase 0.98.5. In example hbase client programs, some use createConnection() and some use HTable() directly, I found they behave different, I wrote two simple tests program using these two different methods, each program will start two threads and do simple put. and I found: O

Re: What is proper way to make a hbase connection? using HTable (conf,tbl) or createConnection? Zookeeper session run out.

Hi Ming, HConnection connection = HConnectionManager.createConnection(conf); HTableInterface table = connection.getTable("mytable"); table.get(...); / table.put(...); Is the correct way to use. However HConnectionManager.createConnection(conf) gives you a "shared" HConnection which you can reuse

RE: What is proper way to make a hbase connection? using HTable (conf,tbl) or createConnection? Zookeeper session run out.

Thank you Bharath, This is a very helpful reply! I will share the connection between two threads. Simply put, HTable is not safe for multi-thread, is this true? In multi-threads, one must use HConnectionManager. Thanks, Ming -Original Message- From: Bharath Vissapragada [mailto:bhara...

how to redirect hbase testcase log to stdin or other file?

Hi Guys, I want to check *-output.txt file, but it is deleted if testcase run good. currently I have to intentionally make it run fail so I can get the file. thanks.

Re: What is proper way to make a hbase connection? using HTable (conf,tbl) or createConnection? Zookeeper session run out.

Yes thats correct. HTable is not thread-safe. On Mon, Nov 24, 2014 at 2:55 PM, Liu, Ming (HPIT-GADSC) wrote: > Thank you Bharath, > > This is a very helpful reply! I will share the connection between two > threads. Simply put, HTable is not safe for multi-thread, is this true? In > multi-threads

Paint dashboards from HBase

Is there any tool to draw data from Hbase to a dashboard like Kibana? I have been looking for, but I didn't found a tool which fits directly with HBase for that purpose.

Re: how to redirect hbase testcase log to stdin or other file?

One option is to set the output buffer of your IDE large enough so that test output is retained. Another option, though tedious, is to issue 'tail -f ' command and redirect its output to a file when the test is running. Cheers On Mon, Nov 24, 2014 at 1:48 AM, Qiang Tian wrote: > Hi Guys, > I w

Re: how to redirect hbase testcase log to stdin or other file?

If what you want from the output is something written by a logger, you can make all tests log to a file by passing in -Dhbase.root.logger=LEVEL,DFRA (where LEVEL is a log4j level i.e. DEBUG). Here's a conversation that goes into more detail: *http://s.apache.org/axq * If

HBase entity relationship

Hi, I am designing my HBase table schema. I have two entities that are related to each other in a nested structure. For example, consider two entities A and B. Both of them are complex types. Entity A contains one or more entity B values. Both entities have their own tables. Each row of entity A

Re: HBase entity relationship

Hi, perhaps I'm wrong, but this sounds a little bit "sql-ish" to me, relations by ids etc.. Is there a hierarchy in the data? Is A some sort of "container" for B? Or are the connections arbitrary? Could your make an example where this relation of classes A and B fit or make a more verbose explan

[ANN]: HBase-Writer 0.98.7 available for download

[ANN]: HBase-Writer 0.98.7 available for download The HBase Writer Project is proud to announce the release of version 0.98.7-RELEASE of HBase Writer [1]. HBase Writer includes numerous fixes for issues recently identified as well as a number of other enhancements and changes. The notable changes

PreBatchMutate - Delete another row inside this method

Hi, IN PreBatchMutate method in Observer, I am trying to check whether a row , say '123', exists and delete the row. This row is different from the current row , say '111' ,in the method, which has locked the current row. But Delete operation is waiting for the lock to '111' instead of '123'. Say

Re: PreBatchMutate - Delete another row inside this method

Row '123' may be in a different region from the one row '111' is in. Cross region RPC should be avoided in coprocessor. Does your application require that the deletion of row '123' be in the same transaction as the mutation ? Cheers On Nov 24, 2014, at 12:31 PM, tvraju wrote: > Hi, > IN Pre

Can I use the Thrift API to scan with filters?

Hi I've been searching for Thrift Java API examples with filters but can't find any. Does the current Thrift API supports it? Regards, Néstor

Using Thrift Java API to get last row

Hi How do I use the Thrift Java API to get the last row in the table? Regards, Néstor

Re: Can I use the Thrift API to scan with filters?

Yes, you can. Did you try the scannerOpenWithScan() call? It takes a TScan as input and you can build it with a filterString. Closest examples I could find are [1] and [2] but I believe its not difficult to extend these. [1] https://github.com/apache/hbase/blob/master/hbase-thrift/src/test/java/o

Re: Can I use the Thrift API to scan with filters?

On Mon, Nov 24, 2014 at 6:06 PM, Bharath Vissapragada wrote: > Yes, you can. Did you try the scannerOpenWithScan() call? It takes a TScan > as input and you can build it with a filterString. Closest examples I could > find are [1] and [2] but I believe its not difficult to extend these. > > [1]

Re: Using Thrift Java API to get last row

You can use reverse scan. See the example in hbase-thrift/src/test/java/org/apache/hadoop/hbase/thrift/TestThriftServer.java: TScan reversedScan = new TScan(); reversedScan.setReversed(true); Cheers On Mon, Nov 24, 2014 at 5:21 PM, Néstor Boscán wrote: > Hi > > How do I use the Thrift

Can't enable table after rebooting hbase

Hi, I created a test table inside a single node hbase (version 0.99.1) installation using the local file system, then I disable the table and reboot the hbase server, then the enable table command hungs hbase shell, is this a bug? create 'test', 'cf' disable 'test' reboot habse

Re: Can't enable table after rebooting hbase

Please tell us what happened. Exceptions, error messages, anything in the logs, anything on the overview pages, etc, etc? -- Lars From: guxiaobo1982 To: user Sent: Monday, November 24, 2014 7:15 PM Subject: Can't enable table after rebooting hbase Hi, I created a test table insid

Re: HBase entity relationship

Thanks Wilm, Let me try to explain my scenario in more detail. Let me talk about two specific entities, Jobs and Sources.*Source-* A URL that is source of some data. It also contains other meta-info like description, type etc. So, the required columns are, source_name, url, description, type.*Job-*

Re: HBase entity relationship

Thanks Wilm, Let me try to explain my scenario in more detail. Let me talk about two specific entities, Jobs and Sources. *Source- *A URL that is source of some data. It also contains other meta-info like description, type etc. So, the required columns are, source_name, url, description, type.

Re: Can't enable table after rebooting hbase

Also if you're relying on the local filesystem, what OS and filesystem. -- Sean On Nov 24, 2014 11:26 PM, "lars hofhansl" wrote: > Please tell us what happened. Exceptions, error messages, anything in the > logs, anything on the overview pages, etc, etc? > -- Lars > From: guxiaobo1982 >

Re: YCSB load failed because hbase region too busy

hi, all I retest the YCSB load data, and here is a situation which may explain the load data blocked. I use too many threads to insert values, so the flush thread is not effectively to handle all memstore, and the user9099 memstore is queued at last, and waiting for flush too long which blocks

Re: YCSB load failed because hbase region too busy

>> hbase.hstore.flusher.count to 20 (default value is 2), and run the YCSB to load data with 32 threads Apologies for the late reply. Your change of configuraton from 2 to 20 is right in this case because you are data ingest rate is high I suppose. Thanks for the reply. Regards Ram On Tue, Nov

Re: YCSB load failed because hbase region too busy

hi，Ram After i modify the hbase.hstore.flusher.count, it just improve the load, but after one hour , the YCSB load program is still blocked! Then I change hbase.hstore.flusher.count to 40, but it’s the same as 20, On Nov 25, 2014, at 14:47, ramkrishna vasudevan wrote: >>> hbase.hstore.flus

Zookeepr shuting down.

Hi I have a cluster of 3 systems each of 32GB RAM and 1 TB HD. I have clustered all the three and able to start and run Hadoop Successfully. I have installed Hbase on the master node. Now am trying to start Zookeeper in the cluster. When I start zookeeper and give command ./zkServer.sh status

Re: YCSB load failed because hbase region too busy

Are you getting any exceptions in the log? Do you have a stack trace when it is blocked? On Tue, Nov 25, 2014 at 12:30 PM, louis.hust wrote: > hi，Ram > > After i modify the hbase.hstore.flusher.count, it just improve the load, > but after one hour , the YCSB > load program is still blocked! Th

Re: YCSB load failed because hbase region too busy

yes, the stack trace like below: 2014-11-25 13:35:40:946 4260 sec: 232700856 operations; 28173.18 current ops/sec; [INSERT AverageLatency(us)=637.59] 2014-11-25 13:35:50:946 4270 sec: 232700856 operations; 0 current ops/sec; 14/11/25 13:35:59 INFO client.AsyncProcess: #14, table=usertable2, atte