Re: Using Hbase as a transactional table

2016-11-23 Thread Ted Yu
Mich: Even though related rows are on the same region server, there is no intrinsic transaction support. For #1 under design considerations, multi column family is one possibility. You should consider how the queries from RDBMS access the related data. You can also evaluate Phoenix / Trafodio

Re: Using Hbase as a transactional table

2016-11-23 Thread Mich Talebzadeh
Thanks all. As I understand Hbase does not support ACIC compliant transactions over multiple rows or across tables? So this is not supported 1. Hbase can support multi-rows transactions if the rows are on the same table and in the same RegionServer? 2. Hbase does not support multi-rows

Re: Using Hbase as a transactional table

2016-11-23 Thread Denise Rogers
I would recommend MariaDB. HBase is not ACID compliant. MariaDB is. Regards, Denise Sent from mi iPad > On Nov 23, 2016, at 11:27 AM, Mich Talebzadeh > wrote: > > Hi, > > I need to explore if anyone has used Hbase as a transactional table to do > the processing that historically one has do

Re: Using Hbase as a transactional table

2016-11-23 Thread Ted Yu
HBase itself doesn't offer transaction support. See the following related projects: http://yahoohadoop.tumblr.com/post/138682361161/high-availability-in-omid http://tephra.incubator.apache.org/ On Wed, Nov 23, 2016 at 8:27 AM, Mich Talebzadeh wrote: > Hi, > > I need to explore if anyone has u

RE: Using Hbase as a transactional table

2016-11-23 Thread Dave Birdsall
Hi, The Apache Trafodion (incubating) project has built a scalable distributed transaction engine that integrates with HBase. See http://trafodion.apache.org/. Dave -Original Message- From: Mich Talebzadeh [mailto:mich.talebza...@gmail.com] Sent: Wednesday, November 23, 2016 8:27 AM To

Using Hbase as a transactional table

2016-11-23 Thread Mich Talebzadeh
Hi, I need to explore if anyone has used Hbase as a transactional table to do the processing that historically one has done with RDBMSs. A simple question dealing with a transaction as a unit of work (all or nothing). In that case if any part of statement in batch transaction fails, that transact

Re: Writting bottleneck in HBase ?

2016-11-23 Thread Ted Yu
bq. it calls the persistence method asynchronously Assuming the persistence method is still executing when the next threshold value is reached, do you have other threads to do persistence ? If so, how many threads can potentially run at the same time ? How many regions does the table have ? What

Writting bottleneck in HBase ?

2016-11-23 Thread schausson
Hi, I am new to HBase and I'm facing performance issues ... Short story : I want to persist 1000 values in HBase and it takes same time on a basic sandbox (HDP hadoop sandbox with single region server node) as it takes on our "production" cluster (that comprises 12 region server with higher c

Re: Rolling upgrade with coprocessors

2016-11-23 Thread Clay Baenziger (BLOOMBERG/ 731 LEX)
Hi Albert, The way I've seen it working -- if you need to leave the table online -- is specifying the coprocessor in the hbase-site.xml of each region server and deploying the class to the table without a path (just the classname). Then, ensure your hbase-site.xml has the correct version for th

Re: hbase/spark - Delegation Token can be issued only with kerberos or web authentication

2016-11-23 Thread Nkechi Achara
Hi Abel, Apologies, but I have been quite busy. The version I am using is here: https://github.com/barkhorn/SparkOnHBase. The tgt does look valid all in all, so I will revert back to my thought that there is an issue with the classpath on the submit. Thanks On 22 November 2016 at 10:14, Abel F