RE: How to Manage Data Architecture & Modeling for HBase

2015-04-06 Thread Pamecha, Abhishek
michael_se...@hotmail.com] Sent: Monday, April 06, 2015 9:55 AM To: user@hbase.apache.org Cc: u...@phoenix.apache.org Subject: Re: How to Manage Data Architecture & Modeling for HBase I should add that in terms of financial modeling… Its easier to store derivatives and synthetic instruments because you

Re: How to Manage Data Architecture & Modeling for HBase

2015-04-06 Thread Michael Segel
I should add that in terms of financial modeling… Its easier to store derivatives and synthetic instruments because you aren’t really constrained by a relational model. (Derivatives are nothing more than a contract.) HTH -Mike > On Apr 6, 2015, at 8:34 AM, Ben Liang wrote: > > Thank you f

Re: How to Manage Data Architecture & Modeling for HBase

2015-04-06 Thread Michael Segel
So this is the hardest thing to do… teach someone not to look at the data in terms of an RDBMs model. And there aren’t any hard and fast rules… Lets look at an example. You’re creating an application for Medicare/Medicaid to help identify potential abuses and fraud within the system. In p

Re: How to Manage Data Architecture & Modeling for HBase

2015-04-06 Thread Ben Liang
Thank you for your prompt reply. In my daily work, I mainly used Oracle DB to build a data warehouse with star topology data modeling, about financial analysis and marketing analysis. Now I trying to use Hbase to do it. I has a question, 1) many tables from ERP should be Incremental loading ev

Re: How to Manage Data Architecture & Modeling for HBase

2015-04-06 Thread Imants Cekusins
> tools to manage Data Architecture & Modeling for HBase To aid visualizing table structure, you could use Enterprise Architect Even though HBase cells store BLOBS, quite often these BLOBS are serialized classes. In EA classes can appear in table definition as field types. It is possible to pu

Re: How to Manage Data Architecture & Modeling for HBase

2015-04-06 Thread Michael Segel
Yeah. Jean-Marc is right. You have to think more in terms of a hierarchical model where you’re modeling records not relationships. Your model would look like a single ER box per record type. The HBase schema is very simple. Tables, column families and that’s it for static structures. Even

Re: How to Manage Data Architecture & Modeling for HBase

2015-04-05 Thread Jean-Marc Spaggiari
Not sure you want to ever do that... Designing an HBase application is far different from designing an RDBMS one. Not sure those tools fit well here. What's you're goal? Designing your HBase schema somewhere and then let the tool generate your HBase tables? 2015-04-05 18:26 GMT-04:00 Ben Liang :

How to Manage Data Architecture & Modeling for HBase

2015-04-05 Thread Ben Liang
Hi all, Do you have any tools to manage Data Architecture & Modeling for HBase( or Phoenix) ? Can we use Powerdesinger or ERWin to do it? Please give me some advice. Regards, Ben Liang