Re: rainstor

2012-01-25 Thread Sam Wilson
Google? Sent from my iPhone On Jan 25, 2012, at 7:34 PM, Dalia Sobhy wrote: > Do anyone have any idea about rainstor ??? > > Opensource? How to download ? How to use? PErformance ??

Re: Wiki Write Access

2012-01-25 Thread Carl Steinbach
Hi Aniket, I added you to the ACL. Thanks for your help with the wiki. Carl On Tue, Jan 24, 2012 at 11:26 PM, Aniket Mokashi wrote: > Hi Carl, > > It would be helpful for me too. > My wiki username: aniket486. > > Thanks, > Aniket > > > On Tue, Jan 24, 2012 at 11:57 AM, Carl Steinbach wrote: >

Re: Hive FAQ

2012-01-25 Thread Carl Steinbach
Hi Nicolas, I added you to the ACL. Thanks. Carl 2012/1/25 Nicolas Lalevée > > Le 24 janv. 2012 à 22:48, Carl Steinbach a écrit : > > > Hi Nicolas, > > > > Thanks for pointing this out. If you would like to provide answers I can > give you edit access to the wiki. Please create an account and

rainstor

2012-01-25 Thread Dalia Sobhy
Do anyone have any idea about rainstor ??? Opensource? How to download ? How to use? PErformance ??

Reading compressed files (external tables) from hive using DeprecatedLzoTextInputFormat

2012-01-25 Thread Sam William
I have some data generated from a Pig script which is LZO compressed. There is no indexer run on this data . I created an external table on hive on top of this data . Here is thecreate table script . CREATE EXTERNAL TABLE tmp_hive(domain string,url string) ROW FORMAT DELIMITED FI

Re: Important Question

2012-01-25 Thread Stephen Boesch
Dalia your requirements appear to be transaction oriented and thus OLTP systems - i.e. regular relational databases - are more likely to be suitable than a hive (/hadoop) based solution. Hive is more for business intelligence and certainly includes latencies - which by saying 'realtime' - would

RE: Important Question

2012-01-25 Thread Dalia Sobhy
I will explain to u more Mike. I am building a Software Oriented Architecture, I want my API to provide some services such as Add/Delete Patients, Search for a patient by name/ID, count the number of people who are suffering from measles in Alexandria Egypt. Something like that so I am wondering

Re: Hive query result in sequence file

2012-01-25 Thread jingjung Ng
Thanks Aniket. I am pretty new to hive, any java example (serde) for archieving this ? -Andrew On Wed, Jan 25, 2012 at 12:12 AM, Aniket Mokashi wrote: > You will have to do your own serde.. > > Hive can write it sequencefile but it will be Text with NULL(bytewritable) > key. > > Thanks, > Anik

Re: Question on bucketed map join

2012-01-25 Thread Bejoy Ks
Hi Avrilia     Ideally map join is used when one of the table involved in join has only small amount of data that is good to be loaded in memory as a hash table (uses distributed cache). Bucketed map join can be used even if none of the tables are small enough to be loaded on to memory.

Re: Important Question

2012-01-25 Thread Bejoy Ks
Hi Dalia     By complex queries if you are looking at joins with multiple tables and so on, Hbase doesn't support joins. In the absence of joins if you want to achieve a join that involved multiple tables in RDBMS, based on your requirement you should find suitable Column Families and Qualifiers

Re: Important Question

2012-01-25 Thread Dalia Sobhy
So what about HBQL?? And if i had complex queries would i get stuck with HBase? Also can anyone provide me with examples of a table in RDBMS transformed into hbase, realtime query and analytical processing.. Sent from my iPhone On 2012-01-25, at 6:15 PM, bejoy...@yahoo.com wrote: > Real Time..

Re: Important Question

2012-01-25 Thread bejoy_ks
Real Time.. Definitely not hive. Go in for HBase, but don't expect Hbase to be as flexible as RDBMS. You need to choose your Row Key and Column Families wisely as per your requirements. For data mining and analytics you can mount Hive table over corresponding Hbase table and play on with SQL li

Important Question

2012-01-25 Thread Dalia Sobhy
Dear all, I am developing an API for medical use i.e Hospital admissions and all about patients, thus transactions and queries and realtime data is important here... Therefore both real-time and analytical processing is a must.. Therefore which best suits my application Hbase or Hive or another m

Re: Hive FAQ

2012-01-25 Thread Nicolas Lalevée
Le 24 janv. 2012 à 22:48, Carl Steinbach a écrit : > Hi Nicolas, > > Thanks for pointing this out. If you would like to provide answers I can give > you edit access to the wiki. Please create an account and send me your > username. It feels a little strange that someone write all these questi

Re: Hive query result in sequence file

2012-01-25 Thread Aniket Mokashi
You will have to do your own serde.. Hive can write it sequencefile but it will be Text with NULL(bytewritable) key. Thanks, Aniket On Tue, Jan 24, 2012 at 11:41 PM, jingjung Ng wrote: > Hi, > > I have following hive query (pseudo hive query code) > > select name, address, phone from t1 join