multiple users for hive access

2015-07-07 Thread Jack Yang
Hi all, I would like to have multiple users to access hive. Does anyone try that before? Is there any tutorial or link I can study from? Best regards, Jack

Re: WHERE ... NOT IN (...) + NULL values = BUG

2015-07-07 Thread Furcy Pin
Thanks matshyeq, you are right, I tested it on other sql engines and the result is the same. (but I still find this confusing...) SELECT 1 IN (1,2,3,NULL) ; true SELECT 1 IN (2,3) ; false SELECT 1 IN (2,3,NULL) ; NULL SELECT 1 NOT IN (1,2,3,NULL) ; false SELECT 1 NOT IN (2,3,NULL) ;

Hive Tez support matrix

2015-07-07 Thread Jim Green
Hi Team, Is there any Hive - Tez support matrix? For example, Hive 1.2 should be on Tez which version? Tez 0.5.3 only supports which versions of Hive? etc… My understanding is that it does not matter which version of Hive and which version of Tez. -- Thanks, www.openkb.info (Open KnowledgeBase

RE: Limiting outer join

2015-07-07 Thread Bennie Leo
Thanks for your replies. I see how extracting the first country would work, however I was hoping to speed up my query by stopping the search once a country has been found. Are you suggesting that I pass the whole IP table to a UDF and perform the search myself? I've only programmed simple

Re: Hive Tez support matrix

2015-07-07 Thread Jim Green
Thanks Hitesh. Should we put a support matrix on Documentation?Or maybe I missed it if it is already there? On Tue, Jul 7, 2015 at 10:34 AM, Hitesh Shah hit...@apache.org wrote: From a Tez perspective, there was a major compatibility change between Tez 0.4 and Tez 0.5. However, Tez-0.7.x and

Hive 1.1 arg!

2015-07-07 Thread Edward Capriolo
Hey all. I am using cloudera 5.4.something which uses hive 1.1 almost. I am getting bit by this error: https://issues.apache.org/jira/browse/HIVE-10437 So I am trying to update my test setup to 1.1 so I can include the annotation. @SerDeSpec(schemaProps = {serdeConstants.LIST_COLUMNS,

hbase column without prefix

2015-07-07 Thread Wojciech Indyk
Hi! I use hbase column regex matching to create map column in hive, like: hbase.columns.mapping = :key,s:ap_.* then I have values in column: {ap_col1:23,ap_col2:7} is it possible to cut the prefix ap_ to have values like below? {col1:23,col2:7} Kindly regards Wojciech Indyk

RE: Hive Tez support matrix

2015-07-07 Thread Bikas Saha
That would be in the hive documentation because it’s the dependent project and determines its compatibility with downstream projects like Tez. From: Jim Green [mailto:openkbi...@gmail.com] Sent: Tuesday, July 07, 2015 10:38 AM To: u...@tez.apache.org Cc: user@hive.apache.org Subject: Re: Hive

Re: Hive Tez support matrix

2015-07-07 Thread Hitesh Shah
From a Tez perspective, there was a major compatibility change between Tez 0.4 and Tez 0.5. However, Tez-0.7.x and Tez-0.6.x are compatible with Tez-0.5.x. I believe Hive 0.13 is compatible only with Tez 0.4. For Hive 0.14 onwards ( including the Hive-1.x. releases ), they should work with

RE: Limiting outer join

2015-07-07 Thread Bennie Leo
Never mind, I got it working with UDF. I just pass the file location to my evaluate function. Thanks! :) From: tben...@hotmail.com To: user@hive.apache.org Subject: RE: Limiting outer join Date: Tue, 7 Jul 2015 09:59:22 -0700 Thanks for your replies. I see how extracting the first country

Re: WHERE ... NOT IN (...) + NULL values = BUG

2015-07-07 Thread Grant Overby (groverby)
I call it my billion-dollar mistake. It was the invention of the null reference in 1965.” — Tony Hoare [http://www.cisco.com/web/europe/images/email/signature/est2014/logo_06.png?ct=1398192119726] Grant Overby Software Engineer Cisco.comhttp://www.cisco.com/

RE: Limiting outer join

2015-07-07 Thread Bennie Leo
It went from about 60 mins to 3 mins. Hive was traversing the whole table multiple times, which is obviously inefficient! Date: Tue, 7 Jul 2015 15:55:19 -0700 Subject: Re: Limiting outer join From: gop...@apache.org To: user@hive.apache.org Never mind, I got it working with UDF. I

Re: Hive Tez support matrix

2015-07-07 Thread Vikram Dixit
Hi Jim, I just created a page with the matrix of supported releases. https://cwiki.apache.org/confluence/display/Hive/Hive-tez+compatibility Although pom is a source of truth, we also work with versions of tez where there have been no API changes (compared to the version in the pom). Yes, 1.2

Re: Limiting outer join

2015-07-07 Thread Gopal Vijayaraghavan
Never mind, I got it working with UDF. I just pass the file location to my evaluate function. Thanks! :) Nice. Would be very interested in looking at performance of such a UDF, if you have numbers before/after. I suspect it will be a magnitude or more faster than the BETWEEN/JOIN clauses.

Re: Hive Tez support matrix

2015-07-07 Thread Jim Green
Thanks Vikram. That looks great. On Tue, Jul 7, 2015 at 4:27 PM, Vikram Dixit vik...@hortonworks.com wrote: Hi Jim, I just created a page with the matrix of supported releases. https://cwiki.apache.org/confluence/display/Hive/Hive-tez+compatibility Although pom is a source of truth,

arraystring become struct when doing select

2015-07-07 Thread Binglin Chang
Hi, I have a table with some array fields, when preview them using select limit at beeline, I got following errors, it seems the typeinfo string is changed from arraystring to struct I am using hive-0.13.1 0: jdbc:hive2://lg-hadoop-hive01.bj:32203/ show create table xxx;

Re: arraystring become struct when doing select

2015-07-07 Thread Binglin Chang
Sorry, forgot to mention, the table is using thrift serde, but 'show create table' shows the table is ROW FORMAT DELIMITED, which I think is a bug. When select simple text format table, the query runs fine, but when select thrift table, error occurs. original create table statement: CREATE

Re: WHERE ... NOT IN (...) + NULL values = BUG

2015-07-07 Thread matshyeq
Obviously, the expected answer is always 2. That's incorrect. It's expected behaviour, SQL standard and I would expect every other DBs behave same way. The direct comparison to NULL returns FALSE. Always. Doesn't matter if used as ,=, IN, NOT IN. IS (NOT) NULL is the right way to handle such

Re: arraystring become struct when doing select

2015-07-07 Thread Karan Kumar
Issue is with the thrift version you are using most probably. https://issues.apache.org/jira/browse/THRIFT-2172 I used thrift-0.9.2 to generate my thrift classes which solved this kind of issue. On Tue, Jul 7, 2015 at 6:14 PM, Binglin Chang decst...@gmail.com wrote: Sorry, forgot to mention,

RE: multiple users for hive access

2015-07-07 Thread Jack Yang
Thanks, mate. I have mysql run as my metadata store. What is the next step? when I start hive (0.13 version), I just type in hive in my command line. Now, that is say I have two users: A and B. I would like A and B access hive tables using hive-cli. How can I do that? From: Jeff Zhang

Re: multiple users for hive access

2015-07-07 Thread Jeff Zhang
Have you tried to start hive cli using these 2 users ? What issue did you see ? On Wed, Jul 8, 2015 at 11:50 AM, Jack Yang j...@uow.edu.au wrote: Thanks, mate. I have mysql run as my metadata store. What is the next step? when I start hive (0.13 version), I just type in hive in my command