Re: Hbase-Hive table integration Error

2016-03-01 Thread Amrit Jangid
Anyone ? On Fri, Feb 26, 2016 at 3:50 PM, Amrit Jangid wrote: > Hi , > > I wanted to access one hbase table in hive, during creating the table, had > incorrect columns mapping in query. > > Now i want to DROP the table to create it again.But every query(DESCRIBE , >

RE: having problem while querying out select statement in TEZ

2016-03-01 Thread Mahender Sarangam
Any update ? To: user@hive.apache.org From: mahender.bigd...@outlook.com Subject: having problem while querying out select statement in TEZ Date: Tue, 1 Mar 2016 12:55:20 -0800 Hi, We have created ORC partition Bucketed Table in Hive with ~ has delimiter. Whenever

Re:Re: How the actual "sample data" are implemented when using tez reduce auto-parallelism

2016-03-01 Thread Maria
 Thank you very very very much for your patiently answers. I got it, this is very helpful to understand the auto-parallelism Optimization. At 2016-02-29 12:50:04, "Rajesh Balamohan" wrote: "tez.shuffle-vertex-manager.desired-task-input-size" - Determines the

Re: Hive and Impala

2016-03-01 Thread Edward Capriolo
My nocks on impala. (not intended to be a post knocking impala) Impala really has not delivered on the complex types that hive has (after promising it for quite a while), also it only works with the 'blessed' input formats, parquet, avro, text. It is very annoying to work with impala, In my

Re: Hive and Impala

2016-03-01 Thread Ashok Kumar
Dr Mitch, My two cents here. I don't have direct experience of Impala but in my humble opinion I share your views that Hive provides the best metastore of all Big Data systems. Looking around almost every product in one form and shape use Hive code somewhere. My colleagues inform me that Hive

having problem while querying out select statement in TEZ

2016-03-01 Thread mahender bigdata
Hi, We have created ORC partition Bucketed Table in Hive with ~ has delimiter. Whenever i firing select statement on ORCPartitionBucketing Table, I keep getting error *org.apache.hadoop.hive.ql.exec.vector.BytesColumnVector cannot be cast to

Re: queues, beeline/hs2 and tez

2016-03-01 Thread Gopal Vijayaraghavan
> tez.queue.name via the --hiveconf switch on beeline and it doesn't look >to me it works. the question is... should it? Nope, it shouldn't, because of Tez sessions the conf param is not job. The tez.queue.name can be changed while a JDBC connection is up, so it is not picked up from the conf

Re: queues, beeline/hs2 and tez

2016-03-01 Thread Siddharth Seth
+ user@hive. This is specific to the way hive handles queues, and user@hive would be the correct list to get an answer. On Fri, Feb 26, 2016 at 3:21 PM, Stephen Sprague wrote: > hey guys (its me again!) > > this is a simple one i think. i'm trying to set the tez.queue.name

Re: Wrong column is picked in HIVE 2.0.0 + TEZ 0.8.2 left join

2016-03-01 Thread Gopal Vijayaraghavan
On 3/1/16, 10:41 AM, "Sergey Shelukhin" wrote: >Can you please open a Hive JIRA? It is a bug. https://issues.apache.org/jira/browse/HIVE-13191 https://issues.apache.org/jira/browse/HIVE-13190 Cheers, Gopal

Re: Wrong column is picked in HIVE 2.0.0 + TEZ 0.8.2 left join

2016-03-01 Thread Sergey Shelukhin
Can you please open a Hive JIRA? It is a bug. On 16/3/1, 10:28, "Gopal Vijayaraghavan" wrote: >(Bcc: Tez, Cross-post to hive) > >> I added ³set hive.execution.engine=mr;² at top of the script, seems the >>result is correctŠ > >Pretty sure it's due to the same table aliases

Re: Wrong column is picked in HIVE 2.0.0 + TEZ 0.8.2 left join

2016-03-01 Thread Gopal Vijayaraghavan
(Bcc: Tez, Cross-post to hive) > I added ³set hive.execution.engine=mr;² at top of the script, seems the >result is correctŠ Pretty sure it's due to the same table aliases for both dummy tables (they're both called _dummy_table) auto join conversion. hive> set hive.auto.convert.join=false;

Reg: Hive Authorization Issue

2016-03-01 Thread Bharat Viswanadham
Hi, A release was made for fix an authorization issue in Hive wherein parent tables of partitions are not authenticated against for some partition-level operations which was released on January 28 2016. In the release notes, it was mentioned, this fix was released to all branches. Can some one

Re: How does Hive do authentication on UDF

2016-03-01 Thread Alan Gates
There are several Hive authorization schemes, but at the moment none of them restrict function use. At some point we’d like to add that feature to SQL standard authorization (see https://cwiki.apache.org/confluence/display/Hive/SQL+Standard+Based+Hive+Authorization ) but no one has done it

Re: ORC file split calculation problems

2016-03-01 Thread Patrick Duin
Hi Prasanth, Thanks for this. I tried out the configuration and I wanted to share some number with you. My test setup is a cascading job that reads in 240 files (ranging from 1.5GB to 2.5GB). In the job log I get the duration from these lines: INFO log.PerfLogger: Running this without any of

Re: Hive and Impala

2016-03-01 Thread Mich Talebzadeh
Just to clarify the statement in quotes was made by the author of the article "We can access all objects from Hive data warehouse with HiveQL which leverages the map-reduce architecture in background for data retrieval and transformation and this results in latency." Dr Mich Talebzadeh

Hive and Impala

2016-03-01 Thread Mich Talebzadeh
I have not heard of Impala anymore. I saw an article in LinkedIn titled "Apache Hive Or Cloudera Impala? What is Best for me?" "We can access all objects from Hive data warehouse with HiveQL which leverages the map-reduce architecture in background for data retrieval and transformation and this

Re: Hive Cli ORC table read error with limit option

2016-03-01 Thread Biswajit Nayak
Hi, It works for MR engine, while in TEZ it fails. *hive> set hive.execution.engine=tez;* *hive> set hive.fetch.task.conversion=none;* *hive> select h from test*db.table_orc* where year = 2016 and month =1 and day >29 limit 10;* *Query ID = 26f9a510-c10c-475c-9988-081998b66b0c* *Total jobs =

Re: Hive-2.0.1 Release date

2016-03-01 Thread Oleksiy MapR
>> Hi. It will be released when some critical mass of bugfixes is accumulated. We already found >> some issues that would be nice to fix, so it may be some time in March. Is there a particular fix >> that interests you? Hi Sergey! Thanks for the information. There is no particular fix I want to

How does Hive do authentication on UDF

2016-03-01 Thread Todd
Hi , We are allowing users to write/use their own UDF in our Hive environment.When they create the function against the db, then all the users that can use the db will see(or use) the udf. I would ask how UDF authentication is done, can UDF be granted to some specific users,so that other

About the hive python client pyhs2

2016-03-01 Thread Tale Firefly
Hello ! I contact you because I have a question related to interact with hive with python. The python client pyhs2 is recommended on the apache site : https://cwiki.apache.org/confluence/display/Hive/Setting+Up+HiveServer2#SettingUpHiveServer2-PythonClientDriver I was wondering if I can use it