Re: Options for connecting to Apache Hive

2017-11-13 Thread Carter Shanklin
"But beware that the python client has been deprecated and you have to jump a few links to find the most recent one." I've had success with PyHive and it is maintained, works with SQL Alchemy / Pandas and all that good stuff. Would it be better to point Python

Re: Hive federation service

2017-07-27 Thread Carter Shanklin
Elliot, Interesting stuff I have 3 questions 1. Can Waggle Dance deal with multiple kerberized Hadoop clusters? 2. Do you support 3 layers in the hierarchy (i.e. cluster.database.table) or 2 layers, with a requirement to avoid any possible name collisions in the mapping layer. 3. Is it compatib

Adding a Hive Statement of SQL Conformance to the docs

2017-01-13 Thread Carter Shanklin
I get asked from time to time what Hive's level of SQL conformance is, and it's difficult to provide a clean answer. Most SQL systems have some detailed statement of SQL conformance to help answer this question. For a year or so I've maintained a spreadsheet that tracks Hive's SQL conformance,

Re: Hive and engine performance tez vs mr

2015-04-06 Thread Carter Shanklin
Erwan, Faced with a similar situation last week I found that decreasing mapred.max.split.size Increased my parallelism by 6x. Yes mapred even though it was a Tez job. I reduced it to 10mb from 256mb which I believe is the default. The other variables to try are: tez.grouping.min-size (make it s

Re: Tez HIve problems.

2014-05-13 Thread Carter Shanklin
ct.Method.invoke(Unknown Source) >> at org.apache.hadoop.util.RunJar.main(RunJar.java:212) >> >> Am I doing something wrong? The Tez I am running by setting* >> hive.execution.engine=mr;* but setting >> >> *mapreduce.framework.name <http:

Re: Interesting claims that seem untrue

2013-09-16 Thread Carter Shanklin
> features. I did not know we (hive) had a road map. I have advocated > switching to feature based release and having a road map before, but it was > suggested that might limit people from itch-scratching. > > > > > -- Carter Shanklin Director, Product Management Hortonwork

Re: Does hive support unicode in table name and column name

2013-06-03 Thread Carter Shanklin
Hi Pavel, I've not tried it with Cyrillic but create table does fail in Hive 11 if you use Chinese characters in either the table name or column names. I assume Cyrillic will fail as well. From what I've seen, any sort of Unicode data is ok in the actual values themselves just not in the DDL. On