Re: Review Request 34586: HIVE-10704

2015-05-26 Thread Mostafa Mokhtar
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34586/ --- (Updated May 27, 2015, 6:33 a.m.) Review request for hive. Repository: hive-g

Re: Review Request 34586: HIVE-10704

2015-05-26 Thread Mostafa Mokhtar
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34586/ --- (Updated May 27, 2015, 6:32 a.m.) Review request for hive. Repository: hive-g

Re: Review Request 34586: HIVE-10704

2015-05-26 Thread Mostafa Mokhtar
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34586/ --- (Updated May 27, 2015, 6:30 a.m.) Review request for hive. Repository: hive-g

Re: Caching metastore objects

2015-05-26 Thread Sivaramakrishnan Narayanan
Awesome!! On Wed, May 27, 2015 at 10:55 AM, Ashutosh Chauhan wrote: > Siva / Scott, > > Such a framework exists in some form : > https://issues.apache.org/jira/browse/HIVE-2038 > To make it even more generic there was a proposal > https://issues.apache.org/jira/browse/HIVE-2147 But there was a

Re: Caching metastore objects

2015-05-26 Thread Ashutosh Chauhan
Siva / Scott, Such a framework exists in some form : https://issues.apache.org/jira/browse/HIVE-2038 To make it even more generic there was a proposal https://issues.apache.org/jira/browse/HIVE-2147 But there was a resistance from a community for it. May be now community is ready for it : ) Ashu

Re: Review Request 34576: Bucketized Table feature fails in some cases

2015-05-26 Thread Xuefu Zhang
> On May 24, 2015, 2:03 a.m., Xuefu Zhang wrote: > > Have you thought of what if the client is not interactive, such as JDBC or > > thrift? > > pengcheng xiong wrote: > I am sorry that we have not thought about it yet. We admitted that the > patch will not cover the case when the client is

Re: Review Request 34696: HIVE-686 add UDF substring_index

2015-05-26 Thread Alexander Pivovarov
> On May 27, 2015, 4:42 a.m., Swarnim Kulkarni wrote: > > ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFSubstringIndex.java, > > line 45 > > > > > > Worth mentinoning in your example what the expected out

Re: Caching metastore objects

2015-05-26 Thread Sivaramakrishnan Narayanan
Thanks for the replies. @Ashutosh - thanks for the pointer! Yes I was running 0.11 metastore. Let me try with 0.13 metastore! Maybe my woes will be gone. If they don't then I'll continue working along these lines. @Alan - agreed. Caching MTables seems like a better approach if 0.13 metastore perf

[jira] [Created] (HIVE-10830) First column of a Hive table created with LazyBinaryColumnarSerDe is not read properly

2015-05-26 Thread lovekesh bansal (JIRA)
lovekesh bansal created HIVE-10830: -- Summary: First column of a Hive table created with LazyBinaryColumnarSerDe is not read properly Key: HIVE-10830 URL: https://issues.apache.org/jira/browse/HIVE-10830

Re: Review Request 34576: Bucketized Table feature fails in some cases

2015-05-26 Thread Gopal V
> On May 24, 2015, 2:03 a.m., Xuefu Zhang wrote: > > Have you thought of what if the client is not interactive, such as JDBC or > > thrift? > > pengcheng xiong wrote: > I am sorry that we have not thought about it yet. We admitted that the > patch will not cover the case when the client is

Re: Review Request 34576: Bucketized Table feature fails in some cases

2015-05-26 Thread Xuefu Zhang
> On May 24, 2015, 2:03 a.m., Xuefu Zhang wrote: > > Have you thought of what if the client is not interactive, such as JDBC or > > thrift? > > pengcheng xiong wrote: > I am sorry that we have not thought about it yet. We admitted that the > patch will not cover the case when the client is

Re: Review Request 34696: HIVE-686 add UDF substring_index

2015-05-26 Thread Swarnim Kulkarni
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34696/#review85318 --- ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFSubstri

Re: Review Request 34696: HIVE-686 add UDF substring_index

2015-05-26 Thread Swarnim Kulkarni
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34696/#review85319 --- Ship it! Ship It! - Swarnim Kulkarni On May 27, 2015, 3:35 a.m.,

Re: normalizing spark tarball dependency in Hive build

2015-05-26 Thread Xuefu Zhang
We thought of that, but unfortunate there this is a binary which isn't published anywhere in public maven repositories. That's why we hosted it at cloudfront. I think this is a general problem for any binaries required by tests. We are open to suggestions though. Thanks, Xuefu On Tue, May 26, 20

Review Request 34696: HIVE-686 add UDF substring_index

2015-05-26 Thread Alexander Pivovarov
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34696/ --- Review request for hive, Hao Cheng, Jason Dere, namit jain, and Thejas Nair. Bu

Review Request 34693: ATS hook fails for explainTask

2015-05-26 Thread pengcheng xiong
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34693/ --- Review request for hive and John Pullokkaran. Repository: hive-git Descriptio

[jira] [Created] (HIVE-10829) ATS hook fails for explainTask

2015-05-26 Thread Pengcheng Xiong (JIRA)
Pengcheng Xiong created HIVE-10829: -- Summary: ATS hook fails for explainTask Key: HIVE-10829 URL: https://issues.apache.org/jira/browse/HIVE-10829 Project: Hive Issue Type: Bug R

[GitHub] hive pull request: Hive 10689

2015-05-26 Thread thejasmn
GitHub user thejasmn opened a pull request: https://github.com/apache/hive/pull/38 Hive 10689 You can merge this pull request into a Git repository by running: $ git pull https://github.com/thejasmn/hive HIVE-10689 Alternatively you can review and apply these changes as the p

Re: Review Request 34447: HIVE-10761 : Create codahale-based metrics system for Hive

2015-05-26 Thread Szehon Ho
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34447/ --- (Updated May 27, 2015, 2:04 a.m.) Review request for hive, Chao Sun, Jimmy Xian

Re: Caching metastore objects

2015-05-26 Thread Ashutosh Chauhan
Are you running pre-0.12 or with hive.metastore.try.direct.sql = false; Work done on https://issues.apache.org/jira/browse/HIVE-4051 should alleviate some of your problems. On Mon, May 25, 2015 at 8:19 PM, Sivaramakrishnan Narayanan < tarb...@gmail.com> wrote: > Apologies if this has been discu

Re: Review Request 34455: HIVE-10550 Dynamic RDD caching optimization for HoS.[Spark Branch]

2015-05-26 Thread chengxiang li
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34455/ --- (Updated May 27, 2015, 1:50 a.m.) Review request for hive, Chao Sun, Jimmy Xian

[jira] [Created] (HIVE-10828) Insert...values for fewer number of columns fail

2015-05-26 Thread Aswathy Chellammal Sreekumar (JIRA)
Aswathy Chellammal Sreekumar created HIVE-10828: --- Summary: Insert...values for fewer number of columns fail Key: HIVE-10828 URL: https://issues.apache.org/jira/browse/HIVE-10828 Project:

Re: [VOTE] Stable releases from branch-1 and experimental releases from master

2015-05-26 Thread Thejas Nair
+1 - This is great for users who want to take longer to upgrade from hadoop-1 and care mainly for bug fixes and incremental features, rather than radical new features. - The ability to release initial 2.x releases marked as alpha/beta also helps to get users to try it out, and also lets them choose

Re: Caching metastore objects

2015-05-26 Thread Scott C Gray
Hi, This may or may not be considered a separate topic, but beyond the caching that could take place in the metastore itself, there is generally a need for a general purpose mechanism for notifications about metastore changes. For example, a number of applications currently maintain their own ca

Re: [VOTE] Stable releases from branch-1 and experimental releases from master

2015-05-26 Thread Chris Drome
+1 I hope that important bugfixes (and functionality) will be backported from trunk to branch-1 for a reasonable amount of time given that many people will continue to rely on branch-1. Thanks, chris On Tuesday, May 26, 2015 1:45 PM, Gopal Vijayaraghavan wrote: +1 This would pro

[jira] [Created] (HIVE-10827) support parallel query compilation in HS2

2015-05-26 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-10827: --- Summary: support parallel query compilation in HS2 Key: HIVE-10827 URL: https://issues.apache.org/jira/browse/HIVE-10827 Project: Hive Issue Type: Impr

Re: Review Request 34473: HIVE-10749 Implement Insert statement for parquet

2015-05-26 Thread Sergio Pena
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34473/#review85265 --- I run a INSERT command, but delta directories were not created. -rw

Re: [VOTE] Stable releases from branch-1 and experimental releases from master

2015-05-26 Thread Gopal Vijayaraghavan
+1 This would protect those who might not want to lose workflow features from the stable releases for the coming year. I¹m not looking forward to a branch merge tearing out the hive CLI client away in a single chop. Having a master branch where we can plan for the future is essential and this is

normalizing spark tarball dependency in Hive build

2015-05-26 Thread Sergey Shelukhin
Hi. I was trying to build Hive on a slow connection (or I could have no connection for that matter), and pulling "http://d3jw87u4immizc.cloudfront.net/spark-tarball/spark-1.3.0-bin-hadoop2 -without-hive.tgz” was taking forever (I ctrl-c-ed it eventually). On a good note it did appear to respect “-o

Re: [VOTE] Stable releases from branch-1 and experimental releases from master

2015-05-26 Thread Vaibhav Gumashta
+1. I think this will help a lot in having a clean way to experiment with new features. ‹Vaibhav On 5/26/15, 12:29 PM, "Sergey Shelukhin" wrote: >+1. >I want to clarify about being not production ready though. That shouldn¹t >mean known shortage of functionality (other than the deprecated part

Re: [VOTE] Stable releases from branch-1 and experimental releases from master

2015-05-26 Thread Owen O'Malley
I'm +1 too. I think it is important to allow the Hive development community to move forward with these big features while supporting users who want a more conservative set of features and more backwards compatibility. .. Owen On Tue, May 26, 2015 at 12:29 PM, Sergey Shelukhin wrote: > +1. > I w

Re: Review Request 34576: Bucketized Table feature fails in some cases

2015-05-26 Thread pengcheng xiong
> On May 24, 2015, 2:03 a.m., Xuefu Zhang wrote: > > Have you thought of what if the client is not interactive, such as JDBC or > > thrift? I am sorry that we have not thought about it yet. We admitted that the patch will not cover the case when the client is not interactive. Do you have any

[jira] [Created] (HIVE-10826) Support min()/max() functions over x preceding and y preceding windowing

2015-05-26 Thread Aihua Xu (JIRA)
Aihua Xu created HIVE-10826: --- Summary: Support min()/max() functions over x preceding and y preceding windowing Key: HIVE-10826 URL: https://issues.apache.org/jira/browse/HIVE-10826 Project: Hive

[jira] [Created] (HIVE-10825) Add parquet branch profile to jenkins-submit-build.sh

2015-05-26 Thread JIRA
Sergio Peña created HIVE-10825: -- Summary: Add parquet branch profile to jenkins-submit-build.sh Key: HIVE-10825 URL: https://issues.apache.org/jira/browse/HIVE-10825 Project: Hive Issue Type: Su

Re: How to debug hive unit test in eclipse ?

2015-05-26 Thread Sergey Shelukhin
-Dmaven.surefire.debug when you run a test. Then attach eclipse to remote process on port 5005 (default). Breakpoints will be hit in unit tests and regular q file tests. In MiniMr/MiniTez/etc., not sure. On 14/12/16, 00:17, "Jeff Zhang" wrote: >The wiki page looks like already out-dated, >https:

Re: [VOTE] Stable releases from branch-1 and experimental releases from master

2015-05-26 Thread Sergey Shelukhin
+1. I want to clarify about being not production ready though. That shouldn’t mean known shortage of functionality (other than the deprecated parts like hadoop-1), imho, just the fact that they are recent with big features enabled. They should be production ready modulo the higher expected bug coun

Re: Review Request 34656: Scaling PK/FK's selectivity for stats annotation

2015-05-26 Thread pengcheng xiong
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34656/ --- (Updated May 26, 2015, 6:44 p.m.) Review request for hive, Ashutosh Chauhan and

Re: Review Request 34656: Scaling PK/FK's selectivity for stats annotation

2015-05-26 Thread pengcheng xiong
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34656/ --- (Updated May 26, 2015, 6:42 p.m.) Review request for hive, Ashutosh Chauhan and

[VOTE] Stable releases from branch-1 and experimental releases from master

2015-05-26 Thread Alan Gates
We have discussed this for several weeks now. Some concerns have been raised which I have tried to address. I think it is time to vote on it as our release plan. To be specific, I propose: Hive makes a branch-1 from the current master. This would be used for 1.3 and future 1.x releases. T

Re: Review Request 34656: Scaling PK/FK's selectivity for stats annotation

2015-05-26 Thread John Pullokkaran
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34656/#review85212 --- Ship it! Ship It! - John Pullokkaran On May 25, 2015, 6:46 p.m.,

Re: Review Request 34656: Scaling PK/FK's selectivity for stats annotation

2015-05-26 Thread John Pullokkaran
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34656/#review85211 --- ql/src/java/org/apache/hadoop/hive/ql/optimizer/stats/annotation/St

Re: Caching metastore objects

2015-05-26 Thread Alan Gates
Sivaramakrishnan Narayanan May 25, 2015 at 20:19 Apologies if this has been discussed in the past - my searches did not pull up any relevant threads. If there are better solutions available out of the box, please let me know! Problem statement

Review Request 34666: HIVE-9152 - Dynamic Partition Pruning [Spark Branch]

2015-05-26 Thread Chao Sun
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34666/ --- Review request for hive, chengxiang li and Xuefu Zhang. Bugs: HIVE-9152 htt

[jira] [Created] (HIVE-10824) Need to update start script changes in .cmd files

2015-05-26 Thread Chinna Rao Lalam (JIRA)
Chinna Rao Lalam created HIVE-10824: --- Summary: Need to update start script changes in .cmd files Key: HIVE-10824 URL: https://issues.apache.org/jira/browse/HIVE-10824 Project: Hive Issue Ty

[jira] [Created] (HIVE-10823) CLI start script throwing error message on console

2015-05-26 Thread Chinna Rao Lalam (JIRA)
Chinna Rao Lalam created HIVE-10823: --- Summary: CLI start script throwing error message on console Key: HIVE-10823 URL: https://issues.apache.org/jira/browse/HIVE-10823 Project: Hive Issue T

[jira] [Created] (HIVE-10822) CLI start script throwing error message on console

2015-05-26 Thread Chinna Rao Lalam (JIRA)
Chinna Rao Lalam created HIVE-10822: --- Summary: CLI start script throwing error message on console Key: HIVE-10822 URL: https://issues.apache.org/jira/browse/HIVE-10822 Project: Hive Issue T