Re: Derby version used by Hive

Richard, A quick eye-balling of the code doesn't show anything that could potentially be a blocker for this upgrade. Also +1 on staying on the latest and greatest. Please feel free to open up a JIRA and submit the patch. Also just out of curiosity, what are you really using a derby backed store

Re: Avro column type in Hive

Sergey, Is your table a partitioned or a non-partitioned one? I have usually seen this problem manifest itself for partitioned tables and that is mostly where the pruning bites. So if you now try to add a partition to this table, you might see an exception like: java.sql.BatchUpdateException:

Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

Congratulations! Well deserved! On Thu, Sep 17, 2015 at 12:03 AM, Vikram Dixit K wrote: > Congrats Ashutosh! > > On Wed, Sep 16, 2015 at 9:01 PM, Chetna C wrote: > >> Congrats Ashutosh ! >> >> Thanks, >> Chetna Chaudhari >> >> On 17 September 2015

Patches needing review

Hello all, I have couple of patches submitted and out for review for some time. If I can get some help on getting them reviewed and merged, I would highly appreciate that! HIVE-11691 (Wiki update for developer debugging. Already one +1 from Lefty) HIVE-11647 (HBase dependency bump to 1.1.1)

Re: hiveserver2 hangs

t; >> We have 8GB HS2 java heap, we have not tried any bumping. >> >> On Tue, Sep 8, 2015 at 8:14 PM, kulkarni.swar...@gmail.com < >> kulkarni.swar...@gmail.com> wrote: >> >>> How much memory have you currently provided to HS2? Have you tried >>> bum

Re: [DISCUSS] github integration

I personally am a big fan of pull requests which is primarily the reason for a similar proposal that I made almost a year and half ago[1] :). I think the consensus we reached at the time was that to move the primary source code from svn to git(which we did) but still use patches submitted to JIRAs

Re: hiveserver2 hangs

te(TUnion.java:213) > at org.apache.thrift.TUnion.write(TUnion.java:152) > > > > On Fri, Aug 21, 2015 at 6:16 AM, kulkarni.swar...@gmail.com < > kulkarni.swar...@gmail.com> wrote: > >> Sanjeev, >> >> One possibility is that you are running into[1]

Re: [ANNOUNCE] New Hive Committer - Lars Francke

Congrats! On Mon, Sep 7, 2015 at 3:54 AM, Carl Steinbach wrote: > The Apache Hive PMC has voted to make Lars Francke a committer on the > Apache Hive Project. > > Please join me in congratulating Lars! > > Thanks. > > - Carl > > -- Swarnim

Patches needing review love

Hey all, I have couple of patches currently review state which are either ready to merge or need review. If I can have someone help me out with these, I would really appreciate that. HIVE-11513 (Ready to merge) HIVE-5277 (Ready to merge) HIVE-11559 (Needs review) HIVE-11469 (Needs review)

Re: hiveserver2 hangs

wrote: We are using hive-0.13 with hadoop1. On Thu, Aug 20, 2015 at 11:49 AM, kulkarni.swar...@gmail.com kulkarni.swar...@gmail.com wrote: Sanjeev, Can you tell me more details about your hive version/hadoop version etc. On Wed, Aug 19, 2015 at 1:35 PM, Sanjeev Verma sanjeev.verm

Re: hiveserver2 hangs

Sanjeev, Can you tell me more details about your hive version/hadoop version etc. On Wed, Aug 19, 2015 at 1:35 PM, Sanjeev Verma sanjeev.verm...@gmail.com wrote: Can somebody gives me some pointer to looked upon? On Wed, Aug 19, 2015 at 9:26 AM, Sanjeev Verma sanjeev.verm...@gmail.com

Re: [DISCUSS] Hive and HBase dependency

that would be ok. Alan. kulkarni.swar...@gmail.com August 14, 2015 at 11:12 Thanks Alan. I created [1] to revert the non-passive changes from 1.x. Out of curiosity, what are your plans on merging the metastore branch to master? It seems like some coordination might be needed as some

Re: [DISCUSS] Hive and HBase dependency

. kulkarni.swar...@gmail.com August 12, 2015 at 8:43 Hi all, It seems like our current dependency on HBase is a little fuzzy to say the least. And with increased features relying on HBase(HBase integration, HBase metastore etc), I think it would be worth giving a thought into how we want to manage

[DISCUSS] Hive and HBase dependency

Hi all, It seems like our current dependency on HBase is a little fuzzy to say the least. And with increased features relying on HBase(HBase integration, HBase metastore etc), I think it would be worth giving a thought into how we want to manage this dependency. I have also seen regressions[1][2]

Re: Hive column mapping to hbase

Sunile, Starting hive 0.12, you can use prefixes to pull the columns corresponding to the column families. So in your case as long as you have sensible prefixes, for example for everything in july, if you use july-DATE-speed, then you can simply do something like WITH SERDEPROPERTIES

Re: [ANNOUNCE] New Hive PMC Member - Sushanth Sowmyan

Congrats Sushanth! On Thu, Jul 23, 2015 at 3:40 PM, Eugene Koifman ekoif...@hortonworks.com wrote: Congratulations! On 7/22/15, 9:45 AM, Carl Steinbach c...@apache.org wrote: I am pleased to announce that Sushanth Sowmyan has been elected to the Hive Project Management Committee. Please

Re: hbase column without prefix

Hey, Just so that I understand your issue better, why do you think it should be key: one, value: 0.5 key: two: value: 0.5 instead of key: tag_one, value: 0.5 key: tag_two, value: 0.5 when you know that the prefixes for your columns are tag_. Hive won't really do anything but simply pull all

Re: hbase column without prefix

you think about it? Does it make sense for you? Even if it's not a bug it would be nice to have option to hide prefixes in keys of map. Kindly regards Wojciech Indyk 2015-07-23 16:32 GMT+02:00 kulkarni.swar...@gmail.com kulkarni.swar...@gmail.com: Hey, Just so that I understand your

Re: [DISCUSS] Supporting Hadoop-1 and experimental features

+1 on the new proposal. Feedback below: New features must be put into master. Whether to put them into branch-1 is at the discretion of the developer. How about we change this to *All* features must be put into master. Whether to put them into branch-1 is at the discretion of the *committer*.

Re: [ANNOUNCE] New Hive Committer - Chaoyu Tang

Congrats Chaoyu! On Thu, May 21, 2015 at 9:17 AM, Sergio Pena sergio.p...@cloudera.com wrote: Congratulations Chaoyu !!! On Wed, May 20, 2015 at 5:29 PM, Carl Steinbach c...@apache.org wrote: The Apache Hive PMC has voted to make Chaoyu Tang a committer on the Apache Hive Project.

Re: Questions related to HBase general use

+ hive-dev Thanks for your question. We recently have been busy adding quite a few features on top on Hive/HBase Integration to make it more stable and easy to use. We also did a talk very recently at HBaseCon 2015 showing off the latest improvements. Slides here[1]. Like Jerry mentioned, if you

Re: JIRA notifications

. -- Lefty On Wed, May 13, 2015 at 10:03 AM, Thejas Nair thejas.n...@gmail.com wrote: comments now added go to iss...@hive.apache.org . emails for JIRAs created should still go to dev@ On Wed, May 13, 2015 at 9:25 AM, kulkarni.swar...@gmail.com kulkarni.swar...@gmail.com wrote: I

[DISCUSS] Hive API passivity

While reviewing some of the recent patches, I came across a few with non-passive changes and or discussion around them. I was wondering what kind of passivity guarantees should we provide to our consumers? I understand that Hive API is probably not as widely used as some of its peers in the

Re: JIRA notifications

instructions - http://accumulo.apache.org/git.html On Thu, May 14, 2015 at 8:01 AM, kulkarni.swar...@gmail.com kulkarni.swar...@gmail.com wrote: Also not sure if it's related but seems like RB has been pretty sluggish lately too for me. It takes forever for a patch to submitted

JIRA notifications

I noticed that I haven't been getting notifications(or they are really delayed) on any of the new JIRAs created/ comments added. Anyone else noticing similar issues as well? -- Swarnim

[DISCUSS] Hive/HBase Integration

Hello all, So last week, Myself, Brock Noland and Nick Dimiduk got a chance to present some of the work we have been doing in the Hive/HBase integration space at HBaseCon 2015 (slides here[1] for anyone interested). One of the interesting things that we noted at this conference was that even

Re: [ANNOUNCE] New Hive Committer - Alex Pivovarov

Congratulations Alex!! On Thu, Apr 30, 2015 at 2:49 PM, Sergey Shelukhin ser...@hortonworks.com wrote: Congratulations! On 15/4/29, 17:57, Jimmy Xiang jxi...@cloudera.com wrote: Congrats!! On Wed, Apr 29, 2015 at 5:48 PM, Xu, Cheng A cheng.a...@intel.com wrote: Congratulations Alex!

Re: [ANNOUNCE] New Hive Committer - Mithun Radhakrishnan

Congratulations!! On Wed, Apr 15, 2015 at 10:57 AM, Viraj Bhat vi...@yahoo-inc.com.invalid wrote: Mithun Congrats!! Viraj From: Carl Steinbach c...@apache.org To: dev@hive.apache.org; u...@hive.apache.org; mit...@apache.org Sent: Tuesday, April 14, 2015 2:54 PM Subject:

Re: Can anyone review dayofyear UDF (HIVE-3378)?

Alexander, I reviewed your code and left a few suggestions on how to possibly simplify it(if I understood your implementation correctly). Let me know if they don't make sense to you. On Wed, Apr 8, 2015 at 12:34 PM, Alexander Pivovarov apivova...@gmail.com wrote:

Re: [ANNOUNCE] New Hive PMC Member - Sergey Shelukhin

Congratulations Sergey! Well deserved! On Fri, Feb 27, 2015 at 1:51 AM, Vinod Kumar Vavilapalli vino...@hortonworks.com wrote: Congratulations and keep up the great work! +Vinod On Feb 25, 2015, at 8:43 AM, Carl Steinbach c...@apache.org wrote: I am pleased to announce that Sergey

Re: [ANNOUNCE] New Hive Committer - Eugene Koifman

Congratulations! Nice Job! On Mon, Sep 15, 2014 at 2:54 AM, Damien Carol dca...@blitzbs.com wrote: Congratulations, Eugene. Damien CAROL - tél : +33 (0)4 74 96 88 14 - fax : +33 (0)4 74 96 31 88 - email : dca...@blitzbs.com BLITZ BUSINESS SERVICE Le 14/09/2014 09:23, Thejas

Re: [ANNOUNCE] New Hive Committers - Gopal Vijayaraghavan and Szehon Ho

Congratulations guys! On Mon, Jun 23, 2014 at 2:09 AM, Lefty Leverenz leftylever...@gmail.com wrote: Bravo, Szehon and Gopal! -- Lefty On Mon, Jun 23, 2014 at 12:53 AM, Gopal V gop...@apache.org wrote: On 6/22/14, 8:42 PM, Carl Steinbach wrote: The Apache Hive PMC has voted to make

Re: Documentation Policy

. -- Lefty On Fri, Jun 13, 2014 at 1:31 PM, kulkarni.swar...@gmail.com kulkarni.swar...@gmail.com wrote: +1 on deleting the TODOC tag as I think it's assumed by default that once an enhancement is done, it will be doc'ed. We may consider adding an additional docdone tag but I think we

Re: Documentation Policy

, no version number). (c) Add a docdone label but keep TODOC##. (d) Something else. -- Lefty On Thu, Jun 12, 2014 at 12:54 PM, Brock Noland br...@cloudera.com wrote: Thank you guys! This is great work. On Wed, Jun 11, 2014 at 6:20 PM, kulkarni.swar...@gmail.com kulkarni.swar

Re: Documentation Policy

Feel free to label such jiras with this keyword and ask the contributors for more information if you need any. Cool. I'll start chugging through the queue today adding labels as apt. On Tue, Jun 10, 2014 at 9:45 PM, Thejas Nair the...@hortonworks.com wrote: Shall we lump 0.13.0 and 0.13.1

Re: Documentation Policy

%3D%20TODOC14%20AND%20status%20in%20(Resolved%2C%20Closed) I'll continue digging through the queue going backwards to 0.12 and 0.11 and see if I find similar stuff there as well. On Wed, Jun 11, 2014 at 10:36 AM, kulkarni.swar...@gmail.com kulkarni.swar...@gmail.com wrote: Feel free to label

Re: Documentation Policy

Writing documentation sooner rather than later is likely to increases the chances of things getting documented. Big +1 on this. I think documentation contributes towards one of the major technical debts(I personally have quite a bit for the patches I contributed). IMHO committers may choose to

Re: Fixing Trunk tests and getting stable nightly build on b.a.o

Hi Lewis, Are there any specific tests that you are seeing trouble with? If so, please feel free to log appropriate JIRAs to get them fixed (and submit patches ;) ) There is a developer guide[1] that explains in quite detail how to run tests. Are there any suggested EXTRA_PARAMETERS to be

Re: Bumping a few JIRAs

I am also definitely willing to help out with reviewing the JIRAs. Just my +1 won't matter much as it is non-binding. :) On Thu, Mar 20, 2014 at 1:21 PM, Lefty Leverenz leftylever...@gmail.comwrote: I gave HIVE-6331 https://issues.apache.org/jira/browse/HIVE-6331 a +1 and asked for a trivial

Re: Bumping a few JIRAs

Left few minor comments on the JIRAs On Thu, Mar 20, 2014 at 2:42 PM, kulkarni.swar...@gmail.com kulkarni.swar...@gmail.com wrote: I am also definitely willing to help out with reviewing the JIRAs. Just my +1 won't matter much as it is non-binding. :) On Thu, Mar 20, 2014 at 1:21 PM

Re: Proposal to switch to pull requests

/improved_integration_between_apache_and On Wed, Mar 5, 2014 at 9:19 AM, kulkarni.swar...@gmail.com kulkarni.swar...@gmail.com wrote: Hello, Since we have a nice mirrored git repository for hive[1], any specific reason why we can't switch to doing pull requests instead of patches? IMHO pull requests are awesome

Proposal to switch to pull requests

Hello, Since we have a nice mirrored git repository for hive[1], any specific reason why we can't switch to doing pull requests instead of patches? IMHO pull requests are awesome for peer review plus it is also very easy to keep track of JIRAs with open pull requests instead of looking for JIRAs

Re: [Discuss] project chop up

I'd like to propose we move towards Maven. Big +1 on this. Most of the major apache projects(hadoop, hbase, avro etc.) are maven based. Also can't agree more that the current build system is frustrating to say the least. Another issue I had with the existing ant based system is that there are

Re: Access to trigger jobs on jenkins

the pre-commit builds? Unfortunately to trigger *regular* builds you'd need an Apache username according the Apache Infra Jenkins http://wiki.apache.org/general/Jenkins page. Brock On Sun, Aug 4, 2013 at 1:37 PM, kulkarni.swar...@gmail.com kulkarni.swar...@gmail.com wrote: Hello, I

Access to trigger jobs on jenkins

Hello, I was wondering if it is possible to get access to be able to trigger jobs on the jenkins server? Or is that access limited to committers? Thanks, -- Swarnim

Re: is there set of queries, which can be used to benchmark the hive performance?

Hi Rob, HiBench[1] is one I have seen most commonly used. [1] https://github.com/intel-hadoop/HiBench/tree/master/hivebench On Tue, Apr 16, 2013 at 6:42 PM, ur lops urlop...@gmail.com wrote: I am looking to benchmark my database with hive. but before I do that, I want to run a set of tests

Preferred way to run unit tests

Hello, I have been trying to run the unit tests for the last hive release (0.10). For me they have been taking in access of 10 hrs to run (not to mention the occasional failures with some of the flaky tests). Current I am just doing a ant clean package test. Is there a better way to run these?

Re: Review Requests

Would someone have a chance to take a quick look at these review requests[1][2]. [1] https://reviews.apache.org/r/9275/ [2] https://reviews.apache.org/r/9276/ Thanks, On Tue, Feb 5, 2013 at 10:00 AM, kulkarni.swar...@gmail.com kulkarni.swar...@gmail.com wrote: Thanks Mark. Appreciate

Re: Review Requests

Thanks Mark. Appreciate that. I'll take a look. On Mon, Feb 4, 2013 at 10:23 PM, Mark Grover grover.markgro...@gmail.comwrote: Swarnim, I left some comments on reviewboard. On Mon, Feb 4, 2013 at 8:00 AM, kulkarni.swar...@gmail.com kulkarni.swar...@gmail.com wrote: Hello, I opened

Review Requests

Hello, I opened up two reviews for small issues, HIVE-3553[1] and HIVE-3725[2]. If you guys get a chance to review and provide feedback on it, I will really appreciate. Thanks, [1] https://reviews.apache.org/r/9275/ [2] https://reviews.apache.org/r/9276/ -- Swarnim

Re: hive 0.10 release

There are couple of enhancements that I have been working on mainly related to the hive/hbase integration. It would be awesome if it is possible at all to include them in this release. None of them should really be high risk. I have patches submitted for few of them. Will try to get for others

Hive JIRA slow/dead

Seems like the hive JIRA is extremely slow to respond since this morning. Is there anyway to may be cycle the instance to fix the issue? Thanks, -- Swarnim

Re: Custom UserDefinedFunction in Hive

Have you tried using EXPLAIN[1] on your query? I usually like to use that to get a better understanding of what my query is actually doing and debugging at other times. [1] https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Explain On Tue, Aug 7, 2012 at 12:20 PM, Raihan Jamal

Re: Some Weird Behavior

, kulkarni.swar...@gmail.com kulkarni.swar...@gmail.com wrote: What is the hive version that you are using? On Tue, Aug 7, 2012 at 12:57 PM, Techy Teck comptechge...@gmail.comwrote: I am not sure about the data, but when we do SELECT count(*) from data_realtime where dt='20120730' and uid

Re: Logging info is not present in console output

Are you running via console? The default logging level is WARN. $HIVE_HOME/bin/hive -hiveconf hive.root.logger=INFO,console This should print the INFO messages onto the console. On Tue, Aug 7, 2012 at 4:07 PM, Ablimit Aji abli...@gmail.com wrote: Hi, I have put some LOG.info() statements

Re: Casting exception while converting from LazyDouble to LazyString

Hi Kanna, This might just mean that in your query you are having a STRING type for a field which is actually a DOUBLE. On Tue, Jul 10, 2012 at 3:05 PM, Kanna Karanam kanna...@microsoft.comwrote: Has anyone seen this error before? Am I missing anything here? ** ** 2012-07-10

Re: Developing Hive UDF in eclipse

Did you try this[1]? It had got me most of my way through the process. [1] https://cwiki.apache.org/Hive/gettingstarted-eclipsesetup.html On Tue, Jun 5, 2012 at 8:49 AM, Arun Prakash ckarunprak...@gmail.comwrote: Hi Friends, I tried to develop udf for hive but i am getting package import

getStructFieldData method on StructObjectInspector

I am trying to write a custom ObjectInspector extending the StructObjectInspector and got a little confused about the use of the getStructFieldData method on the inspector. Looking at the definition of the method: public Object getStructFieldData(Object data, StructField fieldRef); I understand