Re: [DISCUSS] Separating out the metastore as its own TLP

2017-07-05 Thread Alan Gates
On Mon, Jul 3, 2017 at 10:17 AM, Dain Sundstrom wrote: > +1 > > I work on Presto and I think this the right direction for our users. We > have several users running Presto without Hive and anything we can do to > help simplify the Metastore experience would be a good help. > >

Re: [DISCUSS] Separating out the metastore as its own TLP

2017-07-05 Thread Alan Gates
On Mon, Jul 3, 2017 at 6:20 AM, Edward Capriolo wrote: > > We already have things in the meta-store not directly tied to language > features. For example hive metastore has a "retention" property which is > not actively in use by anything. In reality, we rarely say 'no' or

Re: [DISCUSS] Separating out the metastore as its own TLP

2017-07-02 Thread Alan Gates
Comments inlined. On Sun, Jul 2, 2017 at 3:22 PM, Edward Capriolo wrote: > I am not sure I am on the fence with this. > > I am -1, and I offer this -1 with the hope of being convinced otherwise > Thank you for being open to reconsider. > > > "By making it a separate

[DISCUSS] Separating out the metastore as its own TLP

2017-06-30 Thread Alan Gates
Hagleitner Thejas Nair Alan Gates

Fwd: JSON reminder

2017-05-23 Thread Alan Gates
This applies to Hive and blocks the 2.2 and 2.3 releases. The issue has not been resolved on master as well. Alan. -- Forwarded message -- From: Jim Jagielski Date: Tue, May 23, 2017 at 6:57 AM Subject: JSON reminder To: legal discuss

CFP for Dataworks Summit Sydney

2017-05-03 Thread Alan Gates
The Australia/Pacific version of Dataworks Summit is in Sydney this year, September 20-21. This is a great place to talk about work you are doing in Apache Hive or how you are using Hive. Information on submitting an abstract is at

CFP for Dataworks Summit Sydney

2017-05-03 Thread Alan Gates
Resend, sorry if this shows up twice. The Australia/Pacific version of Dataworks Summit is in Sydney this year, September 20-21.   This is a great place to talk about work you are doing in Apache Hive or how you are using Hive.  Information on submitting an abstract is at

Re: [VOTE] Should we release hive-storage-2.3.0rc0?

2017-05-02 Thread Alan Gates
+1.  Did a build with a fresh maven repo, checked the signatures, ran rat. Alan. On Apr 27, 2017, 16:08 -0700, Owen O'Malley , wrote: > All, > I'd like to make a new release of the storage-api for the upcoming 2.2 > release. Since storage-api rolls releases faster than Hive,

[jira] [Created] (HIVE-16535) Hive fails to build from source code tarball

2017-04-25 Thread Alan Gates (JIRA)
Alan Gates created HIVE-16535: - Summary: Hive fails to build from source code tarball Key: HIVE-16535 URL: https://issues.apache.org/jira/browse/HIVE-16535 Project: Hive Issue Type: Bug

[jira] [Created] (HIVE-16504) Addition of binary licenses broke rat check

2017-04-21 Thread Alan Gates (JIRA)
Alan Gates created HIVE-16504: - Summary: Addition of binary licenses broke rat check Key: HIVE-16504 URL: https://issues.apache.org/jira/browse/HIVE-16504 Project: Hive Issue Type: Bug

[jira] [Created] (HIVE-16463) Change license for java transaction jta jar to CDDL 1.0

2017-04-17 Thread Alan Gates (JIRA)
Alan Gates created HIVE-16463: - Summary: Change license for java transaction jta jar to CDDL 1.0 Key: HIVE-16463 URL: https://issues.apache.org/jira/browse/HIVE-16463 Project: Hive Issue Type

Re: Need help to contribute in Hive

2017-03-14 Thread Alan Gates
Prince, welcome to Hive. Probably the best way is to find a JIRA no one else is working on, assign it to yourself, and then start working on it. I did a quick search on open JIRAs relating to the thrift interface and found

Re: [DISCUSS] Spark's fork of hive

2017-03-02 Thread Alan Gates
I think the issues you point out fall into a couple of different buckets: 1) Spark forking Hive code. As you point out, based on the license, there's nothing wrong with this (see naming concerns below). I agree it's crappy technical practice because in the long term Hive and Spark will

[ANNOUNCE] New committer: Zoltan Haindrich

2017-02-21 Thread Alan Gates
On behalf of the Hive PMC I am happy to announce Zoltan Haindrich is our newest committer. He has been contributing to Hive for several months across a number of areas, including the parser, HiveServer2, and cleaning up unit tests and documentation. Please join me in welcoming Zoltan to Hive.

Re: [VOTE] Should we release hive-storage-2.2.1rc0?

2017-02-17 Thread Alan Gates
+1. Did a build with a clean maven repo, ran rat, checked the signatures, checked for any binary files in the tarball. Alan. > On Feb 16, 2017, at 10:56 AM, Owen O'Malley wrote: > > All, > We've made some fixes to the storage-api since 2.2.0 and I'd like to > make a new

Re: [VOTE] Should we release hive-storage 2.2.0RC0

2017-01-11 Thread Alan Gates
+1. Did a build, checked the signatures, looked over the new LICENSE and NOTICE files, ran rat. Alan. > On Jan 5, 2017, at 9:39 AM, Owen O'Malley wrote: > > All, > I'd like to make a release of Hive's storage-api module. This will allow > ORC to remove its fork of

Re: [DISCUSS] Separate release of storage-api

2017-01-11 Thread Alan Gates
90% of the discussion on the previous thread was on version numbering, which never came to a conclusion. Based on your RC candidate I assume you chose the separate version numbering, but starting from the same 2.2.0 base number. I agree this is the only viable option[1], but I wanted to point

[jira] [Created] (HIVE-15413) Primary key constraints forced to be unique across database and table names

2016-12-09 Thread Alan Gates (JIRA)
Alan Gates created HIVE-15413: - Summary: Primary key constraints forced to be unique across database and table names Key: HIVE-15413 URL: https://issues.apache.org/jira/browse/HIVE-15413 Project: Hive

[jira] [Created] (HIVE-15412) Partition columns should be allowed in primary keys

2016-12-09 Thread Alan Gates (JIRA)
Alan Gates created HIVE-15412: - Summary: Partition columns should be allowed in primary keys Key: HIVE-15412 URL: https://issues.apache.org/jira/browse/HIVE-15412 Project: Hive Issue Type: Bug

Re: Request for addition as contributor

2016-12-09 Thread Alan Gates
-- do you want it? Sure. Alan. > > -- Lefty > > > On Thu, Dec 8, 2016 at 7:27 AM, Alan Gates <alanfga...@gmail.com> wrote: > >> On JIRA or the wiki? I tried to add you to the JIRA but it didn't find a >> szita or Adam Szita user. I'm not sure I have permi

[jira] [Created] (HIVE-15401) Import constraints into HBase metastore

2016-12-08 Thread Alan Gates (JIRA)
Alan Gates created HIVE-15401: - Summary: Import constraints into HBase metastore Key: HIVE-15401 URL: https://issues.apache.org/jira/browse/HIVE-15401 Project: Hive Issue Type: Sub-task

Re: Request for addition as contributor

2016-12-08 Thread Alan Gates
On JIRA or the wiki? I tried to add you to the JIRA but it didn't find a szita or Adam Szita user. I'm not sure I have permission to add you to the wiki. Alan. > On Dec 8, 2016, at 07:21, Adam Szita wrote: > > Hi, > > Can you add my userid (szita) as contributor to Hive

[jira] [Created] (HIVE-15342) Add support for primary/foreign keys in HBase metastore

2016-12-02 Thread Alan Gates (JIRA)
Alan Gates created HIVE-15342: - Summary: Add support for primary/foreign keys in HBase metastore Key: HIVE-15342 URL: https://issues.apache.org/jira/browse/HIVE-15342 Project: Hive Issue Type

Re: [VOTE] Apache Hive 2.1.1 Release Candidate 1

2016-12-01 Thread Alan Gates
+1, checked the signatures, checked that the new warning about JSON is in the NOTICE file, did a build (sans unit tests), and checked for any binaries in the source distribution. I didn’t see the signature issues that Sergio saw. Alan. > On Nov 29, 2016, at 12:17, Jesus Camacho Rodriguez

Re: [DISCUSS] Making a stable release from branch 2

2016-11-29 Thread Alan Gates
I’m not sure what would be confusing about the numbering. Assumably the next feature bearing release will be 2.2. The next one after that 2.3. We should make a rule that patches in version x don’t go away in x+1. With that I don’t see any confusion. I agree we shouldn’t turn master into a

Re: [VOTE] Apache Hive 2.1.1 Release Candidate 0

2016-11-28 Thread Alan Gates
Per this email, https://hortonworks.webex.com/hortonworks/j.php?MTID=m85864659ba07e06f1fa31f6c511a424e we will need to modify Hive’s NOTICE file before we can release. Alan. > On Nov 28, 2016, at 14:28, Jesus Camacho Rodriguez > wrote: > > Apache Hive 2.1.1 Release

Re: [DISCUSS] Hive 1.2.2 bug fix release

2016-11-10 Thread Alan Gates
Note that now that Apache legal has decided that the JSON license is no longer acceptable we’ll have to fix that before we release. See https://issues.apache.org/jira/browse/HIVE-15144 for details. Alan. > On Nov 7, 2016, at 02:29, Vaibhav Gumashta wrote: > > Hi,

Hadoop Summit EU 2017

2016-11-04 Thread Alan Gates
The DataWorks Summit EU 2017 (including Hadoop Summit) is going to be in Munich April 5-6 2017. I’ve pasted the text from the CFP below. Would you like to share your knowledge with the best and brightest in the data community? If so, we encourage you to submit an abstract for DataWorks

Re: HIVE-1555 JDBC Storage Handler

2016-11-01 Thread Alan Gates
In Apache projects people work on what interests them or is important to them, so apparently no one has been interested/motivated enough to take this on yet. Feel free to work on it. I see Xuefu has already assigned it to you. Alan. > On Nov 1, 2016, at 04:26, Dmitry Zagorulkin

[jira] [Created] (HIVE-15037) Figure out whether the SCSL 3.0 license is acceptable

2016-10-22 Thread Alan Gates (JIRA)
Alan Gates created HIVE-15037: - Summary: Figure out whether the SCSL 3.0 license is acceptable Key: HIVE-15037 URL: https://issues.apache.org/jira/browse/HIVE-15037 Project: Hive Issue Type: Bug

[jira] [Created] (HIVE-15036) Druid code recently included in Hive pulls in GPL jar

2016-10-22 Thread Alan Gates (JIRA)
Alan Gates created HIVE-15036: - Summary: Druid code recently included in Hive pulls in GPL jar Key: HIVE-15036 URL: https://issues.apache.org/jira/browse/HIVE-15036 Project: Hive Issue Type: Bug

[jira] [Created] (HIVE-15035) Clean up Hive licenses for binary distribution

2016-10-22 Thread Alan Gates (JIRA)
Alan Gates created HIVE-15035: - Summary: Clean up Hive licenses for binary distribution Key: HIVE-15035 URL: https://issues.apache.org/jira/browse/HIVE-15035 Project: Hive Issue Type: Bug

Re: [DISCUSS] Pre-commit tests before commits

2016-10-14 Thread Alan Gates
As far connecting in findbugs, etc. should we consider integrating with Apache Yetus for all this? Alan. > On Oct 14, 2016, at 12:27, Siddharth Seth wrote: > > Once we agree upon what the flow should be, I'm also in favor of reverting > patches which break things. Such

Re: [DISCUSSION] Deprecate HIVE_SUPPORT_SQL11_RESERVED_KEYWORDS

2016-10-03 Thread Alan Gates
Have we warned users in current and previous releases that this may change? We can’t put in a backwards incompatible changes without giving users some amount of time to adapt. Alan. > On Sep 30, 2016, at 20:52, Pengcheng Xiong wrote: > > Hi all, > >I logged

Re: More than one table created at the same location

2016-08-29 Thread Alan Gates
Note that Hive doesn’t track individual files, just which directory a table stores its files in. So we wouldn’t expect this to work. The bug is more that Hive doesn’t detect that two tables are trying to use the same directory. I’m not sure we’re anxious to fix this since it would mean when

Re: [DISCUSS] Making storage-api a separately released artifact

2016-08-17 Thread Alan Gates
+1 for making the API clean and easy for other projects to work with. A few questions: 1) Would this also make it easier for Parquet and others to implement Hive’s ACID interfaces? 2) Would we make any attempt to coordinate version numbers between Hive and the storage module, or would a

Re: [discuss] decimals vs doubles in Hive

2016-06-14 Thread Alan Gates
I’m +1 on reverting it. Let’s not change around functionality on our users and let’s stay as close as possible to the standard, both of which reverting this seems to do. Alan. > On Jun 10, 2016, at 16:07, Sergey Shelukhin wrote: > > There has recently been a change

Re: [VOTE] Apache Hive 2.1.0 Release Candidate 2

2016-06-10 Thread Alan Gates
+1, checked signatures, did a build and ran a few simple unit tests. Alan. > On Jun 10, 2016, at 05:44, Jesus Camacho Rodriguez > wrote: > > Apache Hive 2.1.0 Release Candidate 2 is available here: > > http://people.apache.org/~jcamacho/hive-2.1.0-rc2 > >

Re: [VOTE] Apache Hive 2.1.0 Release Candidate 1

2016-06-06 Thread Alan Gates
When I try to build the source I get: gates> mvn -DskipTests -Dmaven.repo.local=/Users/gates/tmp/hive/m2/ install Picked up JAVA_TOOL_OPTIONS: -Djava.awt.headless=true [INFO] Scanning for projects... Downloading: http://www.datanucleus.org/downloads/maven2/org/apache/apache/14/apache-14.pom

Re: Contributor Role

2016-06-02 Thread Alan Gates
Abdullah, I’ve added you to the contributor group in the JIRA, so you can now assign JIRAs to yourself. You may also find this page https://cwiki.apache.org/confluence/display/Hive/HowToContribute helpful. Welcome to the Hive community! Alan. > On Jun 2, 2016, at 15:26, Abdullah Yousufi

Re: Why can't assign newly opened JIRA issue

2016-05-26 Thread Alan Gates
Apache Infrastructure turned this off due to spam issues. If you send your JIRA id we can add you to the contributors list so you can assign JIRAs to yourself again. Alan. > On May 26, 2016, at 10:43, Svetozar Ivanov > wrote: > > Hi all, I'm wondering why can't

Re: Proposing Hive 2.0.2

2016-05-24 Thread Alan Gates
Since this is an API change does it belong in 2.1 instead of 2.0.2? Alan. > On May 24, 2016, at 11:00, Owen O'Malley wrote: > > I'd like to propose rolling a 2.0.2 release that contains 2.0.1 + HIVE-13464 > , which imports

Re: Becoming a contributor

2016-05-18 Thread Alan Gates
You’ve been added, so you should now be able to assign JIRAs to yourself. Alan. > On May 18, 2016, at 13:38, Vihang Karajgaonkar <vih...@cloudera.com> wrote: > > Thanks Alan! My JIRA id is vihangk1 > > -Vihang > >> On May 18, 2016, at 1:09 PM, Alan Gate

Re: Becoming a contributor

2016-05-18 Thread Alan Gates
Nope, you’re good. You can ignore the stuff about review board as we generally only use that now for large and complex patches. If you have a JIRA in mind you’d like to work on that no one else has you can assign it to yourself* and get started. If someone else is working on it you should

Re: [VOTE] Apache Hive 2.0.1 Release Candidate 1

2016-05-12 Thread Alan Gates
+1. Checked the keys and signatures, did a full build with a clean repo, checked for the presence of any binary files, checked the NOTICE and LICENSE files. Alan. > On May 3, 2016, at 21:25, Sergey Shelukhin wrote: > > Apache Hive 2.0.1 Release Candidate 1 is available

[jira] [Created] (HIVE-13683) Remove erroneously included patch file

2016-05-03 Thread Alan Gates (JIRA)
Alan Gates created HIVE-13683: - Summary: Remove erroneously included patch file Key: HIVE-13683 URL: https://issues.apache.org/jira/browse/HIVE-13683 Project: Hive Issue Type: Bug Affects

[jira] [Created] (HIVE-13681) Update README with latest Hive functionality

2016-05-03 Thread Alan Gates (JIRA)
Alan Gates created HIVE-13681: - Summary: Update README with latest Hive functionality Key: HIVE-13681 URL: https://issues.apache.org/jira/browse/HIVE-13681 Project: Hive Issue Type: Improvement

[jira] [Created] (HIVE-13607) Change website references to HQL/HiveQL to SQL

2016-04-25 Thread Alan Gates (JIRA)
Alan Gates created HIVE-13607: - Summary: Change website references to HQL/HiveQL to SQL Key: HIVE-13607 URL: https://issues.apache.org/jira/browse/HIVE-13607 Project: Hive Issue Type

Re: [VOTE] Bylaws change to allow some commits without review

2016-04-20 Thread Alan Gates
hem. > > Cheers, > Lars > > On Tue, Apr 19, 2016 at 10:37 PM, Alan Gates <alanfga...@gmail.com> wrote: > >> Per the Apache phone book the current list of Hive PMC members is: >> athusoo Ashish Thusoo >> brock Brock Noland >> cws Carl

Re: [VOTE] Bylaws change to allow some commits without review

2016-04-19 Thread Alan Gates
Per the Apache phone book the current list of Hive PMC members is: athusoo Ashish Thusoo brock Brock Noland cws Carl Steinbach ecapriolo Edward Capriolo gates Alan Gates gopalv Gopal Vijayaraghavan gunther Gunther Hagleitner hashutosh Ashutosh Chauhan heyongqiang Yongqiang

Re: Reviews & commits (RTC/CTR), contributions, bylaws

2016-04-12 Thread Alan Gates
I’m +1 on this change of allowing simple cleanup changes without requiring a full review. But jumping to this fix obscures a bigger problem we have as a community. This fix only works for committers, not for non-committers who may also contribute such patches. And it doesn’t solve the

[jira] [Created] (HIVE-13406) HBase metastore needs to support ACID

2016-04-01 Thread Alan Gates (JIRA)
Alan Gates created HIVE-13406: - Summary: HBase metastore needs to support ACID Key: HIVE-13406 URL: https://issues.apache.org/jira/browse/HIVE-13406 Project: Hive Issue Type: Improvement

Re: SELECT without FROM

2016-03-09 Thread Alan Gates
I’m not aware of any JIRA on it. The easiest way to find out will be to look at the git history of Hive’s grammar file and see when it changed. As for taking out, we shouldn’t since it’s valid SQL and we’re pushing towards more ANSI compliance. Alan. > On Mar 9, 2016, at 01:50, Dmitry

Re: hive/odbc codebase

2016-03-08 Thread Alan Gates
AFAIK it’s dead. Alan. > On Mar 7, 2016, at 20:33, Gopal Vijayaraghavan wrote: > > Hi, > > Does anyone know if the hive/odbc codebase works? > > https://github.com/apache/hive/tree/master/odbc/src/cpp > > Is it dead-code we can remove as part of the hive-2.0 branch? > >

Re: Spark and HBase metastore jiras in 2.0 release

2016-02-17 Thread Alan Gates
It makes sense to update the branch fix versions when we merge so that people can figure out what release version a fix or feature is in. So +1. Alan. Thejas Nair February 16, 2016 at 21:48 The hbase-metastore branch jiras are all part of Hive 2.0.0 release, as

Re: [VOTE] Apache Hive 2.0.0 Release Candidate 3

2016-02-11 Thread Alan Gates
+1, checks sigs, build with fresh maven repo, and did a quick smoke test. Does the PMC member who votes on the most RC's get a prize? Alan. Sergey Shelukhin February 9, 2016 at 18:52 Another day, another release candidate... this time fixing the logging issue.

Re: [VOTE] Apache Hive 2.0.0 Release Candidate 2

2016-02-09 Thread Alan Gates
It is expected, you now have to run SchemaTool manually, as the error message indicates. See https://issues.apache.org/jira/browse/HIVE-1841 Alan. Xuefu Zhang February 9, 2016 at 10:37 Some trouble I met: 1. downloaded source and build Hive with -Pdist. 2. try

Re: [VOTE] Apache Hive 2.0.0 Release Candidate 2

2016-02-09 Thread Alan Gates
FYI the URL for the candidate returns 404, the correct URL is http://people.apache.org/~sershe/hive-2.0.0-rc2/ +1, checks signatures, did a build with a brand new maven repo, and ran a quick smoke test. Alan. Sergey Shelukhin February 8, 2016 at 18:29 Apache Hive

Re: [VOTE] Apache Hive 2.0.0 Release Candidate 1

2016-02-08 Thread Alan Gates
+1. Signatures and licenses look good, build is good. We should file a JIRA to resolve the docs for local install ASAP so people can use this out of the box. Alan. Sergey Shelukhin February 2, 2016 at 18:26 Apache Hive 2.0.0 Release Candidate 1 is available

Re: [VOTE] Apache Hive 2.0.0 Release Candidate 1

2016-02-03 Thread Alan Gates
When I installed it locally and tried to run it I get the following failure: Caused by: org.datanucleus.store.rdbms.exceptions.MissingTableException: Required table missing : "VERSION" in Catalog "" Schema "". DataNucleus requires this table to perform its persistence operations. Either your

Re: [VOTE] Apache Hive 2.0.0 Release Candidate 1

2016-02-03 Thread Alan Gates
could be caused by the change to not allow DN to mutate the schema. I cannot find the JIRA right now, Ashutosh might know. The metastore database has to be created via the install script and schema tool. Perhaps we can document that. From: Alan Gates <alanfga...@gmail.com <mailto:alanfga.

Re: [VOTE] Apache Hive 2.0.0 Release Candidate 0

2016-02-02 Thread Alan Gates
-1. There's a jar file in the src distribution, ./data/files/identity_udf.jar We can't have any binary files in the src distribution. When I do: mvn install -DskipTests -Dmaven.repo.local=/Users/gates/tmp/hive/m2 I get: [ERROR] The build could not read 1 project -> [Help 1] [ERROR] [ERROR]

Re: Need your opinion on HIVE-12916 to clean up metastore API

2016-01-28 Thread Alan Gates
Are you proposing to do this in 2.0 or branch-1 or both? In master we can put up with some backwards incompatibility for now. But given that it's straightforward to maintain it (as Sergey outlines) even there it doesn't seem worth it. So unless there's a very compelling reason (i.e. more

[jira] [Created] (HIVE-12902) Refactor TxnHandler to be an interface

2016-01-21 Thread Alan Gates (JIRA)
Alan Gates created HIVE-12902: - Summary: Refactor TxnHandler to be an interface Key: HIVE-12902 URL: https://issues.apache.org/jira/browse/HIVE-12902 Project: Hive Issue Type: Improvement

[jira] [Created] (HIVE-12903) Add ability to run HBase metastore in test mode along with RDBMS

2016-01-21 Thread Alan Gates (JIRA)
Alan Gates created HIVE-12903: - Summary: Add ability to run HBase metastore in test mode along with RDBMS Key: HIVE-12903 URL: https://issues.apache.org/jira/browse/HIVE-12903 Project: Hive

[jira] [Created] (HIVE-12829) Thrift changes for HIVE-12686

2016-01-09 Thread Alan Gates (JIRA)
Alan Gates created HIVE-12829: - Summary: Thrift changes for HIVE-12686 Key: HIVE-12829 URL: https://issues.apache.org/jira/browse/HIVE-12829 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-12832) RDBMS schema changes for HIVE-11388

2016-01-09 Thread Alan Gates (JIRA)
Alan Gates created HIVE-12832: - Summary: RDBMS schema changes for HIVE-11388 Key: HIVE-12832 URL: https://issues.apache.org/jira/browse/HIVE-12832 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-12830) Thrift changes for HIVE-11793

2016-01-09 Thread Alan Gates (JIRA)
Alan Gates created HIVE-12830: - Summary: Thrift changes for HIVE-11793 Key: HIVE-12830 URL: https://issues.apache.org/jira/browse/HIVE-12830 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-12831) Thrift and RDBMS changes for HIVE-10249

2016-01-09 Thread Alan Gates (JIRA)
Alan Gates created HIVE-12831: - Summary: Thrift and RDBMS changes for HIVE-10249 Key: HIVE-12831 URL: https://issues.apache.org/jira/browse/HIVE-12831 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-12814) Make thrift and DB changes for HIVE-11444

2016-01-08 Thread Alan Gates (JIRA)
Alan Gates created HIVE-12814: - Summary: Make thrift and DB changes for HIVE-11444 Key: HIVE-12814 URL: https://issues.apache.org/jira/browse/HIVE-12814 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-12816) Thrift and schema changes for HIVE-11685

2016-01-08 Thread Alan Gates (JIRA)
Alan Gates created HIVE-12816: - Summary: Thrift and schema changes for HIVE-11685 Key: HIVE-12816 URL: https://issues.apache.org/jira/browse/HIVE-12816 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-12821) Thrift and RDBMS schema changes for HIVE-11965

2016-01-08 Thread Alan Gates (JIRA)
Alan Gates created HIVE-12821: - Summary: Thrift and RDBMS schema changes for HIVE-11965 Key: HIVE-12821 URL: https://issues.apache.org/jira/browse/HIVE-12821 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-12822) Thrift and RDBMS schema changes for HIVE-11495

2016-01-08 Thread Alan Gates (JIRA)
Alan Gates created HIVE-12822: - Summary: Thrift and RDBMS schema changes for HIVE-11495 Key: HIVE-12822 URL: https://issues.apache.org/jira/browse/HIVE-12822 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-12823) Thrift and RDBMS schema changes for HIVE-11956

2016-01-08 Thread Alan Gates (JIRA)
Alan Gates created HIVE-12823: - Summary: Thrift and RDBMS schema changes for HIVE-11956 Key: HIVE-12823 URL: https://issues.apache.org/jira/browse/HIVE-12823 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-12818) Schema changes for HIVE-12353

2016-01-08 Thread Alan Gates (JIRA)
Alan Gates created HIVE-12818: - Summary: Schema changes for HIVE-12353 Key: HIVE-12818 URL: https://issues.apache.org/jira/browse/HIVE-12818 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-12819) Thrift and RDBMS schema changes for HIVE-11957

2016-01-08 Thread Alan Gates (JIRA)
Alan Gates created HIVE-12819: - Summary: Thrift and RDBMS schema changes for HIVE-11957 Key: HIVE-12819 URL: https://issues.apache.org/jira/browse/HIVE-12819 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-12807) Thrift and DB Changes for HIVE-12352

2016-01-07 Thread Alan Gates (JIRA)
Alan Gates created HIVE-12807: - Summary: Thrift and DB Changes for HIVE-12352 Key: HIVE-12807 URL: https://issues.apache.org/jira/browse/HIVE-12807 Project: Hive Issue Type: Sub-task

Re: Hive has standalone mode?

2015-12-29 Thread Alan Gates
Hive cannot run without the Hadoop binaries, but it can run locally without a cluster running. If you install Hadoop in standalone mode (see http://hadoop.apache.org/docs/r2.7.1/hadoop-project-dist/hadoop-common/SingleCluster.html#Standalone_Operation ) then set HADOOP_HOME to the location

Re: Allow other implementations of IMetaStoreClient in Hive

2015-12-15 Thread Alan Gates
I don't see an issue with this, it seems fine. One caveat though is we see this as an internal interface and we change it all the time. I wouldn't want to be pushed into making backwards compatibility guarantees for IMetaStoreClient. Which means that if you develop a different

Re: Allow other implementations of IMetaStoreClient in Hive

2015-12-15 Thread Alan Gates
antees for Thrift translate to backward compatibility guarantees for this interface as well? From the way it is used by Query Planning, I think it could be made an "external" interface that belongs in hive-metastore. Alan Gates <mailto:alanfga...@gmail.com> December 15, 201

Re: Allow other implementations of IMetaStoreClient in Hive

2015-12-15 Thread Alan Gates
d good? Thanks, Austin Alan Gates <mailto:alanfga...@gmail.com> December 15, 2015 at 11:04 For work along the same lines you should check out the HBase metastore work in Hive 2.0. It still uses the thrift server and RawStore but puts HBase behind it instead of an RDBMS. We did this becau

Re: Wish to work on an Open Source Project

2015-12-14 Thread Alan Gates
Hi Mihir, welcome to open source. See https://cwiki.apache.org/confluence/display/Hive/HowToContribute for a good overview of how to contribute to Hive. One of the best ways to get started is to find a bug you'd like to fix and work on fixing it. You can find a list of open Hive bugs at

[jira] [Created] (HIVE-12669) Need a way to analyze tables in the background

2015-12-14 Thread Alan Gates (JIRA)
Alan Gates created HIVE-12669: - Summary: Need a way to analyze tables in the background Key: HIVE-12669 URL: https://issues.apache.org/jira/browse/HIVE-12669 Project: Hive Issue Type

[jira] [Created] (HIVE-12672) Record last updated time for partition and table

2015-12-14 Thread Alan Gates (JIRA)
Alan Gates created HIVE-12672: - Summary: Record last updated time for partition and table Key: HIVE-12672 URL: https://issues.apache.org/jira/browse/HIVE-12672 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-12521) Better javadoc for Hive streaming

2015-11-25 Thread Alan Gates (JIRA)
Alan Gates created HIVE-12521: - Summary: Better javadoc for Hive streaming Key: HIVE-12521 URL: https://issues.apache.org/jira/browse/HIVE-12521 Project: Hive Issue Type: Improvement

Re: [DISCUSSION] Data correctness issue reporting procedural

2015-11-24 Thread Alan Gates
Xuefu, thanks, I think this is a good start. I've inlined a few responses. Xuefu Zhang November 24, 2015 at 7:26 Hi all, In the last contributor meetup, the topic around data correctness or data corruption is rather concerning. Not only is the number of such

Re: Review Request 40467: HIVE-12075 analyze for file metadata

2015-11-19 Thread Alan Gates
about metadatum, but still... metastore/src/java/org/apache/hadoop/hive/metastore/hbase/HBaseReadWrite.java (line 2150) <https://reviews.apache.org/r/40467/#comment166303> I don't understand what's in the addedCols and addedVals arrays. - Alan Gates

[jira] [Created] (HIVE-12443) Hive Streaming should expose encoding and serdes for testing

2015-11-17 Thread Alan Gates (JIRA)
Alan Gates created HIVE-12443: - Summary: Hive Streaming should expose encoding and serdes for testing Key: HIVE-12443 URL: https://issues.apache.org/jira/browse/HIVE-12443 Project: Hive Issue

[jira] [Created] (HIVE-12429) Switch default Hive authorization to SQLStandardAuth in 2.0

2015-11-16 Thread Alan Gates (JIRA)
Alan Gates created HIVE-12429: - Summary: Switch default Hive authorization to SQLStandardAuth in 2.0 Key: HIVE-12429 URL: https://issues.apache.org/jira/browse/HIVE-12429 Project: Hive Issue

Re: [VOTE] Hive 2.0 release plan

2015-11-13 Thread Alan Gates
+1. Alan. Sergey Shelukhin November 13, 2015 at 12:38 Hi. With no strong objections on DISCUSS thread, some issues raised and addressed, and a reminder from Carl about the bylaws for the release process, I propose we release the first version of Hive 2 (2.0),

Re: [DISCUSS] the first Hive 2 release

2015-11-11 Thread Alan Gates
We shouldn't block either branch releasing for the other. 1.3.0 should be released when someone volunteers to pick it up and drive the release. Alan. Lefty Leverenz November 11, 2015 at 23:03 Should 1.3.0 be released at the same time, or even before 2.0.0?

Re: [DISCUSS] the first Hive 2 release

2015-11-11 Thread Alan Gates
The stated plan for 2.0 when we created branch-1 was to be able to release more aggressively from master. As Xuefu points out we've added a lot of code and features. I'm +1 for having a 2.0 release soon, but we should be very clear with users that many of the new features are in alpha or

[jira] [Created] (HIVE-12316) Improved integration test for Hive

2015-11-02 Thread Alan Gates (JIRA)
Alan Gates created HIVE-12316: - Summary: Improved integration test for Hive Key: HIVE-12316 URL: https://issues.apache.org/jira/browse/HIVE-12316 Project: Hive Issue Type: New Feature

Build breakage

2015-11-02 Thread Alan Gates
HIVE-12295 broke the qfile and itest/hive-unit tests. Jimmy put up a patch in HIVE-12318 that appeared to fix it. I went ahead and committed that patch without waiting for the precommit testing because there were several patches ahead of it in line that would have failed. This means the

Re: [CONF] Apache Hive > GettingStarted

2015-10-30 Thread Alan Gates
This isn't correct. If we just want to build jars, the command is "mvn clean install -Phadoop-1". If we want to build packages the command is "mvn clean package -Phadoop-1,dist". I wasn't sure which was intended and opted for building packages. We should clarify which is intended and then

Hadoop-1 is dead, long live Hadoop

2015-10-26 Thread Alan Gates
I've committed HIVE-11378 to master, which means Hadoop-1 is no longer supported in Hive's master branch. When building it is no longer necessary to say -Phadoop-2. No profile is needed for regular builds. Alan.

Re: Hadoop-1 is dead, long live Hadoop

2015-10-26 Thread Alan Gates
e-1.2.1 and hadoop-1 (lol). I guess they need to move to hadoop-2 org.apache.hadoop.util.VersionInfo.getVersion res8: String = 1.2.2-SNAPSHOT On Mon, Oct 26, 2015 at 3:02 PM, Alan Gates<alanfga...@gmail.com> wrote: I've committed HIVE-11378 to master, which means Hadoop-1 is no longer su

Review Request 39578: Remove hadoop-1 support from master branch

2015-10-22 Thread Alan Gates
/hadoop/hive/thrift/HadoopThriftAuthBridge.java 7ed7265 shims/pom.xml 12113d5 shims/scheduler/pom.xml 407d57d storage-api/pom.xml 71b79f1 Diff: https://reviews.apache.org/r/39578/diff/ Testing --- Tested that I can build and run tests. Thanks, Alan Gates

Re: Review Request 39026: HIVE-11676 implement metastore API to do file footer PPD

2015-10-15 Thread Alan Gates
ve partition expressions into HBase filters. I'm not sure if you could re-use that here or not. - Alan Gates On Oct. 15, 2015, 1:47 a.m., Sergey Shelukhin wrote: > > --- > This is an automatically generated e-mail. To

Re: How to enable compaction for table with external data?

2015-09-25 Thread Alan Gates
From: Alan Gates <alanfga...@gmail.com <mailto:alanfga...@gmail.com>> Reply-To: "dev@hive.apache.org <mailto:dev@hive.apache.org>" <dev@hive.apache.org <mailto:dev@hive.apache.org>> Date: Tuesday, 15 September 2015 10:30 pm To: "dev@hive.apache.org

<    1   2   3   4   5   6   7   8   9   10   >