Re: [DISCUSS] Unsustainable situation with ptests

2018-05-14 Thread Alan Gates
wrote: > Will there be a separate voting thread? Or the voting on this thread is > sufficient for lock down? > > Thanks > Prasanth > > > On May 14, 2018, at 2:34 PM, Alan Gates <alanfga...@gmail.com> wrote: > > > > ​I see there's support for this, but people are still po

Re: [DISCUSS] Unsustainable situation with ptests

2018-05-14 Thread Alan Gates
​I see there's support for this, but people are still pouring in commits. I proposed we have a quick vote on this to lock down the commits until we get to green. That way everyone knows we have drawn the line at a specific point. Any commits after that point would be reverted. There isn't a

[jira] [Created] (HIVE-19365) Index on COMPLETED_TXN_COMPONENTS in Metastore RDBMS has different names in different scripts

2018-04-30 Thread Alan Gates (JIRA)
Alan Gates created HIVE-19365: - Summary: Index on COMPLETED_TXN_COMPONENTS in Metastore RDBMS has different names in different scripts Key: HIVE-19365 URL: https://issues.apache.org/jira/browse/HIVE-19365

Re: [VOTE] Should we release storage-api 2.6.0 rc0?

2018-04-27 Thread Alan Gates
+1 Did a build in a clean mvn repo, ran rat, looked over NOTICE and LICENSE files. On Fri, Apr 27, 2018 at 8:53 AM, Jesus Camacho Rodriguez < jcama...@apache.org> wrote: > +1 > - compiled from src > - ran unit tests > - ran rat > > -Jesús > > > > On 4/26/18, 8:30 AM, "Owen O'Malley"

[jira] [Created] (HIVE-19323) Create metastore SQL install and upgrade scripts for 3.1

2018-04-26 Thread Alan Gates (JIRA)
Alan Gates created HIVE-19323: - Summary: Create metastore SQL install and upgrade scripts for 3.1 Key: HIVE-19323 URL: https://issues.apache.org/jira/browse/HIVE-19323 Project: Hive Issue Type

Re: Metastore thrift client to get the table location on hdfs

2018-04-26 Thread Alan Gates
The calls you want are in ThriftHiveMetastore.h. You can use these to get lists of tables and objects representing each table. One of the fields in the Table object is a StorageDescriptor, which has a field called 'location'. If you are working with partitioned tables the location information

Re: org.apache.hadoop.hive.ql.metadata.HiveMetaStoreClientFactory

2018-04-23 Thread Alan Gates
Your code searching skills are intact (or, at least this doesn't prove they aren't). That class doesn't exist in Hive and I assume was invented by Amazon. I assume they placed it in o.a.h.hive so they could access package specific classes etc. Apache doesn't prohibit using its name in package

[jira] [Created] (HIVE-19151) Update expected result for some TestNegativeCliDriver tests

2018-04-10 Thread Alan Gates (JIRA)
Alan Gates created HIVE-19151: - Summary: Update expected result for some TestNegativeCliDriver tests Key: HIVE-19151 URL: https://issues.apache.org/jira/browse/HIVE-19151 Project: Hive Issue

[jira] [Created] (HIVE-19135) Need tool to allow admins to create catalogs and move existing dbs to catalog during upgrade

2018-04-09 Thread Alan Gates (JIRA)
Alan Gates created HIVE-19135: - Summary: Need tool to allow admins to create catalogs and move existing dbs to catalog during upgrade Key: HIVE-19135 URL: https://issues.apache.org/jira/browse/HIVE-19135

[jira] [Created] (HIVE-19120) catalog not properly set for some tables in SQL upgrade scripts

2018-04-05 Thread Alan Gates (JIRA)
Alan Gates created HIVE-19120: - Summary: catalog not properly set for some tables in SQL upgrade scripts Key: HIVE-19120 URL: https://issues.apache.org/jira/browse/HIVE-19120 Project: Hive

[jira] [Created] (HIVE-19105) HIVE-18781 broke WarehouseInstance

2018-04-04 Thread Alan Gates (JIRA)
Alan Gates created HIVE-19105: - Summary: HIVE-18781 broke WarehouseInstance Key: HIVE-19105 URL: https://issues.apache.org/jira/browse/HIVE-19105 Project: Hive Issue Type: Bug

[jira] [Created] (HIVE-19099) HIVE-18755 forgot to update derby install script in metastore

2018-04-03 Thread Alan Gates (JIRA)
Alan Gates created HIVE-19099: - Summary: HIVE-18755 forgot to update derby install script in metastore Key: HIVE-19099 URL: https://issues.apache.org/jira/browse/HIVE-19099 Project: Hive Issue

Documenting standalone metastore

2018-04-02 Thread Alan Gates
I've started looking at what will be required to document the new standalone metastore. I started by reviewing the existing admin guide for the metastore at https://cwiki.apache.org/confluence/display/Hive/AdminManual+MetastoreAdmin Much of this will need to change for the standalone metastore,

Re: [VOTE] Apache Hive 2.3.3 Release Candidate 0

2018-03-29 Thread Alan Gates
+1. Did a build in an empty repo, ran rat, checked the key signature and sha256, checked for any binary objects in the output. Alan. On Thu, Mar 29, 2018 at 12:26 AM, Daniel Dai wrote: > Apache Hive 2.3.3 Release Candidate 0 is available here: > >

Re: [VOTE] Should we release Hive Storage API 2.5.0 rc0?

2018-03-27 Thread Alan Gates
+1. Ran 'mvn install' in a clean repo, verified the signature and checksum, ran rat. Alan. On Tue, Mar 27, 2018 at 9:49 AM, Prasanth Jayachandran < pjayachand...@hortonworks.com> wrote: > +1 > - verified signature, licenses and checksum > - compiled from src > - ran unit tests > > Thanks >

[jira] [Created] (HIVE-19031) Mark duplicate configs in HiveConf as deprecated

2018-03-22 Thread Alan Gates (JIRA)
Alan Gates created HIVE-19031: - Summary: Mark duplicate configs in HiveConf as deprecated Key: HIVE-19031 URL: https://issues.apache.org/jira/browse/HIVE-19031 Project: Hive Issue Type: Sub-task

Re: Integration testing for clients

2018-03-22 Thread Alan Gates
Any reason we shouldn't publish our tests jar? I know it isn't clean and nice and easy to use. And we'd need to be explicit about any interfaces we're guaranteeing not to change (very few at this point I think). But the tools in MetaStoreTestUtils would be really useful for other projects.

Re: Hive 3.0 release

2018-03-21 Thread Alan Gates
+1. And +1 to Vihang's comment that this will be helpful for the standalone-metastore. We should work on producing a standalone-metastore release in the same time frame so that the schema's, etc. match. I can RM that unless someone else wants to. Alan. On Wed, Mar 21, 2018 at 12:05 PM, Andrew

[jira] [Created] (HIVE-18991) Drop database cascade doesn't work with materialized views

2018-03-19 Thread Alan Gates (JIRA)
Alan Gates created HIVE-18991: - Summary: Drop database cascade doesn't work with materialized views Key: HIVE-18991 URL: https://issues.apache.org/jira/browse/HIVE-18991 Project: Hive Issue Type

Possible bug in obtaining database paths

2018-03-16 Thread Alan Gates
In the Warehouse class there are a couple of methods to determine the path of a database: getDatabasePath() and getDefaultDatabasePath(). getDatabasePath() reads the location out of the database object, except in the case of the 'default' database, where it returns the warehouse root.

[jira] [Created] (HIVE-18977) Listing partitions returns different results with JDO and direct SQL

2018-03-16 Thread Alan Gates (JIRA)
Alan Gates created HIVE-18977: - Summary: Listing partitions returns different results with JDO and direct SQL Key: HIVE-18977 URL: https://issues.apache.org/jira/browse/HIVE-18977 Project: Hive

[jira] [Created] (HIVE-18973) Make transaction system work with catalogs

2018-03-15 Thread Alan Gates (JIRA)
Alan Gates created HIVE-18973: - Summary: Make transaction system work with catalogs Key: HIVE-18973 URL: https://issues.apache.org/jira/browse/HIVE-18973 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-18967) Standalone metastore SQL upgrade scripts do not properly set schema version

2018-03-15 Thread Alan Gates (JIRA)
Alan Gates created HIVE-18967: - Summary: Standalone metastore SQL upgrade scripts do not properly set schema version Key: HIVE-18967 URL: https://issues.apache.org/jira/browse/HIVE-18967 Project: Hive

[jira] [Created] (HIVE-18965) HIVE-17990 didn't update derby SQL scripts

2018-03-15 Thread Alan Gates (JIRA)
Alan Gates created HIVE-18965: - Summary: HIVE-17990 didn't update derby SQL scripts Key: HIVE-18965 URL: https://issues.apache.org/jira/browse/HIVE-18965 Project: Hive Issue Type: Bug

[jira] [Created] (HIVE-18960) Make Materialized view invalidation cache work with catalogs

2018-03-14 Thread Alan Gates (JIRA)
Alan Gates created HIVE-18960: - Summary: Make Materialized view invalidation cache work with catalogs Key: HIVE-18960 URL: https://issues.apache.org/jira/browse/HIVE-18960 Project: Hive Issue

Re: HMS API testing and direct SQL

2018-03-06 Thread Alan Gates
I would do it at the ObjectStore level. It's faster and will cover 99% of what we want to test between the two. Alan. On Tue, Mar 6, 2018 at 8:10 AM, Peter Vary wrote: > Hi Team, > > The MetaStore API tests are designed to be easily extensible by new > MetaStore

[jira] [Created] (HIVE-18776) MaterializationsInvalidationCache loading causes race condition in the metastore

2018-02-22 Thread Alan Gates (JIRA)
Alan Gates created HIVE-18776: - Summary: MaterializationsInvalidationCache loading causes race condition in the metastore Key: HIVE-18776 URL: https://issues.apache.org/jira/browse/HIVE-18776 Project

Re: reverting test-breaking changes

2018-02-22 Thread Alan Gates
+1. Alan. On Thu, Feb 22, 2018 at 8:25 AM, Thejas Nair wrote: > +1 > I agree, this makes sense. The number of failures keeps increasing. > A 24 hour heads up in either case before revert would be good. > > > On Thu, Feb 22, 2018 at 2:45 AM, Peter Vary

[jira] [Created] (HIVE-18755) Modifications to the metastore for catalogs

2018-02-20 Thread Alan Gates (JIRA)
Alan Gates created HIVE-18755: - Summary: Modifications to the metastore for catalogs Key: HIVE-18755 URL: https://issues.apache.org/jira/browse/HIVE-18755 Project: Hive Issue Type: Sub-task

Fwd: Travel Assistance applications open. Please inform your communities

2018-02-14 Thread Alan Gates
-- Forwarded message -- From: Gavin McDonald Date: Wed, Feb 14, 2018 at 1:34 AM Subject: Travel Assistance applications open. Please inform your communities To: travel-assista...@apache.org Hello PMCs. Please could you forward on the below email to your

Re: Test scripts for various metastore databases

2018-02-13 Thread Alan Gates
> On Feb 12, 2018, at 9:56 AM, Alan Gates <alanfga...@gmail.com> wrote: > > > > With the commit of HIVE-17983 to master there are now tests for install > and > > upgrade scripts for the metastore database for all 4 of the database > types > > (my

Re: [DISCUSS] deprecation policy

2018-02-13 Thread Alan Gates
+1 to Ed’s comments. Alan. On Tue, Feb 13, 2018 at 7:08 AM, Edward Capriolo wrote: > I do not think we should remove: > > https://issues.apache.org/jira/browse/HIVE-18692 > > One of the challenges of HQL is not having a procedure language. This > forces users into

[jira] [Created] (HIVE-18686) Installation on Postgres and Oracle broken

2018-02-12 Thread Alan Gates (JIRA)
Alan Gates created HIVE-18686: - Summary: Installation on Postgres and Oracle broken Key: HIVE-18686 URL: https://issues.apache.org/jira/browse/HIVE-18686 Project: Hive Issue Type: Bug

[jira] [Created] (HIVE-18685) Add catalogs to metastore

2018-02-12 Thread Alan Gates (JIRA)
Alan Gates created HIVE-18685: - Summary: Add catalogs to metastore Key: HIVE-18685 URL: https://issues.apache.org/jira/browse/HIVE-18685 Project: Hive Issue Type: New Feature

Rebased standalone-metastore

2018-02-12 Thread Alan Gates
With the commit of HIVE-17983 I have rebased the standalone-metastore branch. I also put HIVE-18588 onto the branch. Alan.

Test scripts for various metastore databases

2018-02-12 Thread Alan Gates
With the commit of HIVE-17983 to master there are now tests for install and upgrade scripts for the metastore database for all 4 of the database types (mysql, postgres, oracle, and sql server). These are not run by default as they take a bit and require docker to be installed on the box. For

Question on CachedStore cache update

2018-02-06 Thread Alan Gates
I’m confused by the following code in the CachedStore. This in in the CacheUpdateMasterWork thread, in the updateDatabases method (which is called by update()): *// Skip background updates if we detect change* *if *(*isDatabaseCacheDirty*.compareAndSet(*true*, *false*)) {

Dataworks Summit San Jose Call for Abstracts closes Friday Feb 9

2018-02-06 Thread Alan Gates
All, Dataworks Summit San Jose 2018 is June 17-21. The call for abstracts is open through February 9th. One of the tracks is Datawarehousing and Operational Data Store, which is a great fit for Hive talks. You can submit an abstract at https://dataworkssummit.com/san-jose-2018/ Alan.

Re: Yetus JDK version

2018-02-01 Thread Alan Gates
infrastructure. Is there anything else we need to do? We clearly already have 1.8 installed on the test machines because the code compiles with 1.8, but I don’t know what the path is, etc. Alan. On Tue, Jan 30, 2018 at 4:58 PM, Alan Gates <alanfga...@gmail.com> wrote: > I put code in t

Yetus JDK version

2018-01-30 Thread Alan Gates
I put code in the latest patch for HIVE-17983 that executes one of the compiled classes as part of the maven build. (It does this to automatically generate the config template.) This works locally and in the ptest build. But in the Yetus tests it fails with: Exception in thread "main"

[jira] [Created] (HIVE-18588) Add 'checkin' profile that runs slower tests in standalone-metastore

2018-01-30 Thread Alan Gates (JIRA)
Alan Gates created HIVE-18588: - Summary: Add 'checkin' profile that runs slower tests in standalone-metastore Key: HIVE-18588 URL: https://issues.apache.org/jira/browse/HIVE-18588 Project: Hive

Long running time for recently added tests in standalone-metastore

2018-01-29 Thread Alan Gates
With all of the added tests in standalone-metastore/…/client directory, the runtime of ‘mvn test’ in standalone-metastore went from 6 minutes to 26 on my humble laptop. We do not want to get ourselves back where the rest of Hive is; currently Hive developers don’t run the unit tests themselves

Re: Hive packaging and the standalone metastore

2018-01-26 Thread Alan Gates
Hive as a whole doing 'mvn install -Pdist' builds the packages as before. So I think we’ve covered the bases there. Alan.​ > > On Fri, Jan 26, 2018 at 10:42 AM, Alan Gates <alanfga...@gmail.com> wrote: > > > I’m not seeing the value of moving the jars to a different path. If

Re: Hive packaging and the standalone metastore

2018-01-26 Thread Alan Gates
sense (at least for a > while), > > what do you think about somehow separating lib/bin directories created in > > the distro so Hive and metastore have a separate set of bin/lib dirs? > > > > - Alex > > > > On Wed, Jan 24, 2018 at 12:16 PM, Alan Gates <

Hive packaging and the standalone metastore

2018-01-24 Thread Alan Gates
In HIVE-17983 I have been working on packaing and start/stop scripts for the standalone metastore. One question this brings up is how Hive will be released now, with or without the metastore. I can see two options: 1) We continue to ship the metastore with Hive. Not only does this mean the

Re: Rebasing standalone-metastore branch

2018-01-18 Thread Alan Gates
> > Peter > > > > > On Jan 17, 2018, at 12:40 AM, Vihang Karajgaonkar <vih...@cloudera.com > > > > wrote: > > > > > > Thanks for the headsup Alan. I am okay with the rebasing > > > standalone-metastore branch. Will update my WIP

Rebasing standalone-metastore branch

2018-01-16 Thread Alan Gates
I’ve committed HIVE-17982 to master. I have been rebasing standalone-metastore after each push of a patch from it to master to keep it close to master. Vihang and maybe Peter have patches against it, so this will bust your history. It will force you to rebase your branches when you fetch from

Re: [DISCUSS] IMetaStoreClient and HMS Thrift API exception handling

2017-12-19 Thread Alan Gates
about a API V2 with correct > versioning, and deprecation policies. > > Is it OK for everyone? > > Thanks, > Peter > > > > On Dec 15, 2017, at 8:15 PM, Alan Gates <alanfga...@gmail.com> wrote: > > > > Sorry, I didn’t make clear which suggestion I was responding

Rebasing standalone-metastore branch post HIVE-17981

2017-12-18 Thread Alan Gates
I have committed HIVE-17981 to master and will be rebasing the standalone-metastore up to the current master branch. Alan.

[jira] [Created] (HIVE-18297) Add builder for metastore Thrift classes missed in the first pass

2017-12-18 Thread Alan Gates (JIRA)
Alan Gates created HIVE-18297: - Summary: Add builder for metastore Thrift classes missed in the first pass Key: HIVE-18297 URL: https://issues.apache.org/jira/browse/HIVE-18297 Project: Hive

Re: [DISCUSS] IMetaStoreClient and HMS Thrift API exception handling

2017-12-15 Thread Alan Gates
rift api calls. So it should not break any applications. > The only concern I have is some issues if old client is used with new > servers. We need to verifiy that the old client is able to deserialize a > response with new exceptions. > > > On Fri, Dec 15, 2017 at 7:33 AM, Ala

Re: [DISCUSS] IMetaStoreClient and HMS Thrift API exception handling

2017-12-15 Thread Alan Gates
We do not want to break either the Thrift APIs or the IMetaStoreClient ones. I do not know if we have ever declared them to be public or not, but they are de facto public in that everyone uses them. Consider that these are used by Impala, Presto, Qubole, Amazon's Glue, Spark, and probably others

Dataworks Summit EU call for abstracts

2017-12-07 Thread Alan Gates
Dataworks Summit EU 2018 is in Berlin, April 16-19. The call for abstracts is open through December 15th. One of the tracks is Datawarehousing and Operational Data Store, which is a great fit for Hive talks. https://dataworkssummit.com/abstracts/ Alan.

Rebasing standalone-metastore branch and database install/upgrade tests

2017-12-06 Thread Alan Gates
As HIVE-17980 has been committed to master, I will be rebasing the standalone-metastore branch up to the latest in master. This will again be a force push. In this rebase I am also including a newer version of HIVE-17983, which includes integration tests that use docker images to test the

Re: HMS dependency on fb303.FacebookService

2017-12-01 Thread Alan Gates
code for other purposes. For backwards > compatibility we may provide some simple implementation ourselves - does > this sound reasonable? > > Alex > >> On Tue, Nov 28, 2017 at 9:35 AM, Alan Gates <alanfga...@gmail.com> wrote: >> >> Removing this break our backwards

Re: HMS dependency on fb303.FacebookService

2017-11-28 Thread Alan Gates
Removing this break our backwards compatibility. This interface provides public methods like getName. Hive may not be using them but we have no idea if others are in the wild. Given that including this has little or no cost to us AFAIK, why remove it? Alan.​ On Mon, Nov 27, 2017 at 5:21 PM,

Rebasing standalone-metastore branch

2017-11-21 Thread Alan Gates
I'm about to check in HIVE-17967. Once I do that, I will rebase the standalone-metastore branch onto master post that commit and then force push it. This way the branch will be up to date with master again. Alan.

Re: What happened with HMS on Hbase project?

2017-11-08 Thread Alan Gates
Several things happened: 1) By far the biggest issue was running well in the cloud. HBase can be run in the cloud, but it’s hard to do it well in a cost efficient way. While each cloud does provide a native key/value store, these don’t all have the advanced functionality that we need

Re: Integrating Yetus with Precommit job

2017-11-07 Thread Alan Gates
I’ve put some feedback in HIVE-17995. 17996 and 17997 look good. I’ll commit them once the tests run. I think you’ll need to do similar patches for storage-api, as it is also not connected to the hive pom anymore. Alan. On Tue, Nov 7, 2017 at 6:17 AM, Adam Szita wrote: >

[jira] [Created] (HIVE-17990) Add Thrift and DB storage for Schema Registry objects

2017-11-06 Thread Alan Gates (JIRA)
Alan Gates created HIVE-17990: - Summary: Add Thrift and DB storage for Schema Registry objects Key: HIVE-17990 URL: https://issues.apache.org/jira/browse/HIVE-17990 Project: Hive Issue Type: Sub

[jira] [Created] (HIVE-17989) Adding support for Schema Registry objects to standalone

2017-11-06 Thread Alan Gates (JIRA)
Alan Gates created HIVE-17989: - Summary: Adding support for Schema Registry objects to standalone Key: HIVE-17989 URL: https://issues.apache.org/jira/browse/HIVE-17989 Project: Hive Issue Type

[jira] [Created] (HIVE-17983) Make the standalone metastore generate tarballs etc.

2017-11-03 Thread Alan Gates (JIRA)
Alan Gates created HIVE-17983: - Summary: Make the standalone metastore generate tarballs etc. Key: HIVE-17983 URL: https://issues.apache.org/jira/browse/HIVE-17983 Project: Hive Issue Type: Sub

[jira] [Created] (HIVE-17982) Move metastore specific itests

2017-11-03 Thread Alan Gates (JIRA)
Alan Gates created HIVE-17982: - Summary: Move metastore specific itests Key: HIVE-17982 URL: https://issues.apache.org/jira/browse/HIVE-17982 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-17981) Create a set of builders for Thrift classes

2017-11-03 Thread Alan Gates (JIRA)
Alan Gates created HIVE-17981: - Summary: Create a set of builders for Thrift classes Key: HIVE-17981 URL: https://issues.apache.org/jira/browse/HIVE-17981 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-17980) Move HiveMetaStoreClient plus a few remaining classes.

2017-11-03 Thread Alan Gates (JIRA)
Alan Gates created HIVE-17980: - Summary: Move HiveMetaStoreClient plus a few remaining classes. Key: HIVE-17980 URL: https://issues.apache.org/jira/browse/HIVE-17980 Project: Hive Issue Type

Re: Proposal to create a branch for the standalone-metastore work

2017-11-03 Thread Alan Gates
nches rebase relatively > often leads to a much cleaner final git history that using multiple merges. > For the first couple rebases of your development branch, you might want to > tell people just before you do it by sending email out to dev@hive. > > Thanks, >Owen > > O

[jira] [Created] (HIVE-17967) Move HiveMetaStore class

2017-11-02 Thread Alan Gates (JIRA)
Alan Gates created HIVE-17967: - Summary: Move HiveMetaStore class Key: HIVE-17967 URL: https://issues.apache.org/jira/browse/HIVE-17967 Project: Hive Issue Type: Sub-task Components

Re: Hive metastore TLP

2017-11-01 Thread Alan Gates
Excellent, I am glad to hear that this could be useful for you. After discussing the proposal in the community [1] we agreed that the first step should be to break out the metastore as a separately releasable module inside Hive. You can see the progress of that work at HIVE-17159[2]. With this

Proposal to create a branch for the standalone-metastore work

2017-10-30 Thread Alan Gates
​I propose that we create a branch to continue the standalone metastore work in. So far we’ve been doing it in master one patch at a time. However, the speed that we can produce patches outstrips the speed at which we can get them reviewed, fully tested, and into master. I would like to put

Question on TransactionalValidationListener

2017-10-25 Thread Alan Gates
Looking at this code in the TransactionalValidationListener, around line 186: *if *(hive_metastoreConstants.*TABLE_IS_TRANSACTIONAL*.equalsIgnoreCase(key)) { transactional = parameters.get(key); parameters.remove(key); } Why does it remove the parameter after checking? In local metastore

Re: [VOTE] Apache Hive 2.3.1 Release Candidate 0

2017-10-24 Thread Alan Gates
+1. Built from source with a clean repo, checked signatures, ran rat. Alan. On Tue, Oct 24, 2017 at 8:40 AM, Ashutosh Chauhan wrote: > - Built from sources. > - Ran few unit tests. > - Checked md5sum. > > Everything looks good. +1 > > Thanks Jesus for putting this

[jira] [Created] (HIVE-17812) Move remaining classes that HiveMetaStore depends on

2017-10-14 Thread Alan Gates (JIRA)
Alan Gates created HIVE-17812: - Summary: Move remaining classes that HiveMetaStore depends on Key: HIVE-17812 URL: https://issues.apache.org/jira/browse/HIVE-17812 Project: Hive Issue Type: Sub

[jira] [Created] (HIVE-17788) MetastoreConf not properly handling variable interpolation in config values

2017-10-12 Thread Alan Gates (JIRA)
Alan Gates created HIVE-17788: - Summary: MetastoreConf not properly handling variable interpolation in config values Key: HIVE-17788 URL: https://issues.apache.org/jira/browse/HIVE-17788 Project: Hive

[jira] [Created] (HIVE-17733) Move RawStore to standalone metastore

2017-10-06 Thread Alan Gates (JIRA)
Alan Gates created HIVE-17733: - Summary: Move RawStore to standalone metastore Key: HIVE-17733 URL: https://issues.apache.org/jira/browse/HIVE-17733 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-17561) Move TxnStore and implementations to standalone metastore

2017-09-19 Thread Alan Gates (JIRA)
Alan Gates created HIVE-17561: - Summary: Move TxnStore and implementations to standalone metastore Key: HIVE-17561 URL: https://issues.apache.org/jira/browse/HIVE-17561 Project: Hive Issue Type

[jira] [Created] (HIVE-17537) Move Warehouse class to standalone metastore

2017-09-14 Thread Alan Gates (JIRA)
Alan Gates created HIVE-17537: - Summary: Move Warehouse class to standalone metastore Key: HIVE-17537 URL: https://issues.apache.org/jira/browse/HIVE-17537 Project: Hive Issue Type: Sub-task

Re: Hive Custom Inputformat mapred.* vs. mapreduce.*

2017-09-13 Thread Alan Gates
I’m not aware of any plans in Hive to do any more work that uses Map Reduce as the execution engine, so I expect Hive will continue to use mapred. Alan. On Wed, Sep 13, 2017 at 4:25 AM, Jörn Franke wrote: > Dear all, > > I have developed several custom input formats (e.g.

[jira] [Created] (HIVE-17506) Fix standalone-metastore pom.xml to not depend on hive's main pom

2017-09-11 Thread Alan Gates (JIRA)
Alan Gates created HIVE-17506: - Summary: Fix standalone-metastore pom.xml to not depend on hive's main pom Key: HIVE-17506 URL: https://issues.apache.org/jira/browse/HIVE-17506 Project: Hive

[jira] [Created] (HIVE-17488) Move first set of classes to standalone metastore

2017-09-08 Thread Alan Gates (JIRA)
Alan Gates created HIVE-17488: - Summary: Move first set of classes to standalone metastore Key: HIVE-17488 URL: https://issues.apache.org/jira/browse/HIVE-17488 Project: Hive Issue Type: Sub

[jira] [Created] (HIVE-17425) Change MetastoreConf.ConfVars internal members to be private

2017-08-31 Thread Alan Gates (JIRA)
Alan Gates created HIVE-17425: - Summary: Change MetastoreConf.ConfVars internal members to be private Key: HIVE-17425 URL: https://issues.apache.org/jira/browse/HIVE-17425 Project: Hive Issue

[jira] [Created] (HIVE-17359) Deal with TypeInfo dependencies in the metastore

2017-08-18 Thread Alan Gates (JIRA)
Alan Gates created HIVE-17359: - Summary: Deal with TypeInfo dependencies in the metastore Key: HIVE-17359 URL: https://issues.apache.org/jira/browse/HIVE-17359 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-17325) Clean up intermittently failing uni tests

2017-08-15 Thread Alan Gates (JIRA)
Alan Gates created HIVE-17325: - Summary: Clean up intermittently failing uni tests Key: HIVE-17325 URL: https://issues.apache.org/jira/browse/HIVE-17325 Project: Hive Issue Type: Test

[jira] [Created] (HIVE-17307) Change the metastore to not use the metrics code in hive/common

2017-08-12 Thread Alan Gates (JIRA)
Alan Gates created HIVE-17307: - Summary: Change the metastore to not use the metrics code in hive/common Key: HIVE-17307 URL: https://issues.apache.org/jira/browse/HIVE-17307 Project: Hive

[jira] [Created] (HIVE-17241) Change metastore classes to not use the shims

2017-08-03 Thread Alan Gates (JIRA)
Alan Gates created HIVE-17241: - Summary: Change metastore classes to not use the shims Key: HIVE-17241 URL: https://issues.apache.org/jira/browse/HIVE-17241 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-17234) Remove HBase metastore from master

2017-08-02 Thread Alan Gates (JIRA)
Alan Gates created HIVE-17234: - Summary: Remove HBase metastore from master Key: HIVE-17234 URL: https://issues.apache.org/jira/browse/HIVE-17234 Project: Hive Issue Type: Task

[jira] [Created] (HIVE-17224) Move JDO classes to standalone metastore

2017-08-01 Thread Alan Gates (JIRA)
Alan Gates created HIVE-17224: - Summary: Move JDO classes to standalone metastore Key: HIVE-17224 URL: https://issues.apache.org/jira/browse/HIVE-17224 Project: Hive Issue Type: Sub-task

Re: [DISCUSS] Separating out the metastore as its own TLP

2017-07-27 Thread Alan Gates
> the Catalog daemon from impala. > > > > > > On Mon, Jul 24, 2017 at 5:20 PM, Vihang Karajgaonkar < > > vih...@cloudera.com> > > > wrote: > > > > > > > Before we see a flood of name suggestions :) Why not just keep it &

[jira] [Created] (HIVE-17170) Move thrift generated code to stand alone metastore

2017-07-25 Thread Alan Gates (JIRA)
Alan Gates created HIVE-17170: - Summary: Move thrift generated code to stand alone metastore Key: HIVE-17170 URL: https://issues.apache.org/jira/browse/HIVE-17170 Project: Hive Issue Type: Sub

[jira] [Created] (HIVE-17168) Create separate module for stand alone metastore

2017-07-25 Thread Alan Gates (JIRA)
Alan Gates created HIVE-17168: - Summary: Create separate module for stand alone metastore Key: HIVE-17168 URL: https://issues.apache.org/jira/browse/HIVE-17168 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-17167) Create metastore specific configuration tool

2017-07-25 Thread Alan Gates (JIRA)
Alan Gates created HIVE-17167: - Summary: Create metastore specific configuration tool Key: HIVE-17167 URL: https://issues.apache.org/jira/browse/HIVE-17167 Project: Hive Issue Type: Sub-task

Re: [DISCUSS] Separating out the metastore as its own TLP

2017-07-25 Thread Alan Gates
> the Catalog daemon from impala. > > > > On Mon, Jul 24, 2017 at 5:20 PM, Vihang Karajgaonkar < > vih...@cloudera.com> > > wrote: > > > > > Before we see a flood of name suggestions :) Why not just keep it > > > Metastore? Its already we

Re: [VOTE] Shall we release Hive 2.2.0 rc1?

2017-07-24 Thread Alan Gates
+1, checked the signatures, did a build with a clean repo, ran RAT. Alan. On Fri, Jul 21, 2017 at 5:20 PM, Owen O'Malley wrote: > Ok, I rolled a new RC with the Apache header problem fixed. > > Artifacts: https://home.apache.org/~omalley/hive-2.2.0/ > Tag:

Re: [DISCUSS] Separating out the metastore as its own TLP

2017-07-24 Thread Alan Gates
In the same vein Carter and Gunther suggested Omegastore. Pick your alphabet and whether it’s a catalog or a store I guess. Alan. On Mon, Jul 24, 2017 at 1:35 PM, Sergey Shelukhin wrote: > I’d like to suggest ZCatalog. > > On 17/7/11, 15:41, "Lefty Leverenz"

[jira] [Created] (HIVE-17159) Make metastore a separately releasable module

2017-07-24 Thread Alan Gates (JIRA)
Alan Gates created HIVE-17159: - Summary: Make metastore a separately releasable module Key: HIVE-17159 URL: https://issues.apache.org/jira/browse/HIVE-17159 Project: Hive Issue Type: New Feature

Re: [DISCUSS] Separating out the metastore as its own TLP

2017-07-21 Thread Alan Gates
It seems we have settled into a consensus that this will be good for the ecosystem, but there are concerns that this will be a burden on Hive. The original proposal included a time to work on the separation inside the Hive project to help address any such issues. This would culminate in a source

Re: [VOTE] storage-release-2.4.0rc1

2017-07-12 Thread Alan Gates
gt; On Wed, Jul 12, 2017 at 11:08 AM, Ashutosh Chauhan <hashut...@apache.org> > wrote: > > > +1 > > Did a build and some basic testing. > > > > On Tue, Jul 11, 2017 at 1:36 PM, Alan Gates <alanfga...@gmail.com> > wrote: > > > >

Re: [VOTE] storage-release-2.4.0rc1

2017-07-11 Thread Alan Gates
+1. Checked the signatures, did a build with a fresh maven repo, ran rat. On Mon, Jul 10, 2017 at 11:58 PM, Pengcheng Xiong wrote: > Hi all, > >Here is a new release candidate for hive-storage-2.4.0 which Hive 2.3 > will depend on. Please take a look and vote. Thanks. >

Re: [DISCUSS] Separating out the metastore as its own TLP

2017-07-10 Thread Alan Gates
On Wed, Jul 5, 2017 at 12:33 PM, Edward Capriolo wrote: > > I hate to draw in something else but I feel it is related: > > 8 December 2016 : release 2.1.1 available > 07 April 2017 : release 1.2.2 available > hive-dev [DISCUSS] Supporting Hadoop-1 and experimental features

Re: [DISCUSS] Separating out the metastore as its own TLP

2017-07-10 Thread Alan Gates
ck, is certainly not one of > them. > > Thanks, > Xuefu > > On Wed, Jul 5, 2017 at 12:33 PM, Edward Capriolo <edlinuxg...@gmail.com> > wrote: > > > On Wed, Jul 5, 2017 at 1:51 PM, Alan Gates <alanfga...@gmail.com> wrote: > > > > > On Mo

Re: [DISCUSS] Separating out the metastore as its own TLP

2017-07-10 Thread Alan Gates
gt; > blocks for other projects to use HMS as it is. The issue of Spark > including > > a Hive fork, which was brought up some time back, is certainly not one of > > them. > > > > Thanks, > > Xuefu > > > > On Wed, Jul 5, 2017 at 12:33 PM

<    1   2   3   4   5   6   7   8   9   10   >