[GitHub] hive pull request #407: Hive18799

2018-08-02 Thread alanfgates
GitHub user alanfgates opened a pull request:

https://github.com/apache/hive/pull/407

Hive18799

This is based off of Harsha's pull request #393 .  I made the following 
changes:

1. I rebased it against master.  Since the metastore is now split into 
common and server, I put all of the client stuff in a new module 
standalone-metastore/registry-client and the server stuff into 
metastore-server.  Harsha, feedback on whether I put the right things in the 
right places would be helpful.
2. I fixed one thrift request that had multiple arguments rather than a 
struct.

There are no tests in this code.  That's a problem, since this is a lot of 
code.  I assume there are tests for this code in the current registry project.  
Did you intend to move them separately?


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/alanfgates/hive hive18799

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/407.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #407


commit e4d43f778209dfe5cf67f2ef21361bf3c204471b
Author: Sriharsha Chintalapani 
Date:   2018-07-07T21:33:58Z

HIVE-18799: Add SchemaRegistry APIs to Hive MetaStore.

commit 6fcfceb0c8216943a00528ef56d5a1734c3885d6
Author: Sriharsha Chintalapani 
Date:   2018-07-10T05:50:11Z

Addressed feedback.

commit eebe0afb08a05343800afd569a3dde482ad0112c
Author: Alan Gates 
Date:   2018-08-01T21:20:33Z

Intermediate checkin.  Moved stuff events and model objects from 
standalone-metastore to standalone-meastore/metastore-server.  I haven't moved 
the registry classes yet.  That's next.  They aren't currently building.

commit f178fa6ba6c50f36a87c3a7ad17e2e77945fa8b7
Author: Alan Gates 
Date:   2018-08-02T00:09:13Z

Moved what I'm guessing to be client code into registry-common.

commit 6b286b98af7ab501d0160062187e0b78ba8182fb
Author: Alan Gates 
Date:   2018-08-02T00:26:38Z

Moved server code into metastore-server

commit e8e552c7978a9c99700c15d17be37bb8618b0ab7
Author: Alan Gates 
Date:   2018-08-02T21:31:43Z

Changed the name to registry-client (from registry-common)

commit a1659f58dbb98b0ce79e366cf761174964b36016
Author: Alan Gates 
Date:   2018-08-02T22:27:47Z

Fixed on thrift request that had multiple arguments rather than a request 
structure.  Fixed a couple of compile errors I had missed in earlier commits.




---


[GitHub] hive pull request #353: HIVE-18685

2018-05-22 Thread alanfgates
GitHub user alanfgates opened a pull request:

https://github.com/apache/hive/pull/353

HIVE-18685



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/alanfgates/hive hive18973

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/353.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #353


commit bfec5838be14192fee6af60c21916b75e869db2a
Author: Alan Gates <gates@...>
Date:   2018-04-26T21:10:14Z

HIVE-19323 Create metastore SQL install and upgrade scripts for 3.1

commit cfa777cc7d428074da96591b1a1b18cc537c519e
Author: Alan Gates <gates@...>
Date:   2018-04-26T23:27:18Z

HIVE-18685 Make transaction system work with catalogs




---


[GitHub] hive pull request #336: Hive19135

2018-04-26 Thread alanfgates
GitHub user alanfgates opened a pull request:

https://github.com/apache/hive/pull/336

Hive19135



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/alanfgates/hive hive19135

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/336.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #336


commit f01a8d2c4374a831148eb9ae3b59f3a2c533b3fb
Author: Alan Gates <gates@...>
Date:   2018-04-05T23:47:36Z

Added features to schemaTool to create catalogs and move databases and 
tables between catalogs.

commit 673813cb321226b3b5ba8d9c5dcd34c9765df638
Author: Alan Gates <gates@...>
Date:   2018-04-26T00:31:35Z

Fixes based on Thejas review feedback.




---


[GitHub] hive pull request #325: Hive19031 Mark duplicate configs in HiveConf as depr...

2018-03-22 Thread alanfgates
GitHub user alanfgates opened a pull request:

https://github.com/apache/hive/pull/325

Hive19031 Mark duplicate configs in HiveConf as deprecated



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/alanfgates/hive hive19031

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/325.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #325


commit 7b9246825eff191cfe819b20fa10649684fa15b4
Author: Alan Gates <gates@...>
Date:   2018-03-22T19:42:29Z

Cleanup and refactoring in MetastoreConf.

commit e91d26594f2010417dd6a88311644d4a393c1576
Author: Alan Gates <gates@...>
Date:   2018-03-22T22:30:39Z

HIVE-19031 Mark duplicate configs in HiveConf as deprecated




---


[GitHub] hive pull request #320: HIVE-18755 Modifications to metastore for catalog

2018-03-15 Thread alanfgates
GitHub user alanfgates opened a pull request:

https://github.com/apache/hive/pull/320

HIVE-18755 Modifications to metastore for catalog



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/alanfgates/hive hive18755

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/320.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #320


commit 697e0428b4046b0c36d413a74fc46c2cf28d6e67
Author: Alan Gates <gates@...>
Date:   2018-03-15T22:51:06Z

HIVE-18755 Modifications to metastore for catalog




---


[GitHub] hive pull request #308: HIVE-17990 Add Thrift and DB storage for Schema Regi...

2018-02-15 Thread alanfgates
GitHub user alanfgates opened a pull request:

https://github.com/apache/hive/pull/308

HIVE-17990 Add Thrift and DB storage for Schema Registry objects



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/alanfgates/hive hive17990

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/308.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #308


commit a5a49e9a0fcca40c298849e5b9d2eada00cebd9a
Author: Alan Gates <gates@...>
Date:   2017-10-19T23:49:38Z

HIVE-17990 Add Thrift and DB storage for Schema Registry objects




---


[GitHub] hive pull request #291: HIVE-17983 Make the standalone metastore generate ta...

2018-01-16 Thread alanfgates
GitHub user alanfgates opened a pull request:

https://github.com/apache/hive/pull/291

HIVE-17983 Make the standalone metastore generate tarballs etc.

See JIRA for full comments.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/alanfgates/hive hive17983

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/291.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #291


commit 1ba9b62d9ef488355e1a97dbc7237c1472349a24
Author: Alan Gates <gates@...>
Date:   2017-10-19T23:49:38Z

HIVE-17983 Make the standalone metastore generate tarballs etc.




---


[GitHub] hive pull request #279: HIVE-17982 Move metastore specific itests

2017-12-18 Thread alanfgates
GitHub user alanfgates opened a pull request:

https://github.com/apache/hive/pull/279

HIVE-17982 Move metastore specific itests



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/alanfgates/hive hive17982

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/279.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #279


commit 002233b90126469edd61658c1a32988438dfae85
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-10-26T16:49:19Z

HIVE-17982 Move metastore specific itests




---


[GitHub] hive pull request #274: HIVE-17981 Create a set of builders for Thrift class...

2017-12-07 Thread alanfgates
GitHub user alanfgates opened a pull request:

https://github.com/apache/hive/pull/274

HIVE-17981 Create a set of builders for Thrift classes



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/alanfgates/hive hive17981

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/274.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #274


commit 5360d684f12444bbaa846c80bdf972ca1748e875
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-09-12T20:18:09Z

HIVE-17981 Create a set of builders for Thrift classes




---


[GitHub] hive pull request #46: Hbase metastore

2017-11-21 Thread alanfgates
Github user alanfgates closed the pull request at:

https://github.com/apache/hive/pull/46


---


[GitHub] hive pull request #218: HIVE-17234

2017-11-21 Thread alanfgates
Github user alanfgates closed the pull request at:

https://github.com/apache/hive/pull/218


---


[GitHub] hive pull request #272: HIVE-17980 Moved HiveMetaStoreClient plus a few rema...

2017-11-21 Thread alanfgates
GitHub user alanfgates opened a pull request:

https://github.com/apache/hive/pull/272

HIVE-17980 Moved HiveMetaStoreClient plus a few remaining classes.



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/alanfgates/hive hive17980

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/272.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #272


commit 1f88bf94840e75130482e114a990eac5e9e98b88
Author: Alan Gates <alanfga...@gmail.com>
Date:   2017-09-07T02:00:14Z

HIVE-17980 Moved HiveMetaStoreClient plus a few remaining classes.




---


[GitHub] hive pull request #270: Hive17967

2017-11-02 Thread alanfgates
GitHub user alanfgates opened a pull request:

https://github.com/apache/hive/pull/270

Hive17967

See 
https://issues.apache.org/jira/browse/HIVE-17967?focusedCommentId=16236387=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16236387
 for a few important comments on this patch.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/alanfgates/hive hive17967

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/270.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #270


commit 49e3ba4c13a9532fc872541536ed79ddfb744fab
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-11-02T16:21:25Z

WIP.  Have moved HMS, but tests don't all pass yet.

commit 3ff8517247286d1efcb0de5321a29859263c6639
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-10-17T16:19:22Z

Fixes after rebase.  Moved EventCleaner and DumpDirCleaner threads to 
ThreadPool.

commit e1086463c2ae9e6df14150796f5e79ae37632b12
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-10-17T18:03:43Z

Moved TestObjectStore2 back into TestObjectStore now that HiveMetaStore has 
moved.

commit d476dd585976203bac77945ead708ba58492eac1
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-11-02T18:33:40Z

Fixes after rebase.

commit 54af42ad35501c8cd0ad3bb5bae256e6191fbe14
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-11-02T18:44:43Z

Fixed warnings in pom.  Added back deprecated method in ListenerEvent.




---


[GitHub] hive pull request #261: HIVE-17812

2017-11-02 Thread alanfgates
Github user alanfgates closed the pull request at:

https://github.com/apache/hive/pull/261


---


[GitHub] hive pull request #264: HIVE-17425

2017-10-18 Thread alanfgates
GitHub user alanfgates opened a pull request:

https://github.com/apache/hive/pull/264

HIVE-17425



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/alanfgates/hive hive17425

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/264.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #264


commit c9ce517b40cb496221ac3e456e9849cd31f69a31
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-08-31T21:42:38Z

HIVE-17425 Change MetastoreConf.ConfVars internal members to be private

commit 0e86883d9ef82134eb2547178597b11e18cca352
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-10-17T17:44:54Z

Fixed after rebase.




---


[GitHub] hive pull request #261: HIVE-17812

2017-10-14 Thread alanfgates
GitHub user alanfgates opened a pull request:

https://github.com/apache/hive/pull/261

HIVE-17812



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/alanfgates/hive hive17812

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/261.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #261


commit 15ce382059ee985ece8621bb9849776184d4805b
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-08-28T21:18:53Z

Moved EventMessage and friends.

commit eb6e31f25d3af16e8d1f9ebe88f16e25bcb56eeb
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-08-28T21:39:27Z

Moved JSON message implementations.

commit 8150c599e49373b0d3e7d55423b653c2d1757fc9
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-08-28T23:56:09Z

Moved RetryingHMSHandler

commit ab945374b3ddb9fdd1e20c06c99c8154434295db
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-08-30T17:35:31Z

Moved events.  As a part of this I had to change events and listeners to 
take IHMSHandler interface rather than a direct reference to HMSHandler.  I 
believe this is an improvement as it gives a clean separation between the 
interface and the implementation.  But it will break existing listeners.  As 
part of this I had to add a few methods to IHMSHandler.  We may need to 
continue to add methods here to support existing external listeners.

commit fdde7842526d0ba7871333de72c5e38e3a2c2a58
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-08-31T18:00:44Z

Moved the listeners.  Also moved one event that either I missed or that 
snuck in after I moved the others.

commit 5cb1950fc2f91dc412e897c952e076348248d2f6
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-08-31T20:02:13Z

Moved AlterHandler and HiveAlterHandler.  Also did a partial cleanup of 
MetaStoreUtils.  Need to do more.

commit 7a7dde55e60a0b09db22becd7f839c9eaa25d0bd
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-09-01T19:11:50Z

Converted extenders of HouseKeeperService to instead implement 
RunnableConfigurable and use the general ThreadPool.

commit 5506814216dc212b0e79eefc458ec841dc2ca123
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-09-01T22:03:42Z

Moved FileMetadataManager.

commit 446be8e95a0399185ea9d23362bd878d325d0f63
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-10-14T19:02:27Z

Fixes after the rebase.  Also fixed acid house keeping threads to only open 
txn handler once instead of on every run.




---


[GitHub] hive pull request #253: HIVE-17561

2017-10-10 Thread alanfgates
Github user alanfgates closed the pull request at:

https://github.com/apache/hive/pull/253


---


[GitHub] hive pull request #258: HIVE-17733

2017-10-06 Thread alanfgates
GitHub user alanfgates opened a pull request:

https://github.com/apache/hive/pull/258

HIVE-17733

Moved RawStore, implementations, and some classes they depend on.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/alanfgates/hive hive17733

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/258.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #258


commit c6221d3305e0be74b63ec13902bff90cb355ccd1
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-08-24T00:04:18Z

Moved Filter.g and ExpressionTree.  As part of this I had to move 
PARTITION_DATE_FORMAT from HiveMetaStore to MetaStoreUtils.  Without this the 
move would have had to wait until I moved HiveMetaStore.  But this caused a 
cascade of other things to have to wait, so that I would have ended up with one 
huge patch that moves everything.

commit b7a555b27e993250ec2f7c53916d8aaf4d56e495
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-08-24T22:53:20Z

Moved NDV classes in prep for moving Stats mergers.

commit fa7602a290f5691242319cf74fbd021808cc088b
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-08-24T23:12:36Z

Moved ColumnStatsMerger and implementors.

commit 7089ee49ee579e0ef034d73543e96db207c871f1
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-08-25T00:08:34Z

Moved MetaStoreDirectSql, StatObjectConverter, and ColumnStatsAggregator 
and implementations.  Combined all of these together because there was a 
circular dependence.

commit e1d74d08237e7ddcdbb64a90915771ccd5d20199
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-08-25T23:37:33Z

Moved PartFilterExprUtil

commit fd6b77ee78dece36dd239510dc4c9623cd81370c
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-08-31T00:00:05Z

Moved stats data inspectors

commit 9fb4cede04a302f90641aec94a1f91c91a120b79
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-08-26T01:36:15Z

Moved RawStore and friends.

commit 416d88ae19c5c51bc97ba5c12d3dd03bc58e36f7
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-08-28T22:16:02Z

Moved RawStoreProxy and associated test.

commit 6aac3bb41b5923e179b7c508a0c0373e2c217f6f
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-10-06T21:51:23Z

Changes to make it compile after rebase.  Also split TestObjectStore so 
that I could move the majority of it to standalone-metastore (since ObjectStore 
is now there) but left a couple of tests in metastore since they reference 
EventMessage which hasn't moved yet.




---


[GitHub] hive pull request #253: HIVE-17561

2017-09-20 Thread alanfgates
GitHub user alanfgates opened a pull request:

https://github.com/apache/hive/pull/253

HIVE-17561

Moved TxnStore and its implementations.  Moved DataSourceProvider as well.  
Moved ValidTxnList and ValidReadTxnList to storage-api as ORC and the 
standalone metastore will both need them.  Also moved the newly created 
SQLGenerator.  

I did not move the functionality that added bonecp and hikari to the 
restricted list in HiveConf because MetastoreConf doesn't have a restricted 
list.  MetastoreConf doesn't have a restricted list because that functionality 
is broken.  setVar* doesn't check against the restricted list.  Given that 
MetastoreConf is a set of static convenience methods to be used on top of 
Configuration we can't stop users from going underneath and calling set() 
directly anyway.  If we want to restrict users from setting certain values in 
the MetastoreConf we need a comprehensive and secure way to do it.  Plus I'm 
not convinced that boncep and hikari settings are high security issues anyway.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/alanfgates/hive hive17561

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/253.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #253


commit 305c8f27e884c94faad34a350ee1848cdd5f
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-08-04T20:02:03Z

WIP, tests don't pass yet.  I think I've moved all the files.

commit 21523f3dfd0666a3ef68558a392df14c0bf80eb0
Author: Alan Gates <alanfga...@gmail.com>
Date:   2017-09-20T06:01:25Z

Moved SQLGenerator since it was newly created.  I did not move the 
functionality that added bonecp and hikari to the restricted list in HiveConf, 
because there is no restricted list in MetastoreConf.  There's no restricted 
list because the HiveConf implementation is completely broken.  It isn't 
checked when a setVar call is made, so it's easy to end run around.  If we want 
to figure out ways to restrict what values users can set at runtime we need to 
do it in a coherent and complete way.




---


[GitHub] hive pull request #252: HIVE-17537 Moved Warehouse to standalone.

2017-09-14 Thread alanfgates
GitHub user alanfgates opened a pull request:

https://github.com/apache/hive/pull/252

HIVE-17537 Moved Warehouse to standalone.



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/alanfgates/hive hive17537

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/252.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #252


commit 59da41ddf311d3f335c7854194af96c9e6ec9413
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-08-02T19:35:07Z

Moved ReplChangeManager

Moved Warehouse to standalone.




---


[GitHub] hive pull request #247: HIVE-17506 Moved standalone-metastore out from under...

2017-09-11 Thread alanfgates
GitHub user alanfgates opened a pull request:

https://github.com/apache/hive/pull/247

HIVE-17506 Moved standalone-metastore out from under Hive pom to its own 
top lev…

…el pom.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/alanfgates/hive hive17506

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/247.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #247


commit 9374a05dfa57470d7b986e875485670f8ce73276
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-09-11T22:03:22Z

Moved standalone-metastore out from under Hive pom to its own top level pom.




---


[GitHub] hive pull request #244: HIVE-17488 Move first set of metastore objects to st...

2017-09-08 Thread alanfgates
GitHub user alanfgates opened a pull request:

https://github.com/apache/hive/pull/244

HIVE-17488 Move first set of metastore objects to standalone-metastore



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/alanfgates/hive hive17488

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/244.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #244


commit 6914a81f9b65f127cd9fc40f66ac8a7b663ed89b
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-07-25T21:18:11Z

Moved TableType

commit 100e59af9bb03311b1dde284f0e8a8f046374e43
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-07-25T21:40:57Z

Moved HiveMetaHook, HiveMetaHookLoader, and DefaultHiveMetaHook

commit 0c0a921a5f7ef20192d8d3e320cc0fa66c0e675f
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-07-25T21:50:55Z

Moved IExtrapolatePartStatus and LinearExtrapolatePartStatus

commit f1eca5fec96926d44d4355b144359f159e0f7057
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-07-25T21:59:44Z

Moved IHMSHandler

commit 803cec349fe3d487381fcc4c1af57fca22e3f7d7
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-07-27T21:44:05Z

Moved Annotations.

commit 2b56157f60990e9f94ce3b1ad8d020d75e776815
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-07-25T22:55:56Z

Moved MetaStoreFilterHook and DefaultMetaStoreFilterHookImpl.  Since they 
took HiveConf in the constructor this did force a constructor change.

commit d40a78e45eefb265c45ba25302a320073b247446
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-07-25T23:08:06Z

Moved PartitionSpecProxy and its subclasses.

commit 9612ba2a1ff2d5117df8d8ab8eeb970890638b19
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-07-27T22:10:24Z

Moved JDOConnectionURLHook

commit 18f80e23d53854b5ae327fd65dd1ace93fed8a72
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-07-27T22:18:55Z

Moved TServerSocketKeepAlive

commit c8991bab89fec5a3404238223913d18d86142d68
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-07-27T22:28:30Z

Moved PartitionDropOptions

commit c8c5389d14c10f1cbe6bf362a159c9efe99f2293
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-07-27T22:37:56Z

Moved MetaStoreEndFunctionContext and MetaStoreEndFunctionListener

commit b3d4d52f2d804b71ab8913a9ee7b810e8fa5d22b
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-07-27T23:10:00Z

Moved MetaStoreFS and HiveMetaStoreFsImpl.  Created FileUtils and 
MetaStoreUtils and copied a couple of files out of the corresponding classes in 
other packages.

commit 478c3d5afab83cd016f95a92387d10561b1329b6
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-07-27T23:19:56Z

Moved DatabaseProduct

commit 5fc0b72bb17cbe557ffaf11229c6e4ef18aa6a20
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-07-28T00:00:13Z

Moved HiveMetaException

commit a827a7ae3e890740b245ee383f1a1730b3988ef1
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-07-28T13:40:14Z

Moved AggregateStatsCache

commit cc371862e380f66b7cb1bdaf74d9470c47f8ff10
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-07-28T13:52:13Z

Moved LockComponentBuilder, LockRequestBuilder, and TestLockRequestBuilder

commit 2f4a537445d0aef4d5862d6f3e0c65bb522fa4e6
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-07-28T14:53:47Z

Moved MetaStoreThread.  This required switching it from HiveConf to 
Configuration, which trickled down to the compactor threads themselves.

commit 10fd1c7f06ea3775a381f97b52eccd442eea2d1a
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-07-28T18:34:26Z

Copied in HiveVersionAnnotation, HiveVersionInfo, and saveVersion.sh from 
common and switched MetaStoreSchemaInfo to use the new Metastore versions of 
these files.

commit 83b4f138ff233325e407f520ebc2a8bd10494e1e
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-07-28T20:31:36Z

Moved IMetaStoreSchemaInfo, MetaStoreSchemaInfo, 
MetaStoreSchemaInfoFactory, TestMetaStoreSchemaFactory, and 
TestMetaStoreSchemaInfo.

commit 34877b4c8a469b589f659209d67b8ba16d5a3030
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-07-28T21:00:35Z

Moved MetaStoreInit.  Created JavaUtils but only copied over the method 
used.

commit 2a52f6b6289011c6759a1b466368fc6db9e04bb3
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-08-17T23:59:34Z

Fixed compilation errors.

commit 58478570539c6484be1fd0f43c464356f713abd4
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-08-22T22:53:14Z

Moved PartitionExpressionProxy.

commit 2414722f42dcbd5b6b11c2603c972782d7f0b5cb
Author: Alan Gates <ga...@hortonworks.com>
Date:   2

[GitHub] hive pull request #239: HIVE-17359 Split out the typeinfo

2017-08-29 Thread alanfgates
GitHub user alanfgates opened a pull request:

https://github.com/apache/hive/pull/239

HIVE-17359 Split out the typeinfo

I took the approach of duplicating the necessary parts of TypeInfo on the 
metastore side.

Note that this does not solve the SerDe used by 
HiveMetaStore.get_fields_with_environment_context.  We'll solve that separately.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/alanfgates/hive hive17359

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/239.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #239


commit c799a52aeab95542aa5d9eb55dc3987af26f2878
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-08-02T18:38:27Z

Removed use of TypeInfo from metastore classes.  Added metastore specific 
type information.

commit 1e5e99e897df83bd2384f181797bbd9d4b810179
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-08-17T23:32:41Z

Fixed broken compilation in test.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] hive pull request #235: HIVE-17307 Change the metastore to not use the metri...

2017-08-18 Thread alanfgates
GitHub user alanfgates opened a pull request:

https://github.com/apache/hive/pull/235

HIVE-17307 Change the metastore to not use the metrics code in hive/common



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/alanfgates/hive hive17307

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/235.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #235


commit 72fd3e7232a44655dc7471a61729c4a1abf49c26
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-08-01T16:57:32Z

Implemented metrics in standalone-metastore.  Ported existing metastore 
classes to use them.

commit 201b16defbad4076495553fe127ae7c79e08804b
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-08-01T16:58:52Z

Adding pom file I missed in the previous checkin.

commit b310893a5f8400085919e313b58723a10fb18c88
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-08-01T18:36:36Z

Copied JvmPauseMonitor into standalone-metastore

commit 3a8080c6c9cfe77cc0d9561ab5f65d4d4298d5d3
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-08-01T20:43:14Z

Copied PerfLogger into the standalone metastore and moved 
RetryingHMSHandler to use it.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] hive pull request #228: HIVE-17241 Removed shims from metastore. For HDFS an...

2017-08-11 Thread alanfgates
GitHub user alanfgates opened a pull request:

https://github.com/apache/hive/pull/228

HIVE-17241 Removed shims from metastore.  For HDFS and getPassword I just 
access…

… those operations directly.  I copied all of the HadoopThriftAuthBridge 
stuff over from Hive common.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/alanfgates/hive hive17241

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/228.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #228






---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] hive pull request #220: HIVE-17224 Moved all the JDO classes and package.jdo

2017-08-11 Thread alanfgates
Github user alanfgates closed the pull request at:

https://github.com/apache/hive/pull/220


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] hive pull request #220: HIVE-17224 Moved all the JDO classes and package.jdo

2017-08-03 Thread alanfgates
GitHub user alanfgates opened a pull request:

https://github.com/apache/hive/pull/220

HIVE-17224 Moved all the JDO classes and package.jdo



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/alanfgates/hive hive17224

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/220.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #220


commit cd70b9ce7798251d5dd8b247bba0fb8211ebce40
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-07-27T21:27:57Z

Moved all the JDO classes and package.jdo




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] hive pull request #210: HIVE-17168 Create separate module for stand alone me...

2017-08-03 Thread alanfgates
Github user alanfgates closed the pull request at:

https://github.com/apache/hive/pull/210


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] hive pull request #211: HIVE-17167 Create metastore specific configuration t...

2017-08-03 Thread alanfgates
Github user alanfgates closed the pull request at:

https://github.com/apache/hive/pull/211


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] hive pull request #216: HIVE-17170 Move thrift generated code to stand alone...

2017-08-03 Thread alanfgates
Github user alanfgates closed the pull request at:

https://github.com/apache/hive/pull/216


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] hive pull request #218: HIVE-17234

2017-08-02 Thread alanfgates
GitHub user alanfgates opened a pull request:

https://github.com/apache/hive/pull/218

HIVE-17234

This patch removes all of the unused parts of HBase metastore.  The 
aggregate stats work is kept, and moves into directories that match the already 
changed packages.  Two methods that were still used from HBaseUtils move into 
MetaStoreUtils.  FileMetadata remains in the hbase package, since I believe 
Sergey wants to use it sometime in the future.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/alanfgates/hive hive17234

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/218.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #218


commit 6afb3e1335e3541b6775a58d00b383cc36024d18
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-08-03T00:12:09Z

HIVE-17234 Remove HBase metastore from master

commit fbce5296c95f38bb56ff2ba3a670f02533ed6661
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-08-03T00:32:59Z

Removed one more file I missed previously.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] hive pull request #216: HIVE-17170 Move thrift generated code to stand alone...

2017-08-01 Thread alanfgates
GitHub user alanfgates opened a pull request:

https://github.com/apache/hive/pull/216

HIVE-17170 Move thrift generated code to stand alone metastore



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/alanfgates/hive hive17170

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/216.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #216


commit ffd8599cd3db1cbb0464606901dc6f73916bdc69
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-07-25T20:50:38Z

HIVE-17170 Move thrift generated code to stand alone metastore




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] hive pull request #211: HIVE-17167 Create metastore specific configuration t...

2017-07-27 Thread alanfgates
GitHub user alanfgates opened a pull request:

https://github.com/apache/hive/pull/211

HIVE-17167 Create metastore specific configuration tool



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/alanfgates/hive hive17167

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/211.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #211






---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] hive pull request #210: HIVE-17168 Create separate module for stand alone me...

2017-07-25 Thread alanfgates
GitHub user alanfgates opened a pull request:

https://github.com/apache/hive/pull/210

HIVE-17168 Create separate module for stand alone metastore



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/alanfgates/hive hive17168

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/210.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #210


commit 01e46ba1729ee8e66545f2bc6c52d567e1ba4a3a
Author: Alan Gates <ga...@hortonworks.com>
Date:   2017-07-25T17:10:22Z

HIVE-17168 Create separate module for stand alone metastore




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] hive pull request: Hbase metastore

2015-07-17 Thread alanfgates
GitHub user alanfgates opened a pull request:

https://github.com/apache/hive/pull/46

Hbase metastore

HIVE-11294 Cache aggregated stats in hbase

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/alanfgates/hive hbase-metastore

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/46.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #46


commit 58ca965ca58925e4846e14cf37d64638edb3e353
Author: Alan Gates ga...@apache.org
Date:   2015-01-23T19:05:19Z

Creating branch for hbase metastore development.


git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1654331 
13f79535-47bb-0310-9956-ffa450edef68

commit e81704eeaf061e7152c63379b828debdfdfe9a8e
Author: Alan Gates ga...@apache.org
Date:   2015-02-04T20:00:49Z

HIVE-9453 Initial patch [hbase-metastore branch] (Alan Gates, reviewed by 
Thejas Nair)


git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1657394 
13f79535-47bb-0310-9956-ffa450edef68

commit 120047c308a011f17f94258779e4c47fcff191a5
Author: Alan Gates ga...@apache.org
Date:   2015-02-10T21:41:19Z

HIVE-9578 Add support for getDatabases and alterDatabase calls 
[hbase-metastore branch]


git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1658821 
13f79535-47bb-0310-9956-ffa450edef68

commit c7dcf4a85d5cef4151d7b72115b4a1027af488ac
Author: Alan Gates ga...@apache.org
Date:   2015-02-10T22:47:53Z

HIVE-9579 Support all get tables [hbase-metastore branch]


git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1658829 
13f79535-47bb-0310-9956-ffa450edef68

commit cd82601f6e5c4aea5db72b74629b6aada23cf7c2
Author: Alan Gates ga...@apache.org
Date:   2015-02-19T18:51:39Z

HIVE-9606 Need a tool to export metadata from RDBMS based metastore into 
HBase [hbase-metastore branch] (Alan Gates, reviewed by Thejas Nair)


git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1660974 
13f79535-47bb-0310-9956-ffa450edef68

commit 21ba0a93dcadcf8726ae7a18e81f758921552697
Author: Alan Gates ga...@apache.org
Date:   2015-03-02T18:17:01Z

HIVE-9641 Fill out remaining partition functions in HBaseStore (Alan Gates 
reviewed by Vaibhav Gumashta)


git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1663386 
13f79535-47bb-0310-9956-ffa450edef68

commit bb0010caa8734af34ecac7b5b054afd95b49b0e0
Author: Alan Gates ga...@apache.org
Date:   2015-03-05T03:46:28Z

HIVE-9677 Implement privileges call in HBaseStore (Alan Gates)


git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1664220 
13f79535-47bb-0310-9956-ffa450edef68

commit 408d467bffa0923714b8262427f1d1d72ba9932d
Author: Alan Gates ga...@apache.org
Date:   2015-03-05T04:09:31Z

HIVE-9763 Remove M* classes from RawStore interface (Alan Gates)


git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1664226 
13f79535-47bb-0310-9956-ffa450edef68

commit be575b84a8d5b4764550499c60bdccb7b0d1f82f
Author: Alan Gates ga...@apache.org
Date:   2015-03-05T04:35:53Z

HIVE-9802 Refactor HBaseReadWrite to allow different implementations 
underneath, also includes code from HIVE-9783 Move serialization of objects in 
HBase to protocol buffers (Alan Gates)


git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1664227 
13f79535-47bb-0310-9956-ffa450edef68

commit 646468fcdfd612524961751ba3575a26a1fb3fcb
Author: Alan Gates ga...@apache.org
Date:   2015-03-12T19:41:56Z

HIVE-9885 HBase metastore protobufs need to check hasX() functions for 
values that are not auto set in serialization [hbase-metastore branch] (Alan 
Gates)


git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1666280 
13f79535-47bb-0310-9956-ffa450edef68

commit d268b81bcd2fbaae6fdbfe2f980f644ce5e3d92d
Author: Alan Gates ga...@apache.org
Date:   2015-03-12T20:01:30Z

HIVE-9874 Partition storage descriptors being set from table sd without 
copying [hbase-metastore branch] (Alan Gates)


git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1666285 
13f79535-47bb-0310-9956-ffa450edef68

commit 24f224867b70bacc91a877242aee1b0b84efd127
Author: Alan Gates ga...@apache.org
Date:   2015-03-17T15:50:31Z

HIVE-9942 Implement functions methods in HBaseStore (Alan Gates)


git-svn-id: 
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1667338 
13f79535-47bb-0310-9956-ffa450edef68

commit 35ac8b0257614523064c1b3647a91e123b78e999
Author: Alan Gates ga...@apache.org
Date:   2015-03-18T17:41:50Z

HIVE-10008 Need to refactor itests for hbase metastore (Alan