[GitHub] hive pull request #407: Hive18799
GitHub user alanfgates opened a pull request: https://github.com/apache/hive/pull/407 Hive18799 This is based off of Harsha's pull request #393 . I made the following changes: 1. I rebased it against master. Since the metastore is now split into common and server, I put all of the client stuff in a new module standalone-metastore/registry-client and the server stuff into metastore-server. Harsha, feedback on whether I put the right things in the right places would be helpful. 2. I fixed one thrift request that had multiple arguments rather than a struct. There are no tests in this code. That's a problem, since this is a lot of code. I assume there are tests for this code in the current registry project. Did you intend to move them separately? You can merge this pull request into a Git repository by running: $ git pull https://github.com/alanfgates/hive hive18799 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/407.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #407 commit e4d43f778209dfe5cf67f2ef21361bf3c204471b Author: Sriharsha Chintalapani Date: 2018-07-07T21:33:58Z HIVE-18799: Add SchemaRegistry APIs to Hive MetaStore. commit 6fcfceb0c8216943a00528ef56d5a1734c3885d6 Author: Sriharsha Chintalapani Date: 2018-07-10T05:50:11Z Addressed feedback. commit eebe0afb08a05343800afd569a3dde482ad0112c Author: Alan Gates Date: 2018-08-01T21:20:33Z Intermediate checkin. Moved stuff events and model objects from standalone-metastore to standalone-meastore/metastore-server. I haven't moved the registry classes yet. That's next. They aren't currently building. commit f178fa6ba6c50f36a87c3a7ad17e2e77945fa8b7 Author: Alan Gates Date: 2018-08-02T00:09:13Z Moved what I'm guessing to be client code into registry-common. commit 6b286b98af7ab501d0160062187e0b78ba8182fb Author: Alan Gates Date: 2018-08-02T00:26:38Z Moved server code into metastore-server commit e8e552c7978a9c99700c15d17be37bb8618b0ab7 Author: Alan Gates Date: 2018-08-02T21:31:43Z Changed the name to registry-client (from registry-common) commit a1659f58dbb98b0ce79e366cf761174964b36016 Author: Alan Gates Date: 2018-08-02T22:27:47Z Fixed on thrift request that had multiple arguments rather than a request structure. Fixed a couple of compile errors I had missed in earlier commits. ---
[GitHub] hive pull request #353: HIVE-18685
GitHub user alanfgates opened a pull request: https://github.com/apache/hive/pull/353 HIVE-18685 You can merge this pull request into a Git repository by running: $ git pull https://github.com/alanfgates/hive hive18973 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/353.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #353 commit bfec5838be14192fee6af60c21916b75e869db2a Author: Alan Gates <gates@...> Date: 2018-04-26T21:10:14Z HIVE-19323 Create metastore SQL install and upgrade scripts for 3.1 commit cfa777cc7d428074da96591b1a1b18cc537c519e Author: Alan Gates <gates@...> Date: 2018-04-26T23:27:18Z HIVE-18685 Make transaction system work with catalogs ---
[GitHub] hive pull request #336: Hive19135
GitHub user alanfgates opened a pull request: https://github.com/apache/hive/pull/336 Hive19135 You can merge this pull request into a Git repository by running: $ git pull https://github.com/alanfgates/hive hive19135 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/336.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #336 commit f01a8d2c4374a831148eb9ae3b59f3a2c533b3fb Author: Alan Gates <gates@...> Date: 2018-04-05T23:47:36Z Added features to schemaTool to create catalogs and move databases and tables between catalogs. commit 673813cb321226b3b5ba8d9c5dcd34c9765df638 Author: Alan Gates <gates@...> Date: 2018-04-26T00:31:35Z Fixes based on Thejas review feedback. ---
[GitHub] hive pull request #325: Hive19031 Mark duplicate configs in HiveConf as depr...
GitHub user alanfgates opened a pull request: https://github.com/apache/hive/pull/325 Hive19031 Mark duplicate configs in HiveConf as deprecated You can merge this pull request into a Git repository by running: $ git pull https://github.com/alanfgates/hive hive19031 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/325.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #325 commit 7b9246825eff191cfe819b20fa10649684fa15b4 Author: Alan Gates <gates@...> Date: 2018-03-22T19:42:29Z Cleanup and refactoring in MetastoreConf. commit e91d26594f2010417dd6a88311644d4a393c1576 Author: Alan Gates <gates@...> Date: 2018-03-22T22:30:39Z HIVE-19031 Mark duplicate configs in HiveConf as deprecated ---
[GitHub] hive pull request #320: HIVE-18755 Modifications to metastore for catalog
GitHub user alanfgates opened a pull request: https://github.com/apache/hive/pull/320 HIVE-18755 Modifications to metastore for catalog You can merge this pull request into a Git repository by running: $ git pull https://github.com/alanfgates/hive hive18755 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/320.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #320 commit 697e0428b4046b0c36d413a74fc46c2cf28d6e67 Author: Alan Gates <gates@...> Date: 2018-03-15T22:51:06Z HIVE-18755 Modifications to metastore for catalog ---
[GitHub] hive pull request #308: HIVE-17990 Add Thrift and DB storage for Schema Regi...
GitHub user alanfgates opened a pull request: https://github.com/apache/hive/pull/308 HIVE-17990 Add Thrift and DB storage for Schema Registry objects You can merge this pull request into a Git repository by running: $ git pull https://github.com/alanfgates/hive hive17990 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/308.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #308 commit a5a49e9a0fcca40c298849e5b9d2eada00cebd9a Author: Alan Gates <gates@...> Date: 2017-10-19T23:49:38Z HIVE-17990 Add Thrift and DB storage for Schema Registry objects ---
[GitHub] hive pull request #291: HIVE-17983 Make the standalone metastore generate ta...
GitHub user alanfgates opened a pull request: https://github.com/apache/hive/pull/291 HIVE-17983 Make the standalone metastore generate tarballs etc. See JIRA for full comments. You can merge this pull request into a Git repository by running: $ git pull https://github.com/alanfgates/hive hive17983 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/291.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #291 commit 1ba9b62d9ef488355e1a97dbc7237c1472349a24 Author: Alan Gates <gates@...> Date: 2017-10-19T23:49:38Z HIVE-17983 Make the standalone metastore generate tarballs etc. ---
[GitHub] hive pull request #279: HIVE-17982 Move metastore specific itests
GitHub user alanfgates opened a pull request: https://github.com/apache/hive/pull/279 HIVE-17982 Move metastore specific itests You can merge this pull request into a Git repository by running: $ git pull https://github.com/alanfgates/hive hive17982 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/279.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #279 commit 002233b90126469edd61658c1a32988438dfae85 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-10-26T16:49:19Z HIVE-17982 Move metastore specific itests ---
[GitHub] hive pull request #274: HIVE-17981 Create a set of builders for Thrift class...
GitHub user alanfgates opened a pull request: https://github.com/apache/hive/pull/274 HIVE-17981 Create a set of builders for Thrift classes You can merge this pull request into a Git repository by running: $ git pull https://github.com/alanfgates/hive hive17981 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/274.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #274 commit 5360d684f12444bbaa846c80bdf972ca1748e875 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-09-12T20:18:09Z HIVE-17981 Create a set of builders for Thrift classes ---
[GitHub] hive pull request #46: Hbase metastore
Github user alanfgates closed the pull request at: https://github.com/apache/hive/pull/46 ---
[GitHub] hive pull request #218: HIVE-17234
Github user alanfgates closed the pull request at: https://github.com/apache/hive/pull/218 ---
[GitHub] hive pull request #272: HIVE-17980 Moved HiveMetaStoreClient plus a few rema...
GitHub user alanfgates opened a pull request: https://github.com/apache/hive/pull/272 HIVE-17980 Moved HiveMetaStoreClient plus a few remaining classes. You can merge this pull request into a Git repository by running: $ git pull https://github.com/alanfgates/hive hive17980 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/272.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #272 commit 1f88bf94840e75130482e114a990eac5e9e98b88 Author: Alan Gates <alanfga...@gmail.com> Date: 2017-09-07T02:00:14Z HIVE-17980 Moved HiveMetaStoreClient plus a few remaining classes. ---
[GitHub] hive pull request #270: Hive17967
GitHub user alanfgates opened a pull request: https://github.com/apache/hive/pull/270 Hive17967 See https://issues.apache.org/jira/browse/HIVE-17967?focusedCommentId=16236387=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16236387 for a few important comments on this patch. You can merge this pull request into a Git repository by running: $ git pull https://github.com/alanfgates/hive hive17967 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/270.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #270 commit 49e3ba4c13a9532fc872541536ed79ddfb744fab Author: Alan Gates <ga...@hortonworks.com> Date: 2017-11-02T16:21:25Z WIP. Have moved HMS, but tests don't all pass yet. commit 3ff8517247286d1efcb0de5321a29859263c6639 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-10-17T16:19:22Z Fixes after rebase. Moved EventCleaner and DumpDirCleaner threads to ThreadPool. commit e1086463c2ae9e6df14150796f5e79ae37632b12 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-10-17T18:03:43Z Moved TestObjectStore2 back into TestObjectStore now that HiveMetaStore has moved. commit d476dd585976203bac77945ead708ba58492eac1 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-11-02T18:33:40Z Fixes after rebase. commit 54af42ad35501c8cd0ad3bb5bae256e6191fbe14 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-11-02T18:44:43Z Fixed warnings in pom. Added back deprecated method in ListenerEvent. ---
[GitHub] hive pull request #261: HIVE-17812
Github user alanfgates closed the pull request at: https://github.com/apache/hive/pull/261 ---
[GitHub] hive pull request #264: HIVE-17425
GitHub user alanfgates opened a pull request: https://github.com/apache/hive/pull/264 HIVE-17425 You can merge this pull request into a Git repository by running: $ git pull https://github.com/alanfgates/hive hive17425 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/264.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #264 commit c9ce517b40cb496221ac3e456e9849cd31f69a31 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-08-31T21:42:38Z HIVE-17425 Change MetastoreConf.ConfVars internal members to be private commit 0e86883d9ef82134eb2547178597b11e18cca352 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-10-17T17:44:54Z Fixed after rebase. ---
[GitHub] hive pull request #261: HIVE-17812
GitHub user alanfgates opened a pull request: https://github.com/apache/hive/pull/261 HIVE-17812 You can merge this pull request into a Git repository by running: $ git pull https://github.com/alanfgates/hive hive17812 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/261.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #261 commit 15ce382059ee985ece8621bb9849776184d4805b Author: Alan Gates <ga...@hortonworks.com> Date: 2017-08-28T21:18:53Z Moved EventMessage and friends. commit eb6e31f25d3af16e8d1f9ebe88f16e25bcb56eeb Author: Alan Gates <ga...@hortonworks.com> Date: 2017-08-28T21:39:27Z Moved JSON message implementations. commit 8150c599e49373b0d3e7d55423b653c2d1757fc9 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-08-28T23:56:09Z Moved RetryingHMSHandler commit ab945374b3ddb9fdd1e20c06c99c8154434295db Author: Alan Gates <ga...@hortonworks.com> Date: 2017-08-30T17:35:31Z Moved events. As a part of this I had to change events and listeners to take IHMSHandler interface rather than a direct reference to HMSHandler. I believe this is an improvement as it gives a clean separation between the interface and the implementation. But it will break existing listeners. As part of this I had to add a few methods to IHMSHandler. We may need to continue to add methods here to support existing external listeners. commit fdde7842526d0ba7871333de72c5e38e3a2c2a58 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-08-31T18:00:44Z Moved the listeners. Also moved one event that either I missed or that snuck in after I moved the others. commit 5cb1950fc2f91dc412e897c952e076348248d2f6 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-08-31T20:02:13Z Moved AlterHandler and HiveAlterHandler. Also did a partial cleanup of MetaStoreUtils. Need to do more. commit 7a7dde55e60a0b09db22becd7f839c9eaa25d0bd Author: Alan Gates <ga...@hortonworks.com> Date: 2017-09-01T19:11:50Z Converted extenders of HouseKeeperService to instead implement RunnableConfigurable and use the general ThreadPool. commit 5506814216dc212b0e79eefc458ec841dc2ca123 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-09-01T22:03:42Z Moved FileMetadataManager. commit 446be8e95a0399185ea9d23362bd878d325d0f63 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-10-14T19:02:27Z Fixes after the rebase. Also fixed acid house keeping threads to only open txn handler once instead of on every run. ---
[GitHub] hive pull request #253: HIVE-17561
Github user alanfgates closed the pull request at: https://github.com/apache/hive/pull/253 ---
[GitHub] hive pull request #258: HIVE-17733
GitHub user alanfgates opened a pull request: https://github.com/apache/hive/pull/258 HIVE-17733 Moved RawStore, implementations, and some classes they depend on. You can merge this pull request into a Git repository by running: $ git pull https://github.com/alanfgates/hive hive17733 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/258.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #258 commit c6221d3305e0be74b63ec13902bff90cb355ccd1 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-08-24T00:04:18Z Moved Filter.g and ExpressionTree. As part of this I had to move PARTITION_DATE_FORMAT from HiveMetaStore to MetaStoreUtils. Without this the move would have had to wait until I moved HiveMetaStore. But this caused a cascade of other things to have to wait, so that I would have ended up with one huge patch that moves everything. commit b7a555b27e993250ec2f7c53916d8aaf4d56e495 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-08-24T22:53:20Z Moved NDV classes in prep for moving Stats mergers. commit fa7602a290f5691242319cf74fbd021808cc088b Author: Alan Gates <ga...@hortonworks.com> Date: 2017-08-24T23:12:36Z Moved ColumnStatsMerger and implementors. commit 7089ee49ee579e0ef034d73543e96db207c871f1 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-08-25T00:08:34Z Moved MetaStoreDirectSql, StatObjectConverter, and ColumnStatsAggregator and implementations. Combined all of these together because there was a circular dependence. commit e1d74d08237e7ddcdbb64a90915771ccd5d20199 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-08-25T23:37:33Z Moved PartFilterExprUtil commit fd6b77ee78dece36dd239510dc4c9623cd81370c Author: Alan Gates <ga...@hortonworks.com> Date: 2017-08-31T00:00:05Z Moved stats data inspectors commit 9fb4cede04a302f90641aec94a1f91c91a120b79 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-08-26T01:36:15Z Moved RawStore and friends. commit 416d88ae19c5c51bc97ba5c12d3dd03bc58e36f7 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-08-28T22:16:02Z Moved RawStoreProxy and associated test. commit 6aac3bb41b5923e179b7c508a0c0373e2c217f6f Author: Alan Gates <ga...@hortonworks.com> Date: 2017-10-06T21:51:23Z Changes to make it compile after rebase. Also split TestObjectStore so that I could move the majority of it to standalone-metastore (since ObjectStore is now there) but left a couple of tests in metastore since they reference EventMessage which hasn't moved yet. ---
[GitHub] hive pull request #253: HIVE-17561
GitHub user alanfgates opened a pull request: https://github.com/apache/hive/pull/253 HIVE-17561 Moved TxnStore and its implementations. Moved DataSourceProvider as well. Moved ValidTxnList and ValidReadTxnList to storage-api as ORC and the standalone metastore will both need them. Also moved the newly created SQLGenerator. I did not move the functionality that added bonecp and hikari to the restricted list in HiveConf because MetastoreConf doesn't have a restricted list. MetastoreConf doesn't have a restricted list because that functionality is broken. setVar* doesn't check against the restricted list. Given that MetastoreConf is a set of static convenience methods to be used on top of Configuration we can't stop users from going underneath and calling set() directly anyway. If we want to restrict users from setting certain values in the MetastoreConf we need a comprehensive and secure way to do it. Plus I'm not convinced that boncep and hikari settings are high security issues anyway. You can merge this pull request into a Git repository by running: $ git pull https://github.com/alanfgates/hive hive17561 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/253.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #253 commit 305c8f27e884c94faad34a350ee1848cdd5f Author: Alan Gates <ga...@hortonworks.com> Date: 2017-08-04T20:02:03Z WIP, tests don't pass yet. I think I've moved all the files. commit 21523f3dfd0666a3ef68558a392df14c0bf80eb0 Author: Alan Gates <alanfga...@gmail.com> Date: 2017-09-20T06:01:25Z Moved SQLGenerator since it was newly created. I did not move the functionality that added bonecp and hikari to the restricted list in HiveConf, because there is no restricted list in MetastoreConf. There's no restricted list because the HiveConf implementation is completely broken. It isn't checked when a setVar call is made, so it's easy to end run around. If we want to figure out ways to restrict what values users can set at runtime we need to do it in a coherent and complete way. ---
[GitHub] hive pull request #252: HIVE-17537 Moved Warehouse to standalone.
GitHub user alanfgates opened a pull request: https://github.com/apache/hive/pull/252 HIVE-17537 Moved Warehouse to standalone. You can merge this pull request into a Git repository by running: $ git pull https://github.com/alanfgates/hive hive17537 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/252.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #252 commit 59da41ddf311d3f335c7854194af96c9e6ec9413 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-08-02T19:35:07Z Moved ReplChangeManager Moved Warehouse to standalone. ---
[GitHub] hive pull request #247: HIVE-17506 Moved standalone-metastore out from under...
GitHub user alanfgates opened a pull request: https://github.com/apache/hive/pull/247 HIVE-17506 Moved standalone-metastore out from under Hive pom to its own top lev⦠â¦el pom. You can merge this pull request into a Git repository by running: $ git pull https://github.com/alanfgates/hive hive17506 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/247.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #247 commit 9374a05dfa57470d7b986e875485670f8ce73276 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-09-11T22:03:22Z Moved standalone-metastore out from under Hive pom to its own top level pom. ---
[GitHub] hive pull request #244: HIVE-17488 Move first set of metastore objects to st...
GitHub user alanfgates opened a pull request: https://github.com/apache/hive/pull/244 HIVE-17488 Move first set of metastore objects to standalone-metastore You can merge this pull request into a Git repository by running: $ git pull https://github.com/alanfgates/hive hive17488 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/244.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #244 commit 6914a81f9b65f127cd9fc40f66ac8a7b663ed89b Author: Alan Gates <ga...@hortonworks.com> Date: 2017-07-25T21:18:11Z Moved TableType commit 100e59af9bb03311b1dde284f0e8a8f046374e43 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-07-25T21:40:57Z Moved HiveMetaHook, HiveMetaHookLoader, and DefaultHiveMetaHook commit 0c0a921a5f7ef20192d8d3e320cc0fa66c0e675f Author: Alan Gates <ga...@hortonworks.com> Date: 2017-07-25T21:50:55Z Moved IExtrapolatePartStatus and LinearExtrapolatePartStatus commit f1eca5fec96926d44d4355b144359f159e0f7057 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-07-25T21:59:44Z Moved IHMSHandler commit 803cec349fe3d487381fcc4c1af57fca22e3f7d7 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-07-27T21:44:05Z Moved Annotations. commit 2b56157f60990e9f94ce3b1ad8d020d75e776815 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-07-25T22:55:56Z Moved MetaStoreFilterHook and DefaultMetaStoreFilterHookImpl. Since they took HiveConf in the constructor this did force a constructor change. commit d40a78e45eefb265c45ba25302a320073b247446 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-07-25T23:08:06Z Moved PartitionSpecProxy and its subclasses. commit 9612ba2a1ff2d5117df8d8ab8eeb970890638b19 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-07-27T22:10:24Z Moved JDOConnectionURLHook commit 18f80e23d53854b5ae327fd65dd1ace93fed8a72 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-07-27T22:18:55Z Moved TServerSocketKeepAlive commit c8991bab89fec5a3404238223913d18d86142d68 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-07-27T22:28:30Z Moved PartitionDropOptions commit c8c5389d14c10f1cbe6bf362a159c9efe99f2293 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-07-27T22:37:56Z Moved MetaStoreEndFunctionContext and MetaStoreEndFunctionListener commit b3d4d52f2d804b71ab8913a9ee7b810e8fa5d22b Author: Alan Gates <ga...@hortonworks.com> Date: 2017-07-27T23:10:00Z Moved MetaStoreFS and HiveMetaStoreFsImpl. Created FileUtils and MetaStoreUtils and copied a couple of files out of the corresponding classes in other packages. commit 478c3d5afab83cd016f95a92387d10561b1329b6 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-07-27T23:19:56Z Moved DatabaseProduct commit 5fc0b72bb17cbe557ffaf11229c6e4ef18aa6a20 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-07-28T00:00:13Z Moved HiveMetaException commit a827a7ae3e890740b245ee383f1a1730b3988ef1 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-07-28T13:40:14Z Moved AggregateStatsCache commit cc371862e380f66b7cb1bdaf74d9470c47f8ff10 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-07-28T13:52:13Z Moved LockComponentBuilder, LockRequestBuilder, and TestLockRequestBuilder commit 2f4a537445d0aef4d5862d6f3e0c65bb522fa4e6 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-07-28T14:53:47Z Moved MetaStoreThread. This required switching it from HiveConf to Configuration, which trickled down to the compactor threads themselves. commit 10fd1c7f06ea3775a381f97b52eccd442eea2d1a Author: Alan Gates <ga...@hortonworks.com> Date: 2017-07-28T18:34:26Z Copied in HiveVersionAnnotation, HiveVersionInfo, and saveVersion.sh from common and switched MetaStoreSchemaInfo to use the new Metastore versions of these files. commit 83b4f138ff233325e407f520ebc2a8bd10494e1e Author: Alan Gates <ga...@hortonworks.com> Date: 2017-07-28T20:31:36Z Moved IMetaStoreSchemaInfo, MetaStoreSchemaInfo, MetaStoreSchemaInfoFactory, TestMetaStoreSchemaFactory, and TestMetaStoreSchemaInfo. commit 34877b4c8a469b589f659209d67b8ba16d5a3030 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-07-28T21:00:35Z Moved MetaStoreInit. Created JavaUtils but only copied over the method used. commit 2a52f6b6289011c6759a1b466368fc6db9e04bb3 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-08-17T23:59:34Z Fixed compilation errors. commit 58478570539c6484be1fd0f43c464356f713abd4 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-08-22T22:53:14Z Moved PartitionExpressionProxy. commit 2414722f42dcbd5b6b11c2603c972782d7f0b5cb Author: Alan Gates <ga...@hortonworks.com> Date: 2
[GitHub] hive pull request #239: HIVE-17359 Split out the typeinfo
GitHub user alanfgates opened a pull request: https://github.com/apache/hive/pull/239 HIVE-17359 Split out the typeinfo I took the approach of duplicating the necessary parts of TypeInfo on the metastore side. Note that this does not solve the SerDe used by HiveMetaStore.get_fields_with_environment_context. We'll solve that separately. You can merge this pull request into a Git repository by running: $ git pull https://github.com/alanfgates/hive hive17359 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/239.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #239 commit c799a52aeab95542aa5d9eb55dc3987af26f2878 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-08-02T18:38:27Z Removed use of TypeInfo from metastore classes. Added metastore specific type information. commit 1e5e99e897df83bd2384f181797bbd9d4b810179 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-08-17T23:32:41Z Fixed broken compilation in test. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] hive pull request #235: HIVE-17307 Change the metastore to not use the metri...
GitHub user alanfgates opened a pull request: https://github.com/apache/hive/pull/235 HIVE-17307 Change the metastore to not use the metrics code in hive/common You can merge this pull request into a Git repository by running: $ git pull https://github.com/alanfgates/hive hive17307 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/235.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #235 commit 72fd3e7232a44655dc7471a61729c4a1abf49c26 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-08-01T16:57:32Z Implemented metrics in standalone-metastore. Ported existing metastore classes to use them. commit 201b16defbad4076495553fe127ae7c79e08804b Author: Alan Gates <ga...@hortonworks.com> Date: 2017-08-01T16:58:52Z Adding pom file I missed in the previous checkin. commit b310893a5f8400085919e313b58723a10fb18c88 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-08-01T18:36:36Z Copied JvmPauseMonitor into standalone-metastore commit 3a8080c6c9cfe77cc0d9561ab5f65d4d4298d5d3 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-08-01T20:43:14Z Copied PerfLogger into the standalone metastore and moved RetryingHMSHandler to use it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] hive pull request #228: HIVE-17241 Removed shims from metastore. For HDFS an...
GitHub user alanfgates opened a pull request: https://github.com/apache/hive/pull/228 HIVE-17241 Removed shims from metastore. For HDFS and getPassword I just access⦠⦠those operations directly. I copied all of the HadoopThriftAuthBridge stuff over from Hive common. You can merge this pull request into a Git repository by running: $ git pull https://github.com/alanfgates/hive hive17241 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/228.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #228 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] hive pull request #220: HIVE-17224 Moved all the JDO classes and package.jdo
Github user alanfgates closed the pull request at: https://github.com/apache/hive/pull/220 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] hive pull request #220: HIVE-17224 Moved all the JDO classes and package.jdo
GitHub user alanfgates opened a pull request: https://github.com/apache/hive/pull/220 HIVE-17224 Moved all the JDO classes and package.jdo You can merge this pull request into a Git repository by running: $ git pull https://github.com/alanfgates/hive hive17224 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/220.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #220 commit cd70b9ce7798251d5dd8b247bba0fb8211ebce40 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-07-27T21:27:57Z Moved all the JDO classes and package.jdo --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] hive pull request #210: HIVE-17168 Create separate module for stand alone me...
Github user alanfgates closed the pull request at: https://github.com/apache/hive/pull/210 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] hive pull request #211: HIVE-17167 Create metastore specific configuration t...
Github user alanfgates closed the pull request at: https://github.com/apache/hive/pull/211 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] hive pull request #216: HIVE-17170 Move thrift generated code to stand alone...
Github user alanfgates closed the pull request at: https://github.com/apache/hive/pull/216 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] hive pull request #218: HIVE-17234
GitHub user alanfgates opened a pull request: https://github.com/apache/hive/pull/218 HIVE-17234 This patch removes all of the unused parts of HBase metastore. The aggregate stats work is kept, and moves into directories that match the already changed packages. Two methods that were still used from HBaseUtils move into MetaStoreUtils. FileMetadata remains in the hbase package, since I believe Sergey wants to use it sometime in the future. You can merge this pull request into a Git repository by running: $ git pull https://github.com/alanfgates/hive hive17234 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/218.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #218 commit 6afb3e1335e3541b6775a58d00b383cc36024d18 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-08-03T00:12:09Z HIVE-17234 Remove HBase metastore from master commit fbce5296c95f38bb56ff2ba3a670f02533ed6661 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-08-03T00:32:59Z Removed one more file I missed previously. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] hive pull request #216: HIVE-17170 Move thrift generated code to stand alone...
GitHub user alanfgates opened a pull request: https://github.com/apache/hive/pull/216 HIVE-17170 Move thrift generated code to stand alone metastore You can merge this pull request into a Git repository by running: $ git pull https://github.com/alanfgates/hive hive17170 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/216.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #216 commit ffd8599cd3db1cbb0464606901dc6f73916bdc69 Author: Alan Gates <ga...@hortonworks.com> Date: 2017-07-25T20:50:38Z HIVE-17170 Move thrift generated code to stand alone metastore --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] hive pull request #211: HIVE-17167 Create metastore specific configuration t...
GitHub user alanfgates opened a pull request: https://github.com/apache/hive/pull/211 HIVE-17167 Create metastore specific configuration tool You can merge this pull request into a Git repository by running: $ git pull https://github.com/alanfgates/hive hive17167 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/211.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #211 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] hive pull request #210: HIVE-17168 Create separate module for stand alone me...
GitHub user alanfgates opened a pull request: https://github.com/apache/hive/pull/210 HIVE-17168 Create separate module for stand alone metastore You can merge this pull request into a Git repository by running: $ git pull https://github.com/alanfgates/hive hive17168 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/210.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #210 commit 01e46ba1729ee8e66545f2bc6c52d567e1ba4a3a Author: Alan Gates <ga...@hortonworks.com> Date: 2017-07-25T17:10:22Z HIVE-17168 Create separate module for stand alone metastore --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] hive pull request: Hbase metastore
GitHub user alanfgates opened a pull request: https://github.com/apache/hive/pull/46 Hbase metastore HIVE-11294 Cache aggregated stats in hbase You can merge this pull request into a Git repository by running: $ git pull https://github.com/alanfgates/hive hbase-metastore Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/46.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #46 commit 58ca965ca58925e4846e14cf37d64638edb3e353 Author: Alan Gates ga...@apache.org Date: 2015-01-23T19:05:19Z Creating branch for hbase metastore development. git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1654331 13f79535-47bb-0310-9956-ffa450edef68 commit e81704eeaf061e7152c63379b828debdfdfe9a8e Author: Alan Gates ga...@apache.org Date: 2015-02-04T20:00:49Z HIVE-9453 Initial patch [hbase-metastore branch] (Alan Gates, reviewed by Thejas Nair) git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1657394 13f79535-47bb-0310-9956-ffa450edef68 commit 120047c308a011f17f94258779e4c47fcff191a5 Author: Alan Gates ga...@apache.org Date: 2015-02-10T21:41:19Z HIVE-9578 Add support for getDatabases and alterDatabase calls [hbase-metastore branch] git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1658821 13f79535-47bb-0310-9956-ffa450edef68 commit c7dcf4a85d5cef4151d7b72115b4a1027af488ac Author: Alan Gates ga...@apache.org Date: 2015-02-10T22:47:53Z HIVE-9579 Support all get tables [hbase-metastore branch] git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1658829 13f79535-47bb-0310-9956-ffa450edef68 commit cd82601f6e5c4aea5db72b74629b6aada23cf7c2 Author: Alan Gates ga...@apache.org Date: 2015-02-19T18:51:39Z HIVE-9606 Need a tool to export metadata from RDBMS based metastore into HBase [hbase-metastore branch] (Alan Gates, reviewed by Thejas Nair) git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1660974 13f79535-47bb-0310-9956-ffa450edef68 commit 21ba0a93dcadcf8726ae7a18e81f758921552697 Author: Alan Gates ga...@apache.org Date: 2015-03-02T18:17:01Z HIVE-9641 Fill out remaining partition functions in HBaseStore (Alan Gates reviewed by Vaibhav Gumashta) git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1663386 13f79535-47bb-0310-9956-ffa450edef68 commit bb0010caa8734af34ecac7b5b054afd95b49b0e0 Author: Alan Gates ga...@apache.org Date: 2015-03-05T03:46:28Z HIVE-9677 Implement privileges call in HBaseStore (Alan Gates) git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1664220 13f79535-47bb-0310-9956-ffa450edef68 commit 408d467bffa0923714b8262427f1d1d72ba9932d Author: Alan Gates ga...@apache.org Date: 2015-03-05T04:09:31Z HIVE-9763 Remove M* classes from RawStore interface (Alan Gates) git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1664226 13f79535-47bb-0310-9956-ffa450edef68 commit be575b84a8d5b4764550499c60bdccb7b0d1f82f Author: Alan Gates ga...@apache.org Date: 2015-03-05T04:35:53Z HIVE-9802 Refactor HBaseReadWrite to allow different implementations underneath, also includes code from HIVE-9783 Move serialization of objects in HBase to protocol buffers (Alan Gates) git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1664227 13f79535-47bb-0310-9956-ffa450edef68 commit 646468fcdfd612524961751ba3575a26a1fb3fcb Author: Alan Gates ga...@apache.org Date: 2015-03-12T19:41:56Z HIVE-9885 HBase metastore protobufs need to check hasX() functions for values that are not auto set in serialization [hbase-metastore branch] (Alan Gates) git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1666280 13f79535-47bb-0310-9956-ffa450edef68 commit d268b81bcd2fbaae6fdbfe2f980f644ce5e3d92d Author: Alan Gates ga...@apache.org Date: 2015-03-12T20:01:30Z HIVE-9874 Partition storage descriptors being set from table sd without copying [hbase-metastore branch] (Alan Gates) git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1666285 13f79535-47bb-0310-9956-ffa450edef68 commit 24f224867b70bacc91a877242aee1b0b84efd127 Author: Alan Gates ga...@apache.org Date: 2015-03-17T15:50:31Z HIVE-9942 Implement functions methods in HBaseStore (Alan Gates) git-svn-id: https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1667338 13f79535-47bb-0310-9956-ffa450edef68 commit 35ac8b0257614523064c1b3647a91e123b78e999 Author: Alan Gates ga...@apache.org Date: 2015-03-18T17:41:50Z HIVE-10008 Need to refactor itests for hbase metastore (Alan