This is an automated email from the ASF dual-hosted git repository.
ngangam pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hive.git.
from 46ddd5a HIVE-24895. Add a DataCopyEnd stage in ReplStateLogTask for
external table replication. (#2083)(Ayush Saxena, reviewed by Pravin Kumar
Sinha, Aasha Medhi)
new 69e5417 External metastore: clean after rebase
new 87c74ec Adding DDL support for connectors
(create/drop/show/desc/alter)
new d65307d Implemented getTable and getTableNames for MYSQL (working)
new 91f1ccd Added provider for postgres, refactored bunch of classes
new 80013b4 Deleted commented out code and fixed location and IO classes
new 0b9a4f4 HIVE-24396: Build failure in itests due to unimplemented
interface methods
new c6ed378 NullPointerException in CreateDatabaseOperation due to last
change
new 013a693 Adding a qtest and fixing type for default db
new b30173d Adding schema changes for mysql and postgres as well
new 1523cd4 HIVE-24396: getTable/getTables API not expected to throw
NoSuchObjectException
new 7d91a9a HIVE-24396: Added schema changes for Oracle Made
DBS.TYPE NOT NULL in all scripts Added Type support to
DatabaseBuilder Added Unit test for DataConnector Added
Unit test REMOTE Database Fixed test failures in
TestSchemaToolForMetaStore
new 6369daa Missed change from the rebase
new 7504491 HIVE-24396: Fix for drop database for remote databases
new 683d0ae HIVE-24396: qtest failures, regenerate them because of new
columns
new df8cb11 HIVE-24396: Follow up test failure fixes
new a2a592f Test failures with tez driver and duplicate error codes
new 3de6032 HIVE-24396: refactored code to Abstract class and providers
share common code
new 23aafb7 Build issue with EventMessage
new d66d5fc fix for 2 additional test failures
new 0b60db9 Retain case on table names during query processing
new 9937963 HIVE-24396 Moving create/drop/alter APIs to the interface.
Reverting fix for case sensitivity
new 5a2236e HIVE-24396: Build failure due to duplicate db definitions
new 60ae013 HIVE-24396: Addressing test failures
new 3e41782 HIVE-24396: Unhandled longvarchar and integer types for derby
new 4779e86 HIVE-24396: Fix to CachedStore to make DBs NATIVE and fix to
create_table_core on null DBs
new 5c98e30 HIVE-24396: get_table_core() to return null instead of
exception
new 4319d29 HIVE-24396: Fix in connector provider to return null instead
of blank Table
new 2b4fa4e HIVE-24396: Database name for remote table should be set to
hive dbname not the scoped dbname
new 506621c HIVE-24396: Fix for NPE in get_database_core with null
catalog name
new d7a8eb7 HIVE-24396: Some changes with formatters after the rebase
(Naveen Gangam)
new 5f5ec66 HIVE-24396: Duplicate SQL statements in derby upgrade script
(Naveen Gangam)
new b9150e1 HIVE-24396: Incorporating feedback from the initial review
(Naveen Gangam)
new 14283d3 HIVE-24396: Cleanup and one test failure (Naveen Gangam)
new 07ebf02 HIVE-24396: qtest failure (Naveen Gangam)
new 53edee9 HIVE-24396: Changes from additional feedback from code review
(Naveen Gangam)
new cd90398 HIVE-24396: Conflict from rebase to master
new 34720cf HIVE-24396: Remaining comments from the feedback (Naveen
Gangam)
new 2eb0e00 HIVE-24396: Additional feedback incorporated (Naveen Gangam)
Removed ReplicationSpec for connectors Notification
event for alter connector removed some code.
The 38 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../java/org/apache/hadoop/hive/ql/ErrorMsg.java | 3 +
.../hcatalog/listener/DummyRawStoreFailEvent.java | 27 +
.../hadoop/hive/ql/parse/AlterClauseParser.g | 31 +
.../apache/hadoop/hive/ql/parse/CreateDDLParser.g | 42 +
.../apache/hadoop/hive/ql/parse/HiveLexerParent.g | 6 +
.../org/apache/hadoop/hive/ql/parse/HiveParser.g | 35 +-
.../hadoop/hive/ql/parse/IdentifiersParser.g | 8 +-
pom.xml | 3 +
.../database/create/CreateDatabaseAnalyzer.java | 37 +-
.../ql/ddl/database/create/CreateDatabaseDesc.java | 41 +-
.../database/create/CreateDatabaseOperation.java | 24 +-
.../ql/ddl/database/desc/DescDatabaseDesc.java | 6 +-
.../ddl/database/desc/DescDatabaseFormatter.java | 23 +-
.../ddl/database/desc/DescDatabaseOperation.java | 27 +-
.../alter/AbstractAlterDataConnectorAnalyzer.java | 42 +
.../alter/AbstractAlterDataConnectorDesc.java | 30 +-
.../alter/AbstractAlterDataConnectorOperation.java | 55 +
.../owner/AlterDataConnectorSetOwnerAnalyzer.java | 54 +
.../owner/AlterDataConnectorSetOwnerDesc.java | 44 +
.../owner/AlterDataConnectorSetOwnerOperation.java | 28 +-
.../AlterDataConnectorSetPropertiesAnalyzer.java | 57 +
.../AlterDataConnectorSetPropertiesDesc.java | 45 +
.../AlterDataConnectorSetPropertiesOperation.java | 50 +
.../url/AlterDataConnectorSetUrlAnalyzer.java | 45 +
.../alter/url/AlterDataConnectorSetUrlDesc.java | 30 +-
.../url/AlterDataConnectorSetUrlOperation.java | 59 +
.../create/CreateDataConnectorAnalyzer.java} | 52 +-
.../create/CreateDataConnectorDesc.java} | 54 +-
.../create/CreateDataConnectorOperation.java | 71 +
.../desc/DescDataConnectorAnalyzer.java | 61 +
.../desc/DescDataConnectorDesc.java} | 32 +-
.../desc/DescDataConnectorFormatter.java} | 58 +-
.../desc/DescDataConnectorOperation.java} | 30 +-
.../drop/DropDataConnectorAnalyzer.java | 58 +
.../dataconnector/drop/DropDataConnectorDesc.java | 51 +
.../drop/DropDataConnectorOperation.java | 45 +
.../show/ShowDataConnectorsAnalyzer.java | 57 +
.../dataconnector/show/ShowDataConnectorsDesc.java | 54 +
.../show/ShowDataConnectorsFormatter.java | 69 +
.../show/ShowDataConnectorsOperation.java | 67 +
.../org/apache/hadoop/hive/ql/hooks/Entity.java | 33 +-
.../apache/hadoop/hive/ql/hooks/ReadEntity.java | 8 +
.../apache/hadoop/hive/ql/hooks/WriteEntity.java | 6 +
.../org/apache/hadoop/hive/ql/metadata/Hive.java | 109 +-
.../hadoop/hive/ql/parse/BaseSemanticAnalyzer.java | 18 +
.../apache/hadoop/hive/ql/plan/HiveOperation.java | 8 +
.../hive/ql/security/authorization/Privilege.java | 3 +
.../authorization/plugin/HiveOperationType.java | 7 +
.../plugin/sqlstd/Operation2Privilege.java | 8 +
ql/src/test/queries/clientpositive/dataconnector.q | 71 +
.../clientpositive/beeline/escape_comments.q.out | 4 +-
.../llap/alter_change_db_location.q.out | 2 +-
.../clientpositive/llap/alter_db_owner.q.out | 6 +-
.../llap/authorization_owner_actions_db.q.out | 2 +-
.../clientpositive/llap/database_location.q.out | 5 +-
.../clientpositive/llap/database_properties.q.out | 6 +-
.../clientpositive/llap/dataconnector.q.out | 205 +
.../clientpositive/llap/db_ddl_explain.q.out | 3 +-
.../clientpositive/llap/describe_database.q.out | 6 +-
.../clientpositive/llap/unicode_comments.q.out | 2 +-
.../clientpositive/tez/explainanalyze_3.q.out | 2 +-
.../results/clientpositive/tez/explainuser_3.q.out | 2 +-
standalone-metastore/metastore-common/pom.xml | 1 +
.../src/gen/thrift/gen-cpp/ThriftHiveMetastore.cpp | 8148 ++++++++-----
.../src/gen/thrift/gen-cpp/ThriftHiveMetastore.h | 700 ++
.../ThriftHiveMetastore_server.skeleton.cpp | 25 +
.../gen/thrift/gen-cpp/hive_metastore_types.cpp | 8976 ++++++++------
.../src/gen/thrift/gen-cpp/hive_metastore_types.h | 350 +-
.../hive/metastore/api/AbortTxnsRequest.java | 32 +-
.../hive/metastore/api/AddDynamicPartitions.java | 32 +-
.../api/AllocateTableWriteIdsRequest.java | 68 +-
.../api/AllocateTableWriteIdsResponse.java | 36 +-
.../hive/metastore/api/AlterPartitionsRequest.java | 36 +-
.../hive/metastore/api/AlterTableRequest.java | 32 +-
.../metastore/api/ClearFileMetadataRequest.java | 32 +-
.../hive/metastore/api/ClientCapabilities.java | 36 +-
.../hive/metastore/api/CommitTxnRequest.java | 36 +-
.../hive/metastore/api/CompactionRequest.java | 44 +-
...sponse.java => CreateDataConnectorRequest.java} | 221 +-
.../{Database.java => CreateDatabaseRequest.java} | 555 +-
.../hive/metastore/api/CreateTableRequest.java | 248 +-
.../api/{Database.java => DataConnector.java} | 753 +-
.../apache/hadoop/hive/metastore/api/Database.java | 338 +-
.../hadoop/hive/metastore/api/DatabaseType.java | 43 +
.../hive/metastore/api/ExtendedTableInfo.java | 64 +-
.../hive/metastore/api/FindSchemasByColsResp.java | 36 +-
.../hive/metastore/api/FireEventRequest.java | 32 +-
.../hive/metastore/api/FireEventRequestData.java | 36 +-
.../hive/metastore/api/FireEventResponse.java | 32 +-
.../apache/hadoop/hive/metastore/api/Function.java | 36 +-
.../metastore/api/GetAllFunctionsResponse.java | 36 +-
...lesResult.java => GetDataConnectorRequest.java} | 221 +-
.../hive/metastore/api/GetDatabaseRequest.java | 32 +-
.../hive/metastore/api/GetFieldsResponse.java | 36 +-
.../api/GetFileMetadataByExprRequest.java | 32 +-
.../metastore/api/GetFileMetadataByExprResult.java | 48 +-
.../hive/metastore/api/GetFileMetadataRequest.java | 32 +-
.../hive/metastore/api/GetFileMetadataResult.java | 44 +-
.../metastore/api/GetOpenTxnsInfoResponse.java | 36 +-
.../hive/metastore/api/GetOpenTxnsRequest.java | 36 +-
.../hive/metastore/api/GetOpenTxnsResponse.java | 32 +-
.../metastore/api/GetPartitionNamesPsRequest.java | 32 +-
.../metastore/api/GetPartitionNamesPsResponse.java | 32 +-
.../hive/metastore/api/GetPartitionRequest.java | 32 +-
.../metastore/api/GetPartitionsFilterSpec.java | 32 +-
.../api/GetPartitionsPsWithAuthRequest.java | 64 +-
.../api/GetPartitionsPsWithAuthResponse.java | 36 +-
.../hive/metastore/api/GetPartitionsRequest.java | 64 +-
.../hive/metastore/api/GetPartitionsResponse.java | 36 +-
.../hive/metastore/api/GetProjectionsSpec.java | 32 +-
.../hive/metastore/api/GetSchemaResponse.java | 36 +-
.../hadoop/hive/metastore/api/GetTableRequest.java | 32 +-
.../hive/metastore/api/GetTablesExtRequest.java | 32 +-
.../hive/metastore/api/GetTablesRequest.java | 64 +-
.../hadoop/hive/metastore/api/GetTablesResult.java | 36 +-
.../metastore/api/GetValidWriteIdsRequest.java | 32 +-
.../metastore/api/GetValidWriteIdsResponse.java | 36 +-
.../metastore/api/HeartbeatTxnRangeResponse.java | 64 +-
.../hive/metastore/api/InsertEventRequestData.java | 128 +-
.../hadoop/hive/metastore/api/LockRequest.java | 36 +-
.../metastore/api/NotificationEventRequest.java | 32 +-
.../metastore/api/NotificationEventResponse.java | 36 +-
.../hadoop/hive/metastore/api/OpenTxnRequest.java | 32 +-
.../hive/metastore/api/OpenTxnsResponse.java | 32 +-
.../hive/metastore/api/PartitionsResponse.java | 36 +-
.../hive/metastore/api/PutFileMetadataRequest.java | 64 +-
.../hive/metastore/api/RenamePartitionRequest.java | 32 +-
.../hadoop/hive/metastore/api/ReplLastIdInfo.java | 32 +-
.../metastore/api/ReplTblWriteIdStateRequest.java | 32 +-
.../hive/metastore/api/ReplicationMetricList.java | 36 +-
.../hadoop/hive/metastore/api/SchemaVersion.java | 36 +-
.../hive/metastore/api/ShowCompactResponse.java | 36 +-
.../hive/metastore/api/ShowLocksResponse.java | 36 +-
.../hive/metastore/api/TableValidWriteIds.java | 32 +-
.../hive/metastore/api/ThriftHiveMetastore.java | 12180 ++++++++++++++-----
.../hive/metastore/api/WMFullResourcePlan.java | 144 +-
.../api/WMGetAllResourcePlanResponse.java | 36 +-
.../api/WMGetTriggersForResourePlanResponse.java | 36 +-
.../api/WMValidateResourcePlanResponse.java | 64 +-
.../metastore/api/WriteNotificationLogRequest.java | 32 +-
.../thrift/gen-php/metastore/AbortTxnsRequest.php | 18 +-
.../gen-php/metastore/AddDynamicPartitions.php | 18 +-
.../metastore/AllocateTableWriteIdsRequest.php | 38 +-
.../metastore/AllocateTableWriteIdsResponse.php | 20 +-
.../gen-php/metastore/AlterPartitionsRequest.php | 20 +-
.../thrift/gen-php/metastore/AlterTableRequest.php | 18 +-
.../gen-php/metastore/ClearFileMetadataRequest.php | 18 +-
.../gen-php/metastore/ClientCapabilities.php | 18 +-
.../thrift/gen-php/metastore/CommitTxnRequest.php | 20 +-
.../thrift/gen-php/metastore/CompactionRequest.php | 26 +-
...Response.php => CreateDataConnectorRequest.php} | 49 +-
.../{Database.php => CreateDatabaseRequest.php} | 98 +-
.../gen-php/metastore/CreateTableRequest.php | 138 +-
.../metastore/{Database.php => DataConnector.php} | 165 +-
.../src/gen/thrift/gen-php/metastore/Database.php | 72 +
.../gen/thrift/gen-php/metastore/DatabaseType.php | 30 +
.../thrift/gen-php/metastore/ExtendedTableInfo.php | 36 +-
.../gen-php/metastore/FindSchemasByColsResp.php | 20 +-
.../thrift/gen-php/metastore/FireEventRequest.php | 18 +-
.../gen-php/metastore/FireEventRequestData.php | 20 +-
.../thrift/gen-php/metastore/FireEventResponse.php | 18 +-
.../src/gen/thrift/gen-php/metastore/Function.php | 20 +-
.../gen-php/metastore/GetAllFunctionsResponse.php | 20 +-
...apabilities.php => GetDataConnectorRequest.php} | 48 +-
.../gen-php/metastore/GetDatabaseRequest.php | 18 +-
.../thrift/gen-php/metastore/GetFieldsResponse.php | 20 +-
.../metastore/GetFileMetadataByExprRequest.php | 18 +-
.../metastore/GetFileMetadataByExprResult.php | 28 +-
.../gen-php/metastore/GetFileMetadataRequest.php | 18 +-
.../gen-php/metastore/GetFileMetadataResult.php | 26 +-
.../gen-php/metastore/GetOpenTxnsInfoResponse.php | 20 +-
.../gen-php/metastore/GetOpenTxnsRequest.php | 18 +-
.../gen-php/metastore/GetOpenTxnsResponse.php | 18 +-
.../metastore/GetPartitionNamesPsRequest.php | 18 +-
.../metastore/GetPartitionNamesPsResponse.php | 18 +-
.../gen-php/metastore/GetPartitionRequest.php | 18 +-
.../gen-php/metastore/GetPartitionsFilterSpec.php | 18 +-
.../metastore/GetPartitionsPsWithAuthRequest.php | 36 +-
.../metastore/GetPartitionsPsWithAuthResponse.php | 20 +-
.../gen-php/metastore/GetPartitionsRequest.php | 36 +-
.../gen-php/metastore/GetPartitionsResponse.php | 20 +-
.../gen-php/metastore/GetProjectionsSpec.php | 18 +-
.../thrift/gen-php/metastore/GetSchemaResponse.php | 20 +-
.../thrift/gen-php/metastore/GetTableRequest.php | 18 +-
.../gen-php/metastore/GetTablesExtRequest.php | 18 +-
.../thrift/gen-php/metastore/GetTablesRequest.php | 36 +-
.../thrift/gen-php/metastore/GetTablesResult.php | 20 +-
.../gen-php/metastore/GetValidWriteIdsRequest.php | 18 +-
.../gen-php/metastore/GetValidWriteIdsResponse.php | 20 +-
.../metastore/HeartbeatTxnRangeResponse.php | 36 +-
.../gen-php/metastore/InsertEventRequestData.php | 72 +-
.../gen/thrift/gen-php/metastore/LockRequest.php | 20 +-
.../gen-php/metastore/NotificationEventRequest.php | 18 +-
.../metastore/NotificationEventResponse.php | 20 +-
.../thrift/gen-php/metastore/OpenTxnRequest.php | 18 +-
.../thrift/gen-php/metastore/OpenTxnsResponse.php | 18 +-
.../gen-php/metastore/PartitionsResponse.php | 20 +-
.../gen-php/metastore/PutFileMetadataRequest.php | 36 +-
.../gen-php/metastore/RenamePartitionRequest.php | 18 +-
.../thrift/gen-php/metastore/ReplLastIdInfo.php | 18 +-
.../metastore/ReplTblWriteIdStateRequest.php | 18 +-
.../gen-php/metastore/ReplicationMetricList.php | 20 +-
.../gen/thrift/gen-php/metastore/SchemaVersion.php | 20 +-
.../gen-php/metastore/ShowCompactResponse.php | 20 +-
.../thrift/gen-php/metastore/ShowLocksResponse.php | 20 +-
.../gen-php/metastore/TableValidWriteIds.php | 18 +-
.../metastore/ThriftHiveMetastoreClient.php | 321 +
.../gen-php/metastore/ThriftHiveMetastoreIf.php | 35 +
.../ThriftHiveMetastore_add_partitions_args.php | 20 +-
...riftHiveMetastore_add_partitions_pspec_args.php | 20 +-
...riftHiveMetastore_alter_dataconnector_args.php} | 65 +-
...ftHiveMetastore_alter_dataconnector_result.php} | 50 +-
.../ThriftHiveMetastore_alter_partitions_args.php | 20 +-
...er_partitions_with_environment_context_args.php | 20 +-
.../ThriftHiveMetastore_append_partition_args.php | 18 +-
...end_partition_with_environment_context_args.php | 18 +-
...iftHiveMetastore_create_dataconnector_args.php} | 49 +-
...tHiveMetastore_create_dataconnector_result.php} | 84 +-
...etastore_create_table_with_constraints_args.php | 120 +-
...hriftHiveMetastore_drop_dataconnector_args.php} | 92 +-
...iftHiveMetastore_drop_dataconnector_result.php} | 80 +-
.../ThriftHiveMetastore_drop_partition_args.php | 18 +-
...rop_partition_with_environment_context_args.php | 18 +-
...ThriftHiveMetastore_exchange_partition_args.php | 26 +-
...hriftHiveMetastore_exchange_partitions_args.php | 26 +-
...iftHiveMetastore_exchange_partitions_result.php | 20 +-
...iveMetastore_find_columns_with_stats_result.php | 18 +-
...hriftHiveMetastore_get_all_databases_result.php | 18 +-
...erialized_view_objects_for_rewriting_result.php | 20 +-
...ThriftHiveMetastore_get_all_packages_result.php | 18 +-
...eMetastore_get_all_stored_procedures_result.php | 18 +-
.../ThriftHiveMetastore_get_all_tables_result.php | 18 +-
...eMetastore_get_all_token_identifiers_result.php | 18 +-
.../ThriftHiveMetastore_get_databases_result.php | 18 +-
...ftHiveMetastore_get_dataconnector_req_args.php} | 49 +-
...HiveMetastore_get_dataconnector_req_result.php} | 39 +-
...ThriftHiveMetastore_get_dataconnectors_args.php | 68 +
...iftHiveMetastore_get_dataconnectors_result.php} | 24 +-
.../ThriftHiveMetastore_get_fields_result.php | 20 +-
..._get_fields_with_environment_context_result.php | 20 +-
.../ThriftHiveMetastore_get_functions_result.php | 18 +-
.../ThriftHiveMetastore_get_master_keys_result.php | 18 +-
...get_materialized_views_for_rewriting_result.php | 18 +-
...veMetastore_get_part_specs_by_filter_result.php | 20 +-
.../ThriftHiveMetastore_get_partition_args.php | 18 +-
...ftHiveMetastore_get_partition_names_ps_args.php | 18 +-
...HiveMetastore_get_partition_names_ps_result.php | 18 +-
...iveMetastore_get_partition_names_req_result.php | 18 +-
...iftHiveMetastore_get_partition_names_result.php | 18 +-
...tHiveMetastore_get_partition_with_auth_args.php | 36 +-
...veMetastore_get_partitions_by_filter_result.php | 20 +-
...tHiveMetastore_get_partitions_by_names_args.php | 18 +-
...iveMetastore_get_partitions_by_names_result.php | 20 +-
.../ThriftHiveMetastore_get_partitions_ps_args.php | 18 +-
...hriftHiveMetastore_get_partitions_ps_result.php | 20 +-
...eMetastore_get_partitions_ps_with_auth_args.php | 36 +-
...etastore_get_partitions_ps_with_auth_result.php | 20 +-
...ftHiveMetastore_get_partitions_pspec_result.php | 20 +-
.../ThriftHiveMetastore_get_partitions_result.php | 20 +-
...HiveMetastore_get_partitions_with_auth_args.php | 18 +-
...veMetastore_get_partitions_with_auth_result.php | 20 +-
.../ThriftHiveMetastore_get_privilege_set_args.php | 18 +-
.../ThriftHiveMetastore_get_role_names_result.php | 18 +-
...hriftHiveMetastore_get_runtime_stats_result.php | 20 +-
...iveMetastore_get_schema_all_versions_result.php | 20 +-
.../ThriftHiveMetastore_get_schema_result.php | 20 +-
..._get_schema_with_environment_context_result.php | 20 +-
.../ThriftHiveMetastore_get_table_meta_args.php | 18 +-
.../ThriftHiveMetastore_get_table_meta_result.php | 20 +-
...eMetastore_get_table_names_by_filter_result.php | 18 +-
...iveMetastore_get_table_objects_by_name_args.php | 18 +-
...eMetastore_get_table_objects_by_name_result.php | 20 +-
...riftHiveMetastore_get_tables_by_type_result.php | 18 +-
.../ThriftHiveMetastore_get_tables_ext_result.php | 20 +-
.../ThriftHiveMetastore_get_tables_result.php | 18 +-
.../ThriftHiveMetastore_get_type_all_result.php | 28 +-
...iveMetastore_isPartitionMarkedForEvent_args.php | 26 +-
.../ThriftHiveMetastore_list_privileges_result.php | 20 +-
.../ThriftHiveMetastore_list_roles_result.php | 20 +-
...iftHiveMetastore_markPartitionForEvent_args.php | 26 +-
...re_partition_name_has_valid_characters_args.php | 18 +-
...HiveMetastore_partition_name_to_spec_result.php | 26 +-
...HiveMetastore_partition_name_to_vals_result.php | 18 +-
.../ThriftHiveMetastore_rename_partition_args.php | 18 +-
.../metastore/ThriftHiveMetastore_set_ugi_args.php | 18 +-
.../ThriftHiveMetastore_set_ugi_result.php | 18 +-
.../ThriftHiveMetastore_truncate_table_args.php | 18 +-
.../gen-php/metastore/WMFullResourcePlan.php | 80 +-
.../metastore/WMGetAllResourcePlanResponse.php | 20 +-
.../WMGetTriggersForResourePlanResponse.php | 20 +-
.../metastore/WMValidateResourcePlanResponse.php | 36 +-
.../metastore/WriteNotificationLogRequest.php | 18 +-
.../hive_metastore/ThriftHiveMetastore-remote | 35 +
.../gen-py/hive_metastore/ThriftHiveMetastore.py | 3066 +++--
.../src/gen/thrift/gen-py/hive_metastore/ttypes.py | 1645 ++-
.../src/gen/thrift/gen-rb/hive_metastore_types.rb | 134 +-
.../src/gen/thrift/gen-rb/thrift_hive_metastore.rb | 331 +
.../hadoop/hive/metastore/HiveMetaStoreClient.java | 68 +
.../hadoop/hive/metastore/IMetaStoreClient.java | 52 +
.../apache/hadoop/hive/metastore/Warehouse.java | 4 +
.../hadoop/hive/metastore/conf/MetastoreConf.java | 10 +
.../hadoop/hive/metastore/utils/FilterUtils.java | 20 +
.../src/main/thrift/hive_metastore.thrift | 54 +-
standalone-metastore/metastore-server/pom.xml | 1 +
.../apache/hadoop/hive/metastore/HMSHandler.java | 447 +-
.../apache/hadoop/hive/metastore/IHMSHandler.java | 12 +
.../hadoop/hive/metastore/MetaStoreDirectSql.java | 14 +-
.../hive/metastore/MetaStoreEventListener.java | 24 +
.../hive/metastore/MetaStoreListenerNotifier.java | 23 +
.../apache/hadoop/hive/metastore/ObjectStore.java | 218 +-
.../org/apache/hadoop/hive/metastore/RawStore.java | 47 +
.../TransactionalMetaStoreEventListener.java | 14 +
.../hadoop/hive/metastore/cache/CachedStore.java | 29 +
.../metastore/client/builder/DatabaseBuilder.java | 33 +
.../AbstractDataConnectorProvider.java | 132 +
.../DataConnectorProviderFactory.java | 89 +
.../dataconnector/IDataConnectorProvider.java | 93 +
.../JDBCConnectorProviderFactory.java | 32 +
.../jdbc/AbstractJDBCConnectorProvider.java | 314 +
.../jdbc/DerbySQLConnectorProvider.java | 86 +
.../dataconnector/jdbc/MySQLConnectorProvider.java | 87 +
.../jdbc/PostgreSQLConnectorProvider.java | 70 +
...ntContext.java => AlterDataConnectorEvent.java} | 61 +-
.../CreateDataConnectorEvent.java} | 32 +-
.../metastore/events/DropDataConnectorEvent.java | 26 +
.../events/PreCreateDataConnectorEvent.java | 24 +
.../hive/metastore/events/PreEventContext.java | 5 +-
.../hive/metastore/messaging/EventMessage.java | 5 +-
.../hive/metastore/messaging/MessageBuilder.java | 3 +
.../model/{MDatabase.java => MDataConnector.java} | 85 +-
.../hadoop/hive/metastore/model/MDatabase.java | 62 +
.../src/main/resources/package.jdo | 45 +-
.../src/main/sql/derby/hive-schema-4.0.0.derby.sql | 11 +-
.../sql/derby/upgrade-3.2.0-to-4.0.0.derby.sql | 11 +
.../src/main/sql/mysql/hive-schema-4.0.0.mysql.sql | 24 +
.../sql/mysql/upgrade-3.2.0-to-4.0.0.mysql.sql | 26 +
.../main/sql/oracle/hive-schema-4.0.0.oracle.sql | 25 +-
.../sql/oracle/upgrade-3.2.0-to-4.0.0.oracle.sql | 25 +
.../sql/postgres/hive-schema-4.0.0.postgres.sql | 25 +-
.../postgres/upgrade-3.2.0-to-4.0.0.postgres.sql | 25 +
.../metastore/DummyRawStoreControlledCommit.java | 32 +-
.../metastore/DummyRawStoreForJdoConnection.java | 54 +-
.../metastore/HiveMetaStoreClientPreCatalog.java | 44 +-
.../hadoop/hive/metastore/TestHiveMetaStore.java | 140 +-
.../hive/metastore/cache/TestCachedStore.java | 1 +
.../schematool/TestSchemaToolForMetastore.java | 18 +-
.../upgrade-3.1.3000-to-4.0.0.postgres.sql | 28 +
standalone-metastore/pom.xml | 1 +
testutils/ptest2/pom.xml | 1 +
349 files changed, 33347 insertions(+), 16740 deletions(-)
create mode 100644
ql/src/java/org/apache/hadoop/hive/ql/ddl/dataconnector/alter/AbstractAlterDataConnectorAnalyzer.java
copy
standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/TransactionalMetaStoreEventListener.java
=>
ql/src/java/org/apache/hadoop/hive/ql/ddl/dataconnector/alter/AbstractAlterDataConnectorDesc.java
(53%)
create mode 100644
ql/src/java/org/apache/hadoop/hive/ql/ddl/dataconnector/alter/AbstractAlterDataConnectorOperation.java
create mode 100644
ql/src/java/org/apache/hadoop/hive/ql/ddl/dataconnector/alter/owner/AlterDataConnectorSetOwnerAnalyzer.java
create mode 100644
ql/src/java/org/apache/hadoop/hive/ql/ddl/dataconnector/alter/owner/AlterDataConnectorSetOwnerDesc.java
copy
standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/TransactionalMetaStoreEventListener.java
=>
ql/src/java/org/apache/hadoop/hive/ql/ddl/dataconnector/alter/owner/AlterDataConnectorSetOwnerOperation.java
(50%)
create mode 100644
ql/src/java/org/apache/hadoop/hive/ql/ddl/dataconnector/alter/properties/AlterDataConnectorSetPropertiesAnalyzer.java
create mode 100644
ql/src/java/org/apache/hadoop/hive/ql/ddl/dataconnector/alter/properties/AlterDataConnectorSetPropertiesDesc.java
create mode 100644
ql/src/java/org/apache/hadoop/hive/ql/ddl/dataconnector/alter/properties/AlterDataConnectorSetPropertiesOperation.java
create mode 100644
ql/src/java/org/apache/hadoop/hive/ql/ddl/dataconnector/alter/url/AlterDataConnectorSetUrlAnalyzer.java
copy
standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/TransactionalMetaStoreEventListener.java
=>
ql/src/java/org/apache/hadoop/hive/ql/ddl/dataconnector/alter/url/AlterDataConnectorSetUrlDesc.java
(50%)
create mode 100644
ql/src/java/org/apache/hadoop/hive/ql/ddl/dataconnector/alter/url/AlterDataConnectorSetUrlOperation.java
copy
ql/src/java/org/apache/hadoop/hive/ql/ddl/{database/create/CreateDatabaseAnalyzer.java
=> dataconnector/create/CreateDataConnectorAnalyzer.java} (61%)
copy
ql/src/java/org/apache/hadoop/hive/ql/ddl/{database/create/CreateDatabaseDesc.java
=> dataconnector/create/CreateDataConnectorDesc.java} (54%)
create mode 100644
ql/src/java/org/apache/hadoop/hive/ql/ddl/dataconnector/create/CreateDataConnectorOperation.java
create mode 100644
ql/src/java/org/apache/hadoop/hive/ql/ddl/dataconnector/desc/DescDataConnectorAnalyzer.java
copy
ql/src/java/org/apache/hadoop/hive/ql/ddl/{database/desc/DescDatabaseDesc.java
=> dataconnector/desc/DescDataConnectorDesc.java} (61%)
copy
ql/src/java/org/apache/hadoop/hive/ql/ddl/{database/desc/DescDatabaseFormatter.java
=> dataconnector/desc/DescDataConnectorFormatter.java} (65%)
copy
ql/src/java/org/apache/hadoop/hive/ql/ddl/{database/desc/DescDatabaseOperation.java
=> dataconnector/desc/DescDataConnectorOperation.java} (59%)
create mode 100644
ql/src/java/org/apache/hadoop/hive/ql/ddl/dataconnector/drop/DropDataConnectorAnalyzer.java
create mode 100644
ql/src/java/org/apache/hadoop/hive/ql/ddl/dataconnector/drop/DropDataConnectorDesc.java
create mode 100644
ql/src/java/org/apache/hadoop/hive/ql/ddl/dataconnector/drop/DropDataConnectorOperation.java
create mode 100644
ql/src/java/org/apache/hadoop/hive/ql/ddl/dataconnector/show/ShowDataConnectorsAnalyzer.java
create mode 100644
ql/src/java/org/apache/hadoop/hive/ql/ddl/dataconnector/show/ShowDataConnectorsDesc.java
create mode 100644
ql/src/java/org/apache/hadoop/hive/ql/ddl/dataconnector/show/ShowDataConnectorsFormatter.java
create mode 100644
ql/src/java/org/apache/hadoop/hive/ql/ddl/dataconnector/show/ShowDataConnectorsOperation.java
create mode 100644 ql/src/test/queries/clientpositive/dataconnector.q
create mode 100644 ql/src/test/results/clientpositive/llap/dataconnector.q.out
copy
standalone-metastore/metastore-common/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/{FireEventResponse.java
=> CreateDataConnectorRequest.java} (55%)
copy
standalone-metastore/metastore-common/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/{Database.java
=> CreateDatabaseRequest.java} (73%)
copy
standalone-metastore/metastore-common/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/{Database.java
=> DataConnector.java} (64%)
create mode 100644
standalone-metastore/metastore-common/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/DatabaseType.java
copy
standalone-metastore/metastore-common/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/{GetTablesResult.java
=> GetDataConnectorRequest.java} (55%)
copy
standalone-metastore/metastore-common/src/gen/thrift/gen-php/metastore/{FireEventResponse.php
=> CreateDataConnectorRequest.php} (56%)
copy
standalone-metastore/metastore-common/src/gen/thrift/gen-php/metastore/{Database.php
=> CreateDatabaseRequest.php} (77%)
copy
standalone-metastore/metastore-common/src/gen/thrift/gen-php/metastore/{Database.php
=> DataConnector.php} (66%)
create mode 100644
standalone-metastore/metastore-common/src/gen/thrift/gen-php/metastore/DatabaseType.php
copy
standalone-metastore/metastore-common/src/gen/thrift/gen-php/metastore/{ClientCapabilities.php
=> GetDataConnectorRequest.php} (53%)
copy
standalone-metastore/metastore-common/src/gen/thrift/gen-php/metastore/{ThriftHiveMetastore_set_ugi_args.php
=> ThriftHiveMetastore_alter_dataconnector_args.php} (55%)
copy
standalone-metastore/metastore-common/src/gen/thrift/gen-php/metastore/{ThriftHiveMetastore_get_partition_names_ps_result.php
=> ThriftHiveMetastore_alter_dataconnector_result.php} (63%)
copy
standalone-metastore/metastore-common/src/gen/thrift/gen-php/metastore/{FireEventResponse.php
=> ThriftHiveMetastore_create_dataconnector_args.php} (56%)
copy
standalone-metastore/metastore-common/src/gen/thrift/gen-php/metastore/{ThriftHiveMetastore_get_partition_names_result.php
=> ThriftHiveMetastore_create_dataconnector_result.php} (64%)
copy
standalone-metastore/metastore-common/src/gen/thrift/gen-php/metastore/{ThriftHiveMetastore_set_ugi_args.php
=> ThriftHiveMetastore_drop_dataconnector_args.php} (52%)
copy
standalone-metastore/metastore-common/src/gen/thrift/gen-php/metastore/{ThriftHiveMetastore_get_partition_names_result.php
=> ThriftHiveMetastore_drop_dataconnector_result.php} (67%)
copy
standalone-metastore/metastore-common/src/gen/thrift/gen-php/metastore/{FireEventResponse.php
=> ThriftHiveMetastore_get_dataconnector_req_args.php} (56%)
copy
standalone-metastore/metastore-common/src/gen/thrift/gen-php/metastore/{ThriftHiveMetastore_get_partition_names_result.php
=> ThriftHiveMetastore_get_dataconnector_req_result.php} (76%)
create mode 100644
standalone-metastore/metastore-common/src/gen/thrift/gen-php/metastore/ThriftHiveMetastore_get_dataconnectors_args.php
copy
standalone-metastore/metastore-common/src/gen/thrift/gen-php/metastore/{ThriftHiveMetastore_get_tables_by_type_result.php
=> ThriftHiveMetastore_get_dataconnectors_result.php} (86%)
create mode 100644
standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/dataconnector/AbstractDataConnectorProvider.java
create mode 100644
standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/dataconnector/DataConnectorProviderFactory.java
create mode 100644
standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/dataconnector/IDataConnectorProvider.java
create mode 100644
standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/dataconnector/JDBCConnectorProviderFactory.java
create mode 100644
standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/dataconnector/jdbc/AbstractJDBCConnectorProvider.java
create mode 100644
standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/dataconnector/jdbc/DerbySQLConnectorProvider.java
create mode 100644
standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/dataconnector/jdbc/MySQLConnectorProvider.java
create mode 100644
standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/dataconnector/jdbc/PostgreSQLConnectorProvider.java
copy
standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/events/{PreEventContext.java
=> AlterDataConnectorEvent.java} (52%)
copy
standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/{TransactionalMetaStoreEventListener.java
=> events/CreateDataConnectorEvent.java} (54%)
create mode 100644
standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/events/DropDataConnectorEvent.java
create mode 100644
standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/events/PreCreateDataConnectorEvent.java
copy
standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/model/{MDatabase.java
=> MDataConnector.java} (53%)
