This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/standalone-metastore/mysql-mysql-connector-java-8.0.28 in repository https://gitbox.apache.org/repos/asf/hive.git
discard 2b29b86d258 Bump mysql-connector-java from 8.0.27 to 8.0.28 in /standalone-metastore add 3e3ff38b652 HIVE-26402: HiveSchemaTool does not honor metastore-site.xml (#3449) (Zhihua Deng, reviewed by Naveen Gangam) add cf347f173a5 HIVE-26452: NPE when converting join to mapjoin and join column referenced more than once (Krisztian Kasa, reviewed by Ayush Saxena, Aman Sinha) add fa111f15008 HIVE-26115: LLAP cache utilization for Iceberg Parquet files (#3480) (Adam Szita, reviewed by Laszlo Pinter) add 5c872d4d4c0 HIVE-26192: JDBC data connector queries occur exception at cbo stage (#3260) add 4714c4dc9f9 HIVE-22193: Graceful shutdown HiveServer2 (#3386) (Zhihua Deng, reviewed by Naveen Gangam) add ec284379cba HIVE-26438: Remove unnecessary optimization in canHandleQbForCbo (Abhay Chennagiri reviewed by John Sherman, Stamatis Zampetakis) add 18501dd2e6f HIVE-24483: aarch64 Support: Bump protobuf version to 3.21.4 (#3498). (Ayush Saxena, reviewed by Stamatis Zampetakis and Sylwester Lachiewicz) add 8ca211f24a0 HIVE-26460: Upgrade Iceberg dependency to 0.14.0 (#3511) (Adam Szita, reviewed by Laszlo Pinter) add 241dfb1c99e HIVE-26458: Add explicit dependency to commons-dbcp2 in hive-exec module (Stamatis Zampetakis, reviewed by Ayush Saxena) add 4cafe1f8b31 HIVE-26196: Integrate Sonar analysis for master branch and PRs (Alessandro Solimando, reviewed by Stamatis Zampetakis, Zoltan Haindrich) add 5a50af46b87 HIVE-26246: Filter out results 'show connectors' on HMS client-side (#3304) add 35cb0a3c204 HIVE-26466: NullPointerException on HiveQueryLifeTimeHook:checkAndRollbackCTAS (Butao Zhang, reviewed by Denys Kuzmenko) add bb3d2222fcf HIVE-26446: HiveProtoLoggingHook fails to populate TablesWritten field for partitioned tables (Simhadri Govindappa, reviewed by Denys Kuzmenko) add 82f319773cb HIVE-26248: Add data connector authorization on HMS server-side (#3312) add 277f2431a8c HIVE-26415 : Add epoch time in the information_schema.scheduled_executions view (#3467) add 392944e12d4 HIVE-26478: Explicitly set Content-Type in QueryProfileServlet (#3527) add 9b00e04a10d HIVE-26483: Use DDL_NO_LOCK when running iceberg CTAS query (#3533) (Laszlo Pinter, reviewed by Denys Kuzmenko) add 27490a8130a HIVE-26363: converting replLogger time format from epoch to UTC (#3541) add 8f30c8fe1a7 HIVE-26407: Do not compute statistics if the compaction fails (Zsolt Miskolczi, reviewed by Denys Kuzmenko) add 5de6faa8c94 HIVE-26472: Allocate new writeIds during re-compilation (John Sherman, reviewed by Denys Kuzmenko) add 665eadae33e HIVE-26294: Allow substr to take bigint params (Steve Carlin, reviewed by Krisztian Kasa) add 00d346f49c3 HIVE-26487: Auto-compaction may hang or skip some of the eligible items (Denys Kuzmenko, reviewed by Karen Coppage) add ecdac363e04 Fix flaky test TestJdbcWithMiniHS2 testHttpRetryOnServerIdleTimeout (#3547) (Zhihua Deng, reviewed by Ayush Saxena) add 74c4aa91509 HIVE-22193: Graceful shutdown HiveServer2(addendum) (#3530) add e775424a411 HIVE-26479: Add ability to set parameters for query-based compaction (Sourabh Badhya, reviewed by Denys Kuzmenko) add 64b731820cf HIVE-26476: map ORCFILE to ORC while creating an iceberg table (#3525) (Laszlo Pinter, reviewed by Adam Szita) add 1c310f8cebe HIVE-26481: Cleaner fails with FileNotFoundException (Kirti Ruge, reviewed by Ayush Saxena, Denys Kuzmenko) add 3ffc2b403c4 HIVE-26506: HiveIcebergVectorizedRecordReader doesn't set the selected array (#3558) (Adam Szita, reviewed by Laszlo Pinter) add d06957f254e HIVE-26480: Improve SYS.COMPACTIONS and SYS.TRANSACTIONS views (Laszlo Vegh, reviewed by Denys Kuzmenko) add 2d8b0a31f46 HIVE-26474: Enable converting insert-only tables to full ACID tables (Simhadri Govindappa, reviewed by Denys Kuzmenko) add 976102a4a02 HIVE-26511: Fix NoClassDefFoundError in HMS for HBaseConfiguration. (#3569). (Ayush Saxena, reviewed by Zhihua Deng and Istvan Toth) add 6ada437afc6 HIVE-26510: Minor compaction creates empty delta files when no prior delta file exists (#3568). (Sourabh Badhya, reviewed by Denys Kuzmenko and Ayush Saxena) add da204a5263e HIVE-26500: Improve TestHiveMetastore (#3556) (Laszlo Bodor reviewed by Ayush Saxena) add 5e8e84aa06d HIVE-26253: Upgrade postgresql to 42.4.1 due to security issues (#3554) (Hongdan Zhu, reviewed by Zhihua Deng) add cf3c876efdc Bump mysql-connector-java from 8.0.27 to 8.0.28 in /standalone-metastore This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (2b29b86d258) \ N -- N -- N refs/heads/dependabot/maven/standalone-metastore/mysql-mysql-connector-java-8.0.28 (cf3c876efdc) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: Jenkinsfile | 40 + .../hive/beeline/schematool/HiveSchemaTool.java | 5 +- .../apache/hive/beeline/TestBeelineArgParsing.java | 4 +- bin/ext/hiveserver2.sh | 82 +- bin/hive | 2 +- .../org/apache/hadoop/hive/common/FileUtils.java | 13 + .../apache/hadoop/hive/common/StringableMap.java | 107 - .../org/apache/hadoop/hive/conf/Constants.java | 4 + .../java/org/apache/hadoop/hive/conf/HiveConf.java | 6 + .../hive/common/util/ShutdownHookManager.java | 46 +- .../apache/hadoop/hive/common/TestFileUtils.java | 31 + data/files/datasets/src_hbase/load.hive.sql | 4 + .../hbase/HiveHBaseTableSnapshotInputFormat.java | 4 +- .../org/apache/hadoop/hive/hbase/PutWritable.java | 6 +- .../apache/hadoop/hive/hbase/ResultWritable.java | 4 +- .../iceberg/mr/hive/HiveIcebergMetaHook.java | 44 +- .../vector/HiveIcebergVectorizedRecordReader.java | 4 + .../mr/hive/vector/HiveVectorizedReader.java | 22 +- .../mr/hive/writer/HiveIcebergDeleteWriter.java | 5 +- .../mr/hive/writer/HiveIcebergRecordWriter.java | 5 +- .../iceberg/mr/hive/writer/WriterBuilder.java | 4 +- .../parquet}/ParquetFooterInputFromCache.java | 122 +- .../iceberg/mr/hive/TestHiveIcebergInserts.java | 26 + .../iceberg/mr/hive/TestHiveIcebergRollback.java | 4 + .../queries/positive/dynamic_partition_writes.q | 2 +- .../test/queries/positive/llap_iceberg_read_orc.q | 28 + .../queries/positive/llap_iceberg_read_parquet.q | 122 + ...create_iceberg_table_stored_as_fileformat.q.out | 10 +- .../describe_iceberg_metadata_tables.q.out | 27 + .../positive/dynamic_partition_writes.q.out | 30 +- .../positive/llap/llap_iceberg_read_orc.q.out | 154 + .../positive/llap/llap_iceberg_read_parquet.q.out | 465 + ...ery_iceberg_metadata_of_partitioned_table.q.out | 46 +- iceberg/pom.xml | 2 +- .../hive/ql/txn/compactor/CompactorOnTezTest.java | 36 +- .../hive/ql/txn/compactor/CompactorTestUtil.java | 3 +- .../hive/ql/txn/compactor/TestCompactor.java | 12 +- .../ql/txn/compactor/TestCrudCompactorOnTez.java | 146 +- .../ql/txn/compactor/TestMRCompactorOnTez.java | 1 - .../ql/txn/compactor/TestMmCompactorOnTez.java | 6 +- .../org/apache/hive/jdbc/TestJdbcWithMiniHS2.java | 2 +- .../org/apache/hive/jdbc/TestRestrictedList.java | 1 + .../hive/service/cli/session/TestQueryDisplay.java | 1 + .../hive/service/server/TestGracefulStopHS2.java | 151 + .../test/resources/testconfiguration.properties | 4 +- .../java/org/apache/hive/jdbc/miniHS2/MiniHS2.java | 5 + .../org/apache/hadoop/hive/llap/io/api/LlapIo.java | 17 + .../llap/daemon/rpc/LlapDaemonProtocolProtos.java | 16451 ++++++++++++------- .../llap/plugin/rpc/LlapPluginProtocolProtos.java | 609 +- .../hadoop/hive/llap/io/api/impl/LlapIoImpl.java | 58 + .../hive/llap/io/encoded/LlapOrcCacheLoader.java | 4 +- .../hive/llap/io/encoded/OrcEncodedDataReader.java | 18 +- .../llap/io/encoded/SerDeEncodedDataReader.java | 11 +- .../hive/hive-schema-4.0.0-alpha-2.hive.sql | 21 +- ...upgrade-4.0.0-alpha-1-to-4.0.0-alpha-2.hive.sql | 72 +- pom.xml | 9 +- ql/pom.xml | 4 + .../hadoop/hive/ql/hooks/proto/HiveHookEvents.java | 1481 +- .../hadoop/hive/ql/io/protobuf/SampleProtos.java | 2137 ++- .../org/apache/hadoop/hive/llap/LlapHiveUtils.java | 30 +- ql/src/java/org/apache/hadoop/hive/ql/Driver.java | 15 + .../hadoop/hive/ql/HiveQueryLifeTimeHook.java | 5 +- .../AlterTableSetPropertiesOperation.java | 13 +- .../hadoop/hive/ql/exec/repl/util/ReplUtils.java | 12 + .../hadoop/hive/ql/hooks/HiveProtoLoggingHook.java | 4 +- .../org/apache/hadoop/hive/ql/io/AcidUtils.java | 221 +- .../org/apache/hadoop/hive/ql/io/HdfsUtils.java | 3 +- .../apache/hadoop/hive/ql/io/HiveInputFormat.java | 2 +- .../apache/hadoop/hive/ql/io/SyntheticFileId.java | 29 + .../vector/ParquetFooterInputFromCache.java | 4 +- .../vector/VectorizedParquetRecordReader.java | 57 +- .../hadoop/hive/ql/lockmgr/DbTxnManager.java | 24 +- .../hadoop/hive/ql/lockmgr/HiveTxnManager.java | 8 + .../hadoop/hive/ql/lockmgr/HiveTxnManagerImpl.java | 5 + .../hadoop/hive/ql/parse/CalcitePlanner.java | 63 +- .../hadoop/hive/ql/parse/SemanticAnalyzer.java | 60 +- .../hive/ql/parse/repl/dump/io/FileOperations.java | 3 +- .../parse/repl/dump/log/state/AtlasDumpBegin.java | 7 +- .../ql/parse/repl/dump/log/state/AtlasDumpEnd.java | 6 +- .../repl/dump/log/state/BootstrapDumpBegin.java | 8 +- .../repl/dump/log/state/BootstrapDumpEnd.java | 8 +- .../repl/dump/log/state/BootstrapDumpFunction.java | 6 +- .../repl/dump/log/state/BootstrapDumpTable.java | 6 +- .../repl/dump/log/state/IncrementalDumpBegin.java | 8 +- .../repl/dump/log/state/IncrementalDumpEnd.java | 8 +- .../repl/dump/log/state/IncrementalDumpEvent.java | 6 +- .../parse/repl/dump/log/state/RangerDumpBegin.java | 6 +- .../parse/repl/dump/log/state/RangerDumpEnd.java | 6 +- .../parse/repl/load/log/state/AtlasLoadBegin.java | 6 +- .../ql/parse/repl/load/log/state/AtlasLoadEnd.java | 6 +- .../repl/load/log/state/BootstrapLoadBegin.java | 8 +- .../repl/load/log/state/BootstrapLoadEnd.java | 8 +- .../repl/load/log/state/BootstrapLoadFunction.java | 6 +- .../repl/load/log/state/BootstrapLoadTable.java | 6 +- .../ql/parse/repl/load/log/state/DataCopyEnd.java | 4 +- .../repl/load/log/state/IncrementalLoadBegin.java | 8 +- .../repl/load/log/state/IncrementalLoadEnd.java | 8 +- .../repl/load/log/state/IncrementalLoadEvent.java | 6 +- .../parse/repl/load/log/state/RangerLoadBegin.java | 6 +- .../parse/repl/load/log/state/RangerLoadEnd.java | 7 +- .../hadoop/hive/ql/plan/ExprNodeDescUtils.java | 10 +- .../plugin/AuthorizationMetaStoreFilterHook.java | 10 +- .../plugin/HivePrivilegeObjectUtils.java | 14 + .../metastore/HiveMetaStoreAuthorizableEvent.java | 7 + .../plugin/metastore/HiveMetaStoreAuthorizer.java | 14 + .../metastore/events/AlterDataConnectorEvent.java | 100 + .../metastore/events/CreateDataConnectorEvent.java | 93 + .../metastore/events/DropDataConnectorEvent.java | 88 + .../hadoop/hive/ql/txn/compactor/CompactorMR.java | 56 +- .../hive/ql/txn/compactor/CompactorUtil.java | 2 +- .../hadoop/hive/ql/txn/compactor/Initiator.java | 7 +- .../hive/ql/txn/compactor/MajorQueryCompactor.java | 3 +- .../hive/ql/txn/compactor/MinorQueryCompactor.java | 2 +- .../ql/txn/compactor/MmMajorQueryCompactor.java | 3 +- .../ql/txn/compactor/MmMinorQueryCompactor.java | 2 +- .../hive/ql/txn/compactor/QueryCompactor.java | 21 +- .../hadoop/hive/ql/txn/compactor/StatsUpdater.java | 88 + .../hadoop/hive/ql/txn/compactor/Worker.java | 67 +- .../org/apache/hadoop/hive/ql/udf/UDFSubstr.java | 69 +- .../apache/hadoop/hive/ql/util/UpgradeTool.java | 35 +- .../logging/proto/ProtoMessageWritable.java | 3 +- .../metastore/txn/TestCompactionTxnHandler.java | 10 +- .../org/apache/hadoop/hive/ql/TestTxnCommands.java | 8 +- .../apache/hadoop/hive/ql/TestTxnCommands2.java | 27 + .../hive/ql/hooks/TestHiveProtoLoggingHook.java | 75 + .../ql/parse/repl/TestReplStateLogTimeFormat.java | 110 + .../metastore/TestHiveMetaStoreAuthorizer.java | 51 + .../TestCompactorMRJobQueueConfiguration.java | 2 +- .../hadoop/hive/ql/txn/compactor/TestWorker.java | 41 +- .../queries/clientpositive/dataconnector_mysql.q | 3 + .../clientpositive/insert_only_to_acid_convert.q | 31 + ql/src/test/queries/clientpositive/sysdb.q | 2 +- ql/src/test/queries/clientpositive/udf_substr.q | 13 + .../clientpositive/llap/dataconnector_mysql.q.out | 33 + .../llap/insert_only_to_acid_convert.q.out | 394 + .../test/results/clientpositive/llap/sysdb.q.out | 1 + .../results/clientpositive/llap/udf_substr.q.out | 41 + .../compiler/errors/invalid_function_param2.q.out | 2 +- .../org/apache/hive/service/AbstractService.java | 25 +- .../org/apache/hive/service/CompositeService.java | 17 + .../src/java/org/apache/hive/service/Service.java | 15 + .../service/cli/operation/OperationManager.java | 39 +- .../hive/service/cli/session/SessionManager.java | 8 +- .../apache/hive/service/server/HiveServer2.java | 86 +- .../hive/service/servlet/QueryProfileServlet.java | 2 +- standalone-metastore/metastore-common/pom.xml | 2 +- .../gen/thrift/gen-cpp/hive_metastore_types.cpp | 22 + .../src/gen/thrift/gen-cpp/hive_metastore_types.h | 13 +- .../api/AllocateTableWriteIdsRequest.java | 112 +- .../metastore/AllocateTableWriteIdsRequest.php | 24 + .../src/gen/thrift/gen-py/hive_metastore/ttypes.py | 14 +- .../src/gen/thrift/gen-rb/hive_metastore_types.rb | 4 +- .../metastore/DefaultMetaStoreFilterHookImpl.java | 5 + .../hadoop/hive/metastore/HiveMetaStoreClient.java | 34 +- .../hadoop/hive/metastore/IMetaStoreClient.java | 10 + .../hadoop/hive/metastore/MetaStoreFilterHook.java | 7 + .../hadoop/hive/metastore/utils/FilterUtils.java | 2 +- .../src/main/thrift/hive_metastore.thrift | 3 + .../apache/hadoop/hive/metastore/HMSHandler.java | 6 +- .../metastore/TransactionalValidationListener.java | 4 +- .../jdbc/AbstractJDBCConnectorProvider.java | 3 +- .../events/PreAlterDataConnectorEvent.java | 42 +- .../events/PreDropDataConnectorEvent.java | 44 + .../tools/schematool/MetastoreSchemaTool.java | 4 +- .../hive/metastore/txn/CompactionTxnHandler.java | 7 +- .../hadoop/hive/metastore/txn/TxnHandler.java | 64 +- .../apache/hadoop/hive/metastore/txn/TxnStore.java | 2 +- .../apache/hadoop/hive/metastore/txn/TxnUtils.java | 27 +- .../hadoop/hive/metastore/utils/StringableMap.java | 41 +- .../metastore/HiveMetaStoreClientPreCatalog.java | 12 +- .../hadoop/hive/metastore/MetaStoreTestUtils.java | 36 + .../hadoop/hive/metastore/TestFilterHooks.java | 31 + .../hadoop/hive/metastore/TestHiveMetaStore.java | 127 +- standalone-metastore/pom.xml | 21 +- 174 files changed, 17609 insertions(+), 8296 deletions(-) delete mode 100644 common/src/java/org/apache/hadoop/hive/common/StringableMap.java copy {ql/src/java/org/apache/hadoop/hive/ql/io/parquet/vector => iceberg/iceberg-handler/src/main/java/org/apache/iceberg/parquet}/ParquetFooterInputFromCache.java (59%) create mode 100644 iceberg/iceberg-handler/src/test/queries/positive/llap_iceberg_read_parquet.q create mode 100644 iceberg/iceberg-handler/src/test/results/positive/llap/llap_iceberg_read_parquet.q.out create mode 100755 itests/hive-unit/src/test/java/org/apache/hive/service/server/TestGracefulStopHS2.java create mode 100644 ql/src/java/org/apache/hadoop/hive/ql/security/authorization/plugin/metastore/events/AlterDataConnectorEvent.java create mode 100644 ql/src/java/org/apache/hadoop/hive/ql/security/authorization/plugin/metastore/events/CreateDataConnectorEvent.java create mode 100644 ql/src/java/org/apache/hadoop/hive/ql/security/authorization/plugin/metastore/events/DropDataConnectorEvent.java create mode 100644 ql/src/java/org/apache/hadoop/hive/ql/txn/compactor/StatsUpdater.java create mode 100644 ql/src/test/org/apache/hadoop/hive/ql/parse/repl/TestReplStateLogTimeFormat.java create mode 100644 ql/src/test/queries/clientpositive/insert_only_to_acid_convert.q create mode 100644 ql/src/test/results/clientpositive/llap/insert_only_to_acid_convert.q.out copy ql/src/java/org/apache/hadoop/hive/ql/parse/repl/dump/log/state/AtlasDumpBegin.java => standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/events/PreAlterDataConnectorEvent.java (53%) create mode 100644 standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/events/PreDropDataConnectorEvent.java