This is an automated email from the ASF dual-hosted git repository.
morrySnow pushed a change to branch meta-path
in repository https://gitbox.apache.org/repos/asf/doris.git
discard 79da3c0cb20 fix-case
discard e262fe6acf0 [test](regression) Add left join not-null column pruning
regression test
discard 071621333b2 反引号不是本分支(meta-path)改动引入的,而是 StructField.toSql() 在提交
70a82532325(feature Support nested column schema change #65329)中的行为变化导致的
discard ad6a80ee5c0 do not generate s.null
discard c60856c0a84 [P1] Keep the field referenced by the unchanged predicate
discard 3372f9a868b [P1] Do not map expression nullability to a non-null Struct
discard e85c954de83 [test](fe) Validate struct parent null access paths
discard 06b79c3c8fa [fix](be) Reject invalid map access path selectors
discard 09b63882d21 (fe)Emit struct-level NULL path for element_at over struct
IS NULL
discard e95f4a54b36 [doc](be) Document nested access path routing flow
discard 4e977e7cc59 [refactor](be) Use logical selectors for map access paths
discard a2c62b713d5 [refactor](be) Clarify descendant access path routing names
discard cf07bf013e0 [fix](be) Support versioned metadata access paths
add ac7244ff197 [fix](ci) Skip Codex auth with reused refresh tokens
(#67635)
add e1df149d617 [fix](local shuffle) Prevent local exchange under serial
parent pipeline (#67490)
add 798eb24b176 [fix](binlog) Fix row binlog recovery for multi-tablet
transactions (#67508)
add c275e05579b [fix](catalog) Restore DLF support for Iceberg and Paimon
(#67545)
add 94ad62a4aea [fix](cloud) prevent warm-up job scheduling starvation
(#67527)
add bd01e332267 [refactor](qe) Merge the duplicate ConnectType enum and
drop the unreachable forward branch (#67572)
add a42928c5caf [fix](be) Avoid repeated peer connect failures (#67464)
add c88e889515e [feature](function) Add ST_IsClosed function (#67350)
add 396ad795b05 [fix](test) Isolate TPC-H MOR-as-DUP tables from
compaction (#67566)
add 9957987d5bf [fix](cloud) Return existing rowset for concurrent commits
(#67637)
add 88b470c757d [fix](fe) Adapt warm-up scheduler tests to JUnit 5 (#67655)
add 7f10e6f9b68 [fix](be) Support versioned metadata access paths
add c0553e0e61e [refactor](be) Clarify descendant access path routing names
add 16f1b4e4d33 [refactor](be) Use logical selectors for map access paths
add 77da75cd0c3 [doc](be) Document nested access path routing flow
add c1d58869b0c (fe)Emit struct-level NULL path for element_at over struct
IS NULL
add 78fbfe08e18 [fix](be) Reject invalid map access path selectors
add f04a981743b [test](fe) Validate struct parent null access paths
add 2e6d5ad3876 [P1] Do not map expression nullability to a non-null Struct
add 6e5c49ebc5e [P1] Keep the field referenced by the unchanged predicate
add db373a1091e do not generate s.null
add 14a8007840d 反引号不是本分支(meta-path)改动引入的,而是 StructField.toSql() 在提交
70a82532325(feature Support nested column schema change #65329)中的行为变化导致的
add c24ab31448b [test](regression) Add left join not-null column pruning
regression test
add 168e38a2b3c fix-case
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (79da3c0cb20)
\
N -- N -- N refs/heads/meta-path (168e38a2b3c)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/scripts/test_review_auth_quarantine.py | 394 +++++++++++++++++++++
.github/workflows/code-review-runner.yml | 99 +++++-
be/src/cloud/config.cpp | 4 +
be/src/cloud/config.h | 3 +
be/src/exprs/function/geo/functions_geo.cpp | 41 +++
be/src/io/cache/peer_file_cache_reader.cpp | 63 +++-
be/src/storage/data_dir.cpp | 11 +-
be/src/storage/tablet/tablet_manager.cpp | 25 +-
be/src/storage/tablet/tablet_meta.cpp | 6 +
be/src/storage/tablet/tablet_meta.h | 3 +
be/src/util/brpc_client_cache.h | 7 +-
be/test/exprs/function/geo/functions_geo_test.cpp | 32 ++
.../cache/cached_remote_file_reader_peer_test.cpp | 23 ++
be/test/olap/rowset/group_rowset_builder_test.cpp | 131 ++++++-
cloud/src/meta-service/meta_service.cpp | 40 +--
cloud/test/meta_service_test.cpp | 45 +++
.../main/java/org/apache/doris/common/Config.java | 14 +-
.../java/org/apache/doris/common/ConfigTest.java | 21 ++
.../fe-connector-hms-hive-shade/pom.xml | 22 ++
.../connector/iceberg/IcebergCatalogFactory.java | 14 +-
.../iceberg/IcebergCatalogProperties.java | 9 +-
.../doris/connector/iceberg/IcebergConnector.java | 84 +++--
.../iceberg/IcebergConnectorMetadata.java | 5 +
.../iceberg/IcebergConnectorProvider.java | 8 +
.../doris/connector/iceberg/dlf/DLFCatalog.java | 132 +++++++
.../connector/iceberg/dlf/DLFTableOperations.java | 38 ++
.../iceberg/dlf/HiveCompatibleCatalog.java | 292 +++++++++++++++
.../iceberg/dlf/client/DLFCachedClientPool.java | 83 +++++
.../iceberg/dlf/client/DLFClientPool.java | 47 +++
.../iceberg/IcebergCatalogFactoryTest.java | 16 +-
.../iceberg/IcebergCatalogPropertiesTest.java | 14 +
.../iceberg/IcebergConnectorMetadataDdlTest.java | 17 +
.../connector/iceberg/IcebergConnectorTest.java | 12 +-
.../IcebergConnectorTestConnectionTest.java | 64 ++++
.../IcebergConnectorValidatePropertiesTest.java | 13 +-
.../connector/iceberg/dlf/DLFCatalogTest.java | 48 +++
.../iceberg/dlf/HiveCompatibleCatalogTest.java | 320 +++++++++++++++++
.../metastore/DlfMetaStoreProperties.java | 27 ++
.../iceberg/dlf/IcebergDlfMetaStoreProperties.java | 42 +++
.../iceberg/dlf/IcebergDlfMetaStoreProvider.java | 49 +++
...doris.connector.metastore.spi.MetaStoreProvider | 1 +
.../IcebergMetaStoreProvidersDispatchTest.java | 16 +-
.../dlf/IcebergDlfMetaStorePropertiesTest.java | 109 ++++++
.../paimon/dlf/PaimonDlfMetaStoreProperties.java | 43 +++
.../paimon/dlf/PaimonDlfMetaStoreProvider.java | 49 +++
...doris.connector.metastore.spi.MetaStoreProvider | 1 +
.../paimon/MetaStoreProvidersDispatchTest.java | 16 +-
.../dlf/PaimonDlfMetaStorePropertiesTest.java | 72 ++++
.../spi/AbstractDlfMetaStoreProperties.java | 128 +++++++
.../fe-connector-paimon-hive-shade/pom.xml | 19 +
.../connector/paimon/PaimonCatalogFactory.java | 39 ++
.../connector/paimon/PaimonCatalogProperties.java | 5 +-
.../doris/connector/paimon/PaimonConnector.java | 75 ++++
.../connector/paimon/PaimonCatalogFactoryTest.java | 76 +++-
.../paimon/PaimonConnectorTestConnectionTest.java | 85 +++++
.../PaimonConnectorValidatePropertiesTest.java | 27 +-
.../paimon/RecordingConnectorContext.java | 22 +-
.../doris/connector/spi/ConnectorProvider.java | 12 +
.../connector/spi/ConnectorPluginSurfaceTest.java | 4 +-
.../test/resources/connector-plugin-surface.txt | 1 +
.../doris/catalog/BuiltinScalarFunctions.java | 2 +
.../apache/doris/cloud/CacheHotspotManager.java | 120 +++++--
.../doris/common/util/DatasourcePrintableMap.java | 1 +
.../org/apache/doris/common/util/LocationPath.java | 16 +-
.../apache/doris/connector/ConnectorFactory.java | 8 +
.../doris/connector/ConnectorPluginManager.java | 18 +
.../org/apache/doris/datasource/CatalogIf.java | 5 +
.../plugin/PluginDrivenExternalCatalog.java | 17 +
.../org/apache/doris/mtmv/MTMVPartitionUtil.java | 4 +-
.../glue/translator/PlanTranslatorContext.java | 14 +
.../expressions/functions/scalar/StIsClosed.java | 75 ++++
.../expressions/visitor/ScalarFunctionVisitor.java | 5 +
.../trees/plans/commands/CreateTableCommand.java | 10 +
.../org/apache/doris/planner/AddLocalExchange.java | 1 +
.../java/org/apache/doris/planner/PlanNode.java | 16 +-
.../java/org/apache/doris/qe/ConnectProcessor.java | 6 +-
.../org/apache/doris/qe/MysqlConnectProcessor.java | 1 +
.../apache/doris/service/FrontendServiceImpl.java | 17 +-
.../arrowflight/FlightSqlConnectProcessor.java | 1 +
.../cloud/CacheHotspotManagerSchedulerTest.java | 149 ++++++++
.../common/util/DatasourcePrintableMapTest.java | 12 +
.../doris/connector/ConnectorPluginConfTest.java | 14 +
.../DefaultConnectorContextNormalizeUriTest.java | 65 ++++
.../testplugins/ConfProbeConnectorProviderA.java | 13 +-
.../PluginDrivenExternalCatalogDdlRoutingTest.java | 43 +++
.../apache/doris/mtmv/MTMVPartitionUtilTest.java | 9 +
.../scalar/StGeoComponentFunctionsTest.java | 31 +-
.../plans/commands/CreateTableCommandTest.java | 11 +-
.../apache/doris/qe/AuditLogWorkloadGroupTest.java | 1 +
.../ConnectProcessorDelegatedCredentialTest.java | 1 +
.../hdfs/properties/OssHdfsProperties.java | 47 ++-
.../hdfs/properties/OssHdfsPropertiesTest.java | 76 +++-
.../filesystem/oss/OssFileSystemProperties.java | 18 +-
.../oss/OssFileSystemPropertiesTest.java | 35 ++
.../property/ConnectorPropertiesUtils.java | 21 ++
.../data/external_table_p0/test_dlf_catalog.out | 6 +
.../external_table_p0/test_dlf_catalog.groovy | 146 ++++++++
.../test_local_shuffle_rqg_bugs.groovy | 35 ++
.../spatial_functions/test_st_isclosed.groovy | 30 ++
.../ddl/customer_mor_as_dup.sql | 18 +
.../ddl/lineitem_mor_as_dup.sql | 26 ++
.../ddl/nation_mor_as_dup.sql | 14 +
.../ddl/orders_mor_as_dup.sql | 19 +
.../ddl/part_mor_as_dup.sql | 19 +
.../ddl/partsupp_mor_as_dup.sql | 15 +
.../ddl/region_mor_as_dup.sql | 13 +
.../ddl/supplier_mor_as_dup.sql | 17 +
.../suites/tpch_sf100_unique_mor_p2/load.groovy | 12 +-
.../test_read_mor_as_dup.groovy | 12 +-
109 files changed, 4159 insertions(+), 224 deletions(-)
create mode 100644 .github/scripts/test_review_auth_quarantine.py
create mode 100644
fe/fe-connector/fe-connector-iceberg/src/main/java/org/apache/doris/connector/iceberg/dlf/DLFCatalog.java
create mode 100644
fe/fe-connector/fe-connector-iceberg/src/main/java/org/apache/doris/connector/iceberg/dlf/DLFTableOperations.java
create mode 100644
fe/fe-connector/fe-connector-iceberg/src/main/java/org/apache/doris/connector/iceberg/dlf/HiveCompatibleCatalog.java
create mode 100644
fe/fe-connector/fe-connector-iceberg/src/main/java/org/apache/doris/connector/iceberg/dlf/client/DLFCachedClientPool.java
create mode 100644
fe/fe-connector/fe-connector-iceberg/src/main/java/org/apache/doris/connector/iceberg/dlf/client/DLFClientPool.java
create mode 100644
fe/fe-connector/fe-connector-iceberg/src/test/java/org/apache/doris/connector/iceberg/dlf/DLFCatalogTest.java
create mode 100644
fe/fe-connector/fe-connector-iceberg/src/test/java/org/apache/doris/connector/iceberg/dlf/HiveCompatibleCatalogTest.java
create mode 100644
fe/fe-connector/fe-connector-metastore-api/src/main/java/org/apache/doris/connector/metastore/DlfMetaStoreProperties.java
create mode 100644
fe/fe-connector/fe-connector-metastore-iceberg/src/main/java/org/apache/doris/connector/metastore/iceberg/dlf/IcebergDlfMetaStoreProperties.java
create mode 100644
fe/fe-connector/fe-connector-metastore-iceberg/src/main/java/org/apache/doris/connector/metastore/iceberg/dlf/IcebergDlfMetaStoreProvider.java
create mode 100644
fe/fe-connector/fe-connector-metastore-iceberg/src/test/java/org/apache/doris/connector/metastore/iceberg/dlf/IcebergDlfMetaStorePropertiesTest.java
create mode 100644
fe/fe-connector/fe-connector-metastore-paimon/src/main/java/org/apache/doris/connector/metastore/paimon/dlf/PaimonDlfMetaStoreProperties.java
create mode 100644
fe/fe-connector/fe-connector-metastore-paimon/src/main/java/org/apache/doris/connector/metastore/paimon/dlf/PaimonDlfMetaStoreProvider.java
create mode 100644
fe/fe-connector/fe-connector-metastore-paimon/src/test/java/org/apache/doris/connector/metastore/paimon/dlf/PaimonDlfMetaStorePropertiesTest.java
create mode 100644
fe/fe-connector/fe-connector-metastore-spi/src/main/java/org/apache/doris/connector/metastore/spi/AbstractDlfMetaStoreProperties.java
create mode 100644
fe/fe-connector/fe-connector-paimon/src/test/java/org/apache/doris/connector/paimon/PaimonConnectorTestConnectionTest.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/StIsClosed.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/cloud/CacheHotspotManagerSchedulerTest.java
create mode 100644 regression-test/data/external_table_p0/test_dlf_catalog.out
create mode 100644
regression-test/suites/external_table_p0/test_dlf_catalog.groovy
create mode 100644
regression-test/suites/query_p0/sql_functions/spatial_functions/test_st_isclosed.groovy
create mode 100644
regression-test/suites/tpch_sf100_unique_mor_p2/ddl/customer_mor_as_dup.sql
create mode 100644
regression-test/suites/tpch_sf100_unique_mor_p2/ddl/lineitem_mor_as_dup.sql
create mode 100644
regression-test/suites/tpch_sf100_unique_mor_p2/ddl/nation_mor_as_dup.sql
create mode 100644
regression-test/suites/tpch_sf100_unique_mor_p2/ddl/orders_mor_as_dup.sql
create mode 100644
regression-test/suites/tpch_sf100_unique_mor_p2/ddl/part_mor_as_dup.sql
create mode 100644
regression-test/suites/tpch_sf100_unique_mor_p2/ddl/partsupp_mor_as_dup.sql
create mode 100644
regression-test/suites/tpch_sf100_unique_mor_p2/ddl/region_mor_as_dup.sql
create mode 100644
regression-test/suites/tpch_sf100_unique_mor_p2/ddl/supplier_mor_as_dup.sql
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]