This is an automated email from the ASF dual-hosted git repository.
morningman pushed a change to branch branch-catalog-spi
in repository https://gitbox.apache.org/repos/asf/doris.git
omit 18af39c179a [doc](catalog) P6.6-C6 #63068 HANDOFF: record
cache-leakage data-flow test + Task 0 retained-base verify
omit ca246b1d81e [feat](catalog) P6.6-C6 #63068 FE: re-migrate
ExternalDatabaseSessionContextTest (cross-user cache-leakage data-flow)
omit d9586ea409e [doc](catalog) P6.6-C6 #63068 OIDC session migration:
design + research notes + HANDOFF (Tasks 0-7 DONE)
omit 49034126a2e [feat](catalog) P6.6-C6 #63068 iceberg: per-user REST
session routing (metadata + scan/write/procedure)
omit da2a6c658ce [feat](catalog) P6.6-C6 #63068 FE: capability-gated
credential injection + per-user cache bypass
omit f3a8c71c73f [feat](catalog) P6.6-C6 #63068 SPI: neutral
delegated-credential DTO + user-session capability
omit 68807c22cfb [fix](catalog) tier3 #65094: preserve external-table
top-level column-name case on the read path
omit c211c1aa276 [fix](catalog) port upstream #65332/#65094 datasource
fixes into SPI connectors
omit 53dc6361401 [fix](catalog) P4 maxcompute: drop dangling legacy
MaxComputeExternalTableTest after rebase
omit 768e074426d [fix](catalog) jdbc: keep driver classloaders alive per
URL to stop Metaspace leak
omit c4791ca4b48 [refactor](catalog) P6 iceberg: migrate to catalog SPI +
cutover + remove legacy fe-core subsystem (#64688)
omit d79efb4a58d [refactor](catalog) P3b: consolidate kerberos
authentication into fe-kerberos (#64655)
omit 5b85d9fc644 [refactor](catalog) P5 paimon: remove legacy subsystem
from fe-core + make fe-core paimon-SDK-free (T29) (#64653)
omit fd6302a0137 [refactor](catalog) P5 paimon: migrate to catalog SPI +
cutover (#64446) (#64446)
omit bff6abfe140 update P5 handoff and fix compile issue
omit 3d9b085250f [refactor](connector) P4 maxcompute: remove legacy
subsystem from fe-core + make fe-core odps-free (T07-T09) (#64300)
omit 470ade67f3b [feat](connector) P3 hudi connector hardening + test
baseline + dispatch design (hybrid, T02-T08) (#64143)
omit 7f893b4e55c [feat](connector) P2 migrate trino-connector to catalog
SPI (T01-T13) (#64096)
omit 041ffe3b8aa [P1-T03-T05] route plugin-driven scans first in nereids
translator (#63641)
omit 13d31e09c2c [feat](connector) P0 SPI baseline + DDL/Partition + import
gate (T03-T27) (#63582)
omit 0ddf9fb574b [doc](connector) add project tracking system for catalog
SPI migration
add 73032987277 [improvement](be) Optimize Parquet predicate filtering in
format v2 (#65369)
add 296a3bbbffb [fix](regression) Fix docker regression case assertions
(#65201)
add 9c05b33a7b7 [test](regression) Improve BE cancel_query workload policy
regression coverage (#65145)
add 44aaa1e87eb [fix](binlog) Align row binlog after schema with before
values (#65438)
add 8f65b7ccb41 [fix](build) Update pytest dependency pins for security
advisories (#63188)
add 639a2d7437b Revert "[feature](lance) Add Rust-based Lance format
reader for AI-native data (#62182) (#65303)
add f81780bbfe9 [opt](paimon) control paimon jni reader async file reader
(#65365)
add e033e2ff8f6 [fix](fe) Fix duplicate join nodes in
PushDownAggThroughJoinOnPkFk tree reconstruction (#65172)
add 5aa3c6c0d96 [Feature](func) Support REGEXP_EXTRACT_ALL_ARRAY (#61156)
add 4f48ccfaa7d [improvement](be) Improve FileScannerV2 profiling and
pruning (#65449)
add 0070e552721 [doc](connector) add project tracking system for catalog
SPI migration
add 7daefed375c [feat](connector) P0 SPI baseline + DDL/Partition + import
gate (T03-T27) (#63582)
add ed2b391bbed [P1-T03-T05] route plugin-driven scans first in nereids
translator (#63641)
add db63e458f75 [feat](connector) P2 migrate trino-connector to catalog
SPI (T01-T13) (#64096)
add 8b09ab3d4f2 [feat](connector) P3 hudi connector hardening + test
baseline + dispatch design (hybrid, T02-T08) (#64143)
add 1da88365e85 [refactor](connector) P4 maxcompute: remove legacy
subsystem from fe-core + make fe-core odps-free (T07-T09) (#64300)
add e4d1b3ab04c update P5 handoff and fix compile issue
add ec6702cabf1 [refactor](catalog) P5 paimon: migrate to catalog SPI +
cutover (#64446) (#64446)
add dbc38a265e5 [refactor](catalog) P5 paimon: remove legacy subsystem
from fe-core + make fe-core paimon-SDK-free (T29) (#64653)
add f7992b0a07e [refactor](catalog) P3b: consolidate kerberos
authentication into fe-kerberos (#64655)
add 7ffeca95abf [refactor](catalog) P6 iceberg: migrate to catalog SPI +
cutover + remove legacy fe-core subsystem (#64688)
add f7602b341e9 [fix](catalog) jdbc: keep driver classloaders alive per
URL to stop Metaspace leak
add 3e7e0d6bfe9 [fix](catalog) P4 maxcompute: drop dangling legacy
MaxComputeExternalTableTest after rebase
add 641bedea150 [fix](catalog) port upstream #65332/#65094 datasource
fixes into SPI connectors
add 31334a211f6 [fix](catalog) tier3 #65094: preserve external-table
top-level column-name case on the read path
add 8dd1f389424 [feat](catalog) P6.6-C6 #63068 SPI: neutral
delegated-credential DTO + user-session capability
add 3eb30d969c0 [feat](catalog) P6.6-C6 #63068 FE: capability-gated
credential injection + per-user cache bypass
add e56c6763283 [feat](catalog) P6.6-C6 #63068 iceberg: per-user REST
session routing (metadata + scan/write/procedure)
add 593654eace5 [doc](catalog) P6.6-C6 #63068 OIDC session migration:
design + research notes + HANDOFF (Tasks 0-7 DONE)
add 0678f7f998b [feat](catalog) P6.6-C6 #63068 FE: re-migrate
ExternalDatabaseSessionContextTest (cross-user cache-leakage data-flow)
add 5ed5dccd68c [doc](catalog) P6.6-C6 #63068 HANDOFF: record
cache-leakage data-flow test + Task 0 retained-base verify
add bd306af8980 [fix](catalog) reconcile upstream #65365 with connector
SPI after rebase to 4f48ccfaa7d
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (18af39c179a)
\
N -- N -- N refs/heads/branch-catalog-spi (bd306af8980)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
be/CMakeLists.txt | 25 -
be/cmake/rust.cmake | 81 -
be/src/exec/scan/file_scanner.cpp | 13 -
be/src/exec/scan/file_scanner_v2.cpp | 97 +-
be/src/exec/scan/file_scanner_v2.h | 10 +-
be/src/exprs/function/function_regexp.cpp | 461 +-
be/src/exprs/vcast_expr.h | 4 +
be/src/exprs/vectorized_fn_call.cpp | 13 +
be/src/exprs/vectorized_fn_call.h | 2 +
be/src/exprs/vexpr.h | 11 +
be/src/format/CMakeLists.txt | 6 -
be/src/format/lance/lance_ffi.h | 84 -
be/src/format/lance/lance_rust_reader.cpp | 407 --
be/src/format/lance/lance_rust_reader.h | 116 -
be/src/format_v2/jni/jni_table_reader.cpp | 8 +
be/src/format_v2/jni/jni_table_reader.h | 1 +
be/src/format_v2/parquet/parquet_file_context.cpp | 7 +
be/src/format_v2/parquet/parquet_file_context.h | 4 +
be/src/format_v2/parquet/parquet_profile.cpp | 25 +
be/src/format_v2/parquet/parquet_profile.h | 21 +-
be/src/format_v2/parquet/parquet_scan.cpp | 707 ++-
be/src/format_v2/parquet/parquet_scan.h | 28 +-
be/src/format_v2/parquet/parquet_statistics.cpp | 41 +-
be/src/format_v2/parquet/parquet_statistics.h | 32 +
be/src/format_v2/parquet/reader/column_reader.cpp | 51 +-
be/src/format_v2/parquet/reader/column_reader.h | 13 +-
.../parquet/reader/parquet_leaf_reader.cpp | 63 +
.../format_v2/parquet/reader/parquet_leaf_reader.h | 3 +
.../parquet/reader/scalar_column_reader.cpp | 204 +
.../parquet/reader/scalar_column_reader.h | 16 +
be/src/format_v2/table/hudi_reader.cpp | 10 +
be/src/format_v2/table/hudi_reader.h | 2 +
be/src/format_v2/table/iceberg_reader.cpp | 3 +
be/src/format_v2/table/paimon_reader.cpp | 10 +
be/src/format_v2/table/paimon_reader.h | 2 +
be/src/format_v2/table_reader.cpp | 83 +-
be/src/format_v2/table_reader.h | 27 +
be/src/rust/doris-native/Cargo.lock | 5409 --------------------
be/src/rust/doris-native/Cargo.toml | 44 -
be/src/rust/doris-native/README.md | 181 -
.../rust/doris-native/crates/doris-ffi/Cargo.toml | 47 -
be/src/rust/doris-native/crates/doris-ffi/build.rs | 95 -
.../doris-native/crates/doris-ffi/glibc_compat.c | 68 -
.../doris-native/crates/doris-ffi/src/error.rs | 189 -
.../rust/doris-native/crates/doris-ffi/src/ffi.rs | 864 ----
.../crates/doris-ffi/src/lance_reader.rs | 444 --
.../rust/doris-native/crates/doris-ffi/src/lib.rs | 44 -
be/src/rust/doris-native/rust-toolchain.toml | 19 -
be/src/service/internal_service.cpp | 9 -
be/test/CMakeLists.txt | 6 -
be/test/exec/scan/file_scanner_v2_test.cpp | 35 +
be/test/exprs/function/function_like_test.cpp | 151 +
be/test/exprs/try_cast_expr_test.cpp | 10 +-
be/test/format/lance/lance_rust_reader_test.cpp | 218 -
be/test/format/lance/standalone_lance_test.cpp | 376 --
be/test/format_v2/parquet/parquet_reader_test.cpp | 589 +++
be/test/format_v2/parquet/parquet_scan_test.cpp | 202 +
be/test/format_v2/table_reader_test.cpp | 86 +
.../org/apache/doris/paimon/PaimonJniScanner.java | 36 +-
.../apache/doris/paimon/PaimonJniScannerTest.java | 30 +
.../main/java/org/apache/doris/catalog/Column.java | 5 +
.../connector/paimon/PaimonScanPlanProvider.java | 4 +-
.../paimon/PaimonScanPlanProviderTest.java | 19 +
.../doris/catalog/BuiltinScalarFunctions.java | 2 +
.../doris/common/util/FileFormatConstants.java | 1 -
.../property/fileformat/FileFormatProperties.java | 3 -
.../fileformat/LanceFileFormatProperties.java | 51 -
.../rewrite/PushDownAggThroughJoinOnPkFk.java | 34 +-
...pExtractAll.java => RegexpExtractAllArray.java} | 23 +-
.../expressions/visitor/ScalarFunctionVisitor.java | 5 +
.../catalog/OlapTableRowBinlogSchemaTest.java | 30 +-
.../rewrite/PushDownAggThroughJoinOnPkFkTest.java | 126 +-
pytest/requirements.txt | 11 +-
regression-test/README.md | 19 +-
.../cache/ttl/ex06_ttl_restart_consistency.out | 8 +-
.../0-055c1ba4-03ab-4a0e-8829-15bb1a6d2d08.txn | Bin 220 -> 0 bytes
.../1-242b9a64-71b6-4ce9-bc7d-a09c7bd82089.txn | Bin 105 -> 0 bytes
.../2-43117771-3274-4c35-bbf7-948403ce6510.txn | Bin 105 -> 0 bytes
.../tvf/lance/multi.lance/_versions/1.manifest | Bin 289 -> 0 bytes
.../tvf/lance/multi.lance/_versions/2.manifest | Bin 355 -> 0 bytes
.../tvf/lance/multi.lance/_versions/3.manifest | Bin 419 -> 0 bytes
.../5605bf04-7859-468c-8f08-7c95a5444617.lance | Bin 815 -> 0 bytes
.../82a4ff91-1bdd-487d-a008-9c5682a1dca0.lance | Bin 815 -> 0 bytes
.../ca28aa58-00ae-48cc-ac5a-dc1746d1680b.lance | Bin 815 -> 0 bytes
.../0-c6b23c0d-3ce1-45af-852f-25eeddb0fa8f.txn | Bin 220 -> 0 bytes
.../tvf/lance/single.lance/_versions/1.manifest | Bin 289 -> 0 bytes
.../f80e031c-321c-4729-849b-e4338790114e.lance | Bin 815 -> 0 bytes
.../external_table_p0/tvf/lance/test_lance_tvf.out | 40 -
.../test_string_function_regexp.out | 56 +
.../row_binlog_p0/test_binlog_changes_syntax.out | 212 +
.../doris/regression/suite/SuiteCluster.groovy | 2 +-
.../suite/event/TeamcityEventListener.groovy | 8 +-
.../doris/regression/util/LoggerUtils.groovy | 42 +
...est_balance_use_compute_group_properties.groovy | 19 +
.../test_immediate_warmup_multi_segments.groovy | 24 +-
...est_warm_up_cluster_event_cancel_expired.groovy | 15 +-
...rm_up_cluster_event_compaction_sync_wait.groovy | 5 +-
...uster_event_compaction_sync_wait_timeout.groovy | 4 +-
...test_warm_up_cluster_event_schema_change.groovy | 73 +-
...rm_up_cluster_periodic_restart_master_fe.groovy | 40 +
.../cache/ttl/ex06_ttl_restart_consistency.groovy | 13 +-
.../cache/warm_up/test_warmup_table_docker.groovy | 63 +-
.../default_vcg_auto_failover.groovy | 68 +-
.../test_clean_tablet_when_drop_force_table.groovy | 89 +-
...e_compaction_and_read_stale_cloud_docker.groovy | 75 +-
...ultisegments_and_read_stale_cloud_docker.groovy | 135 +-
.../suites/demo_p0/test_lru_persist.groovy | 31 +-
.../hive/test_parquet_lazy_mat_profile.groovy | 36 +
.../test_workload_policy_remote_scan_bytes.groovy | 127 +-
.../tvf/lance/test_lance_tvf.groovy | 119 -
.../test_cloud_concurrent_calc_dbm_task.groovy | 15 +-
...est_cloud_full_compaction_multi_segments.groovy | 17 +-
.../test_cloud_mow_retry_txn_interleave.groovy | 11 +-
.../test_string_function_regexp.groovy | 18 +-
.../test_binlog_changes_syntax.groovy | 236 +-
..._be_workload_policy_cancel_query_metrics.groovy | 162 +
116 files changed, 4236 insertions(+), 9703 deletions(-)
delete mode 100644 be/cmake/rust.cmake
delete mode 100644 be/src/format/lance/lance_ffi.h
delete mode 100644 be/src/format/lance/lance_rust_reader.cpp
delete mode 100644 be/src/format/lance/lance_rust_reader.h
delete mode 100644 be/src/rust/doris-native/Cargo.lock
delete mode 100644 be/src/rust/doris-native/Cargo.toml
delete mode 100644 be/src/rust/doris-native/README.md
delete mode 100644 be/src/rust/doris-native/crates/doris-ffi/Cargo.toml
delete mode 100644 be/src/rust/doris-native/crates/doris-ffi/build.rs
delete mode 100644 be/src/rust/doris-native/crates/doris-ffi/glibc_compat.c
delete mode 100644 be/src/rust/doris-native/crates/doris-ffi/src/error.rs
delete mode 100644 be/src/rust/doris-native/crates/doris-ffi/src/ffi.rs
delete mode 100644
be/src/rust/doris-native/crates/doris-ffi/src/lance_reader.rs
delete mode 100644 be/src/rust/doris-native/crates/doris-ffi/src/lib.rs
delete mode 100644 be/src/rust/doris-native/rust-toolchain.toml
delete mode 100644 be/test/format/lance/lance_rust_reader_test.cpp
delete mode 100644 be/test/format/lance/standalone_lance_test.cpp
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/property/fileformat/LanceFileFormatProperties.java
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/{RegexpExtractAll.java
=> RegexpExtractAllArray.java} (72%)
delete mode 100644
regression-test/data/external_table_p0/tvf/lance/multi.lance/_transactions/0-055c1ba4-03ab-4a0e-8829-15bb1a6d2d08.txn
delete mode 100644
regression-test/data/external_table_p0/tvf/lance/multi.lance/_transactions/1-242b9a64-71b6-4ce9-bc7d-a09c7bd82089.txn
delete mode 100644
regression-test/data/external_table_p0/tvf/lance/multi.lance/_transactions/2-43117771-3274-4c35-bbf7-948403ce6510.txn
delete mode 100644
regression-test/data/external_table_p0/tvf/lance/multi.lance/_versions/1.manifest
delete mode 100644
regression-test/data/external_table_p0/tvf/lance/multi.lance/_versions/2.manifest
delete mode 100644
regression-test/data/external_table_p0/tvf/lance/multi.lance/_versions/3.manifest
delete mode 100644
regression-test/data/external_table_p0/tvf/lance/multi.lance/data/5605bf04-7859-468c-8f08-7c95a5444617.lance
delete mode 100644
regression-test/data/external_table_p0/tvf/lance/multi.lance/data/82a4ff91-1bdd-487d-a008-9c5682a1dca0.lance
delete mode 100644
regression-test/data/external_table_p0/tvf/lance/multi.lance/data/ca28aa58-00ae-48cc-ac5a-dc1746d1680b.lance
delete mode 100644
regression-test/data/external_table_p0/tvf/lance/single.lance/_transactions/0-c6b23c0d-3ce1-45af-852f-25eeddb0fa8f.txn
delete mode 100644
regression-test/data/external_table_p0/tvf/lance/single.lance/_versions/1.manifest
delete mode 100644
regression-test/data/external_table_p0/tvf/lance/single.lance/data/f80e031c-321c-4729-849b-e4338790114e.lance
delete mode 100644
regression-test/data/external_table_p0/tvf/lance/test_lance_tvf.out
create mode 100644
regression-test/data/row_binlog_p0/test_binlog_changes_syntax.out
delete mode 100644
regression-test/suites/external_table_p0/tvf/lance/test_lance_tvf.groovy
create mode 100644
regression-test/suites/workload_manager_p0/test_be_workload_policy_cancel_query_metrics.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
