This is an automated email from the ASF dual-hosted git repository.
924060929 pushed a change to branch auto-pick-64160-branch-4.1
in repository https://gitbox.apache.org/repos/asf/doris.git
discard 182ef43447a [fix](fe) Limit no-op external cache retirement and
filtered events
discard 3d33dba7ab2 [fix](fe) Preserve resolved external drop targets in
replay logs
discard 3ca7f2e22a7 [fix](fe) Fence cache invalidation and preserve replay
name semantics
discard 0cca01ee793 [fix](fe) Fence row counts before table invalidation and
preserve drop identity
discard 0c025c924c0 [fix](fe) Fence cold metadata retirement and scope Paimon
SDK invalidation
discard a7a9e5431cc [test](fe) Verify row-count fence during database
generation swap
discard 5a802427a46 [fix](fe) Fence external metadata invalidation at known
scopes
discard e8d7bfe0a88 [fix](fe) Scope cold external database replay invalidation
discard c8cd86d30c1 [fix](fe) Fence external row counts across cache refreshes
discard ee719bc8ae5 [fix](fe) Invalidate external row count cache after
metadata changes
add 0c0480257ed [fix](regression) Wait for final Iceberg Variant STRING
profile counters (#68597)
add ec0795e2f5c [feature](lance) Support time travel, tags, branches and
REST Namespace managed versioning (#68453)
add 33e44b091ea [fix](fe) Invalidate external row count cache after
metadata changes
add 42fe55f1333 [fix](fe) Fence external row counts across cache refreshes
add 9aedea8313c [fix](fe) Scope cold external database replay invalidation
add f004ab46153 [fix](fe) Fence external metadata invalidation at known
scopes
add 77c668e7715 [test](fe) Verify row-count fence during database
generation swap
add 396b321b6a1 [fix](fe) Fence cold metadata retirement and scope Paimon
SDK invalidation
add 7d9402468d8 [fix](fe) Fence row counts before table invalidation and
preserve drop identity
add 1e7691e3ffa [fix](fe) Fence cache invalidation and preserve replay
name semantics
add c8182185e9f [fix](fe) Preserve resolved external drop targets in
replay logs
add 3f858380b29 [fix](fe) Limit no-op external cache retirement and
filtered events
add 8b8afb28727 [fix](fe) Preserve external cache identity across HMS
events and ALTER
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (182ef43447a)
\
N -- N -- N refs/heads/auto-pick-64160-branch-4.1 (8b8afb28727)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../docker-compose/iceberg/iceberg.yaml.tpl | 24 +-
.../scripts/lance_build_preinstalled_catalog.py | 16 +-
.../iceberg/scripts/lance_build_time_travel.py | 178 +++
.../iceberg/scripts/lance_fixture_requirements.txt | 7 +-
.../iceberg/scripts/lance_rest_server.py | 198 ++-
.../time_travel.lance/_refs/branches/dev.json | 15 +
.../lance/time_travel.lance/_refs/tags/rel.json | 8 +
.../lance/time_travel.lance/_refs/tags/v1.json | 8 +
.../lance/time_travel.lance/_refs/tags/v2.json | 8 +
.../lance/time_travel.lance/_refs/tags/v3.json | 8 +
.../0-c7a3192f-4b4a-4e8b-b3a3-b736534c10f3.txn | Bin 0 -> 185 bytes
.../1-79502d42-ca15-43d2-99e3-8c734698ae2b.txn | Bin 0 -> 122 bytes
.../2-e678f5d6-e017-494d-adaf-fd1c0e245182.txn | Bin 0 -> 122 bytes
.../_versions/18446744073709551612.manifest | Bin 0 -> 546 bytes
.../_versions/18446744073709551613.manifest | Bin 0 -> 464 bytes
.../_versions/18446744073709551614.manifest | Bin 0 -> 447 bytes
.../_versions/latest_version_hint.json | 0
...11001001000111077951d4cb09c0a747e1eddc25e.lance | Bin 0 -> 557 bytes
...010000110100100bcc907454fa3151c2176cb1bc4.lance | Bin 0 -> 557 bytes
...1100100111000010ab68a492fa5d2c0fa972154e5.lance | Bin 0 -> 557 bytes
.../2-ca6009ab-1db7-4777-9e3e-a9374ed947b9.txn | Bin 0 -> 122 bytes
.../2-d76280f6-7616-446b-9575-5b8ec5ea2df1.txn | 1 +
.../dev/_versions/18446744073709551612.manifest | Bin 0 -> 605 bytes
.../dev/_versions/18446744073709551613.manifest | Bin 0 -> 494 bytes
...0110110000010015e5eaf41b5892dff0697f4cbcd.lance | Bin 0 -> 414 bytes
docker/thirdparties/lance-jni-helpers.sh | 10 +-
docs/lance-jni-packaging.md | 6 +-
.../org/apache/doris/catalog/RefreshManager.java | 12 +
.../org/apache/doris/datasource/CatalogMgr.java | 6 +-
.../apache/doris/datasource/ExternalCatalog.java | 5 -
.../doris/datasource/hive/HMSExternalCatalog.java | 38 +-
.../datasource/hive/event/AddPartitionEvent.java | 3 +-
.../datasource/hive/event/AlterDatabaseEvent.java | 17 +-
.../datasource/hive/event/AlterPartitionEvent.java | 6 +-
.../datasource/hive/event/CreateDatabaseEvent.java | 3 +-
.../datasource/hive/event/DropDatabaseEvent.java | 2 +-
.../datasource/hive/event/DropPartitionEvent.java | 2 +-
.../doris/datasource/hive/event/InsertEvent.java | 4 +-
.../doris/datasource/jdbc/JdbcExternalCatalog.java | 16 +
.../doris/datasource/lance/LanceCatalogClient.java | 556 +++++++-
.../datasource/lance/LanceExternalCatalog.java | 7 +-
.../doris/datasource/lance/LanceExternalTable.java | 75 +-
.../doris/datasource/lance/LanceManifestPaths.java | 141 ++
.../datasource/lance/LanceNamespaceClient.java | 154 ++-
.../lance/metadata/LanceRefSelector.java | 75 +
.../lance/metadata/LanceSnapshotResolver.java | 141 +-
.../lance/metadata/LanceTableAccess.java | 60 +-
.../lance/metadata/LanceTableMetadata.java | 14 +
.../datasource/lance/source/LanceScanNode.java | 4 +
.../plans/commands/insert/HiveInsertExecutor.java | 12 +-
.../LanceExternalSearchTableValuedFunction.java | 20 +-
.../doris/catalog/RefreshManagerReplayTest.java | 23 +
.../apache/doris/datasource/CatalogMgrTest.java | 54 +-
.../datasource/jdbc/JdbcExternalCatalogTest.java | 10 +
.../datasource/lance/LanceManagedAccessTest.java | 168 +++
.../lance/LanceManagedVersioningTest.java | 1460 ++++++++++++++++++++
.../datasource/lance/LanceManifestPathsTest.java | 120 ++
.../datasource/lance/LanceSharedSessionTest.java | 11 +-
.../lance/LanceTableAccessCacheTest.java | 17 +
.../lance/metadata/LanceSnapshotTest.java | 211 +++
.../commands/insert/HiveInsertExecutorTest.java | 3 +-
.../VectorSearchTableValuedFunctionTest.java | 18 +
fe/pom.xml | 2 +-
.../lance/test_lance_rest_catalog.out | 10 +
.../lance/test_lance_rest_time_travel.out | 134 ++
.../lance/test_lance_time_travel.out | 141 ++
.../iceberg/test_iceberg_variant_read.groovy | 19 +-
.../lance/test_lance_rest_catalog.groovy | 4 +-
.../lance/test_lance_rest_time_travel.groovy | 294 ++++
.../lance/test_lance_time_travel.groovy | 267 ++++
70 files changed, 4687 insertions(+), 139 deletions(-)
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/lance_build_time_travel.py
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/time_travel.lance/_refs/branches/dev.json
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/time_travel.lance/_refs/tags/rel.json
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/time_travel.lance/_refs/tags/v1.json
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/time_travel.lance/_refs/tags/v2.json
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/time_travel.lance/_refs/tags/v3.json
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/time_travel.lance/_transactions/0-c7a3192f-4b4a-4e8b-b3a3-b736534c10f3.txn
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/time_travel.lance/_transactions/1-79502d42-ca15-43d2-99e3-8c734698ae2b.txn
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/time_travel.lance/_transactions/2-e678f5d6-e017-494d-adaf-fd1c0e245182.txn
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/time_travel.lance/_versions/18446744073709551612.manifest
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/time_travel.lance/_versions/18446744073709551613.manifest
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/time_travel.lance/_versions/18446744073709551614.manifest
copy {be/test/format_v2/table/lance/data/all_types.lance =>
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/time_travel.lance}/_versions/latest_version_hint.json
(100%)
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/time_travel.lance/data/01001111111001001000111077951d4cb09c0a747e1eddc25e.lance
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/time_travel.lance/data/111001110010000110100100bcc907454fa3151c2176cb1bc4.lance
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/time_travel.lance/data/1111000011100100111000010ab68a492fa5d2c0fa972154e5.lance
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/time_travel.lance/tree/dev/_transactions/2-ca6009ab-1db7-4777-9e3e-a9374ed947b9.txn
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/time_travel.lance/tree/dev/_transactions/2-d76280f6-7616-446b-9575-5b8ec5ea2df1.txn
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/time_travel.lance/tree/dev/_versions/18446744073709551612.manifest
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/time_travel.lance/tree/dev/_versions/18446744073709551613.manifest
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/preinstalled_data/lance/time_travel.lance/tree/dev/data/0010100010110110000010015e5eaf41b5892dff0697f4cbcd.lance
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/lance/LanceManifestPaths.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/lance/metadata/LanceRefSelector.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/datasource/lance/LanceManagedAccessTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/datasource/lance/LanceManagedVersioningTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/datasource/lance/LanceManifestPathsTest.java
create mode 100644
regression-test/data/external_table_p0/lance/test_lance_rest_time_travel.out
create mode 100644
regression-test/data/external_table_p0/lance/test_lance_time_travel.out
create mode 100644
regression-test/suites/external_table_p0/lance/test_lance_rest_time_travel.groovy
create mode 100644
regression-test/suites/external_table_p0/lance/test_lance_time_travel.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
