This is an automated email from the ASF dual-hosted git repository.
morningman pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
from 11276d11fc4 [opt](scan) Release instances of Segment to avoid
consuming a large amount of memory in ParallelScannerBuilder (#44189)
add 82f33c2ce77 [feat](iceberg)Supports using `rest` type catalog to read
tables in unity catalog (#43525)
No new revisions were added by this update.
Summary of changes:
be/src/io/fs/file_system.cpp | 34 +++++++----
be/src/io/fs/file_system.h | 2 +-
be/src/io/fs/local_file_system.cpp | 50 ++++++++++++++++
be/src/io/fs/local_file_system.h | 6 +-
be/src/io/fs/remote_file_system.cpp | 10 +++-
be/src/io/fs/remote_file_system.h | 8 ++-
be/src/io/fs/s3_file_system.h | 7 ++-
be/src/vec/exec/format/parquet/schema_desc.cpp | 17 ++++++
be/src/vec/exec/format/parquet/schema_desc.h | 8 +++
be/src/vec/exec/format/parquet/vparquet_reader.cpp | 6 +-
be/src/vec/exec/format/parquet/vparquet_reader.h | 2 +-
be/src/vec/exec/format/table/iceberg_reader.cpp | 48 +++++----------
be/src/vec/exec/format/table/iceberg_reader.h | 2 +-
be/test/io/fs/local_file_system_test.cpp | 50 ++++++++++++++++
.../apache/doris/datasource/ExternalCatalog.java | 6 ++
.../doris/datasource/hive/HMSExternalCatalog.java | 20 ++++---
.../datasource/iceberg/IcebergExternalCatalog.java | 3 +-
.../datasource/iceberg/IcebergMetadataCache.java | 14 ++---
.../datasource/iceberg/IcebergMetadataOps.java | 69 ++++++++++++++++------
.../iceberg/IcebergRestExternalCatalog.java | 2 -
.../datasource/iceberg/IcebergTransaction.java | 3 +-
.../operations/ExternalMetadataOperations.java | 4 +-
.../datasource/operations/ExternalMetadataOps.java | 4 ++
.../iceberg/iceberg_read_unitycatalog_table.out | 40 +++++++++++++
...oovy => iceberg_read_unitycatalog_table.groovy} | 45 +++++++-------
25 files changed, 336 insertions(+), 124 deletions(-)
create mode 100644
regression-test/data/external_table_p0/iceberg/iceberg_read_unitycatalog_table.out
copy
regression-test/suites/external_table_p0/iceberg/{test_external_catalog_iceberg_common.groovy
=> iceberg_read_unitycatalog_table.groovy} (59%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
