This is an automated email from the ASF dual-hosted git repository.
924060929 pushed a change to branch auto-pick-64160-branch-4.1
in repository https://gitbox.apache.org/repos/asf/doris.git
omit 24c9873937a [fix](fe) Fence cache invalidation and preserve replay
name semantics
omit d2773743764 [fix](fe) Fence row counts before table invalidation and
preserve drop identity
omit 82403079607 [fix](fe) Fence cold metadata retirement and scope Paimon
SDK invalidation
omit f1b09556eef [test](fe) Verify row-count fence during database
generation swap
omit 537ea2cc0cb [fix](fe) Fence external metadata invalidation at known
scopes
omit 32bd3b7b163 [fix](fe) Scope cold external database replay invalidation
omit e72b0d3bd59 [fix](fe) Fence external row counts across cache refreshes
omit 7a2473944d8 [fix](fe) Invalidate external row count cache after
metadata changes
add 973fef4af7a branch-4.1: [fix](function) correct misleading aliases for
FunctionNextDay and FunctionPreviousDay #68528 (#68542)
add d1621124131 branch-4.1: [improvement](build) Avoid unnecessary
submodule initialization (#68533) (#68534)
add 54c1d1ae196 branch-4.1: [fix](s3) Keep the response stream usable when
an error body overflows the read buffer (#68544)
add f7332edd69f [fix](external) Preserve external binary and timestamp
mappings (#68532)
add a54df4cd043 [fix](be) Backport Boolean top-N support to branch-4.1
(#68409)
add b190e3cec38 [feat](inverted-index) Backport IK custom analyzers to
branch-4.1 (#68550)
add c2680189917 branch-4.1: [fix](fe) Bump vulnerable FE dependency
versions (#68557)
add 5c964a0ab28 branch-4.1: [test](cloud) Make SyncExecutor delay test
deterministic (#68145) (#68586)
add 16e674d579a branch-4.1: [fix](cloud) Preserve clone source mappings
for deleted instances #68343 (#68570)
add dee10ac4fbe [fix](iceberg) Bind historical scan specs to the selected
schema (#68568)
add 4750b1c988f branch-4.1: [improve](profile) Skip _init_profile in
load_v1 when enable_profile is false #61131 (#62801)
add ee719bc8ae5 [fix](fe) Invalidate external row count cache after
metadata changes
add c8cd86d30c1 [fix](fe) Fence external row counts across cache refreshes
add e8d7bfe0a88 [fix](fe) Scope cold external database replay invalidation
add 5a802427a46 [fix](fe) Fence external metadata invalidation at known
scopes
add a7a9e5431cc [test](fe) Verify row-count fence during database
generation swap
add 0c025c924c0 [fix](fe) Fence cold metadata retirement and scope Paimon
SDK invalidation
add 0cca01ee793 [fix](fe) Fence row counts before table invalidation and
preserve drop identity
add 3ca7f2e22a7 [fix](fe) Fence cache invalidation and preserve replay
name semantics
add 3d33dba7ab2 [fix](fe) Preserve resolved external drop targets in
replay logs
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (24c9873937a)
\
N -- N -- N refs/heads/auto-pick-64160-branch-4.1 (3d33dba7ab2)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
AGENTS.md | 5 +
be/src/cloud/cloud_tablets_channel.cpp | 4 +-
.../data_type_serde/data_type_datetimev2_serde.cpp | 23 +
.../data_type_serde/data_type_datetimev2_serde.h | 5 +
.../data_type_serde/data_type_string_serde.cpp | 7 +-
.../data_type_timestamptz_serde.cpp | 23 +
.../data_type_serde/data_type_timestamptz_serde.h | 5 +
.../data_type_serde/data_type_varbinary_serde.cpp | 20 +
.../data_type_serde/data_type_varbinary_serde.h | 5 +
.../sink/writer/iceberg/partition_transformers.cpp | 75 +-
.../sink/writer/iceberg/partition_transformers.h | 219 +-
.../sink/writer/iceberg/viceberg_table_writer.cpp | 125 +-
.../sink/writer/iceberg/viceberg_table_writer.h | 2 +
.../aggregate/aggregate_function_topn_array.cpp | 9 +-
.../aggregate/aggregate_function_topn_weighted.cpp | 9 +-
.../function_date_or_datetime_computation.h | 4 +-
be/src/exprs/function/function_search.cpp | 25 +
be/src/exprs/function/function_search.h | 10 +
be/src/exprs/function/match.cpp | 24 +-
.../function/variant_inverted_index_search.cpp | 37 +
.../exprs/function/variant_inverted_index_search.h | 5 +
be/src/exprs/vmatch_predicate.cpp | 53 +-
be/src/exprs/vmatch_predicate.h | 4 +
be/src/io/fs/err_utils.cpp | 9 +-
be/src/io/fs/s3_common.h | 145 +-
be/src/io/fs/s3_file_reader.cpp | 10 +-
be/src/io/fs/s3_obj_storage_client.cpp | 14 +-
be/src/load/channel/load_channel.cpp | 19 +-
be/src/load/channel/tablets_channel.cpp | 10 +-
be/src/load/delta_writer/delta_writer.cpp | 6 +-
be/src/load/memtable/memtable_writer.cpp | 3 +
be/src/runtime/index_policy/index_policy_mgr.cpp | 286 ++-
be/src/runtime/index_policy/index_policy_mgr.h | 29 +-
.../index/inverted/analysis_factory_mgr.cpp | 7 +-
.../storage/index/inverted/analyzer/analyzer.cpp | 64 +-
be/src/storage/index/inverted/analyzer/analyzer.h | 6 +-
.../analyzer_provider.h} | 24 +-
.../index/inverted/analyzer/custom_analyzer.cpp | 28 +-
.../index/inverted/analyzer/custom_analyzer.h | 19 +-
.../inverted/analyzer/custom_analyzer_config.cpp | 6 +-
.../inverted/analyzer/custom_analyzer_config.h | 7 +-
.../index/inverted/analyzer/ik/IKTokenizer.cpp | 120 +-
.../index/inverted/analyzer/ik/IKTokenizer.h | 23 +-
.../inverted/analyzer/ik/core/AnalyzeContext.cpp | 4 +-
.../index/inverted/char_filter/char_filter.h | 20 +-
.../char_filter/icu_normalizer_char_filter.cpp | 61 +-
.../char_filter/icu_normalizer_char_filter.h | 9 +
.../index/inverted/inverted_index_iterator.cpp | 244 +--
.../index/inverted/inverted_index_iterator.h | 30 +-
.../index/inverted/inverted_index_parser.cpp | 155 +-
.../storage/index/inverted/inverted_index_parser.h | 75 +-
.../index/inverted/inverted_index_query_type.h | 7 +
.../index/inverted/inverted_index_reader.cpp | 7 +-
.../index/inverted/inverted_index_selector.cpp | 149 ++
.../index/inverted/inverted_index_selector.h | 58 +
.../index/inverted/inverted_index_writer.cpp | 40 +-
.../storage/index/inverted/inverted_index_writer.h | 9 +
.../inverted/token_filter/ascii_folding_filter.cpp | 65 +-
.../inverted/token_filter/ascii_folding_filter.h | 16 +-
.../token_filter/icu_normalizer_filter.cpp | 40 +-
.../inverted/token_filter/icu_normalizer_filter.h | 11 +-
.../inverted/token_filter/lower_case_filter.h | 71 +-
.../index/inverted/token_filter/pinyin_filter.cpp | 239 ++-
.../index/inverted/token_filter/pinyin_filter.h | 46 +-
.../token_filter/pinyin_filter_factory.cpp | 5 +-
.../index/inverted/token_filter/token_filter.h | 41 +-
.../token_filter/word_delimiter_filter.cpp | 173 +-
.../inverted/token_filter/word_delimiter_filter.h | 60 +-
be/src/storage/index/inverted/token_stream.h | 49 +
.../inverted/tokenizer/basic/basic_tokenizer.cpp | 7 +-
.../inverted/tokenizer/char/char_tokenizer.cpp | 5 +-
.../tokenizer/empty/empty_tokenizer_factory.h | 5 +-
.../index/inverted/tokenizer/icu/icu_tokenizer.cpp | 62 +
.../index/inverted/tokenizer/icu/icu_tokenizer.h | 14 +-
.../ik/ik_tokenizer_factory.h} | 32 +-
.../inverted/tokenizer/keyword/keyword_tokenizer.h | 9 +-
.../inverted/tokenizer/ngram/ngram_tokenizer.cpp | 11 +
.../inverted/tokenizer/ngram/ngram_tokenizer.h | 2 +-
.../inverted/tokenizer/pinyin/pinyin_tokenizer.cpp | 115 +-
.../inverted/tokenizer/pinyin/pinyin_tokenizer.h | 16 +
.../inverted/tokenizer/pinyin/smart_get_word.cpp | 56 +-
.../tokenizer/standard/standard_tokenizer.h | 11 +-
.../tokenizer/standard/standard_tokenizer_impl.h | 9 +-
.../storage/index/inverted/tokenizer/tokenizer.h | 159 +-
be/src/storage/predicate_collector.cpp | 142 +-
be/src/storage/predicate_collector.h | 9 +
be/src/storage/rowset_builder.cpp | 6 +-
.../data_type_serde/data_type_serde_arrow_test.cpp | 55 +-
.../writer/iceberg/partition_transformers_test.cpp | 185 +-
.../writer/iceberg/viceberg_table_writer_test.cpp | 243 +++
be/test/exprs/aggregate/agg_topn_boolean_test.cpp | 117 +
.../exprs/function/function_search_nested_test.cpp | 34 +
be/test/exprs/function/function_search_test.cpp | 52 +-
...eberg_position_delete_sys_table_reader_test.cpp | 36 +
be/test/io/fs/s3_response_stream_test.cpp | 189 ++
.../runtime/index_policy/index_policy_mgr_test.cpp | 333 ++-
.../compaction/collection_statistics_test.cpp | 136 ++
.../index/inverted/analysis_factory_mgr_test.cpp | 7 +-
.../index/inverted/analyzer/ik_anayzer_test.cpp | 119 +
.../icu_normalizer_char_filter_factory_test.cpp | 58 +-
.../icu_normalizer_filter_factory_test.cpp | 71 +-
.../inverted/token_filter/pinyin_filter_test.cpp | 1475 +++++++++++++
.../token_filter/word_delimiter_filter_test.cpp | 42 +
.../tokenizer/icu_tokenizer_factory_test.cpp | 105 +-
.../inverted/tokenizer/keyword_analyzer_test.cpp | 33 +-
.../inverted/tokenizer/ngram_tokenizer_test.cpp | 57 +-
.../storage/index/inverted_index_parser_test.cpp | 147 +-
.../segment/inverted_index_iterator_test.cpp | 573 ++++-
.../storage/segment/inverted_index_reader_test.cpp | 65 +
.../storage/segment/inverted_index_writer_test.cpp | 155 ++
cloud/src/resource-manager/resource_manager.cpp | 9 -
cloud/test/clone_chain_reader_test.cpp | 62 +
cloud/test/resource_test.cpp | 10 +-
cloud/test/util_test.cpp | 85 +-
.../apache/doris/hudi/HadoopHudiColumnValue.java | 36 +-
.../doris/hudi/HadoopHudiColumnValueTest.java | 98 +
fe/be-java-extensions/jdbc-scanner/pom.xml | 5 +
.../org/apache/doris/jdbc/BaseJdbcExecutor.java | 14 +-
.../apache/doris/jdbc/ClickHouseJdbcExecutor.java | 39 +-
.../org/apache/doris/jdbc/MySQLJdbcExecutor.java | 33 +-
.../org/apache/doris/jdbc/OracleJdbcExecutor.java | 16 +-
.../apache/doris/jdbc/PostgreSQLJdbcExecutor.java | 34 +-
.../apache/doris/jdbc/SQLServerJdbcExecutor.java | 16 +
.../org/apache/doris/jdbc/TrinoJdbcExecutor.java | 35 +
.../jdbc-scanner/src/test/README.md | 69 +
.../apache/doris/jdbc/JdbcTimestampBindTest.java | 110 +
.../doris/jdbc/JdbcTimestampSemanticsTest.java | 320 +++
.../jdbc/JdbcZonedTimestampIntegrationTest.java | 374 ++++
.../doris/jdbc/MySqlTimestampIntegrationTest.java | 167 ++
.../max-compute-connector/pom.xml | 3 +-
.../doris/maxcompute/MaxComputeColumnValue.java | 4 +-
.../doris/maxcompute/MaxComputeJniWriter.java | 39 +-
.../doris/maxcompute/MaxComputeJniWriterTest.java | 80 +
.../trinoconnector/TrinoConnectorColumnValue.java | 4 +-
.../TrinoTimestampSemanticsTest.java | 61 +
fe/check/checkstyle/suppressions.xml | 2 +
.../apache/doris/alter/SchemaChangeHandler.java | 6 +
.../apache/doris/analysis/AnalyzerSelector.java | 13 +-
.../doris/analysis/InvertedIndexProperties.java | 198 ++
.../apache/doris/analysis/InvertedIndexUtil.java | 131 +-
.../org/apache/doris/analysis/MatchPredicate.java | 3 +-
.../invertedindex/AnalyzerIdentityBuilder.java | 1317 +++++++++++-
.../invertedindex/AnalyzerKeyNormalizer.java | 3 +-
.../main/java/org/apache/doris/catalog/Env.java | 7 +-
.../org/apache/doris/catalog/JdbcResource.java | 4 +-
.../java/org/apache/doris/catalog/OlapTable.java | 10 +
.../org/apache/doris/datasource/CatalogMgr.java | 50 +-
.../apache/doris/datasource/CatalogProperty.java | 32 +-
.../apache/doris/datasource/ExternalCatalog.java | 41 +-
.../doris/datasource/ExternalMetaCacheMgr.java | 54 +-
.../doris/datasource/hive/HMSExternalTable.java | 6 +-
.../datasource/hive/HiveMetaStoreClientHelper.java | 7 +-
.../doris/datasource/hive/HiveMetadataOps.java | 12 +-
.../apache/doris/datasource/hudi/HudiUtils.java | 14 +-
.../doris/datasource/hudi/source/HudiScanNode.java | 7 +
.../datasource/iceberg/IcebergMetadataOps.java | 16 +-
.../doris/datasource/iceberg/IcebergUtils.java | 108 +-
.../iceberg/IcebergWriteSchemaContext.java | 20 +-
.../datasource/iceberg/source/IcebergScanNode.java | 50 +-
.../doris/datasource/jdbc/JdbcExternalCatalog.java | 1 -
.../jdbc/client/JdbcClickHouseClient.java | 5 +-
.../doris/datasource/jdbc/client/JdbcClient.java | 2 -
.../datasource/jdbc/client/JdbcClientConfig.java | 21 +-
.../datasource/jdbc/client/JdbcDB2Client.java | 3 +-
.../datasource/jdbc/client/JdbcMySQLClient.java | 7 +-
.../datasource/jdbc/client/JdbcOracleClient.java | 13 +-
.../jdbc/client/JdbcPostgreSQLClient.java | 10 +-
.../jdbc/client/JdbcSQLServerClient.java | 7 +-
.../datasource/jdbc/client/JdbcTrinoClient.java | 4 +-
.../doris/datasource/jdbc/source/JdbcScanNode.java | 85 +-
.../doris/datasource/maxcompute/MCTransaction.java | 3 +-
.../maxcompute/MaxComputeExternalTable.java | 2 +
.../maxcompute/MaxComputeMetadataOps.java | 15 +-
.../maxcompute/source/MaxComputeScanNode.java | 4 +
.../datasource/operations/ExternalMetadataOps.java | 25 +-
.../paimon/DorisToPaimonTypeVisitor.java | 9 +-
.../doris/datasource/paimon/PaimonMetadataOps.java | 14 +-
.../apache/doris/datasource/paimon/PaimonUtil.java | 33 +-
.../datasource/paimon/PaimonWriteBinding.java | 32 +-
.../doris/datasource/paimon/PaimonWriteTarget.java | 4 +-
.../datasource/paimon/source/PaimonScanNode.java | 81 +-
.../property/fileformat/FileFormatProperties.java | 6 +-
.../TrinoConnectorExternalTable.java | 3 +-
.../source/TrinoConnectorPredicateConverter.java | 31 +-
.../org/apache/doris/indexpolicy/IndexPolicy.java | 18 +-
.../apache/doris/indexpolicy/IndexPolicyMgr.java | 355 ++-
.../apache/doris/job/util/StreamingJobUtils.java | 19 +
.../glue/translator/ExpressionTranslator.java | 4 +
.../doris/nereids/trees/expressions/Match.java | 6 +-
.../expressions/literal/VarBinaryLiteral.java | 6 +
.../trees/plans/commands/info/BaseViewInfo.java | 4 -
.../trees/plans/commands/info/CreateIndexOp.java | 6 +
.../insert/InsertOverwriteTableCommand.java | 8 +-
.../org/apache/doris/nereids/types/DataType.java | 10 +-
.../doris/nereids/util/TypeCoercionUtils.java | 80 +-
.../java/org/apache/doris/persist/DropDbInfo.java | 12 +
.../java/org/apache/doris/persist/DropInfo.java | 12 +
.../java/org/apache/doris/persist/EditLog.java | 2 +-
.../org/apache/doris/planner/IcebergTableSink.java | 10 +-
.../CdcStreamTableValuedFunction.java | 2 +
.../ExternalFileTableValuedFunction.java | 10 +-
.../org/apache/iceberg/DorisDataTableScan.java | 71 +
.../doris/alter/SchemaChangeHandlerTest.java | 545 ++++-
.../analysis/InvertedIndexPropertiesTest.java | 1010 +++++++++
.../invertedindex/AnalyzerIdentityBuilderTest.java | 2266 +++++++++++++++++++-
.../org/apache/doris/catalog/CreateViewTest.java | 9 +-
.../apache/doris/datasource/CatalogMgrTest.java | 86 +
.../doris/datasource/CatalogPropertyTest.java | 28 +
.../datasource/CatalogVarbinaryMigrationTest.java | 232 ++
.../ExternalMetaCacheRouteResolverTest.java | 29 +
.../datasource/ExternalTimestampMappingTest.java | 117 +
.../datasource/hive/HMSExternalTableTest.java | 26 +
.../datasource/hudi/source/HudiScanNodeTest.java | 9 +
.../iceberg/IcebergExternalMetaCacheTest.java | 4 +-
.../iceberg/IcebergMetadataOpsValidationTest.java | 14 +-
.../iceberg/IcebergSchemaDisplayTest.java | 8 +-
.../iceberg/IcebergSysExternalTableTest.java | 7 +-
.../datasource/iceberg/IcebergTransactionTest.java | 19 +
.../doris/datasource/iceberg/IcebergUtilsTest.java | 235 +-
.../iceberg/IcebergWriteSchemaContextTest.java | 71 +-
.../iceberg/helper/IcebergWriterHelperTest.java | 25 +
.../iceberg/source/IcebergScanNodeTest.java | 197 +-
.../datasource/jdbc/client/JdbcClientTest.java | 91 +
.../datasource/jdbc/source/JdbcScanNodeTest.java | 91 +
.../jdbc/source/JdbcTimestampProjectionTest.java | 163 ++
.../maxcompute/MaxComputeExternalTableTest.java | 6 +
.../paimon/PaimonExternalMetaCacheTest.java | 7 +-
.../datasource/paimon/PaimonMetadataOpsTest.java | 16 +
.../doris/datasource/paimon/PaimonUtilTest.java | 73 +-
.../datasource/paimon/PaimonWriteBindingTest.java | 62 +
.../datasource/paimon/PaimonWriteTargetTest.java | 20 +
.../paimon/source/PaimonScanNodeTest.java | 100 +
.../TrinoConnectorPredicateTest.java | 32 +
.../doris/indexpolicy/PolicyValidatorTests.java | 439 +++-
.../doris/job/util/StreamingJobUtilsTest.java | 53 +
.../glue/translator/ExpressionTranslatorTest.java | 37 +
.../insert/IcebergStaticPartitionLiteralTest.java | 62 +
.../nereids/types/VarBinarySqlSupportTest.java | 181 ++
.../doris/persist/DropAndRecoverInfoTest.java | 13 +
.../org/apache/doris/persist/DropDbInfoTest.java | 13 +
.../apache/doris/planner/IcebergTableSinkTest.java | 47 +
.../CdcStreamTableValuedFunctionTest.java | 38 +-
.../ExternalFileTableValuedFunctionTest.java | 16 +
fe/pom.xml | 26 +-
gensrc/thrift/DataSinks.thrift | 2 +
.../hive/hive_json_basic_test.out | 12 +-
.../external_table_p0/hive/test_complex_types.out | 2 +-
.../hive/test_hive_basic_type.out | 72 +-
.../hive/test_hive_get_schema_from_table.out | 4 +-
.../data/external_table_p0/hive/test_hive_orc.out | 1240 +++++------
.../hive/test_hive_varbinary_type.out | 108 +-
.../hive/write/test_hive_text_write_insert.out | 820 +++----
.../hive/write/test_hive_write_insert.out | 224 +-
.../hive/write/test_hive_write_partitions.out | 96 +-
.../test_external_catalog_iceberg_partition.out | 82 +-
.../iceberg/test_gen_iceberg_by_api.out | 8 +-
.../iceberg/test_iceberg_initial_defaults.out | 32 +-
.../iceberg/test_iceberg_predicate_conversion.out | 8 +-
.../iceberg/test_iceberg_statistics.out | 6 +-
.../iceberg/test_iceberg_sys_table.out | 104 +-
.../iceberg/test_iceberg_transform_partitions.out | 9 +-
.../iceberg/test_iceberg_varbinary.out | 28 +-
.../test_iceberg_write_partition_types_null.out | 2 +-
.../write/test_iceberg_write_timestamp_ntz.out | 7 +-
.../jdbc/test_clickhouse_jdbc_catalog.out | 50 +-
.../external_table_p0/jdbc/test_jdbc_query_tvf.out | 8 +-
.../jdbc/test_mariadb_jdbc_catalog.out | 8 +-
.../jdbc/test_mysql_jdbc_catalog.out | 57 +-
.../jdbc/test_mysql_jdbc_catalog_nereids.out | 5 +-
.../jdbc/test_pg_jdbc_catalog.out | 28 +-
.../type_test/ctas/test_mysql_all_types_ctas.out | 12 +-
.../select/test_clickhouse_all_types_select.out | 13 +-
.../select/test_mysql_all_types_select.out | 24 +-
.../type_test/select/test_pg_all_types_select.out | 14 +-
.../type_test/tvf/test_mysql_all_types_tvf.out | 25 +-
.../paimon/paimon_base_filesystem.out | 16 +-
.../paimon/paimon_timestamp_types.out | 57 +-
.../paimon/test_paimon_catalog.out | 569 +++--
.../paimon/test_paimon_catalog_varbinary.out | 5 +-
.../external_table_p0/paimon/test_paimon_minio.out | 17 +-
.../paimon/test_paimon_statistics.out | 1 -
.../paimon/test_paimon_table_properties.out | 3 +-
.../test_paimon_timestamp_with_time_zone.out | 19 +-
.../paimon/write/test_paimon_write_types.out | 11 +-
.../trino_connector/jdbc/test_trino_mysql.out | 25 +-
.../tvf/orc_tvf/test_hdfs_orc_group4_orc_files.out | 2 +-
.../tvf/test_hdfs_parquet_group1.out | 4 +-
.../tvf/test_hdfs_parquet_group2.out | 38 +-
.../tvf/test_hdfs_parquet_group6.out | 26 +-
.../data/external_table_p0/upgrade/test.out | 52 +-
.../analyzer/test_analyzer_identity_semantics.out | 26 +
.../analyzer/test_ik_custom_analyzer.out | 13 +
.../agg_function/topn/topn_boolean.out | 27 +
.../datatype_p0/test_varbinary_sql_support.groovy | 87 +
.../hive/test_hive_basic_type.groovy | 3 +-
.../external_table_p0/hive/test_hive_orc.groovy | 32 +-
.../hive/test_hive_statistics_all_type_p0.groovy | 13 +-
.../hive/test_hive_varbinary_type.groovy | 7 +-
.../action/test_iceberg_execute_actions.groovy | 29 +-
.../test_external_catalog_iceberg_partition.groovy | 4 +-
.../iceberg/test_gen_iceberg_by_api.groovy | 3 +
.../test_iceberg_export_timestamp_tz.groovy | 3 +
.../test_iceberg_historical_filter_planning.groovy | 116 +
.../iceberg/test_iceberg_initial_defaults.groovy | 7 +-
.../test_iceberg_predicate_conversion.groovy | 3 +
...iceberg_runtime_filter_partition_pruning.groovy | 21 +-
...ntime_filter_partition_pruning_transform.groovy | 33 +-
.../iceberg/test_iceberg_statistics.groovy | 2 +
.../iceberg/test_iceberg_sys_table.groovy | 6 +-
.../iceberg/test_iceberg_timestamp_tz.groovy | 3 +-
.../test_iceberg_transform_partitions.groovy | 16 +-
.../iceberg/test_iceberg_varbinary.groovy | 4 +-
.../test_iceberg_static_partition_overwrite.groovy | 39 +
.../test_iceberg_write_binary_partitions.groovy | 81 +
.../test_iceberg_write_partition_types_null.groovy | 1 +
.../write/test_iceberg_write_timestamp_ntz.groovy | 9 +-
.../test_iceberg_write_timestamp_partitions.groovy | 98 +
.../jdbc/test_clickhouse_jdbc_catalog.groovy | 46 +-
.../jdbc/test_jdbc_query_tvf.groovy | 3 +
.../jdbc/test_mariadb_jdbc_catalog.groovy | 6 +-
.../jdbc/test_mysql_jdbc_catalog.groovy | 20 +-
.../jdbc/test_mysql_jdbc_catalog_nereids.groovy | 5 +
.../jdbc/test_pg_jdbc_catalog.groovy | 3 +
.../ctas/test_mysql_all_types_ctas.groovy | 3 +
.../select/test_clickhouse_all_types_select.groovy | 3 +
.../select/test_mysql_all_types_select.groovy | 9 +
.../select/test_pg_all_types_select.groovy | 48 +
.../type_test/tvf/test_mysql_all_types_tvf.groovy | 3 +
.../paimon/paimon_timestamp_types.groovy | 56 +-
.../paimon/test_paimon_catalog.groovy | 4 +-
.../paimon/test_paimon_catalog_varbinary.groovy | 9 +-
.../paimon/test_paimon_minio.groovy | 5 +-
.../paimon/test_paimon_table_properties.groovy | 2 +-
.../paimon/write/test_paimon_write_types.groovy | 49 +-
.../trino_connector/jdbc/test_trino_mysql.groovy | 9 +-
.../orc_tvf/test_hdfs_orc_group4_orc_files.groovy | 5 +
.../tvf/test_hdfs_parquet_group1.groovy | 5 +
.../tvf/test_hdfs_parquet_group2.groovy | 5 +
.../tvf/test_hdfs_parquet_group6.groovy | 5 +
.../suites/external_table_p0/upgrade/test.groovy | 3 +-
.../test_analyzer_identity_semantics.groovy | 421 ++++
.../test_analyzer_malformed_utf8_write.groovy | 110 +
.../analyzer/test_ik_custom_analyzer.groovy | 381 ++++
.../suites/mtmv_p0/test_iceberg_mtmv.groovy | 5 +-
.../agg_function/topn/topn_boolean.groovy | 78 +
345 files changed, 21902 insertions(+), 3626 deletions(-)
create mode 100644 AGENTS.md
copy be/src/storage/index/inverted/{token_filter/token_filter.h =>
analyzer/analyzer_provider.h} (66%)
create mode 100644 be/src/storage/index/inverted/inverted_index_selector.cpp
create mode 100644 be/src/storage/index/inverted/inverted_index_selector.h
copy be/src/storage/index/inverted/{token_filter/icu_normalizer_filter.h =>
tokenizer/ik/ik_tokenizer_factory.h} (51%)
create mode 100644 be/test/exprs/aggregate/agg_topn_boolean_test.cpp
create mode 100644 be/test/io/fs/s3_response_stream_test.cpp
create mode 100644
fe/be-java-extensions/hadoop-hudi-scanner/src/test/java/org/apache/doris/hudi/HadoopHudiColumnValueTest.java
create mode 100644 fe/be-java-extensions/jdbc-scanner/src/test/README.md
create mode 100644
fe/be-java-extensions/jdbc-scanner/src/test/java/org/apache/doris/jdbc/JdbcTimestampBindTest.java
create mode 100644
fe/be-java-extensions/jdbc-scanner/src/test/java/org/apache/doris/jdbc/JdbcTimestampSemanticsTest.java
create mode 100644
fe/be-java-extensions/jdbc-scanner/src/test/java/org/apache/doris/jdbc/JdbcZonedTimestampIntegrationTest.java
create mode 100644
fe/be-java-extensions/jdbc-scanner/src/test/java/org/apache/doris/jdbc/MySqlTimestampIntegrationTest.java
create mode 100644
fe/be-java-extensions/trino-connector-scanner/src/test/java/org/apache/doris/trinoconnector/TrinoTimestampSemanticsTest.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/analysis/InvertedIndexProperties.java
create mode 100644
fe/fe-core/src/main/java/org/apache/iceberg/DorisDataTableScan.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/analysis/InvertedIndexPropertiesTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/datasource/CatalogVarbinaryMigrationTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/datasource/ExternalTimestampMappingTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/datasource/jdbc/source/JdbcTimestampProjectionTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/trees/plans/commands/insert/IcebergStaticPartitionLiteralTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/types/VarBinarySqlSupportTest.java
create mode 100644
regression-test/data/inverted_index_p0/analyzer/test_analyzer_identity_semantics.out
create mode 100644
regression-test/data/inverted_index_p0/analyzer/test_ik_custom_analyzer.out
create mode 100644
regression-test/data/nereids_function_p0/agg_function/topn/topn_boolean.out
create mode 100644
regression-test/suites/datatype_p0/test_varbinary_sql_support.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/test_iceberg_historical_filter_planning.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/write/test_iceberg_write_binary_partitions.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/write/test_iceberg_write_timestamp_partitions.groovy
create mode 100644
regression-test/suites/inverted_index_p0/analyzer/test_analyzer_identity_semantics.groovy
create mode 100644
regression-test/suites/inverted_index_p0/analyzer/test_analyzer_malformed_utf8_write.groovy
create mode 100644
regression-test/suites/inverted_index_p0/analyzer/test_ik_custom_analyzer.groovy
create mode 100644
regression-test/suites/nereids_function_p0/agg_function/topn/topn_boolean.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
