This is an automated email from the ASF dual-hosted git repository.
dataroaring pushed a change to branch branch-3.0
in repository https://gitbox.apache.org/repos/asf/doris.git
from 4d263f08409 [chore](table property) forbid changing
enable_single_replica_compaction property for mow table (#34836)
new 128df04effb [refactor](jdbc catalog) split trino jdbc executor (#34932)
new 0f2d8c7d442 [improvement](jdbc catalog) remove useless jdbc catalog
code (#34986)
new ccb981a14aa [fix](Nereids) LogicalEmptyRelation type is wrong (#35382)
new 9967a19fbab [Update](regression) add case for inverted index (#35305)
new 519ad783b6b [Fix](inverted index) fix build index wrong size for
inverted index (#35366)
new 9013cbcd102 [Fix](trino-connector) Fix the properties' key for
trino-connector (#35377)
new 76d09b2210b [Fix](trino-connector) When an exception occurs, the query
may not be cleared (#35367)
new 04f00ee07e9 [fix](load) fix wrong assert and cancel load error (#35352)
new 682104bcd7b [bugfix](hive)fix testcase for
test_hive_write_different_path (#35209)
new 6edf27efbbd [bugfix](hive)Misspelling of class names (#34981)
new e417d192eb1 [Fix](hive-writer) Fix hive partition update core. (#35311)
new 03e430a4b17 [Configurations](multi-catalog)Fix
enable_orc_filter_by_min_max functionality, the mistake for #35012. (#35320)
new 7a6a3787e48 [Chore](materialized-view) forbid create mv on row store
table (#35360)
new 14c506fcc0e [Fix](multi-catalog) Fix string dict filtering when use
null related function in parquet and orc reader. (#35335)
new 4965e42803b [Chore](column) support all column method on
column_fixed_object and remove some method about IColumn (#35136)
new 632ac70bb81 [Feature](topn) support general expr with topn filter and
some refactor (#35405)
new f15c8e93dce [fix](Nereids): avoid memory usage due to multiple
iterations when eliminate func deps (#35408)
new 23cd69359eb [fix](hint) fix hint tests with different be instances
(#35188)
The 18 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
be/src/olap/iterators.h | 3 +-
be/src/olap/rowset/beta_rowset_reader.cpp | 2 +-
be/src/olap/rowset/rowset_reader_context.h | 3 +-
be/src/olap/rowset/segment_v2/column_reader.cpp | 2 +-
be/src/olap/rowset/segment_v2/segment.cpp | 9 +-
be/src/olap/rowset/segment_v2/segment_iterator.cpp | 33 +-
be/src/olap/tablet_reader.cpp | 15 +-
be/src/olap/tablet_reader.h | 3 +-
be/src/olap/task/index_builder.cpp | 2 +-
be/src/pipeline/exec/file_scan_operator.cpp | 2 +-
be/src/pipeline/exec/olap_scan_operator.h | 4 +-
be/src/pipeline/exec/scan_operator.cpp | 39 +-
be/src/pipeline/exec/scan_operator.h | 14 +-
be/src/pipeline/exec/sort_sink_operator.cpp | 33 +-
be/src/pipeline/exec/sort_sink_operator.h | 1 -
be/src/pipeline/pipeline_fragment_context.cpp | 6 +-
be/src/runtime/query_context.h | 17 +-
be/src/runtime/runtime_predicate.cpp | 125 ++-
be/src/runtime/runtime_predicate.h | 137 +--
be/src/runtime/runtime_state.cpp | 8 -
.../aggregate_functions/aggregate_function_avg.h | 2 +-
.../aggregate_function_avg_weighted.h | 4 +-
.../aggregate_functions/aggregate_function_covar.h | 8 +-
.../aggregate_function_percentile.h | 46 +-
.../aggregate_function_percentile_approx.h | 8 +-
.../aggregate_function_stddev.h | 8 +-
be/src/vec/columns/column.h | 71 +-
be/src/vec/columns/column_array.cpp | 37 -
be/src/vec/columns/column_array.h | 24 +-
be/src/vec/columns/column_complex.h | 42 -
be/src/vec/columns/column_const.cpp | 21 -
be/src/vec/columns/column_const.h | 18 -
be/src/vec/columns/column_decimal.cpp | 14 -
be/src/vec/columns/column_decimal.h | 35 -
be/src/vec/columns/column_dictionary.h | 28 -
be/src/vec/columns/column_dummy.h | 18 -
be/src/vec/columns/column_filter_helper.cpp | 5 -
be/src/vec/columns/column_filter_helper.h | 1 -
be/src/vec/columns/column_fixed_length_object.h | 107 +-
be/src/vec/columns/column_impl.h | 41 -
be/src/vec/columns/column_map.h | 10 -
be/src/vec/columns/column_nullable.cpp | 6 -
be/src/vec/columns/column_nullable.h | 44 +-
be/src/vec/columns/column_object.cpp | 10 +-
be/src/vec/columns/column_object.h | 20 -
be/src/vec/columns/column_string.cpp | 43 -
be/src/vec/columns/column_string.h | 23 -
be/src/vec/columns/column_struct.cpp | 10 -
be/src/vec/columns/column_struct.h | 11 -
be/src/vec/columns/column_vector.cpp | 15 -
be/src/vec/columns/column_vector.h | 41 -
be/src/vec/columns/columns_common.cpp | 29 -
be/src/vec/columns/columns_common.h | 46 -
be/src/vec/columns/predicate_column.h | 43 -
be/src/vec/core/block.cpp | 1 -
.../vec/data_types/serde/data_type_time_serde.cpp | 4 +-
be/src/vec/exec/format/orc/vorc_reader.cpp | 24 +-
.../exec/format/parquet/vparquet_group_reader.cpp | 22 +-
.../format/table/trino_connector_jni_reader.cpp | 3 +-
be/src/vec/exec/scan/new_olap_scanner.cpp | 6 +-
be/src/vec/exec/vjdbc_connector.cpp | 246 +----
be/src/vec/exec/vjdbc_connector.h | 13 -
be/src/vec/exec/vsort_node.cpp | 40 +-
be/src/vec/exec/vsort_node.h | 1 -
be/src/vec/exprs/vtopn_pred.h | 20 +-
.../vec/functions/array/function_array_distance.h | 17 +-
.../array/function_array_first_or_last_index.cpp | 6 +-
.../vec/functions/array/function_array_shuffle.cpp | 3 +-
be/src/vec/functions/function_case.h | 11 +-
.../function_date_or_datetime_computation.cpp | 54 +-
.../function_date_or_datetime_computation.h | 12 +-
be/src/vec/functions/function_string.h | 5 +-
be/src/vec/functions/functions_geo.cpp | 10 +-
be/src/vec/functions/functions_logical.cpp | 2 +-
be/src/vec/functions/random.cpp | 3 +-
be/src/vec/olap/vcollect_iterator.cpp | 2 +-
be/src/vec/sink/writer/vhive_partition_writer.cpp | 7 +-
be/src/vec/sink/writer/vhive_table_writer.cpp | 10 +-
.../data_types/serde/data_type_serde_pb_test.cpp | 2 +-
be/test/vec/exprs/vexpr_test.cpp | 10 +-
.../hive/scripts/create_preinstalled_table.hql | 42 +
.../test_string_dict_filter.orc | Bin 0 -> 1652 bytes
.../test_string_dict_filter.parquet | Bin 0 -> 2292 bytes
fe/be-java-extensions/java-common/pom.xml | 4 -
.../apache/doris/common/jni/utils/UdfUtils.java | 57 -
fe/be-java-extensions/jdbc-scanner/pom.xml | 17 -
.../org/apache/doris/jdbc/BaseJdbcExecutor.java | 12 -
.../apache/doris/jdbc/ClickHouseJdbcExecutor.java | 194 ++--
.../org/apache/doris/jdbc/DefaultJdbcExecutor.java | 1124 --------------------
.../org/apache/doris/jdbc/JdbcExecutorFactory.java | 5 +-
.../org/apache/doris/jdbc/TrinoJdbcExecutor.java | 161 +++
fe/be-java-extensions/preload-extensions/pom.xml | 15 -
.../trinoconnector/TrinoConnectorJniScanner.java | 8 +-
.../doris/alter/MaterializedViewHandler.java | 6 +
.../org/apache/doris/catalog/JdbcResource.java | 4 -
.../java/org/apache/doris/catalog/JdbcTable.java | 1 -
.../org/apache/doris/datasource/hive/HiveUtil.java | 2 +-
.../datasource/jdbc/client/JdbcTrinoClient.java | 4 +-
.../doris/datasource/jdbc/source/JdbcScanNode.java | 23 -
.../constants/TrinoConnectorProperties.java | 2 +-
.../TrinoConnectorExternalCatalog.java | 30 +-
.../source/TrinoConnectorScanNode.java | 32 +-
.../org/apache/doris/nereids/NereidsPlanner.java | 6 +
.../glue/translator/PhysicalPlanTranslator.java | 52 +-
.../doris/nereids/processor/post/TopNScanOpt.java | 110 +-
.../nereids/processor/post/TopnFilterContext.java | 84 +-
.../processor/post/TopnFilterPushDownVisitor.java | 233 ++++
.../apache/doris/nereids/properties/FuncDeps.java | 6 +-
.../functions/scalar/CosineDistance.java | 18 -
.../expressions/functions/scalar/InnerProduct.java | 18 -
.../expressions/functions/scalar/L1Distance.java | 18 -
.../expressions/functions/scalar/L2Distance.java | 18 -
.../trees/plans/logical/LogicalEmptyRelation.java | 2 +-
.../nereids/trees/plans/physical/TopnFilter.java | 78 ++
.../java/org/apache/doris/planner/Planner.java | 5 +
.../main/java/org/apache/doris/qe/Coordinator.java | 23 +-
.../main/java/org/apache/doris/qe/DdlExecutor.java | 8 +-
.../doris/alter/MaterializedViewHandlerTest.java | 6 +-
fe/pom.xml | 20 -
gensrc/thrift/Exprs.thrift | 2 +-
gensrc/thrift/PlanNodes.thrift | 8 +-
gensrc/thrift/Types.thrift | 1 -
.../external_table_p0/hive/ddl/test_hive_ctas.out | 184 ++++
.../hive/test_string_dict_filter.out | 229 ++++
.../hive/write/test_hive_write_different_path.out | 8 +-
.../data/inverted_index_p0/test_index_rqg_bug.out | 19 +
.../hive/ddl/test_hive_ctas.groovy | 21 +-
.../hive/test_string_dict_filter.groovy | 134 +++
.../write/test_hive_write_different_path.groovy | 61 +-
.../jdbc/test_jdbc_query_mysql.groovy | 38 +-
.../hive/test_trino_different_parquet_types.groovy | 4 +-
.../hive/test_trino_hive_orc.groovy | 8 +-
.../hive/test_trino_hive_other.groovy | 4 +-
.../hive/test_trino_hive_parquet.groovy | 4 +-
.../hive/test_trino_hive_schema_evolution.groovy | 4 +-
.../hive/test_trino_hive_serde_prop.groovy | 4 +-
.../hive/test_trino_hive_tablesample_p0.groovy | 4 +-
.../hive/test_trino_hive_tpch_sf1_orc.groovy | 4 +-
.../hive/test_trino_hive_tpch_sf1_parquet.groovy | 4 +-
.../test_trino_prepare_hive_data_in_case.groovy | 4 +-
.../inverted_index_p0/test_index_rqg_bug.groovy | 172 +++
.../broker_load/test_multi_table_load.groovy | 34 +-
.../mv_p0/test_row_store/test_row_store.groovy | 29 +-
.../suites/nereids_p0/hint/fix_leading.groovy | 3 +
.../suites/nereids_p0/hint/multi_leading.groovy | 3 +
.../suites/nereids_p0/hint/test_leading.groovy | 3 +
.../suites/nereids_tpch_p0/tpch/topn-filter.groovy | 8 +-
regression-test/suites/point_query_p0/load.groovy | 25 -
148 files changed, 2200 insertions(+), 3155 deletions(-)
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/orc_table/test_string_dict_filter_orc/test_string_dict_filter.orc
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/parquet_table/test_string_dict_filter_parquet/test_string_dict_filter.parquet
delete mode 100644
fe/be-java-extensions/jdbc-scanner/src/main/java/org/apache/doris/jdbc/DefaultJdbcExecutor.java
create mode 100644
fe/be-java-extensions/jdbc-scanner/src/main/java/org/apache/doris/jdbc/TrinoJdbcExecutor.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/processor/post/TopnFilterPushDownVisitor.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/physical/TopnFilter.java
create mode 100644
regression-test/data/external_table_p0/hive/test_string_dict_filter.out
create mode 100644
regression-test/data/inverted_index_p0/test_index_rqg_bug.out
create mode 100644
regression-test/suites/external_table_p0/hive/test_string_dict_filter.groovy
create mode 100644
regression-test/suites/inverted_index_p0/test_index_rqg_bug.groovy
copy be/src/vec/columns/column_filter_helper.h =>
regression-test/suites/mv_p0/test_row_store/test_row_store.groovy (58%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
