This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a change to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
from 60c6dfc0073 [feature](fe) support ANSI standard keyword for
CURRENT_XXX #30550
new 4418cac69d4 [Chore](workflow)delete auto-reply workflow (#30626)
new 9012098bcaa [pipelinex](profile) improve memory counter of pipelineX
(#30538)
new b92cae51af5 [tools] update tpcds test tools (#30607)
new 6634d9f2a98 [Chore](case) reset all variables at start on
set_and_unset_variable case (#30580)
new 7593c8daef6 [pipelineX](profile) Fix Tablet counter on pipelineX
engine (#30613)
new 47e86d77919 [typo](doc) Modify the alter table column document (#28645)
new ebb04cd7f4e [fix](Nereids) div priority is not right (#30575)
new ae3ee4b85c1 [docs](update) Update Doris-Streamloader docs (#30552)
new 8154b8a3f0b [typo](doc)Update flink Spark connector documentation
(#30565)
new eacef8bee7c [Feature](executor)Insert select limited by WorkloadGroup
#30610
new 7234bdce336 [Refactor][Rf] remove unless code in RF (#30597)
new b911ebc4ad8 [fix](join) incorrect result of mark join (#30543)
new c1ac82f3b7b [fix][refactor] refactor schema init of externa table and
some parquet issue (#30325)
new e4fa19bb078 [fix](insert into) 'output_tuple_slot_num should be equal
to output_expr_num' when insert into unique table with sequence column map
(#30635)
new 192c3ce43d8 [fix](statistics)Fix stats cleaner delete partition stats
bug (#30648)
new 39a6cb6e887 [fix](JDK17) The objects stored in `PriorityQueue` must
implement the `Comparable` interface (#30050) (#30625)
new be1d5a31514 [fix](compile)Fix Ambiguous regex Namespace Issue on MacOS
Compilation (#30652)
new 21d31c6dd9f Sync stats cache while task finished, doesn't need to
query column_statistics table. (#30609)
new af74c9d2aa5 [Fix](parquet-reader) Fix reading fixed length byte array
decimal in parquet reader. (#30535)
The 19 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/actions/create-or-update-comment | 1 -
.github/workflows/auto-pr-reply.yml | 40 --
.gitignore | 2 +
.gitmodules | 3 -
be/src/exprs/bloom_filter_func.h | 3 +-
be/src/exprs/runtime_filter.cpp | 95 ++---
be/src/exprs/runtime_filter.h | 6 +-
be/src/exprs/runtime_filter_slots.h | 13 +-
be/src/exprs/runtime_filter_slots_cross.h | 2 +-
be/src/olap/delete_handler.cpp | 4 +-
be/src/olap/delta_writer.cpp | 2 +-
be/src/olap/delta_writer_v2.cpp | 6 +
be/src/olap/memtable_flush_executor.cpp | 12 +
be/src/olap/memtable_flush_executor.h | 3 +
be/src/olap/memtable_writer.cpp | 11 +-
be/src/olap/memtable_writer.h | 2 +-
be/src/pipeline/exec/aggregation_sink_operator.cpp | 7 +-
be/src/pipeline/exec/aggregation_sink_operator.h | 1 -
be/src/pipeline/exec/analytic_sink_operator.cpp | 4 +-
be/src/pipeline/exec/analytic_sink_operator.h | 1 -
be/src/pipeline/exec/analytic_source_operator.cpp | 3 +-
be/src/pipeline/exec/analytic_source_operator.h | 1 -
be/src/pipeline/exec/exchange_sink_operator.cpp | 1 -
be/src/pipeline/exec/exchange_sink_operator.h | 1 -
be/src/pipeline/exec/hashjoin_build_sink.cpp | 28 +-
be/src/pipeline/exec/hashjoin_build_sink.h | 8 -
be/src/pipeline/exec/hashjoin_probe_operator.cpp | 5 +-
be/src/pipeline/exec/hashjoin_probe_operator.h | 7 -
be/src/pipeline/exec/olap_scan_operator.cpp | 4 +-
be/src/pipeline/exec/olap_scan_operator.h | 1 +
be/src/pipeline/exec/scan_operator.cpp | 11 +-
be/src/pipeline/exec/sort_sink_operator.cpp | 11 +-
be/src/pipeline/exec/sort_sink_operator.h | 2 +-
be/src/pipeline/pipeline_x/operator.cpp | 8 +-
be/src/runtime/runtime_filter_mgr.cpp | 2 +-
be/src/util/runtime_profile.cpp | 5 +-
be/src/util/runtime_profile.h | 6 +-
be/src/vec/common/hash_table/hash_map_context.h | 14 +
be/src/vec/common/hash_table/join_hash_table.h | 101 ++---
.../exec/format/parquet/fix_length_plain_decoder.h | 6 +-
be/src/vec/exec/format/parquet/vparquet_reader.cpp | 9 +-
be/src/vec/exec/join/process_hash_table_probe.h | 19 +-
.../vec/exec/join/process_hash_table_probe_impl.h | 174 ++++++---
be/src/vec/exec/join/vhash_join_node.cpp | 8 -
be/src/vec/exec/join/vhash_join_node.h | 22 +-
be/src/vec/exec/scan/new_olap_scan_node.cpp | 2 +
be/src/vec/exec/scan/new_olap_scan_node.h | 1 +
be/src/vec/sink/writer/async_result_writer.cpp | 30 +-
.../hive/scripts/create_preinstalled_table.hql | 19 +
.../fixed_length_byte_array_decimal_table/000000_0 | Bin 0 -> 200910 bytes
.../import/import-way/stream-load-manual.md | 13 +
docs/en/docs/ecosystem/doris-streamloader.md | 250 +++++++++++++
docs/en/docs/ecosystem/flink-doris-connector.md | 18 +-
docs/en/docs/ecosystem/spark-doris-connector.md | 4 +-
.../Alter/ALTER-TABLE-COLUMN.md | 398 ++++++++++++--------
docs/sidebars.json | 1 +
.../import/import-way/stream-load-manual.md | 12 +
docs/zh-CN/docs/ecosystem/doris-streamloader.md | 247 ++++++++++++
docs/zh-CN/docs/ecosystem/flink-doris-connector.md | 18 +-
docs/zh-CN/docs/ecosystem/spark-doris-connector.md | 4 +-
.../Alter/ALTER-TABLE-COLUMN.md | 414 ++++++++++++---------
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 4 +-
.../apache/doris/analysis/NativeInsertStmt.java | 5 +-
.../doris/catalog/HiveMetaStoreClientHelper.java | 2 +-
.../doris/catalog/external/HMSExternalTable.java | 73 ++--
.../catalog/external/IcebergExternalTable.java | 76 +---
.../apache/doris/datasource/InternalCatalog.java | 2 +-
.../doris/datasource/hive/HiveMetaStoreCache.java | 18 +-
.../datasource/iceberg/IcebergExternalCatalog.java | 2 +-
.../apache/doris/external/hive/util/HiveUtil.java | 44 +--
.../doris/external/iceberg/util/IcebergUtils.java | 90 ++++-
.../apache/doris/job/extensions/mtmv/MTMVTask.java | 4 +
.../planner/external/iceberg/IcebergApiSource.java | 9 +-
.../planner/external/iceberg/IcebergHMSSource.java | 4 +-
.../external/iceberg/IcebergMetadataCache.java | 80 +---
.../planner/external/iceberg/IcebergScanNode.java | 3 +-
.../main/java/org/apache/doris/qe/Coordinator.java | 31 +-
.../java/org/apache/doris/qe/StmtExecutor.java | 5 -
.../doris/resource/workloadgroup/QueueToken.java | 10 +-
.../apache/doris/service/FrontendServiceImpl.java | 12 +-
.../org/apache/doris/statistics/AnalysisJob.java | 14 -
.../apache/doris/statistics/AnalysisManager.java | 2 +-
.../apache/doris/statistics/BaseAnalysisTask.java | 12 +-
.../org/apache/doris/statistics/ColStatsData.java | 71 +++-
.../apache/doris/statistics/ColumnStatistic.java | 1 +
.../doris/statistics/ExternalAnalysisTask.java | 10 -
.../apache/doris/statistics/JdbcAnalysisTask.java | 9 -
.../apache/doris/statistics/StatisticsCache.java | 39 +-
.../apache/doris/statistics/StatisticsCleaner.java | 12 +-
.../java/org/apache/doris/statistics/StatsId.java | 11 +-
.../doris/statistics/util/StatisticsUtil.java | 2 +-
.../apache/doris/statistics/AnalysisJobTest.java | 7 -
.../org/apache/doris/statistics/CacheTest.java | 2 -
.../apache/doris/statistics/ColStatsDataTest.java | 71 ++++
gensrc/thrift/FrontendService.thrift | 3 +-
.../external_table_p0/hive/test_hive_parquet.out | 12 +
regression-test/data/nereids_arith_p0/integer.out | 414 +++++++++++----------
.../data/nereids_p0/join/test_mark_join.out | 43 +++
.../data/variable_p0/set_and_unset_variable.out | 6 +
.../test_sequence_col_default_value.groovy | 2 +-
.../test_array_zip_array_enumerate_uniq.groovy | 2 +-
.../hive/test_hive_parquet.groovy | 16 +
.../suites/nereids_arith_p0/integer.groovy | 12 +
.../suites/nereids_p0/join/test_mark_join.groovy | 126 +++++++
.../variable_p0/set_and_unset_variable.groovy | 2 +
tools/tpcds-tools/conf/opt/opt_sf1.sql | 2 -
tools/tpcds-tools/conf/opt/opt_sf100.sql | 4 +-
tools/tpcds-tools/conf/opt/opt_sf1000.sql | 5 -
tools/tpcds-tools/conf/opt/opt_sf10000.sql | 5 -
109 files changed, 2237 insertions(+), 1260 deletions(-)
delete mode 160000 .github/actions/create-or-update-comment
delete mode 100644 .github/workflows/auto-pr-reply.yml
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/parquet_table/fixed_length_byte_array_decimal_table/000000_0
create mode 100644 docs/en/docs/ecosystem/doris-streamloader.md
create mode 100644 docs/zh-CN/docs/ecosystem/doris-streamloader.md
create mode 100644 regression-test/data/nereids_p0/join/test_mark_join.out
create mode 100644 regression-test/suites/nereids_p0/join/test_mark_join.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
