This is an automated email from the ASF dual-hosted git repository.
kxiao pushed a change to branch branch-2.0
in repository https://gitbox.apache.org/repos/asf/doris.git
from 445e40006c [enhancement](jdbc catalog) Add mysql jdbc catalog function
to filter push-down identification (#21745)
new 473fa51f01 [Enhancement](binlog) Add partitionRange && indexIds in
UpsertRecord && PartitionCommitInfo (#22005)
new d6bc08879f [Fix](topn opt) forbit outfile when using 2phase read
(#21991)
new f9166b787a [fix](memory) fix mem tracker grace exit 2 (#22003)
new 6bb31b7e1d [Improve](simdjson) put unescaped string value after parsed
(#21866)
new a699b573e6 [improvement](memory) modify jemalloc conf in be.conf
(#21943)
new 3bfaa303b0 [fix](max_version) protect max_version by meta lock (#21948)
new dbfed0056f [Enhancement](http) Add HttpError to
HttpClient::execute_with_retry (#21989)
new fd9495b060 [fix](stmt-forward) fix forward null packet (#21979)
new 84a660158d [fix](Nereids) should not push down project to the nullable
side of outer join (#21999)
new 84d3edc0c8 [fix](nereids) ExtractAndNormalizeWindowExpression rule
should push down correct exprs to child (#21827)
new aafb29a92f [Refactor](exec) Remove the unless header of vresult_writer
(#22011)
new dc6517c4a1 [fix](sparkdpp) Hive table properties not take effect when
create spark session (#21881)
new ede80478ce [enhancement](Nereids) add test framework for otherjoin
(#21887)
new 632fa510b9 [enhancement](repeat) add filter in repeat node in BE
(#21984)
new 12327bd980 [opt](config) rename alter_inverted_index_worker_count to
alter_index_worker_count, and add docs (#21985)
new 35968c9956 [improvement](catalog) return the root cause of error when
forwarding init request to master FE (#22001)
new a62d45bbb7 [fix](Nereids) should not remove any limit from
uncorrelated subquery (#21976)
new 423e7f7948 [fix](stats) support utf-8 string range compare (#22024)
new 0425213545 [fix](multi-catalog) check properties when alter catalog
(#20130)
new a509a94981 [Feature](delete) support fold constant on delete stmt
(#21833)
new 864cb94566 [Improvement](profile)Add init and finalize external scan
node time in profile (#21749)
new fd6d47fc9e [fix](multi-catalog)fix minio default region and throw
minio error msg, support s3 bucket root path (#21994)
new 6eacbfb99d [Enhancement](config) optimize behavior of
default_storage_medium (#20739)
new f84dc7298f [Fix](planner)fix failed running alias function with an
alias function in original function. (#21024)
new 91c06cd287 [Fix](planner)fix ctas incorrect string types of the target
table. (#21754)
The 25 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
be/src/agent/task_worker_pool.cpp | 2 +-
be/src/common/config.cpp | 4 +-
be/src/common/config.h | 4 +-
be/src/common/status.h | 2 +
be/src/http/action/download_binlog_action.cpp | 33 +-
be/src/http/http_client.cpp | 10 +-
be/src/olap/olap_server.cpp | 6 +-
be/src/olap/snapshot_manager.cpp | 2 +-
be/src/olap/tablet.cpp | 5 +-
be/src/olap/tablet.h | 1 +
be/src/olap/task/engine_publish_version_task.cpp | 2 +-
be/src/runtime/memory/mem_tracker.cpp | 10 +-
be/src/runtime/memory/mem_tracker.h | 7 +
be/src/runtime/memory/mem_tracker_limiter.cpp | 6 +-
be/src/runtime/memory/mem_tracker_limiter.h | 14 +-
be/src/runtime/result_writer.h | 7 +
be/src/util/mem_info.h | 18 +-
be/src/util/s3_uri.cpp | 5 +-
be/src/vec/exec/format/json/new_json_reader.cpp | 13 +-
be/src/vec/exec/format/json/new_json_reader.h | 1 +
be/src/vec/exec/vrepeat_node.cpp | 2 +-
be/src/vec/runtime/vfile_result_writer.h | 4 +-
be/src/vec/sink/vmysql_result_writer.cpp | 2 +-
be/src/vec/sink/vmysql_result_writer.h | 4 +-
be/src/vec/sink/vresult_file_sink.cpp | 1 -
be/src/vec/sink/vresult_file_sink.h | 3 +-
be/src/vec/sink/vresult_sink.cpp | 1 -
be/src/vec/sink/vresult_sink.h | 5 +-
be/src/vec/sink/vresult_writer.h | 36 --
bin/start_be.sh | 13 +-
conf/be.conf | 5 +
docs/en/community/developer-guide/debug-tool.md | 47 +--
docs/en/docs/admin-manual/config/be-config.md | 5 +
docs/en/docs/advanced/alter-table/schema-change.md | 1 +
docs/en/docs/faq/install-faq.md | 2 +-
docs/en/docs/lakehouse/multi-catalog/hive.md | 1 +
docs/en/docs/lakehouse/multi-catalog/iceberg.md | 1 +
.../sql-manual/sql-functions/table-functions/s3.md | 2 +
.../Backup-and-Restore/CREATE-REPOSITORY.md | 1 +
docs/zh-CN/community/developer-guide/debug-tool.md | 47 +--
docs/zh-CN/docs/admin-manual/config/be-config.md | 5 +
.../docs/advanced/alter-table/schema-change.md | 2 +
docs/zh-CN/docs/faq/install-faq.md | 2 +-
docs/zh-CN/docs/lakehouse/multi-catalog/hive.md | 1 +
docs/zh-CN/docs/lakehouse/multi-catalog/iceberg.md | 1 +
.../sql-manual/sql-functions/table-functions/s3.md | 2 +
.../doris/maxcompute/MaxComputeTableScan.java | 12 +-
.../java/org/apache/doris/analysis/Analyzer.java | 10 +
.../java/org/apache/doris/analysis/DeleteStmt.java | 18 +-
.../main/java/org/apache/doris/analysis/Expr.java | 2 +-
.../apache/doris/analysis/FunctionCallExpr.java | 80 ++--
.../java/org/apache/doris/analysis/SelectStmt.java | 3 +-
.../java/org/apache/doris/backup/RestoreJob.java | 2 +-
.../org/apache/doris/binlog/BinlogManager.java | 4 +
.../java/org/apache/doris/binlog/UpsertRecord.java | 16 +-
.../org/apache/doris/catalog/DataProperty.java | 10 +
.../main/java/org/apache/doris/catalog/Env.java | 4 -
.../java/org/apache/doris/catalog/OlapTable.java | 2 +-
.../doris/common/profile/SummaryProfile.java | 123 +++++-
.../doris/common/util/DynamicPartitionUtil.java | 7 +-
.../apache/doris/common/util/PropertyAnalyzer.java | 20 +-
.../apache/doris/common/util/RuntimeProfile.java | 13 +-
.../java/org/apache/doris/common/util/Util.java | 18 +
.../org/apache/doris/datasource/CatalogMgr.java | 26 +-
.../apache/doris/datasource/CatalogProperty.java | 6 +
.../apache/doris/datasource/ExternalCatalog.java | 14 +-
.../apache/doris/datasource/InternalCatalog.java | 111 +++---
.../datasource/MaxComputeExternalCatalog.java | 14 +-
.../datasource/property/PropertyConverter.java | 5 +-
.../datasource/property/S3ClientBEProperties.java | 6 +-
.../property/constants/MinioProperties.java | 1 +
.../property/constants/S3Properties.java | 2 +-
.../org/apache/doris/fs/remote/S3FileSystem.java | 12 +
.../join/PushdownProjectThroughInnerOuterJoin.java | 13 +-
.../rules/rewrite/EliminateLimitUnderApply.java | 8 +-
.../ExtractAndNormalizeWindowExpression.java | 18 +-
.../expressions/literal/StringLikeLiteral.java | 4 +-
.../java/org/apache/doris/persist/EditLog.java | 2 +-
.../doris/planner/external/FileQueryScanNode.java | 27 ++
.../doris/planner/external/HiveScanNode.java | 13 +-
.../org/apache/doris/qe/MasterCatalogExecutor.java | 6 +
.../java/org/apache/doris/qe/StmtExecutor.java | 1 +
.../apache/doris/service/FrontendServiceImpl.java | 27 +-
.../org/apache/doris/system/SystemInfoService.java | 13 +-
.../doris/tablefunction/S3TableValuedFunction.java | 8 +-
.../doris/transaction/DatabaseTransactionMgr.java | 20 +-
.../doris/transaction/PartitionCommitInfo.java | 9 +-
.../analysis/CreateTableAsSelectStmtTest.java | 38 +-
.../org/apache/doris/analysis/DeleteStmtTest.java | 26 +-
.../org/apache/doris/backup/RestoreJobTest.java | 3 +-
.../CreateTableElasticOnStorageMediumTest.java | 83 ++++
.../apache/doris/catalog/ModifyBackendTest.java | 2 +-
.../apache/doris/common/util/DebugUtilTest.java | 16 +
.../apache/doris/datasource/CatalogMgrTest.java | 76 +++-
.../datasource/RoundRobinCreateTabletTest.java | 2 +-
.../doris/load/sync/canal/CanalSyncDataTest.java | 2 +-
.../jobs/joinorder/hypergraph/OtherJoinTest.java | 56 +++
.../doris/nereids/util/HyperGraphBuilder.java | 416 ++++++++++++++++++++-
.../apache/doris/system/SystemInfoServiceTest.java | 2 +-
.../apache/doris/load/loadv2/etl/SparkEtlJob.java | 29 +-
.../doris/load/loadv2/etl/SparkEtlJobTest.java | 63 +++-
gensrc/thrift/Status.thrift | 3 +
.../fold_constant/fold_constant.out} | 34 +-
.../data/load_p0/stream_load/test_json_load.out | 3 +
.../data/load_p0/stream_load/with_jsonb.json | 1 +
.../nereids_p0/aggregate/agg_window_project.out | 3 +
.../data/nereids_p0/subquery/test_subquery.out | 5 +
.../delete_p0/fold_constant/fold_constant.groovy | 67 ++++
.../load_p0/stream_load/test_json_load.groovy | 87 +++--
.../nereids_p0/aggregate/agg_window_project.groovy | 10 +
.../nereids_p0/subquery/test_subquery.groovy | 55 ++-
111 files changed, 1686 insertions(+), 454 deletions(-)
delete mode 100644 be/src/vec/sink/vresult_writer.h
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/catalog/CreateTableElasticOnStorageMediumTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/jobs/joinorder/hypergraph/OtherJoinTest.java
copy
regression-test/data/{nereids_p0/sql_functions/array_functions/test_array_functions_with_where.out
=> delete_p0/fold_constant/fold_constant.out} (50%)
create mode 100644 regression-test/data/load_p0/stream_load/with_jsonb.json
create mode 100644
regression-test/suites/delete_p0/fold_constant/fold_constant.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
