This is an automated email from the ASF dual-hosted git repository.
liutang123 pushed a change to branch cdw-doris-4.1-for-bybit
in repository https://gitbox.apache.org/repos/asf/doris.git
at 0187c800309 [Tencent](workload group provider) Add workload group
provider in doris
This branch includes the following new commits:
new 78c866af47f [Tencent] Revert "[Debug](thrift) add log for thrift
transport error (#31366)"
new c44c41b5aa1 [Tencent] Support TCHouse-D version release by adding
related scripts, confs, zoneinfo, tencent jar packages and etc.
new 8df62c61c72 [Tencent] Change build version by add tencent-cdw-doris
prefix in gen_build_version.sh
new 2f959d5f8f5 [Tencent] Change to skip root user in audit log and
reserve 180d for audit table
new ac9d82a1d8a [Tencent] Change mem_limit to 85%
new f733eaa6ef1 [Tencent] change partition num of audit log from 30 days
to 180 days
new 0015395138c [Tencent] Fix the import of AuditEvent to right path
new 792b65d6550 [Tencent] let ignore_broken_disk keep true to avoid report
error
new 7f2d91359b0 [Tencent](build) Maven repo download huawei-cloud-sdk
failed
new 4508ee1a129 [Tencent](tools) Fix loading failure in tpcds tools
new 4c7822f2dfd [Tencent](enhance) Support strikethrough(-) in resource
name
new 956812f5304 [Tencent] Change default max connections of user from 100
to 200
new f0e188fa151 [Tencent] mask ak of s3 vault when show storage vault
new c63e1b4d052 [Tencent] allow alter replication for colocate table while
open 3az
new c482f7b6062 [Tencent] support force-drop-cluster-not-in-safe-time
new 670c8bc9aae [Tencent][Opt] improved cloud compaction. #54180
new 8e08d0a1168 [Tencent] fix wrong profile state
new ed2ab28acba [Tencent] Get aws clientconfiguration when env init
new d5990c45f97 [Tencent][fix](bvar) Fix bvar leak after schema change job
in be failed #56207
new 3718effe4b3 [Tencent] get PID_DIR from env
new d80eda4535e [Tencent][TMP] GroupExpression.getOwnerGroup returns null
new fb87c76aa94 [Tencent] use root to modify default vault
new 1761fdf101e [Tencent][Improve] the show config command behaves the
same as the old optimizer
new 892ad224a53 [Tencent][TMP] Like #51747, Check auth when alter vault
new 859c594c0b5 [Tencent] Remove
hadoop-ranger-client-for-hadoop-2.8.5-5.0.jar for version conflict to hadoop
3.3.6 and unify fe, be and broker to use the same hadoop version.
new db803c6e4aa [Tencent](script) Fix a bug that release to Singapore
region
new 68c61e4230d [Tencent][improvement](backup) Add local temporary
directory cleanup for remote repositories
new b47ada079c1 [Tencent] support gooesfs via broker
new 76d8bd1d909 [Tencent] Fix a bug for upgrade for singapore region
new ff8688c1ac7 [Tencent](script) Fix a bug that update common components
after upgrading a component
new e5eb840ea47 [Tencent](script) Remove
hadoop-ranger-client-for-hadoop-3.3.3-5.0 which has a conflict protobuf version
new acf0cee09da [Tencent] fix hadoop.username do not take effect while
insert iceberg table on ofs
new 10ae6e972ec [Tencent] fix hadoop.username do not take effect while
OUTFILE to CosN
new a51265d28cc [Tencent][Improve](broker) Modify the original TGT renewal
logic to prevent high-concurrency access to the KDC (merge request !219)
new 7278eb6ed13 [Tencent](profile) Fix wrong profile type
new 1d00f0bbafe [Tencent][feature](backup) Tencent backup/restore
enhancement (cherry-pick #46059) Cherry-pick Apache Doris PR #46059 to
TCHouse-D 4.1 branch. Co-authored-by: carolinchen
new 6f3e1394ed0 [Tencent] Change the default value of label_num_threshold
from 2000 to 200000
new 9262ee7f4fb [Tencent][opt] exec olap scan query with CN
new 1aea2cd8055 [Tencent] modify default config for cn node
new 7c56fb060bf [Tencent] Add FE config makeup_percent_for_external_table
to make resource utilization more reasonable
new 6ccb466ba3b [Tencent] grant default vault USAGE_PRIV to new created
user
new e9d8d8db07d [Tencent] Add password http API Add a http param `user`
for `/api/{user}/_password` api. Set jetty uri compliance to LEGACY
new b7082a459e9 [Tencent] make paimon scan plan more efficient
new 18a36397811 [Tencent] Increase the default cache size of paimon catalog
new c635760117d [Tencent](ccr) Add global backup snapshot retrieval
capability via thrift interface
new 21c20007a08 [Tencent][enhancement](s3) Add checksumValidationEnabled
config for S3 data integrity verification (merge request !221)
new 3b66804fc10 [Tencent] add config remote_scanner_thread_num_per_cpu for
remote scanner
new 56732f79851 [Tencent] support output/export null value as empty string
for csv format
new f9e366ab35d [Tencent][Feature] support data mask in doris internal auth
new d9acaae1ffa [Tencent] [Metric] add slow query metric
new dc6bbb936ec [Tencent] remove cool down time limit for storage policy
by add a config item.
new ad2d796eaf0 [Tencent] [Improve] add some system table for table data
drill-down
new 1e8480aa20f [Tencent] [Improve] support monitoring drill-down
new 7956f4b4a1e [Tencent] support dlc ranger auth
new 3c856b7c070 [Tencent](fix) Add checkStorageVaultPriv method since
CatalogAccessController has one
new 23d3cf00444 [Tencent][fix](mtmv) Fix UnsupportedOperationException in
getMTMVCanRewritePartitions
new 191e5aea2fd [Tencent][serverless] add logical plan info to audit log
new 045a4d4c29d [Tencent](statistics) check each partition replica num and
use proper connect context in modifyTblReplicaCount to fix endless replica
scale loop
new fff947d8d13 [Tencent](conf) refine FE/BE/CN/Broker default config for
cdw-doris-4.1
new f74b6110d80 [Tencent](scripts) pre-create FE/BE data dirs before
launching the JVM
new 69aa41cbabc [Tencent](scripts) fix start_broker.sh: align with FE/BE
and honor JAVA_OPTS_FOR_JDK_17
new 4aa4f27d3f2 [Tencent](scripts) align jdbc_drivers with 4.1 default and
harden directory pre-creation
new cd7c9ce81cc [Tencent](conf) add MS (doris_cloud) and sanitizer suppr
configs to cdw-doris-release
new 4fcb16eace6 [Tencent](ops) add storage_medium HDD->SSD migration
script and runbook
new d2ed02eb85c [Tencent](chore) surround column name with "`" in show
create command 在 show create 命令中给列名包裹反引号并处理列注释转义。目的是让show
create输出的ddl语句能复制直接执行通过语法校验 在拼接列名时添加反引号包裹。 对列注释中的单引号进行转义处理。
new 176d24d595f [Tencent](tvf) support pushdown mv_name for mv_infos
(merge request !317) 原sql `select * from mv_infos("database"="xxx") where Name
= "mv_app_xxx"`在使用mv_infos表函数时,实际没有将Name
pushdown到执行层,导致每一次查询单个物化视图的状态时,都需要遍历整个数据库的表,当数据库中的表特别多(~2000张)时,这个操作会变的非常贵,尤其在每个物化视图的基表是外表的场景(缓存会失效,每个表的远程rpc串连非常耗时间)。
new 8c45e94441a [Tencent] new add saudi-arabia region to upgrading script
new 67808c18ff7 [Tencent][Improve](MTMV) can cancel all tasks of mtmv
new f4e0111ace6 [Tencent][fix](window) Fix _read_row_rank Defer wrongly
setting *eos=true to stop silent row loss for DENSE_RANK / RANK
new 8be1c262db6 [Tencent][fix](mtmv) SHOW CREATE MATERIALIZED VIEW 展示原始
SQL 而非全限定改写后的 SQL
new c57c267601c [Tencent](mtmv) Add last refresh task info to mv_infos tvf
(merge request !325)
new f60d5cab61b [Tencent][fix](mtmv) 为 SHOW CREATE MATERIALIZED VIEW
增加回滚开关 show_create_mtmv_use_original_query_sql
new c69a4864930 [Tencent][Feat](fs) support ofs storage properties for
external catalog
new 7b53ec3b96c [Tencent](fix) prevent jni jvm oom when read ofs file data
new 9f8879e1fdc [Tencent] enable-ofs-jni (merge request !279)
new 29b0568bca3 [Tencent](fix) external catalog meta data inconsistent
when frequent refreshing
new a163f62dd6b [Tencent](ofs) fix ofs thread leak
new 6619241cfb1 [Tencent][fix](workload-group) fix unsafe workload group
resource usage metrics
new 1e3c72460b4 [Tencent](auth) oidc auth plugin
new 8353377a157 [Tencent][Feature] Support Paimon HMS metadata 支持 Paimon
HMS 元数据缓存功能,实现对 HMS 目录下 Paimon 表的元数据管理。 新增 PaimonDlaTable 类及相关初始化、Schema
获取逻辑,支持 Paimon 表识别。 新增 PaimonMetadataOps 类,实现 Paimon 表的加载与分区列表功能。 新增
PaimonUtils 工具方法,支持 HMS 目录创建 Paimon Catalog 及 Schema 缓存加载。 修改
PaimonScanNode、PaimonSource 等文件,兼容 HMS 目录并支持 Paimon 表扫描。 修改 PaimonTableLoader
和分区加载逻辑,通过 MetadataOps 支持多目录类型的表加载。 扩展外部元数据缓存解析器,支持 Paimon 引擎缓存及失效事件传播。
new 005105d9950 [Tencent](mtmv) mv_infos tvf allow multiple mv names
(merge request !331)
new 56851833b86 [Tencent] Customize trino connector's log dir
new 41851232039 [Tencent](nereids) round-like function can returns DECIMAL
type to avoid IEEE-754 tail leak (merge request !340) just see
https://iwiki.woa.com/p/4022313190
new c26f18d5ac3 [Tencent](hms) Support paimon table detection by
storage_handler (merge request !342)
new c86e32b8a8a [Tencent] Revert "branch-4.1: [bug](iceberg) fix can't get
migrated Iceberg tables format type #64134 (#64292)"
new a78b6df526e [Tencent](mtmv) fail fast and clarify error when MV
date_trunc partition granularity is finer than base table
new c98b0e00687 [Tencent][feature](fe) Support SQL result cache for
Iceberg external tables
new edbb91df3e6 [Tencent](Improve) support user custom hive conf (merge
request !356)
new a92c44c10a1 [Tencent][fix](mtmv) rescue lost BUILD IMMEDIATE refresh
and carry compute group (merge request !358)
new 1df048fda59 [Tencent][iceberg] add max iceberg delete file config &
optimize iceberg delete file get split (merge request !359)
new 9d0a4dcdebd [Tencent] proxy user
new d8e26d242e0 [Tencent][fix](proxy) fix check style
new 7077b9a31be [Tencent][oidc] add oidc auth timeout config
new 0187c800309 [Tencent](workload group provider) Add workload group
provider in doris
The 94 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]