Re: [PR] [feature](tvf) support max_filter_ratio [doris]
dataroaring commented on PR #35431: URL: https://github.com/apache/doris/pull/35431#issuecomment-2132775959 Does it works as broker load or streamload? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids)set mark join reference for bitmap-in-apply [doris]
englefly commented on PR #35435: URL: https://github.com/apache/doris/pull/35435#issuecomment-2132772204 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids)set mark join reference for bitmap-in-apply [doris]
doris-robot commented on PR #35435: URL: https://github.com/apache/doris/pull/35435#issuecomment-2132772058 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](nereids)set mark join reference for bitmap-in-apply [doris]
englefly opened a new pull request, #35435: URL: https://github.com/apache/doris/pull/35435 ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](nereids) fix merge aggregate setting top projection bug [doris]
github-actions[bot] commented on PR #35348: URL: https://github.com/apache/doris/pull/35348#issuecomment-2132761480 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](nereids) fix merge aggregate setting top projection bug [doris]
github-actions[bot] commented on PR #35348: URL: https://github.com/apache/doris/pull/35348#issuecomment-2132761423 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Bugfix] Fix mv column type is not changed when do schema change [doris]
dataroaring merged PR #34598: URL: https://github.com/apache/doris/pull/34598 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [Bugfix] Fix mv column type is not changed when do schema change (#34598)
This is an automated email from the ASF dual-hosted git repository.
dataroaring pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new ffa5ac3fad9 [Bugfix] Fix mv column type is not changed when do schema
change (#34598)
ffa5ac3fad9 is described below
commit ffa5ac3fad92cd007d4363027b4bbc721398b619
Author: Lightman <31928846+lchangli...@users.noreply.github.com>
AuthorDate: Mon May 27 14:46:33 2024 +0800
[Bugfix] Fix mv column type is not changed when do schema change (#34598)
---
.../apache/doris/alter/SchemaChangeHandler.java| 63 +++--
.../org/apache/doris/alter/SchemaChangeJobV2.java | 48 +-
.../doris/analysis/CreateMaterializedViewStmt.java | 2 +-
.../schema_change_modify_mv_column_type.out| 103 +
.../schema_change_modify_mv_column_type2.out | 75 +++
.../schema_change_modify_mv_column_type_agg.out| 55 +++
.../schema_change_modify_mv_column_type.groovy | 98
.../schema_change_modify_mv_column_type2.groovy| 98
.../schema_change_modify_mv_column_type_agg.groovy | 97 +++
9 files changed, 582 insertions(+), 57 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/alter/SchemaChangeHandler.java
b/fe/fe-core/src/main/java/org/apache/doris/alter/SchemaChangeHandler.java
index 4a6fc3fd856..aa747a6d699 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/alter/SchemaChangeHandler.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/alter/SchemaChangeHandler.java
@@ -25,6 +25,7 @@ import org.apache.doris.analysis.CancelAlterTableStmt;
import org.apache.doris.analysis.CancelStmt;
import org.apache.doris.analysis.ColumnPosition;
import org.apache.doris.analysis.CreateIndexClause;
+import org.apache.doris.analysis.CreateMaterializedViewStmt;
import org.apache.doris.analysis.DropColumnClause;
import org.apache.doris.analysis.DropIndexClause;
import org.apache.doris.analysis.IndexDef;
@@ -672,52 +673,50 @@ public class SchemaChangeHandler extends AlterHandler {
}
List schema = entry.getValue();
for (Column column : schema) {
-if
(column.getName().equalsIgnoreCase(modColumn.getName())) {
+String columnName = column.getName();
+if (column.isMaterializedViewColumn()) {
+columnName = MaterializedIndexMeta.normalizeName(
+
CreateMaterializedViewStmt.mvColumnBreaker(columnName));
+}
+if (columnName.equalsIgnoreCase(modColumn.getName())) {
otherIndexIds.add(entry.getKey());
break;
}
}
}
-
-if (KeysType.AGG_KEYS == olapTable.getKeysType() ||
KeysType.UNIQUE_KEYS == olapTable.getKeysType()) {
-for (Long otherIndexId : otherIndexIds) {
-List otherIndexSchema =
indexSchemaMap.get(otherIndexId);
+for (Long otherIndexId : otherIndexIds) {
+List otherIndexSchema =
indexSchemaMap.get(otherIndexId);
+for (int i = 0; i < otherIndexSchema.size(); i++) {
modColIndex = -1;
-for (int i = 0; i < otherIndexSchema.size(); i++) {
-if
(otherIndexSchema.get(i).getName().equalsIgnoreCase(modColumn.getName())) {
-modColIndex = i;
-break;
-}
+Column otherCol = null;
+Column col = otherIndexSchema.get(i);
+String columnName = col.getName();
+if (col.isMaterializedViewColumn()) {
+columnName = MaterializedIndexMeta.normalizeName(
+
CreateMaterializedViewStmt.mvColumnBreaker(columnName));
}
-Preconditions.checkState(modColIndex != -1);
-// replace the old column
-otherIndexSchema.set(modColIndex, modColumn);
-} // end for other indices
-} else {
-// DUPLICATE data model has a little
-for (Long otherIndexId : otherIndexIds) {
-List otherIndexSchema =
indexSchemaMap.get(otherIndexId);
-modColIndex = -1;
-for (int i = 0; i < otherIndexSchema.size(); i++) {
-if
(otherIndexSchema.get(i).getName().equalsIgnoreCase(modColumn.getName())) {
-modColIndex = i;
-break;
-}
+if (!columnName.equalsIgnoreCase(modColumn.getName())) {
+conti
Re: [PR] [fix](memory) Fix nested scoped tracker and nested reserve memory [doris]
github-actions[bot] commented on PR #35257: URL: https://github.com/apache/doris/pull/35257#issuecomment-2132756089 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature](Prepared Statment) Implement in nereids planner [doris]
morrySnow commented on code in PR #35318:
URL: https://github.com/apache/doris/pull/35318#discussion_r1615523932
##
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/PlaceholderExpr.java:
##
@@ -0,0 +1,82 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+package org.apache.doris.nereids.trees.expressions;
+
+import org.apache.doris.catalog.MysqlColType;
+import org.apache.doris.nereids.exceptions.UnboundException;
+import org.apache.doris.nereids.trees.expressions.visitor.ExpressionVisitor;
+import org.apache.doris.nereids.types.DataType;
+
+/**
+ * Placeholder for prepared statement
+ */
+public class PlaceholderExpr extends Expression {
+private final int exprId;
Review Comment:
use a IdGenenator to generate id, refer to
`org.apache.doris.nereids.trees.plans.RelationId`,
`org.apache.doris.nereids.StatementContext#relationIdGenerator` and
`org.apache.doris.nereids.trees.expressions.StatementScopeIdGenerator#newRelationId`
##
fe/fe-core/src/main/antlr4/org/apache/doris/nereids/DorisLexer.g4:
##
@@ -392,6 +392,7 @@ ORDER: 'ORDER';
OUTER: 'OUTER';
OUTFILE: 'OUTFILE';
OVER: 'OVER';
+PLACEHOLDER: '?';
Review Comment:
Newly added keywords, please sort in alphabetical order.
##
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/PlaceholderExpr.java:
##
@@ -0,0 +1,82 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+package org.apache.doris.nereids.trees.expressions;
+
+import org.apache.doris.catalog.MysqlColType;
+import org.apache.doris.nereids.exceptions.UnboundException;
+import org.apache.doris.nereids.trees.expressions.visitor.ExpressionVisitor;
+import org.apache.doris.nereids.types.DataType;
+
+/**
+ * Placeholder for prepared statement
+ */
+public class PlaceholderExpr extends Expression {
Review Comment:
rename it `PlaceholderExpr` -> `Placeholder`
##
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/literal/Literal.java:
##
@@ -396,4 +400,153 @@ public boolean isZero() {
}
return false;
}
+
+/**
+** get paramter length, port from mysql get_param_length
+**/
+public static int getParmLen(ByteBuffer data) {
+int maxLen = data.remaining();
+if (maxLen < 1) {
+return 0;
+}
+// get and advance 1 byte
+int len = MysqlProto.readInt1(data);
+if (len == 252) {
+if (maxLen < 3) {
+return 0;
+}
+// get and advance 2 bytes
+return MysqlProto.readInt2(data);
+} else if (len == 253) {
+if (maxLen < 4) {
+return 0;
+}
+// get and advance 3 bytes
+return MysqlProto.readInt3(data);
+} else if (len == 254) {
+/*
+In our client-server protocol all numbers bigger than 2^24
+stored as 8 bytes with uint8korr. Here we always know that
+parameter length is less than 2^4 so we don't look at the second
+4 bytes. But still we need to obey the protocol hence 9 in the
+assignment below.
+*/
+if (maxLen < 9) {
+return 0;
+}
+len = MysqlProto.readInt4(data);
+MysqlProto.readFixedString(data, 4);
+return len;
+} else if (len == 255) {
+return 0;
+
Re: [PR] [branch-2.1][hotfix](jdbc table) Restoring a table type that should not be deleted [doris]
github-actions[bot] commented on PR #35434: URL: https://github.com/apache/doris/pull/35434#issuecomment-2132755575 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](memory) Fix nested scoped tracker and nested reserve memory [doris]
github-actions[bot] commented on PR #35257: URL: https://github.com/apache/doris/pull/35257#issuecomment-2132754860 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Bugfix] Fix mv column type is not changed when do schema change [doris]
github-actions[bot] commented on PR #34598: URL: https://github.com/apache/doris/pull/34598#issuecomment-2132754090 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](memory) Fix nested scoped tracker and nested reserve memory [doris]
github-actions[bot] commented on PR #35257: URL: https://github.com/apache/doris/pull/35257#issuecomment-2132754926 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [hotfix](jdbc table) Restoring a table type that should not be deleted [doris]
github-actions[bot] commented on PR #35433: URL: https://github.com/apache/doris/pull/35433#issuecomment-2132753690 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [hotfix](jdbc table) Restoring a table type that should not be deleted [doris]
github-actions[bot] commented on PR #35433: URL: https://github.com/apache/doris/pull/35433#issuecomment-2132753642 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [hotfix](jdbc table) Restoring a table type that should not be deleted [doris]
github-actions[bot] commented on PR #35433: URL: https://github.com/apache/doris/pull/35433#issuecomment-2132752839 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](SenderQueue) error memlimt in add/sub _blocks_memory_usage [doris]
doris-robot commented on PR #35428: URL: https://github.com/apache/doris/pull/35428#issuecomment-2132751271 ClickBench: Total hot run time: 30.04 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit a0f9e50f2ab5ec26ff236bfbda61a604a97207be, data reload: false query1 0.040.040.03 query2 0.090.040.04 query3 0.230.050.06 query4 1.710.070.07 query5 0.500.490.50 query6 1.130.710.72 query7 0.020.020.02 query8 0.050.040.04 query9 0.540.480.49 query10 0.530.560.55 query11 0.150.120.11 query12 0.140.120.12 query13 0.580.590.61 query14 0.750.800.77 query15 0.820.830.81 query16 0.360.370.37 query17 0.971.031.02 query18 0.240.240.24 query19 1.821.671.66 query20 0.020.010.00 query21 15.56 0.650.64 query22 4.697.431.50 query23 18.32 1.421.22 query24 1.660.230.26 query25 0.150.080.09 query26 0.270.170.18 query27 0.080.080.07 query28 13.42 1.020.99 query29 13.28 3.333.26 query30 0.240.060.05 query31 2.860.380.40 query32 3.290.470.46 query33 2.902.932.91 query34 17.14 4.394.44 query35 4.504.484.53 query36 0.710.470.46 query37 0.170.150.15 query38 0.150.140.15 query39 0.040.040.03 query40 0.160.150.15 query41 0.080.050.04 query42 0.060.040.05 query43 0.040.030.04 Total cold run time: 110.46 s Total hot run time: 30.04 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.1][hotfix](jdbc table) Restoring a table type that should not be deleted [doris]
github-actions[bot] commented on PR #35434: URL: https://github.com/apache/doris/pull/35434#issuecomment-2132750865 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [refactor](minor) delete unused code [doris]
Gabriel39 merged PR #35413: URL: https://github.com/apache/doris/pull/35413 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](memory) Fix nested scoped tracker and nested reserve memory [doris]
xinyiZzz commented on code in PR #35257:
URL: https://github.com/apache/doris/pull/35257#discussion_r1615544169
##
be/src/runtime/memory/thread_mem_tracker_mgr.h:
##
@@ -193,7 +198,8 @@ inline void ThreadMemTrackerMgr::consume(int64_t size, int
skip_large_memory_che
_reserved_mem -= size;
// store bytes that not synchronized to process reserved memory.
_untracked_mem += size;
-if (_untracked_mem >= SYNC_PROC_RESERVED_INTERVAL_BYTES) {
+// If _reserved_mem is added back, it still need synchronized to
process reserved_memory.
+if (std::abs(_untracked_mem) >= SYNC_PROC_RESERVED_INTERVAL_BYTES)
{
Review Comment:
done
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [hotfix](jdbc table) Restoring a table type that should not be deleted [doris]
github-actions[bot] commented on PR #35433: URL: https://github.com/apache/doris/pull/35433#issuecomment-2132747245 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.1][hotfix](jdbc table) Restoring a table type that should not be deleted [doris]
yiguolei merged PR #35434: URL: https://github.com/apache/doris/pull/35434 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [refactor](minor) delete unused shared hash table construction (#35413)
This is an automated email from the ASF dual-hosted git repository.
gabriellee pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 28aad017d1c [refactor](minor) delete unused shared hash table
construction (#35413)
28aad017d1c is described below
commit 28aad017d1c093e1ad4fda956ea9f94ed8561cfb
Author: Gabriel
AuthorDate: Mon May 27 14:40:08 2024 +0800
[refactor](minor) delete unused shared hash table construction (#35413)
---
be/src/pipeline/exec/hashjoin_build_sink.cpp | 4 +-
be/src/runtime/fragment_mgr.cpp| 80 --
be/src/runtime/fragment_mgr.h | 10 --
be/src/vec/exec/join/vhash_join_node.cpp | 176 ++---
be/src/vec/exec/join/vhash_join_node.h | 14 --
.../vec/runtime/shared_hash_table_controller.cpp | 55 +--
be/src/vec/runtime/shared_hash_table_controller.h | 9 +-
.../main/java/org/apache/doris/qe/Coordinator.java | 6 -
gensrc/thrift/PaloInternalService.thrift | 2 +
9 files changed, 56 insertions(+), 300 deletions(-)
diff --git a/be/src/pipeline/exec/hashjoin_build_sink.cpp
b/be/src/pipeline/exec/hashjoin_build_sink.cpp
index 90aeb7070b6..7c486fd4b45 100644
--- a/be/src/pipeline/exec/hashjoin_build_sink.cpp
+++ b/be/src/pipeline/exec/hashjoin_build_sink.cpp
@@ -57,8 +57,8 @@ Status HashJoinBuildSinkLocalState::init(RuntimeState* state,
LocalSinkStateInfo
_should_build_hash_table = info.task_idx == 0;
if (_should_build_hash_table) {
profile()->add_info_string("ShareHashTableEnabled", "true");
-CHECK(p._shared_hashtable_controller->should_build_hash_table(
-state->fragment_instance_id(), p.node_id()));
+p._shared_hashtable_controller->set_builder_and_consumers(
+state->fragment_instance_id(), p.node_id());
}
} else {
profile()->add_info_string("ShareHashTableEnabled", "false");
diff --git a/be/src/runtime/fragment_mgr.cpp b/be/src/runtime/fragment_mgr.cpp
index cd54edd5f54..8534638f681 100644
--- a/be/src/runtime/fragment_mgr.cpp
+++ b/be/src/runtime/fragment_mgr.cpp
@@ -674,7 +674,6 @@ Status FragmentMgr::_get_query_ctx(const Params& params,
TUniqueId query_id, boo
query_ctx->set_rsc_info = true;
}
-
query_ctx->get_shared_hash_table_controller()->set_pipeline_engine_enabled(pipeline);
_set_scan_concurrency(params, query_ctx.get());
const bool is_pipeline = std::is_same_v;
@@ -851,7 +850,6 @@ Status FragmentMgr::exec_plan_fragment(const
TPipelineFragmentParams& params,
params.query_options.enable_pipeline_x_engine) ||
(params.query_options.__isset.enable_pipeline_engine &&
params.query_options.enable_pipeline_engine));
-_setup_shared_hashtable_for_broadcast_join(params, query_ctx.get());
int64_t duration_ns = 0;
std::shared_ptr context =
std::make_shared(
@@ -1440,84 +1438,6 @@ Status FragmentMgr::merge_filter(const
PMergeFilterRequest* request,
return merge_status;
}
-void FragmentMgr::_setup_shared_hashtable_for_broadcast_join(const
TExecPlanFragmentParams& params,
- QueryContext*
query_ctx) {
-if
(!params.query_options.__isset.enable_share_hash_table_for_broadcast_join ||
-!params.query_options.enable_share_hash_table_for_broadcast_join) {
-return;
-}
-
-if (!params.__isset.fragment || !params.fragment.__isset.plan ||
-params.fragment.plan.nodes.empty()) {
-return;
-}
-for (auto& node : params.fragment.plan.nodes) {
-if (node.node_type != TPlanNodeType::HASH_JOIN_NODE ||
-!node.hash_join_node.__isset.is_broadcast_join ||
-!node.hash_join_node.is_broadcast_join) {
-continue;
-}
-
-if (params.build_hash_table_for_broadcast_join) {
-
query_ctx->get_shared_hash_table_controller()->set_builder_and_consumers(
-params.params.fragment_instance_id, node.node_id);
-}
-}
-}
-
-void FragmentMgr::_setup_shared_hashtable_for_broadcast_join(
-const TPipelineFragmentParams& params, const TPipelineInstanceParams&
local_params,
-QueryContext* query_ctx) {
-if
(!params.query_options.__isset.enable_share_hash_table_for_broadcast_join ||
-!params.query_options.enable_share_hash_table_for_broadcast_join) {
-return;
-}
-
-if (!params.__isset.fragment || !params.fragment.__isset.plan ||
-params.fragment.plan.nodes.empty()) {
-return;
-}
-for (auto& node : params.fragment.plan.nodes) {
-if (node.node_type != TPlanNodeType::HASH_JOIN_NODE ||
-!node.hash_join_node.__isset.is_broadcast_join
Re: [PR] [fix](memory) Fix nested scoped tracker and nested reserve memory [doris]
xinyiZzz commented on PR #35257: URL: https://github.com/apache/doris/pull/35257#issuecomment-2132748223 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.1 updated: [branch-2.1][hotfix](jdbc table) Restoring a table type that should not be deleted (#35434)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.1 by this push:
new f99b2f0f82f [branch-2.1][hotfix](jdbc table) Restoring a table type
that should not be deleted (#35434)
f99b2f0f82f is described below
commit f99b2f0f82f9b8af788a18ff7d91d9338a5f6223
Author: zy-kkk
AuthorDate: Mon May 27 14:39:36 2024 +0800
[branch-2.1][hotfix](jdbc table) Restoring a table type that should not be
deleted (#35434)
* [hotfix](jdbc table) Restoring a table type that should not be deleted
* add comment
---
gensrc/thrift/Types.thrift | 1 +
1 file changed, 1 insertion(+)
diff --git a/gensrc/thrift/Types.thrift b/gensrc/thrift/Types.thrift
index dbab5c61caa..3c2fcfbd6fa 100644
--- a/gensrc/thrift/Types.thrift
+++ b/gensrc/thrift/Types.thrift
@@ -399,6 +399,7 @@ enum TOdbcTableType {
PRESTO,
OCEANBASE,
OCEANBASE_ORACLE,
+NEBULA, // Deprecated
DB2
}
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [hotfix](jdbc table) Restoring a table type that should not be deleted [doris]
zy-kkk commented on PR #35433: URL: https://github.com/apache/doris/pull/35433#issuecomment-2132746841 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](planner) fix create view star except and modify cast to sql [doris]
feiniaofeiafei commented on PR #35324: URL: https://github.com/apache/doris/pull/35324#issuecomment-2132745498 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [refactor](minor) delete unused code [doris]
github-actions[bot] commented on PR #35413: URL: https://github.com/apache/doris/pull/35413#issuecomment-2132745195 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [refactor](minor) delete unused code [doris]
github-actions[bot] commented on PR #35413: URL: https://github.com/apache/doris/pull/35413#issuecomment-2132745157 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](SenderQueue) error memlimt in add/sub _blocks_memory_usage [doris]
doris-robot commented on PR #35428: URL: https://github.com/apache/doris/pull/35428#issuecomment-2132744053 TPC-DS: Total hot run time: 169399 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit a0f9e50f2ab5ec26ff236bfbda61a604a97207be, data reload: false query1 914 376 367 367 query2 6445242222482248 query3 6637203 200 200 query4 20342 17825 17374 17374 query5 4159420 417 417 query6 252 171 153 153 query7 4581300 291 291 query8 238 176 200 176 query9 8479237023482348 query10 450 303 269 269 query11 10589 10160 99719971 query12 131 93 91 91 query13 1636362 358 358 query14 10024 744174027402 query15 203 163 162 162 query16 7740265 264 264 query17 1511517 519 517 query18 1943271 268 268 query19 188 152 154 152 query20 92 84 84 84 query21 196 156 128 128 query22 4234381339763813 query23 33637 33060 33065 33060 query24 9038283728362836 query25 568 369 354 354 query26 703 159 153 153 query27 2236309 320 309 query28 5438202720412027 query29 862 609 596 596 query30 238 148 155 148 query31 973 786 766 766 query32 92 52 58 52 query33 642 286 275 275 query34 854 470 471 470 query35 752 613 618 613 query36 1069917 925 917 query37 102 70 71 70 query38 2871276927552755 query39 853 769 779 769 query40 197 126 126 126 query41 47 44 47 44 query42 101 94 97 94 query43 587 551 545 545 query44 1081739 749 739 query45 176 167 168 167 query46 1057698 708 698 query47 1869178017891780 query48 381 294 296 294 query49 852 374 386 374 query50 762 375 388 375 query51 6987678767766776 query52 99 92 85 85 query53 349 280 283 280 query54 750 436 432 432 query55 71 71 71 71 query56 269 268 257 257 query57 1106107610411041 query58 231 207 228 207 query59 3533316333953163 query60 276 267 265 265 query61 89 90 90 90 query62 595 442 462 442 query63 312 281 279 279 query64 8471223716821682 query65 3209307131073071 query66 782 344 321 321 query67 15261 14713 14694 14694 query68 4546517 535 517 query69 440 269 265 265 query70 1164115811271127 query71 387 277 263 263 query72 7631524127162716 query73 714 319 317 317 query74 6040555755765557 query75 3378264226312631 query76 23151005916 916 query77 397 268 262 262 query78 10139 978396599659 query79 2479502 506 502 query80 1064446 433 433 query81 546 219 219 219 query82 729 92 92 92 query83 263 169 166 166 query84 243 90 85 85 query85 1632279 275 275 query86 505 319 268 268 query87 3301306831763068 query88 4303244324392439 query89 469 392 379 379 query90 2021191 193 191 query91 137 109 107 107 query92 72 50 53 50 query93 2109503 492 492 query94 1327188 184 184 query95 399 319 314 314 query96 601 271 266 266 query97 3156296330712963 query98 256 216 217 216 query99 1122855 845 845 Total cold run time: 265297 ms Total hot run time: 169399 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp
Re: [PR] [branch-2.1][hotfix](jdbc table) Restoring a table type that should not be deleted [doris]
doris-robot commented on PR #35434: URL: https://github.com/apache/doris/pull/35434#issuecomment-2132741784 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [branch-2.1][hotfix](jdbc table) Restoring a table type that should not be deleted [doris]
zy-kkk opened a new pull request, #35434: URL: https://github.com/apache/doris/pull/35434 ## Proposed changes Issue Number: close #xxx prefix #35418 We cannot directly delete fields in thrift, which will affect enumeration errors caused by version inconsistencies between FE and BE during upgrades. ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (6e7ec66528e -> 38bf77b3895)
This is an automated email from the ASF dual-hosted git repository. panxiaolei pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from 6e7ec66528e [improve](ub) fix some runtime error of ubsan when downcast (#35343) add 38bf77b3895 [Bug](runtime-filter) try to fix DCHECK fail on _acquire_runtime_filter (#35422) No new revisions were added by this update. Summary of changes: be/src/pipeline/pipeline_task.cpp | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Bug](runtime-filter) try to fix DCHECK fail on _acquire_runtime_filter [doris]
BiteThet merged PR #35422: URL: https://github.com/apache/doris/pull/35422 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [hotfix](jdbc table) Restoring a table type that should not be deleted [doris]
zy-kkk commented on PR #35433: URL: https://github.com/apache/doris/pull/35433#issuecomment-2132739479 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [hotfix](jdbc table) Restoring a table type that should not be deleted [doris]
doris-robot commented on PR #35433: URL: https://github.com/apache/doris/pull/35433#issuecomment-2132739409 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [hotfix](jdbc table) Restoring a table type that should not be deleted [doris]
zy-kkk opened a new pull request, #35433: URL: https://github.com/apache/doris/pull/35433 ## Proposed changes Issue Number: close #xxx prefix #34986 We cannot directly delete fields in thrift, which will affect enumeration errors caused by version inconsistencies between FE and BE during upgrades. ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](memory) Fix nested scoped tracker and nested reserve memory [doris]
xinyiZzz commented on code in PR #35257:
URL: https://github.com/apache/doris/pull/35257#discussion_r1615531946
##
be/src/runtime/memory/thread_mem_tracker_mgr.h:
##
@@ -210,6 +216,7 @@ inline void ThreadMemTrackerMgr::consume(int64_t size, int
skip_large_memory_che
}
}
_untracked_mem += size;
+DCHECK(_reserved_mem == 0);
if (!_init && !ExecEnv::ready()) {
return;
}
Review Comment:
done
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](SenderQueue) error memlimt in add/sub _blocks_memory_usage [doris]
doris-robot commented on PR #35428: URL: https://github.com/apache/doris/pull/35428#issuecomment-2132730655 TPC-H: Total hot run time: 41673 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit a0f9e50f2ab5ec26ff236bfbda61a604a97207be, data reload: false -- Round 1 -- q1 18075 435442314231 q2 2027183 190 183 q3 10550 117912491179 q4 10228 825 882 825 q5 7487271827032703 q6 221 132 132 132 q7 952 605 598 598 q8 9210212521032103 q9 9376665866296629 q10 9093391739153915 q11 470 248 238 238 q12 457 222 237 222 q13 17199 332232213221 q14 280 227 238 227 q15 532 485 474 474 q16 510 404 394 394 q17 998 612 660 612 q18 8373784076587658 q19 7186156115231523 q20 667 329 313 313 q21 5162405440094009 q22 352 286 284 284 Total cold run time: 119405 ms Total hot run time: 41673 ms - Round 2, with runtime_filter_mode=off - q1 4484442644334426 q2 378 270 264 264 q3 3103293028842884 q4 1953171616051605 q5 5295549355295493 q6 221 125 125 125 q7 2174186918221822 q8 3252337333973373 q9 8647861886688618 q10 4029387937643764 q11 591 495 475 475 q12 787 647 616 616 q13 17139 313232033132 q14 310 270 260 260 q15 515 492 494 492 q16 505 453 441 441 q17 1853153415361534 q18 7903762574487448 q19 1660147415551474 q20 2021178418031784 q21 11627 465348444653 q22 554 490 513 490 Total cold run time: 79001 ms Total hot run time: 55173 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.1 updated: [improvement](jdbc catalog) remove useless jdbc catalog code (#34986) (#35418)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.1 by this push:
new 2e20e385234 [improvement](jdbc catalog) remove useless jdbc catalog
code (#34986) (#35418)
2e20e385234 is described below
commit 2e20e385234228667dbf1c628efecef2373ab658
Author: zy-kkk
AuthorDate: Mon May 27 14:25:26 2024 +0800
[improvement](jdbc catalog) remove useless jdbc catalog code (#34986)
(#35418)
---
be/src/vec/exec/vjdbc_connector.cpp| 247 +
be/src/vec/exec/vjdbc_connector.h | 13 -
fe/be-java-extensions/java-common/pom.xml |4 -
.../apache/doris/common/jni/utils/UdfUtils.java| 57 -
fe/be-java-extensions/jdbc-scanner/pom.xml | 17 -
.../org/apache/doris/jdbc/BaseJdbcExecutor.java| 12 -
.../apache/doris/jdbc/ClickHouseJdbcExecutor.java | 194 ++--
.../org/apache/doris/jdbc/DefaultJdbcExecutor.java | 1123
.../org/apache/doris/jdbc/JdbcExecutorFactory.java |2 +-
fe/be-java-extensions/preload-extensions/pom.xml | 15 -
.../org/apache/doris/catalog/JdbcResource.java |4 -
.../java/org/apache/doris/catalog/JdbcTable.java |1 -
.../doris/datasource/jdbc/source/JdbcScanNode.java | 23 -
fe/pom.xml | 20 -
gensrc/thrift/Types.thrift |1 -
.../jdbc/test_jdbc_query_mysql.groovy | 38 +-
16 files changed, 143 insertions(+), 1628 deletions(-)
diff --git a/be/src/vec/exec/vjdbc_connector.cpp
b/be/src/vec/exec/vjdbc_connector.cpp
index bef99daf0bb..20660a4cbe6 100644
--- a/be/src/vec/exec/vjdbc_connector.cpp
+++ b/be/src/vec/exec/vjdbc_connector.cpp
@@ -20,7 +20,6 @@
#include
#include
-#include
// IWYU pragma: no_include
#include // IWYU pragma: keep
#include
@@ -32,7 +31,6 @@
#include "exec/table_connector.h"
#include "gutil/strings/substitute.h"
#include "jni.h"
-#include "runtime/define_primitive_type.h"
#include "runtime/descriptors.h"
#include "runtime/runtime_state.h"
#include "runtime/types.h"
@@ -46,14 +44,12 @@
#include "vec/exec/jni_connector.h"
#include "vec/exprs/vexpr.h"
#include "vec/functions/simple_function_factory.h"
-#include "vec/io/reader_buffer.h"
namespace doris::vectorized {
const char* JDBC_EXECUTOR_FACTORY_CLASS =
"org/apache/doris/jdbc/JdbcExecutorFactory";
const char* JDBC_EXECUTOR_CTOR_SIGNATURE = "([B)V";
const char* JDBC_EXECUTOR_STMT_WRITE_SIGNATURE = "(Ljava/util/Map;)I";
const char* JDBC_EXECUTOR_HAS_NEXT_SIGNATURE = "()Z";
-const char* JDBC_EXECUTOR_GET_TYPES_SIGNATURE = "()Ljava/util/List;";
const char* JDBC_EXECUTOR_CLOSE_SIGNATURE = "()V";
const char* JDBC_EXECUTOR_TRANSACTION_SIGNATURE = "()V";
@@ -69,11 +65,6 @@ JdbcConnector::~JdbcConnector() {
}
}
-#define GET_BASIC_JAVA_CLAZZ(JAVA_TYPE, CPP_TYPE) \
-RETURN_IF_ERROR(JniUtil::GetGlobalClassRef(env, JAVA_TYPE,
&_executor_##CPP_TYPE##_clazz));
-
-#define DELETE_BASIC_JAVA_CLAZZ_REF(CPP_TYPE)
env->DeleteGlobalRef(_executor_##CPP_TYPE##_clazz);
-
Status JdbcConnector::close(Status /*unused*/) {
SCOPED_RAW_TIMER(&_jdbc_statistic._connector_close_timer);
_closed = true;
@@ -88,10 +79,6 @@ Status JdbcConnector::close(Status /*unused*/) {
env->CallNonvirtualVoidMethod(_executor_obj, _executor_clazz,
_executor_close_id);
env->DeleteGlobalRef(_executor_factory_clazz);
env->DeleteGlobalRef(_executor_clazz);
-DELETE_BASIC_JAVA_CLAZZ_REF(object)
-DELETE_BASIC_JAVA_CLAZZ_REF(string)
-DELETE_BASIC_JAVA_CLAZZ_REF(list)
-#undef DELETE_BASIC_JAVA_CLAZZ_REF
RETURN_IF_ERROR(JniUtil::GetJniExceptionMsg(env));
env->DeleteGlobalRef(_executor_obj);
return Status::OK();
@@ -128,9 +115,6 @@ Status JdbcConnector::open(RuntimeState* state, bool read) {
env->DeleteLocalRef(jtable_type);
env->ReleaseStringUTFChars(executor_name, executor_name_str);
env->DeleteLocalRef(executor_name);
-GET_BASIC_JAVA_CLAZZ("java/util/List", list)
-GET_BASIC_JAVA_CLAZZ("java/lang/Object", object)
-GET_BASIC_JAVA_CLAZZ("java/lang/String", string)
#undef GET_BASIC_JAVA_CLAZZ
RETURN_IF_ERROR(_register_func_id(env));
@@ -244,9 +228,6 @@ Status JdbcConnector::query() {
}
LOG(INFO) << "JdbcConnector::query has exec success: " << _sql_str;
-if (_conn_param.table_type != TOdbcTableType::NEBULA) {
-RETURN_IF_ERROR(_check_column_type());
-}
return Status::OK();
}
@@ -386,12 +367,6 @@ Status JdbcConnector::_register_func_id(JNIEnv* env) {
_executor_get_block_address_id));
RETURN_IF_ERROR(
register_id(_executor_clazz, "getCurBlockRows", "()I",
_executor_block_rows_id));
-RETURN_IF_ERROR(register_id(_executor_list_clazz, "get",
"(I)Ljava/lang/Object;",
-
Re: [PR] [fix](memory) Fix nested scoped tracker and nested reserve memory [doris]
xinyiZzz commented on code in PR #35257:
URL: https://github.com/apache/doris/pull/35257#discussion_r1615530570
##
be/src/runtime/memory/thread_mem_tracker_mgr.cpp:
##
@@ -44,18 +44,26 @@ class AsyncCancelQueryTask : public Runnable {
void ThreadMemTrackerMgr::attach_limiter_tracker(
const std::shared_ptr& mem_tracker) {
DCHECK(mem_tracker);
-DCHECK(_reserved_mem == 0);
CHECK(init());
flush_untracked_mem();
+_reserved_mem_stack.push_back(_reserved_mem);
+if (_reserved_mem != 0) {
+
doris::GlobalMemoryArbitrator::release_process_reserved_memory(_untracked_mem);
Review Comment:
done
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.1][improvement](jdbc catalog) remove useless jdbc catalog code [doris]
yiguolei merged PR #35418: URL: https://github.com/apache/doris/pull/35418 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](scan) Use lazy-init for segment iterators and avoid caching all segments in the rowset reader [doris]
github-actions[bot] commented on PR #35432: URL: https://github.com/apache/doris/pull/35432#issuecomment-2132727595 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [I] [Enhancement] Reduce memory uage when scan wide table [doris]
wangbo closed issue #35340: [Enhancement] Reduce memory uage when scan wide table URL: https://github.com/apache/doris/issues/35340 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](spill) fix wrong disk usage of spill [doris]
github-actions[bot] commented on PR #35423: URL: https://github.com/apache/doris/pull/35423#issuecomment-2132723931 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](spill) fix wrong disk usage of spill [doris]
github-actions[bot] commented on PR #35423: URL: https://github.com/apache/doris/pull/35423#issuecomment-2132723486 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](export) filter empty partition before export table to remote storage [doris]
caiconghui commented on PR #35389: URL: https://github.com/apache/doris/pull/35389#issuecomment-2132721638 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](scan) Use lazy-init for segment iterators and avoid caching all segments in the rowset reader [doris]
doris-robot commented on PR #35432: URL: https://github.com/apache/doris/pull/35432#issuecomment-2132721161 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](scan) Use lazy-init for segment iterators and avoid caching all segments in the rowset reader [doris]
mrhhsg commented on PR #35432: URL: https://github.com/apache/doris/pull/35432#issuecomment-2132721150 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](short circurt) fix return default value issue [doris]
github-actions[bot] commented on PR #34186: URL: https://github.com/apache/doris/pull/34186#issuecomment-2132721106 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [opt](scan) Use lazy-init for segment iterators and avoid caching all segments in the rowset reader [doris]
mrhhsg opened a new pull request, #35432: URL: https://github.com/apache/doris/pull/35432 ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch export updated (f44a5114a33 -> d920815f65d)
This is an automated email from the ASF dual-hosted git repository. caiconghui pushed a change to branch export in repository https://gitbox.apache.org/repos/asf/doris.git omit f44a5114a33 [enhancement](export) filter empty partition before export table to remote storage add d920815f65d [enhancement](export) filter empty partition before export table to remote storage This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (f44a5114a33) \ N -- N -- N refs/heads/export (d920815f65d) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: .../main/java/org/apache/doris/load/ExportJob.java | 20 +--- 1 file changed, 9 insertions(+), 11 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](ubsan) fix some Undefined behavior [doris]
doris-robot commented on PR #35393: URL: https://github.com/apache/doris/pull/35393#issuecomment-2132719360 TeamCity be ut coverage result: Function Coverage: 35.74% (9009/25206) Line Coverage: 27.37% (74571/272488) Region Coverage: 26.58% (38568/145121) Branch Coverage: 23.44% (19669/83916) Coverage Report: http://coverage.selectdb-in.cc/coverage/33463a7dc7afc01388f6c232a76005339dee42ac_33463a7dc7afc01388f6c232a76005339dee42ac/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix] fix wrong result of spill agg with limit [doris]
jacktengg commented on PR #35403: URL: https://github.com/apache/doris/pull/35403#issuecomment-2132719386 run performance -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](spill) fix wrong disk usage of spill [doris]
jacktengg commented on PR #35423: URL: https://github.com/apache/doris/pull/35423#issuecomment-2132716971 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (b66f9ffbab1 -> 6e7ec66528e)
This is an automated email from the ASF dual-hosted git repository. zhangstar333 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from b66f9ffbab1 [improve](nereids) support pushdown count when scan project without any slot ref (#35162) add 6e7ec66528e [improve](ub) fix some runtime error of ubsan when downcast (#35343) No new revisions were added by this update. Summary of changes: be/src/pipeline/exec/aggregation_sink_operator.cpp | 6 ++ .../pipeline/exec/aggregation_source_operator.cpp | 5 ++--- .../exec/streaming_aggregation_operator.cpp| 6 ++ .../vec/aggregate_functions/aggregate_function.h | 22 +- .../aggregate_functions/aggregate_function_avg.h | 4 ++-- .../aggregate_function_bitmap.h| 12 ++-- .../aggregate_function_bitmap_agg.h| 12 ++-- .../aggregate_function_collect.h | 10 -- .../aggregate_functions/aggregate_function_count.h | 8 .../aggregate_functions/aggregate_function_map.h | 8 .../aggregate_function_min_max.h | 4 ++-- .../aggregate_functions/aggregate_function_sum.h | 4 ++-- .../aggregate_function_uniq_distribute_key.h | 4 ++-- be/src/vec/exec/vaggregation_node.h| 8 14 files changed, 55 insertions(+), 58 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](catalog) close connection on refresh [doris]
doris-robot commented on PR #35426: URL: https://github.com/apache/doris/pull/35426#issuecomment-2132716841 ClickBench: Total hot run time: 30.62 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit ff762da79273ae5cd35cec221b590b5e4c4ed8c9, data reload: false query1 0.040.030.03 query2 0.080.040.04 query3 0.230.060.06 query4 1.660.070.07 query5 0.500.500.50 query6 1.120.730.73 query7 0.020.020.01 query8 0.050.040.04 query9 0.550.500.48 query10 0.530.550.56 query11 0.150.110.12 query12 0.150.120.12 query13 0.600.600.59 query14 0.780.780.79 query15 0.830.810.80 query16 0.360.350.34 query17 0.960.980.96 query18 0.240.260.22 query19 1.771.671.67 query20 0.010.010.01 query21 15.44 0.700.67 query22 4.737.172.06 query23 18.31 1.361.26 query24 1.360.400.23 query25 0.160.090.08 query26 0.260.170.17 query27 0.090.080.09 query28 13.35 1.020.99 query29 12.75 3.313.30 query30 0.240.050.06 query31 2.880.400.38 query32 3.270.480.47 query33 2.902.842.91 query34 17.16 4.404.47 query35 4.504.484.58 query36 0.680.500.46 query37 0.180.160.15 query38 0.160.140.15 query39 0.040.030.04 query40 0.160.140.15 query41 0.090.040.04 query42 0.070.050.05 query43 0.040.040.04 Total cold run time: 109.45 s Total hot run time: 30.62 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](ub) fix some runtime error of ubsan when downcast [doris]
zhangstar333 merged PR #35343: URL: https://github.com/apache/doris/pull/35343 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](ub) fix some runtime error of ubsan when downcast [doris]
github-actions[bot] commented on PR #35343: URL: https://github.com/apache/doris/pull/35343#issuecomment-2132716467 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](SenderQueue) error memlimt in add/sub _blocks_memory_usage [doris]
github-actions[bot] commented on PR #35428: URL: https://github.com/apache/doris/pull/35428#issuecomment-2132715345 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](short circurt) fix return default value issue [doris]
felixwluo commented on PR #34186: URL: https://github.com/apache/doris/pull/34186#issuecomment-2132713665 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch export updated (4ea97bf7924 -> f44a5114a33)
This is an automated email from the ASF dual-hosted git repository. caiconghui pushed a change to branch export in repository https://gitbox.apache.org/repos/asf/doris.git omit 4ea97bf7924 remove regresiion test exclude case omit 22ec3309c91 [enhancement](export) filter empty partition before export table to remote storage add f44a5114a33 [enhancement](export) filter empty partition before export table to remote storage This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (4ea97bf7924) \ N -- N -- N refs/heads/export (f44a5114a33) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: .../suites/export_p0/test_export_empty_table.groovy| 10 +- 1 file changed, 5 insertions(+), 5 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](export) filter empty partition before export table to remote storage [doris]
caiconghui commented on PR #35389: URL: https://github.com/apache/doris/pull/35389#issuecomment-2132714238 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](tvf) support max_filter_ratio [doris]
doris-robot commented on PR #35431: URL: https://github.com/apache/doris/pull/35431#issuecomment-2132712930 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [feature](tvf) support max_filter_ratio [doris]
suxiaogang223 opened a new pull request, #35431: URL: https://github.com/apache/doris/pull/35431 ## Proposed changes Add max_filter_ratio in session variables, default is 1. When enable_insert_strict is false, importing data from [tvf](https://doris.apache.org/docs/lakehouse/file/) will check whether the proportion of filtered rows is greater than max_filter_ratio. ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test]reset workload_group_max_num for P0 [doris]
wangbo merged PR #35430: URL: https://github.com/apache/doris/pull/35430 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.1 updated: Reset workload_group_max_num for regression test (#35430)
This is an automated email from the ASF dual-hosted git repository. wangbo pushed a commit to branch branch-2.1 in repository https://gitbox.apache.org/repos/asf/doris.git The following commit(s) were added to refs/heads/branch-2.1 by this push: new e3b4d4e6300 Reset workload_group_max_num for regression test (#35430) e3b4d4e6300 is described below commit e3b4d4e630083e41dbec798a0be333dccc005d9f Author: wangbo AuthorDate: Mon May 27 14:10:25 2024 +0800 Reset workload_group_max_num for regression test (#35430) --- regression-test/pipeline/p0/conf/fe.conf | 1 + 1 file changed, 1 insertion(+) diff --git a/regression-test/pipeline/p0/conf/fe.conf b/regression-test/pipeline/p0/conf/fe.conf index 3233d67dd56..80fd1d84af6 100644 --- a/regression-test/pipeline/p0/conf/fe.conf +++ b/regression-test/pipeline/p0/conf/fe.conf @@ -111,6 +111,7 @@ enable_job_schedule_second_for_test = true enable_workload_group = true publish_topic_info_interval_ms = 1000 workload_sched_policy_interval_ms = 1000 +workload_group_max_num = 30 master_sync_policy = WRITE_NO_SYNC replica_sync_policy = WRITE_NO_SYNC - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [I] Doris每次查询数据不一致 [doris]
paul1989889 commented on issue #29778: URL: https://github.com/apache/doris/issues/29778#issuecomment-2132711062 same problem in 2.1.2 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](catalog) close connection on refresh [doris]
doris-robot commented on PR #35426: URL: https://github.com/apache/doris/pull/35426#issuecomment-2132710578 TPC-DS: Total hot run time: 169193 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit ff762da79273ae5cd35cec221b590b5e4c4ed8c9, data reload: false query1 929 396 387 387 query2 6438250023602360 query3 6631202 208 202 query4 20616 17279 17233 17233 query5 4115439 438 438 query6 248 157 162 157 query7 4582296 303 296 query8 243 199 197 197 query9 8500235923402340 query10 446 281 260 260 query11 10530 10059 99649964 query12 137 92 89 89 query13 1647375 381 375 query14 9369647378046473 query15 230 171 172 171 query16 7748269 269 269 query17 1539550 533 533 query18 1972292 314 292 query19 199 161 154 154 query20 97 87 87 87 query21 194 138 129 129 query22 4042392638833883 query23 33392 33191 33137 33137 query24 6694285829312858 query25 472 357 361 357 query26 694 162 160 160 query27 1904331 329 329 query28 3770208420402040 query29 850 616 601 601 query30 215 150 152 150 query31 994 770 740 740 query32 59 53 55 53 query33 499 273 273 273 query34 880 473 495 473 query35 729 602 628 602 query36 1024936 943 936 query37 111 65 67 65 query38 2913282727222722 query39 866 790 815 790 query40 201 127 133 127 query41 47 43 48 43 query42 105 103 95 95 query43 569 563 574 563 query44 1120742 769 742 query45 184 166 159 159 query46 1051726 714 714 query47 1827176717701767 query48 376 311 305 305 query49 772 400 399 399 query50 780 393 404 393 query51 6865675768306757 query52 99 94 92 92 query53 357 288 296 288 query54 533 436 427 427 query55 77 73 74 73 query56 271 254 251 251 query57 1105104210321032 query58 242 225 234 225 query59 3793308632353086 query60 275 258 260 258 query61 94 136 88 88 query62 564 475 465 465 query63 317 294 296 294 query64 2587175717111711 query65 3192306031333060 query66 785 330 323 323 query67 15151 14771 14760 14760 query68 4630529 537 529 query69 469 276 279 276 query70 1148110111541101 query71 393 275 277 275 query72 7651588327172717 query73 731 324 321 321 query74 6078552556125525 query75 3391267326662666 query76 2286113110021002 query77 435 268 277 268 query78 10209 974010277 9740 query79 2211519 513 513 query80 926 459 439 439 query81 514 235 230 230 query82 769 91 93 91 query83 252 173 171 171 query84 251 89 86 86 query85 1037273 275 273 query86 472 308 336 308 query87 3276310130853085 query88 3952244624452445 query89 469 400 397 397 query90 1990199 194 194 query91 127 98 99 98 query92 63 52 50 50 query93 1472497 493 493 query94 1117191 189 189 query95 410 311 310 310 query96 598 273 272 272 query97 3189299129872987 query98 234 244 217 217 query99 1205853 859 853 Total cold run time: 251812 ms Total hot run time: 169193 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp
Re: [PR] [fix](SenderQueue) error memlimt in add/sub _blocks_memory_usage [doris]
Mryange commented on PR #35428: URL: https://github.com/apache/doris/pull/35428#issuecomment-2132709151 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test]reset workload_group_max_num for P0 [doris]
doris-robot commented on PR #35430: URL: https://github.com/apache/doris/pull/35430#issuecomment-2132708975 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [test]reset workload_group_max_num for P0 [doris]
wangbo opened a new pull request, #35430: URL: https://github.com/apache/doris/pull/35430 ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (717722e1114 -> b66f9ffbab1)
This is an automated email from the ASF dual-hosted git repository. zhangstar333 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from 717722e1114 Support drop partition statistics. (#35374) add b66f9ffbab1 [improve](nereids) support pushdown count when scan project without any slot ref (#35162) No new revisions were added by this update. Summary of changes: .../org/apache/doris/nereids/rules/RuleType.java | 1 + .../rules/implementation/AggregateStrategies.java | 41 ++ .../eliminate_distinct_constant.out| 8 ++--- .../push_down_filter_other_condition.out | 2 +- .../explain/test_pushdown_explain.groovy | 8 + 5 files changed, 55 insertions(+), 5 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](nereids) support pushdown count when scan project without any slot ref [doris]
zhangstar333 merged PR #35162: URL: https://github.com/apache/doris/pull/35162 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](ub) fix some runtime error of ubsan when downcast [doris]
github-actions[bot] commented on PR #35343: URL: https://github.com/apache/doris/pull/35343#issuecomment-2132705636 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](s3) auto retry when meeting 429 error [doris]
github-actions[bot] commented on PR #35397: URL: https://github.com/apache/doris/pull/35397#issuecomment-2132703700 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Bug](runtime-filter) try to fix DCHECK fail on _acquire_runtime_filter [doris]
yiguolei commented on PR #35422: URL: https://github.com/apache/doris/pull/35422#issuecomment-2132700693 If we could not make sure DCHECK(MonotonicMillis() - registration_time_ >= wait_times_ms); in some abnormal cases, we should remove this dcheck. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](ubsan) fix some Undefined behavior [doris]
Mryange commented on PR #35393: URL: https://github.com/apache/doris/pull/35393#issuecomment-2132699131 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](catalog) close connection on refresh [doris]
doris-robot commented on PR #35426: URL: https://github.com/apache/doris/pull/35426#issuecomment-2132698635 TPC-H: Total hot run time: 41591 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit ff762da79273ae5cd35cec221b590b5e4c4ed8c9, data reload: false -- Round 1 -- q1 17606 451142334233 q2 2021188 192 188 q3 10437 125411641164 q4 10195 821 791 791 q5 7480275226842684 q6 229 130 131 130 q7 938 607 622 607 q8 9229210620652065 q9 9267663266526632 q10 9029394638553855 q11 466 238 243 238 q12 438 237 232 232 q13 17272 326831793179 q14 280 224 246 224 q15 522 483 489 483 q16 518 398 408 398 q17 975 708 608 608 q18 8224776077647760 q19 3667153715081508 q20 624 317 323 317 q21 5055401640464016 q22 353 291 279 279 Total cold run time: 114825 ms Total hot run time: 41591 ms - Round 2, with runtime_filter_mode=off - q1 4505434844044348 q2 374 291 277 277 q3 3092292728892889 q4 2014172416421642 q5 5291547555055475 q6 213 127 131 127 q7 2214185218831852 q8 3196343334113411 q9 8641865186498649 q10 4094388037463746 q11 584 486 492 486 q12 778 590 616 590 q13 16820 316931913169 q14 303 271 279 271 q15 514 493 489 489 q16 528 434 428 428 q17 1814155515371537 q18 7841767474587458 q19 1682156515291529 q20 1996176217861762 q21 10364 485347074707 q22 584 494 504 494 Total cold run time: 77442 ms Total hot run time: 55336 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](inverted index) fix race condition in index build [doris]
doris-robot commented on PR #35427: URL: https://github.com/apache/doris/pull/35427#issuecomment-2132697633 ClickBench: Total hot run time: 30.71 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 4e99366840b7930a23e62ec32d36cf99ac5d530b, data reload: false query1 0.040.030.03 query2 0.080.040.04 query3 0.230.050.05 query4 1.670.070.07 query5 0.470.480.50 query6 1.120.720.71 query7 0.020.010.01 query8 0.050.040.04 query9 0.540.500.48 query10 0.540.550.56 query11 0.150.120.11 query12 0.150.120.11 query13 0.590.580.59 query14 0.780.780.77 query15 0.810.790.81 query16 0.370.370.38 query17 1.001.010.94 query18 0.220.220.27 query19 1.751.661.74 query20 0.020.010.00 query21 15.46 0.670.66 query22 4.227.122.19 query23 18.32 1.411.38 query24 1.820.230.23 query25 0.140.070.08 query26 0.260.170.17 query27 0.070.080.08 query28 13.30 1.031.01 query29 13.21 3.313.25 query30 0.250.060.06 query31 2.870.390.38 query32 3.280.470.47 query33 2.872.912.84 query34 17.25 4.414.46 query35 4.514.494.47 query36 0.650.460.46 query37 0.180.150.16 query38 0.160.150.14 query39 0.040.030.04 query40 0.170.130.15 query41 0.090.040.04 query42 0.050.050.05 query43 0.050.030.04 Total cold run time: 109.82 s Total hot run time: 30.71 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](paimon)fix paimon cache bug [doris]
github-actions[bot] commented on PR #35309: URL: https://github.com/apache/doris/pull/35309#issuecomment-2132696951 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](paimon)fix paimon cache bug [doris]
github-actions[bot] commented on PR #35309: URL: https://github.com/apache/doris/pull/35309#issuecomment-2132696993 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [only for test] "[fix](ubsan) fix some Undefined behavior #35393" [doris]
doris-robot commented on PR #35394: URL: https://github.com/apache/doris/pull/35394#issuecomment-2132695683 TeamCity be ut coverage result: Function Coverage: 35.75% (9010/25206) Line Coverage: 27.37% (74573/272488) Region Coverage: 26.58% (38574/145121) Branch Coverage: 23.44% (19668/83916) Coverage Report: http://coverage.selectdb-in.cc/coverage/dafb759d9e85c87e975cac5ef2a1abc0e7a6ff56_dafb759d9e85c87e975cac5ef2a1abc0e7a6ff56/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](inverted index) fix race condition in index build [doris]
doris-robot commented on PR #35427: URL: https://github.com/apache/doris/pull/35427#issuecomment-2132691894 TPC-DS: Total hot run time: 173261 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 4e99366840b7930a23e62ec32d36cf99ac5d530b, data reload: false query1 923 382 377 377 query2 6946223224372232 query3 6655208 204 204 query4 19625 17443 17470 17443 query5 4178427 401 401 query6 248 157 152 152 query7 4582307 294 294 query8 235 177 188 177 query9 8390235723482348 query10 457 280 265 265 query11 10543 10219 10143 10143 query12 143 91 91 91 query13 1643373 369 369 query14 10264 778176807680 query15 242 169 172 169 query16 8123275 266 266 query17 1873548 540 540 query18 1979290 277 277 query19 360 155 164 155 query20 98 89 91 89 query21 205 141 132 132 query22 4162403338543854 query23 33801 33163 33177 33163 query24 11520 282728822827 query25 638 349 357 349 query26 1728154 154 154 query27 2853316 322 316 query28 7291204320472043 query29 1004614 594 594 query30 273 150 162 150 query31 951 751 746 746 query32 87 51 53 51 query33 762 293 278 278 query34 1020476 470 470 query35 728 621 580 580 query36 1046905 942 905 query37 276 69 69 69 query38 2877278827392739 query39 861 796 804 796 query40 282 125 127 125 query41 48 44 45 44 query42 104 95 95 95 query43 599 581 530 530 query44 1215739 752 739 query45 180 169 162 162 query46 1066723 721 721 query47 1847180718051805 query48 369 312 304 304 query49 1185389 388 388 query50 770 392 391 391 query51 6999690568146814 query52 100 91 84 84 query53 345 287 291 287 query54 1013438 424 424 query55 75 76 73 73 query56 258 239 251 239 query57 1118104010671040 query58 240 208 210 208 query59 3368309431893094 query60 306 258 293 258 query61 91 86 87 86 query62 649 438 453 438 query63 313 287 291 287 query64 9731217917501750 query65 3172308831103088 query66 1345331 324 324 query67 15423 14802 14821 14802 query68 6307529 532 529 query69 504 274 278 274 query70 1183108410841084 query71 499 280 268 268 query72 7987534355875343 query73 809 326 328 326 query74 6118573156765676 query75 4075259926282599 query76 44761009969 969 query77 642 268 265 265 query78 10252 10042 97569756 query79 2981518 511 511 query80 1393436 449 436 query81 509 224 224 224 query82 832 95 87 87 query83 198 171 171 171 query84 265 89 89 89 query85 1455262 259 259 query86 478 326 320 320 query87 3240316531043104 query88 4738246824592459 query89 502 394 386 386 query90 1992193 187 187 query91 128 98 97 97 query92 60 51 48 48 query93 4450511 493 493 query94 1136185 187 185 query95 402 309 308 308 query96 603 266 269 266 query97 3272301630823016 query98 243 219 213 213 query99 1260825 881 825 Total cold run time: 284790 ms Total hot run time: 173261 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp
Re: [PR] [Fix](inverted index) fix race condition in index build [doris]
doris-robot commented on PR #35427: URL: https://github.com/apache/doris/pull/35427#issuecomment-2132681093 TPC-H: Total hot run time: 39677 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 4e99366840b7930a23e62ec32d36cf99ac5d530b, data reload: false -- Round 1 -- q1 17643 440642544254 q2 2017183 193 183 q3 10581 114111601141 q4 10172 752 835 752 q5 7485265426192619 q6 218 132 133 132 q7 938 598 604 598 q8 9222206720442044 q9 8906648564876485 q10 8841369237233692 q11 442 245 239 239 q12 452 215 219 215 q13 18712 299229812981 q14 274 215 229 215 q15 520 481 470 470 q16 533 384 376 376 q17 978 647 712 647 q18 8103740074267400 q19 7761155915031503 q20 639 298 301 298 q21 4950385531573157 q22 337 276 284 276 Total cold run time: 119724 ms Total hot run time: 39677 ms - Round 2, with runtime_filter_mode=off - q1 4325421841814181 q2 369 275 262 262 q3 3005273427842734 q4 1831161516051605 q5 5258527952585258 q6 208 122 126 122 q7 2117178617601760 q8 3164331833073307 q9 8338832882988298 q10 3889372936353635 q11 595 486 499 486 q12 757 607 597 597 q13 17396 298129812981 q14 286 262 266 262 q15 516 475 480 475 q16 480 411 411 411 q17 1788149314821482 q18 7794755174047404 q19 1650157215841572 q20 1995178517901785 q21 5002479548074795 q22 554 503 492 492 Total cold run time: 71317 ms Total hot run time: 53904 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](jdbcScan) Change the mysql function that does not support pushdown in JdbcScan to Config [doris]
doris-robot commented on PR #35196: URL: https://github.com/apache/doris/pull/35196#issuecomment-2132680017 ClickBench: Total hot run time: 30.4 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 25946d47995548631fddac44fa0c1ca306196d45, data reload: false query1 0.040.030.03 query2 0.080.040.05 query3 0.230.050.04 query4 1.690.070.07 query5 0.490.490.50 query6 1.120.720.72 query7 0.030.010.01 query8 0.050.040.04 query9 0.530.470.49 query10 0.540.550.55 query11 0.150.100.11 query12 0.140.120.11 query13 0.590.590.58 query14 0.780.770.79 query15 0.840.820.81 query16 0.360.370.38 query17 1.011.020.96 query18 0.220.240.25 query19 1.801.671.69 query20 0.020.010.00 query21 15.76 0.650.64 query22 4.466.771.75 query23 18.28 1.391.22 query24 1.550.250.33 query25 0.140.090.09 query26 0.280.170.17 query27 0.080.080.08 query28 13.28 1.010.99 query29 13.84 3.293.26 query30 0.250.060.05 query31 2.880.370.37 query32 3.280.450.46 query33 2.922.942.94 query34 17.08 4.464.43 query35 4.514.574.57 query36 0.650.480.51 query37 0.170.150.15 query38 0.150.150.14 query39 0.040.030.03 query40 0.170.140.15 query41 0.090.050.05 query42 0.050.050.04 query43 0.040.040.04 Total cold run time: 110.66 s Total hot run time: 30.4 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](inverted index) fix race condition in index build [doris]
doris-robot commented on PR #35427: URL: https://github.com/apache/doris/pull/35427#issuecomment-2132680545 TeamCity be ut coverage result: Function Coverage: 35.73% (9007/25205) Line Coverage: 27.36% (74546/272435) Region Coverage: 26.58% (38566/145088) Branch Coverage: 23.44% (19663/83894) Coverage Report: http://coverage.selectdb-in.cc/coverage/4e99366840b7930a23e62ec32d36cf99ac5d530b_4e99366840b7930a23e62ec32d36cf99ac5d530b/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](nereids) fix merge aggregate setting top projection bug [doris]
doris-robot commented on PR #35348: URL: https://github.com/apache/doris/pull/35348#issuecomment-2132679825 ClickBench: Total hot run time: 30.73 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 3defeb6dd438f56943128e3fcdaab6fcadff3d69, data reload: false query1 0.040.030.03 query2 0.080.040.04 query3 0.230.050.05 query4 1.690.070.07 query5 0.480.510.50 query6 1.120.720.72 query7 0.020.020.01 query8 0.050.030.04 query9 0.540.490.50 query10 0.540.540.54 query11 0.150.120.11 query12 0.140.120.11 query13 0.600.580.60 query14 0.770.790.77 query15 0.820.820.80 query16 0.360.350.37 query17 0.960.981.02 query18 0.200.260.23 query19 1.781.681.74 query20 0.020.010.01 query21 15.43 0.690.66 query22 4.377.002.27 query23 18.31 1.421.26 query24 1.950.230.21 query25 0.140.090.08 query26 0.280.160.18 query27 0.080.080.08 query28 13.31 1.021.00 query29 12.77 3.293.23 query30 0.230.050.06 query31 2.870.380.38 query32 3.300.470.47 query33 2.862.882.92 query34 17.23 4.404.45 query35 4.534.474.57 query36 0.690.500.46 query37 0.170.150.15 query38 0.150.140.15 query39 0.040.040.03 query40 0.150.140.14 query41 0.100.050.04 query42 0.060.040.04 query43 0.050.040.03 Total cold run time: 109.66 s Total hot run time: 30.73 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](external) ignore not find files [doris]
doris-robot commented on PR #35319: URL: https://github.com/apache/doris/pull/35319#issuecomment-2132680246 TeamCity be ut coverage result: Function Coverage: 35.74% (9009/25205) Line Coverage: 27.37% (74560/272458) Region Coverage: 26.59% (38576/145100) Branch Coverage: 23.44% (19667/83902) Coverage Report: http://coverage.selectdb-in.cc/coverage/88096d0e39b32ce605f1fcab3dcf5ddff63a43ff_88096d0e39b32ce605f1fcab3dcf5ddff63a43ff/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](external) ignore not find files [doris]
doris-robot commented on PR #35319: URL: https://github.com/apache/doris/pull/35319#issuecomment-2132679879 ClickBench: Total hot run time: 30.56 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 88096d0e39b32ce605f1fcab3dcf5ddff63a43ff, data reload: false query1 0.040.030.03 query2 0.080.040.04 query3 0.230.060.05 query4 1.660.100.09 query5 0.500.560.49 query6 1.130.730.72 query7 0.020.020.02 query8 0.050.040.04 query9 0.540.490.48 query10 0.530.550.53 query11 0.160.110.11 query12 0.160.130.12 query13 0.590.590.60 query14 0.760.790.78 query15 0.820.810.82 query16 0.350.360.37 query17 1.011.011.02 query18 0.220.230.22 query19 1.821.801.75 query20 0.010.020.01 query21 15.45 0.690.67 query22 4.297.281.87 query23 18.33 1.321.18 query24 1.450.310.26 query25 0.130.100.09 query26 0.250.160.16 query27 0.080.080.09 query28 13.40 1.000.99 query29 12.63 3.343.29 query30 0.230.050.06 query31 2.880.400.38 query32 3.260.470.47 query33 2.932.882.91 query34 17.03 4.434.49 query35 4.484.474.52 query36 0.680.500.45 query37 0.180.160.15 query38 0.150.150.15 query39 0.040.040.03 query40 0.160.150.14 query41 0.080.040.05 query42 0.050.050.05 query43 0.040.030.04 Total cold run time: 108.88 s Total hot run time: 30.56 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [bugfix](hive)Partition fields in wrong order [doris]
doris-robot commented on PR #35322: URL: https://github.com/apache/doris/pull/35322#issuecomment-2132679793 ClickBench: Total hot run time: 31.12 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 59c6b5de80b66ea31b30b90245860e01449331f0, data reload: false query1 0.030.030.03 query2 0.080.040.04 query3 0.230.050.05 query4 1.680.070.08 query5 0.480.500.50 query6 1.130.720.72 query7 0.020.010.01 query8 0.050.040.03 query9 0.530.490.48 query10 0.540.550.53 query11 0.150.110.11 query12 0.150.120.12 query13 0.590.590.59 query14 0.770.760.80 query15 0.830.810.81 query16 0.360.360.36 query17 0.981.001.00 query18 0.240.240.24 query19 1.771.731.69 query20 0.010.000.01 query21 15.72 0.660.65 query22 4.376.212.58 query23 18.24 1.361.16 query24 1.620.310.22 query25 0.150.090.08 query26 0.280.180.18 query27 0.080.080.08 query28 13.32 1.010.99 query29 12.99 3.333.26 query30 0.240.060.05 query31 2.870.390.39 query32 3.270.450.47 query33 2.882.892.87 query34 17.08 4.464.45 query35 4.484.514.49 query36 0.670.490.48 query37 0.170.150.16 query38 0.150.150.15 query39 0.040.030.04 query40 0.160.140.14 query41 0.090.040.04 query42 0.060.050.05 query43 0.030.040.04 Total cold run time: 109.58 s Total hot run time: 31.12 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](spill) fix wrong disk usage of spill [doris]
doris-robot commented on PR #35423: URL: https://github.com/apache/doris/pull/35423#issuecomment-2132677781 TeamCity be ut coverage result: Function Coverage: 35.73% (9007/25206) Line Coverage: 27.36% (74558/272478) Region Coverage: 26.58% (38570/145085) Branch Coverage: 23.45% (19670/83894) Coverage Report: http://coverage.selectdb-in.cc/coverage/144712af7bebae2f89aa6dc9bdae3ba20f792d69_144712af7bebae2f89aa6dc9bdae3ba20f792d69/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](Row store) forbit create MTMV with row store [doris]
doris-robot commented on PR #35336: URL: https://github.com/apache/doris/pull/35336#issuecomment-2132675174 ClickBench: Total hot run time: 30.78 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 888307570f165801f1d5f60263f6020129e3d452, data reload: false query1 0.040.030.03 query2 0.080.040.05 query3 0.230.050.05 query4 1.670.070.08 query5 0.500.480.50 query6 1.130.730.71 query7 0.020.010.01 query8 0.050.040.05 query9 0.540.490.49 query10 0.550.540.53 query11 0.160.120.11 query12 0.140.120.13 query13 0.590.590.60 query14 0.760.780.78 query15 0.830.810.81 query16 0.360.340.37 query17 0.960.971.02 query18 0.210.250.23 query19 1.901.721.66 query20 0.010.020.01 query21 15.71 0.650.65 query22 4.166.592.28 query23 18.32 1.381.27 query24 1.970.220.22 query25 0.140.100.09 query26 0.260.170.16 query27 0.090.090.09 query28 13.24 1.011.00 query29 13.18 3.253.26 query30 0.250.050.06 query31 2.890.380.38 query32 3.290.470.46 query33 2.862.882.96 query34 17.05 4.444.40 query35 4.474.504.52 query36 0.650.460.46 query37 0.180.160.15 query38 0.160.150.15 query39 0.050.030.03 query40 0.160.130.14 query41 0.080.040.04 query42 0.060.040.05 query43 0.040.040.03 Total cold run time: 109.99 s Total hot run time: 30.78 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](jdbcScan) Change the mysql function that does not support pushdown in JdbcScan to Config [doris]
doris-robot commented on PR #35196: URL: https://github.com/apache/doris/pull/35196#issuecomment-2132674885 TPC-DS: Total hot run time: 172104 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 25946d47995548631fddac44fa0c1ca306196d45, data reload: false query1 940 377 367 367 query2 6433242123432343 query3 6654202 205 202 query4 19173 17388 17216 17216 query5 4103414 417 414 query6 251 158 148 148 query7 4583294 291 291 query8 259 183 177 177 query9 8586237023502350 query10 466 291 268 268 query11 10664 10229 99039903 query12 139 98 87 87 query13 1642360 363 360 query14 10164 762172917291 query15 211 174 168 168 query16 7466272 260 260 query17 1555521 518 518 query18 1292269 263 263 query19 200 153 147 147 query20 93 88 87 87 query21 196 132 133 132 query22 4243397939703970 query23 33430 32992 32877 32877 query24 6872287129482871 query25 496 356 358 356 query26 695 153 162 153 query27 1904320 331 320 query28 3835205520372037 query29 866 596 590 590 query30 224 151 151 151 query31 950 753 729 729 query32 74 53 55 53 query33 510 265 258 258 query34 859 466 466 466 query35 701 596 592 592 query36 1067917 884 884 query37 105 65 70 65 query38 2875277227362736 query39 844 791 797 791 query40 196 124 123 123 query41 46 45 44 44 query42 100 97 93 93 query43 560 536 550 536 query44 1104730 751 730 query45 180 162 165 162 query46 1050718 720 718 query47 1865173517651735 query48 383 299 302 299 query49 783 412 413 412 query50 776 378 390 378 query51 6910672067646720 query52 100 97 90 90 query53 354 286 296 286 query54 540 454 447 447 query55 77 74 74 74 query56 284 262 266 262 query57 1128103610611036 query58 245 221 216 216 query59 3483304230243024 query60 298 274 279 274 query61 110 109 115 109 query62 555 448 450 448 query63 316 291 290 290 query64 3208193717561756 query65 3172310630973097 query66 766 342 352 342 query67 15280 14666 14910 14666 query68 4554533 518 518 query69 440 264 273 264 query70 1141107311401073 query71 399 280 286 280 query72 7625575857835758 query73 726 326 317 317 query74 6095553056145530 query75 3367262326322623 query76 23191029947 947 query77 386 269 260 260 query78 10351 979296959695 query79 2440515 501 501 query80 884 433 426 426 query81 510 224 217 217 query82 671 88 89 88 query83 247 170 172 170 query84 247 87 83 83 query85 1283272 313 272 query86 468 316 295 295 query87 3252307131563071 query88 3921243124432431 query89 491 394 373 373 query90 2067184 182 182 query91 122 96 96 96 query92 58 48 48 48 query93 2533498 485 485 query94 1165188 181 181 query95 395 313 308 308 query96 589 268 269 268 query97 3188302630743026 query98 236 218 216 216 query99 1158852 844 844 Total cold run time: 252817 ms Total hot run time: 172104 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp
Re: [PR] [opt](external) ignore not find files [doris]
doris-robot commented on PR #35319: URL: https://github.com/apache/doris/pull/35319#issuecomment-2132674741 TPC-DS: Total hot run time: 168976 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 88096d0e39b32ce605f1fcab3dcf5ddff63a43ff, data reload: false query1 930 379 385 379 query2 6457244222932293 query3 6639208 203 203 query4 19251 17511 17157 17157 query5 4142430 427 427 query6 256 165 156 156 query7 4583294 285 285 query8 245 190 184 184 query9 8457236023502350 query10 453 279 273 273 query11 10569 10106 10163 10106 query12 138 94 92 92 query13 1647384 371 371 query14 10349 701775197017 query15 256 161 164 161 query16 8038259 269 259 query17 1727511 501 501 query18 2083287 271 271 query19 198 155 156 155 query20 91 81 81 81 query21 195 128 147 128 query22 4196393038043804 query23 33701 32962 32971 32962 query24 9935285227662766 query25 570 355 363 355 query26 704 154 161 154 query27 2176324 328 324 query28 5736203820342034 query29 845 612 596 596 query30 235 146 157 146 query31 953 769 760 760 query32 94 52 58 52 query33 658 274 292 274 query34 866 478 485 478 query35 703 585 591 585 query36 1096902 920 902 query37 103 66 67 66 query38 2912275028222750 query39 832 795 829 795 query40 194 130 123 123 query41 47 46 43 43 query42 103 95 96 95 query43 589 567 541 541 query44 1087741 759 741 query45 178 158 156 156 query46 1056717 726 717 query47 1837172617521726 query48 384 297 313 297 query49 850 390 418 390 query50 773 401 397 397 query51 6896672467116711 query52 102 96 90 90 query53 349 294 294 294 query54 823 436 444 436 query55 75 73 71 71 query56 263 246 247 246 query57 1129105910241024 query58 234 211 217 211 query59 3414312531043104 query60 285 260 269 260 query61 96 92 91 91 query62 586 471 457 457 query63 312 287 294 287 query64 8460215217091709 query65 3153308931083089 query66 780 328 331 328 query67 15251 14837 14721 14721 query68 4470526 570 526 query69 443 268 276 268 query70 1194114711401140 query71 374 270 273 270 query72 7463572526872687 query73 736 332 322 322 query74 6035563455615561 query75 3331266726312631 query76 2309957 954 954 query77 371 273 265 265 query78 10434 965997099659 query79 1932516 508 508 query80 1031443 429 429 query81 516 222 218 218 query82 669 94 91 91 query83 242 173 173 173 query84 252 90 92 90 query85 1526333 324 324 query86 464 306 318 306 query87 3314310831533108 query88 4236243824402438 query89 468 395 390 390 query90 2045192 192 192 query91 123 96 99 96 query92 58 51 50 50 query93 2319515 493 493 query94 1278187 187 187 query95 414 312 306 306 query96 586 284 267 267 query97 3169295230102952 query98 248 225 218 218 query99 1114869 850 850 Total cold run time: 265489 ms Total hot run time: 168976 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp
Re: [PR] [Fix](nereids) fix merge aggregate setting top projection bug [doris]
doris-robot commented on PR #35348: URL: https://github.com/apache/doris/pull/35348#issuecomment-2132674675 TPC-DS: Total hot run time: 172456 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 3defeb6dd438f56943128e3fcdaab6fcadff3d69, data reload: false query1 908 378 364 364 query2 7569239425242394 query3 6638201 201 201 query4 19402 17215 17294 17215 query5 4135410 414 410 query6 246 157 152 152 query7 4573302 285 285 query8 253 183 183 183 query9 8457235223512351 query10 450 280 263 263 query11 10558 998310037 9983 query12 135 97 88 88 query13 1649362 362 362 query14 10010 745174007400 query15 244 175 168 168 query16 7963263 254 254 query17 1764509 504 504 query18 2058266 267 266 query19 198 156 150 150 query20 94 84 86 84 query21 191 129 132 129 query22 4378396439443944 query23 33574 32996 33102 32996 query24 9022289527932793 query25 551 347 356 347 query26 694 153 152 152 query27 2184323 319 319 query28 5722205420472047 query29 841 615 613 613 query30 223 148 150 148 query31 967 755 747 747 query32 93 51 56 51 query33 628 265 258 258 query34 840 467 478 467 query35 684 618 613 613 query36 1101899 897 897 query37 100 66 64 64 query38 2928277728092777 query39 824 778 810 778 query40 206 126 122 122 query41 46 45 44 44 query42 102 95 96 95 query43 597 572 577 572 query44 1074731 751 731 query45 191 179 169 169 query46 1066693 686 686 query47 1868178218001782 query48 363 305 300 300 query49 875 383 382 382 query50 761 386 382 382 query51 6827683168056805 query52 97 91 85 85 query53 352 281 283 281 query54 738 428 417 417 query55 73 72 73 72 query56 259 239 239 239 query57 1132100510471005 query58 237 207 206 206 query59 3562329032773277 query60 282 256 280 256 query61 88 87 86 86 query62 608 455 449 449 query63 306 281 278 278 query64 8424221118001800 query65 3186304630863046 query66 790 334 317 317 query67 15267 15030 14917 14917 query68 4549523 519 519 query69 476 266 259 259 query70 1190108311301083 query71 382 285 256 256 query72 7518527457395274 query73 711 336 316 316 query74 5970579055715571 query75 3331259726192597 query76 2601963 957 957 query77 586 263 263 263 query78 10273 978897939788 query79 1798512 508 508 query80 680 458 490 458 query81 471 215 214 214 query82 769 91 87 87 query83 191 172 166 166 query84 241 87 85 85 query85 1243261 259 259 query86 439 310 274 274 query87 3285315530913091 query88 3878243524352435 query89 471 376 373 373 query90 2036187 185 185 query91 121 96 95 95 query92 59 47 48 47 query93 2051496 482 482 query94 1184183 184 183 query95 412 311 302 302 query96 586 273 265 265 query97 3146299530072995 query98 241 219 208 208 query99 1145843 854 843 Total cold run time: 264260 ms Total hot run time: 172456 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe
Re: [PR] [bugfix](hive)Partition fields in wrong order [doris]
doris-robot commented on PR #35322: URL: https://github.com/apache/doris/pull/35322#issuecomment-2132674649 TPC-DS: Total hot run time: 168715 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 59c6b5de80b66ea31b30b90245860e01449331f0, data reload: false query1 911 379 368 368 query2 6444256923772377 query3 6637205 210 205 query4 20945 17380 17114 17114 query5 4093431 416 416 query6 246 154 154 154 query7 4585292 289 289 query8 240 182 181 181 query9 8799235823492349 query10 455 283 266 266 query11 10583 10193 10133 10133 query12 129 89 88 88 query13 1628363 370 363 query14 9359688168596859 query15 221 162 167 162 query16 7418250 255 250 query17 1324531 526 526 query18 1902264 270 264 query19 199 159 154 154 query20 86 85 80 80 query21 192 129 129 129 query22 4101398540013985 query23 33625 33042 32987 32987 query24 7880283728202820 query25 568 354 357 354 query26 731 155 152 152 query27 2231316 329 316 query28 5439203120302030 query29 841 593 601 593 query30 220 153 148 148 query31 950 767 727 727 query32 85 51 51 51 query33 544 270 262 262 query34 881 464 473 464 query35 679 616 599 599 query36 1051953 918 918 query37 102 67 68 67 query38 2922281128022802 query39 822 770 796 770 query40 197 127 125 125 query41 49 48 46 46 query42 105 102 99 99 query43 618 558 526 526 query44 1064739 756 739 query45 179 157 161 157 query46 1053699 709 699 query47 1866174817571748 query48 368 295 309 295 query49 834 384 382 382 query50 762 378 384 378 query51 6959683667246724 query52 109 91 91 91 query53 347 296 297 296 query54 551 439 423 423 query55 74 70 73 70 query56 253 241 247 241 query57 1130104110391039 query58 232 210 227 210 query59 3536323732423237 query60 268 251 247 247 query61 91 89 85 85 query62 585 436 450 436 query63 316 283 280 280 query64 8485220416871687 query65 3165308330963083 query66 826 326 322 322 query67 15192 15077 14649 14649 query68 4861527 530 527 query69 492 264 265 264 query70 1186112111631121 query71 410 265 267 265 query72 8168268425252525 query73 716 319 321 319 query74 6054561055305530 query75 3399266026612660 query76 3189995 1016995 query77 643 262 256 256 query78 10166 993496019601 query79 2072515 503 503 query80 1632441 430 430 query81 525 216 222 216 query82 812 90 89 89 query83 288 163 181 163 query84 257 87 85 85 query85 1439256 257 256 query86 481 292 276 276 query87 3266313031503130 query88 4131243524362435 query89 467 381 378 378 query90 2015183 189 183 query91 125 93 97 93 query92 58 50 50 50 query93 2428517 491 491 query94 1278195 191 191 query95 411 319 380 319 query96 592 277 268 268 query97 3202300629612961 query98 243 209 218 209 query99 1170840 841 840 Total cold run time: 265458 ms Total hot run time: 168715 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp
Re: [PR] [enhance](catalog)show partitions support iceberg [doris]
doris-robot commented on PR #35424: URL: https://github.com/apache/doris/pull/35424#issuecomment-2132674541 ClickBench: Total hot run time: 30.46 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 3432b8bbb3db2da443b64c835e86393f966f8ec9, data reload: false query1 0.040.030.03 query2 0.080.030.04 query3 0.230.060.05 query4 1.660.100.10 query5 0.500.490.51 query6 1.120.730.73 query7 0.020.010.01 query8 0.050.040.04 query9 0.530.500.49 query10 0.550.550.53 query11 0.150.100.11 query12 0.150.110.11 query13 0.600.590.59 query14 0.780.790.80 query15 0.840.830.81 query16 0.370.370.36 query17 0.950.980.94 query18 0.220.260.24 query19 1.821.691.69 query20 0.010.010.01 query21 16.12 0.650.64 query22 4.387.471.94 query23 18.26 1.421.22 query24 1.780.280.21 query25 0.150.090.09 query26 0.260.170.17 query27 0.090.080.09 query28 13.35 1.051.07 query29 12.69 3.273.23 query30 0.250.060.05 query31 2.880.380.37 query32 3.280.480.49 query33 2.842.882.89 query34 17.13 4.394.43 query35 4.534.504.46 query36 0.650.480.48 query37 0.180.160.15 query38 0.150.140.14 query39 0.050.040.03 query40 0.170.140.14 query41 0.090.050.05 query42 0.050.040.05 query43 0.040.030.04 Total cold run time: 110.04 s Total hot run time: 30.46 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](SenderQueue) error memlimt in add/sub _blocks_memory_usage [doris]
github-actions[bot] commented on PR #35428: URL: https://github.com/apache/doris/pull/35428#issuecomment-2132671145 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
