This is an automated email from the ASF dual-hosted git repository.
liaoxin pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 682be10a549 [fix](routine load) fix invalid EOF tasks scheduling delay
(#44949)
682be10a549 is described below
commit 682be10a549801a1d70764cc0f25512738fa1c41
Author: hui lai <lai...@selectdb.com>
AuthorDate: Fri Dec 6 11:07:26 2024 +0800
[fix](routine load) fix invalid EOF tasks scheduling delay (#44949)
Related PR: https://github.com/apache/doris/pull/39975
In the above PR, we introduce delay schedule EOF tasks to avoid too many
small transactions, but it is invalid, the pr fix the issue.
---
.../org/apache/doris/load/routineload/RoutineLoadTaskScheduler.java | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/load/routineload/RoutineLoadTaskScheduler.java
b/fe/fe-core/src/main/java/org/apache/doris/load/routineload/RoutineLoadTaskScheduler.java
index 8afc35411b5..d40a6705626 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/load/routineload/RoutineLoadTaskScheduler.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/load/routineload/RoutineLoadTaskScheduler.java
@@ -106,7 +106,7 @@ public class RoutineLoadTaskScheduler extends MasterDaemon {
if (routineLoadTaskInfo.getIsEof()) {
RoutineLoadJob routineLoadJob =
routineLoadManager.getJob(routineLoadTaskInfo.getJobId());
if (System.currentTimeMillis() -
routineLoadTaskInfo.getLastScheduledTime()
- < routineLoadJob.getMaxBatchIntervalS()) {
+ < routineLoadJob.getMaxBatchIntervalS() * 1000) {
needScheduleTasksQueue.addLast(routineLoadTaskInfo);
return;
}
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
