Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-06-03 Thread via GitHub


morrySnow merged PR #50942:
URL: https://github.com/apache/doris/pull/50942


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-06-03 Thread via GitHub


github-actions[bot] commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2938199957

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-06-03 Thread via GitHub


github-actions[bot] commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2938199892

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-06-03 Thread via GitHub


zddr commented on code in PR #50942:
URL: https://github.com/apache/doris/pull/50942#discussion_r2123474988


##
fe/fe-core/src/main/java/org/apache/doris/job/manager/JobManager.java:
##
@@ -271,32 +294,50 @@ public void triggerJob(long jobId, C context) throws 
JobException {
 }
 
 public void replayCreateJob(T job) throws JobException {
-if (jobMap.containsKey(job.getJobId())) {
+// mtmv has its own editLog to replay jobs, here it is to ignore the 
logs already generated by older versions.
+if (!job.needPersist()) {
 return;
 }
-jobMap.putIfAbsent(job.getJobId(), job);
-job.onReplayCreate();
+createJobInternal(job, true);
 }
 
 /**
  * Replay update load job.
  **/
 public void replayUpdateJob(T job) {
-jobMap.put(job.getJobId(), job);
-log.info(new LogBuilder(LogKey.SCHEDULER_JOB, job.getJobId())
+Long jobId = job.getJobId();
+// In previous versions, the job ID in MTMV was not fixed (a new ID 
would be generated each time the editLog
+// was replayed), but the name was constant and unique. However, since 
job updates use jobId as the key,
+// it is possible that this jobId no longer exists. Therefore, we now 
look up the ID based on the name.
+if (!jobMap.containsKey(jobId) && job instanceof MTMVJob) {
+List jobs = queryJobs(JobType.MV, job.getJobName());
+if (CollectionUtils.isEmpty(jobs) || jobs.size() != 1) {
+LOG.warn("jobs by name: {} not normal,should have one job,but 
job num is: {}", job.getJobName(),
+jobs.size());
+return;
+}
+jobId = jobs.get(0).getJobId();
+job.setJobId(jobId);
+}
+
+if (!jobMap.containsKey(jobId)) {
+LOG.warn("replayUpdateJob not normal, job: {}, jobId: {}, jobMap: 
{}", job, jobId, jobMap);
+return;
+}
+jobMap.put(jobId, job);
+log.info(new LogBuilder(LogKey.SCHEDULER_JOB, jobId)
 .add("msg", "replay update scheduler job").build());
 }

Review Comment:
   The method org.apache.doris.job.base.AbstractJob#needPersist already exists, 
but the current logic is unrelated to it. The main purpose here is to maintain 
compatibility with the changes in the ID generation approach for MTMVJob. If 
this compatibility is not ensured, the IDs generated when creating a 
materialized view and when updating the job will differ, preventing successful 
updates.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-06-03 Thread via GitHub


zddr commented on code in PR #50942:
URL: https://github.com/apache/doris/pull/50942#discussion_r2123492431


##
fe/fe-core/src/main/java/org/apache/doris/job/base/AbstractJob.java:
##
@@ -265,6 +265,15 @@ public void initTasks(Collection tasks, 
TaskType taskType) {
 this.startTimeMs = System.currentTimeMillis();
 }
 
+/**
+ * Some of the logic does not satisfy idempotency—each job can only be 
called once.
+ */
+public void initParams() {
+if (jobConfig != null) {

Review Comment:
   This method is only called once during initialization, so there are no 
thread-safety concerns.
   
   



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-29 Thread via GitHub


CalvinKirs commented on code in PR #50942:
URL: https://github.com/apache/doris/pull/50942#discussion_r2115232956


##
fe/fe-core/src/main/java/org/apache/doris/job/manager/JobManager.java:
##
@@ -271,32 +294,50 @@ public void triggerJob(long jobId, C context) throws 
JobException {
 }
 
 public void replayCreateJob(T job) throws JobException {
-if (jobMap.containsKey(job.getJobId())) {
+// mtmv has its own editLog to replay jobs, here it is to ignore the 
logs already generated by older versions.
+if (!job.needPersist()) {
 return;
 }
-jobMap.putIfAbsent(job.getJobId(), job);
-job.onReplayCreate();
+createJobInternal(job, true);
 }
 
 /**
  * Replay update load job.
  **/
 public void replayUpdateJob(T job) {
-jobMap.put(job.getJobId(), job);
-log.info(new LogBuilder(LogKey.SCHEDULER_JOB, job.getJobId())
+Long jobId = job.getJobId();
+// In previous versions, the job ID in MTMV was not fixed (a new ID 
would be generated each time the editLog
+// was replayed), but the name was constant and unique. However, since 
job updates use jobId as the key,
+// it is possible that this jobId no longer exists. Therefore, we now 
look up the ID based on the name.
+if (!jobMap.containsKey(jobId) && job instanceof MTMVJob) {
+List jobs = queryJobs(JobType.MV, job.getJobName());
+if (CollectionUtils.isEmpty(jobs) || jobs.size() != 1) {
+LOG.warn("jobs by name: {} not normal,should have one job,but 
job num is: {}", job.getJobName(),
+jobs.size());
+return;
+}
+jobId = jobs.get(0).getJobId();
+job.setJobId(jobId);
+}
+
+if (!jobMap.containsKey(jobId)) {
+LOG.warn("replayUpdateJob not normal, job: {}, jobId: {}, jobMap: 
{}", job, jobId, jobMap);
+return;
+}
+jobMap.put(jobId, job);
+log.info(new LogBuilder(LogKey.SCHEDULER_JOB, jobId)
 .add("msg", "replay update scheduler job").build());
 }

Review Comment:
   Can persistence be used as a status flag that different task types set 
internally themselves, so that the task management layer can rely on this flag 
to make decisions—instead of using such an intrusive approach?



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-26 Thread via GitHub


morrySnow commented on code in PR #50942:
URL: https://github.com/apache/doris/pull/50942#discussion_r2108090843


##
fe/fe-core/src/main/java/org/apache/doris/job/base/AbstractJob.java:
##
@@ -265,6 +265,15 @@ public void initTasks(Collection tasks, 
TaskType taskType) {
 this.startTimeMs = System.currentTimeMillis();
 }
 
+/**
+ * Some of the logic does not satisfy idempotency—each job can only be 
called once.
+ */
+public void initParams() {
+if (jobConfig != null) {

Review Comment:
   do not need lock?



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-22 Thread via GitHub


doris-robot commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2901827572

   
   
   ClickBench: Total hot run time: 29.42 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 5f267e2336c17197542d652cf0f83bbf6418c8fd, 
data reload: false
   
   query1   0.040.040.03
   query2   0.130.100.10
   query3   0.240.190.20
   query4   1.590.200.21
   query5   0.460.440.45
   query6   1.540.670.68
   query7   0.020.020.02
   query8   0.040.030.04
   query9   0.570.520.52
   query10  0.550.580.56
   query11  0.160.110.11
   query12  0.140.120.12
   query13  0.620.590.61
   query14  0.790.810.79
   query15  0.880.860.87
   query16  0.370.370.37
   query17  1.051.061.02
   query18  0.230.210.21
   query19  1.911.831.82
   query20  0.010.010.01
   query21  15.40   0.860.54
   query22  0.761.230.93
   query23  14.73   1.360.61
   query24  6.860.901.28
   query25  0.510.160.07
   query26  0.660.170.14
   query27  0.050.050.06
   query28  9.360.950.45
   query29  12.58   3.923.30
   query30  0.260.100.07
   query31  2.820.590.37
   query32  3.220.560.47
   query33  3.043.073.11
   query34  15.73   5.134.51
   query35  4.494.524.49
   query36  0.670.520.48
   query37  0.090.060.06
   query38  0.060.040.04
   query39  0.020.020.02
   query40  0.180.130.12
   query41  0.080.020.02
   query42  0.040.030.02
   query43  0.040.030.03
   Total cold run time: 102.99 s
   Total hot run time: 29.42 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-22 Thread via GitHub


doris-robot commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2901809861

   
   
   TPC-DS: Total hot run time: 185944 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 5f267e2336c17197542d652cf0f83bbf6418c8fd, 
data reload: false
   
   query1   1033479 497 479
   query2   6581184918471847
   query3   6785228 223 223
   query4   26883   23662   22971   22971
   query5   4387631 481 481
   query6   303 218 211 211
   query7   4630489 285 285
   query8   294 259 247 247
   query9   8606263626452636
   query10  493 329 273 273
   query11  15819   15090   14973   14973
   query12  156 113 107 107
   query13  1684533 410 410
   query14  9022620161456145
   query15  204 187 170 170
   query16  7156621 470 470
   query17  1189720 566 566
   query18  1964396 332 332
   query19  192 187 159 159
   query20  117 115 118 115
   query21  213 119 107 107
   query22  3994446039443944
   query23  33849   33138   33095   33095
   query24  8569238723582358
   query25  543 466 400 400
   query26  1234277 159 159
   query27  2749499 341 341
   query28  4330214221292129
   query29  763 566 446 446
   query30  278 223 188 188
   query31  914 870 746 746
   query32  75  74  66  66
   query33  557 378 316 316
   query34  829 863 529 529
   query35  795 797 747 747
   query36  939 971 901 901
   query37  108 106 81  81
   query38  4101407340994073
   query39  1515142714171417
   query40  224 124 116 116
   query41  63  59  60  59
   query42  127 117 117 117
   query43  504 504 498 498
   query44  1294835 813 813
   query45  183 184 172 172
   query46  847 1014633 633
   query47  1768178417071707
   query48  392 439 314 314
   query49  811 531 503 503
   query50  639 686 418 418
   query51  4175419941274127
   query52  107 104 100 100
   query53  223 254 187 187
   query54  587 571 507 507
   query55  92  87  83  83
   query56  316 300 289 289
   query57  1142118510881088
   query58  264 265 263 263
   query59  2617270725732573
   query60  350 319 312 312
   query61  126 124 128 124
   query62  784 749 684 684
   query63  228 190 198 190
   query64  4337984 666 666
   query65  4309424742394239
   query66  1139433 321 321
   query67  15730   15917   15348   15348
   query68  7922891 533 533
   query69  477 316 271 271
   query70  1210113710671067
   query71  469 322 300 300
   query72  5594470547614705
   query73  677 584 356 356
   query74  9065894786908690
   query75  3799322026862686
   query76  36701196765 765
   query77  786 387 336 336
   query78  10149   10098   93749374
   query79  2506835 592 592
   query80  611 506 457 457
   query81  491 254 215 215
   query82  452 132 101 101
   query83  291 247 238 238
   query84  296 110 85  85
   query85  785 361 317 317
   query86  391 308 270 270
   query87  4392451644164416
   query88  3526227122602260
   query89  396 313 292 292
   query90  1836217 208 208
   query91  155 145 113 113
   query92  78  63  57  57
   query93  1847951 589 589
   query94  656 395 321 321
   query95  377 296 289 289
   query96  490 578 289 289
   query97  2757279826622662
   query98  235 205 204 204
   query99  1436139212921292
   Total cold run time: 275053 ms
   Total hot run time: 185944 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go t

Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-22 Thread via GitHub


doris-robot commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2901772172

   
   
   TPC-H: Total hot run time: 34250 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 5f267e2336c17197542d652cf0f83bbf6418c8fd, 
data reload: false
   
   -- Round 1 --
   q1   26691   520151435143
   q2   2068290 189 189
   q3   10437   1272723 723
   q4   10258   990 539 539
   q5   8462250623692369
   q6   192 166 134 134
   q7   923 749 626 626
   q8   9315129911001100
   q9   6851515351245124
   q10  6894230718921892
   q11  485 285 279 279
   q12  349 355 219 219
   q13  17789   368431683168
   q14  235 243 209 209
   q15  537 491 490 490
   q16  416 429 375 375
   q17  603 884 370 370
   q18  7633717571637163
   q19  1833959 563 563
   q20  328 351 228 228
   q21  3682317423682368
   q22  10481012979 979
   Total cold run time: 117029 ms
   Total hot run time: 34250 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5308520051805180
   q2   240 328 234 234
   q3   2117262822912291
   q4   1331188814781478
   q5   4562443943814381
   q6   222 176 131 131
   q7   2008189917631763
   q8   2609257425032503
   q9   7158722670567056
   q10  3009315127652765
   q11  578 512 507 507
   q12  701 796 619 619
   q13  3533389234133413
   q14  282 305 286 286
   q15  523 479 475 475
   q16  441 483 442 442
   q17  1163165613281328
   q18  7751753472717271
   q19  874 816 871 816
   q20  2006203718701870
   q21  4789432343184318
   q22  1064102210101010
   Total cold run time: 52269 ms
   Total hot run time: 50137 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-22 Thread via GitHub


zddr commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2901695542

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-22 Thread via GitHub


doris-robot commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2901389782

   
   
   ClickBench: Total hot run time: 29.29 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 5f267e2336c17197542d652cf0f83bbf6418c8fd, 
data reload: false
   
   query1   0.040.040.03
   query2   0.120.100.11
   query3   0.250.190.20
   query4   1.590.200.10
   query5   0.430.420.42
   query6   1.150.660.66
   query7   0.030.020.01
   query8   0.040.030.03
   query9   0.560.520.51
   query10  0.560.580.56
   query11  0.150.110.11
   query12  0.140.110.12
   query13  0.620.600.60
   query14  0.780.810.81
   query15  0.870.870.86
   query16  0.420.410.38
   query17  1.031.061.08
   query18  0.210.210.21
   query19  1.921.831.82
   query20  0.010.010.01
   query21  15.42   0.910.54
   query22  0.741.300.98
   query23  14.70   1.380.65
   query24  6.971.460.70
   query25  0.490.220.13
   query26  0.720.160.15
   query27  0.050.060.05
   query28  9.260.920.44
   query29  12.56   3.903.26
   query30  0.260.090.07
   query31  2.820.580.40
   query32  3.220.550.47
   query33  3.073.113.07
   query34  15.74   5.054.49
   query35  4.524.524.50
   query36  0.660.500.49
   query37  0.090.060.06
   query38  0.050.040.03
   query39  0.030.030.02
   query40  0.160.140.14
   query41  0.090.030.02
   query42  0.030.020.03
   query43  0.040.030.03
   Total cold run time: 102.61 s
   Total hot run time: 29.29 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-22 Thread via GitHub


doris-robot commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2901373058

   
   
   TPC-DS: Total hot run time: 193055 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 5f267e2336c17197542d652cf0f83bbf6418c8fd, 
data reload: false
   
   query1   1415109110811081
   query2   6399184218411841
   query3   11019   447744524452
   query4   54700   24696   23416   23416
   query5   5189510 479 479
   query6   387 214 198 198
   query7   5076510 302 302
   query8   348 274 256 256
   query9   6440263126712631
   query10  433 342 278 278
   query11  15126   15084   14785   14785
   query12  170 110 110 110
   query13  1153528 411 411
   query14  10114   636664066366
   query15  205 223 189 189
   query16  7042657 509 509
   query17  1088743 608 608
   query18  1566409 313 313
   query19  210 195 176 176
   query20  130 127 117 117
   query21  207 172 108 108
   query22  4252430842894289
   query23  34216   33499   33539   33499
   query24  6552248924522452
   query25  454 468 407 407
   query26  750 279 167 167
   query27  2349515 351 351
   query28  3492216021792160
   query29  589 570 439 439
   query30  277 226 195 195
   query31  860 844 788 788
   query32  79  67  64  64
   query33  452 376 317 317
   query34  805 856 549 549
   query35  796 864 771 771
   query36  944 1017910 910
   query37  116 99  79  79
   query38  4239422343124223
   query39  1504150014661466
   query40  222 123 115 115
   query41  59  52  59  52
   query42  130 115 117 115
   query43  519 509 491 491
   query44  1364839 837 837
   query45  177 181 175 175
   query46  868 1045664 664
   query47  1833187318161816
   query48  411 437 335 335
   query49  689 508 456 456
   query50  643 691 409 409
   query51  4259440441724172
   query52  107 112 100 100
   query53  227 261 184 184
   query54  595 602 520 520
   query55  86  83  82  82
   query56  303 324 304 304
   query57  1151117511341134
   query58  266 267 266 266
   query59  2758286227782778
   query60  361 324 303 303
   query61  124 122 120 120
   query62  746 730 644 644
   query63  236 197 185 185
   query64  17871055675 675
   query65  4314419642164196
   query66  726 409 309 309
   query67  15956   15599   15458   15458
   query68  8076911 527 527
   query69  567 314 266 266
   query70  1199113110851085
   query71  517 341 296 296
   query72  5793475647624756
   query73  1273627 354 354
   query74  8907880888958808
   query75  4042321826852685
   query76  43781189778 778
   query77  615 401 290 290
   query78  996410259   93409340
   query79  2976815 580 580
   query80  642 522 454 454
   query81  492 263 220 220
   query82  460 136 98  98
   query83  358 253 236 236
   query84  293 110 86  86
   query85  796 361 311 311
   query86  376 316 291 291
   query87  4389444743674367
   query88  3043229023632290
   query89  425 318 289 289
   query90  1981215 230 215
   query91  140 143 109 109
   query92  68  61  58  58
   query93  1800941 583 583
   query94  691 463 315 315
   query95  368 317 303 303
   query96  503 560 288 288
   query97  2731279826542654
   query98  229 215 204 204
   query99  1426141712721272
   Total cold run time: 301578 ms
   Total hot run time: 193055 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go 

Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-22 Thread via GitHub


doris-robot commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2901329676

   
   
   TPC-H: Total hot run time: 34541 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 5f267e2336c17197542d652cf0f83bbf6418c8fd, 
data reload: false
   
   -- Round 1 --
   q1   25983   517650725072
   q2   2087269 184 184
   q3   10408   1220699 699
   q4   10207   997 510 510
   q5   7521233023522330
   q6   182 170 138 138
   q7   909 776 634 634
   q8   9302127810791079
   q9   6807508851555088
   q10  7106235819141914
   q11  494 304 282 282
   q12  355 367 224 224
   q13  17879   380731933193
   q14  232 236 219 219
   q15  533 480 485 480
   q16  430 448 383 383
   q17  600 881 386 386
   q18  7726729670107010
   q19  1681961 569 569
   q20  346 338 233 233
   q21  3758318929492949
   q22  1032994 965 965
   Total cold run time: 115578 ms
   Total hot run time: 34541 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5257512251965122
   q2   240 336 226 226
   q3   2217263923142314
   q4   1357179514281428
   q5   4469439543914391
   q6   223 175 134 134
   q7   1999195317881788
   q8   2583251425232514
   q9   7193717970117011
   q10  3052316227182718
   q11  602 511 502 502
   q12  684 763 616 616
   q13  3598393634223422
   q14  290 291 264 264
   q15  518 485 472 472
   q16  440 501 452 452
   q17  1167157813831383
   q18  7848767974737473
   q19  811 872 1047872
   q20  1952197619241924
   q21  4921450245114502
   q22  1097103910581039
   Total cold run time: 52518 ms
   Total hot run time: 50567 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-22 Thread via GitHub


zddr commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2901198197

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-21 Thread via GitHub


zddr commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2896523834

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-20 Thread via GitHub


doris-robot commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2896657927

   
   
   ClickBench: Total hot run time: 29.48 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 7c4b5ecf1ff44da1dcd5ad5fdb31cde1f7f29111, 
data reload: false
   
   query1   0.040.040.04
   query2   0.120.100.11
   query3   0.260.190.20
   query4   1.600.190.19
   query5   0.450.430.44
   query6   1.180.670.66
   query7   0.020.010.01
   query8   0.040.040.04
   query9   0.600.510.52
   query10  0.580.580.58
   query11  0.160.110.11
   query12  0.140.120.11
   query13  0.610.600.59
   query14  0.790.810.81
   query15  0.870.840.85
   query16  0.380.390.38
   query17  1.041.021.07
   query18  0.220.210.21
   query19  1.901.871.78
   query20  0.020.010.01
   query21  15.40   0.850.53
   query22  0.771.000.68
   query23  15.07   1.370.66
   query24  6.721.761.13
   query25  0.450.160.11
   query26  0.580.170.14
   query27  0.050.050.05
   query28  9.360.890.43
   query29  12.64   4.003.36
   query30  0.250.090.07
   query31  2.810.600.39
   query32  3.230.540.46
   query33  3.003.193.10
   query34  15.83   5.064.48
   query35  4.504.554.50
   query36  0.660.500.48
   query37  0.080.060.06
   query38  0.050.040.03
   query39  0.030.020.02
   query40  0.160.130.12
   query41  0.080.020.02
   query42  0.040.020.02
   query43  0.040.040.03
   Total cold run time: 102.82 s
   Total hot run time: 29.48 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-20 Thread via GitHub


doris-robot commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2896649460

   
   
   TPC-DS: Total hot run time: 192616 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 7c4b5ecf1ff44da1dcd5ad5fdb31cde1f7f29111, 
data reload: false
   
   query1   1392109710741074
   query2   6326187718251825
   query3   11029   452044174417
   query4   53859   25675   23153   23153
   query5   5129521 451 451
   query6   342 209 211 209
   query7   4887540 318 318
   query8   327 258 232 232
   query9   5596265026542650
   query10  466 338 271 271
   query11  15073   15039   14777   14777
   query12  160 113 105 105
   query13  1052531 417 417
   query14  10123   632063736320
   query15  212 206 179 179
   query16  7099646 511 511
   query17  1106770 618 618
   query18  1575415 322 322
   query19  202 199 183 183
   query20  138 127 125 125
   query21  211 131 109 109
   query22  4369454744514451
   query23  34346   9   33463   9
   query24  6749242723982398
   query25  474 468 413 413
   query26  711 275 155 155
   query27  2320532 363 363
   query28  3182218821902188
   query29  593 561 436 436
   query30  277 214 184 184
   query31  859 860 813 813
   query32  88  59  64  59
   query33  451 354 300 300
   query34  788 857 545 545
   query35  786 824 753 753
   query36  946 1015911 911
   query37  108 100 81  81
   query38  4193432341824182
   query39  1524143814601438
   query40  210 128 110 110
   query41  53  53  53  53
   query42  128 117 116 116
   query43  516 524 494 494
   query44  1400871 841 841
   query45  188 177 170 170
   query46  876 1030652 652
   query47  1844188617741774
   query48  404 442 321 321
   query49  710 533 438 438
   query50  686 726 410 410
   query51  4245434741734173
   query52  115 113 109 109
   query53  233 255 206 206
   query54  612 583 522 522
   query55  92  81  82  81
   query56  331 321 306 306
   query57  1177118811751175
   query58  272 266 277 266
   query59  2638281926752675
   query60  347 328 304 304
   query61  126 132 124 124
   query62  740 742 706 706
   query63  242 195 195 195
   query64  18951056715 715
   query65  4443423642264226
   query66  724 407 361 361
   query67  16053   15527   15511   15511
   query68  7025896 521 521
   query69  540 302 267 267
   query70  1253110211101102
   query71  510 335 308 308
   query72  5937478850624788
   query73  1455696 357 357
   query74  8985915885768576
   query75  3903318327122712
   query76  42071204781 781
   query77  633 369 290 290
   query78  10101   10106   93619361
   query79  2533864 577 577
   query80  635 507 444 444
   query81  500 254 223 223
   query82  428 126 97  97
   query83  359 252 241 241
   query84  288 106 84  84
   query85  809 346 313 313
   query86  386 290 288 288
   query87  4435440944134409
   query88  3498234423162316
   query89  417 333 282 282
   query90  1768214 211 211
   query91  145 156 112 112
   query92  77  61  55  55
   query93  1994932 570 570
   query94  672 409 293 293
   query95  369 296 294 294
   query96  513 581 290 290
   query97  2753276226512651
   query98  231 208 205 205
   query99  1447138912891289
   Total cold run time: 299174 ms
   Total hot run time: 192616 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go 

Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-20 Thread via GitHub


doris-robot commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2896628191

   
   
   TPC-H: Total hot run time: 33873 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 7c4b5ecf1ff44da1dcd5ad5fdb31cde1f7f29111, 
data reload: false
   
   -- Round 1 --
   q1   26352   503250095009
   q2   2068274 181 181
   q3   10393   1224676 676
   q4   10218   1009530 530
   q5   7532235423442344
   q6   190 164 132 132
   q7   928 747 624 624
   q8   9317128310851085
   q9   6840510951425109
   q10  6859232318721872
   q11  488 284 289 284
   q12  344 351 215 215
   q13  17780   367131153115
   q14  241 220 206 206
   q15  527 477 486 477
   q16  427 426 375 375
   q17  606 858 367 367
   q18  7559722771427142
   q19  1399948 577 577
   q20  361 332 221 221
   q21  3878317523732373
   q22  996 997 959 959
   Total cold run time: 115303 ms
   Total hot run time: 33873 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5108508550655065
   q2   240 334 236 236
   q3   2122263923012301
   q4   1388173313491349
   q5   4395435444104354
   q6   227 167 126 126
   q7   2041189817571757
   q8   2602249524342434
   q9   7229724669486948
   q10  3060317727782778
   q11  567 526 482 482
   q12  693 760 611 611
   q13  3488393332483248
   q14  274 305 294 294
   q15  545 487 504 487
   q16  471 511 437 437
   q17  1146152213661366
   q18  7778748874357435
   q19  831 888 941 888
   q20  1995206718751875
   q21  4824451145004500
   q22  1109104910181018
   Total cold run time: 52133 ms
   Total hot run time: 49989 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-20 Thread via GitHub


zddr commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2893811793

   run cloud_p0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-20 Thread via GitHub


doris-robot commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2893706443

   
   
   TPC-DS: Total hot run time: 187108 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 56d31eda708aedfc4e3065c9e42fca91017ee021, 
data reload: false
   
   query1   1023497 515 497
   query2   6571181817811781
   query3   6761224 226 224
   query4   26641   23404   23478   23404
   query5   4363660 458 458
   query6   295 229 206 206
   query7   4621501 304 304
   query8   304 264 253 253
   query9   8620267926512651
   query10  483 334 292 292
   query11  15880   15054   14894   14894
   query12  160 121 108 108
   query13  1666545 430 430
   query14  8743627363516273
   query15  212 189 170 170
   query16  7138658 474 474
   query17  1016695 562 562
   query18  1970394 285 285
   query19  187 195 162 162
   query20  125 127 117 117
   query21  215 127 106 106
   query22  4063413540764076
   query23  33876   33185   33266   33185
   query24  8475242624212421
   query25  531 476 390 390
   query26  1242300 165 165
   query27  2723508 340 340
   query28  4329211421022102
   query29  796 563 440 440
   query30  285 220 188 188
   query31  919 838 747 747
   query32  75  66  66  66
   query33  576 375 335 335
   query34  821 895 534 534
   query35  779 832 717 717
   query36  964 998 891 891
   query37  121 106 85  85
   query38  4112416241004100
   query39  1474140114231401
   query40  213 125 114 114
   query41  58  54  54  54
   query42  126 112 116 112
   query43  513 516 482 482
   query44  1376840 834 834
   query45  182 174 170 170
   query46  873 1045656 656
   query47  1744178317111711
   query48  387 439 324 324
   query49  797 535 434 434
   query50  662 716 402 402
   query51  4203413241074107
   query52  115 113 102 102
   query53  249 257 191 191
   query54  588 575 507 507
   query55  92  87  83  83
   query56  317 307 331 307
   query57  1145113910961096
   query58  269 257 265 257
   query59  2552269225192519
   query60  318 321 301 301
   query61  127 126 133 126
   query62  807 737 660 660
   query63  231 193 199 193
   query64  44321012689 689
   query65  4353423142584231
   query66  1131404 324 324
   query67  16050   15597   15349   15349
   query68  4687922 538 538
   query69  490 318 278 278
   query70  1192112710961096
   query71  426 337 306 306
   query72  5715489549134895
   query73  670 612 372 372
   query74  9282913289998999
   query75  3231327427272727
   query76  31841211785 785
   query77  508 514 301 301
   query78  10131   10252   93729372
   query79  2769829 573 573
   query80  1536543 469 469
   query81  542 251 219 219
   query82  715 134 102 102
   query83  273 254 236 236
   query84  299 114 80  80
   query85  806 354 422 354
   query86  473 281 281 281
   query87  4412449243394339
   query88  4134233923252325
   query89  403 323 295 295
   query90  1908226 220 220
   query91  146 144 122 122
   query92  79  63  57  57
   query93  2534933 582 582
   query94  795 412 315 315
   query95  384 299 293 293
   query96  495 565 289 289
   query97  2783276126432643
   query98  247 211 207 207
   query99  1460144812691269
   Total cold run time: 273774 ms
   Total hot run time: 187108 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go t

Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-20 Thread via GitHub


doris-robot commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2893721163

   
   
   ClickBench: Total hot run time: 29.41 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 56d31eda708aedfc4e3065c9e42fca91017ee021, 
data reload: false
   
   query1   0.040.040.03
   query2   0.130.110.10
   query3   0.240.200.20
   query4   1.590.200.11
   query5   0.450.410.42
   query6   1.170.660.67
   query7   0.030.010.02
   query8   0.040.030.04
   query9   0.590.520.51
   query10  0.570.600.57
   query11  0.150.110.11
   query12  0.160.120.11
   query13  0.620.600.60
   query14  0.780.810.81
   query15  0.880.870.87
   query16  0.400.400.40
   query17  1.051.071.05
   query18  0.230.210.20
   query19  1.991.861.80
   query20  0.010.010.01
   query21  15.41   0.860.54
   query22  0.761.230.72
   query23  14.74   1.340.64
   query24  6.761.081.38
   query25  0.560.230.15
   query26  0.520.160.13
   query27  0.050.040.04
   query28  10.72   0.890.44
   query29  12.51   4.053.30
   query30  0.250.090.06
   query31  2.830.590.38
   query32  3.240.550.47
   query33  3.143.043.08
   query34  15.70   5.074.54
   query35  4.504.524.48
   query36  0.670.500.49
   query37  0.080.070.06
   query38  0.050.040.04
   query39  0.030.020.02
   query40  0.170.140.13
   query41  0.080.030.02
   query42  0.030.020.02
   query43  0.040.030.03
   Total cold run time: 103.96 s
   Total hot run time: 29.41 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-20 Thread via GitHub


doris-robot commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2893670406

   
   
   TPC-H: Total hot run time: 33909 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 56d31eda708aedfc4e3065c9e42fca91017ee021, 
data reload: false
   
   -- Round 1 --
   q1   26442   507250625062
   q2   2099292 184 184
   q3   10380   1272693 693
   q4   10230   1076516 516
   q5   7545224924792249
   q6   182 173 134 134
   q7   948 803 637 637
   q8   9332137711501150
   q9   6822509551305095
   q10  6826230018861886
   q11  473 296 278 278
   q12  365 356 216 216
   q13  17768   368930913091
   q14  234 227 219 219
   q15  530 492 499 492
   q16  441 427 380 380
   q17  601 876 364 364
   q18  8113722671137113
   q19  1208945 567 567
   q20  343 349 225 225
   q21  3915319824122412
   q22  994 1016946 946
   Total cold run time: 115791 ms
   Total hot run time: 33909 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5130505751055057
   q2   241 335 232 232
   q3   2199269822652265
   q4   1361182314281428
   q5   4553449344114411
   q6   253 178 131 131
   q7   2016192117391739
   q8   2605273326232623
   q9   7107720372447203
   q10  2959315327332733
   q11  577 499 506 499
   q12  696 740 606 606
   q13  3522393432783278
   q14  282 285 278 278
   q15  527 485 472 472
   q16  455 495 442 442
   q17  1145158713751375
   q18  7783748774127412
   q19  823 806 865 806
   q20  1991201519461946
   q21  4879435143054305
   q22  1061103010071007
   Total cold run time: 52165 ms
   Total hot run time: 50248 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-20 Thread via GitHub


zddr commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2893599560

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-19 Thread via GitHub


doris-robot commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2892757126

   
   
   ClickBench: Total hot run time: 29.02 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit ff5a5000dd83b48ec5a13f3c9d0ae36a368e7f22, 
data reload: false
   
   query1   0.040.040.03
   query2   0.130.100.12
   query3   0.250.200.20
   query4   1.600.200.11
   query5   0.430.410.44
   query6   1.160.660.65
   query7   0.020.020.02
   query8   0.040.030.04
   query9   0.580.530.52
   query10  0.570.570.57
   query11  0.150.110.11
   query12  0.140.120.11
   query13  0.620.610.61
   query14  0.780.780.80
   query15  0.890.870.87
   query16  0.380.390.37
   query17  1.071.061.05
   query18  0.230.210.21
   query19  1.921.791.84
   query20  0.020.010.01
   query21  15.40   0.870.55
   query22  0.761.080.65
   query23  15.03   1.400.64
   query24  7.361.670.84
   query25  0.490.360.06
   query26  0.510.160.14
   query27  0.050.050.05
   query28  9.690.870.45
   query29  12.56   3.953.31
   query30  0.270.090.06
   query31  2.810.610.39
   query32  3.230.550.46
   query33  3.143.083.09
   query34  15.62   5.124.50
   query35  4.504.504.49
   query36  0.670.490.48
   query37  0.090.070.06
   query38  0.050.040.03
   query39  0.040.030.03
   query40  0.180.130.13
   query41  0.080.020.02
   query42  0.040.030.02
   query43  0.030.030.03
   Total cold run time: 103.62 s
   Total hot run time: 29.02 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-19 Thread via GitHub


doris-robot commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2892751049

   
   
   TPC-DS: Total hot run time: 187339 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit ff5a5000dd83b48ec5a13f3c9d0ae36a368e7f22, 
data reload: false
   
   query1   1012475 493 475
   query2   6596187318251825
   query3   6738221 224 221
   query4   26398   23503   23574   23503
   query5   4274590 462 462
   query6   294 205 200 200
   query7   4625500 285 285
   query8   294 248 247 247
   query9   8602268426692669
   query10  527 322 278 278
   query11  15743   15149   15528   15149
   query12  161 107 101 101
   query13  1651523 408 408
   query14  9087623763096237
   query15  233 204 169 169
   query16  7170637 479 479
   query17  1214729 588 588
   query18  1979405 314 314
   query19  198 192 175 175
   query20  124 118 119 118
   query21  213 139 112 112
   query22  4041421642034203
   query23  34183   33060   33230   33060
   query24  8450241124182411
   query25  565 506 422 422
   query26  1244287 164 164
   query27  2732509 348 348
   query28  4364211921092109
   query29  794 608 424 424
   query30  286 206 186 186
   query31  933 870 768 768
   query32  73  70  68  68
   query33  557 370 320 320
   query34  833 868 539 539
   query35  816 808 748 748
   query36  941 989 894 894
   query37  107 102 80  80
   query38  4116413241354132
   query39  1543141814231418
   query40  218 127 107 107
   query41  63  56  54  54
   query42  125 112 108 108
   query43  516 501 470 470
   query44  1322858 833 833
   query45  179 174 165 165
   query46  842 1019639 639
   query47  1741179717301730
   query48  415 425 315 315
   query49  774 529 445 445
   query50  641 685 429 429
   query51  4175419640614061
   query52  107 105 97  97
   query53  229 250 182 182
   query54  577 571 514 514
   query55  88  82  90  82
   query56  298 318 313 313
   query57  1136114310741074
   query58  273 256 253 253
   query59  2587271126552655
   query60  344 344 326 326
   query61  125 129 125 125
   query62  810 731 666 666
   query63  253 196 194 194
   query64  43681048677 677
   query65  4319428542594259
   query66  1159433 320 320
   query67  15991   15835   15362   15362
   query68  8447881 518 518
   query69  480 312 278 278
   query70  1213118511061106
   query71  462 331 302 302
   query72  5449477146884688
   query73  689 581 353 353
   query74  8916935988608860
   query75  4078321826952695
   query76  36461174734 734
   query77  774 363 285 285
   query78  10121   10339   94469446
   query79  1851875 605 605
   query80  633 514 453 453
   query81  470 255 219 219
   query82  420 125 98  98
   query83  299 270 251 251
   query84  258 104 86  86
   query85  799 372 314 314
   query86  338 305 298 298
   query87  4484447243314331
   query88  3335233823502338
   query89  383 309 301 301
   query90  1937216 215 215
   query91  159 151 121 121
   query92  83  63  55  55
   query93  1117955 590 590
   query94  663 419 310 310
   query95  382 296 287 287
   query96  495 565 288 288
   query97  2716276026562656
   query98  245 205 210 205
   query99  1437139712891289
   Total cold run time: 274165 ms
   Total hot run time: 187339 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to 

Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-19 Thread via GitHub


doris-robot commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2892737009

   
   
   TPC-H: Total hot run time: 33699 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit ff5a5000dd83b48ec5a13f3c9d0ae36a368e7f22, 
data reload: false
   
   -- Round 1 --
   q1   26779   518150505050
   q2   2092296 188 188
   q3   10399   1248699 699
   q4   10248   989 512 512
   q5   7691240323022302
   q6   185 166 134 134
   q7   910 757 643 643
   q8   9322127110781078
   q9   6735507150295029
   q10  6856232518711871
   q11  485 298 274 274
   q12  342 349 209 209
   q13  17787   368830643064
   q14  240 245 209 209
   q15  546 492 486 486
   q16  435 434 374 374
   q17  608 860 362 362
   q18  7774707270697069
   q19  1356955 561 561
   q20  341 353 227 227
   q21  3710322424122412
   q22  10411014946 946
   Total cold run time: 115882 ms
   Total hot run time: 33699 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5084510350385038
   q2   239 332 231 231
   q3   2179264222692269
   q4   1406179713561356
   q5   4571447243824382
   q6   214 172 129 129
   q7   2011192117701770
   q8   2584265226342634
   q9   7199715871837158
   q10  2997313227472747
   q11  564 520 504 504
   q12  685 780 614 614
   q13  3487389133023302
   q14  269 292 287 287
   q15  527 468 469 468
   q16  450 485 438 438
   q17  1204165713251325
   q18  7672748073347334
   q19  812 779 799 779
   q20  2012203019371937
   q21  4721428441914191
   q22  10841014969 969
   Total cold run time: 51971 ms
   Total hot run time: 49862 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-19 Thread via GitHub


zddr commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2892714255

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-19 Thread via GitHub


zddr commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2890615138

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-19 Thread via GitHub


doris-robot commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2890700689

   
   
   TPC-DS: Total hot run time: 187134 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 7806af5c8a01506214ffe3848f065bd4f54de6da, 
data reload: false
   
   query1   1041485 486 485
   query2   6565182018141814
   query3   6747238 217 217
   query4   26643   23676   23300   23300
   query5   4332640 470 470
   query6   326 214 201 201
   query7   4622494 305 305
   query8   299 251 222 222
   query9   8604263826442638
   query10  477 318 288 288
   query11  15762   15344   14814   14814
   query12  151 112 110 110
   query13  1660547 433 433
   query14  8619615062266150
   query15  209 203 171 171
   query16  7138626 499 499
   query17  967 761 590 590
   query18  1978420 307 307
   query19  196 190 170 170
   query20  132 117 120 117
   query21  226 126 112 112
   query22  4300445143244324
   query23  34105   33058   33319   33058
   query24  8405241324232413
   query25  574 551 393 393
   query26  1236269 153 153
   query27  2763502 345 345
   query28  4290215021292129
   query29  789 562 430 430
   query30  281 214 192 192
   query31  914 860 774 774
   query32  72  64  61  61
   query33  551 369 306 306
   query34  795 878 536 536
   query35  769 829 729 729
   query36  942 968 911 911
   query37  113 100 81  81
   query38  4198414541334133
   query39  1467140114081401
   query40  205 116 106 106
   query41  58  55  50  50
   query42  121 115 111 111
   query43  528 503 480 480
   query44  1315841 844 841
   query45  178 175 170 170
   query46  855 1029637 637
   query47  1805181417241724
   query48  390 431 319 319
   query49  787 517 423 423
   query50  646 696 409 409
   query51  4103419941544154
   query52  112 109 103 103
   query53  214 255 188 188
   query54  584 567 512 512
   query55  91  84  82  82
   query56  303 290 301 290
   query57  1179113310921092
   query58  274 253 256 253
   query59  2537269225562556
   query60  328 317 318 317
   query61  123 128 140 128
   query62  813 721 697 697
   query63  224 187 194 187
   query64  4383994 690 690
   query65  4295422142434221
   query66  1143459 310 310
   query67  15858   15730   15535   15535
   query68  7886904 555 555
   query69  478 319 277 277
   query70  1198108611141086
   query71  488 317 312 312
   query72  5880474746674667
   query73  698 594 359 359
   query74  8944914890179017
   query75  3901320227322732
   query76  37661205755 755
   query77  773 380 289 289
   query78  10212   10093   94199419
   query79  2898834 583 583
   query80  617 519 475 475
   query81  505 254 218 218
   query82  467 135 105 105
   query83  276 253 237 237
   query84  287 107 81  81
   query85  772 409 316 316
   query86  390 312 288 288
   query87  4481455143294329
   query88  3491238223842382
   query89  391 322 289 289
   query90  1892213 212 212
   query91  138 152 113 113
   query92  77  60  56  56
   query93  1932946 592 592
   query94  680 421 303 303
   query95  379 295 283 283
   query96  510 592 289 289
   query97  2723273626852685
   query98  237 209 216 209
   query99  1458144412541254
   Total cold run time: 275535 ms
   Total hot run time: 187134 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go t

Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-19 Thread via GitHub


zddr commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2890264470

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-19 Thread via GitHub


doris-robot commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2890715583

   
   
   ClickBench: Total hot run time: 29.05 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 7806af5c8a01506214ffe3848f065bd4f54de6da, 
data reload: false
   
   query1   0.040.040.03
   query2   0.120.110.10
   query3   0.250.190.19
   query4   1.590.200.19
   query5   0.440.390.42
   query6   1.150.660.67
   query7   0.020.020.01
   query8   0.040.040.03
   query9   0.580.520.51
   query10  0.570.580.56
   query11  0.150.110.10
   query12  0.150.120.12
   query13  0.610.590.60
   query14  0.780.820.81
   query15  0.870.860.85
   query16  0.380.380.39
   query17  1.051.041.06
   query18  0.220.200.20
   query19  1.961.851.78
   query20  0.020.010.01
   query21  15.53   0.900.56
   query22  0.741.210.75
   query23  14.83   1.360.57
   query24  7.340.941.12
   query25  0.430.280.06
   query26  0.610.170.14
   query27  0.050.040.04
   query28  9.230.870.43
   query29  12.60   3.963.26
   query30  0.250.100.08
   query31  2.810.590.39
   query32  3.230.560.46
   query33  3.043.033.19
   query34  15.81   5.024.50
   query35  4.534.534.50
   query36  0.670.500.48
   query37  0.090.060.06
   query38  0.050.040.03
   query39  0.030.020.02
   query40  0.170.130.13
   query41  0.080.020.02
   query42  0.030.020.02
   query43  0.030.030.03
   Total cold run time: 103.17 s
   Total hot run time: 29.05 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-19 Thread via GitHub


doris-robot commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2890668731

   
   
   TPC-H: Total hot run time: 33863 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 7806af5c8a01506214ffe3848f065bd4f54de6da, 
data reload: false
   
   -- Round 1 --
   q1   26498   508449864986
   q2   2082280 192 192
   q3   10384   1261711 711
   q4   10232   983 523 523
   q5   7518238123502350
   q6   182 162 130 130
   q7   922 741 636 636
   q8   9320130910521052
   q9   6868508850585058
   q10  6835233419001900
   q11  495 305 268 268
   q12  340 351 209 209
   q13  17746   361330813081
   q14  223 224 232 224
   q15  528 479 483 479
   q16  431 446 369 369
   q17  603 860 379 379
   q18  7689717573047175
   q19  1205960 547 547
   q20  345 357 236 236
   q21  3789313323832383
   q22  10581006975 975
   Total cold run time: 115293 ms
   Total hot run time: 33863 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5050506850405040
   q2   227 328 235 235
   q3   2197267422922292
   q4   1345177513731373
   q5   4552443943944394
   q6   210 166 131 131
   q7   1932189017801780
   q8   2577250124532453
   q9   7125719372307193
   q10  3017317426892689
   q11  576 512 499 499
   q12  663 764 604 604
   q13  3516386232063206
   q14  284 312 294 294
   q15  523 466 467 466
   q16  436 487 431 431
   q17  1146153913751375
   q18  7636756075177517
   q19  806 755 853 755
   q20  1982200419071907
   q21  4919432542024202
   q22  10831042996 996
   Total cold run time: 51802 ms
   Total hot run time: 49832 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-19 Thread via GitHub


doris-robot commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2890611385

   
   
   ClickBench: Total hot run time: 28.51 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 6f73a3c6492b8fe2a567af2495a0adb880980569, 
data reload: false
   
   query1   0.040.040.04
   query2   0.130.100.13
   query3   0.260.190.19
   query4   1.590.200.11
   query5   0.440.410.43
   query6   1.170.660.67
   query7   0.030.020.02
   query8   0.040.040.04
   query9   0.600.530.52
   query10  0.570.600.57
   query11  0.150.110.11
   query12  0.150.110.12
   query13  0.620.600.60
   query14  0.790.810.80
   query15  0.890.860.86
   query16  0.390.390.38
   query17  1.061.031.04
   query18  0.220.210.22
   query19  1.961.881.79
   query20  0.010.010.01
   query21  15.41   0.910.55
   query22  0.761.240.66
   query23  14.90   1.380.65
   query24  7.951.070.32
   query25  0.290.230.08
   query26  0.720.160.15
   query27  0.050.040.04
   query28  8.960.880.45
   query29  12.54   4.023.31
   query30  0.240.090.06
   query31  2.840.590.38
   query32  3.230.560.46
   query33  3.033.023.07
   query34  15.74   5.114.50
   query35  4.514.534.50
   query36  0.680.490.48
   query37  0.090.070.06
   query38  0.050.040.04
   query39  0.030.030.03
   query40  0.170.140.13
   query41  0.090.030.03
   query42  0.030.020.02
   query43  0.040.030.03
   Total cold run time: 103.46 s
   Total hot run time: 28.51 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-19 Thread via GitHub


doris-robot commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2890597138

   
   
   TPC-DS: Total hot run time: 187238 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 6f73a3c6492b8fe2a567af2495a0adb880980569, 
data reload: false
   
   query1   1018490 502 490
   query2   6558182617991799
   query3   6741233 218 218
   query4   26452   23831   23509   23509
   query5   4397624 483 483
   query6   299 199 191 191
   query7   4630502 314 314
   query8   296 260 251 251
   query9   8666266426912664
   query10  460 335 279 279
   query11  15784   15122   14784   14784
   query12  163 111 113 111
   query13  1669538 438 438
   query14  8921636161756175
   query15  234 199 167 167
   query16  7135619 493 493
   query17  1189708 563 563
   query18  1961392 295 295
   query19  203 183 163 163
   query20  119 123 123 123
   query21  215 128 104 104
   query22  4081414341084108
   query23  33939   33193   33210   33193
   query24  8447240423742374
   query25  544 484 393 393
   query26  1239268 154 154
   query27  2748510 349 349
   query28  4330214121302130
   query29  791 557 438 438
   query30  286 217 218 217
   query31  936 845 761 761
   query32  78  65  65  65
   query33  567 369 328 328
   query34  806 862 549 549
   query35  773 789 732 732
   query36  948 980 888 888
   query37  119 101 78  78
   query38  4129422542144214
   query39  1467141114251411
   query40  215 125 108 108
   query41  60  59  54  54
   query42  139 110 113 110
   query43  518 501 477 477
   query44  1322845 860 845
   query45  197 175 176 175
   query46  853 1026655 655
   query47  1764176817391739
   query48  401 426 343 343
   query49  777 538 437 437
   query50  668 674 427 427
   query51  4175416940474047
   query52  117 109 106 106
   query53  230 256 187 187
   query54  594 585 513 513
   query55  88  89  98  89
   query56  316 317 285 285
   query57  1142114711091109
   query58  279 262 260 260
   query59  2523263024662466
   query60  334 339 331 331
   query61  127 123 127 123
   query62  794 725 683 683
   query63  230 192 199 192
   query64  43701027695 695
   query65  4319426842424242
   query66  1146435 315 315
   query67  15862   15762   15457   15457
   query68  5102908 552 552
   query69  492 315 286 286
   query70  1201112411211121
   query71  402 339 305 305
   query72  5721483049214830
   query73  711 661 371 371
   query74  9450910986778677
   query75  3170319726972697
   query76  31831177757 757
   query77  493 385 299 299
   query78  10290   10465   94779477
   query79  1353852 576 576
   query80  854 530 458 458
   query81  495 260 217 217
   query82  402 126 101 101
   query83  260 253 243 243
   query84  246 107 86  86
   query85  808 359 316 316
   query86  336 303 300 300
   query87  4395448143354335
   query88  2999239023742374
   query89  390 320 294 294
   query90  1674221 216 216
   query91  147 158 119 119
   query92  62  62  61  61
   query93  1106959 597 597
   query94  672 423 304 304
   query95  382 299 290 290
   query96  505 569 297 297
   query97  2691277127022702
   query98  224 212 213 212
   query99  1296139513021302
   Total cold run time: 268410 ms
   Total hot run time: 187238 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go t

Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-19 Thread via GitHub


doris-robot commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2890564523

   
   
   TPC-H: Total hot run time: 34100 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 6f73a3c6492b8fe2a567af2495a0adb880980569, 
data reload: false
   
   -- Round 1 --
   q1   26861   506450405040
   q2   2073284 191 191
   q3   10536   1267755 755
   q4   10248   1024536 536
   q5   7813234123832341
   q6   189 167 135 135
   q7   948 764 608 608
   q8   9338129310841084
   q9   6778514750795079
   q10  6828233918791879
   q11  493 288 282 282
   q12  353 348 213 213
   q13  17782   368030963096
   q14  228 225 224 224
   q15  531 490 482 482
   q16  444 445 367 367
   q17  622 864 393 393
   q18  7670720272257202
   q19  2038960 568 568
   q20  349 346 235 235
   q21  4040311224002400
   q22  10531020990 990
   Total cold run time: 117215 ms
   Total hot run time: 34100 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5164505550285028
   q2   237 336 235 235
   q3   2199265722982298
   q4   1349180114211421
   q5   4605443443694369
   q6   219 171 129 129
   q7   1939188917801780
   q8   2575248024542454
   q9   7199718771227122
   q10  3019316927772777
   q11  578 515 493 493
   q12  684 778 588 588
   q13  3494385932383238
   q14  290 307 286 286
   q15  522 473 479 473
   q16  430 508 456 456
   q17  1159159914081408
   q18  7849759073607360
   q19  815 835 866 835
   q20  2007209219501950
   q21  4974433541814181
   q22  10491020979 979
   Total cold run time: 52356 ms
   Total hot run time: 49860 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-19 Thread via GitHub


doris-robot commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2890247630

   
   
   TPC-DS: Total hot run time: 188732 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 958208152cb3c68fc3a6586b8142d9815cbc012a, 
data reload: false
   
   query1   1026491 501 491
   query2   6592196219771962
   query3   6910238 233 233
   query4   26082   23247   23191   23191
   query5   4339640 465 465
   query6   315 218 197 197
   query7   4633516 331 331
   query8   322 274 259 259
   query9   8625286028582858
   query10  489 343 299 299
   query11  15904   15124   14829   14829
   query12  164 111 111 111
   query13  1646567 441 441
   query14  8850619062586190
   query15  212 205 183 183
   query16  7148647 520 520
   query17  1223759 597 597
   query18  1991411 332 332
   query19  211 201 189 189
   query20  127 126 131 126
   query21  219 133 113 113
   query22  4277416940684068
   query23  34299   33374   33193   33193
   query24  8571241524502415
   query25  573 498 421 421
   query26  1258305 160 160
   query27  2713527 363 363
   query28  4385229422732273
   query29  790 566 437 437
   query30  289 223 204 204
   query31  949 871 789 789
   query32  76  64  66  64
   query33  579 381 330 330
   query34  835 878 573 573
   query35  826 891 733 733
   query36  10101048948 948
   query37  125 103 77  77
   query38  4266423241434143
   query39  1475141414601414
   query40  217 122 114 114
   query41  63  56  58  56
   query42  131 124 120 120
   query43  575 545 529 529
   query44  1371866 870 866
   query45  180 175 172 172
   query46  876 1037669 669
   query47  1815182517351735
   query48  401 435 331 331
   query49  786 546 426 426
   query50  678 690 413 413
   query51  4141422241154115
   query52  122 113 110 110
   query53  246 262 188 188
   query54  632 618 536 536
   query55  95  91  87  87
   query56  328 310 296 296
   query57  1135116310861086
   query58  288 276 264 264
   query59  2790293127782778
   query60  362 334 340 334
   query61  133 134 132 132
   query62  838 727 672 672
   query63  235 191 198 191
   query64  43871075690 690
   query65  4317427242514251
   query66  1165442 321 321
   query67  16111   15861   15574   15574
   query68  8473930 556 556
   query69  485 319 285 285
   query70  1248111711211117
   query71  476 351 319 319
   query72  5805482049574820
   query73  763 740 395 395
   query74  9370918686928692
   query75  3941319427462746
   query76  36551205790 790
   query77  798 408 310 310
   query78  10092   10325   94219421
   query79  2603838 621 621
   query80  635 545 477 477
   query81  512 264 221 221
   query82  474 129 102 102
   query83  296 267 259 259
   query84  303 113 87  87
   query85  808 364 341 341
   query86  399 310 311 310
   query87  4455447943964396
   query88  3464250424962496
   query89  403 333 302 302
   query90  1857220 213 213
   query91  148 156 121 121
   query92  83  65  61  61
   query93  1797996 613 613
   query94  666 422 317 317
   query95  388 315 292 292
   query96  545 599 303 303
   query97  2798273926752675
   query98  258 221 221 221
   query99  1437137912751275
   Total cold run time: 278177 ms
   Total hot run time: 188732 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go t

Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-19 Thread via GitHub


doris-robot commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2890264781

   
   
   ClickBench: Total hot run time: 29.11 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 958208152cb3c68fc3a6586b8142d9815cbc012a, 
data reload: false
   
   query1   0.050.040.03
   query2   0.120.110.12
   query3   0.250.200.20
   query4   1.590.210.11
   query5   0.440.430.44
   query6   1.180.670.67
   query7   0.030.020.02
   query8   0.040.040.04
   query9   0.590.530.53
   query10  0.590.590.57
   query11  0.160.110.11
   query12  0.150.120.12
   query13  0.610.600.60
   query14  0.800.810.81
   query15  0.880.860.87
   query16  0.420.390.40
   query17  1.071.031.08
   query18  0.240.220.22
   query19  1.971.831.87
   query20  0.020.020.01
   query21  15.42   0.950.56
   query22  0.761.170.70
   query23  14.95   1.400.67
   query24  7.451.430.36
   query25  0.300.120.11
   query26  0.640.170.13
   query27  0.060.060.06
   query28  8.700.970.47
   query29  12.58   4.183.51
   query30  0.260.090.06
   query31  2.830.610.39
   query32  3.230.550.48
   query33  3.033.063.16
   query34  15.76   5.204.51
   query35  4.554.584.53
   query36  0.660.500.48
   query37  0.090.070.06
   query38  0.060.040.03
   query39  0.030.030.03
   query40  0.170.140.13
   query41  0.080.030.03
   query42  0.030.030.03
   query43  0.040.040.03
   Total cold run time: 102.88 s
   Total hot run time: 29.11 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv)MTMV uses a set of editLogs to resolve atomicity issues [doris]

2025-05-19 Thread via GitHub


doris-robot commented on PR #50942:
URL: https://github.com/apache/doris/pull/50942#issuecomment-2890207448

   
   
   TPC-H: Total hot run time: 34976 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 958208152cb3c68fc3a6586b8142d9815cbc012a, 
data reload: false
   
   -- Round 1 --
   q1   27321   502455135024
   q2   2083285 187 187
   q3   10392   1261694 694
   q4   10215   1014561 561
   q5   7544291323922392
   q6   189 165 136 136
   q7   939 750 611 611
   q8   9325128010801080
   q9   6872517251345134
   q10  6890235419161916
   q11  501 305 296 296
   q12  368 362 231 231
   q13  17780   373531603160
   q14  242 238 228 228
   q15  536 497 475 475
   q16  457 445 383 383
   q17  651 861 378 378
   q18  7712731073487310
   q19  2545970 573 573
   q20  344 335 230 230
   q21  3670319529842984
   q22  10911037993 993
   Total cold run time: 117667 ms
   Total hot run time: 34976 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5652510250605060
   q2   243 328 247 247
   q3   2164268425502550
   q4   1455198014661466
   q5   4473437843184318
   q6   212 170 128 128
   q7   2004195318251825
   q8   2584261925162516
   q9   7256713972577139
   q10  2976323127842784
   q11  583 504 490 490
   q12  703 782 595 595
   q13  3519391832433243
   q14  279 290 274 274
   q15  529 488 475 475
   q16  464 488 454 454
   q17  1190159713751375
   q18  7728758274427442
   q19  881 844 889 844
   q20  1910201918541854
   q21  4794444643824382
   q22  1088103110191019
   Total cold run time: 52687 ms
   Total hot run time: 50480 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org