Re: [PR] [opt](nereids) add cost penalty for pattern Aggregation-nestedLoopJoin [doris]

2025-05-29 Thread via GitHub


englefly merged PR #51127:
URL: https://github.com/apache/doris/pull/51127


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](nereids) add cost penalty for pattern Aggregation-nestedLoopJoin [doris]

2025-05-29 Thread via GitHub


github-actions[bot] commented on PR #51127:
URL: https://github.com/apache/doris/pull/51127#issuecomment-2918647106

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](nereids) add cost penalty for pattern Aggregation-nestedLoopJoin [doris]

2025-05-27 Thread via GitHub


doris-robot commented on PR #51127:
URL: https://github.com/apache/doris/pull/51127#issuecomment-2914593588

   
   
   ClickBench: Total hot run time: 29.32 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 0de65bddc553fc9c58f9497194a5d7c1e9fe8ab1, 
data reload: false
   
   query1   0.030.030.03
   query2   0.120.120.11
   query3   0.260.200.19
   query4   1.590.200.21
   query5   0.440.460.44
   query6   1.190.660.65
   query7   0.030.010.02
   query8   0.040.040.03
   query9   0.600.510.52
   query10  0.560.570.58
   query11  0.150.100.11
   query12  0.150.120.12
   query13  0.610.590.59
   query14  0.780.820.79
   query15  0.880.850.85
   query16  0.390.370.39
   query17  1.001.041.04
   query18  0.230.210.21
   query19  1.901.841.87
   query20  0.010.010.01
   query21  15.44   0.900.54
   query22  0.761.230.63
   query23  14.92   1.400.63
   query24  7.101.221.59
   query25  0.490.220.09
   query26  0.590.160.13
   query27  0.050.050.05
   query28  9.650.880.44
   query29  12.60   3.873.25
   query30  0.250.090.06
   query31  2.840.600.38
   query32  3.230.550.47
   query33  3.093.033.08
   query34  15.81   5.154.44
   query35  4.504.514.50
   query36  0.660.490.48
   query37  0.080.060.06
   query38  0.050.040.04
   query39  0.030.020.02
   query40  0.160.130.14
   query41  0.090.030.02
   query42  0.030.020.03
   query43  0.040.030.03
   Total cold run time: 103.42 s
   Total hot run time: 29.32 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](nereids) add cost penalty for pattern Aggregation-nestedLoopJoin [doris]

2025-05-27 Thread via GitHub


doris-robot commented on PR #51127:
URL: https://github.com/apache/doris/pull/51127#issuecomment-2914575211

   
   
   TPC-DS: Total hot run time: 192799 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 0de65bddc553fc9c58f9497194a5d7c1e9fe8ab1, 
data reload: false
   
   query1   1401110210531053
   query2   6241182918151815
   query3   11056   450542294229
   query4   52577   25520   23438   23438
   query5   4987600 462 462
   query6   357 202 200 200
   query7   4905504 288 288
   query8   305 245 235 235
   query9   5228265126402640
   query10  437 330 279 279
   query11  15063   15049   14965   14965
   query12  175 108 107 107
   query13  1056535 431 431
   query14  10203   633163716331
   query15  205 198 178 178
   query16  7129631 493 493
   query17  1053734 578 578
   query18  1604404 300 300
   query19  210 194 168 168
   query20  133 131 117 117
   query21  208 126 118 118
   query22  4354449043254325
   query23  34344   33397   33555   33397
   query24  6584242224352422
   query25  465 455 412 412
   query26  700 278 151 151
   query27  2465515 331 331
   query28  3193215321482148
   query29  580 565 422 422
   query30  272 218 185 185
   query31  875 844 790 790
   query32  75  60  63  60
   query33  441 381 309 309
   query34  805 848 537 537
   query35  801 840 768 768
   query36  956 985 919 919
   query37  121 95  79  79
   query38  4153421242174212
   query39  1516143914441439
   query40  231 122 108 108
   query41  55  53  53  53
   query42  121 123 113 113
   query43  516 522 473 473
   query44  1316821 816 816
   query45  180 174 174 174
   query46  862 1047658 658
   query47  1858184817711771
   query48  386 430 339 339
   query49  657 520 446 446
   query50  671 696 422 422
   query51  4195421142224211
   query52  106 113 101 101
   query53  237 262 185 185
   query54  599 576 515 515
   query55  80  85  83  83
   query56  285 321 297 297
   query57  1167121011451145
   query58  260 269 266 266
   query59  2681271526392639
   query60  366 348 330 330
   query61  163 167 150 150
   query62  757 730 682 682
   query63  225 196 200 196
   query64  19221016669 669
   query65  4317420542544205
   query66  767 407 306 306
   query67  15981   15506   15468   15468
   query68  7370890 511 511
   query69  529 303 272 272
   query70  1178114911311131
   query71  503 325 282 282
   query72  5907484750364847
   query73  1494678 356 356
   query74  8844919489308930
   query75  4080319326902690
   query76  42591182774 774
   query77  742 372 293 293
   query78  10102   10227   95159515
   query79  2070793 579 579
   query80  610 500 449 449
   query81  475 252 221 221
   query82  493 124 94  94
   query83  259 251 238 238
   query84  294 104 84  84
   query85  771 344 311 311
   query86  330 299 291 291
   query87  4408451542654265
   query88  3196224322542243
   query89  400 315 283 283
   query90  1974206 198 198
   query91  138 139 119 119
   query92  69  56  53  53
   query93  1106946 580 580
   query94  670 399 311 311
   query95  374 295 284 284
   query96  484 570 274 274
   query97  2735277526602660
   query98  229 211 202 202
   query99  1581140613071307
   Total cold run time: 295868 ms
   Total hot run time: 192799 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go 

Re: [PR] [opt](nereids) add cost penalty for pattern Aggregation-nestedLoopJoin [doris]

2025-05-27 Thread via GitHub


doris-robot commented on PR #51127:
URL: https://github.com/apache/doris/pull/51127#issuecomment-2914558448

   
   
   TPC-H: Total hot run time: 33756 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 0de65bddc553fc9c58f9497194a5d7c1e9fe8ab1, 
data reload: false
   
   -- Round 1 --
   q1   25989   503350245024
   q2   2271269 180 180
   q3   10412   1243679 679
   q4   10229   991 505 505
   q5   7539234023332333
   q6   181 160 135 135
   q7   891 771 609 609
   q8   9304122910721072
   q9   6772513750695069
   q10  6917232819061906
   q11  498 294 265 265
   q12  342 343 208 208
   q13  17801   367331173117
   q14  236 219 217 217
   q15  525 470 494 470
   q16  419 432 386 386
   q17  601 845 376 376
   q18  7660717971217121
   q19  1434934 566 566
   q20  347 344 222 222
   q21  3777315223222322
   q22  1020991 974 974
   Total cold run time: 115165 ms
   Total hot run time: 33756 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5139513750695069
   q2   250 331 232 232
   q3   2139264522862286
   q4   1311176813751375
   q5   4454433444484334
   q6   221 168 126 126
   q7   2030190617281728
   q8   2586258125602560
   q9   7196714568906890
   q10  3038320027862786
   q11  581 516 498 498
   q12  693 758 595 595
   q13  3585384433143314
   q14  285 291 282 282
   q15  510 487 488 487
   q16  464 516 452 452
   q17  1139152614431443
   q18  7770746674537453
   q19  794 832 898 832
   q20  1999205218291829
   q21  4764462844184418
   q22  1085102110051005
   Total cold run time: 52033 ms
   Total hot run time: 49994 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](nereids) add cost penalty for pattern Aggregation-nestedLoopJoin [doris]

2025-05-27 Thread via GitHub


englefly commented on PR #51127:
URL: https://github.com/apache/doris/pull/51127#issuecomment-2914500798

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](nereids) add cost penalty for pattern Aggregation-nestedLoopJoin [doris]

2025-05-27 Thread via GitHub


doris-robot commented on PR #51127:
URL: https://github.com/apache/doris/pull/51127#issuecomment-2911813379

   
   
   ClickBench: Total hot run time: 29.06 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 7e0a49bf642c076f3356f0d211b0b0feb5fd61b1, 
data reload: false
   
   query1   0.040.040.03
   query2   0.120.100.11
   query3   0.250.200.19
   query4   1.580.180.19
   query5   0.440.410.42
   query6   1.160.670.67
   query7   0.020.010.02
   query8   0.050.040.04
   query9   0.580.530.51
   query10  0.570.580.56
   query11  0.150.110.11
   query12  0.150.120.12
   query13  0.620.620.60
   query14  0.790.800.80
   query15  0.880.870.85
   query16  0.380.390.38
   query17  1.101.031.00
   query18  0.230.220.21
   query19  1.941.861.79
   query20  0.010.020.01
   query21  15.40   0.890.55
   query22  0.751.170.76
   query23  14.90   1.390.62
   query24  7.000.960.66
   query25  0.510.280.14
   query26  0.640.170.15
   query27  0.050.050.05
   query28  9.290.930.46
   query29  12.55   3.943.31
   query30  0.260.100.07
   query31  2.810.590.39
   query32  3.220.550.47
   query33  3.073.003.08
   query34  16.03   5.174.52
   query35  4.574.554.53
   query36  0.670.490.48
   query37  0.090.060.06
   query38  0.060.040.04
   query39  0.040.030.02
   query40  0.160.140.13
   query41  0.080.030.03
   query42  0.040.030.02
   query43  0.040.030.04
   Total cold run time: 103.29 s
   Total hot run time: 29.06 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](nereids) add cost penalty for pattern Aggregation-nestedLoopJoin [doris]

2025-05-27 Thread via GitHub


doris-robot commented on PR #51127:
URL: https://github.com/apache/doris/pull/51127#issuecomment-2911798292

   
   
   TPC-DS: Total hot run time: 185459 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 7e0a49bf642c076f3356f0d211b0b0feb5fd61b1, 
data reload: false
   
   query1   1011471 482 471
   query2   6556194519421942
   query3   6761232 218 218
   query4   26833   23688   23302   23302
   query5   4305634 462 462
   query6   300 201 198 198
   query7   4623497 293 293
   query8   301 255 247 247
   query9   8630263526432635
   query10  488 350 281 281
   query11  15490   15117   14787   14787
   query12  166 108 106 106
   query13  1658542 414 414
   query14  8855606560786065
   query15  212 183 175 175
   query16  7180635 476 476
   query17  1181694 545 545
   query18  1951386 298 298
   query19  185 185 157 157
   query20  124 120 121 120
   query21  217 123 110 110
   query22  4079426339163916
   query23  33950   33140   33246   33140
   query24  8390237423612361
   query25  535 460 389 389
   query26  1223266 150 150
   query27  2740501 333 333
   query28  4335210320842084
   query29  750 536 439 439
   query30  282 211 183 183
   query31  917 812 754 754
   query32  74  68  62  62
   query33  557 374 295 295
   query34  812 848 522 522
   query35  796 805 743 743
   query36  958 978 894 894
   query37  112 102 80  80
   query38  3975415640334033
   query39  1480142914191419
   query40  215 123 112 112
   query41  65  60  65  60
   query42  122 112 116 112
   query43  510 501 497 497
   query44  1286810 815 810
   query45  185 180 177 177
   query46  828 1015631 631
   query47  1757179417371737
   query48  387 434 308 308
   query49  808 537 455 455
   query50  667 696 413 413
   query51  4152416740894089
   query52  111 110 106 106
   query53  223 249 181 181
   query54  579 554 494 494
   query55  89  81  82  81
   query56  302 316 293 293
   query57  1132115210881088
   query58  291 254 265 254
   query59  2678272227252722
   query60  343 333 309 309
   query61  127 124 121 121
   query62  817 758 667 667
   query63  222 182 185 182
   query64  43661009669 669
   query65  4303426442124212
   query66  1159401 313 313
   query67  15784   15529   15290   15290
   query68  8644894 515 515
   query69  474 301 264 264
   query70  1180113110451045
   query71  458 316 302 302
   query72  5547482747814781
   query73  745 666 363 363
   query74  9190918987448744
   query75  4027316926962696
   query76  36711190753 753
   query77  794 449 275 275
   query78  10470   10388   92709270
   query79  2656810 575 575
   query80  611 533 444 444
   query81  488 252 217 217
   query82  485 123 98  98
   query83  284 247 238 238
   query84  301 107 79  79
   query85  786 358 310 310
   query86  388 300 286 286
   query87  4503450442554255
   query88  3469224022412240
   query89  392 319 281 281
   query90  1830209 205 205
   query91  148 142 111 111
   query92  78  67  57  57
   query93  1807949 585 585
   query94  666 424 310 310
   query95  379 283 279 279
   query96  493 561 284 284
   query97  2725275726282628
   query98  229 203 196 196
   query99  1447138112911291
   Total cold run time: 275865 ms
   Total hot run time: 185459 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to

Re: [PR] [opt](nereids) add cost penalty for pattern Aggregation-nestedLoopJoin [doris]

2025-05-27 Thread via GitHub


doris-robot commented on PR #51127:
URL: https://github.com/apache/doris/pull/51127#issuecomment-2911758360

   
   
   TPC-H: Total hot run time: 33942 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 7e0a49bf642c076f3356f0d211b0b0feb5fd61b1, 
data reload: false
   
   -- Round 1 --
   q1   26230   506050735060
   q2   2085275 182 182
   q3   10388   1233712 712
   q4   10234   986 522 522
   q5   7513236223802362
   q6   179 164 135 135
   q7   892 771 607 607
   q8   9308127610741074
   q9   6753515550835083
   q10  6897228918931893
   q11  539 292 272 272
   q12  346 353 213 213
   q13  17770   370030703070
   q14  240 241 218 218
   q15  549 484 492 484
   q16  416 437 376 376
   q17  592 858 367 367
   q18  7603724272067206
   q19  1462947 582 582
   q20  338 339 227 227
   q21  3653311323362336
   q22  10911031961 961
   Total cold run time: 115078 ms
   Total hot run time: 33942 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5125506550585058
   q2   239 333 225 225
   q3   2184262622912291
   q4   1354177013701370
   q5   4566441644214416
   q6   222 172 128 128
   q7   1955192017391739
   q8   2588261725232523
   q9   7050715270407040
   q10  3031321927622762
   q11  585 522 497 497
   q12  651 784 644 644
   q13  3572394632713271
   q14  284 288 288 288
   q15  509 476 487 476
   q16  422 492 443 443
   q17  1159150314301430
   q18  7724751674807480
   q19  812 829 999 829
   q20  1988206519321932
   q21  4794430043304300
   q22  1045989 978 978
   Total cold run time: 51859 ms
   Total hot run time: 50120 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](nereids) add cost penalty for pattern Aggregation-nestedLoopJoin [doris]

2025-05-26 Thread via GitHub


github-actions[bot] commented on PR #51127:
URL: https://github.com/apache/doris/pull/51127#issuecomment-2911004888

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](nereids) add cost penalty for pattern Aggregation-nestedLoopJoin [doris]

2025-05-26 Thread via GitHub


github-actions[bot] commented on PR #51127:
URL: https://github.com/apache/doris/pull/51127#issuecomment-2911004848

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](nereids) add cost penalty for pattern Aggregation-nestedLoopJoin [doris]

2025-05-25 Thread via GitHub


englefly commented on code in PR #51127:
URL: https://github.com/apache/doris/pull/51127#discussion_r2106466888


##
fe/fe-core/src/main/java/org/apache/doris/nereids/cost/CostModelV1.java:
##
@@ -559,9 +559,13 @@ public Cost visitPhysicalNestedLoopJoin(
 Preconditions.checkState(context.arity() == 2);
 Statistics leftStatistics = context.getChildStatistics(0);
 Statistics rightStatistics = context.getChildStatistics(1);
+double nljPenalty = 1.0;
+if (leftStatistics.getRowCount() < 10 * rightStatistics.getRowCount()) 
{
+nljPenalty = Math.min(leftStatistics.getRowCount(), 
rightStatistics.getRowCount());
+}

Review Comment:
   done



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](nereids) add cost penalty for pattern Aggregation-nestedLoopJoin [doris]

2025-05-25 Thread via GitHub


englefly commented on PR #51127:
URL: https://github.com/apache/doris/pull/51127#issuecomment-2908445276

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](nereids) add cost penalty for pattern Aggregation-nestedLoopJoin [doris]

2025-05-21 Thread via GitHub


morrySnow commented on code in PR #51127:
URL: https://github.com/apache/doris/pull/51127#discussion_r2101777618


##
fe/fe-core/src/main/java/org/apache/doris/nereids/cost/CostModelV1.java:
##
@@ -559,9 +559,13 @@ public Cost visitPhysicalNestedLoopJoin(
 Preconditions.checkState(context.arity() == 2);
 Statistics leftStatistics = context.getChildStatistics(0);
 Statistics rightStatistics = context.getChildStatistics(1);
+double nljPenalty = 1.0;
+if (leftStatistics.getRowCount() < 10 * rightStatistics.getRowCount()) 
{
+nljPenalty = Math.min(leftStatistics.getRowCount(), 
rightStatistics.getRowCount());
+}

Review Comment:
   add comment to explain the effect of the penalty



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](nereids) add cost penalty for pattern Aggregation-nestedLoopJoin [doris]

2025-05-21 Thread via GitHub


doris-robot commented on PR #51127:
URL: https://github.com/apache/doris/pull/51127#issuecomment-2897773048

   
   
   TPC-DS: Total hot run time: 185865 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit cdfcd0b5e301de63ba3748dbb82df45c8de39ada, 
data reload: false
   
   query1   1012485 523 485
   query2   6587179017891789
   query3   6743214 233 214
   query4   26324   23200   22831   22831
   query5   4367634 461 461
   query6   308 212 211 211
   query7   4625490 308 308
   query8   295 261 227 227
   query9   8610261226382612
   query10  479 352 266 266
   query11  15751   15003   14872   14872
   query12  163 111 102 102
   query13  1643526 398 398
   query14  8956621862096209
   query15  224 208 171 171
   query16  7184621 433 433
   query17  1209732 589 589
   query18  1973395 305 305
   query19  203 197 169 169
   query20  122 124 118 118
   query21  218 127 111 111
   query22  4141427640924092
   query23  33987   33030   32974   32974
   query24  8509240224402402
   query25  568 495 475 475
   query26  1244273 148 148
   query27  2765502 348 348
   query28  4296213321122112
   query29  760 536 431 431
   query30  283 215 188 188
   query31  919 849 744 744
   query32  74  65  61  61
   query33  562 368 322 322
   query34  796 855 527 527
   query35  802 799 742 742
   query36  951 985 937 937
   query37  120 100 81  81
   query38  4108409340554055
   query39  1463140814001400
   query40  212 119 104 104
   query41  58  55  53  53
   query42  120 110 115 110
   query43  490 514 484 484
   query44  1306824 826 824
   query45  182 171 166 166
   query46  836 1023638 638
   query47  1759179517181718
   query48  385 425 322 322
   query49  771 526 449 449
   query50  684 677 419 419
   query51  4168420141084108
   query52  105 108 100 100
   query53  226 253 185 185
   query54  577 566 511 511
   query55  85  83  84  83
   query56  316 320 314 314
   query57  1138116811061106
   query58  264 255 274 255
   query59  2636264025162516
   query60  336 332 301 301
   query61  164 131 128 128
   query62  820 733 667 667
   query63  226 191 183 183
   query64  43821004739 739
   query65  4279428042304230
   query66  1147417 308 308
   query67  15842   15585   15472   15472
   query68  8617880 520 520
   query69  480 306 273 273
   query70  1250117111371137
   query71  462 329 312 312
   query72  5241471746424642
   query73  730 585 352 352
   query74  9291918689448944
   query75  3982321626882688
   query76  36331198755 755
   query77  787 388 293 293
   query78  10037   10164   93739373
   query79  1883774 582 582
   query80  599 525 510 510
   query81  472 250 217 217
   query82  417 122 91  91
   query83  254 253 239 239
   query84  246 107 87  87
   query85  790 348 313 313
   query86  337 302 276 276
   query87  4486443643104310
   query88  3354231123112311
   query89  394 379 285 285
   query90  1921213 211 211
   query91  135 137 114 114
   query92  70  62  56  56
   query93  1129942 579 579
   query94  677 419 310 310
   query95  382 292 278 278
   query96  513 567 286 286
   query97  2655273026392639
   query98  236 207 202 202
   query99  1452139812671267
   Total cold run time: 273770 ms
   Total hot run time: 185865 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to

Re: [PR] [opt](nereids) add cost penalty for pattern Aggregation-nestedLoopJoin [doris]

2025-05-21 Thread via GitHub


doris-robot commented on PR #51127:
URL: https://github.com/apache/doris/pull/51127#issuecomment-2897796556

   
   
   ClickBench: Total hot run time: 28.67 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit cdfcd0b5e301de63ba3748dbb82df45c8de39ada, 
data reload: false
   
   query1   0.040.040.03
   query2   0.120.110.10
   query3   0.250.200.20
   query4   1.580.190.18
   query5   0.440.430.45
   query6   1.170.660.66
   query7   0.020.010.01
   query8   0.040.030.03
   query9   0.590.520.52
   query10  0.550.580.57
   query11  0.150.110.11
   query12  0.140.120.11
   query13  0.620.610.59
   query14  0.790.780.81
   query15  0.900.860.87
   query16  0.400.390.38
   query17  1.061.041.09
   query18  0.220.210.22
   query19  1.951.771.82
   query20  0.010.010.01
   query21  15.40   0.900.54
   query22  0.771.150.68
   query23  14.95   1.390.61
   query24  7.801.230.32
   query25  0.290.170.18
   query26  0.690.160.15
   query27  0.050.050.05
   query28  8.820.860.46
   query29  12.55   4.003.35
   query30  0.260.090.06
   query31  2.820.590.38
   query32  3.230.540.46
   query33  3.043.143.04
   query34  15.76   5.104.54
   query35  4.544.504.47
   query36  0.650.490.49
   query37  0.080.060.06
   query38  0.050.040.03
   query39  0.030.030.02
   query40  0.160.140.13
   query41  0.080.020.02
   query42  0.040.020.02
   query43  0.030.030.03
   Total cold run time: 103.13 s
   Total hot run time: 28.67 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](nereids) add cost penalty for pattern Aggregation-nestedLoopJoin [doris]

2025-05-21 Thread via GitHub


doris-robot commented on PR #51127:
URL: https://github.com/apache/doris/pull/51127#issuecomment-2897731273

   
   
   TPC-H: Total hot run time: 33954 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit cdfcd0b5e301de63ba3748dbb82df45c8de39ada, 
data reload: false
   
   -- Round 1 --
   q1   26292   517349694969
   q2   2073273 189 189
   q3   10571   1254709 709
   q4   10287   993 542 542
   q5   8602232923842329
   q6   189 165 135 135
   q7   908 766 623 623
   q8   9316129610841084
   q9   6838508351205083
   q10  6833232018891889
   q11  495 292 276 276
   q12  360 353 220 220
   q13  17768   373131393139
   q14  225 225 222 222
   q15  552 477 482 477
   q16  422 434 389 389
   q17  628 869 368 368
   q18  7686718971597159
   q19  1345957 575 575
   q20  353 361 230 230
   q21  4127325623992399
   q22  10441025948 948
   Total cold run time: 116914 ms
   Total hot run time: 33954 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5177509450505050
   q2   244 328 233 233
   q3   2187267223102310
   q4   1387178714581458
   q5   4591444543484348
   q6   207 167 126 126
   q7   1967187717461746
   q8   2578249025282490
   q9   7148698870716988
   q10  2993319427182718
   q11  583 497 505 497
   q12  720 785 639 639
   q13  3453392133363336
   q14  281 295 276 276
   q15  523 474 470 470
   q16  436 500 435 435
   q17  1170154913681368
   q18  7641738774627387
   q19  848 843 882 843
   q20  2011203918591859
   q21  4786434542934293
   q22  10531013964 964
   Total cold run time: 51984 ms
   Total hot run time: 49834 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](nereids) add cost penalty for pattern Aggregation-nestedLoopJoin [doris]

2025-05-21 Thread via GitHub


englefly commented on PR #51127:
URL: https://github.com/apache/doris/pull/51127#issuecomment-2897666398

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](nereids) add cost penalty for pattern Aggregation-nestedLoopJoin [doris]

2025-05-21 Thread via GitHub


Thearas commented on PR #51127:
URL: https://github.com/apache/doris/pull/51127#issuecomment-2897666068

   
   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
   
   Please clearly describe your PR:
   1. What problem was fixed (it's best to include specific error reporting 
information). How it was fixed.
   2. Which behaviors were modified. What was the previous behavior, what is it 
now, why was it modified, and what possible impacts might there be.
   3. What features were added. Why was this function added?
   4. Which code was refactored and why was this part of the code refactored?
   5. Which functions were optimized and what is the difference before and 
after the optimization?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org