Re: [PR] [enhancement](nereids) add transform rule SaltJoin and countDistinctSkewRewrite [doris]

2025-05-12 Thread via GitHub


doris-robot commented on PR #49096:
URL: https://github.com/apache/doris/pull/49096#issuecomment-2874893349

   
   
   ClickBench: Total hot run time: 29.27 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit f60baf44a59f7a54b9829ccd2b6582fdeae276a6, 
data reload: false
   
   query1   0.040.040.03
   query2   0.140.100.13
   query3   0.250.180.19
   query4   1.610.200.11
   query5   0.570.570.57
   query6   1.200.730.73
   query7   0.020.020.02
   query8   0.050.040.03
   query9   0.580.530.52
   query10  0.580.590.56
   query11  0.160.110.11
   query12  0.150.120.12
   query13  0.620.600.60
   query14  0.780.820.85
   query15  0.900.870.86
   query16  0.380.370.39
   query17  1.101.041.07
   query18  0.230.220.22
   query19  2.001.891.82
   query20  0.010.010.02
   query21  15.39   0.900.55
   query22  0.761.330.68
   query23  14.82   1.380.64
   query24  6.491.990.64
   query25  0.490.090.06
   query26  0.690.180.15
   query27  0.060.050.05
   query28  9.870.930.45
   query29  12.55   4.053.40
   query30  0.250.090.07
   query31  2.830.620.39
   query32  3.230.560.48
   query33  3.033.093.23
   query34  15.68   5.124.50
   query35  4.524.494.54
   query36  0.680.500.49
   query37  0.090.070.06
   query38  0.050.040.03
   query39  0.030.030.03
   query40  0.160.130.13
   query41  0.080.030.02
   query42  0.040.030.02
   query43  0.040.030.04
   Total cold run time: 103.2 s
   Total hot run time: 29.27 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhancement](nereids) add transform rule SaltJoin and countDistinctSkewRewrite [doris]

2025-05-12 Thread via GitHub


doris-robot commented on PR #49096:
URL: https://github.com/apache/doris/pull/49096#issuecomment-2874887455

   
   
   TPC-DS: Total hot run time: 188936 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit f60baf44a59f7a54b9829ccd2b6582fdeae276a6, 
data reload: false
   
   query1   1032485 484 484
   query2   6561189118431843
   query3   6753227 229 227
   query4   26638   23853   23762   23762
   query5   4332668 489 489
   query6   298 211 208 208
   query7   4618544 306 306
   query8   291 253 229 229
   query9   8597268427092684
   query10  476 341 268 268
   query11  15618   15202   15019   15019
   query12  168 126 110 110
   query13  1664567 419 419
   query14  9102634162916291
   query15  212 195 173 173
   query16  7149683 453 453
   query17  957 761 576 576
   query18  1983431 310 310
   query19  202 198 165 165
   query20  131 119 125 119
   query21  212 131 109 109
   query22  4117422241054105
   query23  34311   33603   33225   33225
   query24  8454250024992499
   query25  573 499 452 452
   query26  1250297 166 166
   query27  2703528 354 354
   query28  4314214221272127
   query29  790 602 443 443
   query30  285 224 193 193
   query31  955 872 756 756
   query32  73  70  64  64
   query33  568 394 335 335
   query34  843 962 528 528
   query35  814 848 730 730
   query36  10211021888 888
   query37  113 103 73  73
   query38  4176429441314131
   query39  1505142014301420
   query40  210 125 110 110
   query41  61  55  55  55
   query42  131 107 111 107
   query43  520 504 457 457
   query44  1378840 817 817
   query45  185 182 168 168
   query46  914 1125664 664
   query47  1776179917411741
   query48  387 433 317 317
   query49  789 531 432 432
   query50  698 729 421 421
   query51  4202420740744074
   query52  113 112 102 102
   query53  234 276 195 195
   query54  594 599 524 524
   query55  90  92  87  87
   query56  311 316 310 310
   query57  1155122610991099
   query58  275 268 268 268
   query59  2578272525842584
   query60  338 330 335 330
   query61  127 131 156 131
   query62  807 770 652 652
   query63  241 191 190 190
   query64  43551047683 683
   query65  4351424142934241
   query66  1147477 326 326
   query67  16064   15755   15498   15498
   query68  8039938 536 536
   query69  487 325 278 278
   query70  1253116310981098
   query71  490 342 307 307
   query72  5774476648064766
   query73  714 609 361 361
   query74  9113944888658865
   query75  3953337527642764
   query76  37561328816 816
   query77  799 392 307 307
   query78  10245   10276   94659465
   query79  2386892 598 598
   query80  654 549 475 475
   query81  482 263 231 231
   query82  474 137 108 108
   query83  291 265 259 259
   query84  293 116 89  89
   query85  790 379 313 313
   query86  347 300 290 290
   query87  4503456245134513
   query88  3463233023422330
   query89  440 338 298 298
   query90  1939233 210 210
   query91  140 150 115 115
   query92  74  65  60  60
   query93  1546970 595 595
   query94  677 432 315 315
   query95  374 299 316 299
   query96  510 636 288 288
   query97  3259333231643164
   query98  231 218 211 211
   query99  1465144012961296
   Total cold run time: 276851 ms
   Total hot run time: 188936 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go t

Re: [PR] [enhancement](nereids) add transform rule SaltJoin and countDistinctSkewRewrite [doris]

2025-05-12 Thread via GitHub


doris-robot commented on PR #49096:
URL: https://github.com/apache/doris/pull/49096#issuecomment-2874837008

   
   
   TPC-H: Total hot run time: 34224 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit f60baf44a59f7a54b9829ccd2b6582fdeae276a6, 
data reload: false
   
   -- Round 1 --
   q1   26984   518250645064
   q2   2091288 189 189
   q3   10688   1421717 717
   q4   10260   1007536 536
   q5   7893243523862386
   q6   193 166 133 133
   q7   925 762 608 608
   q8   9337134010431043
   q9   6814511250875087
   q10  6821232718951895
   q11  503 293 271 271
   q12  345 352 219 219
   q13  17765   374031133113
   q14  238 229 216 216
   q15  545 478 482 478
   q16  440 447 374 374
   q17  635 874 386 386
   q18  7759727672617261
   q19  1341967 582 582
   q20  340 330 238 238
   q21  4115336524652465
   q22  10401038963 963
   Total cold run time: 117072 ms
   Total hot run time: 34224 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5163509250505050
   q2   240 323 235 235
   q3   2172264623282328
   q4   1406189314961496
   q5   4571440543734373
   q6   224 171 128 128
   q7   1971187617371737
   q8   2580249524722472
   q9   7228719472397194
   q10  3013318627352735
   q11  582 501 499 499
   q12  697 805 616 616
   q13  3548384432943294
   q14  296 311 263 263
   q15  520 467 492 467
   q16  469 504 470 470
   q17  1151155714111411
   q18  7752765975487548
   q19  819 821 984 821
   q20  2024200218701870
   q21  5175466046114611
   q22  10651019991 991
   Total cold run time: 52666 ms
   Total hot run time: 50609 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhancement](nereids) add transform rule SaltJoin and countDistinctSkewRewrite [doris]

2025-05-12 Thread via GitHub


feiniaofeiafei commented on PR #49096:
URL: https://github.com/apache/doris/pull/49096#issuecomment-2874804735

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhancement](nereids) add transform rule SaltJoin and countDistinctSkewRewrite [doris]

2025-05-07 Thread via GitHub


doris-robot commented on PR #49096:
URL: https://github.com/apache/doris/pull/49096#issuecomment-2858422976

   
   
   TPC-DS: Total hot run time: 185914 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit d6327dc0a88a3670479b3eb0e92acf05bed42461, 
data reload: false
   
   query1   1003482 529 482
   query2   6568182718071807
   query3   6762215 222 215
   query4   26376   23685   23340   23340
   query5   4400612 454 454
   query6   317 208 223 208
   query7   4617488 289 289
   query8   298 250 255 250
   query9   8619253425442534
   query10  492 329 270 270
   query11  15875   15214   15077   15077
   query12  159 112 106 106
   query13  1656519 404 404
   query14  8685616361146114
   query15  198 188 175 175
   query16  7162607 495 495
   query17  1188729 576 576
   query18  1961388 301 301
   query19  187 185 163 163
   query20  115 112 122 112
   query21  207 123 105 105
   query22  3924415541404140
   query23  33757   32899   32940   32899
   query24  8442234623772346
   query25  548 448 399 399
   query26  1236266 153 153
   query27  2753480 327 327
   query28  4394207920462046
   query29  790 549 435 435
   query30  271 207 186 186
   query31  943 844 766 766
   query32  76  65  65  65
   query33  548 345 305 305
   query34  791 847 520 520
   query35  774 819 756 756
   query36  966 985 870 870
   query37  113 97  76  76
   query38  4145423340994099
   query39  1470137914101379
   query40  212 118 104 104
   query41  58  56  52  52
   query42  120 102 108 102
   query43  492 498 475 475
   query44  1271804 783 783
   query45  173 165 164 164
   query46  820 993 606 606
   query47  1783178917011701
   query48  374 400 299 299
   query49  763 503 393 393
   query50  668 665 389 389
   query51  4068419740754075
   query52  104 110 96  96
   query53  212 254 197 197
   query54  567 571 507 507
   query55  87  79  77  77
   query56  335 295 294 294
   query57  1167121711151115
   query58  268 247 254 247
   query59  2569268825352535
   query60  324 310 304 304
   query61  126 128 127 127
   query62  817 742 631 631
   query63  215 185 183 183
   query64  43901061776 776
   query65  4330422442544224
   query66  1166426 333 333
   query67  15696   15496   15440   15440
   query68  7886870 506 506
   query69  474 308 268 268
   query70  1200112610961096
   query71  421 322 358 322
   query72  5615464446984644
   query73  663 594 343 343
   query74  8847907488308830
   query75  3570324526722672
   query76  33461193739 739
   query77  785 396 300 300
   query78  10039   10132   93019301
   query79  2051812 559 559
   query80  596 527 427 427
   query81  469 257 215 215
   query82  446 127 95  95
   query83  251 250 232 232
   query84  242 98  82  82
   query85  825 344 306 306
   query86  333 307 285 285
   query87  4278449243014301
   query88  3618221422292214
   query89  388 303 288 288
   query90  1936206 211 206
   query91  145 144 108 108
   query92  84  57  56  56
   query93  1403924 577 577
   query94  697 411 271 271
   query95  380 288 274 274
   query96  478 562 273 273
   query97  3142321331573157
   query98  235 217 205 205
   query99  1686140212891289
   Total cold run time: 272490 ms
   Total hot run time: 185914 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to 

Re: [PR] [enhancement](nereids) add transform rule SaltJoin and countDistinctSkewRewrite [doris]

2025-05-07 Thread via GitHub


doris-robot commented on PR #49096:
URL: https://github.com/apache/doris/pull/49096#issuecomment-2858449415

   
   
   ClickBench: Total hot run time: 28.66 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit d6327dc0a88a3670479b3eb0e92acf05bed42461, 
data reload: false
   
   query1   0.040.040.04
   query2   0.120.100.10
   query3   0.260.190.19
   query4   1.590.200.11
   query5   0.570.560.57
   query6   1.200.710.73
   query7   0.020.020.02
   query8   0.040.040.04
   query9   0.570.520.51
   query10  0.570.560.56
   query11  0.150.110.11
   query12  0.150.110.11
   query13  0.610.600.60
   query14  0.780.790.81
   query15  0.870.840.88
   query16  0.380.390.39
   query17  1.001.061.03
   query18  0.220.190.19
   query19  1.881.871.84
   query20  0.010.010.01
   query21  15.40   0.920.56
   query22  0.761.170.65
   query23  15.00   1.380.62
   query24  7.611.510.40
   query25  0.470.070.15
   query26  0.670.170.15
   query27  0.050.050.05
   query28  9.380.870.46
   query29  12.52   3.913.25
   query30  0.250.090.07
   query31  2.820.600.38
   query32  3.230.540.47
   query33  3.043.083.05
   query34  15.70   5.124.45
   query35  4.564.564.51
   query36  0.680.500.48
   query37  0.080.070.06
   query38  0.050.040.03
   query39  0.030.030.02
   query40  0.160.130.11
   query41  0.080.030.02
   query42  0.030.020.02
   query43  0.030.040.03
   Total cold run time: 103.63 s
   Total hot run time: 28.66 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhancement](nereids) add transform rule SaltJoin and countDistinctSkewRewrite [doris]

2025-05-07 Thread via GitHub


doris-robot commented on PR #49096:
URL: https://github.com/apache/doris/pull/49096#issuecomment-2858392121

   
   
   TPC-H: Total hot run time: 33745 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit d6327dc0a88a3670479b3eb0e92acf05bed42461, 
data reload: false
   
   -- Round 1 --
   q1   26309   508549704970
   q2   2079275 201 201
   q3   10376   1252702 702
   q4   10215   1004514 514
   q5   7528235823462346
   q6   184 181 134 134
   q7   905 744 620 620
   q8   9302128110321032
   q9   6806519750685068
   q10  6806229918691869
   q11  482 281 273 273
   q12  333 340 211 211
   q13  17748   365330783078
   q14  226 223 209 209
   q15  538 483 498 483
   q16  427 432 368 368
   q17  593 870 357 357
   q18  7831729771637163
   q19  1206956 542 542
   q20  347 348 225 225
   q21  3935331724072407
   q22  10501031973 973
   Total cold run time: 115226 ms
   Total hot run time: 33745 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5041499250124992
   q2   233 330 230 230
   q3   2168264622682268
   q4   1366176113461346
   q5   4499448243734373
   q6   208 163 124 124
   q7   1943191017401740
   q8   2575252625082508
   q9   7094708371477083
   q10  2978318627192719
   q11  579 518 489 489
   q12  701 756 622 622
   q13  3500386733263326
   q14  290 293 274 274
   q15  528 481 485 481
   q16  439 476 429 429
   q17  1114152814191419
   q18  7692767874097409
   q19  754 755 935 755
   q20  1979200418271827
   q21  4981467145764576
   q22  10701032976 976
   Total cold run time: 51732 ms
   Total hot run time: 49966 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhancement](nereids) add transform rule SaltJoin and countDistinctSkewRewrite [doris]

2025-05-07 Thread via GitHub


feiniaofeiafei commented on PR #49096:
URL: https://github.com/apache/doris/pull/49096#issuecomment-2858338990

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org