Re: [PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35263:
URL: https://github.com/apache/doris/pull/35263#issuecomment-2128523141

   
   
   ClickBench: Total hot run time: 30.73 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 315b52c04acff0b11639a3d22dc63b01cc34a5ea, 
data reload: false
   
   query1   0.040.030.03
   query2   0.090.040.04
   query3   0.240.050.06
   query4   1.660.090.10
   query5   0.500.510.50
   query6   1.130.730.73
   query7   0.020.020.01
   query8   0.050.040.04
   query9   0.540.500.50
   query10  0.540.550.56
   query11  0.140.110.11
   query12  0.150.120.12
   query13  0.600.580.60
   query14  0.780.790.78
   query15  0.830.800.81
   query16  0.360.360.37
   query17  1.041.010.95
   query18  0.220.240.24
   query19  1.861.791.76
   query20  0.020.010.01
   query21  15.60   0.690.67
   query22  4.306.691.91
   query23  18.31   1.451.26
   query24  1.990.240.19
   query25  0.140.080.07
   query26  0.260.170.16
   query27  0.080.070.08
   query28  13.28   1.001.00
   query29  13.24   3.473.41
   query30  0.240.060.05
   query31  2.880.380.38
   query32  3.280.470.47
   query33  2.872.852.93
   query34  16.95   4.434.46
   query35  4.504.494.58
   query36  0.680.470.48
   query37  0.170.150.16
   query38  0.150.140.14
   query39  0.040.030.03
   query40  0.160.140.15
   query41  0.090.060.05
   query42  0.060.050.05
   query43  0.040.040.04
   Total cold run time: 110.12 s
   Total hot run time: 30.73 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35263:
URL: https://github.com/apache/doris/pull/35263#issuecomment-2128519067

   
   
   TPC-DS: Total hot run time: 171132 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 315b52c04acff0b11639a3d22dc63b01cc34a5ea, 
data reload: false
   
   query1   912 381 384 381
   query2   6451242122952295
   query3   6636205 211 205
   query4   19226   17338   17248   17248
   query5   4158428 421 421
   query6   246 162 154 154
   query7   4589299 299 299
   query8   238 191 186 186
   query9   8567240523912391
   query10  456 294 271 271
   query11  10576   10107   10049   10049
   query12  128 99  88  88
   query13  1629366 364 364
   query14  9934744760196019
   query15  208 167 167 167
   query16  7753268 255 255
   query17  1492518 509 509
   query18  1902270 271 270
   query19  186 151 153 151
   query20  93  84  84  84
   query21  193 157 129 129
   query22  4193391938973897
   query23  33475   33058   33256   33058
   query24  6852279829042798
   query25  468 376 376 376
   query26  694 159 161 159
   query27  1926337 328 328
   query28  3871208420832083
   query29  827 602 604 602
   query30  258 181 177 177
   query31  931 772 725 725
   query32  65  54  54  54
   query33  495 266 260 260
   query34  843 486 496 486
   query35  702 624 613 613
   query36  1020919 921 919
   query37  137 71  70  70
   query38  2906275127422742
   query39  871 773 798 773
   query40  204 126 119 119
   query41  46  45  43  43
   query42  106 100 102 100
   query43  603 574 540 540
   query44  1101742 764 742
   query45  178 160 165 160
   query46  1059711 708 708
   query47  1846175317711753
   query48  371 297 290 290
   query49  775 383 386 383
   query50  769 388 392 388
   query51  6928672667876726
   query52  107 94  89  89
   query53  361 290 288 288
   query54  546 444 427 427
   query55  76  73  74  73
   query56  292 240 252 240
   query57  1142108410591059
   query58  225 215 218 215
   query59  3533308331803083
   query60  280 258 250 250
   query61  85  90  86  86
   query62  561 469 466 466
   query63  316 285 290 285
   query64  2554181217361736
   query65  3177308131333081
   query66  783 329 322 322
   query67  15066   14751   14636   14636
   query68  4552545 548 545
   query69  436 263 269 263
   query70  1186115911331133
   query71  390 278 278 278
   query72  7227549056275490
   query73  717 321 317 317
   query74  6063560655885588
   query75  3291267326262626
   query76  22441012990 990
   query77  389 270 268 268
   query78  10273   982796939693
   query79  2586529 514 514
   query80  1016446 432 432
   query81  529 250 241 241
   query82  737 99  96  96
   query83  265 177 177 177
   query84  252 86  83  83
   query85  1200292 259 259
   query86  476 310 304 304
   query87  3276315030603060
   query88  3988235123612351
   query89  476 393 401 393
   query90  2067192 193 192
   query91  133 108 176 108
   query92  65  48  48  48
   query93  2025523 519 519
   query94  1122187 185 185
   query95  403 315 317 315
   query96  602 267 265 265
   query97  3172302530053005
   query98  250 224 208 208
   query99  1160842 846 842
   Total cold run time: 251765 ms
   Total hot run time: 171132 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the 

Re: [PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35263:
URL: https://github.com/apache/doris/pull/35263#issuecomment-2128510690

   
   
   TPC-H: Total hot run time: 41252 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 315b52c04acff0b11639a3d22dc63b01cc34a5ea, 
data reload: false
   
   -- Round 1 --
   q1   17627   504642404240
   q2   2028197 192 192
   q3   10443   116011711160
   q4   10200   850 731 731
   q5   7471286427152715
   q6   233 133 136 133
   q7   974 634 633 633
   q8   9236219321312131
   q9   9545674067866740
   q10  9577390838603860
   q11  456 243 247 243
   q12  465 228 228 228
   q13  17226   326632323232
   q14  283 242 217 217
   q15  512 477 489 477
   q16  495 388 394 388
   q17  1003689 713 689
   q18  8444785477847784
   q19  4495157315181518
   q20  625 323 320 320
   q21  5248409233483348
   q22  372 285 273 273
   Total cold run time: 116958 ms
   Total hot run time: 41252 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4525444644114411
   q2   390 287 264 264
   q3   3212293729272927
   q4   1917167016651665
   q5   5503551755495517
   q6   222 121 120 120
   q7   2158187017961796
   q8   3268340133993399
   q9   8664873487088708
   q10  4015377938293779
   q11  583 498 487 487
   q12  818 634 635 634
   q13  15905   319631313131
   q14  314 287 279 279
   q15  528 489 511 489
   q16  518 435 459 435
   q17  1826154614601460
   q18  7859780876057605
   q19  2336154915631549
   q20  2002180018011800
   q21  4944484846674667
   q22  561 467 496 467
   Total cold run time: 72068 ms
   Total hot run time: 55589 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]

2024-05-23 Thread via GitHub


github-actions[bot] commented on PR #35263:
URL: https://github.com/apache/doris/pull/35263#issuecomment-2128452191

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]

2024-05-23 Thread via GitHub


xinyiZzz commented on PR #35263:
URL: https://github.com/apache/doris/pull/35263#issuecomment-2128446511

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35263:
URL: https://github.com/apache/doris/pull/35263#issuecomment-2127687072

   
   
   ClickBench: Total hot run time: 30.1 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit fb2c1069281b48727b59f1c2ff1b73d5e3da911c, 
data reload: false
   
   query1   0.040.030.03
   query2   0.080.040.04
   query3   0.230.050.04
   query4   1.680.070.07
   query5   0.500.490.50
   query6   1.130.730.72
   query7   0.020.010.01
   query8   0.040.040.04
   query9   0.540.490.49
   query10  0.540.540.54
   query11  0.160.110.11
   query12  0.150.130.12
   query13  0.590.590.60
   query14  0.760.780.77
   query15  0.830.810.81
   query16  0.380.350.35
   query17  0.950.950.99
   query18  0.200.240.25
   query19  1.821.681.75
   query20  0.020.010.01
   query21  15.46   0.680.65
   query22  4.247.951.53
   query23  18.25   1.401.28
   query24  2.020.210.20
   query25  0.140.090.09
   query26  0.250.160.16
   query27  0.080.080.08
   query28  13.25   1.030.99
   query29  13.21   3.333.30
   query30  0.240.060.05
   query31  2.870.390.37
   query32  3.260.480.47
   query33  2.862.902.86
   query34  17.06   4.444.40
   query35  4.524.514.58
   query36  0.650.470.46
   query37  0.170.160.16
   query38  0.160.140.14
   query39  0.040.030.03
   query40  0.170.140.14
   query41  0.090.050.05
   query42  0.050.050.05
   query43  0.040.030.04
   Total cold run time: 109.74 s
   Total hot run time: 30.1 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35263:
URL: https://github.com/apache/doris/pull/35263#issuecomment-2127678285

   
   
   TPC-DS: Total hot run time: 170494 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit fb2c1069281b48727b59f1c2ff1b73d5e3da911c, 
data reload: false
   
   query1   907 378 380 378
   query2   6452249523672367
   query3   6650204 209 204
   query4   20054   17457   17360   17360
   query5   4162427 409 409
   query6   256 153 149 149
   query7   4595292 286 286
   query8   240 183 199 183
   query9   8540240823812381
   query10  462 276 269 269
   query11  10680   10195   10197   10195
   query12  130 88  88  88
   query13  1641356 361 356
   query14  10076   739873977397
   query15  235 181 171 171
   query16  7885255 253 253
   query17  1871515 509 509
   query18  1943271 268 268
   query19  204 150 151 150
   query20  93  84  86  84
   query21  193 125 127 125
   query22  4225404839483948
   query23  33808   33092   33081   33081
   query24  11894   285928132813
   query25  648 354 364 354
   query26  1790153 153 153
   query27  2970322 320 320
   query28  7574208620722072
   query29  1065617 590 590
   query30  314 169 173 169
   query31  976 770 733 733
   query32  91  52  55  52
   query33  763 263 259 259
   query34  1018472 475 472
   query35  730 585 600 585
   query36  1093927 908 908
   query37  180 70  78  70
   query38  3006285128012801
   query39  831 790 796 790
   query40  272 123 122 122
   query41  44  46  42  42
   query42  106 99  100 99
   query43  584 564 531 531
   query44  1200746 756 746
   query45  180 164 159 159
   query46  1081688 715 688
   query47  1856177918121779
   query48  364 293 290 290
   query49  1180395 383 383
   query50  762 399 387 387
   query51  7010676568626765
   query52  106 88  93  88
   query53  352 291 277 277
   query54  986 427 421 421
   query55  78  72  73  72
   query56  286 232 244 232
   query57  1145105110771051
   query58  227 211 203 203
   query59  3315322834173228
   query60  273 247 250 247
   query61  86  87  85  85
   query62  655 453 460 453
   query63  305 279 285 279
   query64  9901221317661766
   query65  3165308231363082
   query66  1356338 334 334
   query67  15385   15010   15129   15010
   query68  4686531 537 531
   query69  438 260 266 260
   query70  1190112710281028
   query71  399 272 271 271
   query72  7142272125752575
   query73  737 324 323 323
   query74  6048573657195719
   query75  3338264326172617
   query76  2611967 931 931
   query77  408 265 262 262
   query78  10313   10056   97549754
   query79  2661514 518 514
   query80  1072432 428 428
   query81  518 242 245 242
   query82  969 104 94  94
   query83  267 172 171 171
   query84  249 90  95  90
   query85  1367257 357 257
   query86  444 312 289 289
   query87  3364313331343133
   query88  4150236523452345
   query89  478 382 371 371
   query90  1945184 188 184
   query91  120 97  95  95
   query92  58  47  50  47
   query93  1891516 502 502
   query94  1234183 183 183
   query95  393 304 303 303
   query96  597 267 271 267
   query97  3225307530953075
   query98  244 216 216 216
   query99  1091846 847 846
   Total cold run time: 276152 ms
   Total hot run time: 170494 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the sp

Re: [PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35263:
URL: https://github.com/apache/doris/pull/35263#issuecomment-2127658041

   
   
   TPC-H: Total hot run time: 40367 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit fb2c1069281b48727b59f1c2ff1b73d5e3da911c, 
data reload: false
   
   -- Round 1 --
   q1   17621   450743634363
   q2   2020192 191 191
   q3   10584   119112601191
   q4   10337   790 774 774
   q5   7542273926242624
   q6   222 134 138 134
   q7   961 603 606 603
   q8   9315211121442111
   q9   9206664266476642
   q10  10004   369237443692
   q11  474 242 234 234
   q12  539 220 215 215
   q13  17769   298830082988
   q14  267 218 217 217
   q15  523 471 476 471
   q16  510 376 382 376
   q17  990 767 652 652
   q18  8160754575797545
   q19  5168150415041504
   q20  653 311 316 311
   q21  5060405232523252
   q22  342 277 280 277
   Total cold run time: 118267 ms
   Total hot run time: 40367 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4373423842534238
   q2   364 268 276 268
   q3   3014280427222722
   q4   1862163616091609
   q5   5308529153205291
   q6   212 126 128 126
   q7   2165177517021702
   q8   3199335733833357
   q9   8425840584168405
   q10  3861371437403714
   q11  589 490 477 477
   q12  779 586 581 581
   q13  16337   297730092977
   q14  295 242 267 242
   q15  518 482 469 469
   q16  477 413 415 413
   q17  1798148514641464
   q18  7692760775017501
   q19  1703157715851577
   q20  1959178717641764
   q21  4774478447534753
   q22  565 483 507 483
   Total cold run time: 70269 ms
   Total hot run time: 54133 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]

2024-05-23 Thread via GitHub


github-actions[bot] commented on PR #35263:
URL: https://github.com/apache/doris/pull/35263#issuecomment-2127482727

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]

2024-05-23 Thread via GitHub


github-actions[bot] commented on PR #35263:
URL: https://github.com/apache/doris/pull/35263#issuecomment-2127468294

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]

2024-05-23 Thread via GitHub


xinyiZzz commented on PR #35263:
URL: https://github.com/apache/doris/pull/35263#issuecomment-2127466143

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]

2024-05-23 Thread via GitHub


xinyiZzz commented on PR #35263:
URL: https://github.com/apache/doris/pull/35263#issuecomment-2127453899

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35263:
URL: https://github.com/apache/doris/pull/35263#issuecomment-2126436036

   
   
   ClickBench: Total hot run time: 30.14 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 54818c957cfdaf468330ca8cd7094bca623438d1, 
data reload: false
   
   query1   0.040.030.03
   query2   0.080.040.05
   query3   0.230.050.05
   query4   1.680.070.08
   query5   0.500.480.52
   query6   1.130.720.72
   query7   0.020.010.01
   query8   0.050.040.03
   query9   0.540.500.49
   query10  0.540.560.54
   query11  0.160.100.11
   query12  0.140.120.12
   query13  0.590.580.60
   query14  0.790.780.77
   query15  0.830.800.80
   query16  0.360.370.36
   query17  1.010.991.01
   query18  0.210.230.25
   query19  1.891.681.63
   query20  0.010.010.01
   query21  15.63   0.670.64
   query22  4.077.911.79
   query23  18.26   1.331.18
   query24  1.680.280.21
   query25  0.140.090.09
   query26  0.260.160.17
   query27  0.080.080.07
   query28  13.36   1.031.00
   query29  13.17   3.273.24
   query30  0.240.060.05
   query31  2.870.380.38
   query32  3.320.470.47
   query33  2.872.902.90
   query34  17.01   4.434.40
   query35  4.534.504.47
   query36  0.640.460.46
   query37  0.180.150.16
   query38  0.150.140.15
   query39  0.050.030.04
   query40  0.160.140.17
   query41  0.080.050.04
   query42  0.060.040.05
   query43  0.040.040.04
   Total cold run time: 109.65 s
   Total hot run time: 30.14 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35263:
URL: https://github.com/apache/doris/pull/35263#issuecomment-2126426036

   
   
   TPC-DS: Total hot run time: 169617 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 54818c957cfdaf468330ca8cd7094bca623438d1, 
data reload: false
   
   query1   912 383 370 370
   query2   6465236322452245
   query3   6657208 206 206
   query4   20798   17320   17359   17320
   query5   4223417 414 414
   query6   255 151 150 150
   query7   4583299 290 290
   query8   238 187 183 183
   query9   8452236223252325
   query10  450 276 255 255
   query11  10564   10158   10013   10013
   query12  131 87  92  87
   query13  1634376 369 369
   query14  9255699573986995
   query15  213 167 169 167
   query16  7827260 258 258
   query17  1849521 513 513
   query18  1959285 279 279
   query19  209 159 184 159
   query20  92  87  82  82
   query21  198 129 129 129
   query22  4242405439763976
   query23  33640   33023   32968   32968
   query24  11979   279727762776
   query25  678 348 361 348
   query26  1813151 152 151
   query27  3024314 316 314
   query28  7659206420332033
   query29  1136600 591 591
   query30  270 169 170 169
   query31  981 745 765 745
   query32  92  54  55  54
   query33  759 270 277 270
   query34  1006471 481 471
   query35  746 621 598 598
   query36  1072922 921 921
   query37  282 75  75  75
   query38  2876276527832765
   query39  866 803 787 787
   query40  264 124 122 122
   query41  49  50  43  43
   query42  101 95  95  95
   query43  581 574 529 529
   query44  1191736 746 736
   query45  171 165 162 162
   query46  1081743 689 689
   query47  1832179217771777
   query48  373 299 300 299
   query49  1192378 385 378
   query50  789 388 382 382
   query51  6938688967576757
   query52  105 92  92  92
   query53  347 292 290 290
   query54  987 435 425 425
   query55  71  99  73  73
   query56  251 237 250 237
   query57  1150103710351035
   query58  232 225 203 203
   query59  3604327531423142
   query60  277 254 251 251
   query61  89  101 87  87
   query62  662 464 456 456
   query63  310 278 283 278
   query64  9846217916971697
   query65  3205309631213096
   query66  1381338 323 323
   query67  15492   14921   14910   14910
   query68  4621554 545 545
   query69  431 261 262 261
   query70  1113114511711145
   query71  395 270 273 270
   query72  7653519627552755
   query73  712 323 321 321
   query74  5961556055435543
   query75  3357267126422642
   query76  2538925 952 925
   query77  406 261 263 261
   query78  10313   992510014   9925
   query79  2661526 513 513
   query80  1071435 429 429
   query81  522 244 245 244
   query82  712 93  95  93
   query83  265 166 169 166
   query84  238 86  84  84
   query85  1672283 267 267
   query86  512 297 303 297
   query87  3291309631013096
   query88  4282243924422439
   query89  501 390 390 390
   query90  1969190 192 190
   query91  125 97  97  97
   query92  67  49  49  49
   query93  1976513 505 505
   query94  1224184 187 184
   query95  403 315 309 309
   query96  601 275 272 272
   query97  3207295930782959
   query98  242 214 212 212
   query99  1108844 844 844
   Total cold run time: 276805 ms
   Total hot run time: 169617 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the sp

Re: [PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35263:
URL: https://github.com/apache/doris/pull/35263#issuecomment-2126407761

   
   
   TPC-H: Total hot run time: 39933 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 54818c957cfdaf468330ca8cd7094bca623438d1, 
data reload: false
   
   -- Round 1 --
   q1   18062   444142944294
   q2   2595191 202 191
   q3   11139   118211571157
   q4   10516   843 780 780
   q5   7510281426732673
   q6   220 136 131 131
   q7   953 601 602 601
   q8   9310209920972097
   q9   8899646764466446
   q10  8916366836803668
   q11  449 244 227 227
   q12  407 221 212 212
   q13  17767   296329762963
   q14  259 217 223 217
   q15  515 459 463 459
   q16  498 390 382 382
   q17  956 707 664 664
   q18  8027750074597459
   q19  4094153314921492
   q20  644 292 296 292
   q21  4977379332603260
   q22  337 268 282 268
   Total cold run time: 117050 ms
   Total hot run time: 39933 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4314417541754175
   q2   364 253 263 253
   q3   2932279627812781
   q4   1830160015761576
   q5   5183524452575244
   q6   212 124 123 123
   q7   2076175317421742
   q8   3173331932963296
   q9   8348828282878282
   q10  3858368837063688
   q11  589 484 483 483
   q12  766 620 579 579
   q13  16441   299029872987
   q14  295 279 253 253
   q15  505 471 467 467
   q16  479 418 424 418
   q17  1784151914491449
   q18  7701748475377484
   q19  1655152815281528
   q20  1979176917851769
   q21  4850486047154715
   q22  588 496 479 479
   Total cold run time: 69922 ms
   Total hot run time: 53771 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35263:
URL: https://github.com/apache/doris/pull/35263#issuecomment-2126306914

   
   
   TPC-DS: Total hot run time: 171942 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 54818c957cfdaf468330ca8cd7094bca623438d1, 
data reload: false
   
   query1   922 383 371 371
   query2   6436227823442278
   query3   6646206 205 205
   query4   19146   17367   17303   17303
   query5   4145438 447 438
   query6   249 170 158 158
   query7   4590299 297 297
   query8   241 198 189 189
   query9   8475235523452345
   query10  455 297 275 275
   query11  10516   10148   10013   10013
   query12  135 90  86  86
   query13  1640380 385 380
   query14  10330   697469846974
   query15  227 171 173 171
   query16  7767299 267 267
   query17  1381521 550 521
   query18  1946278 267 267
   query19  203 154 151 151
   query20  99  84  84  84
   query21  197 132 133 132
   query22  4120390139213901
   query23  33912   32956   33093   32956
   query24  9104287728602860
   query25  586 360 387 360
   query26  709 157 161 157
   query27  2201337 325 325
   query28  5742206820572057
   query29  869 611 604 604
   query30  224 173 173 173
   query31  979 757 752 752
   query32  92  52  54  52
   query33  613 271 268 268
   query34  883 480 473 473
   query35  716 628 598 598
   query36  1043906 890 890
   query37  110 68  73  68
   query38  2873276527772765
   query39  878 792 784 784
   query40  193 135 126 126
   query41  46  45  40  40
   query42  105 97  100 97
   query43  588 562 553 553
   query44  1114748 762 748
   query45  177 163 167 163
   query46  1063719 752 719
   query47  1846176717611761
   query48  376 309 298 298
   query49  833 382 408 382
   query50  777 403 403 403
   query51  6791678468516784
   query52  122 90  88  88
   query53  361 293 296 293
   query54  699 450 431 431
   query55  76  75  73  73
   query56  270 250 249 249
   query57  1151106410511051
   query58  227 215 222 215
   query59  3408336332223222
   query60  287 260 254 254
   query61  89  89  90  89
   query62  609 470 453 453
   query63  317 288 324 288
   query64  8479221217581758
   query65  3153310031333100
   query66  792 333 329 329
   query67  15224   14961   14676   14676
   query68  4538555 565 555
   query69  452 272 279 272
   query70  1104106311351063
   query71  362 276 273 273
   query72  7527565348754875
   query73  715 330 327 327
   query74  6115561356055605
   query75  3324259426122594
   query76  2334999 1008999
   query77  379 268 286 268
   query78  10283   986097689768
   query79  1926529 527 527
   query80  1148456 460 456
   query81  541 246 248 246
   query82  622 100 102 100
   query83  255 181 176 176
   query84  256 91  90  90
   query85  1650313 266 266
   query86  480 304 311 304
   query87  3262314231283128
   query88  4238245424292429
   query89  486 404 395 395
   query90  2013189 191 189
   query91  124 98  102 98
   query92  66  47  48  47
   query93  2442526 513 513
   query94  1296188 189 188
   query95  405 321 312 312
   query96  594 291 270 270
   query97  3160296229862962
   query98  246 228 215 215
   query99  1221841 864 841
   Total cold run time: 264137 ms
   Total hot run time: 171942 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the s

Re: [PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35263:
URL: https://github.com/apache/doris/pull/35263#issuecomment-2126294727

   
   
   TPC-H: Total hot run time: 42492 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 54818c957cfdaf468330ca8cd7094bca623438d1, 
data reload: false
   
   -- Round 1 --
   q1   17604   503943434343
   q2   2018189 195 189
   q3   10460   119812511198
   q4   10188   888 812 812
   q5   7487277227732772
   q6   218 135 135 135
   q7   986 623 646 623
   q8   9216219521522152
   q9   9275669367546693
   q10  9158404339393939
   q11  450 241 248 241
   q12  468 247 243 243
   q13  17232   338032123212
   q14  266 226 227 226
   q15  522 490 496 490
   q16  527 419 403 403
   q17  1030784 712 712
   q18  8766813578977897
   q19  7682160315471547
   q20  674 322 323 322
   q21  5384406043074060
   q22  380 283 291 283
   Total cold run time: 119991 ms
   Total hot run time: 42492 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4595443043804380
   q2   401 275 280 275
   q3   3236292629202920
   q4   2068176617461746
   q5   5376553755365536
   q6   211 129 131 129
   q7   2279181418861814
   q8   3240342834653428
   q9   8715867688228676
   q10  4160389438163816
   q11  601 484 494 484
   q12  760 589 599 589
   q13  17174   319632253196
   q14  303 287 267 267
   q15  536 489 486 486
   q16  517 460 453 453
   q17  1930160315441544
   q18  8246773675357535
   q19  1696152416031524
   q20  2031179818211798
   q21  9591473948984739
   q22  582 488 498 488
   Total cold run time: 78248 ms
   Total hot run time: 55823 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]

2024-05-22 Thread via GitHub


github-actions[bot] commented on PR #35263:
URL: https://github.com/apache/doris/pull/35263#issuecomment-2126209231

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]

2024-05-22 Thread via GitHub


xinyiZzz opened a new pull request, #35263:
URL: https://github.com/apache/doris/pull/35263

   ## Proposed changes
   
   If enable_query_enforce_exec is false, BE process exceed memory limit will 
reject new Query execution
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]

2024-05-22 Thread via GitHub


xinyiZzz commented on PR #35263:
URL: https://github.com/apache/doris/pull/35263#issuecomment-2126204770

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]

2024-05-22 Thread via GitHub


doris-robot commented on PR #35263:
URL: https://github.com/apache/doris/pull/35263#issuecomment-2126204747

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org