Re: [PR] branch-3.1: [fix](filecache) no fd num limit for segment cache when cloud mode #55610 [doris]

2025-09-04 Thread via GitHub


doris-robot commented on PR #55638:
URL: https://github.com/apache/doris/pull/55638#issuecomment-3251778024

   
   
   TPC-H: Total hot run time: 33413 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit e1f047133391e12e85e611310cf9e0479df97c35, 
data reload: false
   
   -- Round 1 --
   q1   17686   569955955595
   q2   2033514 279 279
   q3   11965   1297792 792
   q4   10245   886 463 463
   q5   8500248621922192
   q6   195 169 131 131
   q7   910 770 622 622
   q8   9334146612551255
   q9   5424498249544954
   q10  6830230818361836
   q11  491 293 277 277
   q12  347 369 217 217
   q13  17774   365030573057
   q14  232 233 210 210
   q15  530 473 471 471
   q16  450 452 391 391
   q17  609 895 365 365
   q18  7243648866146488
   q19  1329981 589 589
   q20  335 351 206 206
   q21  3066234420452045
   q22  10581023978 978
   Total cold run time: 106586 ms
   Total hot run time: 33413 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5687555855545554
   q2   238 335 229 229
   q3   2324276823772377
   q4   1397186114661466
   q5   4579520951155115
   q6   180 169 134 134
   q7   2116202818491849
   q8   2713293028062806
   q9   7295731272617261
   q10  3119324028162816
   q11  602 531 502 502
   q12  689 787 616 616
   q13  3419385232063206
   q14  302 295 274 274
   q15  524 469 487 469
   q16  464 491 448 448
   q17  1269180312551255
   q18  7886751875107510
   q19  887 125211831183
   q20  2038208119121912
   q21  5638509646014601
   q22  1082104310271027
   Total cold run time: 54448 ms
   Total hot run time: 52610 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] branch-3.1: [fix](filecache) no fd num limit for segment cache when cloud mode #55610 [doris]

2025-09-04 Thread via GitHub


doris-robot commented on PR #55638:
URL: https://github.com/apache/doris/pull/55638#issuecomment-3251800046

   
   
   TPC-DS: Total hot run time: 193243 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit e1f047133391e12e85e611310cf9e0479df97c35, 
data reload: false
   
   query1   947 395 400 395
   query2   6219190718401840
   query3   8686210 211 210
   query4   33222   23657   23775   23657
   query5   3613600 459 459
   query6   297 197 168 168
   query7   4190487 311 311
   query8   298 238 235 235
   query9   9456266526582658
   query10  512 352 265 265
   query11  18460   15471   15352   15352
   query12  162 109 104 104
   query13  1551554 425 425
   query14  10273   676270926762
   query15  264 188 181 181
   query16  8080659 492 492
   query17  1578795 607 607
   query18  2194425 326 326
   query19  229 192 173 173
   query20  134 126 125 125
   query21  209 132 119 119
   query22  4524456345134513
   query23  35466   34424   34324   34324
   query24  7226269527592695
   query25  561 492 429 429
   query26  733 296 182 182
   query27  1867486 369 369
   query28  5176224322452243
   query29  746 612 484 484
   query30  241 198 166 166
   query31  1014915 866 866
   query32  87  62  63  62
   query33  511 394 304 304
   query34  766 875 525 525
   query35  794 805 753 753
   query36  10121053960 960
   query37  108 100 73  73
   query38  4076413039893989
   query39  1512147914951479
   query40  214 117 103 103
   query41  50  50  46  46
   query42  124 113 106 106
   query43  506 521 469 469
   query44  1342836 840 836
   query45  199 186 176 176
   query46  919 1061701 701
   query47  1970199219641964
   query48  418 425 348 348
   query49  741 495 412 412
   query50  694 689 450 450
   query51  7406726571737173
   query52  110 105 94  94
   query53  244 260 193 193
   query54  577 544 472 472
   query55  85  84  79  79
   query56  277 272 256 256
   query57  1286128412591259
   query58  237 228 232 228
   query59  3177320831113111
   query60  298 281 274 274
   query61  117 112 114 112
   query62  770 743 704 704
   query63  247 199 198 198
   query64  33961043666 666
   query65  3413328133173281
   query66  814 415 350 350
   query67  16442   15872   15511   15511
   query68  7595847 554 554
   query69  502 310 274 274
   query70  1214116411211121
   query71  377 294 273 273
   query72  5763385138303830
   query73  639 747 357 357
   query74  10224   909690609060
   query75  3264313626542654
   query76  31221183778 778
   query77  533 376 278 278
   query78  10340   10609   95979597
   query79  3387910 614 614
   query80  656 517 429 429
   query81  497 260 222 222
   query82  605 123 94  94
   query83  162 167 145 145
   query84  244 103 86  86
   query85  792 370 297 297
   query86  403 321 295 295
   query87  4355434042484248
   query88  5310242624332426
   query89  399 336 298 298
   query90  1767186 189 186
   query91  139 155 114 114
   query92  64  54  52  52
   query93  2035933 560 560
   query94  681 415 319 319
   query95  338 276 264 264
   query96  504 608 284 284
   query97  3207324631743174
   query98  224 220 196 196
   query99  1596142413121312
   Total cold run time: 294005 ms
   Total hot run time: 193243 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to 

Re: [PR] branch-3.1: [fix](filecache) no fd num limit for segment cache when cloud mode #55610 [doris]

2025-09-04 Thread via GitHub


morrySnow merged PR #55638:
URL: https://github.com/apache/doris/pull/55638


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] branch-3.1: [fix](filecache) no fd num limit for segment cache when cloud mode #55610 [doris]

2025-09-04 Thread via GitHub


hello-stephen commented on PR #55638:
URL: https://github.com/apache/doris/pull/55638#issuecomment-3252299162

   # BE Regression && UT Coverage Report
   Increment line coverage `100.00% (9/9)` :tada:
   
   [Increment coverage 
report](http://coverage.selectdb-in.cc/coverage/55638_e1f047133391e12e85e611310cf9e0479df97c35_merge/increment_report/index.html)
   [Complete coverage 
report](http://coverage.selectdb-in.cc/coverage/55638_e1f047133391e12e85e611310cf9e0479df97c35_merge/report/index.html)
   | Category  | Coverage   |
   |---||
   | Function Coverage | 76.24% (20985/27525) |
   | Line Coverage | 69.46% (216245/311345) |
   | Region Coverage   | 67.38% (129310/191915) |
   | Branch Coverage   | 61.00% (67357/110414) |


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] branch-3.1: [fix](filecache) no fd num limit for segment cache when cloud mode #55610 [doris]

2025-09-03 Thread via GitHub


morrySnow commented on PR #55638:
URL: https://github.com/apache/doris/pull/55638#issuecomment-3251558867

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] branch-3.1: [fix](filecache) no fd num limit for segment cache when cloud mode #55610 [doris]

2025-09-03 Thread via GitHub


doris-robot commented on PR #55638:
URL: https://github.com/apache/doris/pull/55638#issuecomment-3251859193

   # BE UT Coverage Report
   Increment line coverage `0.00% (0/9)` :tada:
   
   [Increment coverage 
report](http://coverage.selectdb-in.cc/coverage/e1f047133391e12e85e611310cf9e0479df97c35_e1f047133391e12e85e611310cf9e0479df97c35/increment_report/index.html)
   [Complete coverage 
report](http://coverage.selectdb-in.cc/coverage/e1f047133391e12e85e611310cf9e0479df97c35_e1f047133391e12e85e611310cf9e0479df97c35/report/index.html)
   | Category  | Coverage   |
   |---||
   | Function Coverage | 45.52% (12743/27996) |
   | Line Coverage | 36.38% (113652/312394) |
   | Region Coverage   | 34.00% (65004/191176) |
   | Branch Coverage   | 31.04% (34116/109918) |


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] branch-3.1: [fix](filecache) no fd num limit for segment cache when cloud mode #55610 [doris]

2025-09-03 Thread via GitHub


doris-robot commented on PR #55638:
URL: https://github.com/apache/doris/pull/55638#issuecomment-3251812174

   
   
   ClickBench: Total hot run time: 29.6 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit e1f047133391e12e85e611310cf9e0479df97c35, 
data reload: false
   
   query1   0.040.030.02
   query2   0.060.030.03
   query3   0.240.060.07
   query4   1.620.110.10
   query5   0.530.510.54
   query6   1.130.740.73
   query7   0.020.010.02
   query8   0.040.040.04
   query9   0.580.520.49
   query10  0.580.550.55
   query11  0.140.100.10
   query12  0.140.120.11
   query13  0.610.590.59
   query14  0.770.790.80
   query15  0.850.850.83
   query16  0.390.380.40
   query17  1.061.001.05
   query18  0.250.210.23
   query19  1.841.791.88
   query20  0.010.010.01
   query21  15.43   0.950.60
   query22  0.740.730.78
   query23  15.02   1.450.63
   query24  3.011.481.49
   query25  0.140.180.05
   query26  0.290.140.15
   query27  0.050.040.04
   query28  13.83   1.060.43
   query29  12.59   3.983.28
   query30  0.250.090.07
   query31  2.820.580.37
   query32  3.230.550.48
   query33  3.013.023.04
   query34  16.80   5.254.58
   query35  4.584.554.63
   query36  0.630.510.48
   query37  0.090.060.06
   query38  0.050.040.04
   query39  0.040.020.02
   query40  0.160.140.13
   query41  0.080.020.03
   query42  0.030.030.02
   query43  0.030.030.03
   Total cold run time: 103.8 s
   Total hot run time: 29.6 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] branch-3.1: [fix](filecache) no fd num limit for segment cache when cloud mode #55610 [doris]

2025-09-03 Thread via GitHub


doris-robot commented on PR #55638:
URL: https://github.com/apache/doris/pull/55638#issuecomment-3249074354

   # BE UT Coverage Report
   Increment line coverage `0.00% (0/9)` :tada:
   
   [Increment coverage 
report](http://coverage.selectdb-in.cc/coverage/e1f047133391e12e85e611310cf9e0479df97c35_e1f047133391e12e85e611310cf9e0479df97c35/increment_report/index.html)
   [Complete coverage 
report](http://coverage.selectdb-in.cc/coverage/e1f047133391e12e85e611310cf9e0479df97c35_e1f047133391e12e85e611310cf9e0479df97c35/report/index.html)
   | Category  | Coverage   |
   |---||
   | Function Coverage | 45.49% (12724/27973) |
   | Line Coverage | 36.37% (113455/311936) |
   | Region Coverage   | 34.00% (64952/191013) |
   | Branch Coverage   | 31.05% (34103/109816) |


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] branch-3.1: [fix](filecache) no fd num limit for segment cache when cloud mode #55610 [doris]

2025-09-03 Thread via GitHub


doris-robot commented on PR #55638:
URL: https://github.com/apache/doris/pull/55638#issuecomment-3249027819

   
   
   ClickBench: Total hot run time: 29.34 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit e1f047133391e12e85e611310cf9e0479df97c35, 
data reload: false
   
   query1   0.030.030.03
   query2   0.070.030.03
   query3   0.240.070.06
   query4   1.630.110.11
   query5   0.500.510.52
   query6   1.130.730.73
   query7   0.020.010.02
   query8   0.050.040.03
   query9   0.570.520.49
   query10  0.560.550.55
   query11  0.140.110.10
   query12  0.140.110.12
   query13  0.630.600.59
   query14  0.770.800.78
   query15  0.850.840.83
   query16  0.420.400.40
   query17  1.051.091.03
   query18  0.240.220.22
   query19  1.981.851.86
   query20  0.010.010.01
   query21  15.40   0.980.56
   query22  0.740.770.67
   query23  15.12   1.480.53
   query24  3.351.311.24
   query25  0.180.130.16
   query26  0.300.150.13
   query27  0.050.050.04
   query28  14.21   1.000.43
   query29  12.55   3.963.26
   query30  0.250.090.07
   query31  2.840.580.38
   query32  3.220.550.47
   query33  3.023.073.05
   query34  16.55   5.184.54
   query35  4.584.604.58
   query36  0.650.490.48
   query37  0.090.060.06
   query38  0.040.040.04
   query39  0.030.030.02
   query40  0.170.130.12
   query41  0.080.020.02
   query42  0.040.020.02
   query43  0.040.030.03
   Total cold run time: 104.53 s
   Total hot run time: 29.34 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] branch-3.1: [fix](filecache) no fd num limit for segment cache when cloud mode #55610 [doris]

2025-09-03 Thread via GitHub


doris-robot commented on PR #55638:
URL: https://github.com/apache/doris/pull/55638#issuecomment-3249010888

   
   
   TPC-DS: Total hot run time: 194030 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit e1f047133391e12e85e611310cf9e0479df97c35, 
data reload: false
   
   query1   957 408 387 387
   query2   6289197319061906
   query3   8675200 198 198
   query4   33728   24047   23470   23470
   query5   3725612 459 459
   query6   297 201 191 191
   query7   4201497 336 336
   query8   313 255 255 255
   query9   9363260325952595
   query10  456 326 266 266
   query11  18032   15438   15173   15173
   query12  163 104 104 104
   query13  1537544 411 411
   query14  8676792174787478
   query15  256 194 177 177
   query16  8117663 473 473
   query17  1573755 572 572
   query18  2186430 338 338
   query19  243 190 186 186
   query20  133 126 123 123
   query21  208 131 109 109
   query22  4556475945074507
   query23  35038   34347   34430   34347
   query24  7576274727392739
   query25  530 471 414 414
   query26  1168283 170 170
   query27  2048489 364 364
   query28  5417225122372237
   query29  784 573 435 435
   query30  239 197 161 161
   query31  1011937 848 848
   query32  94  61  57  57
   query33  494 364 319 319
   query34  776 853 531 531
   query35  800 805 733 733
   query36  10291048982 982
   query37  98  90  65  65
   query38  4073400340444003
   query39  1556149614701470
   query40  223 128 114 114
   query41  48  47  51  47
   query42  120 107 103 103
   query43  498 522 501 501
   query44  1310833 821 821
   query45  184 180 169 169
   query46  874 1048693 693
   query47  2016201419311931
   query48  413 431 360 360
   query49  773 490 417 417
   query50  671 700 432 432
   query51  7407741273117311
   query52  106 97  91  91
   query53  236 254 192 192
   query54  548 568 485 485
   query55  82  78  78  78
   query56  287 263 264 263
   query57  1276130512071207
   query58  252 216 216 216
   query59  3186321531333133
   query60  299 284 270 270
   query61  118 110 115 110
   query62  799 779 723 723
   query63  228 205 191 191
   query64  44911010724 724
   query65  3394338133063306
   query66  1001434 326 326
   query67  16022   15599   15710   15599
   query68  2181847 588 588
   query69  464 318 286 286
   query70  1177118410351035
   query71  344 290 264 264
   query72  6092391140053911
   query73  641 754 374 374
   query74  10058   934091039103
   query75  3173319427122712
   query76  26461155793 793
   query77  487 369 270 270
   query78  10405   10453   97389738
   query79  3387852 611 611
   query80  1656516 437 437
   query81  541 255 220 220
   query82  334 114 87  87
   query83  240 161 143 143
   query84  239 103 81  81
   query85  757 341 314 314
   query86  492 301 307 301
   query87  4324436042284228
   query88  5572243024112411
   query89  400 332 295 295
   query90  1850190 191 190
   query91  134 137 107 107
   query92  63  55  51  51
   query93  2813923 552 552
   query94  726 412 302 302
   query95  343 275 268 268
   query96  494 615 281 281
   query97  3182330731773177
   query98  234 218 205 205
   query99  1348140812931293
   Total cold run time: 290074 ms
   Total hot run time: 194030 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to 

Re: [PR] branch-3.1: [fix](filecache) no fd num limit for segment cache when cloud mode #55610 [doris]

2025-09-03 Thread via GitHub


doris-robot commented on PR #55638:
URL: https://github.com/apache/doris/pull/55638#issuecomment-3248971871

   
   
   TPC-H: Total hot run time: 33493 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit e1f047133391e12e85e611310cf9e0479df97c35, 
data reload: false
   
   -- Round 1 --
   q1   17609   578556065606
   q2   2019400 291 291
   q3   11946   1332793 793
   q4   10542   900 456 456
   q5   9522249022682268
   q6   206 170 145 145
   q7   952 774 618 618
   q8   9337162313051305
   q9   5479505850395039
   q10  6843230218381838
   q11  503 285 264 264
   q12  348 377 214 214
   q13  17771   366930123012
   q14  243 228 220 220
   q15  522 464 459 459
   q16  425 447 378 378
   q17  607 911 366 366
   q18  6969639564716395
   q19  12121094587 587
   q20  332 358 204 204
   q21  2910230620592059
   q22  10721041976 976
   Total cold run time: 107369 ms
   Total hot run time: 33493 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5828584358465843
   q2   248 332 236 236
   q3   2250263723042304
   q4   1391189113651365
   q5   4614517151545154
   q6   189 163 126 126
   q7   2130200518121812
   q8   2791293328502850
   q9   7272722972297229
   q10  3072325828652865
   q11  598 515 512 512
   q12  722 756 617 617
   q13  3457390631443144
   q14  302 298 272 272
   q15  526 467 474 467
   q16  456 501 433 433
   q17  1333182413061306
   q18  7628752973457345
   q19  879 125612711256
   q20  2102208319461946
   q21  5460503446764676
   q22  1097106410261026
   Total cold run time: 54345 ms
   Total hot run time: 52784 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] branch-3.1: [fix](filecache) no fd num limit for segment cache when cloud mode #55610 [doris]

2025-09-03 Thread via GitHub


hello-stephen commented on PR #55638:
URL: https://github.com/apache/doris/pull/55638#issuecomment-3248885471

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] branch-3.1: [fix](filecache) no fd num limit for segment cache when cloud mode #55610 [doris]

2025-09-03 Thread via GitHub


hello-stephen commented on PR #55638:
URL: https://github.com/apache/doris/pull/55638#issuecomment-3248885292

   
   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
   
   Please clearly describe your PR:
   1. What problem was fixed (it's best to include specific error reporting 
information). How it was fixed.
   2. Which behaviors were modified. What was the previous behavior, what is it 
now, why was it modified, and what possible impacts might there be.
   3. What features were added. Why was this function added?
   4. Which code was refactored and why was this part of the code refactored?
   5. Which functions were optimized and what is the difference before and 
after the optimization?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] branch-3.1: [fix](filecache) no fd num limit for segment cache when cloud mode #55610 [doris]

2025-09-03 Thread via GitHub


dataroaring closed pull request #55638: branch-3.1: [fix](filecache) no fd num 
limit for segment cache when cloud mode #55610
URL: https://github.com/apache/doris/pull/55638


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]