Re: [PR] [improve](load) introduce black list of backend when load job fetch meta to avoid jitter [doris]

2025-05-19 Thread via GitHub


dataroaring merged PR #50587:
URL: https://github.com/apache/doris/pull/50587


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [improve](load) introduce black list of backend when load job fetch meta to avoid jitter [doris]

2025-05-16 Thread via GitHub


github-actions[bot] commented on PR #50587:
URL: https://github.com/apache/doris/pull/50587#issuecomment-2886045762

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [improve](load) introduce black list of backend when load job fetch meta to avoid jitter [doris]

2025-05-13 Thread via GitHub


github-actions[bot] commented on PR #50587:
URL: https://github.com/apache/doris/pull/50587#issuecomment-2875419087

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [improve](load) introduce black list of backend when load job fetch meta to avoid jitter [doris]

2025-05-12 Thread via GitHub


doris-robot commented on PR #50587:
URL: https://github.com/apache/doris/pull/50587#issuecomment-2875040683

   
   
   ClickBench: Total hot run time: 29.43 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 2572189d39d59f2b94b6b8a0860cd972df804f6a, 
data reload: false
   
   query1   0.040.040.04
   query2   0.130.110.10
   query3   0.260.200.20
   query4   1.590.160.20
   query5   0.570.570.54
   query6   1.210.710.73
   query7   0.020.020.01
   query8   0.040.030.04
   query9   0.570.520.51
   query10  0.580.570.58
   query11  0.160.100.11
   query12  0.150.110.12
   query13  0.620.600.58
   query14  0.800.800.82
   query15  0.880.840.87
   query16  0.370.390.38
   query17  1.071.071.06
   query18  0.220.210.21
   query19  1.861.751.79
   query20  0.010.010.02
   query21  15.39   0.850.55
   query22  0.751.140.76
   query23  14.89   1.340.63
   query24  6.811.850.98
   query25  0.520.160.05
   query26  0.590.150.13
   query27  0.050.060.05
   query28  9.820.890.45
   query29  12.53   3.913.29
   query30  0.250.090.07
   query31  2.820.600.38
   query32  3.230.550.46
   query33  3.093.093.07
   query34  15.82   5.094.53
   query35  4.544.544.50
   query36  0.660.500.50
   query37  0.090.070.06
   query38  0.060.040.03
   query39  0.030.020.03
   query40  0.180.140.14
   query41  0.080.020.02
   query42  0.030.020.03
   query43  0.040.040.03
   Total cold run time: 103.42 s
   Total hot run time: 29.43 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [improve](load) introduce black list of backend when load job fetch meta to avoid jitter [doris]

2025-05-12 Thread via GitHub


doris-robot commented on PR #50587:
URL: https://github.com/apache/doris/pull/50587#issuecomment-2875034538

   
   
   TPC-DS: Total hot run time: 193916 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 2572189d39d59f2b94b6b8a0860cd972df804f6a, 
data reload: false
   
   query1   1392110610501050
   query2   6259183218411832
   query3   11175   453346454533
   query4   54138   25577   23207   23207
   query5   5237518 461 461
   query6   379 209 204 204
   query7   5001519 299 299
   query8   331 247 249 247
   query9   6239266626752666
   query10  443 324 268 268
   query11  15059   14999   14812   14812
   query12  158 108 111 108
   query13  1152545 423 423
   query14  10136   642662816281
   query15  223 213 180 180
   query16  7097684 514 514
   query17  1110697 584 584
   query18  1520391 313 313
   query19  202 194 162 162
   query20  122 122 121 121
   query21  213 134 108 108
   query22  4367444843094309
   query23  34160   33595   33458   33458
   query24  6930245024282428
   query25  482 471 451 451
   query26  698 285 156 156
   query27  2216523 353 353
   query28  3166219021752175
   query29  578 557 438 438
   query30  277 217 183 183
   query31  882 875 809 809
   query32  74  64  71  64
   query33  463 368 326 326
   query34  852 865 553 553
   query35  790 834 742 742
   query36  940 1004903 903
   query37  113 107 79  79
   query38  4220433442474247
   query39  1523145114521451
   query40  216 127 111 111
   query41  67  64  65  64
   query42  132 117 108 108
   query43  494 522 491 491
   query44  1323844 843 843
   query45  183 174 170 170
   query46  869 1029667 667
   query47  1869188618141814
   query48  412 449 346 346
   query49  687 539 484 484
   query50  670 696 410 410
   query51  4248433741934193
   query52  119 111 109 109
   query53  243 265 188 188
   query54  655 601 539 539
   query55  89  89  83  83
   query56  308 308 311 308
   query57  1158123511341134
   query58  269 278 263 263
   query59  2734275626942694
   query60  343 335 313 313
   query61  124 129 130 129
   query62  763 727 695 695
   query63  238 239 195 195
   query64  19011061703 703
   query65  4321423042584230
   query66  735 401 304 304
   query67  15790   15479   15445   15445
   query68  4859921 541 541
   query69  519 313 272 272
   query70  1183113211321132
   query71  449 334 292 292
   query72  5876493150624931
   query73  886 666 362 362
   query74  9021921289588958
   query75  3503321727462746
   query76  36321183781 781
   query77  540 390 305 305
   query78  10142   10137   93269326
   query79  2772829 598 598
   query80  866 530 474 474
   query81  521 249 229 229
   query82  735 124 100 100
   query83  263 257 312 257
   query84  295 113 89  89
   query85  797 362 321 321
   query86  457 307 294 294
   query87  4403436444254364
   query88  3445231022982298
   query89  405 314 282 282
   query90  1884212 216 212
   query91  153 146 119 119
   query92  77  61  55  55
   query93  2633940 567 567
   query94  719 408 284 284
   query95  368 292 282 282
   query96  493 574 285 285
   query97  3217325431473147
   query98  223 208 201 201
   query99  1416135812811281
   Total cold run time: 298029 ms
   Total hot run time: 193916 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go

Re: [PR] [improve](load) introduce black list of backend when load job fetch meta to avoid jitter [doris]

2025-05-12 Thread via GitHub


doris-robot commented on PR #50587:
URL: https://github.com/apache/doris/pull/50587#issuecomment-2875020931

   
   
   TPC-H: Total hot run time: 34217 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 2572189d39d59f2b94b6b8a0860cd972df804f6a, 
data reload: false
   
   -- Round 1 --
   q1   26102   512050055005
   q2   2065275 180 180
   q3   10599   1263740 740
   q4   10263   1028557 557
   q5   7856235924042359
   q6   180 169 134 134
   q7   931 758 619 619
   q8   9325133011911191
   q9   6752501950435019
   q10  6824230018991899
   q11  519 286 267 267
   q12  357 370 214 214
   q13  17784   364931243124
   q14  225 228 211 211
   q15  527 487 497 487
   q16  423 417 376 376
   q17  611 872 379 379
   q18  7484717471507150
   q19  1571939 579 579
   q20  339 350 224 224
   q21  4372359825282528
   q22  10421044975 975
   Total cold run time: 116151 ms
   Total hot run time: 34217 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5098507050025002
   q2   234 320 224 224
   q3   2175264023232323
   q4   1380179714841484
   q5   4467434944094349
   q6   219 169 128 128
   q7   2000194317621762
   q8   2591252025632520
   q9   7229708071077080
   q10  3023319527792779
   q11  584 521 505 505
   q12  686 783 606 606
   q13  3584386033623362
   q14  308 324 264 264
   q15  546 497 484 484
   q16  438 483 437 437
   q17  1174148514001400
   q18  7846758774567456
   q19  869 908 901 901
   q20  1978201818491849
   q21  5182493147084708
   q22  10961078997 997
   Total cold run time: 52707 ms
   Total hot run time: 50620 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [improve](load) introduce black list of backend when load job fetch meta to avoid jitter [doris]

2025-05-12 Thread via GitHub


sollhui commented on PR #50587:
URL: https://github.com/apache/doris/pull/50587#issuecomment-2874944343

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [improve](load) introduce black list of backend when load job fetch meta to avoid jitter [doris]

2025-05-12 Thread via GitHub


sollhui commented on PR #50587:
URL: https://github.com/apache/doris/pull/50587#issuecomment-2874944957

   run buildall
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] [improve](load) introduce black list of backend when load job fetch meta to avoid jitter [doris]

2025-05-12 Thread via GitHub


sollhui commented on PR #50587:
URL: https://github.com/apache/doris/pull/50587#issuecomment-2874922359

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]