[PR] Update load-ssb-data.sh [doris]

2024-05-23 Thread via GitHub


249031042 opened a new pull request, #35275:
URL: https://github.com/apache/doris/pull/35275

   小BUG修复:因Label默认为空字符串,这个bug导致该脚本重复执行时date表的数据无法导入,报错Label已存在
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] Update load-ssb-data.sh [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35275:
URL: https://github.com/apache/doris/pull/35275#issuecomment-2126371971

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](ubsan) fix some Undefined behavior [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35262:
URL: https://github.com/apache/doris/pull/35262#issuecomment-2126374399

   
   
   ClickBench: Total hot run time: 30.2 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit ff0f505a7fe8de4a197526d6d070571cd3a92890, 
data reload: false
   
   query1   0.040.040.03
   query2   0.080.040.04
   query3   0.230.060.06
   query4   1.660.100.10
   query5   0.500.500.51
   query6   1.130.720.71
   query7   0.030.010.01
   query8   0.050.040.04
   query9   0.540.490.50
   query10  0.540.560.53
   query11  0.160.110.12
   query12  0.150.120.12
   query13  0.600.600.59
   query14  0.760.770.77
   query15  0.850.810.82
   query16  0.370.360.36
   query17  0.961.020.95
   query18  0.220.250.23
   query19  1.881.741.71
   query20  0.010.010.02
   query21  15.49   0.700.67
   query22  3.907.621.68
   query23  18.32   1.441.22
   query24  1.520.340.19
   query25  0.140.080.08
   query26  0.240.160.17
   query27  0.080.070.09
   query28  13.46   1.030.97
   query29  13.34   3.273.26
   query30  0.260.050.05
   query31  2.870.390.39
   query32  3.280.460.47
   query33  2.892.912.86
   query34  17.39   4.404.39
   query35  4.584.534.66
   query36  0.650.460.48
   query37  0.170.160.16
   query38  0.150.140.14
   query39  0.040.030.03
   query40  0.170.150.14
   query41  0.090.040.04
   query42  0.050.050.05
   query43  0.040.030.04
   Total cold run time: 109.88 s
   Total hot run time: 30.2 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [minor](dependencies)binding a third-party Hadoop component to version 1.2.0 [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35093:
URL: https://github.com/apache/doris/pull/35093#issuecomment-2126374469

   
   
   TPC-DS: Total hot run time: 168090 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit b73f2549e45cb9928b4a39b084f4939152564e79, 
data reload: false
   
   query1   910 373 372 372
   query2   6446241523312331
   query3   6642207 215 207
   query4   20082   17246   17335   17246
   query5   4121410 416 410
   query6   246 155 150 150
   query7   4581296 284 284
   query8   250 179 182 179
   query9   8658238323582358
   query10  446 285 265 265
   query11  10704   10056   10004   10004
   query12  135 97  90  90
   query13  1644387 351 351
   query14  9439650975096509
   query15  210 166 175 166
   query16  7747257 268 257
   query17  1624521 516 516
   query18  1938265 269 265
   query19  208 154 161 154
   query20  91  88  81  81
   query21  195 133 122 122
   query22  4422396439033903
   query23  33638   33075   32653   32653
   query24  6887289627982798
   query25  569 351 349 349
   query26  710 160 155 155
   query27  2031318 331 318
   query28  3933203520292029
   query29  849 604 608 604
   query30  263 170 175 170
   query31  966 779 756 756
   query32  97  50  52  50
   query33  484 267 255 255
   query34  849 471 460 460
   query35  716 589 595 589
   query36  1055926 922 922
   query37  106 67  69  67
   query38  2898278527372737
   query39  858 781 792 781
   query40  194 124 120 120
   query41  48  42  42  42
   query42  103 95  100 95
   query43  584 572 541 541
   query44  1080722 751 722
   query45  183 164 167 164
   query46  1059703 783 703
   query47  1858179418151794
   query48  361 301 288 288
   query49  818 372 382 372
   query50  754 379 376 376
   query51  6870669768056697
   query52  102 88  90  88
   query53  347 275 291 275
   query54  534 433 416 416
   query55  74  74  72  72
   query56  249 236 263 236
   query57  1142105310661053
   query58  225 211 207 207
   query59  3397320732473207
   query60  309 248 244 244
   query61  85  89  84  84
   query62  588 458 443 443
   query63  303 279 278 278
   query64  8390221117541754
   query65  3203307930953079
   query66  785 319 326 319
   query67  15034   14646   14760   14646
   query68  4463529 530 529
   query69  436 259 274 259
   query70  1177106611631066
   query71  374 268 263 263
   query72  7700549127352735
   query73  704 321 326 321
   query74  6000569555935593
   query75  3303262626092609
   query76  2309991 968 968
   query77  388 272 267 267
   query78  10304   993497509750
   query79  2432506 496 496
   query80  1018432 425 425
   query81  533 244 242 242
   query82  127891  95  91
   query83  241 166 169 166
   query84  247 99  87  87
   query85  1287266 256 256
   query86  482 304 283 283
   query87  3347310431453104
   query88  4080235623402340
   query89  454 383 369 369
   query90  2067194 182 182
   query91  119 94  146 94
   query92  63  46  48  46
   query93  2677515 502 502
   query94  1308180 185 180
   query95  399 303 307 303
   query96  589 264 267 264
   query97  3187300030453000
   query98  244 223 217 217
   query99  871 855 855
   Total cold run time: 260648 ms
   Total hot run time: 168090 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the sp

Re: [PR] [feat](nereids) count prefix index in CBO [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #34970:
URL: https://github.com/apache/doris/pull/34970#issuecomment-2126376162

   
   
   TPC-H: Total hot run time: 41398 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 70233d22a874fdff9c14621cb0ca6d7a99a9bcf0, 
data reload: false
   
   -- Round 1 --
   q1   17977   686142504250
   q2   2033186 190 186
   q3   10607   113612191136
   q4   10390   842 794 794
   q5   7470273027162716
   q6   220 132 134 132
   q7   965 611 605 605
   q8   9212215420942094
   q9   9496672267046704
   q10  9610388739063887
   q11  480 237 240 237
   q12  462 226 220 220
   q13  17352   318332763183
   q14  258 220 220 220
   q15  509 475 475 475
   q16  501 385 393 385
   q17  986 653 661 653
   q18  8432791379177913
   q19  4691156815801568
   q20  662 326 326 326
   q21  5191343538823435
   q22  349 285 279 279
   Total cold run time: 117853 ms
   Total hot run time: 41398 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4582438144094381
   q2   369 270 274 270
   q3   3193290930022909
   q4   1887158915831583
   q5   5438549554845484
   q6   220 122 122 122
   q7   2189184618281828
   q8   3300342033553355
   q9   8717871986878687
   q10  3895373138263731
   q11  591 504 492 492
   q12  805 619 617 617
   q13  16292   314932273149
   q14  294 272 266 266
   q15  526 484 475 475
   q16  494 428 420 420
   q17  1758150814921492
   q18  7686760675117511
   q19  1658151315851513
   q20  2029180518021802
   q21  4883478147904781
   q22  579 485 487 485
   Total cold run time: 71385 ms
   Total hot run time: 55353 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [opt](fe) Adjust two default configuration for fe [doris]

2024-05-23 Thread via GitHub


SWJTU-ZhangLei opened a new pull request, #35276:
URL: https://github.com/apache/doris/pull/35276

   * replace `CMS` gc alogrithem with `G1`
   * set label keep time smaller by default
   
   ## Proposed changes
   
   Issue Number: close #xxx
   
   
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](fe) Adjust two default configuration for fe [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35276:
URL: https://github.com/apache/doris/pull/35276#issuecomment-2126377761

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Fix](Nereids) fix leading hint should have all tables in one query block (#33517) [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35272:
URL: https://github.com/apache/doris/pull/35272#issuecomment-2126381652

   
   
   TPC-H: Total hot run time: 50622 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 8326cefcc6588150badbaf64bdfa0319236856f5, 
data reload: false
   
   -- Round 1 --
   q1   17602   436143114311
   q2   2059148 145 145
   q3   10352   190619211906
   q4   10553   123013361230
   q5   8484425439833983
   q6   240 128 125 125
   q7   2111163416001600
   q8   9491273427212721
   q9   13934   10723   10581   10581
   q10  8638351535393515
   q11  420 246 244 244
   q12  472 290 305 290
   q13  19325   402040504020
   q14  355 330 335 330
   q15  515 482 465 465
   q16  676 567 582 567
   q17  1161979 941 941
   q18  7632725073037250
   q19  1770160515981598
   q20  533 306 304 304
   q21  4451416241034103
   q22  491 393 412 393
   Total cold run time: 121265 ms
   Total hot run time: 50622 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4390432643394326
   q2   334 240 220 220
   q3   4186413741504137
   q4   2728272227382722
   q5   7149715771317131
   q6   235 119 119 119
   q7   3163287328422842
   q8   4305444544714445
   q9   17317   16999   17098   16999
   q10  4255424042594240
   q11  731 704 680 680
   q12  1038851 874 851
   q13  6919374037293729
   q14  454 427 423 423
   q15  501 456 451 451
   q16  736 682 683 682
   q17  3816385237973797
   q18  8699875887768758
   q19  1719167616891676
   q20  2402209121182091
   q21  8374838083778377
   q22  1059964 904 904
   Total cold run time: 84510 ms
   Total hot run time: 79600 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [env](be) Change the compilation opt for ubsan. [doris]

2024-05-23 Thread via GitHub


Mryange opened a new pull request, #35277:
URL: https://github.com/apache/doris/pull/35277

   ## Proposed changes
   
   There are many errors related to strict aliasing and memory alignment.
   
   
   
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [env](be) Change the compilation opt for ubsan. [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35277:
URL: https://github.com/apache/doris/pull/35277#issuecomment-2126381973

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [minor](dependencies)binding a third-party Hadoop component to version 1.2.0 [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35093:
URL: https://github.com/apache/doris/pull/35093#issuecomment-2126382434

   
   
   ClickBench: Total hot run time: 30.14 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit b73f2549e45cb9928b4a39b084f4939152564e79, 
data reload: false
   
   query1   0.040.030.03
   query2   0.080.040.04
   query3   0.230.050.05
   query4   1.670.070.07
   query5   0.500.480.48
   query6   1.110.710.74
   query7   0.020.020.02
   query8   0.060.040.05
   query9   0.540.490.49
   query10  0.540.540.55
   query11  0.150.120.12
   query12  0.150.120.12
   query13  0.600.580.59
   query14  0.780.760.78
   query15  0.830.810.81
   query16  0.360.360.37
   query17  0.930.991.02
   query18  0.220.260.22
   query19  1.731.681.66
   query20  0.010.020.01
   query21  15.50   0.690.67
   query22  4.467.371.66
   query23  18.25   1.351.31
   query24  1.620.320.19
   query25  0.140.090.08
   query26  0.260.150.17
   query27  0.070.080.07
   query28  13.36   1.010.99
   query29  12.68   3.273.24
   query30  0.240.050.08
   query31  2.840.380.39
   query32  3.300.460.46
   query33  2.852.982.83
   query34  17.16   4.414.42
   query35  4.494.534.49
   query36  0.690.490.48
   query37  0.180.150.14
   query38  0.150.140.14
   query39  0.040.030.03
   query40  0.170.140.15
   query41  0.090.050.05
   query42  0.060.050.06
   query43  0.040.040.03
   Total cold run time: 109.19 s
   Total hot run time: 30.14 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](fe) Fix drop frontend cause `bdbje` and `fe memory` inconsistent state [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35203:
URL: https://github.com/apache/doris/pull/35203#issuecomment-2126387371

   
   
   TPC-H: Total hot run time: 39666 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 28eac70fa2dded64d0ee84d16361413e1d1a9608, 
data reload: false
   
   -- Round 1 --
   q1   17609   435742534253
   q2   2010190 195 190
   q3   10458   122111331133
   q4   10323   769 738 738
   q5   7751268026682668
   q6   224 135 138 135
   q7   975 619 603 603
   q8   9634208920802080
   q9   9274660864666466
   q10  8957375137313731
   q11  453 235 229 229
   q12  465 224 209 209
   q13  17758   294129792941
   q14  252 217 231 217
   q15  502 462 469 462
   q16  507 380 382 380
   q17  943 628 700 628
   q18  8175756375387538
   q19  2143152414451445
   q20  646 325 312 312
   q21  4968303439063034
   q22  353 281 274 274
   Total cold run time: 114380 ms
   Total hot run time: 39666 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4320421141854185
   q2   383 258 255 255
   q3   3001276227482748
   q4   1828155615621556
   q5   5230524752655247
   q6   210 121 127 121
   q7   2144178516791679
   q8   3149329332833283
   q9   8272832583118311
   q10  3852364737063647
   q11  597 493 477 477
   q12  732 607 576 576
   q13  16369   296429642964
   q14  293 249 255 249
   q15  510 480 472 472
   q16  460 420 414 414
   q17  1765148314711471
   q18  7802764775087508
   q19  3594157915331533
   q20  2039179217901790
   q21  4827462147654621
   q22  567 483 482 482
   Total cold run time: 71944 ms
   Total hot run time: 53589 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [env](be) Change the compilation opt for ubsan. [doris]

2024-05-23 Thread via GitHub


github-actions[bot] commented on PR #35277:
URL: https://github.com/apache/doris/pull/35277#issuecomment-2126390171

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [feat](nereids) count prefix index in CBO [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #34970:
URL: https://github.com/apache/doris/pull/34970#issuecomment-2126392558

   
   
   TPC-DS: Total hot run time: 172873 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 70233d22a874fdff9c14621cb0ca6d7a99a9bcf0, 
data reload: false
   
   query1   914 386 363 363
   query2   6451242824142414
   query3   6651208 210 208
   query4   19410   17370   17247   17247
   query5   4188421 421 421
   query6   240 156 147 147
   query7   4591298 289 289
   query8   235 192 183 183
   query9   8466237123572357
   query10  456 278 286 278
   query11  10660   10109   10084   10084
   query12  143 97  85  85
   query13  1638357 354 354
   query14  10088   755677057556
   query15  218 171 175 171
   query16  7701260 258 258
   query17  1710539 507 507
   query18  1937271 272 271
   query19  196 151 155 151
   query20  92  84  85  84
   query21  194 126 126 126
   query22  4261392139823921
   query23  33680   32999   33340   32999
   query24  6725289327972797
   query25  459 354 382 354
   query26  689 159 159 159
   query27  1908323 318 318
   query28  3866205220272027
   query29  834 623 602 602
   query30  241 180 173 173
   query31  936 761 762 761
   query32  60  51  56  51
   query33  503 272 264 264
   query34  843 489 489 489
   query35  699 625 618 618
   query36  1012930 947 930
   query37  107 73  71  71
   query38  2893278327902783
   query39  837 811 796 796
   query40  201 133 140 133
   query41  47  48  53  48
   query42  108 96  97  96
   query43  603 556 550 550
   query44  1067728 745 728
   query45  184 169 162 162
   query46  1060729 719 719
   query47  1847176217811762
   query48  365 296 284 284
   query49  761 372 387 372
   query50  781 387 383 383
   query51  6909670067996700
   query52  106 96  93  93
   query53  350 290 292 290
   query54  526 435 419 419
   query55  77  74  75  74
   query56  283 238 245 238
   query57  1139104210481042
   query58  242 214 215 214
   query59  3420342832193219
   query60  263 251 249 249
   query61  90  89  88  88
   query62  558 455 446 446
   query63  311 289 293 289
   query64  2521178817221722
   query65  3195310631343106
   query66  799 332 326 326
   query67  15244   14754   14779   14754
   query68  4588533 539 533
   query69  439 271 274 271
   query70  1142111611501116
   query71  350 263 268 263
   query72  7348542853725372
   query73  719 318 320 318
   query74  6046565356435643
   query75  3249265826142614
   query76  2259930 1064930
   query77  424 266 268 266
   query78  10229   979097179717
   query79  2479514 514 514
   query80  1114441 431 431
   query81  520 248 239 239
   query82  792 96  93  93
   query83  246 167 190 167
   query84  247 85  89  85
   query85  1060282 276 276
   query86  450 330 309 309
   query87  3295310830963096
   query88  4134233223722332
   query89  487 397 384 384
   query90  2086189 185 185
   query91  140 99  110 99
   query92  58  48  59  48
   query93  2035518 495 495
   query94  1187197 195 195
   query95  415 326 321 321
   query96  597 280 268 268
   query97  3185306330633063
   query98  248 220 222 220
   query99  1178837 850 837
   Total cold run time: 252535 ms
   Total hot run time: 172873 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the sp

Re: [PR] [feat](nereids) count prefix index in CBO [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #34970:
URL: https://github.com/apache/doris/pull/34970#issuecomment-2126401167

   
   
   ClickBench: Total hot run time: 30.03 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 70233d22a874fdff9c14621cb0ca6d7a99a9bcf0, 
data reload: false
   
   query1   0.040.040.03
   query2   0.080.040.04
   query3   0.230.050.06
   query4   1.670.080.09
   query5   0.520.490.53
   query6   1.120.730.72
   query7   0.020.010.02
   query8   0.050.050.05
   query9   0.530.480.50
   query10  0.540.550.54
   query11  0.160.110.12
   query12  0.150.120.12
   query13  0.610.600.61
   query14  0.770.770.76
   query15  0.830.800.81
   query16  0.350.370.36
   query17  1.021.011.01
   query18  0.220.240.24
   query19  1.871.741.73
   query20  0.020.010.00
   query21  15.43   0.720.69
   query22  4.567.841.26
   query23  18.31   1.431.36
   query24  1.700.210.26
   query25  0.150.080.08
   query26  0.260.160.17
   query27  0.080.070.07
   query28  13.30   1.020.99
   query29  13.30   3.273.27
   query30  0.270.080.08
   query31  2.840.390.37
   query32  3.310.470.47
   query33  2.872.862.90
   query34  17.10   4.434.42
   query35  4.504.474.55
   query36  0.660.460.46
   query37  0.170.160.15
   query38  0.150.140.14
   query39  0.050.040.04
   query40  0.150.140.14
   query41  0.090.040.04
   query42  0.050.050.04
   query43  0.040.040.04
   Total cold run time: 110.14 s
   Total hot run time: 30.03 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Fix](Nereids) fix leading hint should have all tables in one query block (#33517) [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35272:
URL: https://github.com/apache/doris/pull/35272#issuecomment-2126401736

   
   
   TPC-DS: Total hot run time: 203894 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 8326cefcc6588150badbaf64bdfa0319236856f5, 
data reload: false
   
   query1   929 384 369 369
   query2   6541287328682868
   query3   6914212 210 210
   query4   20021   18068   18174   18068
   query5   19730   657866366578
   query6   290 213 228 213
   query7   4157301 317 301
   query8   263 276 261 261
   query9   3087269526182618
   query10  441 303 310 303
   query11  11358   10728   10785   10728
   query12  119 74  83  74
   query13  5575690 667 667
   query14  17747   13463   13349   13349
   query15  362 214 222 214
   query16  6481268 256 256
   query17  17261485872 872
   query18  2293405 402 402
   query19  213 144 147 144
   query20  81  79  77  77
   query21  194 92  98  92
   query22  5219516250355035
   query23  32652   31859   31801   31801
   query24  6941644964846449
   query25  521 414 415 414
   query26  499 161 157 157
   query27  1770285 290 285
   query28  6216236323242324
   query29  2835270328002703
   query30  244 159 165 159
   query31  923 719 724 719
   query32  69  64  63  63
   query33  395 247 238 238
   query34  852 467 472 467
   query35  1144838 955 838
   query36  1401111611811116
   query37  88  60  59  59
   query38  3131293429152915
   query39  1358135113411341
   query40  206 99  93  93
   query41  40  40  36  36
   query42  84  84  84  84
   query43  678 744 755 744
   query44  1132711 710 710
   query45  240 229 232 229
   query46  1224948 948 948
   query47  1762167018551670
   query48  1019714 708 708
   query49  623 368 367 367
   query50  858 596 585 585
   query51  4772468747314687
   query52  95  76  84  76
   query53  444 324 315 315
   query54  2662245624522452
   query55  98  78  84  78
   query56  235 224 209 209
   query57  1152114211321132
   query58  215 198 181 181
   query59  4116392537723772
   query60  220 203 201 201
   query61  86  86  85  85
   query62  847 508 495 495
   query63  491 343 335 335
   query64  2484148814741474
   query65  3609355535323532
   query66  767 383 377 377
   query67  15672   16143   15709   15709
   query68  8302661 693 661
   query69  559 344 349 344
   query70  1691125514371255
   query71  383 307 308 307
   query72  6408342534613425
   query73  728 327 324 324
   query74  6276578558865785
   query75  4546372337123712
   query76  4740112611321126
   query77  622 247 262 247
   query78  12725   11871   12965   11871
   query79  11006   671 683 671
   query80  1395393 390 390
   query81  498 233 234 233
   query82  638 104 95  95
   query83  164 129 133 129
   query84  261 69  73  69
   query85  867 305 299 299
   query86  329 282 290 282
   query87  3248301530233015
   query88  4681237823732373
   query89  378 301 287 287
   query90  1930217 218 217
   query91  167 131 135 131
   query92  61  54  53  53
   query93  3685575 588 575
   query94  831 207 200 200
   query95  1119106810651065
   query96  638 326 338 326
   query97  6624641163536353
   query98  206 178 166 166
   query99  3124899 877 877
   Total cold run time: 309441 ms
   Total hot run time: 203894 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go t

Re: [PR] [fix](fe) Fix drop frontend cause `bdbje` and `fe memory` inconsistent state [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35203:
URL: https://github.com/apache/doris/pull/35203#issuecomment-2126405046

   
   
   TPC-DS: Total hot run time: 171461 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 28eac70fa2dded64d0ee84d16361413e1d1a9608, 
data reload: false
   
   query1   923 374 369 369
   query2   6467256923602360
   query3   6655208 205 205
   query4   19535   17606   17258   17258
   query5   4220418 418 418
   query6   257 170 156 156
   query7   4591300 285 285
   query8   257 189 186 186
   query9   8492237723472347
   query10  459 270 277 270
   query11  10613   10110   10151   10110
   query12  139 93  88  88
   query13  1650370 361 361
   query14  9300629868426298
   query15  216 172 172 172
   query16  7723272 269 269
   query17  1390534 518 518
   query18  1946273 269 269
   query19  197 155 150 150
   query20  90  85  83  83
   query21  192 128 131 128
   query22  4181426739063906
   query23  33762   32874   32909   32874
   query24  12396   275229612752
   query25  679 350 364 350
   query26  1854157 156 156
   query27  3070318 319 318
   query28  7755203520542035
   query29  1188625 586 586
   query30  273 172 172 172
   query31  980 761 776 761
   query32  90  54  52  52
   query33  760 270 263 263
   query34  1036478 459 459
   query35  720 592 610 592
   query36  1068921 941 921
   query37  276 69  70  69
   query38  2939278827772777
   query39  868 785 814 785
   query40  268 125 124 124
   query41  46  45  43  43
   query42  106 96  95  95
   query43  589 523 543 523
   query44  1302761 737 737
   query45  183 163 161 161
   query46  1069728 692 692
   query47  1876179617591759
   query48  379 285 297 285
   query49  1185383 387 383
   query50  769 376 381 376
   query51  6844669066746674
   query52  101 90  90  90
   query53  353 289 278 278
   query54  938 434 414 414
   query55  76  76  76  76
   query56  265 238 246 238
   query57  1169104010311031
   query58  232 209 213 209
   query59  3549329033343290
   query60  275 256 273 256
   query61  89  88  87  87
   query62  669 450 454 450
   query63  309 281 281 281
   query64  9788221118201820
   query65  3199309731463097
   query66  1374338 321 321
   query67  15279   14960   14907   14907
   query68  4539530 544 530
   query69  433 263 267 263
   query70  1147114910861086
   query71  409 275 261 261
   query72  7617540855745408
   query73  720 322 323 322
   query74  5982559355755575
   query75  3478259726152597
   query76  2745100810111008
   query77  390 281 265 265
   query78  10462   975098429750
   query79  2187518 515 515
   query80  1074434 431 431
   query81  519 242 244 242
   query82  642 92  100 92
   query83  243 169 166 166
   query84  236 85  91  85
   query85  1874272 265 265
   query86  506 309 314 309
   query87  3282317131073107
   query88  4180232823272327
   query89  475 405 389 389
   query90  1998184 185 184
   query91  127 96  98  96
   query92  64  49  52  49
   query93  2381504 492 492
   query94  1264186 183 183
   query95  399 314 308 308
   query96  588 269 261 261
   query97  3177299730352997
   query98  234 215 219 215
   query99  1205858 860 858
   Total cold run time: 276065 ms
   Total hot run time: 171461 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the s

Re: [PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35263:
URL: https://github.com/apache/doris/pull/35263#issuecomment-2126407761

   
   
   TPC-H: Total hot run time: 39933 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 54818c957cfdaf468330ca8cd7094bca623438d1, 
data reload: false
   
   -- Round 1 --
   q1   18062   444142944294
   q2   2595191 202 191
   q3   11139   118211571157
   q4   10516   843 780 780
   q5   7510281426732673
   q6   220 136 131 131
   q7   953 601 602 601
   q8   9310209920972097
   q9   8899646764466446
   q10  8916366836803668
   q11  449 244 227 227
   q12  407 221 212 212
   q13  17767   296329762963
   q14  259 217 223 217
   q15  515 459 463 459
   q16  498 390 382 382
   q17  956 707 664 664
   q18  8027750074597459
   q19  4094153314921492
   q20  644 292 296 292
   q21  4977379332603260
   q22  337 268 282 268
   Total cold run time: 117050 ms
   Total hot run time: 39933 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4314417541754175
   q2   364 253 263 253
   q3   2932279627812781
   q4   1830160015761576
   q5   5183524452575244
   q6   212 124 123 123
   q7   2076175317421742
   q8   3173331932963296
   q9   8348828282878282
   q10  3858368837063688
   q11  589 484 483 483
   q12  766 620 579 579
   q13  16441   299029872987
   q14  295 279 253 253
   q15  505 471 467 467
   q16  479 418 424 418
   q17  1784151914491449
   q18  7701748475377484
   q19  1655152815281528
   q20  1979176917851769
   q21  4850486047154715
   q22  588 496 479 479
   Total cold run time: 69922 ms
   Total hot run time: 53771 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Fix](Nereids) fix leading hint should have all tables in one query block (#33517) [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35272:
URL: https://github.com/apache/doris/pull/35272#issuecomment-2126410836

   
   
   ClickBench: Total hot run time: 31.29 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 8326cefcc6588150badbaf64bdfa0319236856f5, 
data reload: false
   
   query1   0.020.020.02
   query2   0.060.030.02
   query3   0.250.050.05
   query4   1.790.080.10
   query5   0.530.530.52
   query6   1.240.610.61
   query7   0.020.010.01
   query8   0.030.020.02
   query9   0.520.490.48
   query10  0.530.550.51
   query11  0.120.080.09
   query12  0.110.080.08
   query13  0.630.620.61
   query14  0.780.800.79
   query15  0.790.770.78
   query16  0.360.350.36
   query17  1.010.940.98
   query18  0.230.220.25
   query19  1.911.821.84
   query20  0.020.010.01
   query21  15.47   0.580.54
   query22  2.002.442.06
   query23  17.26   0.970.99
   query24  7.561.091.06
   query25  0.380.090.06
   query26  0.800.150.14
   query27  0.050.030.03
   query28  5.470.730.72
   query29  12.76   2.342.35
   query30  0.510.510.53
   query31  2.800.380.37
   query32  3.400.500.49
   query33  3.073.103.09
   query34  15.27   4.794.83
   query35  4.864.874.87
   query36  1.061.021.02
   query37  0.060.050.04
   query38  0.040.020.02
   query39  0.010.010.02
   query40  0.160.150.14
   query41  0.060.010.02
   query42  0.020.010.01
   query43  0.020.010.02
   Total cold run time: 104.04 s
   Total hot run time: 31.29 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [refactor](query) Make query finish with context released safely [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35248:
URL: https://github.com/apache/doris/pull/35248#issuecomment-2126413250

   
   
   TPC-H: Total hot run time: 41380 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit c9ee12775683d2ce3e95e7e799521b9b5c9b96b4, 
data reload: false
   
   -- Round 1 --
   q1   17605   439542044204
   q2   2023185 193 185
   q3   10457   120412081204
   q4   10198   777 894 777
   q5   7479282727702770
   q6   216 131 137 131
   q7   972 613 614 613
   q8   9263220321252125
   q9   9840681667866786
   q10  9457398138523852
   q11  448 247 242 242
   q12  447 227 229 227
   q13  17553   326831533153
   q14  249 224 209 209
   q15  518 479 465 465
   q16  525 414 401 401
   q17  980 699 735 699
   q18  8534788679407886
   q19  3226158315241524
   q20  639 313 319 313
   q21  5234408933403340
   q22  346 275 274 274
   Total cold run time: 116209 ms
   Total hot run time: 41380 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4545443743814381
   q2   378 292 287 287
   q3   3199297527712771
   q4   1909156816591568
   q5   5498550155175501
   q6   219 127 126 126
   q7   2165181818631818
   q8   3244343133863386
   q9   8612873486318631
   q10  3882378438103784
   q11  605 498 482 482
   q12  797 647 637 637
   q13  16710   318531953185
   q14  298 276 268 268
   q15  526 478 473 473
   q16  479 414 424 414
   q17  1781145514671455
   q18  7757762074637463
   q19  2251151115851511
   q20  2013178717641764
   q21  10350   469347174693
   q22  553 491 502 491
   Total cold run time: 1 ms
   Total hot run time: 55089 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](fe) Fix drop frontend cause `bdbje` and `fe memory` inconsistent state [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35203:
URL: https://github.com/apache/doris/pull/35203#issuecomment-2126414181

   
   
   ClickBench: Total hot run time: 29.81 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 28eac70fa2dded64d0ee84d16361413e1d1a9608, 
data reload: false
   
   query1   0.040.030.04
   query2   0.080.030.03
   query3   0.220.050.05
   query4   1.690.060.07
   query5   0.470.500.49
   query6   1.120.720.73
   query7   0.020.010.02
   query8   0.050.040.04
   query9   0.540.490.50
   query10  0.550.540.54
   query11  0.160.110.11
   query12  0.140.120.12
   query13  0.600.600.60
   query14  0.760.770.77
   query15  0.830.800.79
   query16  0.350.370.34
   query17  0.960.961.04
   query18  0.220.240.25
   query19  1.851.751.67
   query20  0.010.000.01
   query21  15.73   0.670.66
   query22  4.697.341.48
   query23  18.27   1.331.22
   query24  1.440.360.22
   query25  0.150.080.08
   query26  0.250.160.17
   query27  0.080.080.08
   query28  13.37   1.010.99
   query29  13.20   3.283.22
   query30  0.240.060.06
   query31  2.860.390.38
   query32  3.320.470.46
   query33  2.882.862.93
   query34  17.16   4.364.37
   query35  4.494.544.48
   query36  0.670.470.50
   query37  0.180.150.16
   query38  0.150.160.14
   query39  0.040.040.03
   query40  0.170.140.16
   query41  0.080.040.04
   query42  0.050.050.04
   query43  0.040.030.04
   Total cold run time: 110.17 s
   Total hot run time: 29.81 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Fix](Nereids) fix leading hint should have all tables in one query block (#33517) [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35272:
URL: https://github.com/apache/doris/pull/35272#issuecomment-2126416101

   
   Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   ```
   Load test result on commit 8326cefcc6588150badbaf64bdfa0319236856f5 with 
default session variables
   Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
   Stream load orc:  58 seconds loaded 1101869774 Bytes, about 18 MB/s
   Stream load parquet:  31 seconds loaded 861443392 Bytes, about 26 MB/s
   Insert into select:   21.3 seconds inserted 1000 Rows, about 469K 
ops/s
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [fix](httpapi) restore compaction/run_status api can show be's overall compaction status and refactor code [doris]

2024-05-23 Thread via GitHub


Yulei-Yang opened a new pull request, #35278:
URL: https://github.com/apache/doris/pull/35278

   ## Proposed changes
   
   Issue: http api compaction/run_status without parameter does not work now, 
like below:
   ```sql
   curl -X GET http://localhost:8040/api/compaction/run_status
 % Total% Received % Xferd  Average Speed   TimeTime Time  
Current
Dload  Upload   Total   SpentLeft  Speed
 0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 
0{
   "status": "INTERNAL_ERROR",
   "msg": "tablet id and table id can not be empty at the same time!"
   ```
   
   
   
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](httpapi) restore compaction/run_status api can show be's overall compaction status and refactor code [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35278:
URL: https://github.com/apache/doris/pull/35278#issuecomment-2126418053

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [regression-test](load) add something like $.tag.[a.b] key's json case [doris]

2024-05-23 Thread via GitHub


felixwluo commented on PR #35134:
URL: https://github.com/apache/doris/pull/35134#issuecomment-2126418102

   run p0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](httpapi) restore compaction/run_status api can show be's overall compaction status and refactor code [doris]

2024-05-23 Thread via GitHub


Yulei-Yang commented on PR #35278:
URL: https://github.com/apache/doris/pull/35278#issuecomment-2126419250

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](routine-load) use backoff algorithm in auto resume [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35266:
URL: https://github.com/apache/doris/pull/35266#issuecomment-2126421677

   
   
   TPC-H: Total hot run time: 41657 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 15416770af32580da3cefd3106aad66c7f7c9d8b, 
data reload: false
   
   -- Round 1 --
   q1   17618   425141694169
   q2   2000191 188 188
   q3   10454   123611881188
   q4   10191   792 767 767
   q5   7477275127092709
   q6   216 131 137 131
   q7   961 592 618 592
   q8   9226213320842084
   q9   9174672666596659
   q10  9328397038433843
   q11  427 249 244 244
   q12  517 224 230 224
   q13  17395   319333193193
   q14  272 211 228 211
   q15  512 476 472 472
   q16  486 405 387 387
   q17  973 689 705 689
   q18  8416788677937793
   q19  5748159215291529
   q20  634 316 317 316
   q21  5180399240333992
   q22  347 277 284 277
   Total cold run time: 117552 ms
   Total hot run time: 41657 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4539440443944394
   q2   401 275 271 271
   q3   3170295927252725
   q4   1876158116261581
   q5   5475548054815480
   q6   221 126 126 126
   q7   2233182218161816
   q8   3226334433843344
   q9   8667869686068606
   q10  3940386538043804
   q11  600 485 485 485
   q12  824 638 625 625
   q13  16060   313231773132
   q14  300 275 262 262
   q15  521 486 495 486
   q16  485 447 423 423
   q17  1755147814631463
   q18  7716759374407440
   q19  1699153715381537
   q20  2003180617761776
   q21  5013471347894713
   q22  572 482 501 482
   Total cold run time: 71296 ms
   Total hot run time: 54971 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35263:
URL: https://github.com/apache/doris/pull/35263#issuecomment-2126426036

   
   
   TPC-DS: Total hot run time: 169617 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 54818c957cfdaf468330ca8cd7094bca623438d1, 
data reload: false
   
   query1   912 383 370 370
   query2   6465236322452245
   query3   6657208 206 206
   query4   20798   17320   17359   17320
   query5   4223417 414 414
   query6   255 151 150 150
   query7   4583299 290 290
   query8   238 187 183 183
   query9   8452236223252325
   query10  450 276 255 255
   query11  10564   10158   10013   10013
   query12  131 87  92  87
   query13  1634376 369 369
   query14  9255699573986995
   query15  213 167 169 167
   query16  7827260 258 258
   query17  1849521 513 513
   query18  1959285 279 279
   query19  209 159 184 159
   query20  92  87  82  82
   query21  198 129 129 129
   query22  4242405439763976
   query23  33640   33023   32968   32968
   query24  11979   279727762776
   query25  678 348 361 348
   query26  1813151 152 151
   query27  3024314 316 314
   query28  7659206420332033
   query29  1136600 591 591
   query30  270 169 170 169
   query31  981 745 765 745
   query32  92  54  55  54
   query33  759 270 277 270
   query34  1006471 481 471
   query35  746 621 598 598
   query36  1072922 921 921
   query37  282 75  75  75
   query38  2876276527832765
   query39  866 803 787 787
   query40  264 124 122 122
   query41  49  50  43  43
   query42  101 95  95  95
   query43  581 574 529 529
   query44  1191736 746 736
   query45  171 165 162 162
   query46  1081743 689 689
   query47  1832179217771777
   query48  373 299 300 299
   query49  1192378 385 378
   query50  789 388 382 382
   query51  6938688967576757
   query52  105 92  92  92
   query53  347 292 290 290
   query54  987 435 425 425
   query55  71  99  73  73
   query56  251 237 250 237
   query57  1150103710351035
   query58  232 225 203 203
   query59  3604327531423142
   query60  277 254 251 251
   query61  89  101 87  87
   query62  662 464 456 456
   query63  310 278 283 278
   query64  9846217916971697
   query65  3205309631213096
   query66  1381338 323 323
   query67  15492   14921   14910   14910
   query68  4621554 545 545
   query69  431 261 262 261
   query70  1113114511711145
   query71  395 270 273 270
   query72  7653519627552755
   query73  712 323 321 321
   query74  5961556055435543
   query75  3357267126422642
   query76  2538925 952 925
   query77  406 261 263 261
   query78  10313   992510014   9925
   query79  2661526 513 513
   query80  1071435 429 429
   query81  522 244 245 244
   query82  712 93  95  93
   query83  265 166 169 166
   query84  238 86  84  84
   query85  1672283 267 267
   query86  512 297 303 297
   query87  3291309631013096
   query88  4282243924422439
   query89  501 390 390 390
   query90  1969190 192 190
   query91  125 97  97  97
   query92  67  49  49  49
   query93  1976513 505 505
   query94  1224184 187 184
   query95  403 315 309 309
   query96  601 275 272 272
   query97  3207295930782959
   query98  242 214 212 212
   query99  1108844 844 844
   Total cold run time: 276805 ms
   Total hot run time: 169617 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the sp

Re: [PR] [fix](httpapi) restore compaction/run_status api can show be's overall compaction status and refactor code [doris]

2024-05-23 Thread via GitHub


github-actions[bot] commented on PR #35278:
URL: https://github.com/apache/doris/pull/35278#issuecomment-2126428708

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [refactor](query) Make query finish with context released safely [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35248:
URL: https://github.com/apache/doris/pull/35248#issuecomment-2126431501

   
   
   TPC-DS: Total hot run time: 168485 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit c9ee12775683d2ce3e95e7e799521b9b5c9b96b4, 
data reload: false
   
   query1   919 393 378 378
   query2   6443259423832383
   query3   6664212 208 208
   query4   20117   17361   17313   17313
   query5   4157421 412 412
   query6   246 164 154 154
   query7   4581305 289 289
   query8   242 189 181 181
   query9   8417239023452345
   query10  451 271 258 258
   query11  10507   10056   10061   10056
   query12  131 96  87  87
   query13  1646371 371 371
   query14  10078   681859425942
   query15  201 172 174 172
   query16  7717277 257 257
   query17  1369514 531 514
   query18  2206270 264 264
   query19  198 155 155 155
   query20  93  84  83  83
   query21  195 132 123 123
   query22  4306409939213921
   query23  33522   33007   33168   33007
   query24  9545282828072807
   query25  568 357 372 357
   query26  702 158 159 158
   query27  2200313 322 313
   query28  5852205920492049
   query29  860 611 591 591
   query30  277 173 175 173
   query31  969 750 752 750
   query32  90  52  54  52
   query33  661 284 306 284
   query34  852 480 497 480
   query35  704 597 608 597
   query36  1084920 926 920
   query37  110 67  71  67
   query38  2872278827602760
   query39  856 774 806 774
   query40  199 122 122 122
   query41  44  42  42  42
   query42  103 97  97  97
   query43  600 586 553 553
   query44  1062726 727 726
   query45  181 163 163 163
   query46  1067736 723 723
   query47  1865176217751762
   query48  368 299 309 299
   query49  852 381 399 381
   query50  769 392 375 375
   query51  6870684267996799
   query52  110 86  91  86
   query53  349 288 283 283
   query54  822 424 419 419
   query55  75  74  73  73
   query56  257 238 259 238
   query57  1128105210361036
   query58  229 208 213 208
   query59  3517333432433243
   query60  281 254 249 249
   query61  86  88  86  86
   query62  602 459 446 446
   query63  306 282 281 281
   query64  8463227717171717
   query65  3156308930803080
   query66  773 350 321 321
   query67  15106   14934   14869   14869
   query68  4627541 535 535
   query69  509 267 271 267
   query70  1133113011381130
   query71  392 262 258 258
   query72  7921270625672567
   query73  714 332 327 327
   query74  6069564355775577
   query75  3331262826262626
   query76  2933972 947 947
   query77  611 265 271 265
   query78  10175   971697229716
   query79  2284524 522 522
   query80  948 438 427 427
   query81  544 238 242 238
   query82  1060100 96  96
   query83  243 175 176 175
   query84  249 84  86  84
   query85  1474271 261 261
   query86  457 290 300 290
   query87  3306309630823082
   query88  4156236823742368
   query89  500 396 379 379
   query90  2018197 191 191
   query91  136 119 106 106
   query92  62  50  50  50
   query93  2427518 577 518
   query94  1282186 182 182
   query95  391 318 306 306
   query96  589 265 268 265
   query97  3197300530053005
   query98  260 219 215 215
   query99  1138854 828 828
   Total cold run time: 266984 ms
   Total hot run time: 168485 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the s

Re: [PR] [opt](memory) BE process exceed memory limit will reject new Query execution [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35263:
URL: https://github.com/apache/doris/pull/35263#issuecomment-2126436036

   
   
   ClickBench: Total hot run time: 30.14 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 54818c957cfdaf468330ca8cd7094bca623438d1, 
data reload: false
   
   query1   0.040.030.03
   query2   0.080.040.05
   query3   0.230.050.05
   query4   1.680.070.08
   query5   0.500.480.52
   query6   1.130.720.72
   query7   0.020.010.01
   query8   0.050.040.03
   query9   0.540.500.49
   query10  0.540.560.54
   query11  0.160.100.11
   query12  0.140.120.12
   query13  0.590.580.60
   query14  0.790.780.77
   query15  0.830.800.80
   query16  0.360.370.36
   query17  1.010.991.01
   query18  0.210.230.25
   query19  1.891.681.63
   query20  0.010.010.01
   query21  15.63   0.670.64
   query22  4.077.911.79
   query23  18.26   1.331.18
   query24  1.680.280.21
   query25  0.140.090.09
   query26  0.260.160.17
   query27  0.080.080.07
   query28  13.36   1.031.00
   query29  13.17   3.273.24
   query30  0.240.060.05
   query31  2.870.380.38
   query32  3.320.470.47
   query33  2.872.902.90
   query34  17.01   4.434.40
   query35  4.534.504.47
   query36  0.640.460.46
   query37  0.180.150.16
   query38  0.150.140.15
   query39  0.050.030.04
   query40  0.160.140.17
   query41  0.080.050.04
   query42  0.060.040.05
   query43  0.040.040.04
   Total cold run time: 109.65 s
   Total hot run time: 30.14 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](httpapi) restore compaction/run_status api can show be's overall compaction status and refactor code [doris]

2024-05-23 Thread via GitHub


Yulei-Yang commented on PR #35278:
URL: https://github.com/apache/doris/pull/35278#issuecomment-2126438557

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](httpapi) restore compaction/run_status api can show be's overall compaction status and refactor code [doris]

2024-05-23 Thread via GitHub


github-actions[bot] commented on PR #35278:
URL: https://github.com/apache/doris/pull/35278#issuecomment-2126439949

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Bug](udtf) fix udtf core dump use as normal function [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35235:
URL: https://github.com/apache/doris/pull/35235#issuecomment-2126440391

   TeamCity be ut coverage result:
Function Coverage: 35.66% (9015/25277) 
Line Coverage: 27.31% (74532/272897)
Region Coverage: 26.55% (38581/145315)
Branch Coverage: 23.40% (19679/84092)
Coverage Report: 
http://coverage.selectdb-in.cc/coverage/4875554c86c062240c1735d40e88b78602d82fe4_4875554c86c062240c1735d40e88b78602d82fe4/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](routine-load) use backoff algorithm in auto resume [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35266:
URL: https://github.com/apache/doris/pull/35266#issuecomment-2126440672

   
   
   TPC-DS: Total hot run time: 173065 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 15416770af32580da3cefd3106aad66c7f7c9d8b, 
data reload: false
   
   query1   925 370 363 363
   query2   6441256223682368
   query3   6643221 209 209
   query4   19244   17277   17203   17203
   query5   4158426 422 422
   query6   253 155 159 155
   query7   4657304 288 288
   query8   242 192 203 192
   query9   8705236223392339
   query10  461 281 271 271
   query11  10646   10058   10054   10054
   query12  142 108 86  86
   query13  1626364 363 363
   query14  10202   766077717660
   query15  219 173 178 173
   query16  7709284 259 259
   query17  1696519 500 500
   query18  1814266 264 264
   query19  197 154 157 154
   query20  90  84  88  84
   query21  202 138 136 136
   query22  4344393839403938
   query23  33750   32957   33024   32957
   query24  6904286427812781
   query25  580 353 375 353
   query26  704 153 153 153
   query27  2135316 331 316
   query28  4472203420472034
   query29  878 612 603 603
   query30  258 173 175 173
   query31  969 756 742 742
   query32  90  53  57  53
   query33  514 257 261 257
   query34  870 468 477 468
   query35  699 625 620 620
   query36  1064939 879 879
   query37  116 74  72  72
   query38  2901281828042804
   query39  837 792 799 792
   query40  194 123 126 123
   query41  43  41  44  41
   query42  104 94  98  94
   query43  590 554 554 554
   query44  1061715 729 715
   query45  175 170 164 164
   query46  1059732 720 720
   query47  1836176817641764
   query48  370 303 306 303
   query49  839 375 387 375
   query50  769 383 384 383
   query51  6877679967346734
   query52  108 90  93  90
   query53  361 294 290 290
   query54  542 427 423 423
   query55  77  74  73  73
   query56  262 268 254 254
   query57  1140106110771061
   query58  224 211 225 211
   query59  3379314732893147
   query60  274 252 251 251
   query61  93  85  86  85
   query62  600 466 444 444
   query63  314 289 290 289
   query64  8504229117901790
   query65  3162310531313105
   query66  816 321 319 319
   query67  15335   14744   14941   14744
   query68  4517531 536 531
   query69  436 268 266 266
   query70  1184113411181118
   query71  367 275 261 261
   query72  7570575353875387
   query73  720 322 319 319
   query74  6015557456045574
   query75  3298262626372626
   query76  2333106511631065
   query77  393 271 267 267
   query78  10213   10041   99699969
   query79  1505509 527 509
   query80  1050442 427 427
   query81  548 241 242 241
   query82  957 98  95  95
   query83  239 170 171 170
   query84  245 88  86  86
   query85  902 264 261 261
   query86  384 289 299 289
   query87  3361312731373127
   query88  3109232523312325
   query89  488 408 404 404
   query90  1983186 189 186
   query91  177 97  96  96
   query92  59  49  50  49
   query93  1114514 494 494
   query94  1014185 185 185
   query95  414 308 317 308
   query96  570 265 273 265
   query97  3219304531083045
   query98  242 214 209 209
   query99  1181827 839 827
   Total cold run time: 257272 ms
   Total hot run time: 173065 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the s

Re: [PR] [refactor](query) Make query finish with context released safely [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35248:
URL: https://github.com/apache/doris/pull/35248#issuecomment-2126441647

   
   
   ClickBench: Total hot run time: 30.59 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit c9ee12775683d2ce3e95e7e799521b9b5c9b96b4, 
data reload: false
   
   query1   0.040.030.03
   query2   0.070.040.04
   query3   0.230.050.05
   query4   1.680.060.06
   query5   0.500.480.50
   query6   1.150.730.72
   query7   0.010.010.01
   query8   0.050.040.04
   query9   0.540.480.48
   query10  0.540.560.55
   query11  0.150.110.11
   query12  0.150.110.12
   query13  0.600.580.60
   query14  0.770.770.76
   query15  0.820.800.80
   query16  0.370.350.35
   query17  0.940.971.01
   query18  0.230.210.27
   query19  1.871.761.68
   query20  0.010.010.01
   query21  15.75   0.680.68
   query22  4.477.152.04
   query23  18.25   1.441.28
   query24  1.710.300.22
   query25  0.150.080.09
   query26  0.270.170.17
   query27  0.080.080.08
   query28  13.25   1.020.99
   query29  13.78   3.273.27
   query30  0.240.060.06
   query31  2.870.380.37
   query32  3.290.460.46
   query33  2.922.882.88
   query34  17.21   4.414.43
   query35  4.504.524.65
   query36  0.650.460.46
   query37  0.170.150.15
   query38  0.160.140.14
   query39  0.040.040.03
   query40  0.160.140.14
   query41  0.100.050.04
   query42  0.060.050.05
   query43  0.030.030.04
   Total cold run time: 110.83 s
   Total hot run time: 30.59 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [improvement](DDL)Automatically convert string type partition into varchar(65533) [doris]

2024-05-23 Thread via GitHub


wuwenchi opened a new pull request, #35279:
URL: https://github.com/apache/doris/pull/35279

   ## Proposed changes
   
   ### problem
   The current partition type of doris does not support string, If you use the 
string type as a partition field, an error will be reported.
   like:
   1. CREATE TABLE :
   ```
   mysql> create table tb2 (id int, val string) DUPLICATE KEY(`id`) auto 
partition by list (val)() DISTRIBUTED BY HASH(`id`) BUCKETS 1  
properties("replication_num" = "1");
   
   ERROR 1105 (HY000): errCode = 2, detailMessage = String Type should not be 
used in partition column[val].
   ```
   2. CTAS :
   ```
   mysql> use hive_emr.mmc_hive;
   
   mysql> create table tb11 (id int, val string, val2 string);
   Query OK, 0 rows affected (0.04 sec)
   
   mysql> insert into tb11 values (1, 'a', 'a');
   Query OK, 1 row affected (0.13 sec)
   {'status':'COMMITTED', 'txnId':'55029'}
   
   mysql> use internal.doris;
   
   mysql> create table tb3 auto partition by list (val)() 
properties("replication_num" = "1") as select * from hive_emr.mmc_hive.tb11;
   
   ERROR 1105 (HY000): errCode = 2, detailMessage = String Type should not be 
used in partition column[val].
   ```
   ### solution
   This PR supports automatic conversion of string to varchar(65533),
   so, when using a CTAS table and using string for partitioning, it can still 
be successful.
   like:
   1. create table:
   ```
   mysql> create table tb2 (id int, val string) DUPLICATE KEY(`id`) auto 
partition by list (val)() DISTRIBUTED BY HASH(`id`) BUCKETS 1  
properties("replication_num" = "1");
   Query OK, 0 rows affected (0.01 sec)
   
   mysql> desc tb2;
   +---++--+---+-+---+
   | Field | Type   | Null | Key   | Default | Extra |
   +---++--+---+-+---+
   | id| INT| Yes  | true  | NULL|   |
   | val   | VARCHAR(65533) | Yes  | false | NULL| NONE  |
   +---++--+---+-+---+
   2 rows in set (0.00 sec)
   ```
   
   2. CTAS
   ```
   mysql> create table tb3 auto partition by list (val)() 
properties("replication_num" = "1") as select * from hive_emr.mmc_hive.tb11;
   Query OK, 1 row affected (0.25 sec)
   {'label':'label_e6a6e62b4ee543d2_8fb42e7b1c829f6f', 'status':'VISIBLE', 
'txnId':'11013'}
   
   mysql> desc tb3;
   +---++--+---+-+---+
   | Field | Type   | Null | Key   | Default | Extra |
   +---++--+---+-+---+
   | id| INT| Yes  | true  | NULL|   |
   | val   | VARCHAR(65533) | Yes  | true  | NULL|   |
   | val2  | TEXT   | Yes  | false | NULL| NONE  |
   +---++--+---+-+---+
   3 rows in set (0.01 sec)
   
   mysql> select * from tb3;
   +--+--+--+
   | id   | val  | val2 |
   +--+--+--+
   |1 | a| a|
   +--+--+--+
   1 row in set (0.05 sec)
   ```
   
   
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improvement](DDL)Automatically convert string type partition into varchar(65533) [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35279:
URL: https://github.com/apache/doris/pull/35279#issuecomment-2126446373

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improvement](DDL)Automatically convert string type partition into varchar(65533) [doris]

2024-05-23 Thread via GitHub


wuwenchi commented on PR #35279:
URL: https://github.com/apache/doris/pull/35279#issuecomment-2126450472

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](routine-load) use backoff algorithm in auto resume [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35266:
URL: https://github.com/apache/doris/pull/35266#issuecomment-2126452303

   
   
   ClickBench: Total hot run time: 29.95 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 15416770af32580da3cefd3106aad66c7f7c9d8b, 
data reload: false
   
   query1   0.040.040.03
   query2   0.080.040.04
   query3   0.230.050.06
   query4   1.660.080.08
   query5   0.500.500.51
   query6   1.130.720.72
   query7   0.020.010.02
   query8   0.060.050.04
   query9   0.530.470.49
   query10  0.550.540.54
   query11  0.160.110.11
   query12  0.140.110.12
   query13  0.610.600.60
   query14  0.780.780.78
   query15  0.830.800.80
   query16  0.360.370.38
   query17  0.971.001.00
   query18  0.230.210.26
   query19  1.881.741.79
   query20  0.010.010.02
   query21  15.56   0.690.67
   query22  4.077.651.40
   query23  18.26   1.401.18
   query24  1.710.290.23
   query25  0.140.080.08
   query26  0.270.160.16
   query27  0.080.070.08
   query28  13.29   0.991.00
   query29  12.91   3.323.25
   query30  0.240.060.05
   query31  2.870.380.38
   query32  3.300.470.46
   query33  2.932.902.89
   query34  17.10   4.404.46
   query35  4.474.494.53
   query36  0.670.480.46
   query37  0.170.160.15
   query38  0.150.150.14
   query39  0.040.040.04
   query40  0.160.130.15
   query41  0.090.050.04
   query42  0.050.040.05
   query43  0.040.040.04
   Total cold run time: 109.34 s
   Total hot run time: 29.95 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [Fix](inverted index) fix bkd index file is empty error status [doris]

2024-05-23 Thread via GitHub


airborne12 opened a new pull request, #35280:
URL: https://github.com/apache/doris/pull/35280

   ## Proposed changes
   
   Issue Number: close #xxx
   
   
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Fix](inverted index) fix bkd index file is empty error status [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35280:
URL: https://github.com/apache/doris/pull/35280#issuecomment-2126461132

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Fix](inverted index) fix bkd index file is empty error status [doris]

2024-05-23 Thread via GitHub


airborne12 commented on PR #35280:
URL: https://github.com/apache/doris/pull/35280#issuecomment-2126461599

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](httpapi) restore compaction/run_status api can show be's overall compaction status and refactor code [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35278:
URL: https://github.com/apache/doris/pull/35278#issuecomment-2126473492

   
   
   TPC-H: Total hot run time: 40469 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 90458f95e2521f79d817b8bb8115199e2f7af36b, 
data reload: false
   
   -- Round 1 --
   q1   17560   439342294229
   q2   2021194 190 190
   q3   10483   126412001200
   q4   10149   752 785 752
   q5   7451265425742574
   q6   216 131 133 131
   q7   954 610 621 610
   q8   9231206320862063
   q9   8999651564826482
   q10  8922370637293706
   q11  521 240 241 240
   q12  471 239 221 221
   q13  18633   298129862981
   q14  266 224 225 224
   q15  507 475 485 475
   q16  509 391 380 380
   q17  972 688 787 688
   q18  8126758474097409
   q19  7664157315261526
   q20  670 313 312 312
   q21  4972379839713798
   q22  342 280 278 278
   Total cold run time: 119639 ms
   Total hot run time: 40469 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4399432842134213
   q2   368 274 272 272
   q3   2979273427942734
   q4   1871157315861573
   q5   5247526852725268
   q6   215 128 128 128
   q7   2118174017761740
   q8   3224334833463346
   q9   8319827783518277
   q10  3902366036893660
   q11  568 498 494 494
   q12  777 645 622 622
   q13  17407   299030042990
   q14  301 268 276 268
   q15  528 474 462 462
   q16  494 418 413 413
   q17  1778148214611461
   q18  7853758175277527
   q19  1663158815851585
   q20  1976177917931779
   q21  4959483647254725
   q22  578 504 464 464
   Total cold run time: 71524 ms
   Total hot run time: 54001 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](httpapi) restore compaction/run_status api can show be's overall compaction status and refactor code [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35278:
URL: https://github.com/apache/doris/pull/35278#issuecomment-2126473143

   TeamCity be ut coverage result:
Function Coverage: 35.66% (9014/25279) 
Line Coverage: 27.31% (74527/272913)
Region Coverage: 26.54% (38574/145331)
Branch Coverage: 23.40% (19677/84100)
Coverage Report: 
http://coverage.selectdb-in.cc/coverage/90458f95e2521f79d817b8bb8115199e2f7af36b_90458f95e2521f79d817b8bb8115199e2f7af36b/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](inverted index) nonConcurrent is added to the test case [doris]

2024-05-23 Thread via GitHub


qidaye merged PR #35259:
URL: https://github.com/apache/doris/pull/35259


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch master updated (936e0cc1fdd -> 133454dd963)

2024-05-23 Thread jianliangqi
This is an automated email from the ASF dual-hosted git repository.

jianliangqi pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git


from 936e0cc1fdd [fix](overflow) show backends overflow for backend ids 
(#35245)
 add 133454dd963 [test](inverted index) nonConcurrent is added to the test 
case (#35259)

No new revisions were added by this update.

Summary of changes:
 .../fault_injection_p0/test_index_lowercase_fault_injection.groovy  | 2 +-
 .../suites/fault_injection_p0/test_index_mow_fault_injection.groovy | 2 +-
 2 files changed, 2 insertions(+), 2 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch master updated (133454dd963 -> 5bcc542f00e)

2024-05-23 Thread jianliangqi
This is an automated email from the ASF dual-hosted git repository.

jianliangqi pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git


from 133454dd963 [test](inverted index) nonConcurrent is added to the test 
case (#35259)
 add 5bcc542f00e [optimize](regression)Add retry for curl request (#35260)

No new revisions were added by this update.

Summary of changes:
 .../plugins/plugin_curl_requester.groovy   | 32 +++---
 1 file changed, 28 insertions(+), 4 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [optimize](regression)Add retry for curl request [doris]

2024-05-23 Thread via GitHub


github-actions[bot] commented on PR #35260:
URL: https://github.com/apache/doris/pull/35260#issuecomment-2126482010

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [optimize](regression)Add retry for curl request [doris]

2024-05-23 Thread via GitHub


qidaye merged PR #35260:
URL: https://github.com/apache/doris/pull/35260


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [fix](httpapi) restore compaction/run_status api can show be's overall compaction status and refactor code [doris]

2024-05-23 Thread via GitHub


Yulei-Yang opened a new pull request, #35281:
URL: https://github.com/apache/doris/pull/35281

   bp #35278
   
   
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](httpapi) restore compaction/run_status api can show be's overall compaction status and refactor code [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35281:
URL: https://github.com/apache/doris/pull/35281#issuecomment-2126485058

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improvement](DDL)Automatically convert string type partition into varchar(65533) [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35279:
URL: https://github.com/apache/doris/pull/35279#issuecomment-2126485519

   
   
   TPC-H: Total hot run time: 40179 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit a971445a514b6c401de4446ee2b08fed2a2c5bff, 
data reload: false
   
   -- Round 1 --
   q1   17613   432042004200
   q2   2016187 193 187
   q3   10851   131513051305
   q4   10541   868 799 799
   q5   9037270727062706
   q6   219 136 140 136
   q7   979 604 606 604
   q8   9359211121032103
   q9   9453664566106610
   q10  9369371337453713
   q11  446 235 241 235
   q12  455 227 228 227
   q13  17923   296429772964
   q14  254 213 221 213
   q15  505 468 454 454
   q16  525 380 375 375
   q17  951 614 738 614
   q18  8084740673917391
   q19  3149153115311531
   q20  646 310 301 301
   q21  4916323639203236
   q22  347 276 275 275
   Total cold run time: 117638 ms
   Total hot run time: 40179 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4290416741864167
   q2   379 277 271 271
   q3   3022271627782716
   q4   1887160615951595
   q5   5238529052625262
   q6   213 124 128 124
   q7   2086176517681765
   q8   3194332533353325
   q9   8362829683498296
   q10  3878365636503650
   q11  582 490 487 487
   q12  754 626 595 595
   q13  17419   298329972983
   q14  301 270 272 270
   q15  510 492 474 474
   q16  462 411 426 411
   q17  1750146614621462
   q18  7686758975187518
   q19  2839162215591559
   q20  1993182518031803
   q21  4833482048904820
   q22  580 508 499 499
   Total cold run time: 72258 ms
   Total hot run time: 54052 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [feature])(function) add percentile_approx_weighted function [doris]

2024-05-23 Thread via GitHub


github-actions[bot] commented on PR #35132:
URL: https://github.com/apache/doris/pull/35132#issuecomment-2126486659

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [feature])(function) add percentile_approx_weighted function [doris]

2024-05-23 Thread via GitHub


github-actions[bot] commented on PR #35132:
URL: https://github.com/apache/doris/pull/35132#issuecomment-2126486723

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](httpapi) restore compaction/run_status api can show be's overall compaction status and refactor code [doris]

2024-05-23 Thread via GitHub


Yulei-Yang commented on PR #35281:
URL: https://github.com/apache/doris/pull/35281#issuecomment-2126492415

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](httpapi) restore compaction/run_status api can show be's overall compaction status and refactor code [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35278:
URL: https://github.com/apache/doris/pull/35278#issuecomment-2126494276

   
   
   TPC-DS: Total hot run time: 172842 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 90458f95e2521f79d817b8bb8115199e2f7af36b, 
data reload: false
   
   query1   924 391 380 380
   query2   6465247824892478
   query3   6654209 213 209
   query4   19910   17217   17436   17217
   query5   4215427 432 427
   query6   247 150 162 150
   query7   4596300 284 284
   query8   242 185 184 184
   query9   8772236823562356
   query10  460 280 268 268
   query11  10720   998910097   9989
   query12  135 89  91  89
   query13  1630357 349 349
   query14  10030   752875077507
   query15  234 177 172 172
   query16  7872260 262 260
   query17  1846525 528 525
   query18  1913275 263 263
   query19  210 152 164 152
   query20  110 82  83  82
   query21  190 128 127 127
   query22  4224387640333876
   query23  33743   7   33057   33057
   query24  12123   284529282845
   query25  701 359 355 355
   query26  1835158 160 158
   query27  2951320 325 320
   query28  7505203320552033
   query29  1131604 600 600
   query30  303 176 171 171
   query31  955 751 722 722
   query32  98  52  56  52
   query33  756 270 272 270
   query34  1003477 461 461
   query35  752 612 630 612
   query36  1097956 949 949
   query37  275 71  71  71
   query38  2886278427622762
   query39  882 803 780 780
   query40  270 122 124 122
   query41  46  43  44  43
   query42  100 96  94  94
   query43  588 557 595 557
   query44  1225718 740 718
   query45  181 166 162 162
   query46  1069722 718 718
   query47  1886174618091746
   query48  367 297 294 294
   query49  1187372 379 372
   query50  774 380 391 380
   query51  6903676367766763
   query52  101 88  89  88
   query53  354 279 295 279
   query54  949 421 443 421
   query55  73  70  73  70
   query56  260 241 242 241
   query57  1135102110421021
   query58  239 217 210 210
   query59  3339324331323132
   query60  270 252 248 248
   query61  92  90  87  87
   query62  647 452 442 442
   query63  307 286 285 285
   query64  9840218716981698
   query65  3185309031093090
   query66  1355325 322 322
   query67  15303   15308   14892   14892
   query68  5670537 530 530
   query69  490 266 264 264
   query70  1170118411281128
   query71  428 263 265 263
   query72  7738559755495549
   query73  764 323 320 320
   query74  6206570956515651
   query75  3714263126002600
   query76  3610941 944 941
   query77  638 265 263 263
   query78  10220   986597569756
   query79  2073526 512 512
   query80  1355454 436 436
   query81  510 251 240 240
   query82  697 97  96  96
   query83  194 167 165 165
   query84  267 84  84  84
   query85  1346268 290 268
   query86  461 304 294 294
   query87  3297313130783078
   query88  3897232423312324
   query89  469 381 377 377
   query90  1954182 182 182
   query91  120 99  96  96
   query92  57  47  50  47
   query93  2186518 502 502
   query94  1184184 182 182
   query95  402 313 305 305
   query96  583 265 264 264
   query97  3263300030413000
   query98  249 222 220 220
   query99  1221848 883 848
   Total cold run time: 279073 ms
   Total hot run time: 172842 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the spe

Re: [PR] [bugfix](hive)fix testcase for test_hive_write_different_path [doris]

2024-05-23 Thread via GitHub


wuwenchi commented on PR #35209:
URL: https://github.com/apache/doris/pull/35209#issuecomment-2126501590

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Fix](inverted index) fix bkd index file is empty error status [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35280:
URL: https://github.com/apache/doris/pull/35280#issuecomment-2126501732

   
   
   TPC-H: Total hot run time: 49345 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 481bff82d810c0127df3d8a0ef6b4bccb7c3320f, 
data reload: false
   
   -- Round 1 --
   q1   17812   436543064306
   q2   2038151 142 142
   q3   10286   188119581881
   q4   10345   121413221214
   q5   8497384639273846
   q6   231 129 127 127
   q7   2010164015881588
   q8   9473274627062706
   q9   13680   10245   10237   10237
   q10  8676351435323514
   q11  418 248 251 248
   q12  463 306 304 304
   q13  18342   394140563941
   q14  354 331 326 326
   q15  512 450 458 450
   q16  690 578 563 563
   q17  1139949 918 918
   q18  7207674768506747
   q19  1704158315461546
   q20  529 292 306 292
   q21  4469416540634063
   q22  487 391 386 386
   Total cold run time: 119362 ms
   Total hot run time: 49345 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4305429542604260
   q2   318 231 228 228
   q3   4181418141214121
   q4   2752275027172717
   q5   7228712071387120
   q6   238 125 123 123
   q7   3158283428462834
   q8   4340443144474431
   q9   16825   16805   16659   16659
   q10  4260428042424242
   q11  759 675 684 675
   q12  1032842 871 842
   q13  7237376037373737
   q14  456 434 435 434
   q15  501 473 457 457
   q16  736 674 705 674
   q17  3913380839293808
   q18  8793871888838718
   q19  1719164016441640
   q20  2392210021462100
   q21  8468845184328432
   q22  1055955 913 913
   Total cold run time: 84666 ms
   Total hot run time: 79165 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](httpapi) restore compaction/run_status api can show be's overall compaction status and refactor code [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35278:
URL: https://github.com/apache/doris/pull/35278#issuecomment-2126504570

   
   
   ClickBench: Total hot run time: 30.14 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 90458f95e2521f79d817b8bb8115199e2f7af36b, 
data reload: false
   
   query1   0.040.030.03
   query2   0.090.040.04
   query3   0.230.050.04
   query4   1.670.060.07
   query5   0.510.500.50
   query6   1.120.730.72
   query7   0.020.020.01
   query8   0.050.040.04
   query9   0.540.490.49
   query10  0.540.550.56
   query11  0.160.120.11
   query12  0.150.120.12
   query13  0.590.600.60
   query14  0.770.800.76
   query15  0.830.820.81
   query16  0.370.350.35
   query17  0.961.010.99
   query18  0.220.240.26
   query19  1.841.681.69
   query20  0.010.010.02
   query21  15.76   0.670.67
   query22  4.437.031.67
   query23  18.32   1.351.27
   query24  1.730.320.23
   query25  0.150.070.09
   query26  0.260.160.16
   query27  0.080.080.08
   query28  13.22   1.011.01
   query29  13.23   3.243.27
   query30  0.250.070.06
   query31  2.850.380.37
   query32  3.300.460.46
   query33  2.902.852.91
   query34  17.12   4.424.35
   query35  4.504.464.47
   query36  0.660.460.47
   query37  0.180.160.16
   query38  0.160.150.14
   query39  0.040.040.03
   query40  0.160.130.15
   query41  0.090.050.04
   query42  0.050.050.05
   query43  0.040.040.03
   Total cold run time: 110.19 s
   Total hot run time: 30.14 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improvement](DDL)Automatically convert string type partition into varchar(65533) [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35279:
URL: https://github.com/apache/doris/pull/35279#issuecomment-2126505799

   
   
   TPC-DS: Total hot run time: 168642 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit a971445a514b6c401de4446ee2b08fed2a2c5bff, 
data reload: false
   
   query1   930 380 368 368
   query2   6454250724232423
   query3   6652211 208 208
   query4   19563   17250   17267   17250
   query5   4212412 417 412
   query6   239 163 155 155
   query7   4576305 289 289
   query8   234 184 188 184
   query9   8413237723652365
   query10  450 266 251 251
   query11  10647   10193   10146   10146
   query12  137 91  88  88
   query13  1632361 364 361
   query14  9831749063116311
   query15  208 165 169 165
   query16  7829262 257 257
   query17  1855517 513 513
   query18  1946260 259 259
   query19  197 159 180 159
   query20  100 93  92  92
   query21  204 128 130 128
   query22  4301398140593981
   query23  33729   32920   33059   32920
   query24  11959   284528142814
   query25  673 372 355 355
   query26  1796157 151 151
   query27  3018324 322 322
   query28  7234204020552040
   query29  1110609 594 594
   query30  306 171 174 171
   query31  963 775 752 752
   query32  88  52  54  52
   query33  779 274 273 273
   query34  990 484 478 478
   query35  769 595 601 595
   query36  1062913 944 913
   query37  164 67  68  67
   query38  2893278227692769
   query39  825 776 797 776
   query40  272 122 124 122
   query41  45  45  43  43
   query42  102 96  101 96
   query43  596 536 543 536
   query44  1181719 739 719
   query45  190 163 160 160
   query46  1073711 713 711
   query47  1893177617671767
   query48  376 303 298 298
   query49  1173373 380 373
   query50  764 385 390 385
   query51  6898687267456745
   query52  107 88  87  87
   query53  372 293 279 279
   query54  948 419 422 419
   query55  81  75  74  74
   query56  252 242 248 242
   query57  1139103610371036
   query58  236 210 204 204
   query59  3524321030753075
   query60  273 249 271 249
   query61  86  88  84  84
   query62  640 463 466 463
   query63  316 287 291 287
   query64  9914231517341734
   query65  3207314530993099
   query66  1370320 321 320
   query67  15547   14863   14898   14863
   query68  4614525 531 525
   query69  447 274 274 274
   query70  1154112311651123
   query71  402 267 290 267
   query72  7578272425852585
   query73  713 322 324 322
   query74  5969557256835572
   query75  3301264026162616
   query76  26101017982 982
   query77  421 273 271 271
   query78  10569   981296739673
   query79  2060510 512 510
   query80  929 440 428 428
   query81  522 244 247 244
   query82  616 95  94  94
   query83  241 165 166 165
   query84  232 84  82  82
   query85  1848262 263 262
   query86  528 303 305 303
   query87  3326314230943094
   query88  3955233523322332
   query89  479 399 373 373
   query90  1971256 184 184
   query91  125 97  97  97
   query92  56  47  49  47
   query93  2172510 495 495
   query94  1251188 187 187
   query95  410 309 311 309
   query96  584 266 263 263
   query97  3225306130193019
   query98  236 219 213 213
   query99  1102854 876 854
   Total cold run time: 275189 ms
   Total hot run time: 168642 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the sp

Re: [PR] [Fix](inverted index) fix bkd index file is empty error status [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35280:
URL: https://github.com/apache/doris/pull/35280#issuecomment-2126511129

   TeamCity be ut coverage result:
Function Coverage: 37.80% (8078/21369) 
Line Coverage: 29.46% (65965/223926)
Region Coverage: 28.93% (33965/117403)
Branch Coverage: 24.78% (17426/70326)
Coverage Report: 
http://coverage.selectdb-in.cc/coverage/481bff82d810c0127df3d8a0ef6b4bccb7c3320f_481bff82d810c0127df3d8a0ef6b4bccb7c3320f/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [bugfix](jni) using light pool to do transmit block [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35256:
URL: https://github.com/apache/doris/pull/35256#issuecomment-2126513115

   TeamCity be ut coverage result:
Function Coverage: 35.66% (9013/25278) 
Line Coverage: 27.30% (74514/272906)
Region Coverage: 26.54% (38563/145319)
Branch Coverage: 23.39% (19674/84096)
Coverage Report: 
http://coverage.selectdb-in.cc/coverage/a1f9261b3f598efb06f4ac0e98f9d87d1570ff83_a1f9261b3f598efb06f4ac0e98f9d87d1570ff83/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [doc](function) percentile_approx_weighted [doris-website]

2024-05-23 Thread via GitHub


Mryange opened a new pull request, #682:
URL: https://github.com/apache/doris-website/pull/682

   wait for this merge
   https://github.com/apache/doris/pull/35132


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improvement](DDL)Automatically convert string type partition into varchar(65533) [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35279:
URL: https://github.com/apache/doris/pull/35279#issuecomment-2126515743

   
   
   ClickBench: Total hot run time: 31.15 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit a971445a514b6c401de4446ee2b08fed2a2c5bff, 
data reload: false
   
   query1   0.040.030.03
   query2   0.080.040.04
   query3   0.230.050.05
   query4   1.670.080.07
   query5   0.490.480.50
   query6   1.130.730.72
   query7   0.030.010.01
   query8   0.050.040.05
   query9   0.550.480.48
   query10  0.530.540.54
   query11  0.160.110.11
   query12  0.140.120.12
   query13  0.590.580.60
   query14  0.770.800.77
   query15  0.840.830.81
   query16  0.350.350.38
   query17  0.991.010.95
   query18  0.220.250.25
   query19  1.861.741.68
   query20  0.010.010.01
   query21  15.71   0.670.66
   query22  3.936.672.59
   query23  18.28   1.391.25
   query24  1.350.300.33
   query25  0.150.080.07
   query26  0.260.170.17
   query27  0.070.070.08
   query28  13.35   1.011.00
   query29  13.17   3.253.23
   query30  0.240.060.05
   query31  2.870.390.38
   query32  3.300.470.47
   query33  2.922.902.92
   query34  17.30   4.424.38
   query35  4.504.574.52
   query36  0.630.440.45
   query37  0.170.160.15
   query38  0.150.140.14
   query39  0.040.040.03
   query40  0.160.140.14
   query41  0.090.050.04
   query42  0.050.040.05
   query43  0.040.040.04
   Total cold run time: 109.46 s
   Total hot run time: 31.15 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris-website) branch asf-site updated (021c27c2fb -> 871097e4db)

2024-05-23 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch asf-site
in repository https://gitbox.apache.org/repos/asf/doris-website.git


 discard 021c27c2fb Automated deployment with doris branch master@ 
cb924090bad30f1efbc7b714bab0f0f9bd922cd7
 new 871097e4db Automated deployment with doris branch master@ 
cb924090bad30f1efbc7b714bab0f0f9bd922cd7

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (021c27c2fb)
\
 N -- N -- N   refs/heads/asf-site (871097e4db)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 docs/1.2/search-index.json   | 2 +-
 docs/2.0/search-index.json   | 2 +-
 docs/dev/search-index.json   | 2 +-
 search-index.json| 2 +-
 zh-CN/docs/1.2/search-index.json | 2 +-
 zh-CN/docs/2.0/search-index.json | 2 +-
 zh-CN/docs/dev/search-index.json | 2 +-
 zh-CN/search-index.json  | 2 +-
 8 files changed, 8 insertions(+), 8 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](httpapi) restore compaction/run_status api can show be's overall compaction status and refactor code [doris]

2024-05-23 Thread via GitHub


xy720 commented on code in PR #35278:
URL: https://github.com/apache/doris/pull/35278#discussion_r1611235059


##
be/src/http/action/compaction_action.cpp:
##
@@ -178,10 +195,8 @@ Status 
CompactionAction::_handle_run_compaction(HttpRequest* req, std::string* j
 
 Status CompactionAction::_handle_run_status_compaction(HttpRequest* req, 
std::string* json_result) {
 uint64_t tablet_id = 0;
-uint64_t table_id = 0;
-
-// check req_tablet_id is not empty
-RETURN_NOT_OK_STATUS_WITH_WARN(_check_param(req, &tablet_id, &table_id), 
"check param failed");
+RETURN_NOT_OK_STATUS_WITH_WARN(_check_param(req, &tablet_id, 
TABLET_ID_KEY),

Review Comment:
   please add some comments here.



##
be/src/http/action/compaction_action.cpp:
##
@@ -61,7 +61,7 @@ CompactionAction::CompactionAction(CompactionActionType 
ctype, ExecEnv* exec_env
TPrivilegeType::type ptype)
 : HttpHandlerWithAuth(exec_env, hier, ptype), _engine(engine), 
_type(ctype) {}
 
-/// check param and fetch tablet_id from req
+/// check param and fetch tablet_id & table_id from req

Review Comment:
   You should modify the comment in cloud compaction action too



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Fix](inverted index) fix bkd index file is empty error status [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35280:
URL: https://github.com/apache/doris/pull/35280#issuecomment-2126524978

   
   
   TPC-DS: Total hot run time: 203225 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 481bff82d810c0127df3d8a0ef6b4bccb7c3320f, 
data reload: false
   
   query1   933 384 383 383
   query2   6530260729152607
   query3   6924212 214 212
   query4   20174   17974   18037   17974
   query5   19726   649265436492
   query6   286 211 227 211
   query7   4151301 304 301
   query8   262 283 248 248
   query9   3115268226102610
   query10  402 287 297 287
   query11  11377   10689   10764   10689
   query12  127 72  75  72
   query13  5575681 675 675
   query14  17590   13367   13250   13250
   query15  355 219 229 219
   query16  6478274 259 259
   query17  17161455860 860
   query18  2311407 400 400
   query19  208 147 147 147
   query20  82  78  82  78
   query21  190 101 93  93
   query22  5174507450535053
   query23  32347   31861   31880   31861
   query24  6921651466156514
   query25  516 442 417 417
   query26  525 158 155 155
   query27  1898292 293 292
   query28  6211237523352335
   query29  2878272128152721
   query30  246 163 168 163
   query31  909 712 735 712
   query32  69  63  57  57
   query33  399 254 261 254
   query34  844 470 484 470
   query35  1140933 888 888
   query36  1475117412121174
   query37  89  60  59  59
   query38  3091291229572912
   query39  1376133313081308
   query40  203 90  93  90
   query41  37  40  36  36
   query42  87  87  78  78
   query43  728 755 670 670
   query44  1150715 710 710
   query45  248 229 226 226
   query46  1215955 971 955
   query47  1974174517981745
   query48  1018738 723 723
   query49  620 366 367 366
   query50  869 590 606 590
   query51  4754468447054684
   query52  96  81  76  76
   query53  441 321 312 312
   query54  2644246824822468
   query55  85  74  87  74
   query56  225 211 220 211
   query57  1161107211161072
   query58  215 205 193 193
   query59  4199391939033903
   query60  214 218 196 196
   query61  86  83  86  83
   query62  837 493 503 493
   query63  489 339 333 333
   query64  2384151613591359
   query65  3642355835323532
   query66  804 390 377 377
   query67  17856   16122   15280   15280
   query68  7061667 668 667
   query69  568 353 347 347
   query70  1675149316541493
   query71  399 299 323 299
   query72  6479344834283428
   query73  735 324 324 324
   query74  6311585858875858
   query75  4600361237163612
   query76  4413117011841170
   query77  540 256 253 253
   query78  12646   11837   12673   11837
   query79  8907659 650 650
   query80  2610387 385 385
   query81  525 237 229 229
   query82  130997  98  97
   query83  186 135 132 132
   query84  260 68  74  68
   query85  1393296 300 296
   query86  360 292 290 290
   query87  3190298230442982
   query88  5141238123862381
   query89  398 287 285 285
   query90  1752210 210 210
   query91  167 135 145 135
   query92  58  56  53  53
   query93  4164622 557 557
   query94  892 209 201 201
   query95  1084105110241024
   query96  645 340 335 335
   query97  6473636363496349
   query98  193 174 172 172
   query99  2735859 889 859
   Total cold run time: 310770 ms
   Total hot run time: 203225 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go t

Re: [PR] [fix](httpapi) restore compaction/run_status api can show be's overall compaction status and refactor code [doris]

2024-05-23 Thread via GitHub


xy720 commented on code in PR #35278:
URL: https://github.com/apache/doris/pull/35278#discussion_r1611210101


##
be/src/http/action/compaction_action.cpp:
##
@@ -61,7 +61,7 @@ CompactionAction::CompactionAction(CompactionActionType 
ctype, ExecEnv* exec_env
TPrivilegeType::type ptype)
 : HttpHandlerWithAuth(exec_env, hier, ptype), _engine(engine), 
_type(ctype) {}
 
-/// check param and fetch tablet_id from req
+/// check param and fetch tablet_id & table_id from req

Review Comment:
   You should also modify the comment in cloud compaction action



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](clean trash) Fix clean trash lost submit task [doris]

2024-05-23 Thread via GitHub


dataroaring merged PR #35271:
URL: https://github.com/apache/doris/pull/35271


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch branch-2.1 updated: [fix](clean trash) Fix clean trash lost submit task (#35271)

2024-05-23 Thread dataroaring
This is an automated email from the ASF dual-hosted git repository.

dataroaring pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git


The following commit(s) were added to refs/heads/branch-2.1 by this push:
 new 0d2ab9d5c3f [fix](clean trash) Fix clean trash lost submit task 
(#35271)
0d2ab9d5c3f is described below

commit 0d2ab9d5c3fb4634e4c8c04320a8d9fa9a5e50b8
Author: deardeng <565620...@qq.com>
AuthorDate: Thu May 23 16:27:20 2024 +0800

[fix](clean trash) Fix clean trash lost submit task (#35271)
---
 be/src/agent/agent_server.cpp | 10 +-
 be/src/agent/agent_server.h   |  2 +-
 2 files changed, 10 insertions(+), 2 deletions(-)

diff --git a/be/src/agent/agent_server.cpp b/be/src/agent/agent_server.cpp
index e94d4c349a9..e7217cdcff0 100644
--- a/be/src/agent/agent_server.cpp
+++ b/be/src/agent/agent_server.cpp
@@ -161,7 +161,7 @@ void AgentServer::start_workers(ExecEnv* exec_env) {
 _report_tablet_workers = std::make_unique(
 "REPORT_OLAP_TABLE", _master_info, 
config::report_tablet_interval_seconds,[&engine, &master_info = _master_info] { 
report_tablet_callback(engine, master_info); });
 
-_clean_trash_binlog_workers = std::make_unique(
+_clean_trash_workers = std::make_unique(
 "CLEAN_TRASH", 1, [&engine](auto&& task) {return 
clean_trash_callback(engine, task); });
 // clang-format on
 }
@@ -270,6 +270,14 @@ void AgentServer::submit_tasks(TAgentResult& agent_result,
 "task(signature={}) has wrong request member = 
gc_binlog_req", signature);
 }
 break;
+case TTaskType::CLEAN_TRASH:
+if (task.__isset.clean_trash_req) {
+_clean_trash_workers->submit_task(task);
+} else {
+ret_st = Status::InvalidArgument(
+"task(signature={}) has wrong request member = 
clean_trash_req", signature);
+}
+break;
 default:
 ret_st = Status::InvalidArgument("task(signature={}, type={}) has 
wrong task type",
  signature, task_type);
diff --git a/be/src/agent/agent_server.h b/be/src/agent/agent_server.h
index 283d2118ce3..b789bbe98de 100644
--- a/be/src/agent/agent_server.h
+++ b/be/src/agent/agent_server.h
@@ -96,7 +96,7 @@ private:
 std::unique_ptr _push_storage_policy_workers;
 std::unique_ptr _topic_subscriber;
 std::unique_ptr _gc_binlog_workers;
-std::unique_ptr _clean_trash_binlog_workers;
+std::unique_ptr _clean_trash_workers;
 };
 
 } // end namespace doris


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](httpapi) restore compaction/run_status api can show be's overall compaction status and refactor code [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35281:
URL: https://github.com/apache/doris/pull/35281#issuecomment-2126532487

   
   
   TPC-H: Total hot run time: 49852 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit c04510e4bf3189e1f4438267211b864090d90987, 
data reload: false
   
   -- Round 1 --
   q1   17620   446943934393
   q2   2022160 156 156
   q3   10332   193219751932
   q4   10112   125913251259
   q5   8412397639323932
   q6   241 127 125 125
   q7   2068160015821582
   q8   9341274127242724
   q9   10577   10397   10276   10276
   q10  8621353834823482
   q11  426 250 254 250
   q12  480 300 302 300
   q13  18336   397239743972
   q14  367 320 335 320
   q15  504 454 456 454
   q16  672 568 569 568
   q17  11601009958 958
   q18  7392697368656865
   q19  1678157215381538
   q20  555 323 297 297
   q21  4496413440844084
   q22  487 385 392 385
   Total cold run time: 115899 ms
   Total hot run time: 49852 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4320434443334333
   q2   321 218 224 218
   q3   4208417141534153
   q4   2761274127632741
   q5   7209714171657141
   q6   242 122 122 122
   q7   3222288028822880
   q8   4419450345544503
   q9   16950   16763   16884   16763
   q10  4264428542684268
   q11  768 686 715 686
   q12  1021851 852 851
   q13  7523374737503747
   q14  454 436 421 421
   q15  510 459 464 459
   q16  742 682 689 682
   q17  3816385438463846
   q18  8883887688998876
   q19  1725170116471647
   q20  2376211820822082
   q21  8519848585558485
   q22  1042903 930 903
   Total cold run time: 85295 ms
   Total hot run time: 79807 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](httpapi) restore compaction/run_status api can show be's overall compaction status and refactor code [doris]

2024-05-23 Thread via GitHub


Yulei-Yang commented on code in PR #35278:
URL: https://github.com/apache/doris/pull/35278#discussion_r1611247119


##
be/src/http/action/compaction_action.cpp:
##
@@ -61,7 +61,7 @@ CompactionAction::CompactionAction(CompactionActionType 
ctype, ExecEnv* exec_env
TPrivilegeType::type ptype)
 : HttpHandlerWithAuth(exec_env, hier, ptype), _engine(engine), 
_type(ctype) {}
 
-/// check param and fetch tablet_id from req
+/// check param and fetch tablet_id & table_id from req

Review Comment:
   done



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](httpapi) restore compaction/run_status api can show be's overall compaction status and refactor code [doris]

2024-05-23 Thread via GitHub


Yulei-Yang commented on code in PR #35278:
URL: https://github.com/apache/doris/pull/35278#discussion_r1611247663


##
be/src/http/action/compaction_action.cpp:
##
@@ -178,10 +195,8 @@ Status 
CompactionAction::_handle_run_compaction(HttpRequest* req, std::string* j
 
 Status CompactionAction::_handle_run_status_compaction(HttpRequest* req, 
std::string* json_result) {
 uint64_t tablet_id = 0;
-uint64_t table_id = 0;
-
-// check req_tablet_id is not empty
-RETURN_NOT_OK_STATUS_WITH_WARN(_check_param(req, &tablet_id, &table_id), 
"check param failed");
+RETURN_NOT_OK_STATUS_WITH_WARN(_check_param(req, &tablet_id, 
TABLET_ID_KEY),

Review Comment:
   done



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Fix](inverted index) fix bkd index file is empty error status [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35280:
URL: https://github.com/apache/doris/pull/35280#issuecomment-2126537290

   
   
   ClickBench: Total hot run time: 31.25 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 481bff82d810c0127df3d8a0ef6b4bccb7c3320f, 
data reload: false
   
   query1   0.020.030.03
   query2   0.070.020.02
   query3   0.240.040.05
   query4   1.800.060.08
   query5   0.540.520.52
   query6   1.230.610.63
   query7   0.010.010.01
   query8   0.030.020.02
   query9   0.530.480.47
   query10  0.550.540.54
   query11  0.120.090.09
   query12  0.110.100.09
   query13  0.620.610.61
   query14  0.780.800.77
   query15  0.780.760.76
   query16  0.370.370.34
   query17  1.021.031.00
   query18  0.220.240.23
   query19  1.901.871.81
   query20  0.020.010.01
   query21  15.48   0.550.55
   query22  2.292.202.15
   query23  17.33   0.930.97
   query24  5.491.201.01
   query25  0.370.080.05
   query26  0.650.150.16
   query27  0.050.050.03
   query28  7.730.700.78
   query29  12.64   2.352.34
   query30  0.570.520.55
   query31  2.940.390.38
   query32  3.880.500.50
   query33  3.063.053.06
   query34  15.26   4.784.80
   query35  4.844.854.84
   query36  1.081.001.01
   query37  0.060.050.04
   query38  0.030.020.02
   query39  0.020.010.01
   query40  0.150.140.13
   query41  0.070.020.02
   query42  0.020.020.01
   query43  0.020.010.01
   Total cold run time: 104.99 s
   Total hot run time: 31.25 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](httpapi) restore compaction/run_status api can show be's overall compaction status and refactor code [doris]

2024-05-23 Thread via GitHub


Yulei-Yang commented on PR #35278:
URL: https://github.com/apache/doris/pull/35278#issuecomment-2126543092

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Fix](inverted index) fix bkd index file is empty error status [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35280:
URL: https://github.com/apache/doris/pull/35280#issuecomment-2126543609

   
   Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   ```
   Load test result on commit 481bff82d810c0127df3d8a0ef6b4bccb7c3320f with 
default session variables
   Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
   Stream load orc:  58 seconds loaded 1101869774 Bytes, about 18 MB/s
   Stream load parquet:  31 seconds loaded 861443392 Bytes, about 26 MB/s
   Insert into select:   21.2 seconds inserted 1000 Rows, about 471K 
ops/s
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](httpapi) restore compaction/run_status api can show be's overall compaction status and refactor code [doris]

2024-05-23 Thread via GitHub


github-actions[bot] commented on PR #35278:
URL: https://github.com/apache/doris/pull/35278#issuecomment-2126545559

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](httpapi) restore compaction/run_status api can show be's overall compaction status and refactor code [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35281:
URL: https://github.com/apache/doris/pull/35281#issuecomment-2126546383

   TeamCity be ut coverage result:
Function Coverage: 37.79% (8076/21370) 
Line Coverage: 29.45% (65952/223940)
Region Coverage: 28.92% (33954/117412)
Branch Coverage: 24.77% (17422/70330)
Coverage Report: 
http://coverage.selectdb-in.cc/coverage/c04510e4bf3189e1f4438267211b864090d90987_c04510e4bf3189e1f4438267211b864090d90987/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [Fix](trino-connector) add regression tests for trino-connector accessing Kafka. [doris]

2024-05-23 Thread via GitHub


BePPPower opened a new pull request, #35282:
URL: https://github.com/apache/doris/pull/35282

   ## Proposed changes
   
   Issue Number: close #xxx
   
   
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Fix](trino-connector) add regression tests for trino-connector accessing Kafka. [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35282:
URL: https://github.com/apache/doris/pull/35282#issuecomment-2126552467

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Fix](executor)Add workload group upgrade check. [doris]

2024-05-23 Thread via GitHub


wangbo commented on PR #35004:
URL: https://github.com/apache/doris/pull/35004#issuecomment-2126552563

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Fix](trino-connector) add regression tests for trino-connector accessing Kafka. [doris]

2024-05-23 Thread via GitHub


BePPPower commented on PR #35282:
URL: https://github.com/apache/doris/pull/35282#issuecomment-2126552596

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](httpapi) restore compaction/run_status api can show be's overall compaction status and refactor code [doris]

2024-05-23 Thread via GitHub


github-actions[bot] commented on PR #35278:
URL: https://github.com/apache/doris/pull/35278#issuecomment-2126553089

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](httpapi) restore compaction/run_status api can show be's overall compaction status and refactor code [doris]

2024-05-23 Thread via GitHub


github-actions[bot] commented on PR #35278:
URL: https://github.com/apache/doris/pull/35278#issuecomment-2126553166

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [fix](p2-test) fix `test_export_with_parallelism` case [doris]

2024-05-23 Thread via GitHub


BePPPower opened a new pull request, #35283:
URL: https://github.com/apache/doris/pull/35283

   ## Proposed changes
   
   Issue Number: close #xxx
   
   
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](p2-test) fix `test_export_with_parallelism` case [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35283:
URL: https://github.com/apache/doris/pull/35283#issuecomment-2126557149

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](p2-test) fix `test_export_with_parallelism` case [doris]

2024-05-23 Thread via GitHub


BePPPower commented on PR #35283:
URL: https://github.com/apache/doris/pull/35283#issuecomment-2126557406

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](httpapi) restore compaction/run_status api can show be's overall compaction status and refactor code [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35281:
URL: https://github.com/apache/doris/pull/35281#issuecomment-2126558053

   
   
   TPC-DS: Total hot run time: 203441 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit c04510e4bf3189e1f4438267211b864090d90987, 
data reload: false
   
   query1   939 392 381 381
   query2   6535285129012851
   query3   6929212 216 212
   query4   20235   17997   18001   17997
   query5   19738   656565396539
   query6   289 214 233 214
   query7   4163296 319 296
   query8   258 244 261 244
   query9   3159272926502650
   query10  411 315 301 301
   query11  11322   10803   10690   10690
   query12  126 75  75  75
   query13  5581707 671 671
   query14  17894   13319   13895   13319
   query15  363 227 220 220
   query16  6453275 261 261
   query17  15571475870 870
   query18  2277416 408 408
   query19  211 147 151 147
   query20  80  79  80  79
   query21  191 101 97  97
   query22  5237490448974897
   query23  32470   31891   32090   31891
   query24  6946655964956495
   query25  514 440 418 418
   query26  523 168 166 166
   query27  1875293 295 293
   query28  6119236423372337
   query29  2937268828752688
   query30  242 167 162 162
   query31  912 730 725 725
   query32  69  61  62  61
   query33  395 259 254 254
   query34  866 465 485 465
   query35  1091931 944 931
   query36  1180121211901190
   query37  89  60  60  60
   query38  3056294829362936
   query39  1375134413381338
   query40  206 95  92  92
   query41  42  36  36  36
   query42  92  90  81  81
   query43  747 774 743 743
   query44  1115718 733 718
   query45  240 232 225 225
   query46  1213966 969 966
   query47  2148174717621747
   query48  1007736 701 701
   query49  627 375 368 368
   query50  859 626 621 621
   query51  4732458446714584
   query52  84  82  77  77
   query53  442 317 320 317
   query54  2649244924572449
   query55  90  79  80  79
   query56  227 196 220 196
   query57  1296113810621062
   query58  210 201 194 194
   query59  4536411242084112
   query60  204 190 216 190
   query61  88  82  83  82
   query62  709 509 460 460
   query63  486 346 340 340
   query64  2466148214671467
   query65  3658355235823552
   query66  776 382 372 372
   query67  15762   17579   15034   15034
   query68  9821650 650 650
   query69  589 350 366 350
   query70  1634135413621354
   query71  415 304 312 304
   query72  6518353533913391
   query73  727 327 324 324
   query74  6276580359365803
   query75  5507371237143712
   query76  6153112111741121
   query77  1071256 249 249
   query78  12695   11648   12018   11648
   query79  7176643 649 643
   query80  1037411 388 388
   query81  492 236 231 231
   query82  901 101 98  98
   query83  175 137 136 136
   query84  251 69  69  69
   query85  846 299 291 291
   query86  344 283 299 283
   query87  3233308930813081
   query88  4471237123822371
   query89  376 299 295 295
   query90  1957214 206 206
   query91  174 138 135 135
   query92  60  53  51  51
   query93  6156568 577 568
   query94  701 204 209 204
   query95  1121105810561056
   query96  649 332 335 332
   query97  6435634263386338
   query98  199 181 174 174
   query99  2878914 891 891
   Total cold run time: 312356 ms
   Total hot run time: 203441 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go t

Re: [PR] [fix](nereids)the preagg state for count(*) is wrong [doris]

2024-05-23 Thread via GitHub


starocean999 commented on PR #35254:
URL: https://github.com/apache/doris/pull/35254#issuecomment-2126558722

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Enhencement](tvf) select tvf supports using resource [doris]

2024-05-23 Thread via GitHub


BePPPower commented on PR #35139:
URL: https://github.com/apache/doris/pull/35139#issuecomment-2126560445

   run external performance


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Fix](bloom filter) Fix bloom filter memory leak [doris]

2024-05-23 Thread via GitHub


zhannngchen merged PR #34871:
URL: https://github.com/apache/doris/pull/34871


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch master updated (5bcc542f00e -> a62659a36c5)

2024-05-23 Thread zhangchen
This is an automated email from the ASF dual-hosted git repository.

zhangchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git


from 5bcc542f00e [optimize](regression)Add retry for curl request (#35260)
 add a62659a36c5 [Fix](bloom filter) Fix bloom filter memory leak (#34871)

No new revisions were added by this update.

Summary of changes:
 be/src/olap/base_tablet.cpp   |   2 +-
 be/src/olap/rowset/segment_v2/segment.cpp |  10 +
 be/src/olap/segment_loader.cpp|   8 +-
 be/src/olap/segment_loader.h  |   7 +-
 be/test/olap/segment_cache_test.cpp   | 361 ++
 5 files changed, 385 insertions(+), 3 deletions(-)
 create mode 100644 be/test/olap/segment_cache_test.cpp


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](fe) Adjust two default configuration for fe [doris]

2024-05-23 Thread via GitHub


dataroaring commented on PR #35276:
URL: https://github.com/apache/doris/pull/35276#issuecomment-2126564710

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](fe) Adjust two default configuration for fe [doris]

2024-05-23 Thread via GitHub


github-actions[bot] commented on PR #35276:
URL: https://github.com/apache/doris/pull/35276#issuecomment-2126567115

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](fe) Adjust two default configuration for fe [doris]

2024-05-23 Thread via GitHub


github-actions[bot] commented on PR #35276:
URL: https://github.com/apache/doris/pull/35276#issuecomment-2126567188

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](httpapi) restore compaction/run_status api can show be's overall compaction status and refactor code [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35281:
URL: https://github.com/apache/doris/pull/35281#issuecomment-2126568796

   
   
   ClickBench: Total hot run time: 30.67 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit c04510e4bf3189e1f4438267211b864090d90987, 
data reload: false
   
   query1   0.020.020.02
   query2   0.070.020.02
   query3   0.240.050.04
   query4   1.800.080.07
   query5   0.530.520.52
   query6   1.260.610.60
   query7   0.010.020.02
   query8   0.030.020.03
   query9   0.500.480.49
   query10  0.540.520.55
   query11  0.110.080.08
   query12  0.110.090.09
   query13  0.630.610.61
   query14  0.770.790.78
   query15  0.780.770.76
   query16  0.370.360.36
   query17  1.021.010.98
   query18  0.250.240.24
   query19  1.931.831.84
   query20  0.020.020.01
   query21  15.49   0.550.53
   query22  2.132.271.61
   query23  17.19   1.100.92
   query24  6.060.981.49
   query25  0.380.130.04
   query26  0.620.150.13
   query27  0.040.050.04
   query28  7.260.760.73
   query29  12.74   2.332.34
   query30  0.600.550.54
   query31  2.810.400.37
   query32  3.370.500.51
   query33  3.083.083.03
   query34  15.27   4.814.78
   query35  4.864.824.88
   query36  1.041.011.02
   query37  0.060.050.05
   query38  0.040.030.02
   query39  0.020.020.01
   query40  0.160.140.14
   query41  0.060.020.01
   query42  0.020.010.01
   query43  0.020.020.02
   Total cold run time: 104.31 s
   Total hot run time: 30.67 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [security] Remove sensitive information from the code. [doris]

2024-05-23 Thread via GitHub


dataroaring commented on PR #35127:
URL: https://github.com/apache/doris/pull/35127#issuecomment-2126571566

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](httpapi) restore compaction/run_status api can show be's overall compaction status and refactor code [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35281:
URL: https://github.com/apache/doris/pull/35281#issuecomment-2126575162

   
   Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   ```
   Load test result on commit c04510e4bf3189e1f4438267211b864090d90987 with 
default session variables
   Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
   Stream load orc:  58 seconds loaded 1101869774 Bytes, about 18 MB/s
   Stream load parquet:  31 seconds loaded 861443392 Bytes, about 26 MB/s
   Insert into select:   21.2 seconds inserted 1000 Rows, about 471K 
ops/s
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](httpapi) restore compaction/run_status api can show be's overall compaction status and refactor code [doris]

2024-05-23 Thread via GitHub


doris-robot commented on PR #35278:
URL: https://github.com/apache/doris/pull/35278#issuecomment-2126578927

   
   
   TPC-H: Total hot run time: 39849 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 5647eeb7c711d7f35e3cc1ab19f07f031cf8d51b, 
data reload: false
   
   -- Round 1 --
   q1   18005   513644144414
   q2   2417196 193 193
   q3   11711   118811841184
   q4   10659   825 841 825
   q5   7534267526162616
   q6   220 140 135 135
   q7   996 599 610 599
   q8   9293211620622062
   q9   8812650164606460
   q10  8851367937023679
   q11  476 240 242 240
   q12  427 222 217 217
   q13  17786   300129572957
   q14  270 210 223 210
   q15  500 476 479 476
   q16  496 392 367 367
   q17  972 636 715 636
   q18  8040758374417441
   q19  6813156414571457
   q20  642 307 298 298
   q21  4939387631103110
   q22  342 274 273 273
   Total cold run time: 120201 ms
   Total hot run time: 39849 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4350425142574251
   q2   383 262 262 262
   q3   3001279227812781
   q4   1872156715881567
   q5   5223527452715271
   q6   218 124 124 124
   q7   2154175017061706
   q8   3188329633273296
   q9   8282830883778308
   q10  3892362637203626
   q11  608 480 487 480
   q12  775 569 599 569
   q13  17320   295229442944
   q14  292 279 246 246
   q15  517 477 476 476
   q16  460 406 412 406
   q17  1771146514961465
   q18  7738770775687568
   q19  1693154715571547
   q20  1971177117861771
   q21  4903457547604575
   q22  550 487 493 487
   Total cold run time: 71161 ms
   Total hot run time: 53726 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



  1   2   3   4   5   6   7   8   9   10   >