Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]

2025-06-12 Thread via GitHub


bobhan1 closed pull request #50080: [Opt](metric) Add metrics for invalid 
delete bitmap key count
URL: https://github.com/apache/doris/pull/50080


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]

2025-04-29 Thread via GitHub


hello-stephen commented on PR #50080:
URL: https://github.com/apache/doris/pull/50080#issuecomment-2840909784

   # BE Regression && UT Coverage Report
   Increment line coverage `20.27% (15/74)` :tada:
   
   [Increment coverage 
report](http://coverage.selectdb-in.cc/coverage/50080_3e3ace510173441f8b9972f636d2479c5785c6e8_merge/increment_report/index.html)
   [Complete coverage 
report](http://coverage.selectdb-in.cc/coverage/50080_3e3ace510173441f8b9972f636d2479c5785c6e8_merge/report/index.html)
   | Category  | Coverage   |
   |---||
   | Function Coverage | 80.31% (21257/26468) |
   | Line Coverage | 74.40% (219282/294729) |
   | Region Coverage   | 72.71% (132071/181653) |
   | Branch Coverage   | 66.02% (67528/102282) |


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]

2025-04-29 Thread via GitHub


bobhan1 commented on PR #50080:
URL: https://github.com/apache/doris/pull/50080#issuecomment-2840734099

   run p0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]

2025-04-29 Thread via GitHub


bobhan1 commented on PR #50080:
URL: https://github.com/apache/doris/pull/50080#issuecomment-2840636091

   run cloud_p0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]

2025-04-29 Thread via GitHub


bobhan1 commented on PR #50080:
URL: https://github.com/apache/doris/pull/50080#issuecomment-2840635970

   run p0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]

2025-04-29 Thread via GitHub


hello-stephen commented on PR #50080:
URL: https://github.com/apache/doris/pull/50080#issuecomment-2839692791

   # BE Regression P0 && UT Coverage Report
   Increment line coverage `20.27% (15/74)` :tada:
   
   [Increment coverage 
report](http://coverage.selectdb-in.cc/coverage/50080_3e3ace510173441f8b9972f636d2479c5785c6e8_merge/increment_report/index.html)
   [Complete coverage 
report](http://coverage.selectdb-in.cc/coverage/50080_3e3ace510173441f8b9972f636d2479c5785c6e8_merge/report/index.html)
   | Category  | Coverage   |
   |---||
   | Function Coverage | 78.13% (20680/26468) |
   | Line Coverage | 71.70% (211328/294729) |
   | Region Coverage   | 69.88% (126939/181653) |
   | Branch Coverage   | 63.14% (64585/102282) |


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]

2025-04-29 Thread via GitHub


hello-stephen commented on PR #50080:
URL: https://github.com/apache/doris/pull/50080#issuecomment-2839170749

   # BE UT Coverage Report
   Increment line coverage `3.70% (2/54)` :tada:
   
   [Increment coverage 
report](http://coverage.selectdb-in.cc/coverage/3e3ace510173441f8b9972f636d2479c5785c6e8_3e3ace510173441f8b9972f636d2479c5785c6e8/increment_report/index.html)
   [Complete coverage 
report](http://coverage.selectdb-in.cc/coverage/3e3ace510173441f8b9972f636d2479c5785c6e8_3e3ace510173441f8b9972f636d2479c5785c6e8/report/index.html)
   | Category  | Coverage   |
   |---||
   | Function Coverage | 54.79% (14774/26963) |
   | Line Coverage | 43.91% (129632/295194) |
   | Region Coverage   | 42.62% (66168/155240) |
   | Branch Coverage   | 37.22% (33395/89716) |


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]

2025-04-29 Thread via GitHub


doris-robot commented on PR #50080:
URL: https://github.com/apache/doris/pull/50080#issuecomment-2838798773

   
   
   ClickBench: Total hot run time: 29.24 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 3e3ace510173441f8b9972f636d2479c5785c6e8, 
data reload: false
   
   query1   0.030.030.03
   query2   0.120.100.10
   query3   0.260.200.20
   query4   1.590.200.11
   query5   0.560.570.53
   query6   1.200.720.72
   query7   0.020.020.02
   query8   0.040.030.03
   query9   0.570.510.52
   query10  0.590.570.57
   query11  0.150.110.12
   query12  0.150.120.12
   query13  0.610.600.59
   query14  0.800.790.80
   query15  0.870.860.86
   query16  0.370.380.37
   query17  1.021.041.03
   query18  0.200.200.20
   query19  1.891.741.86
   query20  0.010.020.01
   query21  15.43   0.900.56
   query22  0.761.220.71
   query23  14.84   1.400.61
   query24  7.001.320.80
   query25  0.500.180.06
   query26  0.580.170.15
   query27  0.050.050.05
   query28  9.070.850.45
   query29  12.55   4.013.35
   query30  0.250.100.06
   query31  2.820.600.38
   query32  3.230.560.49
   query33  2.973.033.08
   query34  15.88   5.134.55
   query35  4.534.594.55
   query36  0.660.490.48
   query37  0.090.070.06
   query38  0.050.040.04
   query39  0.030.020.02
   query40  0.180.140.13
   query41  0.080.030.02
   query42  0.030.030.02
   query43  0.040.030.03
   Total cold run time: 102.67 s
   Total hot run time: 29.24 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]

2025-04-29 Thread via GitHub


doris-robot commented on PR #50080:
URL: https://github.com/apache/doris/pull/50080#issuecomment-2838765011

   
   
   TPC-DS: Total hot run time: 185351 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 3e3ace510173441f8b9972f636d2479c5785c6e8, 
data reload: false
   
   query1   1025471 490 471
   query2   6552192418811881
   query3   6740224 219 219
   query4   26241   23399   23555   23399
   query5   4396654 461 461
   query6   306 216 206 206
   query7   4638482 281 281
   query8   290 233 230 230
   query9   8581259926092599
   query10  489 318 258 258
   query11  15600   15064   14847   14847
   query12  155 110 102 102
   query13  1660543 403 403
   query14  8819616859935993
   query15  204 185 180 180
   query16  7138667 489 489
   query17  1227749 581 581
   query18  1988412 311 311
   query19  197 192 157 157
   query20  125 126 127 126
   query21  214 128 111 111
   query22  4061427240074007
   query23  34191   32776   32935   32776
   query24  8271240224092402
   query25  608 445 389 389
   query26  1233267 152 152
   query27  2745484 333 333
   query28  4320209921052099
   query29  777 549 428 428
   query30  281 218 189 189
   query31  928 859 768 768
   query32  72  68  68  68
   query33  559 403 313 313
   query34  796 856 510 510
   query35  765 813 740 740
   query36  953 985 876 876
   query37  111 104 76  76
   query38  4148412540814081
   query39  1462142913751375
   query40  212 119 105 105
   query41  58  57  56  56
   query42  116 105 105 105
   query43  507 526 488 488
   query44  1306788 787 787
   query45  180 177 174 174
   query46  863 1042628 628
   query47  1749175516871687
   query48  366 415 298 298
   query49  780 501 399 399
   query50  658 684 418 418
   query51  4058416941214121
   query52  114 107 96  96
   query53  231 267 185 185
   query54  580 576 523 523
   query55  83  84  81  81
   query56  300 307 291 291
   query57  1123120310761076
   query58  266 245 254 245
   query59  2690277626792679
   query60  316 326 312 312
   query61  130 126 130 126
   query62  778 731 640 640
   query63  223 185 185 185
   query64  43601014668 668
   query65  4320422942514229
   query66  1165414 327 327
   query67  15959   15392   15226   15226
   query68  8564880 506 506
   query69  469 313 273 273
   query70  1178106410811064
   query71  470 370 299 299
   query72  5264476148084761
   query73  724 648 339 339
   query74  8869908786028602
   query75  3964318526802680
   query76  36371186767 767
   query77  793 392 287 287
   query78  983810115   93479347
   query79  1991804 571 571
   query80  638 503 438 438
   query81  471 252 214 214
   query82  242 134 96  96
   query83  276 249 232 232
   query84  298 107 77  77
   query85  775 349 311 311
   query86  339 281 307 281
   query87  4423441842154215
   query88  2769220222092202
   query89  452 309 283 283
   query90  2082210 210 210
   query91  148 148 110 110
   query92  74  64  59  59
   query93  1151931 585 585
   query94  672 416 310 310
   query95  372 293 282 282
   query96  490 568 281 281
   query97  3185324131543154
   query98  253 198 200 198
   query99  1364139912751275
   Total cold run time: 272592 ms
   Total hot run time: 185351 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to 

Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]

2025-04-29 Thread via GitHub


doris-robot commented on PR #50080:
URL: https://github.com/apache/doris/pull/50080#issuecomment-2838701601

   
   
   TPC-H: Total hot run time: 34103 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 3e3ace510173441f8b9972f636d2479c5785c6e8, 
data reload: false
   
   -- Round 1 --
   q1   26118   512350415041
   q2   2076282 181 181
   q3   10510   1261718 718
   q4   10226   998 523 523
   q5   7704247822942294
   q6   186 164 130 130
   q7   944 762 621 621
   q8   9331135711721172
   q9   6882512452175124
   q10  6850231719031903
   q11  478 289 273 273
   q12  353 354 211 211
   q13  17778   370730823082
   q14  219 231 217 217
   q15  527 488 491 488
   q16  430 435 369 369
   q17  626 876 392 392
   q18  7771711971407119
   q19  1515982 567 567
   q20  352 350 225 225
   q21  4126338824802480
   q22  10471000973 973
   Total cold run time: 116049 ms
   Total hot run time: 34103 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5160505451085054
   q2   240 325 236 236
   q3   2155264722992299
   q4   1343178814711471
   q5   4574445844094409
   q6   215 172 127 127
   q7   1993195217451745
   q8   2636259026042590
   q9   7233727370537053
   q10  3007321727282728
   q11  569 516 487 487
   q12  690 738 642 642
   q13  3539400232363236
   q14  294 281 279 279
   q15  525 497 461 461
   q16  444 497 442 442
   q17  1208150314301430
   q18  7708769874397439
   q19  815 857 922 857
   q20  1975198818121812
   q21  4988471745134513
   q22  10771040988 988
   Total cold run time: 52388 ms
   Total hot run time: 50298 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]

2025-04-29 Thread via GitHub


bobhan1 commented on PR #50080:
URL: https://github.com/apache/doris/pull/50080#issuecomment-2838385984

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]

2025-04-21 Thread via GitHub


zhannngchen commented on code in PR #50080:
URL: https://github.com/apache/doris/pull/50080#discussion_r2052078374


##
be/src/olap/tablet_meta.cpp:
##
@@ -1390,6 +1391,19 @@ DeleteBitmap::Version 
DeleteBitmap::_get_rowset_cache_version(const BitmapKey& b
 return 0;
 }
 
+void DeleteBitmap::traverse_rowset_id_prefix(
+const std::function& func) const {
+std::shared_lock rlock {lock};
+auto it = delete_bitmap.cbegin();
+while (it != delete_bitmap.cend()) {
+RowsetId rowset_id = std::get<0>(it->first);
+func(rowset_id);
+// find next rowset id
+it = delete_bitmap.upper_bound({rowset_id, 
std::numeric_limits::max(),

Review Comment:
   the key count is not accurate if you skip to next rowsetid



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]

2025-04-18 Thread via GitHub


doris-robot commented on PR #50080:
URL: https://github.com/apache/doris/pull/50080#issuecomment-2814836295

   # BE UT Coverage Report
   Increment line coverage `4.35% (2/46)` :tada:
   
   [Increment coverage 
report](http://coverage.selectdb-in.cc/coverage/04f38c48de0b861180fd9a3e189b91326dbaad9e_04f38c48de0b861180fd9a3e189b91326dbaad9e/increment_report/index.html)
   [Complete coverage 
report](http://coverage.selectdb-in.cc/coverage/04f38c48de0b861180fd9a3e189b91326dbaad9e_04f38c48de0b861180fd9a3e189b91326dbaad9e/report/index.html)
   | Category  | Coverage   |
   |---||
   | Function Coverage | 53.14% (14422/27141) |
   | Line Coverage | 42.00% (124961/297531) |
   | Region Coverage   | 40.82% (63845/156401) |
   | Branch Coverage   | 35.46% (32106/90546) |


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]

2025-04-17 Thread via GitHub


doris-robot commented on PR #50080:
URL: https://github.com/apache/doris/pull/50080#issuecomment-2814615079

   
   
   TPC-DS: Total hot run time: 185923 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 04f38c48de0b861180fd9a3e189b91326dbaad9e, 
data reload: false
   
   query1   1000479 508 479
   query2   6597183518111811
   query3   6748218 219 218
   query4   26906   23770   23364   23364
   query5   4332600 447 447
   query6   311 218 203 203
   query7   4615480 287 287
   query8   280 242 215 215
   query9   8628252525352525
   query10  444 300 250 250
   query11  15397   15508   14810   14810
   query12  154 116 108 108
   query13  1659520 393 393
   query14  9292605460746054
   query15  207 195 165 165
   query16  7198646 472 472
   query17  1192722 540 540
   query18  1957401 288 288
   query19  189 184 150 150
   query20  124 115 111 111
   query21  212 125 102 102
   query22  4312436442954295
   query23  33785   32952   33146   32952
   query24  8395237123562356
   query25  517 435 389 389
   query26  1226264 176 176
   query27  2743488 329 329
   query28  4316210420692069
   query29  759 542 415 415
   query30  283 220 187 187
   query31  953 831 737 737
   query32  76  65  61  61
   query33  546 364 330 330
   query34  787 851 491 491
   query35  789 817 738 738
   query36  945 991 886 886
   query37  105 100 76  76
   query38  4169415842184158
   query39  1452137813751375
   query40  210 114 104 104
   query41  54  54  53  53
   query42  122 104 104 104
   query43  490 484 475 475
   query44  1281790 794 790
   query45  178 170 173 170
   query46  823 1027615 615
   query47  1752179517141714
   query48  362 404 290 290
   query49  779 510 417 417
   query50  630 688 402 402
   query51  4185413941354135
   query52  108 109 96  96
   query53  221 243 185 185
   query54  565 573 497 497
   query55  76  77  80  77
   query56  296 290 298 290
   query57  115410861086
   query58  261 264 245 245
   query59  2604275026372637
   query60  338 308 302 302
   query61  148 152 152 152
   query62  792 730 689 689
   query63  228 194 179 179
   query64  44251007673 673
   query65  4248425342924253
   query66  1132415 307 307
   query67  15674   15517   15265   15265
   query68  7676864 502 502
   query69  463 298 265 265
   query70  1211108510991085
   query71  419 317 287 287
   query72  5336467646844676
   query73  632 578 333 333
   query74  9295912789428942
   query75  3722316827792779
   query76  34461175736 736
   query77  771 351 288 288
   query78  9948999193569356
   query79  2103815 560 560
   query80  565 507 431 431
   query81  506 259 255 255
   query82  477 121 94  94
   query83  252 250 238 238
   query84  251 102 81  81
   query85  833 349 304 304
   query86  379 307 283 283
   query87  4308441343564356
   query88  3834223122412231
   query89  374 312 275 275
   query90  1967205 210 205
   query91  133 133 110 110
   query92  84  58  55  55
   query93  1831952 573 573
   query94  658 405 283 283
   query95  367 293 284 284
   query96  483 561 273 273
   query97  3165324531073107
   query98  241 213 203 203
   query99  1322141012591259
   Total cold run time: 273745 ms
   Total hot run time: 185923 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to 

Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]

2025-04-17 Thread via GitHub


doris-robot commented on PR #50080:
URL: https://github.com/apache/doris/pull/50080#issuecomment-2814623464

   
   
   ClickBench: Total hot run time: 29.37 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 04f38c48de0b861180fd9a3e189b91326dbaad9e, 
data reload: false
   
   query1   0.040.030.03
   query2   0.120.100.11
   query3   0.250.200.19
   query4   1.600.190.19
   query5   0.590.570.58
   query6   1.190.710.71
   query7   0.030.010.02
   query8   0.040.040.04
   query9   0.590.530.51
   query10  0.570.560.57
   query11  0.150.110.10
   query12  0.140.110.11
   query13  0.600.610.59
   query14  1.141.211.19
   query15  0.880.860.84
   query16  0.370.370.40
   query17  1.051.021.02
   query18  0.210.200.20
   query19  1.901.781.74
   query20  0.010.010.02
   query21  15.40   0.900.54
   query22  0.751.160.81
   query23  14.80   1.400.58
   query24  6.971.220.63
   query25  0.460.350.09
   query26  0.460.150.15
   query27  0.050.050.06
   query28  9.380.900.44
   query29  12.56   4.073.34
   query30  0.250.090.06
   query31  2.820.580.37
   query32  3.230.550.46
   query33  2.972.983.06
   query34  15.75   5.054.53
   query35  4.474.554.48
   query36  0.670.490.48
   query37  0.090.060.06
   query38  0.060.030.04
   query39  0.030.030.02
   query40  0.180.140.13
   query41  0.080.020.02
   query42  0.040.030.02
   query43  0.040.030.02
   Total cold run time: 102.98 s
   Total hot run time: 29.37 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]

2025-04-17 Thread via GitHub


doris-robot commented on PR #50080:
URL: https://github.com/apache/doris/pull/50080#issuecomment-2814602061

   
   
   TPC-H: Total hot run time: 34180 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 04f38c48de0b861180fd9a3e189b91326dbaad9e, 
data reload: false
   
   -- Round 1 --
   q1   26387   506150875061
   q2   2079282 196 196
   q3   10507   1245712 712
   q4   10237   1010532 532
   q5   7752238723872387
   q6   184 177 137 137
   q7   915 737 629 629
   q8   9315133711581158
   q9   6844505950775059
   q10  6814228818721872
   q11  475 285 273 273
   q12  338 348 217 217
   q13  17776   365030653065
   q14  220 221 214 214
   q15  538 492 498 492
   q16  437 452 396 396
   q17  619 872 382 382
   q18  7747736171777177
   q19  1785942 549 549
   q20  343 339 224 224
   q21  4089335324892489
   q22  10431037959 959
   Total cold run time: 116444 ms
   Total hot run time: 34180 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5120506850815068
   q2   236 337 239 239
   q3   2147264622862286
   q4   1426182915241524
   q5   4489446543624362
   q6   211 170 129 129
   q7   1963190417591759
   q8   2598251325832513
   q9   7296727871207120
   q10  2992318627382738
   q11  578 496 480 480
   q12  648 758 600 600
   q13  3489384033213321
   q14  271 286 284 284
   q15  515 479 469 469
   q16  478 537 457 457
   q17  1143151914011401
   q18  7713744473537353
   q19  805 792 781 781
   q20  1963202418391839
   q21  5073467345714571
   q22  10291015996 996
   Total cold run time: 52183 ms
   Total hot run time: 50290 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]

2025-04-17 Thread via GitHub


bobhan1 commented on PR #50080:
URL: https://github.com/apache/doris/pull/50080#issuecomment-2814502582

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]

2025-04-16 Thread via GitHub


bobhan1 commented on PR #50080:
URL: https://github.com/apache/doris/pull/50080#issuecomment-2811535140

   run cloud_p0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]

2025-04-16 Thread via GitHub


doris-robot commented on PR #50080:
URL: https://github.com/apache/doris/pull/50080#issuecomment-2808954286

   # BE UT Coverage Report
   Increment line coverage `4.35% (2/46)` :tada:
   
   [Increment coverage 
report](http://coverage.selectdb-in.cc/coverage/fd593d49bd896cc66d0568ed55645450dbf45c64_fd593d49bd896cc66d0568ed55645450dbf45c64/increment_report/index.html)
   [Complete coverage 
report](http://coverage.selectdb-in.cc/coverage/fd593d49bd896cc66d0568ed55645450dbf45c64_fd593d49bd896cc66d0568ed55645450dbf45c64/report/index.html)
   | Category  | Coverage   |
   |---||
   | Function Coverage | 52.81% (14221/26930) |
   | Line Coverage | 41.71% (123442/295953) |
   | Region Coverage   | 40.45% (62872/155436) |
   | Branch Coverage   | 35.07% (31533/89902) |


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]

2025-04-16 Thread via GitHub


doris-robot commented on PR #50080:
URL: https://github.com/apache/doris/pull/50080#issuecomment-2808735173

   
   
   ClickBench: Total hot run time: 30.18 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit fd593d49bd896cc66d0568ed55645450dbf45c64, 
data reload: false
   
   query1   0.040.040.04
   query2   0.120.110.12
   query3   0.260.190.19
   query4   1.600.200.19
   query5   0.600.600.58
   query6   1.180.710.72
   query7   0.020.020.02
   query8   0.050.040.04
   query9   0.570.540.51
   query10  0.580.580.55
   query11  0.170.100.11
   query12  0.150.120.11
   query13  0.610.590.61
   query14  1.161.191.17
   query15  0.890.850.86
   query16  0.380.380.39
   query17  1.021.021.03
   query18  0.210.200.19
   query19  1.911.821.78
   query20  0.010.010.01
   query21  15.41   0.910.53
   query22  0.751.180.69
   query23  14.90   1.400.63
   query24  6.681.521.40
   query25  0.490.260.09
   query26  0.590.150.12
   query27  0.050.050.05
   query28  10.05   0.890.45
   query29  12.71   4.023.31
   query30  0.250.100.06
   query31  2.820.590.38
   query32  3.220.540.46
   query33  3.033.103.11
   query34  15.79   5.074.51
   query35  4.584.564.45
   query36  0.670.500.48
   query37  0.090.060.06
   query38  0.050.040.04
   query39  0.030.030.02
   query40  0.160.140.13
   query41  0.090.030.03
   query42  0.030.020.03
   query43  0.030.030.03
   Total cold run time: 104 s
   Total hot run time: 30.18 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]

2025-04-16 Thread via GitHub


doris-robot commented on PR #50080:
URL: https://github.com/apache/doris/pull/50080#issuecomment-2808722935

   
   
   TPC-DS: Total hot run time: 192159 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit fd593d49bd896cc66d0568ed55645450dbf45c64, 
data reload: false
   
   query1   1431109010631063
   query2   6227182717531753
   query3   11010   453944844484
   query4   54422   25749   23268   23268
   query5   5269495 477 477
   query6   389 208 204 204
   query7   5113487 303 303
   query8   331 263 246 246
   query9   6586258926342589
   query10  443 320 270 270
   query11  15055   14978   14832   14832
   query12  163 110 109 109
   query13  1172508 414 414
   query14  10265   654363076307
   query15  198 200 182 182
   query16  7107674 502 502
   query17  1068741 577 577
   query18  1529396 309 309
   query19  212 198 164 164
   query20  130 121 118 118
   query21  216 129 121 121
   query22  4361438044174380
   query23  34028   33191   33469   33191
   query24  6693244424812444
   query25  478 470 410 410
   query26  678 271 158 158
   query27  2184519 344 344
   query28  3100214921292129
   query29  593 548 424 424
   query30  275 220 185 185
   query31  866 858 784 784
   query32  74  64  73  64
   query33  484 385 314 314
   query34  774 858 531 531
   query35  804 844 771 771
   query36  959 977 886 886
   query37  121 107 87  87
   query38  4148421742744217
   query39  1520141015891410
   query40  218 128 117 117
   query41  58  57  60  57
   query42  127 110 110 110
   query43  500 500 467 467
   query44  1337818 822 818
   query45  183 178 168 168
   query46  862 1035656 656
   query47  1843189718231823
   query48  381 416 310 310
   query49  690 521 438 438
   query50  650 691 432 432
   query51  4224437642284228
   query52  109 106 95  95
   query53  228 261 186 186
   query54  589 578 528 528
   query55  81  78  92  78
   query56  305 328 300 300
   query57  1180117610881088
   query58  266 258 260 258
   query59  2667272026432643
   query60  329 333 304 304
   query61  133 131 137 131
   query62  762 738 685 685
   query63  236 198 188 188
   query64  15271021730 730
   query65  4415423042284228
   query66  723 394 301 301
   query67  15900   15627   15356   15356
   query68  7695874 509 509
   query69  546 346 259 259
   query70  1198113110791079
   query71  524 309 303 303
   query72  5720463846104610
   query73  1213563 350 350
   query74  8984912087038703
   query75  3753321727122712
   query76  43111194770 770
   query77  640 385 290 290
   query78  10044   10160   92569256
   query79  2268820 560 560
   query80  702 511 440 440
   query81  484 253 221 221
   query82  442 123 96  96
   query83  374 247 243 243
   query84  288 108 87  87
   query85  788 337 306 306
   query86  436 294 295 294
   query87  4570450644264426
   query88  3384219922042199
   query89  388 311 282 282
   query90  1934217 218 217
   query91  143 144 112 112
   query92  77  62  59  59
   query93  1817948 574 574
   query94  686 417 308 308
   query95  370 291 280 280
   query96  487 572 275 275
   query97  3158322731343134
   query98  237 210 192 192
   query99  1430141712691269
   Total cold run time: 300090 ms
   Total hot run time: 192159 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go t

Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]

2025-04-16 Thread via GitHub


doris-robot commented on PR #50080:
URL: https://github.com/apache/doris/pull/50080#issuecomment-2808692897

   
   
   TPC-H: Total hot run time: 34704 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit fd593d49bd896cc66d0568ed55645450dbf45c64, 
data reload: false
   
   -- Round 1 --
   q1   26007   509450595059
   q2   2060282 189 189
   q3   10386   1255712 712
   q4   10224   1038549 549
   q5   7549238023362336
   q6   185 169 134 134
   q7   942 764 609 609
   q8   9306128210731073
   q9   6824509951265099
   q10  6873232618851885
   q11  496 285 279 279
   q12  352 362 216 216
   q13  17783   370831053105
   q14  239 222 211 211
   q15  528 480 480 480
   q16  454 445 405 405
   q17  582 871 372 372
   q18  7702725470937093
   q19  1813991 561 561
   q20  336 342 228 228
   q21  3971339931433143
   q22  1067980 966 966
   Total cold run time: 115679 ms
   Total hot run time: 34704 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5233514251015101
   q2   240 329 233 233
   q3   2161267822702270
   q4   1476183815041504
   q5   4470443544324432
   q6   225 175 128 128
   q7   1979192617651765
   q8   2651261226522612
   q9   7327716371637163
   q10  2982322027372737
   q11  577 503 515 503
   q12  660 763 584 584
   q13  3608392833453345
   q14  304 307 294 294
   q15  525 480 478 478
   q16  468 533 467 467
   q17  1192165513811381
   q18  7850762874357435
   q19  846 813 1018813
   q20  2053201418591859
   q21  5380485448454845
   q22  1070107810461046
   Total cold run time: 53277 ms
   Total hot run time: 50995 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]

2025-04-15 Thread via GitHub


bobhan1 commented on PR #50080:
URL: https://github.com/apache/doris/pull/50080#issuecomment-2808470074

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]

2025-04-15 Thread via GitHub


hello-stephen commented on PR #50080:
URL: https://github.com/apache/doris/pull/50080#issuecomment-2808083682

   
   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
   
   Please clearly describe your PR:
   1. What problem was fixed (it's best to include specific error reporting 
information). How it was fixed.
   2. Which behaviors were modified. What was the previous behavior, what is it 
now, why was it modified, and what possible impacts might there be.
   3. What features were added. Why was this function added?
   4. Which code was refactored and why was this part of the code refactored?
   5. Which functions were optimized and what is the difference before and 
after the optimization?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]

2025-04-15 Thread via GitHub


bobhan1 opened a new pull request, #50080:
URL: https://github.com/apache/doris/pull/50080

   ### What problem does this PR solve?
   
   Issue Number: close #xxx
   
   Related PR: #xxx
   
   Problem Summary:
   
   ### Release note
   
   None
   
   ### Check List (For Author)
   
   - Test 
   - [ ] Regression test
   - [ ] Unit Test
   - [ ] Manual test (add detailed scripts or steps below)
   - [ ] No need to test or manual test. Explain why:
   - [ ] This is a refactor/code format and no logic has been changed.
   - [ ] Previous test can cover this change.
   - [ ] No code files have been changed.
   - [ ] Other reason 
   
   - Behavior changed:
   - [ ] No.
   - [ ] Yes. 
   
   - Does this need documentation?
   - [ ] No.
   - [ ] Yes. 
   
   ### Check List (For Reviewer who merge this PR)
   
   - [ ] Confirm the release note
   - [ ] Confirm test cases
   - [ ] Confirm document
   - [ ] Add branch pick label 
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org