Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]
bobhan1 closed pull request #50080: [Opt](metric) Add metrics for invalid delete bitmap key count URL: https://github.com/apache/doris/pull/50080 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]
hello-stephen commented on PR #50080: URL: https://github.com/apache/doris/pull/50080#issuecomment-2840909784 # BE Regression && UT Coverage Report Increment line coverage `20.27% (15/74)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/50080_3e3ace510173441f8b9972f636d2479c5785c6e8_merge/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/50080_3e3ace510173441f8b9972f636d2479c5785c6e8_merge/report/index.html) | Category | Coverage | |---|| | Function Coverage | 80.31% (21257/26468) | | Line Coverage | 74.40% (219282/294729) | | Region Coverage | 72.71% (132071/181653) | | Branch Coverage | 66.02% (67528/102282) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]
bobhan1 commented on PR #50080: URL: https://github.com/apache/doris/pull/50080#issuecomment-2840734099 run p0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]
bobhan1 commented on PR #50080: URL: https://github.com/apache/doris/pull/50080#issuecomment-2840636091 run cloud_p0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]
bobhan1 commented on PR #50080: URL: https://github.com/apache/doris/pull/50080#issuecomment-2840635970 run p0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]
hello-stephen commented on PR #50080: URL: https://github.com/apache/doris/pull/50080#issuecomment-2839692791 # BE Regression P0 && UT Coverage Report Increment line coverage `20.27% (15/74)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/50080_3e3ace510173441f8b9972f636d2479c5785c6e8_merge/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/50080_3e3ace510173441f8b9972f636d2479c5785c6e8_merge/report/index.html) | Category | Coverage | |---|| | Function Coverage | 78.13% (20680/26468) | | Line Coverage | 71.70% (211328/294729) | | Region Coverage | 69.88% (126939/181653) | | Branch Coverage | 63.14% (64585/102282) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]
hello-stephen commented on PR #50080: URL: https://github.com/apache/doris/pull/50080#issuecomment-2839170749 # BE UT Coverage Report Increment line coverage `3.70% (2/54)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/3e3ace510173441f8b9972f636d2479c5785c6e8_3e3ace510173441f8b9972f636d2479c5785c6e8/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/3e3ace510173441f8b9972f636d2479c5785c6e8_3e3ace510173441f8b9972f636d2479c5785c6e8/report/index.html) | Category | Coverage | |---|| | Function Coverage | 54.79% (14774/26963) | | Line Coverage | 43.91% (129632/295194) | | Region Coverage | 42.62% (66168/155240) | | Branch Coverage | 37.22% (33395/89716) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]
doris-robot commented on PR #50080: URL: https://github.com/apache/doris/pull/50080#issuecomment-2838798773 ClickBench: Total hot run time: 29.24 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 3e3ace510173441f8b9972f636d2479c5785c6e8, data reload: false query1 0.030.030.03 query2 0.120.100.10 query3 0.260.200.20 query4 1.590.200.11 query5 0.560.570.53 query6 1.200.720.72 query7 0.020.020.02 query8 0.040.030.03 query9 0.570.510.52 query10 0.590.570.57 query11 0.150.110.12 query12 0.150.120.12 query13 0.610.600.59 query14 0.800.790.80 query15 0.870.860.86 query16 0.370.380.37 query17 1.021.041.03 query18 0.200.200.20 query19 1.891.741.86 query20 0.010.020.01 query21 15.43 0.900.56 query22 0.761.220.71 query23 14.84 1.400.61 query24 7.001.320.80 query25 0.500.180.06 query26 0.580.170.15 query27 0.050.050.05 query28 9.070.850.45 query29 12.55 4.013.35 query30 0.250.100.06 query31 2.820.600.38 query32 3.230.560.49 query33 2.973.033.08 query34 15.88 5.134.55 query35 4.534.594.55 query36 0.660.490.48 query37 0.090.070.06 query38 0.050.040.04 query39 0.030.020.02 query40 0.180.140.13 query41 0.080.030.02 query42 0.030.030.02 query43 0.040.030.03 Total cold run time: 102.67 s Total hot run time: 29.24 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]
doris-robot commented on PR #50080: URL: https://github.com/apache/doris/pull/50080#issuecomment-2838765011 TPC-DS: Total hot run time: 185351 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 3e3ace510173441f8b9972f636d2479c5785c6e8, data reload: false query1 1025471 490 471 query2 6552192418811881 query3 6740224 219 219 query4 26241 23399 23555 23399 query5 4396654 461 461 query6 306 216 206 206 query7 4638482 281 281 query8 290 233 230 230 query9 8581259926092599 query10 489 318 258 258 query11 15600 15064 14847 14847 query12 155 110 102 102 query13 1660543 403 403 query14 8819616859935993 query15 204 185 180 180 query16 7138667 489 489 query17 1227749 581 581 query18 1988412 311 311 query19 197 192 157 157 query20 125 126 127 126 query21 214 128 111 111 query22 4061427240074007 query23 34191 32776 32935 32776 query24 8271240224092402 query25 608 445 389 389 query26 1233267 152 152 query27 2745484 333 333 query28 4320209921052099 query29 777 549 428 428 query30 281 218 189 189 query31 928 859 768 768 query32 72 68 68 68 query33 559 403 313 313 query34 796 856 510 510 query35 765 813 740 740 query36 953 985 876 876 query37 111 104 76 76 query38 4148412540814081 query39 1462142913751375 query40 212 119 105 105 query41 58 57 56 56 query42 116 105 105 105 query43 507 526 488 488 query44 1306788 787 787 query45 180 177 174 174 query46 863 1042628 628 query47 1749175516871687 query48 366 415 298 298 query49 780 501 399 399 query50 658 684 418 418 query51 4058416941214121 query52 114 107 96 96 query53 231 267 185 185 query54 580 576 523 523 query55 83 84 81 81 query56 300 307 291 291 query57 1123120310761076 query58 266 245 254 245 query59 2690277626792679 query60 316 326 312 312 query61 130 126 130 126 query62 778 731 640 640 query63 223 185 185 185 query64 43601014668 668 query65 4320422942514229 query66 1165414 327 327 query67 15959 15392 15226 15226 query68 8564880 506 506 query69 469 313 273 273 query70 1178106410811064 query71 470 370 299 299 query72 5264476148084761 query73 724 648 339 339 query74 8869908786028602 query75 3964318526802680 query76 36371186767 767 query77 793 392 287 287 query78 983810115 93479347 query79 1991804 571 571 query80 638 503 438 438 query81 471 252 214 214 query82 242 134 96 96 query83 276 249 232 232 query84 298 107 77 77 query85 775 349 311 311 query86 339 281 307 281 query87 4423441842154215 query88 2769220222092202 query89 452 309 283 283 query90 2082210 210 210 query91 148 148 110 110 query92 74 64 59 59 query93 1151931 585 585 query94 672 416 310 310 query95 372 293 282 282 query96 490 568 281 281 query97 3185324131543154 query98 253 198 200 198 query99 1364139912751275 Total cold run time: 272592 ms Total hot run time: 185351 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]
doris-robot commented on PR #50080: URL: https://github.com/apache/doris/pull/50080#issuecomment-2838701601 TPC-H: Total hot run time: 34103 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 3e3ace510173441f8b9972f636d2479c5785c6e8, data reload: false -- Round 1 -- q1 26118 512350415041 q2 2076282 181 181 q3 10510 1261718 718 q4 10226 998 523 523 q5 7704247822942294 q6 186 164 130 130 q7 944 762 621 621 q8 9331135711721172 q9 6882512452175124 q10 6850231719031903 q11 478 289 273 273 q12 353 354 211 211 q13 17778 370730823082 q14 219 231 217 217 q15 527 488 491 488 q16 430 435 369 369 q17 626 876 392 392 q18 7771711971407119 q19 1515982 567 567 q20 352 350 225 225 q21 4126338824802480 q22 10471000973 973 Total cold run time: 116049 ms Total hot run time: 34103 ms - Round 2, with runtime_filter_mode=off - q1 5160505451085054 q2 240 325 236 236 q3 2155264722992299 q4 1343178814711471 q5 4574445844094409 q6 215 172 127 127 q7 1993195217451745 q8 2636259026042590 q9 7233727370537053 q10 3007321727282728 q11 569 516 487 487 q12 690 738 642 642 q13 3539400232363236 q14 294 281 279 279 q15 525 497 461 461 q16 444 497 442 442 q17 1208150314301430 q18 7708769874397439 q19 815 857 922 857 q20 1975198818121812 q21 4988471745134513 q22 10771040988 988 Total cold run time: 52388 ms Total hot run time: 50298 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]
bobhan1 commented on PR #50080: URL: https://github.com/apache/doris/pull/50080#issuecomment-2838385984 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]
zhannngchen commented on code in PR #50080: URL: https://github.com/apache/doris/pull/50080#discussion_r2052078374 ## be/src/olap/tablet_meta.cpp: ## @@ -1390,6 +1391,19 @@ DeleteBitmap::Version DeleteBitmap::_get_rowset_cache_version(const BitmapKey& b return 0; } +void DeleteBitmap::traverse_rowset_id_prefix( +const std::function& func) const { +std::shared_lock rlock {lock}; +auto it = delete_bitmap.cbegin(); +while (it != delete_bitmap.cend()) { +RowsetId rowset_id = std::get<0>(it->first); +func(rowset_id); +// find next rowset id +it = delete_bitmap.upper_bound({rowset_id, std::numeric_limits::max(), Review Comment: the key count is not accurate if you skip to next rowsetid -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]
doris-robot commented on PR #50080: URL: https://github.com/apache/doris/pull/50080#issuecomment-2814836295 # BE UT Coverage Report Increment line coverage `4.35% (2/46)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/04f38c48de0b861180fd9a3e189b91326dbaad9e_04f38c48de0b861180fd9a3e189b91326dbaad9e/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/04f38c48de0b861180fd9a3e189b91326dbaad9e_04f38c48de0b861180fd9a3e189b91326dbaad9e/report/index.html) | Category | Coverage | |---|| | Function Coverage | 53.14% (14422/27141) | | Line Coverage | 42.00% (124961/297531) | | Region Coverage | 40.82% (63845/156401) | | Branch Coverage | 35.46% (32106/90546) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]
doris-robot commented on PR #50080: URL: https://github.com/apache/doris/pull/50080#issuecomment-2814615079 TPC-DS: Total hot run time: 185923 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 04f38c48de0b861180fd9a3e189b91326dbaad9e, data reload: false query1 1000479 508 479 query2 6597183518111811 query3 6748218 219 218 query4 26906 23770 23364 23364 query5 4332600 447 447 query6 311 218 203 203 query7 4615480 287 287 query8 280 242 215 215 query9 8628252525352525 query10 444 300 250 250 query11 15397 15508 14810 14810 query12 154 116 108 108 query13 1659520 393 393 query14 9292605460746054 query15 207 195 165 165 query16 7198646 472 472 query17 1192722 540 540 query18 1957401 288 288 query19 189 184 150 150 query20 124 115 111 111 query21 212 125 102 102 query22 4312436442954295 query23 33785 32952 33146 32952 query24 8395237123562356 query25 517 435 389 389 query26 1226264 176 176 query27 2743488 329 329 query28 4316210420692069 query29 759 542 415 415 query30 283 220 187 187 query31 953 831 737 737 query32 76 65 61 61 query33 546 364 330 330 query34 787 851 491 491 query35 789 817 738 738 query36 945 991 886 886 query37 105 100 76 76 query38 4169415842184158 query39 1452137813751375 query40 210 114 104 104 query41 54 54 53 53 query42 122 104 104 104 query43 490 484 475 475 query44 1281790 794 790 query45 178 170 173 170 query46 823 1027615 615 query47 1752179517141714 query48 362 404 290 290 query49 779 510 417 417 query50 630 688 402 402 query51 4185413941354135 query52 108 109 96 96 query53 221 243 185 185 query54 565 573 497 497 query55 76 77 80 77 query56 296 290 298 290 query57 115410861086 query58 261 264 245 245 query59 2604275026372637 query60 338 308 302 302 query61 148 152 152 152 query62 792 730 689 689 query63 228 194 179 179 query64 44251007673 673 query65 4248425342924253 query66 1132415 307 307 query67 15674 15517 15265 15265 query68 7676864 502 502 query69 463 298 265 265 query70 1211108510991085 query71 419 317 287 287 query72 5336467646844676 query73 632 578 333 333 query74 9295912789428942 query75 3722316827792779 query76 34461175736 736 query77 771 351 288 288 query78 9948999193569356 query79 2103815 560 560 query80 565 507 431 431 query81 506 259 255 255 query82 477 121 94 94 query83 252 250 238 238 query84 251 102 81 81 query85 833 349 304 304 query86 379 307 283 283 query87 4308441343564356 query88 3834223122412231 query89 374 312 275 275 query90 1967205 210 205 query91 133 133 110 110 query92 84 58 55 55 query93 1831952 573 573 query94 658 405 283 283 query95 367 293 284 284 query96 483 561 273 273 query97 3165324531073107 query98 241 213 203 203 query99 1322141012591259 Total cold run time: 273745 ms Total hot run time: 185923 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]
doris-robot commented on PR #50080: URL: https://github.com/apache/doris/pull/50080#issuecomment-2814623464 ClickBench: Total hot run time: 29.37 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 04f38c48de0b861180fd9a3e189b91326dbaad9e, data reload: false query1 0.040.030.03 query2 0.120.100.11 query3 0.250.200.19 query4 1.600.190.19 query5 0.590.570.58 query6 1.190.710.71 query7 0.030.010.02 query8 0.040.040.04 query9 0.590.530.51 query10 0.570.560.57 query11 0.150.110.10 query12 0.140.110.11 query13 0.600.610.59 query14 1.141.211.19 query15 0.880.860.84 query16 0.370.370.40 query17 1.051.021.02 query18 0.210.200.20 query19 1.901.781.74 query20 0.010.010.02 query21 15.40 0.900.54 query22 0.751.160.81 query23 14.80 1.400.58 query24 6.971.220.63 query25 0.460.350.09 query26 0.460.150.15 query27 0.050.050.06 query28 9.380.900.44 query29 12.56 4.073.34 query30 0.250.090.06 query31 2.820.580.37 query32 3.230.550.46 query33 2.972.983.06 query34 15.75 5.054.53 query35 4.474.554.48 query36 0.670.490.48 query37 0.090.060.06 query38 0.060.030.04 query39 0.030.030.02 query40 0.180.140.13 query41 0.080.020.02 query42 0.040.030.02 query43 0.040.030.02 Total cold run time: 102.98 s Total hot run time: 29.37 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]
doris-robot commented on PR #50080: URL: https://github.com/apache/doris/pull/50080#issuecomment-2814602061 TPC-H: Total hot run time: 34180 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 04f38c48de0b861180fd9a3e189b91326dbaad9e, data reload: false -- Round 1 -- q1 26387 506150875061 q2 2079282 196 196 q3 10507 1245712 712 q4 10237 1010532 532 q5 7752238723872387 q6 184 177 137 137 q7 915 737 629 629 q8 9315133711581158 q9 6844505950775059 q10 6814228818721872 q11 475 285 273 273 q12 338 348 217 217 q13 17776 365030653065 q14 220 221 214 214 q15 538 492 498 492 q16 437 452 396 396 q17 619 872 382 382 q18 7747736171777177 q19 1785942 549 549 q20 343 339 224 224 q21 4089335324892489 q22 10431037959 959 Total cold run time: 116444 ms Total hot run time: 34180 ms - Round 2, with runtime_filter_mode=off - q1 5120506850815068 q2 236 337 239 239 q3 2147264622862286 q4 1426182915241524 q5 4489446543624362 q6 211 170 129 129 q7 1963190417591759 q8 2598251325832513 q9 7296727871207120 q10 2992318627382738 q11 578 496 480 480 q12 648 758 600 600 q13 3489384033213321 q14 271 286 284 284 q15 515 479 469 469 q16 478 537 457 457 q17 1143151914011401 q18 7713744473537353 q19 805 792 781 781 q20 1963202418391839 q21 5073467345714571 q22 10291015996 996 Total cold run time: 52183 ms Total hot run time: 50290 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]
bobhan1 commented on PR #50080: URL: https://github.com/apache/doris/pull/50080#issuecomment-2814502582 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]
bobhan1 commented on PR #50080: URL: https://github.com/apache/doris/pull/50080#issuecomment-2811535140 run cloud_p0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]
doris-robot commented on PR #50080: URL: https://github.com/apache/doris/pull/50080#issuecomment-2808954286 # BE UT Coverage Report Increment line coverage `4.35% (2/46)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/fd593d49bd896cc66d0568ed55645450dbf45c64_fd593d49bd896cc66d0568ed55645450dbf45c64/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/fd593d49bd896cc66d0568ed55645450dbf45c64_fd593d49bd896cc66d0568ed55645450dbf45c64/report/index.html) | Category | Coverage | |---|| | Function Coverage | 52.81% (14221/26930) | | Line Coverage | 41.71% (123442/295953) | | Region Coverage | 40.45% (62872/155436) | | Branch Coverage | 35.07% (31533/89902) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]
doris-robot commented on PR #50080: URL: https://github.com/apache/doris/pull/50080#issuecomment-2808735173 ClickBench: Total hot run time: 30.18 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit fd593d49bd896cc66d0568ed55645450dbf45c64, data reload: false query1 0.040.040.04 query2 0.120.110.12 query3 0.260.190.19 query4 1.600.200.19 query5 0.600.600.58 query6 1.180.710.72 query7 0.020.020.02 query8 0.050.040.04 query9 0.570.540.51 query10 0.580.580.55 query11 0.170.100.11 query12 0.150.120.11 query13 0.610.590.61 query14 1.161.191.17 query15 0.890.850.86 query16 0.380.380.39 query17 1.021.021.03 query18 0.210.200.19 query19 1.911.821.78 query20 0.010.010.01 query21 15.41 0.910.53 query22 0.751.180.69 query23 14.90 1.400.63 query24 6.681.521.40 query25 0.490.260.09 query26 0.590.150.12 query27 0.050.050.05 query28 10.05 0.890.45 query29 12.71 4.023.31 query30 0.250.100.06 query31 2.820.590.38 query32 3.220.540.46 query33 3.033.103.11 query34 15.79 5.074.51 query35 4.584.564.45 query36 0.670.500.48 query37 0.090.060.06 query38 0.050.040.04 query39 0.030.030.02 query40 0.160.140.13 query41 0.090.030.03 query42 0.030.020.03 query43 0.030.030.03 Total cold run time: 104 s Total hot run time: 30.18 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]
doris-robot commented on PR #50080: URL: https://github.com/apache/doris/pull/50080#issuecomment-2808722935 TPC-DS: Total hot run time: 192159 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit fd593d49bd896cc66d0568ed55645450dbf45c64, data reload: false query1 1431109010631063 query2 6227182717531753 query3 11010 453944844484 query4 54422 25749 23268 23268 query5 5269495 477 477 query6 389 208 204 204 query7 5113487 303 303 query8 331 263 246 246 query9 6586258926342589 query10 443 320 270 270 query11 15055 14978 14832 14832 query12 163 110 109 109 query13 1172508 414 414 query14 10265 654363076307 query15 198 200 182 182 query16 7107674 502 502 query17 1068741 577 577 query18 1529396 309 309 query19 212 198 164 164 query20 130 121 118 118 query21 216 129 121 121 query22 4361438044174380 query23 34028 33191 33469 33191 query24 6693244424812444 query25 478 470 410 410 query26 678 271 158 158 query27 2184519 344 344 query28 3100214921292129 query29 593 548 424 424 query30 275 220 185 185 query31 866 858 784 784 query32 74 64 73 64 query33 484 385 314 314 query34 774 858 531 531 query35 804 844 771 771 query36 959 977 886 886 query37 121 107 87 87 query38 4148421742744217 query39 1520141015891410 query40 218 128 117 117 query41 58 57 60 57 query42 127 110 110 110 query43 500 500 467 467 query44 1337818 822 818 query45 183 178 168 168 query46 862 1035656 656 query47 1843189718231823 query48 381 416 310 310 query49 690 521 438 438 query50 650 691 432 432 query51 4224437642284228 query52 109 106 95 95 query53 228 261 186 186 query54 589 578 528 528 query55 81 78 92 78 query56 305 328 300 300 query57 1180117610881088 query58 266 258 260 258 query59 2667272026432643 query60 329 333 304 304 query61 133 131 137 131 query62 762 738 685 685 query63 236 198 188 188 query64 15271021730 730 query65 4415423042284228 query66 723 394 301 301 query67 15900 15627 15356 15356 query68 7695874 509 509 query69 546 346 259 259 query70 1198113110791079 query71 524 309 303 303 query72 5720463846104610 query73 1213563 350 350 query74 8984912087038703 query75 3753321727122712 query76 43111194770 770 query77 640 385 290 290 query78 10044 10160 92569256 query79 2268820 560 560 query80 702 511 440 440 query81 484 253 221 221 query82 442 123 96 96 query83 374 247 243 243 query84 288 108 87 87 query85 788 337 306 306 query86 436 294 295 294 query87 4570450644264426 query88 3384219922042199 query89 388 311 282 282 query90 1934217 218 217 query91 143 144 112 112 query92 77 62 59 59 query93 1817948 574 574 query94 686 417 308 308 query95 370 291 280 280 query96 487 572 275 275 query97 3158322731343134 query98 237 210 192 192 query99 1430141712691269 Total cold run time: 300090 ms Total hot run time: 192159 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]
doris-robot commented on PR #50080: URL: https://github.com/apache/doris/pull/50080#issuecomment-2808692897 TPC-H: Total hot run time: 34704 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit fd593d49bd896cc66d0568ed55645450dbf45c64, data reload: false -- Round 1 -- q1 26007 509450595059 q2 2060282 189 189 q3 10386 1255712 712 q4 10224 1038549 549 q5 7549238023362336 q6 185 169 134 134 q7 942 764 609 609 q8 9306128210731073 q9 6824509951265099 q10 6873232618851885 q11 496 285 279 279 q12 352 362 216 216 q13 17783 370831053105 q14 239 222 211 211 q15 528 480 480 480 q16 454 445 405 405 q17 582 871 372 372 q18 7702725470937093 q19 1813991 561 561 q20 336 342 228 228 q21 3971339931433143 q22 1067980 966 966 Total cold run time: 115679 ms Total hot run time: 34704 ms - Round 2, with runtime_filter_mode=off - q1 5233514251015101 q2 240 329 233 233 q3 2161267822702270 q4 1476183815041504 q5 4470443544324432 q6 225 175 128 128 q7 1979192617651765 q8 2651261226522612 q9 7327716371637163 q10 2982322027372737 q11 577 503 515 503 q12 660 763 584 584 q13 3608392833453345 q14 304 307 294 294 q15 525 480 478 478 q16 468 533 467 467 q17 1192165513811381 q18 7850762874357435 q19 846 813 1018813 q20 2053201418591859 q21 5380485448454845 q22 1070107810461046 Total cold run time: 53277 ms Total hot run time: 50995 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]
bobhan1 commented on PR #50080: URL: https://github.com/apache/doris/pull/50080#issuecomment-2808470074 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]
hello-stephen commented on PR #50080: URL: https://github.com/apache/doris/pull/50080#issuecomment-2808083682 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [Opt](metric) Add metrics for invalid delete bitmap key count [doris]
bobhan1 opened a new pull request, #50080: URL: https://github.com/apache/doris/pull/50080 ### What problem does this PR solve? Issue Number: close #xxx Related PR: #xxx Problem Summary: ### Release note None ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [ ] No. - [ ] Yes. - Does this need documentation? - [ ] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org