Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
github-actions[bot] commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3626588831 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
github-actions[bot] commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3626589151 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
hello-stephen commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3625969906 # BE Regression && UT Coverage Report Increment line coverage `87.18% (993/1139)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/57770_175a739557d7e675ea2db134d8052ebc603aa9e4_merge/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/57770_175a739557d7e675ea2db134d8052ebc603aa9e4_merge/report/index.html) | Category | Coverage | |---|| | Function Coverage | 72.24% (24827/34366) | | Line Coverage | 58.98% (260750/442064) | | Region Coverage | 53.93% (216947/402307) | | Branch Coverage | 55.46% (92706/167146) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
hello-stephen commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3625643835 # BE UT Coverage Report Increment line coverage `74.35% (922/1240)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/175a739557d7e675ea2db134d8052ebc603aa9e4_175a739557d7e675ea2db134d8052ebc603aa9e4/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/175a739557d7e675ea2db134d8052ebc603aa9e4_175a739557d7e675ea2db134d8052ebc603aa9e4/report/index.html) | Category | Coverage | |---|| | Function Coverage | 53.35% (18705/35062) | | Line Coverage | 39.05% (172794/442540) | | Region Coverage | 33.70% (134005/397582) | | Branch Coverage | 34.61% (57539/166271) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
luwei16 commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3625599298 run feut -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
luwei16 commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3625600143 run vault_p0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3625312850 ClickBench: Total hot run time: 27.59 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 175a739557d7e675ea2db134d8052ebc603aa9e4, data reload: false query1 0.050.050.05 query2 0.100.050.05 query3 0.260.080.08 query4 1.600.110.11 query5 0.410.360.32 query6 1.170.790.62 query7 0.030.020.03 query8 0.050.050.04 query9 0.580.510.51 query10 0.560.580.55 query11 0.150.100.11 query12 0.140.120.11 query13 0.620.600.59 query14 0.981.000.99 query15 0.810.790.79 query16 0.420.400.40 query17 1.051.071.08 query18 0.240.220.21 query19 1.821.851.79 query20 0.020.030.01 query21 15.42 0.280.13 query22 4.730.060.04 query23 15.87 0.270.10 query24 2.330.480.71 query25 0.100.060.07 query26 0.140.140.13 query27 0.090.040.04 query28 5.341.201.01 query29 12.62 3.953.18 query30 0.290.140.12 query31 2.830.620.39 query32 3.230.560.46 query33 2.993.053.07 query34 17.01 5.214.62 query35 4.584.544.62 query36 0.680.490.49 query37 0.110.070.06 query38 0.070.040.03 query39 0.040.020.03 query40 0.180.140.14 query41 0.090.030.03 query42 0.040.030.03 query43 0.040.030.03 Total cold run time: 99.88 s Total hot run time: 27.59 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3625299898 TPC-DS: Total hot run time: 180289 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 175a739557d7e675ea2db134d8052ebc603aa9e4, data reload: false query5 5206663 508 508 query6 368 252 230 230 query7 4680493 280 280 query8 338 260 251 251 query9 8744265326532653 query10 591 322 292 292 query11 15540 14715 14637 14637 query12 185 121 116 116 query13 1692508 380 380 query14 6320339231513151 query14_13019297729292929 query15 212 201 186 186 query16 7696509 476 476 query17 1270735 614 614 query18 2058438 348 348 query19 223 197 168 168 query20 135 123 120 120 query21 224 142 114 114 query22 3888395138223822 query23 16710 16117 15994 15994 query23_116040 16041 16044 16041 query24 7137164212451245 query24_11243122812371228 query25 697 464 431 431 query26 1258271 169 169 query27 2916469 302 302 query28 4364215921422142 query29 818 580 448 448 query30 326 240 208 208 query31 815 709 624 624 query32 81 71 76 71 query33 704 368 302 302 query34 879 897 567 567 query35 802 824 745 745 query36 893 954 860 860 query37 121 93 90 90 query38 3873383437633763 query39 754 754 725 725 query39_1716 702 694 694 query40 229 132 125 125 query41 71 64 63 63 query42 125 103 102 102 query43 443 426 399 399 query44 1365778 766 766 query45 202 190 187 187 query46 897 964 604 604 query47 1671168016031603 query48 406 338 232 232 query49 748 442 358 358 query50 678 303 249 249 query51 3989388638483848 query52 119 100 88 88 query53 247 233 190 190 query54 328 264 246 246 query55 101 83 75 75 query56 349 282 298 282 query57 1129114911141114 query58 298 264 256 256 query59 2329236023372337 query60 364 311 302 302 query61 164 166 167 166 query62 791 675 631 631 query63 234 179 181 179 query64 45781175897 897 query65 4078398239363936 query66 1176461 371 371 query67 15166 15050 14775 14775 query68 5547978 660 660 query69 515 294 271 271 query70 11221027957 957 query71 461 292 278 278 query72 6002521749284928 query73 670 546 301 301 query74 8793890286248624 query75 3058302425412541 query76 33181165753 753 query77 528 414 317 317 query78 9399952488938893 query79 1709915 622 622 query80 666 565 457 457 query81 530 267 248 248 query82 467 136 106 106 query83 277 275 256 256 query84 271 114 94 94 query85 941 498 458 458 query86 385 284 289 284 query87 4145405738913891 query88 4202213321532133 query89 399 318 279 279 query90 2064173 162 162 query91 176 171 141 141 query92 83 66 67 66 query93 18451022671 671 query94 785 312 272 272 query95 575 339 384 339 query96 534 505 214 214 query97 2647266125822582 query98 251 205 201 201 query99 1401134012421242 Total cold run time: 269589 ms Total hot run time: 180289 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3625274895 TPC-H: Total hot run time: 35665 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 175a739557d7e675ea2db134d8052ebc603aa9e4, data reload: false -- Round 1 -- q1 17666 510549254925 q2 2055318 209 209 q3 10217 1308737 737 q4 10220 842 315 315 q5 7510238222742274 q6 187 170 136 136 q7 953 780 635 635 q8 9359147211521152 q9 7388541154045404 q10 6879222118261826 q11 541 315 304 304 q12 399 374 230 230 q13 17794 366229992999 q14 235 237 212 212 q15 590 524 517 517 q16 913 877 826 826 q17 687 842 484 484 q18 8206820378777877 q19 13441007631 631 q20 397 351 229 229 q21 4439406926952695 q22 1174106710481048 Total cold run time: 109153 ms Total hot run time: 35665 ms - Round 2, with runtime_filter_mode=off - q1 5327516651945166 q2 299 415 301 301 q3 2309285825062506 q4 1498185514131413 q5 4557426141544154 q6 203 164 122 122 q7 1880181616261626 q8 2560237123512351 q9 7059699469836983 q10 2900309626302630 q11 569 504 471 471 q12 648 705 575 575 q13 3271368230423042 q14 277 273 269 269 q15 529 495 484 484 q16 852 891 844 844 q17 1122141713831383 q18 7227713771567137 q19 846 790 848 790 q20 1884197517981798 q21 4647419041624162 q22 10701043980 980 Total cold run time: 51534 ms Total hot run time: 49187 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3624997243 # Cloud UT Coverage Report Increment line coverage `43.76% (522/1193)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/175a739557d7e675ea2db134d8052ebc603aa9e4_175a739557d7e675ea2db134d8052ebc603aa9e4_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/175a739557d7e675ea2db134d8052ebc603aa9e4_175a739557d7e675ea2db134d8052ebc603aa9e4_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 79.81% (1727/2164) | | Line Coverage | 65.94% (30574/46366) | | Region Coverage | 66.63% (15253/22893) | | Branch Coverage | 56.88% (8107/14252) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
liaoxin01 commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3624795774 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
hello-stephen commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3622551883 # FE UT Coverage Report Increment line coverage `` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/57770_ab695fc167026cc855f12129497813c8875ff4cc/fe_increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/57770_ab695fc167026cc855f12129497813c8875ff4cc/fe_report/index.html) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3622547366 ClickBench: Total hot run time: 28.42 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit ab695fc167026cc855f12129497813c8875ff4cc, data reload: false query1 0.050.050.04 query2 0.130.070.08 query3 0.310.080.09 query4 1.610.100.09 query5 0.260.250.25 query6 1.180.650.64 query7 0.030.030.02 query8 0.070.060.06 query9 0.600.510.50 query10 0.550.560.54 query11 0.260.140.13 query12 0.280.140.14 query13 0.640.630.60 query14 1.011.011.00 query15 0.880.830.83 query16 0.400.390.39 query17 1.031.061.05 query18 0.230.230.22 query19 1.841.851.86 query20 0.020.010.01 query21 15.39 0.280.24 query22 5.030.090.09 query23 15.39 0.390.22 query24 2.430.470.30 query25 0.090.080.09 query26 0.180.180.17 query27 0.090.090.09 query28 3.721.351.16 query29 12.59 4.193.34 query30 0.320.130.10 query31 2.820.650.45 query32 3.240.620.49 query33 3.023.043.06 query34 16.76 5.254.53 query35 4.624.604.70 query36 0.610.490.49 query37 0.240.080.08 query38 0.200.060.06 query39 0.070.050.05 query40 0.200.170.17 query41 0.130.060.06 query42 0.080.050.05 query43 0.060.060.05 Total cold run time: 98.66 s Total hot run time: 28.42 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3622534604 TPC-DS: Total hot run time: 179313 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit ab695fc167026cc855f12129497813c8875ff4cc, data reload: false query5 4410657 521 521 query6 328 232 207 207 query7 4645471 280 280 query8 309 249 231 231 query9 8716257926002579 query10 500 324 278 278 query11 15127 14901 14686 14686 query12 172 119 113 113 query13 1674481 360 360 query14 5491323329532953 query14_12904287929072879 query15 213 193 182 182 query16 7203481 433 433 query17 1229684 617 617 query18 1990419 326 326 query19 205 183 152 152 query20 125 120 121 120 query21 214 132 114 114 query22 4006400537993799 query23 16783 16182 15950 15950 query23_115982 16019 16045 16019 query24 7039172811811181 query24_11179119712191197 query25 614 466 415 415 query26 1264271 164 164 query27 2904484 318 318 query28 4332215321102110 query29 847 550 450 450 query30 312 248 215 215 query31 817 717 642 642 query32 82 71 70 70 query33 671 338 285 285 query34 882 892 543 543 query35 782 827 730 730 query36 888 900 842 842 query37 123 101 76 76 query38 3898379238063792 query39 770 731 730 730 query39_1698 733 696 696 query40 232 128 119 119 query41 66 62 62 62 query42 127 103 96 96 query43 445 419 389 389 query44 1313746 745 745 query45 194 194 185 185 query46 891 965 586 586 query47 1669171716301630 query48 409 343 234 234 query49 767 445 358 358 query50 684 320 236 236 query51 3876389138193819 query52 122 98 89 89 query53 238 234 178 178 query54 337 297 262 262 query55 104 85 81 81 query56 362 328 320 320 query57 1168113010901090 query58 309 271 263 263 query59 2327244123652365 query60 382 339 321 321 query61 195 187 190 187 query62 799 691 641 641 query63 246 183 185 183 query64 4607131610271027 query65 4105402740714027 query66 1264466 354 354 query67 15773 15230 14625 14625 query68 7860947 670 670 query69 538 325 269 269 query70 11091026948 948 query71 417 298 273 273 query72 6080482647844784 query73 689 542 301 301 query74 8942890385688568 query75 3019304225522552 query76 1143759 759 query77 525 405 287 287 query78 9386962289338933 query79 1766820 587 587 query80 646 547 468 468 query81 493 269 235 235 query82 420 126 108 108 query83 270 276 261 261 query84 255 119 91 91 query85 951 490 446 446 query86 374 323 279 279 query87 4000402939463946 query88 4182215021882150 query89 394 322 286 286 query90 1999168 154 154 query91 171 165 141 141 query92 88 70 61 61 query93 19271035680 680 query94 794 306 269 269 query95 563 341 372 341 query96 543 496 213 213 query97 2606269925682568 query98 258 206 195 195 query99 1353135412111211 Total cold run time: 269318 ms Total hot run time: 179313 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3622508246 TPC-H: Total hot run time: 33789 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit ab695fc167026cc855f12129497813c8875ff4cc, data reload: false -- Round 1 -- q1 16464 516149284928 q2 1997294 193 193 q3 97451324722 722 q4 9677877 307 307 q5 7310238021322132 q6 184 165 133 133 q7 929 773 621 621 q8 9036138310351035 q9 6899526053015260 q10 6784217617631763 q11 512 315 284 284 q12 337 362 216 216 q13 17234 369230083008 q14 234 238 213 213 q15 573 514 523 514 q16 907 867 822 822 q17 668 786 533 533 q18 7326698470126984 q19 1134957 623 623 q20 373 349 217 217 q21 3901326523452345 q22 1040992 936 936 Total cold run time: 103264 ms Total hot run time: 33789 ms - Round 2, with runtime_filter_mode=off - q1 5051495849554955 q2 324 408 324 324 q3 2120263823172317 q4 1322170812941294 q5 4218414643624146 q6 222 187 135 135 q7 2112193618371837 q8 2682258824932493 q9 7372738775327387 q10 3103331628012801 q11 589 525 475 475 q12 699 792 649 649 q13 3528385032763276 q14 289 299 293 293 q15 574 525 499 499 q16 915 920 895 895 q17 1221154515221522 q18 7655776874777477 q19 944 964 961 961 q20 1948206418421842 q21 5054450542984298 q22 10541056983 983 Total cold run time: 52996 ms Total hot run time: 50859 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3622446579 # Cloud UT Coverage Report Increment line coverage `43.76% (522/1193)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/ab695fc167026cc855f12129497813c8875ff4cc_ab695fc167026cc855f12129497813c8875ff4cc_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/ab695fc167026cc855f12129497813c8875ff4cc_ab695fc167026cc855f12129497813c8875ff4cc_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 79.81% (1727/2164) | | Line Coverage | 65.92% (30566/46366) | | Region Coverage | 66.56% (15237/22893) | | Branch Coverage | 56.84% (8101/14252) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
luwei16 commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3622349585 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3621884718 ClickBench: Total hot run time: 28.48 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit ab695fc167026cc855f12129497813c8875ff4cc, data reload: false query1 0.060.050.05 query2 0.130.060.06 query3 0.310.080.08 query4 1.610.090.09 query5 0.260.240.23 query6 1.180.650.63 query7 0.030.030.02 query8 0.080.060.06 query9 0.580.510.51 query10 0.560.590.56 query11 0.260.140.14 query12 0.260.140.15 query13 0.630.640.61 query14 1.011.011.01 query15 0.890.820.81 query16 0.390.380.42 query17 1.041.001.05 query18 0.240.210.22 query19 1.941.821.76 query20 0.020.010.02 query21 15.39 0.280.23 query22 4.980.100.09 query23 15.39 0.400.22 query24 2.450.480.32 query25 0.110.090.09 query26 0.180.170.18 query27 0.090.080.09 query28 3.861.341.16 query29 12.56 4.123.29 query30 0.330.140.10 query31 2.800.640.43 query32 3.240.610.49 query33 3.253.103.17 query34 16.65 5.234.69 query35 4.694.704.66 query36 0.630.490.50 query37 0.250.080.08 query38 0.200.060.06 query39 0.070.050.05 query40 0.200.160.18 query41 0.120.060.06 query42 0.080.050.05 query43 0.060.050.05 Total cold run time: 99.06 s Total hot run time: 28.48 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3621880926 TPC-DS: Total hot run time: 177906 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit ab695fc167026cc855f12129497813c8875ff4cc, data reload: false query5 4826662 497 497 query6 347 228 215 215 query7 4678465 274 274 query8 328 253 255 253 query9 8736260726122607 query10 529 338 275 275 query11 15220 14748 14502 14502 query12 176 118 117 117 query13 1670468 354 354 query14 5833332830693069 query14_12933291729792917 query15 210 199 180 180 query16 7270475 439 439 query17 1208720 588 588 query18 2003441 349 349 query19 231 198 168 168 query20 135 121 122 121 query21 223 140 113 113 query22 3843405038423842 query23 16538 16062 15898 15898 query23_116105 16124 16089 16089 query24 6881161412451245 query24_11262122812251225 query25 633 471 419 419 query26 1260282 171 171 query27 2870480 311 311 query28 4232214321292129 query29 855 565 452 452 query30 316 243 211 211 query31 835 714 616 616 query32 87 73 72 72 query33 633 338 300 300 query34 875 898 545 545 query35 837 825 749 749 query36 867 914 828 828 query37 128 99 80 80 query38 3916385337963796 query39 756 722 742 722 query39_1713 709 702 702 query40 229 136 123 123 query41 67 66 61 61 query42 131 106 103 103 query43 444 422 408 408 query44 1364762 759 759 query45 200 190 186 186 query46 902 972 618 618 query47 1651167516171617 query48 414 319 233 233 query49 787 438 363 363 query50 718 311 249 249 query51 3826387138633863 query52 121 104 86 86 query53 242 236 175 175 query54 323 273 243 243 query55 98 80 76 76 query56 341 295 284 284 query57 1150114710871087 query58 289 260 271 260 query59 2306234823352335 query60 369 328 290 290 query61 164 160 163 160 query62 795 680 651 651 query63 245 182 185 182 query64 4401131210151015 query65 4056394639973946 query66 1254465 356 356 query67 15233 14868 14750 14750 query68 4732994 685 685 query69 546 309 278 278 query70 1133991 986 986 query71 424 309 294 294 query72 6027278152892781 query73 826 730 299 299 query74 9012885586498649 query75 3055303025622562 query76 34131141764 764 query77 523 412 339 339 query78 9701980187888788 query79 1519896 592 592 query80 1688556 455 455 query81 559 271 237 237 query82 391 135 107 107 query83 389 286 264 264 query84 294 116 97 97 query85 925 508 453 453 query86 384 310 278 278 query87 4152403539273927 query88 3063214921332133 query89 397 331 283 283 query90 1862173 157 157 query91 177 181 145 145 query92 72 80 67 67 query93 12451066693 693 query94 740 320 280 280 query95 585 377 331 331 query96 559 503 218 218 query97 2597269525902590 query98 252 200 196 196 query99 1352136912331233 Total cold run time: 265726 ms Total hot run time: 177906 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3621872817 TPC-H: Total hot run time: 33775 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit ab695fc167026cc855f12129497813c8875ff4cc, data reload: false -- Round 1 -- q1 16446 495249074907 q2 1999303 194 194 q3 97211283720 720 q4 9674846 311 311 q5 7302240820832083 q6 192 166 142 142 q7 949 781 643 643 q8 9016136111041104 q9 6998532053725320 q10 6796221017701770 q11 521 314 286 286 q12 337 373 224 224 q13 17370 366329922992 q14 233 229 212 212 q15 566 516 521 516 q16 879 858 803 803 q17 676 810 504 504 q18 7273703369336933 q19 920 961 606 606 q20 381 344 220 220 q21 3674315623612361 q22 1031996 924 924 Total cold run time: 102954 ms Total hot run time: 33775 ms - Round 2, with runtime_filter_mode=off - q1 4902513448704870 q2 316 406 318 318 q3 2131264822732273 q4 1319171612871287 q5 4210415242654152 q6 225 183 138 138 q7 2161194418581858 q8 2690261325152515 q9 7528753475507534 q10 3058325328992899 q11 586 514 491 491 q12 713 798 611 611 q13 3603400332513251 q14 304 295 316 295 q15 545 526 514 514 q16 909 941 884 884 q17 1161145014561450 q18 8631776676487648 q19 888 845 859 845 q20 2014206418791879 q21 4595427541724172 q22 10351038989 989 Total cold run time: 53524 ms Total hot run time: 50873 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3621860101 # Cloud UT Coverage Report Increment line coverage `43.76% (522/1193)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/ab695fc167026cc855f12129497813c8875ff4cc_ab695fc167026cc855f12129497813c8875ff4cc_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/ab695fc167026cc855f12129497813c8875ff4cc_ab695fc167026cc855f12129497813c8875ff4cc_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 79.81% (1727/2164) | | Line Coverage | 65.93% (30567/46366) | | Region Coverage | 66.61% (15249/22893) | | Branch Coverage | 56.90% (8109/14252) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
luwei16 commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3621836137 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3621716303 ClickBench: Total hot run time: 27.36 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 64cdd90e1a3988b7fc7cb747e1b97f6963db918f, data reload: false query1 0.050.050.05 query2 0.100.050.05 query3 0.260.090.09 query4 1.600.110.11 query5 0.290.250.25 query6 1.180.640.63 query7 0.030.020.02 query8 0.050.050.04 query9 0.580.500.50 query10 0.560.560.55 query11 0.160.110.11 query12 0.140.110.12 query13 0.610.600.60 query14 1.010.971.00 query15 0.820.790.81 query16 0.400.390.43 query17 1.061.051.05 query18 0.240.220.21 query19 1.851.881.84 query20 0.020.010.01 query21 15.43 0.290.14 query22 4.950.050.04 query23 16.01 0.280.10 query24 1.070.790.22 query25 0.060.060.08 query26 0.150.130.14 query27 0.070.060.05 query28 4.071.261.02 query29 12.56 4.043.31 query30 0.280.140.13 query31 2.820.620.41 query32 3.230.560.45 query33 3.033.033.06 query34 17.02 5.164.58 query35 4.554.494.57 query36 0.670.500.48 query37 0.110.070.06 query38 0.070.040.04 query39 0.040.030.03 query40 0.180.140.13 query41 0.080.040.03 query42 0.040.030.03 query43 0.050.030.03 Total cold run time: 97.55 s Total hot run time: 27.36 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3621707549 TPC-DS: Total hot run time: 181215 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 64cdd90e1a3988b7fc7cb747e1b97f6963db918f, data reload: false query5 5212655 491 491 query6 378 250 230 230 query7 4681488 291 291 query8 323 247 240 240 query9 8725264326492643 query10 582 330 268 268 query11 15423 15369 14938 14938 query12 199 117 119 117 query13 1704488 384 384 query14 6818323730543054 query14_12903290829022902 query15 207 198 179 179 query16 7691501 447 447 query17 1266709 607 607 query18 2068453 352 352 query19 217 191 171 171 query20 133 121 116 116 query21 222 137 116 116 query22 3879410841334108 query23 16796 16303 16053 16053 query23_116170 16019 16169 16019 query24 7008162812211221 query24_11189122312201220 query25 653 513 473 473 query26 1265293 182 182 query27 2880479 318 318 query28 4385221822122212 query29 843 582 473 473 query30 319 248 217 217 query31 868 708 607 607 query32 85 71 72 71 query33 685 362 350 350 query34 869 889 534 534 query35 804 800 719 719 query36 875 917 839 839 query37 115 88 79 79 query38 3871379638043796 query39 744 734 719 719 query39_1707 701 689 689 query40 229 130 116 116 query41 66 61 61 61 query42 128 98 95 95 query43 442 427 403 403 query44 1336801 785 785 query45 201 192 183 183 query46 897 971 588 588 query47 1683172416631663 query48 407 330 233 233 query49 762 438 351 351 query50 692 305 247 247 query51 3891388437953795 query52 121 99 85 85 query53 241 228 183 183 query54 327 266 266 266 query55 94 81 75 75 query56 337 278 304 278 query57 1183117311061106 query58 287 292 252 252 query59 2378242623312331 query60 371 316 299 299 query61 162 156 157 156 query62 759 691 646 646 query63 233 179 191 179 query64 45321202914 914 query65 4039394239843942 query66 1168442 340 340 query67 15133 15064 15068 15064 query68 8377963 695 695 query69 510 302 267 267 query70 1068101110001000 query71 501 290 275 275 query72 6119494349054905 query73 698 550 300 300 query74 8843879585468546 query75 3669307825812581 query76 37231154765 765 query77 811 420 312 312 query78 9452969088908890 query79 1655858 574 574 query80 649 561 465 465 query81 502 276 238 238 query82 444 132 102 102 query83 274 271 266 266 query84 256 121 94 94 query85 912 492 441 441 query86 337 292 311 292 query87 4113402539613961 query88 3812211521162115 query89 399 317 282 282 query90 2086162 159 159 query91 170 169 140 140 query92 81 69 65 65 query93 12531024688 688 query94 771 279 295 279 query95 568 381 326 326 query96 552 491 213 213 query97 2633265525482548 query98 255 202 195 195 query99 1378128512221222 Total cold run time: 272480 ms Total hot run time: 181215 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3621692180 TPC-H: Total hot run time: 35028 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 64cdd90e1a3988b7fc7cb747e1b97f6963db918f, data reload: false -- Round 1 -- q1 17607 516348684868 q2 2053317 200 200 q3 10195 1311728 728 q4 10212 837 322 322 q5 7473243522092209 q6 190 179 137 137 q7 964 787 640 640 q8 9364146510991099 q9 7238536154035361 q10 6870222617951795 q11 550 306 285 285 q12 395 386 230 230 q13 17780 368430073007 q14 239 230 210 210 q15 599 529 517 517 q16 910 872 799 799 q17 697 820 476 476 q18 8066754580867545 q19 1099998 640 640 q20 396 369 227 227 q21 4320399926982698 q22 1091109710351035 Total cold run time: 108308 ms Total hot run time: 35028 ms - Round 2, with runtime_filter_mode=off - q1 5171509050855085 q2 355 397 318 318 q3 2349298824412441 q4 1457188814911491 q5 4673450145944501 q6 209 164 123 123 q7 2018198317391739 q8 2662248524892485 q9 7582761475287528 q10 3100322627032703 q11 592 489 469 469 q12 648 706 558 558 q13 3248363829902990 q14 275 282 253 253 q15 573 494 490 490 q16 870 877 884 877 q17 1137128713131287 q18 7229719368636863 q19 834 810 846 810 q20 1892195618341834 q21 4573436042494249 q22 11031051973 973 Total cold run time: 52550 ms Total hot run time: 50067 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
hello-stephen commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3621669387 # FE UT Coverage Report Increment line coverage `` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/57770_64cdd90e1a3988b7fc7cb747e1b97f6963db918f/fe_increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/57770_64cdd90e1a3988b7fc7cb747e1b97f6963db918f/fe_report/index.html) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
liaoxin01 commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3621592823 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
hello-stephen commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3618005232 # BE Regression && UT Coverage Report Increment line coverage `65.76% (749/1139)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/57770_445248fd6d092dac88fce489fc80312775f64782_merge/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/57770_445248fd6d092dac88fce489fc80312775f64782_merge/report/index.html) | Category | Coverage | |---|| | Function Coverage | 58.23% (20016/34372) | | Line Coverage | 43.86% (193965/442250) | | Region Coverage | 38.40% (154562/402501) | | Branch Coverage | 39.17% (65519/167283) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3617611733 # BE UT Coverage Report Increment line coverage `74.35% (922/1240)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/445248fd6d092dac88fce489fc80312775f64782_445248fd6d092dac88fce489fc80312775f64782/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/445248fd6d092dac88fce489fc80312775f64782_445248fd6d092dac88fce489fc80312775f64782/report/index.html) | Category | Coverage | |---|| | Function Coverage | 53.34% (18706/35068) | | Line Coverage | 39.04% (172840/442726) | | Region Coverage | 33.73% (134167/397776) | | Branch Coverage | 34.61% (57587/166408) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
hello-stephen commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3617089188 # FE UT Coverage Report Increment line coverage `` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/57770_445248fd6d092dac88fce489fc80312775f64782/fe_increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/57770_445248fd6d092dac88fce489fc80312775f64782/fe_report/index.html) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3617017549 ClickBench: Total hot run time: 27.13 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 445248fd6d092dac88fce489fc80312775f64782, data reload: false query1 0.050.050.05 query2 0.120.050.05 query3 0.250.090.10 query4 1.600.110.11 query5 0.300.240.25 query6 1.180.650.63 query7 0.030.030.03 query8 0.050.040.04 query9 0.560.510.49 query10 0.550.530.55 query11 0.160.110.11 query12 0.160.110.12 query13 0.620.600.62 query14 1.011.000.97 query15 0.810.800.79 query16 0.400.400.38 query17 1.091.061.04 query18 0.240.220.22 query19 1.921.791.85 query20 0.020.010.01 query21 15.42 0.290.14 query22 4.670.050.05 query23 16.17 0.290.11 query24 1.650.240.18 query25 0.090.090.05 query26 0.140.140.14 query27 0.060.060.05 query28 4.081.231.02 query29 12.60 4.123.19 query30 0.270.150.12 query31 2.810.610.40 query32 3.240.560.47 query33 3.123.043.06 query34 17.02 5.214.48 query35 4.534.584.58 query36 0.660.500.49 query37 0.110.070.06 query38 0.080.040.04 query39 0.050.030.03 query40 0.170.130.14 query41 0.090.040.03 query42 0.040.030.03 query43 0.040.030.02 Total cold run time: 98.23 s Total hot run time: 27.13 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3616999452 TPC-DS: Total hot run time: 179795 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 445248fd6d092dac88fce489fc80312775f64782, data reload: false query5 4834660 477 477 query6 347 222 209 209 query7 4648477 280 280 query8 336 252 233 233 query9 8735262826192619 query10 554 303 310 303 query11 15328 14754 14630 14630 query12 176 117 114 114 query13 1674494 357 357 query14 6312329730163016 query14_12880292828812881 query15 211 192 184 184 query16 7469480 446 446 query17 1177718 595 595 query18 2008420 343 343 query19 224 225 154 154 query20 126 120 118 118 query21 219 134 112 112 query22 3869406838673867 query23 16793 16083 15829 15829 query23_115947 16009 16052 16009 query24 6969161812031203 query24_11217120012351200 query25 631 477 429 429 query26 1262276 188 188 query27 2873460 310 310 query28 4283214221352135 query29 830 582 476 476 query30 320 228 219 219 query31 823 693 614 614 query32 91 69 72 69 query33 673 345 285 285 query34 861 869 541 541 query35 791 831 731 731 query36 914 918 826 826 query37 139 99 82 82 query38 3825383337433743 query39 740 753 715 715 query39_1713 695 709 695 query40 234 135 120 120 query41 69 63 60 60 query42 127 101 96 96 query43 450 443 382 382 query44 1335770 773 770 query45 198 191 182 182 query46 897 967 584 584 query47 1697169916331633 query48 395 317 237 237 query49 787 424 354 354 query50 690 300 242 242 query51 3822396738403840 query52 122 105 93 93 query53 229 229 184 184 query54 324 253 245 245 query55 105 80 74 74 query56 339 285 301 285 query57 1155115210861086 query58 302 281 270 270 query59 2457247024072407 query60 383 335 317 317 query61 192 184 185 184 query62 799 681 653 653 query63 239 182 183 182 query64 4490131310091009 query65 4057396940223969 query66 1209463 363 363 query67 15255 14903 14947 14903 query68 6419951 684 684 query69 531 319 263 263 query70 11221024996 996 query71 440 300 283 283 query72 6145492248904890 query73 692 553 315 315 query74 8839878386278627 query75 3067303625322532 query76 33551133760 760 query77 508 406 316 316 query78 9568962988428842 query79 1955872 581 581 query80 715 582 462 462 query81 521 272 242 242 query82 192 133 106 106 query83 271 271 257 257 query84 258 110 95 95 query85 899 483 452 452 query86 378 291 279 279 query87 4054406039883988 query88 4248212221622122 query89 394 313 282 282 query90 2054162 159 159 query91 169 166 140 140 query92 78 67 63 63 query93 23571038684 684 query94 811 309 269 269 query95 569 337 324 324 query96 540 508 213 213 query97 2596270926012601 query98 276 202 200 200 query99 1342134712091209 Total cold run time: 269249 ms Total hot run time: 179795 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3616962253 TPC-H: Total hot run time: 34436 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 445248fd6d092dac88fce489fc80312775f64782, data reload: false -- Round 1 -- q1 16506 509549314931 q2 2048309 197 197 q3 98481347741 741 q4 9869864 318 318 q5 7519245121392139 q6 195 168 134 134 q7 988 784 634 634 q8 9257144911201120 q9 7148533253595332 q10 6788218417561756 q11 526 312 288 288 q12 346 374 231 231 q13 17584 368729912991 q14 234 227 218 218 q15 584 511 507 507 q16 899 895 815 815 q17 692 742 617 617 q18 8007719370897089 q19 989 958 600 600 q20 383 345 228 228 q21 4070333126062606 q22 1063996 944 944 Total cold run time: 105543 ms Total hot run time: 34436 ms - Round 2, with runtime_filter_mode=off - q1 4954493649184918 q2 333 408 310 310 q3 2161263622982298 q4 1328178413221322 q5 4249434347404343 q6 222 177 132 132 q7 2045201718561856 q8 2667252525242524 q9 7648757174137413 q10 3127326728692869 q11 611 519 499 499 q12 699 767 614 614 q13 3506398334523452 q14 281 293 281 281 q15 552 529 515 515 q16 911 946 912 912 q17 1174162214551455 q18 7855765776417641 q19 919 916 936 916 q20 1996203619271927 q21 4998435042484248 q22 10871022980 980 Total cold run time: 53323 ms Total hot run time: 51425 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
luwei16 commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3616817594 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
luwei16 commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3616814069 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3616795481 ClickBench: Total hot run time: 27.12 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit fcc0616f042efb55e8e8db8002cdeeff663b8e79, data reload: false query1 0.050.050.05 query2 0.110.050.05 query3 0.260.090.09 query4 1.600.110.12 query5 0.280.250.27 query6 1.160.650.63 query7 0.040.030.03 query8 0.050.040.05 query9 0.580.520.50 query10 0.550.560.57 query11 0.160.100.10 query12 0.150.120.13 query13 0.620.600.61 query14 0.990.970.98 query15 0.820.800.81 query16 0.390.400.40 query17 1.001.000.98 query18 0.240.210.22 query19 1.881.791.82 query20 0.020.010.01 query21 15.43 0.310.14 query22 4.460.050.05 query23 15.94 0.280.10 query24 1.200.530.24 query25 0.080.050.06 query26 0.140.140.14 query27 0.070.050.06 query28 3.931.211.02 query29 12.60 4.003.16 query30 0.280.150.11 query31 2.820.610.39 query32 3.240.550.47 query33 3.023.023.04 query34 16.72 5.184.48 query35 4.564.564.61 query36 0.670.500.51 query37 0.100.060.06 query38 0.080.040.04 query39 0.050.030.03 query40 0.170.140.13 query41 0.090.030.03 query42 0.040.030.03 query43 0.040.040.03 Total cold run time: 96.68 s Total hot run time: 27.12 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3616776930 TPC-DS: Total hot run time: 180277 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit fcc0616f042efb55e8e8db8002cdeeff663b8e79, data reload: false query5 4436654 499 499 query6 362 241 226 226 query7 4667491 275 275 query8 325 262 245 245 query9 8719261226252612 query10 506 322 293 293 query11 15223 14839 14786 14786 query12 185 120 118 118 query13 1693482 380 380 query14 5640329730343034 query14_12934292529032903 query15 220 197 184 184 query16 7369486 454 454 query17 1280734 625 625 query18 2017439 351 351 query19 219 196 166 166 query20 130 120 120 120 query21 217 138 112 112 query22 3910400538843884 query23 16739 16302 15846 15846 query23_116183 16130 16127 16127 query24 7148163212181218 query24_11232121812401218 query25 657 511 441 441 query26 1273283 179 179 query27 2897472 309 309 query28 4374217821602160 query29 885 590 481 481 query30 315 234 226 226 query31 830 705 615 615 query32 85 73 72 72 query33 674 354 342 342 query34 870 875 544 544 query35 782 820 750 750 query36 883 940 850 850 query37 122 95 83 83 query38 3875385238743852 query39 764 752 714 714 query39_1679 717 697 697 query40 226 132 114 114 query41 71 61 67 61 query42 123 99 95 95 query43 440 435 381 381 query44 1326757 753 753 query45 197 191 187 187 query46 898 970 589 589 query47 1677172916231623 query48 410 320 233 233 query49 781 438 356 356 query50 689 307 233 233 query51 3878384538673845 query52 114 97 90 90 query53 236 230 178 178 query54 312 250 236 236 query55 98 80 77 77 query56 344 283 295 283 query57 1158112610991099 query58 297 254 288 254 query59 2343245924062406 query60 370 308 295 295 query61 162 161 161 161 query62 765 661 621 621 query63 228 177 173 173 query64 45271194917 917 query65 4048394039543940 query66 1262441 333 333 query67 15169 15098 14951 14951 query68 8295930 659 659 query69 539 302 265 265 query70 1147987 990 987 query71 464 298 277 277 query72 6163498051704980 query73 724 634 304 304 query74 8526875085828582 query75 3634301525322532 query76 36141129726 726 query77 814 449 302 302 query78 9414951988498849 query79 1716862 575 575 query80 669 549 456 456 query81 527 277 239 239 query82 454 129 113 113 query83 280 282 259 259 query84 282 127 97 97 query85 980 491 452 452 query86 392 292 278 278 query87 4034407740124012 query88 4197218321532153 query89 403 324 284 284 query90 2004159 158 158 query91 179 170 145 145 query92 84 73 66 66 query93 18381032676 676 query94 784 319 257 257 query95 585 358 374 358 query96 541 506 215 215 query97 2642269225962596 query98 243 202 199 199 query99 1421135012011201 Total cold run time: 271148 ms Total hot run time: 180277 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3616719140 TPC-H: Total hot run time: 34647 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit fcc0616f042efb55e8e8db8002cdeeff663b8e79, data reload: false -- Round 1 -- q1 17498 513549614961 q2 2078313 204 204 q3 10117 1359738 738 q4 10198 811 322 322 q5 7500249621942194 q6 194 172 135 135 q7 972 790 647 647 q8 9376145511711171 q9 7083539153125312 q10 6848221317921792 q11 532 303 296 296 q12 401 377 230 230 q13 17789 374230143014 q14 236 237 216 216 q15 612 515 525 515 q16 925 882 816 816 q17 669 793 521 521 q18 8149717371757173 q19 1093977 617 617 q20 367 362 223 223 q21 4035378426062606 q22 10721015944 944 Total cold run time: 107744 ms Total hot run time: 34647 ms - Round 2, with runtime_filter_mode=off - q1 4962496849704968 q2 316 408 314 314 q3 2121274423362336 q4 1362180413441344 q5 4351463346954633 q6 221 171 128 128 q7 2068201519041904 q8 2736260725152515 q9 7566752575077507 q10 3099325728452845 q11 593 509 497 497 q12 682 753 611 611 q13 3830394035823582 q14 282 293 277 277 q15 564 508 526 508 q16 899 927 867 867 q17 1176148215141482 q18 8015763076197619 q19 917 875 911 875 q20 2018207120142014 q21 4998467141704170 q22 11001046993 993 Total cold run time: 53876 ms Total hot run time: 51989 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
hello-stephen commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3616613229 # FE UT Coverage Report Increment line coverage `` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/57770_fcc0616f042efb55e8e8db8002cdeeff663b8e79/fe_increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/57770_fcc0616f042efb55e8e8db8002cdeeff663b8e79/fe_report/index.html) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
luwei16 commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3616272191 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3611937718 ClickBench: Total hot run time: 28.33 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 164a8d5c76149c0caed0a333fd42cea14a3d6302, data reload: false query1 0.050.050.05 query2 0.140.070.06 query3 0.330.070.08 query4 1.610.110.10 query5 0.270.250.24 query6 1.180.630.65 query7 0.030.030.03 query8 0.080.060.07 query9 0.600.520.51 query10 0.570.560.55 query11 0.280.140.14 query12 0.280.140.17 query13 0.630.620.62 query14 1.011.011.00 query15 0.890.810.82 query16 0.380.390.42 query17 1.060.990.98 query18 0.240.220.22 query19 1.841.851.77 query20 0.020.020.01 query21 15.39 0.280.24 query22 4.950.100.11 query23 15.37 0.380.22 query24 2.450.460.30 query25 0.090.100.09 query26 0.180.180.17 query27 0.090.090.09 query28 3.671.391.16 query29 12.60 4.173.34 query30 0.330.120.10 query31 2.820.660.43 query32 3.250.620.49 query33 3.123.053.09 query34 16.83 5.184.56 query35 4.654.714.63 query36 0.610.510.48 query37 0.240.080.08 query38 0.200.060.05 query39 0.060.040.04 query40 0.200.170.17 query41 0.130.060.06 query42 0.080.050.05 query43 0.060.060.05 Total cold run time: 98.86 s Total hot run time: 28.33 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3611901277 TPC-DS: Total hot run time: 180431 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 164a8d5c76149c0caed0a333fd42cea14a3d6302, data reload: false query5 5114647 487 487 query6 345 224 231 224 query7 4654470 276 276 query8 333 253 231 231 query9 8737259426222594 query10 565 354 280 280 query11 15418 14891 14835 14835 query12 187 121 116 116 query13 1695479 369 369 query14 6327329230663066 query14_12960290928692869 query15 225 204 186 186 query16 7702485 476 476 query17 1228749 630 630 query18 2067446 342 342 query19 225 204 166 166 query20 131 121 128 121 query21 222 138 117 117 query22 4096419539283928 query23 16722 16277 16133 16133 query23_116065 16000 16054 16000 query24 7291164612131213 query24_11212123012101210 query25 651 504 450 450 query26 1268281 171 171 query27 2878477 307 307 query28 4355216821382138 query29 844 621 480 480 query30 321 248 216 216 query31 825 707 628 628 query32 90 72 72 72 query33 692 362 304 304 query34 875 939 537 537 query35 806 814 743 743 query36 903 926 806 806 query37 120 93 75 75 query38 3918379938493799 query39 767 746 722 722 query39_1691 723 718 718 query40 225 130 121 121 query41 64 62 62 62 query42 125 96 99 96 query43 463 422 415 415 query44 1320752 745 745 query45 193 192 194 192 query46 905 977 599 599 query47 1654171416311631 query48 408 339 234 234 query49 805 454 344 344 query50 692 311 232 232 query51 3842385238563852 query52 115 101 86 86 query53 232 240 176 176 query54 316 273 237 237 query55 99 77 75 75 query56 348 295 289 289 query57 1188118311121112 query58 298 264 289 264 query59 2326242023062306 query60 360 312 310 310 query61 163 158 159 158 query62 807 672 627 627 query63 235 175 180 175 query64 45211179897 897 query65 4071398039683968 query66 1191437 338 338 query67 15275 15181 14971 14971 query68 8249932 671 671 query69 512 293 260 260 query70 1110985 952 952 query71 459 300 272 272 query72 5972489548724872 query73 680 546 306 306 query74 8522875385498549 query75 3457304525352535 query76 35681140742 742 query77 813 415 309 309 query78 9510956088818881 query79 1631851 588 588 query80 650 584 461 461 query81 503 269 237 237 query82 478 130 106 106 query83 286 282 255 255 query84 267 116 102 102 query85 957 483 465 465 query86 344 299 290 290 query87 4113410940054005 query88 4081214821192119 query89 399 322 281 281 query90 2086173 165 165 query91 177 167 140 140 query92 85 75 64 64 query93 16071071676 676 query94 793 308 271 271 query95 574 345 328 328 query96 553 500 216 216 query97 2612267225692569 query98 252 205 198 198 query99 1374130012421242 Total cold run time: 272413 ms Total hot run time: 180431 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3611832587 TPC-H: Total hot run time: 34542 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 164a8d5c76149c0caed0a333fd42cea14a3d6302, data reload: false -- Round 1 -- q1 17601 513649524952 q2 2100315 194 194 q3 10192 1347769 769 q4 10218 819 304 304 q5 7569247322102210 q6 207 179 140 140 q7 989 794 654 654 q8 9355145710751075 q9 7381557954165416 q10 6891220818041804 q11 522 310 285 285 q12 398 376 224 224 q13 17817 370530553055 q14 242 231 222 222 q15 605 515 513 513 q16 906 876 798 798 q17 714 816 505 505 q18 7689705071267050 q19 1109973 600 600 q20 384 345 229 229 q21 4066331925722572 q22 1033998 971 971 Total cold run time: 107988 ms Total hot run time: 34542 ms - Round 2, with runtime_filter_mode=off - q1 4991498449534953 q2 364 385 312 312 q3 2124267823352335 q4 1311178113101310 q5 4231457244394439 q6 220 185 134 134 q7 2101199518421842 q8 2735251924792479 q9 7656747575907475 q10 3067332728532853 q11 621 516 494 494 q12 715 749 631 631 q13 3613398733383338 q14 283 316 294 294 q15 561 514 513 513 q16 910 919 891 891 q17 1239143314531433 q18 8006753777767537 q19 916 851 841 841 q20 1887202118001800 q21 4611430442544254 q22 11191024991 991 Total cold run time: 53281 ms Total hot run time: 51149 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3611389419 # Cloud UT Coverage Report Increment line coverage `43.52% (517/1188)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/164a8d5c76149c0caed0a333fd42cea14a3d6302_164a8d5c76149c0caed0a333fd42cea14a3d6302_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/164a8d5c76149c0caed0a333fd42cea14a3d6302_164a8d5c76149c0caed0a333fd42cea14a3d6302_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 79.81% (1727/2164) | | Line Coverage | 65.92% (30563/46361) | | Region Coverage | 66.59% (15244/22893) | | Branch Coverage | 56.88% (8106/14252) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
luwei16 commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3611216033 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3602135449 ClickBench: Total hot run time: 28.62 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 2009bb552175af2959395a3f377a4256cc790965, data reload: false query1 0.060.050.04 query2 0.140.070.07 query3 0.310.070.09 query4 1.610.100.11 query5 0.260.250.25 query6 1.180.650.63 query7 0.030.030.03 query8 0.080.060.06 query9 0.590.520.51 query10 0.570.550.58 query11 0.270.140.13 query12 0.260.150.14 query13 0.650.620.62 query14 1.041.021.01 query15 0.890.810.82 query16 0.400.390.39 query17 1.041.011.05 query18 0.230.220.21 query19 1.851.851.80 query20 0.020.020.02 query21 15.42 0.280.26 query22 4.990.100.10 query23 15.40 0.400.23 query24 2.440.460.30 query25 0.100.100.09 query26 0.180.170.18 query27 0.100.090.09 query28 3.801.391.17 query29 12.58 4.133.29 query30 0.340.130.10 query31 2.820.640.44 query32 3.230.590.50 query33 3.103.093.05 query34 16.61 5.234.67 query35 4.714.694.72 query36 0.610.500.51 query37 0.250.090.09 query38 0.200.050.06 query39 0.080.050.05 query40 0.200.180.17 query41 0.130.060.06 query42 0.090.050.05 query43 0.060.060.05 Total cold run time: 98.92 s Total hot run time: 28.62 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3602109679 TPC-DS: Total hot run time: 181654 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 2009bb552175af2959395a3f377a4256cc790965, data reload: false query1 1098406 386 386 query2 6598120411671167 query3 6743234 225 225 query4 25290 23410 22647 22647 query5 4978674 510 510 query6 345 238 217 217 query7 4668525 319 319 query8 295 248 229 229 query9 8722262626002600 query10 546 367 293 293 query11 15136 14830 14869 14830 query12 179 116 111 111 query13 1680571 421 421 query14 9523592258895889 query15 205 207 182 182 query16 7509680 517 517 query17 1183749 597 597 query18 2022452 332 332 query19 207 200 191 191 query20 127 122 121 121 query21 214 132 119 119 query22 3911404339173917 query23 32868 31857 32128 31857 query24 8453243624062406 query25 590 510 443 443 query26 1252282 173 173 query27 2739496 338 338 query28 4377214321102110 query29 833 623 495 495 query30 314 240 211 211 query31 804 716 645 645 query32 78 70 75 70 query33 621 386 329 329 query34 840 884 532 532 query35 798 832 744 744 query36 900 917 843 843 query37 128 114 88 88 query38 3882392237963796 query39 1461141613911391 query40 232 137 122 122 query41 66 63 63 63 query42 129 120 114 114 query43 431 447 417 417 query44 1376752 746 746 query45 204 195 184 184 query46 906 1034656 656 query47 1665171116181618 query48 404 422 332 332 query49 759 515 422 422 query50 697 715 425 425 query51 3840385238293829 query52 117 115 104 104 query53 247 281 198 198 query54 331 315 302 302 query55 99 99 95 95 query56 366 353 338 338 query57 1137118010841084 query58 304 293 290 290 query59 2382236023392339 query60 381 376 365 365 query61 196 182 187 182 query62 785 820 658 658 query63 245 202 204 202 query64 4625134010221022 query65 4111400539613961 query66 1156455 370 370 query67 15485 15127 14842 14842 query68 81321008627 627 query69 543 368 331 331 query70 11501042983 983 query71 463 379 329 329 query72 5891488648414841 query73 674 604 351 351 query74 8852875386108610 query75 3113303725302530 query76 32911162763 763 query77 504 417 330 330 query78 9446961489828982 query79 3035863 586 586 query80 720 595 490 490 query81 534 274 243 243 query82 514 146 132 132 query83 306 269 255 255 query84 306 128 94 94 query85 912 492 473 473 query86 385 292 294 292 query87 4117403140444031 query88 4066229623062296 query89 410 335 296 296 query90 1906226 218 218 query91 175 185 146 146 query92 83 69 66 66 query93 29771016662 662 query94 766 467 363 363 query95 514 423 413 413 query96 540 560 289 289 query97 2680268825862586 query98 247 223 210 210 query99 1416141012651265 Total cold run time: 273461 ms Total hot run time: 181654 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3602045984 TPC-H: Total hot run time: 34186 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 2009bb552175af2959395a3f377a4256cc790965, data reload: false -- Round 1 -- q1 17617 508749254925 q2 2054322 217 217 q3 10258 1303734 734 q4 10215 870 326 326 q5 7561247721722172 q6 190 172 143 143 q7 964 804 653 653 q8 9364142710801080 q9 6974535853785358 q10 6794220117871787 q11 542 321 303 303 q12 337 373 237 237 q13 17803 373230613061 q14 239 242 218 218 q15 588 527 514 514 q16 896 877 804 804 q17 673 859 460 460 q18 7426703769856985 q19 910 969 601 601 q20 359 348 231 231 q21 3974320824042404 q22 1048999 973 973 Total cold run time: 106786 ms Total hot run time: 34186 ms - Round 2, with runtime_filter_mode=off - q1 4958509949384938 q2 327 386 315 315 q3 2173271823172317 q4 1353177813421342 q5 4226440245514402 q6 218 183 129 129 q7 2031200018361836 q8 2693256125572557 q9 7513752275847522 q10 3039333728412841 q11 605 506 499 499 q12 690 761 622 622 q13 3519395133473347 q14 281 304 305 304 q15 636 609 531 531 q16 902 922 881 881 q17 1197133214041332 q18 8044779276837683 q19 869 883 877 877 q20 2022207218801880 q21 4674431842204220 q22 10931034989 989 Total cold run time: 53063 ms Total hot run time: 51364 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
hello-stephen commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3601749119 # Cloud UT Coverage Report Increment line coverage `43.11% (494/1146)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/2009bb552175af2959395a3f377a4256cc790965_2009bb552175af2959395a3f377a4256cc790965_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/2009bb552175af2959395a3f377a4256cc790965_2009bb552175af2959395a3f377a4256cc790965_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 79.81% (1727/2164) | | Line Coverage | 65.93% (30534/46313) | | Region Coverage | 66.56% (15231/22883) | | Branch Coverage | 56.86% (8103/14250) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
liaoxin01 commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3601652337 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
hello-stephen commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3601635214 # Cloud UT Coverage Report Increment line coverage `43.11% (494/1146)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/483080d29bbccbbc03bbc6aa5ca88fcc50eebe22_483080d29bbccbbc03bbc6aa5ca88fcc50eebe22_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/483080d29bbccbbc03bbc6aa5ca88fcc50eebe22_483080d29bbccbbc03bbc6aa5ca88fcc50eebe22_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 79.81% (1727/2164) | | Line Coverage | 65.94% (30537/46313) | | Region Coverage | 66.59% (15238/22883) | | Branch Coverage | 56.85% (8101/14250) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
luwei16 commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3601471443 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
liaoxin01 commented on code in PR #57770:
URL: https://github.com/apache/doris/pull/57770#discussion_r2577109978
##
be/src/io/fs/merge_file_writer.cpp:
##
@@ -0,0 +1,201 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+#include "io/fs/merge_file_writer.h"
+
+#include
+
+#include "cloud/config.h"
+#include "common/config.h"
+#include "common/status.h"
+#include "runtime/exec_env.h"
+#include "util/slice.h"
+
+namespace doris::io {
+
+MergeFileWriter::MergeFileWriter(FileWriterPtr inner_writer, Path path)
+: _inner_writer(std::move(inner_writer)),
+ _file_path(path.native()),
+ _merge_file_manager(MergeFileManager::instance()) {
+DCHECK(_inner_writer != nullptr);
+DCHECK(!_file_path.empty());
+}
+
+MergeFileWriter::~MergeFileWriter() {
+if (_state == State::OPENED) {
+LOG(WARNING) << "MergeFileWriter destroyed without being closed, file:
" << _file_path;
+}
+}
+
+Status MergeFileWriter::appendv(const Slice* data, size_t data_cnt) {
+if (_state != State::OPENED) {
+return Status::InternalError("Cannot append to closed or closing
writer for file: " +
+ _file_path);
+}
+
+// Calculate total size to append
+size_t total_size = 0;
+for (size_t i = 0; i < data_cnt; ++i) {
+total_size += data[i].size;
+}
+
+if (total_size == 0) {
+return Status::OK();
+}
+
+// Check if we should switch to direct write mode
+if (!_is_direct_write && _bytes_appended + total_size >
config::small_file_threshold_bytes) {
+RETURN_IF_ERROR(_switch_to_direct_write());
+_is_direct_write = true;
Review Comment:
That's impossible. The data of small file is in the buffer.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
hello-stephen commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3594547163 # BE Regression && UT Coverage Report Increment line coverage `87.42% (848/970)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/57770_f0e5a0004229fa39eed731c71e9d6facae523087_merge/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/57770_f0e5a0004229fa39eed731c71e9d6facae523087_merge/report/index.html) | Category | Coverage | |---|| | Function Coverage | 71.72% (24657/34378) | | Line Coverage | 58.30% (257555/441769) | | Region Coverage | 53.40% (214725/402139) | | Branch Coverage | 54.93% (91820/167149) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3594449436 # BE UT Coverage Report Increment line coverage `73.24% (758/1035)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/f0e5a0004229fa39eed731c71e9d6facae523087_f0e5a0004229fa39eed731c71e9d6facae523087/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/f0e5a0004229fa39eed731c71e9d6facae523087_f0e5a0004229fa39eed731c71e9d6facae523087/report/index.html) | Category | Coverage | |---|| | Function Coverage | 52.90% (18560/35082) | | Line Coverage | 38.45% (170166/442595) | | Region Coverage | 33.28% (132408/397830) | | Branch Coverage | 34.19% (56919/166468) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3594407675 ClickBench: Total hot run time: 28.64 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit f0e5a0004229fa39eed731c71e9d6facae523087, data reload: false query1 0.050.040.04 query2 0.140.060.06 query3 0.340.080.08 query4 1.600.090.10 query5 0.260.240.25 query6 1.190.640.62 query7 0.030.020.02 query8 0.110.060.07 query9 0.580.510.51 query10 0.570.560.56 query11 0.250.140.14 query12 0.260.140.14 query13 0.660.630.60 query14 0.991.021.02 query15 0.890.840.81 query16 0.400.390.39 query17 1.021.041.05 query18 0.240.230.22 query19 1.871.761.80 query20 0.020.010.01 query21 15.42 0.280.24 query22 4.980.100.10 query23 15.41 0.370.24 query24 2.310.430.35 query25 0.090.090.10 query26 0.200.180.18 query27 0.090.090.09 query28 3.751.351.18 query29 12.60 3.953.30 query30 0.340.150.10 query31 2.810.630.45 query32 3.230.590.50 query33 3.133.083.09 query34 16.76 5.194.66 query35 4.684.654.65 query36 0.620.500.50 query37 0.250.100.09 query38 0.210.060.06 query39 0.070.040.05 query40 0.200.170.17 query41 0.130.060.06 query42 0.080.050.05 query43 0.060.050.06 Total cold run time: 98.89 s Total hot run time: 28.64 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3594398545 TPC-DS: Total hot run time: 181998 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit f0e5a0004229fa39eed731c71e9d6facae523087, data reload: false query1 1065429 391 391 query2 6577117011401140 query3 6754224 233 224 query4 25203 23331 22936 22936 query5 5094636 505 505 query6 345 224 251 224 query7 4646506 306 306 query8 319 281 259 259 query9 8710256125922561 query10 540 357 305 305 query11 15339 14771 15028 14771 query12 181 125 116 116 query13 1709576 444 444 query14 9392602559445944 query15 212 200 184 184 query16 7551705 535 535 query17 1214808 611 611 query18 2025426 337 337 query19 213 204 174 174 query20 125 125 121 121 query21 216 142 125 125 query22 3828394138143814 query23 32776 32160 32067 32067 query24 8436242223782378 query25 620 516 469 469 query26 1239271 169 169 query27 2731520 354 354 query28 4239211021252110 query29 799 627 489 489 query30 307 237 214 214 query31 834 717 627 627 query32 114 71 74 71 query33 626 373 332 332 query34 832 855 538 538 query35 806 836 747 747 query36 854 928 857 857 query37 115 107 88 88 query38 3863379138493791 query39 1492141214451412 query40 236 127 127 127 query41 66 63 62 62 query42 123 127 113 113 query43 425 457 431 431 query44 1316753 744 744 query45 214 188 181 181 query46 868 989 642 642 query47 1661170316401640 query48 396 421 328 328 query49 761 525 419 419 query50 659 690 417 417 query51 3920390338713871 query52 117 114 107 107 query53 239 258 196 196 query54 308 294 291 291 query55 97 104 92 92 query56 344 344 320 320 query57 1121119811021102 query58 286 279 272 272 query59 2326239222852285 query60 361 354 330 330 query61 159 182 160 160 query62 781 730 644 644 query63 230 196 196 196 query64 44501200903 903 query65 4106396439843964 query66 1148437 337 337 query67 15130 14949 14856 14856 query68 4650975 628 628 query69 511 351 309 309 query70 10881036992 992 query71 429 360 312 312 query72 5797506450575057 query73 679 587 373 373 query74 8846887287208720 query75 3045303825452545 query76 32971134744 744 query77 523 432 333 333 query78 9474986088608860 query79 1663859 588 588 query80 1693609 546 546 query81 556 329 244 244 query82 405 139 115 115 query83 380 270 248 248 query84 261 116 93 93 query85 920 489 449 449 query86 391 300 274 274 query87 4064407939733973 query88 2924230023642300 query89 378 334 291 291 query90 1744228 227 227 query91 176 172 140 140 query92 74 68 68 68 query93 11361003655 655 query94 739 464 349 349 query95 512 411 423 411 query96 525 545 287 287 query97 2609266826012601 query98 241 223 217 217 query99 1322141512791279 Total cold run time: 264841 ms Total hot run time: 181998 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3594377851 TPC-H: Total hot run time: 34425 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit f0e5a0004229fa39eed731c71e9d6facae523087, data reload: false -- Round 1 -- q1 17205 506349544954 q2 2018313 215 215 q3 10039 1338731 731 q4 10247 964 373 373 q5 7583248022602260 q6 195 175 143 143 q7 933 776 648 648 q8 9343135711161116 q9 7008532652555255 q10 6866224518241824 q11 517 314 315 314 q12 345 368 228 228 q13 1 367230343034 q14 243 253 222 222 q15 591 526 520 520 q16 894 867 819 819 q17 610 715 507 507 q18 7879725270357035 q19 1110955 584 584 q20 349 348 238 238 q21 3570326324612461 q22 10171006944 944 Total cold run time: 106339 ms Total hot run time: 34425 ms - Round 2, with runtime_filter_mode=off - q1 4991499149474947 q2 334 406 328 328 q3 2151269122682268 q4 1307170512621262 q5 4275441745754417 q6 224 175 133 133 q7 2031197318791879 q8 2684239525182395 q9 7477749875337498 q10 3088323128332833 q11 609 549 491 491 q12 688 776 632 632 q13 3574382533523352 q14 389 317 296 296 q15 566 516 531 516 q16 892 919 879 879 q17 1156143415241434 q18 7855773877907738 q19 837 785 850 785 q20 2031207218871887 q21 4701427941674167 q22 10941061966 966 Total cold run time: 52954 ms Total hot run time: 51103 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3594327510 # Cloud UT Coverage Report Increment line coverage `43.36% (496/1144)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/f0e5a0004229fa39eed731c71e9d6facae523087_f0e5a0004229fa39eed731c71e9d6facae523087_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/f0e5a0004229fa39eed731c71e9d6facae523087_f0e5a0004229fa39eed731c71e9d6facae523087_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 81.00% (1727/2132) | | Line Coverage | 66.37% (30506/45962) | | Region Coverage | 67.00% (15237/22743) | | Branch Coverage | 57.10% (8103/14192) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
liaoxin01 commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3594257407 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
hello-stephen commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3592987296 # BE Regression && UT Coverage Report Increment line coverage `87.42% (848/970)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/57770_2d14d7ec4bff2b09f4ff08b9656d209ab6677f80_merge/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/57770_2d14d7ec4bff2b09f4ff08b9656d209ab6677f80_merge/report/index.html) | Category | Coverage | |---|| | Function Coverage | 71.69% (24645/34378) | | Line Coverage | 58.21% (257173/441769) | | Region Coverage | 53.33% (214443/402139) | | Branch Coverage | 54.81% (91617/167149) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
hello-stephen commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3592930625 # BE Regression && UT Coverage Report Increment line coverage `87.42% (848/970)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/57770_2d14d7ec4bff2b09f4ff08b9656d209ab6677f80_merge/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/57770_2d14d7ec4bff2b09f4ff08b9656d209ab6677f80_merge/report/index.html) | Category | Coverage | |---|| | Function Coverage | 71.68% (24643/34378) | | Line Coverage | 58.20% (257130/441769) | | Region Coverage | 53.31% (214392/402139) | | Branch Coverage | 54.80% (91598/167149) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
hello-stephen commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3592820481 # BE Regression && UT Coverage Report Increment line coverage `87.42% (848/970)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/57770_2d14d7ec4bff2b09f4ff08b9656d209ab6677f80_merge/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/57770_2d14d7ec4bff2b09f4ff08b9656d209ab6677f80_merge/report/index.html) | Category | Coverage | |---|| | Function Coverage | 71.68% (24640/34377) | | Line Coverage | 58.17% (256944/441726) | | Region Coverage | 53.24% (214079/402071) | | Branch Coverage | 54.76% (91508/167113) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
hello-stephen commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3592810848 # BE UT Coverage Report Increment line coverage `73.24% (758/1035)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/2d14d7ec4bff2b09f4ff08b9656d209ab6677f80_2d14d7ec4bff2b09f4ff08b9656d209ab6677f80/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/2d14d7ec4bff2b09f4ff08b9656d209ab6677f80_2d14d7ec4bff2b09f4ff08b9656d209ab6677f80/report/index.html) | Category | Coverage | |---|| | Function Coverage | 52.99% (18585/35070) | | Line Coverage | 38.55% (170467/442238) | | Region Coverage | 33.34% (132491/397402) | | Branch Coverage | 34.28% (56995/166270) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3592701410 ClickBench: Total hot run time: 28.67 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 2d14d7ec4bff2b09f4ff08b9656d209ab6677f80, data reload: false query1 0.050.040.04 query2 0.140.070.07 query3 0.310.080.08 query4 1.600.100.10 query5 0.260.250.25 query6 1.190.650.64 query7 0.060.030.02 query8 0.070.060.06 query9 0.590.510.50 query10 0.560.560.57 query11 0.260.140.14 query12 0.260.140.14 query13 0.670.630.61 query14 0.990.991.01 query15 0.900.810.81 query16 0.390.390.41 query17 1.061.051.04 query18 0.240.230.22 query19 1.861.801.80 query20 0.020.020.01 query21 15.42 0.290.24 query22 4.980.110.10 query23 15.41 0.370.24 query24 2.400.470.31 query25 0.100.090.09 query26 0.180.180.18 query27 0.100.090.09 query28 3.751.391.19 query29 12.59 3.993.32 query30 0.330.130.12 query31 2.850.640.44 query32 3.230.590.52 query33 3.133.163.13 query34 16.69 5.234.64 query35 4.664.624.71 query36 0.620.510.48 query37 0.240.090.08 query38 0.220.060.05 query39 0.070.040.05 query40 0.200.170.16 query41 0.130.070.06 query42 0.080.050.05 query43 0.060.060.05 Total cold run time: 98.92 s Total hot run time: 28.67 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3592692860 TPC-DS: Total hot run time: 182310 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 2d14d7ec4bff2b09f4ff08b9656d209ab6677f80, data reload: false query1 1035410 394 394 query2 6643118511761176 query3 6755230 234 230 query4 25700 23521 23273 23273 query5 4967666 506 506 query6 345 236 216 216 query7 4649503 312 312 query8 312 253 247 247 query9 8737258525532553 query10 555 355 296 296 query11 15542 14894 15239 14894 query12 182 123 114 114 query13 1679540 443 443 query14 9442599861185998 query15 205 203 183 183 query16 7443697 526 526 query17 1192776 629 629 query18 2047448 349 349 query19 215 209 190 190 query20 128 127 121 121 query21 227 140 116 116 query22 3978392138063806 query23 32893 31909 31872 31872 query24 8588239224562392 query25 637 554 485 485 query26 1265278 178 178 query27 2728490 351 351 query28 4317215421102110 query29 839 657 516 516 query30 316 242 215 215 query31 836 714 622 622 query32 86 81 74 74 query33 609 393 358 358 query34 811 890 548 548 query35 815 852 748 748 query36 895 971 815 815 query37 120 110 91 91 query38 3952386539023865 query39 1509139414221394 query40 234 143 125 125 query41 78 73 69 69 query42 128 114 115 114 query43 434 451 432 432 query44 1281778 755 755 query45 207 194 190 190 query46 869 1018647 647 query47 1665174416491649 query48 404 428 337 337 query49 811 522 422 422 query50 661 690 414 414 query51 3944393040133930 query52 119 121 104 104 query53 238 264 195 195 query54 326 321 318 318 query55 94 99 91 91 query56 349 350 350 350 query57 1148126810801080 query58 284 277 286 277 query59 2364239123552355 query60 357 349 356 349 query61 160 147 152 147 query62 775 721 659 659 query63 232 192 194 192 query64 45401190883 883 query65 4080396339403940 query66 1153445 334 334 query67 15390 14925 15096 14925 query68 8352973 614 614 query69 519 351 306 306 query70 1079104710211021 query71 488 339 323 323 query72 5854486148324832 query73 668 570 352 352 query74 8814881886388638 query75 3700305125552555 query76 37251143721 721 query77 822 394 321 321 query78 9469963488158815 query79 2379841 587 587 query80 653 581 504 504 query81 501 272 235 235 query82 436 138 114 114 query83 307 267 255 255 query84 301 121 99 99 query85 920 509 448 448 query86 392 308 298 298 query87 4013405539943994 query88 3937229622642264 query89 401 337 290 290 query90 1933237 222 222 query91 176 172 144 144 query92 83 71 72 71 query93 19681016649 649 query94 712 445 365 365 query95 514 420 419 419 query96 521 565 290 290 query97 2628270025712571 query98 248 224 221 221 query99 1432138712831283 Total cold run time: 273464 ms Total hot run time: 182310 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3592674296 TPC-H: Total hot run time: 34476 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 2d14d7ec4bff2b09f4ff08b9656d209ab6677f80, data reload: false -- Round 1 -- q1 17478 508349574957 q2 2011319 213 213 q3 10147 1323750 750 q4 10236 905 365 365 q5 7505248223272327 q6 195 177 146 146 q7 967 805 646 646 q8 9350139710351035 q9 7282535853765358 q10 6878220918261826 q11 520 308 292 292 q12 355 383 232 232 q13 17800 371230323032 q14 228 237 221 221 q15 592 526 510 510 q16 887 869 822 822 q17 585 791 495 495 q18 7675707570557055 q19 1058964 571 571 q20 347 349 237 237 q21 3597379524382438 q22 1042997 948 948 Total cold run time: 106735 ms Total hot run time: 34476 ms - Round 2, with runtime_filter_mode=off - q1 4999503049954995 q2 348 409 335 335 q3 2114270922822282 q4 1354176313331333 q5 4238448644864486 q6 239 183 134 134 q7 2102197318891889 q8 2712251025122510 q9 7456755175057505 q10 3140322429132913 q11 573 527 501 501 q12 692 748 625 625 q13 3806395834043404 q14 288 311 310 310 q15 555 528 513 513 q16 900 959 889 889 q17 1138136514551365 q18 7828781075467546 q19 875 831 833 831 q20 1962197718211821 q21 4599430541294129 q22 10711038969 969 Total cold run time: 52989 ms Total hot run time: 51285 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3592560690 # Cloud UT Coverage Report Increment line coverage `43.36% (496/1144)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/2d14d7ec4bff2b09f4ff08b9656d209ab6677f80_2d14d7ec4bff2b09f4ff08b9656d209ab6677f80_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/2d14d7ec4bff2b09f4ff08b9656d209ab6677f80_2d14d7ec4bff2b09f4ff08b9656d209ab6677f80_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 81.00% (1727/2132) | | Line Coverage | 66.38% (30509/45962) | | Region Coverage | 66.98% (15233/22743) | | Branch Coverage | 57.08% (8101/14192) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
liaoxin01 commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3592539535 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
hello-stephen commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3587416622 # BE Regression && UT Coverage Report Increment line coverage `87.42% (848/970)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/57770_2d14d7ec4bff2b09f4ff08b9656d209ab6677f80_merge/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/57770_2d14d7ec4bff2b09f4ff08b9656d209ab6677f80_merge/report/index.html) | Category | Coverage | |---|| | Function Coverage | 71.69% (24639/34368) | | Line Coverage | 58.24% (257211/441632) | | Region Coverage | 53.33% (214344/401937) | | Branch Coverage | 54.85% (91656/167103) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3587302949 # BE UT Coverage Report Increment line coverage `73.24% (758/1035)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/2d14d7ec4bff2b09f4ff08b9656d209ab6677f80_2d14d7ec4bff2b09f4ff08b9656d209ab6677f80/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/2d14d7ec4bff2b09f4ff08b9656d209ab6677f80_2d14d7ec4bff2b09f4ff08b9656d209ab6677f80/report/index.html) | Category | Coverage | |---|| | Function Coverage | 52.97% (18573/35060) | | Line Coverage | 38.52% (170281/442102) | | Region Coverage | 33.31% (132320/397202) | | Branch Coverage | 34.27% (56958/166226) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3587164257 ClickBench: Total hot run time: 28.37 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 2d14d7ec4bff2b09f4ff08b9656d209ab6677f80, data reload: false query1 0.040.050.05 query2 0.140.060.06 query3 0.300.080.07 query4 1.600.100.10 query5 0.260.250.25 query6 1.180.650.64 query7 0.030.030.02 query8 0.070.060.06 query9 0.580.530.50 query10 0.570.570.55 query11 0.250.140.14 query12 0.250.150.14 query13 0.680.640.62 query14 1.011.000.99 query15 0.890.810.80 query16 0.380.370.38 query17 1.021.071.01 query18 0.230.230.22 query19 1.891.791.80 query20 0.010.010.02 query21 15.39 0.270.24 query22 4.930.100.10 query23 15.39 0.380.23 query24 2.390.430.34 query25 0.090.080.10 query26 0.190.190.18 query27 0.100.100.09 query28 4.001.351.17 query29 12.65 4.003.32 query30 0.320.110.10 query31 2.810.630.44 query32 3.240.600.50 query33 3.053.093.04 query34 16.84 5.134.57 query35 4.604.624.66 query36 0.620.500.48 query37 0.260.090.08 query38 0.210.050.06 query39 0.070.040.05 query40 0.200.180.16 query41 0.140.070.06 query42 0.080.050.04 query43 0.060.060.05 Total cold run time: 99.01 s Total hot run time: 28.37 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3587154320 TPC-DS: Total hot run time: 184183 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 2d14d7ec4bff2b09f4ff08b9656d209ab6677f80, data reload: false query1 1076398 391 391 query2 6563159815781578 query3 6746226 223 223 query4 25550 22903 22814 22814 query5 4397624 468 468 query6 340 242 224 224 query7 4642518 311 311 query8 318 262 239 239 query9 8714254725622547 query10 530 335 341 335 query11 15218 14778 14952 14778 query12 181 117 111 111 query13 1677542 445 445 query14 10798 890788598859 query15 208 196 178 178 query16 7413688 530 530 query17 1225772 614 614 query18 1999434 384 384 query19 203 195 181 181 query20 126 128 121 121 query21 217 138 125 125 query22 3933405137983798 query23 33118 31970 31856 31856 query24 8544239223622362 query25 600 524 464 464 query26 1259270 162 162 query27 2753484 351 351 query28 4365213421142114 query29 824 663 497 497 query30 309 254 211 211 query31 819 717 633 633 query32 86 70 72 70 query33 596 382 325 325 query34 816 874 542 542 query35 848 825 738 738 query36 887 927 834 834 query37 123 119 88 88 query38 3265330932303230 query39 1488141213851385 query40 227 133 120 120 query41 64 60 73 60 query42 122 113 114 113 query43 444 461 429 429 query44 1290763 749 749 query45 201 204 185 185 query46 868 1008645 645 query47 1669171316211621 query48 389 412 324 324 query49 785 531 405 405 query50 653 696 418 418 query51 3912389138473847 query52 115 114 107 107 query53 241 262 193 193 query54 305 290 270 270 query55 92 95 93 93 query56 311 330 338 330 query57 1123117111231123 query58 297 281 287 281 query59 2362248323062306 query60 356 363 376 363 query61 195 193 187 187 query62 794 747 673 673 query63 236 201 205 201 query64 4654131410111011 query65 4093397640033976 query66 1185441 338 338 query67 15336 14926 14737 14737 query68 7419946 619 619 query69 518 342 296 296 query70 1328121511921192 query71 432 339 315 315 query72 5741484748764847 query73 638 587 357 357 query74 8516886285598559 query75 3314335328162816 query76 32971152698 698 query77 505 413 310 310 query78 9419955988118811 query79 1453847 592 592 query80 628 590 506 506 query81 504 270 238 238 query82 206 159 131 131 query83 272 263 257 257 query84 258 113 91 91 query85 900 519 451 451 query86 377 286 290 286 query87 3478353233923392 query88 2885230822852285 query89 400 331 306 306 query90 1975230 221 221 query91 222 196 158 158 query92 83 72 68 68 query93 12011004661 661 query94 739 461 365 365 query95 524 434 425 425 query96 519 550 292 292 query97 2885302129302930 query98 242 238 211 211 query99 1282139312761276 Total cold run time: 267253 ms Total hot run time: 184183 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3587136120 TPC-H: Total hot run time: 34072 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 2d14d7ec4bff2b09f4ff08b9656d209ab6677f80, data reload: false -- Round 1 -- q1 17457 504749254925 q2 2013305 202 202 q3 10192 1293724 724 q4 10232 927 357 357 q5 7549253621872187 q6 191 173 141 141 q7 965 819 636 636 q8 93501383968 968 q9 7066533252705270 q10 6875221718101810 q11 518 317 293 293 q12 362 367 223 223 q13 17796 365129922992 q14 232 238 224 224 q15 598 518 509 509 q16 10371015945 945 q17 612 813 450 450 q18 8310707870397039 q19 1100944 562 562 q20 340 331 228 228 q21 2965314724322432 q22 10391014955 955 Total cold run time: 106799 ms Total hot run time: 34072 ms - Round 2, with runtime_filter_mode=off - q1 4938492849184918 q2 325 408 317 317 q3 2109269023032303 q4 1304175713291329 q5 4240430944824309 q6 205 168 141 141 q7 2044200718851885 q8 2681257125422542 q9 7498744975217449 q10 3065330828002800 q11 590 511 490 490 q12 703 762 641 641 q13 3566387033993399 q14 294 300 272 272 q15 553 526 497 497 q16 1087110410811081 q17 1146138913811381 q18 7961770475147514 q19 803 812 762 762 q20 2019197518471847 q21 4657423441294129 q22 11011012985 985 Total cold run time: 52889 ms Total hot run time: 50991 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
hello-stephen commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3587027281 # FE UT Coverage Report Increment line coverage `` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/57770_2d14d7ec4bff2b09f4ff08b9656d209ab6677f80/fe_increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/57770_2d14d7ec4bff2b09f4ff08b9656d209ab6677f80/fe_report/index.html) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
hello-stephen commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3586972579 # Cloud UT Coverage Report Increment line coverage `43.36% (496/1144)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/2d14d7ec4bff2b09f4ff08b9656d209ab6677f80_2d14d7ec4bff2b09f4ff08b9656d209ab6677f80_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/2d14d7ec4bff2b09f4ff08b9656d209ab6677f80_2d14d7ec4bff2b09f4ff08b9656d209ab6677f80_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 81.00% (1727/2132) | | Line Coverage | 66.37% (30493/45946) | | Region Coverage | 67.02% (15239/22739) | | Branch Coverage | 57.10% (8102/14188) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
luwei16 commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3586901991 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
hello-stephen commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3585693754 # BE Regression && UT Coverage Report Increment line coverage `87.40% (846/968)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/57770_2ce2b4402dfae648153eb15b7c773f33973e6b7c_merge/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/57770_2ce2b4402dfae648153eb15b7c773f33973e6b7c_merge/report/index.html) | Category | Coverage | |---|| | Function Coverage | 71.67% (24623/34356) | | Line Coverage | 58.27% (257189/441399) | | Region Coverage | 53.45% (214753/401817) | | Branch Coverage | 54.88% (91659/167013) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
hello-stephen commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3585335537 # BE UT Coverage Report Increment line coverage `75.27% (755/1003)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/2ce2b4402dfae648153eb15b7c773f33973e6b7c_2ce2b4402dfae648153eb15b7c773f33973e6b7c/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/2ce2b4402dfae648153eb15b7c773f33973e6b7c_2ce2b4402dfae648153eb15b7c773f33973e6b7c/report/index.html) | Category | Coverage | |---|| | Function Coverage | 52.99% (18573/35047) | | Line Coverage | 38.55% (170336/441820) | | Region Coverage | 33.36% (132443/397040) | | Branch Coverage | 34.30% (56974/166124) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3585072422 ClickBench: Total hot run time: 28.38 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 2ce2b4402dfae648153eb15b7c773f33973e6b7c, data reload: false query1 0.050.050.04 query2 0.120.070.06 query3 0.300.060.07 query4 1.610.080.09 query5 0.260.260.24 query6 1.160.670.66 query7 0.030.020.03 query8 0.100.070.06 query9 0.640.540.54 query10 0.590.580.60 query11 0.250.140.14 query12 0.250.140.14 query13 0.660.620.62 query14 1.031.071.02 query15 0.930.870.86 query16 0.400.380.38 query17 1.041.051.04 query18 0.230.210.22 query19 1.931.861.75 query20 0.020.010.01 query21 15.40 0.290.24 query22 5.030.100.10 query23 15.37 0.380.23 query24 2.880.530.32 query25 0.090.100.09 query26 0.180.180.17 query27 0.090.090.09 query28 3.751.281.11 query29 12.60 3.973.29 query30 0.320.120.10 query31 2.830.620.46 query32 3.240.610.52 query33 3.133.043.08 query34 16.80 5.204.57 query35 4.574.544.56 query36 0.650.530.50 query37 0.220.090.10 query38 0.190.060.05 query39 0.050.050.05 query40 0.200.180.17 query41 0.120.060.05 query42 0.070.040.05 query43 0.060.050.05 Total cold run time: 99.44 s Total hot run time: 28.38 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3585053950 TPC-DS: Total hot run time: 184974 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 2ce2b4402dfae648153eb15b7c773f33973e6b7c, data reload: false query1 1053420 442 420 query2 6586159415831583 query3 6755224 223 223 query4 25929 22969 22704 22704 query5 4397627 476 476 query6 326 242 218 218 query7 4662500 298 298 query8 327 249 242 242 query9 8695255825982558 query10 524 371 310 310 query11 15241 15196 14532 14532 query12 180 118 111 111 query13 1704559 456 456 query14 10703 897889168916 query15 218 213 183 183 query16 7285705 550 550 query17 1258832 653 653 query18 2016447 351 351 query19 212 204 185 185 query20 128 131 120 120 query21 216 135 118 118 query22 4053413941084108 query23 33016 32216 32111 32111 query24 8546240624242406 query25 628 563 485 485 query26 1242282 162 162 query27 2745504 347 347 query28 4333215221382138 query29 893 645 520 520 query30 307 243 224 224 query31 838 705 614 614 query32 86 77 74 74 query33 632 394 339 339 query34 779 882 529 529 query35 813 884 730 730 query36 919 930 888 888 query37 120 112 92 92 query38 3299329232293229 query39 1461141214311412 query40 223 129 125 125 query41 67 66 66 66 query42 125 112 114 112 query43 463 469 448 448 query44 1226748 742 742 query45 200 195 191 191 query46 892 1005634 634 query47 1695172916511651 query48 398 430 325 325 query49 765 491 407 407 query50 647 676 396 396 query51 3916405438783878 query52 109 110 109 109 query53 245 276 201 201 query54 306 290 288 288 query55 94 94 98 94 query56 330 339 327 327 query57 1158119511071107 query58 295 275 273 273 query59 2454257425252525 query60 342 348 354 348 query61 218 170 162 162 query62 792 711 656 656 query63 222 189 192 189 query64 45941208906 906 query65 4087396939933969 query66 1170427 346 346 query67 15184 14939 14943 14939 query68 8430898 616 616 query69 515 329 313 313 query70 1313125811481148 query71 474 318 308 308 query72 6055507449914991 query73 714 594 353 353 query74 8596890686058605 query75 3888335528282828 query76 37431121718 718 query77 809 394 311 311 query78 9382962889228922 query79 2899790 585 585 query80 711 592 498 498 query81 502 267 250 250 query82 433 161 129 129 query83 308 255 248 248 query84 299 120 105 105 query85 929 503 462 462 query86 340 311 298 298 query87 3501353633493349 query88 2943225422052205 query89 418 329 293 293 query90 1951221 217 217 query91 169 171 138 138 query92 80 71 65 65 query93 1971988 649 649 query94 717 455 355 355 query95 487 412 391 391 query96 503 580 292 292 query97 2993297328532853 query98 248 216 214 214 query99 1457138212361236 Total cold run time: 273120 ms Total hot run time: 184974 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3585009649 TPC-H: Total hot run time: 34151 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 2ce2b4402dfae648153eb15b7c773f33973e6b7c, data reload: false -- Round 1 -- q1 17412 501248824882 q2 2013305 207 207 q3 10180 1282720 720 q4 10217 919 354 354 q5 7562229823872298 q6 187 175 139 139 q7 924 798 638 638 q8 9344140011281128 q9 7194519153315191 q10 6874224118311831 q11 504 295 298 295 q12 352 361 213 213 q13 17794 362430003000 q14 235 244 214 214 q15 590 523 522 522 q16 10391050987 987 q17 577 874 373 373 q18 7656721871597159 q19 1119945 547 547 q20 374 352 236 236 q21 3756314722682268 q22 10371009949 949 Total cold run time: 106940 ms Total hot run time: 34151 ms - Round 2, with runtime_filter_mode=off - q1 4976490949374909 q2 328 403 316 316 q3 2189265923212321 q4 1378178413381338 q5 4259439245774392 q6 231 176 146 146 q7 2086195817711771 q8 2752255826132558 q9 7481752575037503 q10 3093326928252825 q11 585 529 493 493 q12 725 773 633 633 q13 3570393534353435 q14 290 291 271 271 q15 544 517 505 505 q16 1082107110691069 q17 1191160813531353 q18 7874787377137713 q19 809 787 910 787 q20 2033211018251825 q21 4625440142644264 q22 1082106610051005 Total cold run time: 53183 ms Total hot run time: 51432 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3584691088 # Cloud UT Coverage Report Increment line coverage `43.88% (484/1103)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/2ce2b4402dfae648153eb15b7c773f33973e6b7c_2ce2b4402dfae648153eb15b7c773f33973e6b7c_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/2ce2b4402dfae648153eb15b7c773f33973e6b7c_2ce2b4402dfae648153eb15b7c773f33973e6b7c_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 80.99% (1726/2131) | | Line Coverage | 66.34% (30436/45877) | | Region Coverage | 66.96% (15227/22740) | | Branch Coverage | 57.05% (8092/14184) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
luwei16 commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3584558280 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3582914380 ClickBench: Total hot run time: 28.36 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 8813a1d1f6a61aad4af3d3a2681eeac3087ecf91, data reload: false query1 0.060.050.04 query2 0.120.070.07 query3 0.320.070.08 query4 1.610.090.07 query5 0.260.250.26 query6 1.170.670.64 query7 0.030.020.03 query8 0.080.070.06 query9 0.630.530.53 query10 0.580.580.59 query11 0.250.130.15 query12 0.260.140.14 query13 0.650.640.62 query14 1.031.051.02 query15 0.950.850.86 query16 0.390.390.39 query17 1.041.121.06 query18 0.230.220.21 query19 2.001.841.84 query20 0.020.020.01 query21 15.40 0.280.24 query22 4.960.090.10 query23 15.37 0.380.23 query24 2.920.480.31 query25 0.090.090.09 query26 0.190.180.17 query27 0.100.090.09 query28 3.761.271.08 query29 12.54 3.973.29 query30 0.340.120.11 query31 2.830.630.45 query32 3.250.600.50 query33 3.083.093.13 query34 16.58 5.154.47 query35 4.764.534.52 query36 0.650.530.51 query37 0.230.090.09 query38 0.190.060.05 query39 0.060.050.06 query40 0.210.170.17 query41 0.120.060.06 query42 0.080.050.06 query43 0.050.050.06 Total cold run time: 99.44 s Total hot run time: 28.36 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3582890343 TPC-DS: Total hot run time: 183644 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 8813a1d1f6a61aad4af3d3a2681eeac3087ecf91, data reload: false query1 1022418 413 413 query2 6625159116391591 query3 6753222 223 222 query4 25915 22966 22198 22198 query5 4388642 471 471 query6 334 235 227 227 query7 4662503 304 304 query8 310 258 242 242 query9 8707253725572537 query10 505 361 314 314 query11 15412 14812 14671 14671 query12 173 129 110 110 query13 1673578 472 472 query14 10402 875788968757 query15 242 204 185 185 query16 7236703 535 535 query17 1264778 662 662 query18 2019449 345 345 query19 218 215 190 190 query20 138 134 134 134 query21 218 135 116 116 query22 3938393038093809 query23 33174 32111 32219 32111 query24 8409239123972391 query25 643 547 489 489 query26 1246277 174 174 query27 2752492 358 358 query28 4391212521142114 query29 894 637 525 525 query30 311 259 220 220 query31 872 703 647 647 query32 86 76 78 76 query33 609 402 345 345 query34 838 870 519 519 query35 814 845 751 751 query36 917 966 864 864 query37 135 108 88 88 query38 3272330832403240 query39 1495151014191419 query40 228 130 119 119 query41 64 64 64 64 query42 127 113 111 111 query43 455 449 429 429 query44 1215753 747 747 query45 200 195 178 178 query46 874 993 634 634 query47 1704173716581658 query48 391 417 339 339 query49 768 494 416 416 query50 656 674 420 420 query51 3893395438903890 query52 108 107 101 101 query53 230 270 194 194 query54 295 291 267 267 query55 91 90 88 88 query56 330 307 323 307 query57 1161119911091109 query58 286 281 272 272 query59 2425252923352335 query60 356 356 337 337 query61 164 158 160 158 query62 779 731 653 653 query63 229 191 187 187 query64 46081204866 866 query65 4079396839523952 query66 1179440 332 332 query67 15210 15039 14845 14845 query68 8436894 628 628 query69 510 333 306 306 query70 1318120312431203 query71 485 342 316 316 query72 5636493348584858 query73 696 584 345 345 query74 8551864283748374 query75 3903336428392839 query76 37441116684 684 query77 809 394 295 295 query78 9572968289478947 query79 2437810 590 590 query80 686 572 514 514 query81 525 264 243 243 query82 484 166 145 145 query83 269 250 245 245 query84 262 112 106 106 query85 952 491 451 451 query86 390 319 292 292 query87 3537358734083408 query88 3686224422482244 query89 387 324 293 293 query90 1860219 215 215 query91 175 185 144 144 query92 90 70 68 68 query93 1881996 671 671 query94 722 450 343 343 query95 496 403 401 401 query96 499 565 277 277 query97 2954294828482848 query98 241 212 220 212 query99 1294137112951295 Total cold run time: 272604 ms Total hot run time: 183644 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3582839171 TPC-H: Total hot run time: 34206 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 8813a1d1f6a61aad4af3d3a2681eeac3087ecf91, data reload: false -- Round 1 -- q1 17608 501248594859 q2 2041318 210 210 q3 10192 1288712 712 q4 10238 954 366 366 q5 7499229223852292 q6 212 175 139 139 q7 906 818 650 650 q8 9338137011451145 q9 7270524753385247 q10 6907224818321832 q11 511 299 276 276 q12 369 360 223 223 q13 17778 364730183018 q14 243 248 219 219 q15 592 508 509 508 q16 10241183966 966 q17 600 868 366 366 q18 7457716471247124 q19 1101954 566 566 q20 348 336 232 232 q21 3688321822902290 q22 10421018966 966 Total cold run time: 106964 ms Total hot run time: 34206 ms - Round 2, with runtime_filter_mode=off - q1 4954492649044904 q2 324 393 313 313 q3 2212269723252325 q4 1364180613061306 q5 4266440645424406 q6 213 171 130 130 q7 2092211118621862 q8 2690267826312631 q9 7580758174857485 q10 3105327527852785 q11 595 519 501 501 q12 708 786 677 677 q13 3604405333383338 q14 294 299 278 278 q15 549 495 501 495 q16 1119112410831083 q17 1190156713801380 q18 7987783275677567 q19 843 840 862 840 q20 2082213019391939 q21 4903430844654308 q22 10761080995 995 Total cold run time: 53750 ms Total hot run time: 51548 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3582523448 # Cloud UT Coverage Report Increment line coverage `43.88% (484/1103)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/8813a1d1f6a61aad4af3d3a2681eeac3087ecf91_8813a1d1f6a61aad4af3d3a2681eeac3087ecf91_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/8813a1d1f6a61aad4af3d3a2681eeac3087ecf91_8813a1d1f6a61aad4af3d3a2681eeac3087ecf91_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 80.99% (1726/2131) | | Line Coverage | 66.42% (30473/45877) | | Region Coverage | 67.01% (15238/22740) | | Branch Coverage | 57.13% (8104/14184) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
luwei16 commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3582295817 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
hello-stephen commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3577485531 # BE Regression && UT Coverage Report Increment line coverage `87.41% (847/969)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/57770_cb471687b90876a1b68ab7e9368f8eace0c05c76_merge/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/57770_cb471687b90876a1b68ab7e9368f8eace0c05c76_merge/report/index.html) | Category | Coverage | |---|| | Function Coverage | 71.69% (24548/34242) | | Line Coverage | 58.21% (255932/439685) | | Region Coverage | 53.43% (213887/400308) | | Branch Coverage | 54.87% (91233/166279) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3577194574 # BE UT Coverage Report Increment line coverage `75.50% (758/1004)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/cb471687b90876a1b68ab7e9368f8eace0c05c76_cb471687b90876a1b68ab7e9368f8eace0c05c76/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/cb471687b90876a1b68ab7e9368f8eace0c05c76_cb471687b90876a1b68ab7e9368f8eace0c05c76/report/index.html) | Category | Coverage | |---|| | Function Coverage | 52.99% (18487/34891) | | Line Coverage | 38.47% (169100/439570) | | Region Coverage | 33.28% (131472/395048) | | Branch Coverage | 34.19% (56514/165294) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3576919752 ClickBench: Total hot run time: 28.37 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit cb471687b90876a1b68ab7e9368f8eace0c05c76, data reload: false query1 0.050.060.05 query2 0.120.070.06 query3 0.310.080.07 query4 1.610.080.08 query5 0.260.260.25 query6 1.170.660.65 query7 0.040.030.03 query8 0.080.070.08 query9 0.630.530.52 query10 0.580.590.58 query11 0.260.130.13 query12 0.260.140.15 query13 0.640.640.63 query14 1.041.021.00 query15 0.930.860.85 query16 0.390.390.38 query17 1.021.051.05 query18 0.230.210.22 query19 2.001.821.82 query20 0.020.010.01 query21 15.38 0.270.25 query22 4.990.100.09 query23 15.37 0.380.23 query24 2.670.610.35 query25 0.100.090.09 query26 0.180.170.18 query27 0.100.090.09 query28 3.631.261.08 query29 12.65 4.033.27 query30 0.310.120.11 query31 2.810.640.46 query32 3.240.600.50 query33 3.053.183.11 query34 16.80 5.144.46 query35 4.494.534.52 query36 0.640.530.51 query37 0.220.090.10 query38 0.190.060.05 query39 0.050.040.04 query40 0.190.180.17 query41 0.120.060.06 query42 0.070.040.05 query43 0.070.060.05 Total cold run time: 98.96 s Total hot run time: 28.37 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3576883255 TPC-DS: Total hot run time: 184108 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit cb471687b90876a1b68ab7e9368f8eace0c05c76, data reload: false query1 1082419 387 387 query2 6576159315831583 query3 6745225 223 223 query4 25953 23044 22332 22332 query5 4405617 472 472 query6 337 244 223 223 query7 4648494 294 294 query8 290 259 259 259 query9 8680261526312615 query10 534 371 307 307 query11 15104 14819 14688 14688 query12 167 119 113 113 query13 1690589 444 444 query14 10315 918490599059 query15 217 202 195 195 query16 7413684 542 542 query17 1273766 653 653 query18 2007431 340 340 query19 225 215 185 185 query20 138 126 118 118 query21 218 135 119 119 query22 3988408938013801 query23 33344 32122 32022 32022 query24 8468240724602407 query25 651 565 484 484 query26 1256273 168 168 query27 2755503 368 368 query28 4346218521582158 query29 872 674 485 485 query30 311 237 215 215 query31 836 714 621 621 query32 90 73 73 73 query33 590 383 317 317 query34 796 856 535 535 query35 817 847 750 750 query36 912 937 844 844 query37 127 108 82 82 query38 3450328933043289 query39 1487142914041404 query40 228 132 123 123 query41 68 80 76 76 query42 140 115 113 113 query43 474 478 460 460 query44 1252758 748 748 query45 200 188 184 184 query46 889 1002645 645 query47 1669172916441644 query48 422 436 337 337 query49 777 501 426 426 query50 680 675 419 419 query51 3857407338883888 query52 109 113 103 103 query53 247 267 192 192 query54 316 293 281 281 query55 89 85 82 82 query56 330 332 321 321 query57 1170117311161116 query58 290 280 275 275 query59 2401253223952395 query60 353 346 343 343 query61 180 161 158 158 query62 789 687 655 655 query63 233 199 198 198 query64 45521212887 887 query65 4050399439413941 query66 1180452 326 326 query67 15095 15002 14836 14836 query68 8416909 624 624 query69 511 336 308 308 query70 1242124812271227 query71 477 333 319 319 query72 5628482048174817 query73 675 598 371 371 query74 8863874583338333 query75 3944330528212821 query76 36951120713 713 query77 830 428 323 323 query78 9451963088948894 query79 1227854 607 607 query80 644 582 491 491 query81 506 268 245 245 query82 204 166 136 136 query83 287 264 252 252 query84 266 123 103 103 query85 864 484 455 455 query86 334 312 273 273 query87 3511355334013401 query88 2907231722632263 query89 391 324 284 284 query90 2084235 232 232 query91 185 175 138 138 query92 82 73 67 67 query93 1096974 655 655 query94 713 461 327 327 query95 517 409 415 409 query96 494 586 284 284 query97 2920299328992899 query98 240 221 207 207 query99 1375141412841284 Total cold run time: 269732 ms Total hot run time: 184108 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3576835527 TPC-H: Total hot run time: 34278 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit cb471687b90876a1b68ab7e9368f8eace0c05c76, data reload: false -- Round 1 -- q1 17609 509249864986 q2 2000337 203 203 q3 10193 1293729 729 q4 10222 909 364 364 q5 7520233624692336 q6 195 178 141 141 q7 924 791 629 629 q8 9349133510461046 q9 7418533952395239 q10 6913220318131813 q11 511 304 292 292 q12 369 357 211 211 q13 17794 367230223022 q14 227 239 208 208 q15 591 521 511 511 q16 10361024964 964 q17 589 872 403 403 q18 7887729271437143 q19 1104958 556 556 q20 353 345 234 234 q21 3731318822942294 q22 10461020954 954 Total cold run time: 107581 ms Total hot run time: 34278 ms - Round 2, with runtime_filter_mode=off - q1 5013492949914929 q2 324 400 305 305 q3 2159273822912291 q4 1367180213281328 q5 4214455145324532 q6 220 175 130 130 q7 2092199818201820 q8 2744266325722572 q9 7647757274197419 q10 3087321928642864 q11 589 520 496 496 q12 675 780 622 622 q13 3606402633843384 q14 302 291 295 291 q15 562 534 529 529 q16 1101110910461046 q17 1197157714451445 q18 7768762675457545 q19 843 889 905 889 q20 1888193818131813 q21 4737429543054295 q22 10841052983 983 Total cold run time: 53219 ms Total hot run time: 51528 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3576533823 # Cloud UT Coverage Report Increment line coverage `43.88% (484/1103)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/cb471687b90876a1b68ab7e9368f8eace0c05c76_cb471687b90876a1b68ab7e9368f8eace0c05c76_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/cb471687b90876a1b68ab7e9368f8eace0c05c76_cb471687b90876a1b68ab7e9368f8eace0c05c76_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 80.99% (1726/2131) | | Line Coverage | 66.36% (30442/45877) | | Region Coverage | 66.94% (15223/22740) | | Branch Coverage | 57.07% (8095/14184) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
liaoxin01 commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3576373524 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3575951941 ClickBench: Total hot run time: 28.2 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 78e84504cd77b1e6d650b4596e1c9f55eb199f12, data reload: false query1 0.050.040.04 query2 0.130.070.07 query3 0.300.070.08 query4 1.600.080.09 query5 0.270.240.26 query6 1.170.660.65 query7 0.030.020.02 query8 0.070.060.09 query9 0.630.540.53 query10 0.580.580.58 query11 0.250.130.14 query12 0.260.140.14 query13 0.640.640.62 query14 1.011.001.01 query15 0.930.860.84 query16 0.400.400.39 query17 1.021.021.02 query18 0.230.220.22 query19 1.981.801.78 query20 0.020.010.02 query21 15.39 0.270.24 query22 4.990.100.09 query23 15.36 0.380.23 query24 2.870.510.32 query25 0.100.090.09 query26 0.190.180.18 query27 0.090.100.10 query28 3.621.251.07 query29 12.55 3.933.26 query30 0.320.120.10 query31 2.850.640.45 query32 3.230.590.51 query33 3.183.053.06 query34 16.68 5.164.52 query35 4.524.484.50 query36 0.650.520.50 query37 0.220.090.10 query38 0.200.060.06 query39 0.060.050.04 query40 0.210.200.17 query41 0.120.060.06 query42 0.070.050.05 query43 0.060.050.05 Total cold run time: 99.1 s Total hot run time: 28.2 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3575928392 TPC-DS: Total hot run time: 184202 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 78e84504cd77b1e6d650b4596e1c9f55eb199f12, data reload: false query1 1089413 400 400 query2 6542160816041604 query3 6756226 232 226 query4 25575 23012 22394 22394 query5 4438647 475 475 query6 354 236 222 222 query7 4654494 295 295 query8 317 251 247 247 query9 8698263026352630 query10 530 367 300 300 query11 15146 15137 14551 14551 query12 173 129 112 112 query13 1684572 461 461 query14 10489 894589988945 query15 219 199 189 189 query16 7306708 528 528 query17 1265798 681 681 query18 1985427 328 328 query19 205 202 174 174 query20 131 127 121 121 query21 215 135 113 113 query22 3817395040083950 query23 32801 31998 31883 31883 query24 8216240424242404 query25 606 512 456 456 query26 1240272 164 164 query27 2748503 346 346 query28 4214218421682168 query29 852 633 479 479 query30 310 244 215 215 query31 836 746 641 641 query32 85 72 71 71 query33 600 382 342 342 query34 791 871 548 548 query35 784 822 760 760 query36 883 964 884 884 query37 120 113 93 93 query38 3368338133363336 query39 1482140914341409 query40 221 131 122 122 query41 66 63 74 63 query42 133 110 112 110 query43 474 472 433 433 query44 1296764 759 759 query45 200 196 185 185 query46 906 996 656 656 query47 1687169716381638 query48 395 431 330 330 query49 758 489 418 418 query50 656 693 407 407 query51 3830389438683868 query52 111 114 112 112 query53 245 271 191 191 query54 315 301 284 284 query55 89 86 88 86 query56 344 328 323 323 query57 1146116710821082 query58 297 277 281 277 query59 2380249223182318 query60 349 349 340 340 query61 164 153 159 153 query62 789 717 653 653 query63 230 194 199 194 query64 44341306894 894 query65 4043399439473947 query66 1155452 337 337 query67 15459 15041 14746 14746 query68 6623886 623 623 query69 535 336 312 312 query70 1260122711811181 query71 445 344 306 306 query72 5777499949194919 query73 669 610 368 368 query74 8631871685658565 query75 3280334128312831 query76 33281138747 747 query77 523 404 316 316 query78 9341970588348834 query79 1263815 619 619 query80 646 586 503 503 query81 528 276 239 239 query82 215 172 142 142 query83 268 265 254 254 query84 255 114 99 99 query85 878 480 442 442 query86 378 319 307 307 query87 3534356834183418 query88 2912228322892283 query89 387 324 296 296 query90 1897222 226 222 query91 174 175 144 144 query92 75 73 67 67 query93 1129970 654 654 query94 725 454 342 342 query95 498 411 394 394 query96 501 589 281 281 query97 2869295428552855 query98 235 208 210 208 query99 1305140513601360 Total cold run time: 264780 ms Total hot run time: 184202 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
hello-stephen commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3575926986 # BE UT Coverage Report Increment line coverage `75.50% (758/1004)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/78e84504cd77b1e6d650b4596e1c9f55eb199f12_78e84504cd77b1e6d650b4596e1c9f55eb199f12/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/78e84504cd77b1e6d650b4596e1c9f55eb199f12_78e84504cd77b1e6d650b4596e1c9f55eb199f12/report/index.html) | Category | Coverage | |---|| | Function Coverage | 52.92% (18467/34896) | | Line Coverage | 38.41% (168899/439694) | | Region Coverage | 33.29% (131535/395167) | | Branch Coverage | 34.15% (56470/165378) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [PR] [feature-WIP](cloud) Implement small-file merging [doris]
doris-robot commented on PR #57770: URL: https://github.com/apache/doris/pull/57770#issuecomment-3575880123 TPC-H: Total hot run time: 34301 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 78e84504cd77b1e6d650b4596e1c9f55eb199f12, data reload: false -- Round 1 -- q1 16688 505849434943 q2 2036314 213 213 q3 98901311732 732 q4 10068 972 385 385 q5 7625236324072363 q6 188 173 141 141 q7 940 797 645 645 q8 9351136311121112 q9 6972536353085308 q10 6843223817861786 q11 491 302 285 285 q12 335 367 228 228 q13 17782 367530123012 q14 231 235 224 224 q15 577 511 509 509 q16 10531009962 962 q17 584 891 373 373 q18 7400721170017001 q19 1090949 556 556 q20 367 345 227 227 q21 3840323023322332 q22 10071005964 964 Total cold run time: 105358 ms Total hot run time: 34301 ms - Round 2, with runtime_filter_mode=off - q1 4960496050334960 q2 333 401 317 317 q3 2200264822742274 q4 1365177313301330 q5 4248432044994320 q6 218 174 133 133 q7 2110192118781878 q8 2696255325742553 q9 7515751674847484 q10 3014334528352835 q11 593 515 504 504 q12 732 747 609 609 q13 3551398633853385 q14 304 327 308 308 q15 554 499 511 499 q16 1063112910641064 q17 1180155513891389 q18 7874779276047604 q19 842 876 896 876 q20 2033194518251825 q21 4767433142664266 q22 1082104310111011 Total cold run time: 53234 ms Total hot run time: 51424 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
