Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
zzzxl1993 closed pull request #50145: [feture](inverted index) Add multi inverted index support for single column URL: https://github.com/apache/doris/pull/50145 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
hello-stephen commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2832245675 # BE Regression P0 && UT Coverage Report Increment line coverage `65.49% (372/568)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/50145_7c3a50f967978a347ab3ca4ec725a7db06841c41_merge/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/50145_7c3a50f967978a347ab3ca4ec725a7db06841c41_merge/report/index.html) | Category | Coverage | |---|| | Function Coverage | 55.00% (14649/26633) | | Line Coverage | 44.34% (131688/297014) | | Region Coverage | 41.41% (75766/182981) | | Branch Coverage | 35.53% (36675/103232) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
hello-stephen commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2832149545 # BE UT Coverage Report Increment line coverage `65.49% (372/568)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/7c3a50f967978a347ab3ca4ec725a7db06841c41_7c3a50f967978a347ab3ca4ec725a7db06841c41/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/7c3a50f967978a347ab3ca4ec725a7db06841c41_7c3a50f967978a347ab3ca4ec725a7db06841c41/report/index.html) | Category | Coverage | |---|| | Function Coverage | 54.18% (14702/27136) | | Line Coverage | 43.04% (128070/297543) | | Region Coverage | 41.90% (65598/156552) | | Branch Coverage | 36.55% (33137/90674) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
doris-robot commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2832073911 ClickBench: Total hot run time: 29.62 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 7c3a50f967978a347ab3ca4ec725a7db06841c41, data reload: false query1 0.050.030.03 query2 0.120.100.10 query3 0.270.190.19 query4 1.600.190.20 query5 0.580.580.59 query6 1.180.720.72 query7 0.020.020.02 query8 0.040.040.03 query9 0.570.510.51 query10 0.560.570.55 query11 0.160.110.10 query12 0.150.120.12 query13 0.620.600.60 query14 1.141.191.21 query15 0.880.840.85 query16 0.380.380.38 query17 0.991.001.03 query18 0.210.200.20 query19 1.871.781.85 query20 0.010.010.02 query21 15.42 0.880.54 query22 0.741.230.69 query23 14.92 1.360.61 query24 7.121.530.74 query25 0.520.130.09 query26 0.620.170.15 query27 0.050.050.05 query28 9.160.930.44 query29 12.54 3.993.30 query30 0.260.090.06 query31 2.830.610.38 query32 3.220.560.48 query33 3.043.043.06 query34 15.77 5.184.56 query35 4.514.564.56 query36 0.670.500.48 query37 0.090.070.06 query38 0.060.040.03 query39 0.030.030.02 query40 0.180.140.12 query41 0.090.030.03 query42 0.030.020.03 query43 0.040.040.03 Total cold run time: 103.31 s Total hot run time: 29.62 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
doris-robot commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2832067315 TPC-DS: Total hot run time: 193182 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 7c3a50f967978a347ab3ca4ec725a7db06841c41, data reload: false query1 1403107110541054 query2 5991182017921792 query3 11142 469247244692 query4 25269 23428 23488 23428 query5 5037615 445 445 query6 305 216 204 204 query7 3989481 283 283 query8 298 249 234 234 query9 8562255825782558 query10 530 344 259 259 query11 15715 15085 14904 14904 query12 162 110 116 110 query13 1581528 417 417 query14 9453619759905990 query15 197 183 172 172 query16 7646631 477 477 query17 1297775 579 579 query18 2015398 322 322 query19 201 193 170 170 query20 131 136 123 123 query21 213 122 111 111 query22 4675453245424532 query23 34584 33796 33550 33550 query24 9020239323852385 query25 517 471 403 403 query26 1195268 148 148 query27 2771516 335 335 query28 4791214121082108 query29 689 578 439 439 query30 280 218 191 191 query31 897 902 823 823 query32 77 66 61 61 query33 524 380 308 308 query34 786 871 499 499 query35 816 849 766 766 query36 964 1002898 898 query37 111 99 81 81 query38 4315421142334211 query39 1493143314491433 query40 220 117 110 110 query41 56 54 52 52 query42 123 107 111 107 query43 521 500 495 495 query44 1282833 807 807 query45 178 173 164 164 query46 829 1015629 629 query47 1862190118001800 query48 373 419 322 322 query49 780 516 461 461 query50 659 699 424 424 query51 4194431341874187 query52 106 107 97 97 query53 220 258 181 181 query54 582 578 521 521 query55 83 77 77 77 query56 303 323 297 297 query57 1193123711081108 query58 255 256 255 255 query59 2744285426762676 query60 328 323 298 298 query61 123 125 122 122 query62 796 723 681 681 query63 221 191 192 191 query64 42091055685 685 query65 4472439543714371 query66 944 401 308 308 query67 15972 15424 15386 15386 query68 8237868 503 503 query69 483 288 259 259 query70 1203112611231123 query71 443 315 293 293 query72 5692475547844755 query73 689 623 358 358 query74 9015923292179217 query75 3779320626482648 query76 35571182789 789 query77 775 367 284 284 query78 999510165 92559255 query79 2050808 574 574 query80 559 501 440 440 query81 459 253 214 214 query82 465 125 101 101 query83 244 253 236 236 query84 237 100 79 79 query85 789 355 312 312 query86 342 296 280 280 query87 4465443142884288 query88 3289218221672167 query89 428 307 276 276 query90 1974202 203 202 query91 141 140 109 109 query92 77 61 59 59 query93 1197924 571 571 query94 625 390 290 290 query95 372 282 280 280 query96 473 558 273 273 query97 3203323031503150 query98 224 204 197 197 query99 1360141812931293 Total cold run time: 280111 ms Total hot run time: 193182 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
doris-robot commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2832059853 TPC-H: Total hot run time: 33766 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 7c3a50f967978a347ab3ca4ec725a7db06841c41, data reload: false -- Round 1 -- q1 25805 505049834983 q2 2064284 197 197 q3 10383 1241690 690 q4 10218 1008557 557 q5 7539228123172281 q6 178 161 133 133 q7 912 778 607 607 q8 9308126710331033 q9 6939512251255122 q10 6851229918941894 q11 470 280 271 271 q12 344 354 221 221 q13 17785 368230723072 q14 227 220 205 205 q15 529 484 482 482 q16 443 446 400 400 q17 580 841 341 341 q18 7505709971717099 q19 1408955 551 551 q20 334 328 217 217 q21 4077259423952395 q22 1069104510151015 Total cold run time: 114968 ms Total hot run time: 33766 ms - Round 2, with runtime_filter_mode=off - q1 5104505050785050 q2 237 346 244 244 q3 2223276823422342 q4 1483180414281428 q5 4367440444084404 q6 221 167 131 131 q7 2000189417761776 q8 2570248725372487 q9 7223726869966996 q10 3031318527522752 q11 587 508 486 486 q12 705 777 679 679 q13 3707386333513351 q14 302 304 285 285 q15 538 480 475 475 q16 470 505 464 464 q17 1154159813471347 q18 7677762073537353 q19 799 785 868 785 q20 1980194818231823 q21 5299486747824782 q22 1106105610101010 Total cold run time: 52783 ms Total hot run time: 50450 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
zzzxl1993 commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2832042101 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
hello-stephen commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2832042085 # BE Regression P0 && UT Coverage Report Increment line coverage `65.37% (370/566)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/50145_d0d6ba220e4c9c8142a2e77ff5451885e6f40612_merge/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/50145_d0d6ba220e4c9c8142a2e77ff5451885e6f40612_merge/report/index.html) | Category | Coverage | |---|| | Function Coverage | 57.99% (15445/26633) | | Line Coverage | 47.48% (141012/297012) | | Region Coverage | 44.58% (81567/182979) | | Branch Coverage | 38.03% (39257/103230) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
doris-robot commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2832006016 # BE UT Coverage Report Increment line coverage `65.37% (370/566)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/d0d6ba220e4c9c8142a2e77ff5451885e6f40612_d0d6ba220e4c9c8142a2e77ff5451885e6f40612/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/d0d6ba220e4c9c8142a2e77ff5451885e6f40612_d0d6ba220e4c9c8142a2e77ff5451885e6f40612/report/index.html) | Category | Coverage | |---|| | Function Coverage | 54.19% (14704/27136) | | Line Coverage | 43.05% (128083/297541) | | Region Coverage | 41.90% (65596/156550) | | Branch Coverage | 36.54% (33135/90672) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
zzzxl1993 commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2831916877 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
doris-robot commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2823912915 TPC-H: Total hot run time: 34002 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit c81cd3bf8be907ae4e3623590ed4b0c3acc9a75c, data reload: false -- Round 1 -- q1 26422 499949874987 q2 2076281 192 192 q3 10393 1265703 703 q4 10254 1031561 561 q5 7564245023902390 q6 189 165 130 130 q7 934 766 608 608 q8 9324128510361036 q9 6879515150855085 q10 6825233918911891 q11 504 282 265 265 q12 364 356 216 216 q13 17767 390531393139 q14 232 224 225 224 q15 568 481 494 481 q16 450 452 397 397 q17 601 878 365 365 q18 7838716171727161 q19 1706961 561 561 q20 331 331 217 217 q21 4208334624302430 q22 1044989 963 963 Total cold run time: 116473 ms Total hot run time: 34002 ms - Round 2, with runtime_filter_mode=off - q1 5162511250825082 q2 237 333 235 235 q3 2170263322532253 q4 1451181915361536 q5 4620443744484437 q6 213 170 128 128 q7 2005195317211721 q8 2576261624562456 q9 7258723871217121 q10 3043312527542754 q11 567 502 480 480 q12 699 767 645 645 q13 3530382132883288 q14 296 306 286 286 q15 528 474 471 471 q16 480 515 448 448 q17 1141158313841384 q18 7684754874597459 q19 799 816 971 816 q20 1950195717791779 q21 5208483946654665 q22 10511034981 981 Total cold run time: 52668 ms Total hot run time: 50425 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
doris-robot commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2823953495 ClickBench: Total hot run time: 28.83 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit c81cd3bf8be907ae4e3623590ed4b0c3acc9a75c, data reload: false query1 0.040.040.03 query2 0.120.110.10 query3 0.260.200.19 query4 1.590.200.19 query5 0.580.570.59 query6 1.190.720.72 query7 0.020.010.02 query8 0.040.040.03 query9 0.560.510.51 query10 0.560.570.56 query11 0.160.110.11 query12 0.150.110.10 query13 0.610.600.61 query14 1.171.201.15 query15 0.860.850.86 query16 0.390.390.38 query17 1.091.031.01 query18 0.210.190.20 query19 1.921.721.80 query20 0.020.010.02 query21 15.42 0.920.53 query22 0.761.230.67 query23 14.91 1.370.65 query24 6.771.450.33 query25 0.460.110.08 query26 0.610.160.14 query27 0.060.060.05 query28 9.580.940.42 query29 12.55 3.983.28 query30 0.260.080.06 query31 2.820.590.38 query32 3.230.550.47 query33 3.143.013.04 query34 15.72 5.094.43 query35 4.534.534.51 query36 0.650.500.48 query37 0.080.060.06 query38 0.060.040.04 query39 0.020.040.03 query40 0.180.130.12 query41 0.080.030.02 query42 0.030.020.02 query43 0.040.030.02 Total cold run time: 103.5 s Total hot run time: 28.83 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
doris-robot commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2823941512 TPC-DS: Total hot run time: 185641 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit c81cd3bf8be907ae4e3623590ed4b0c3acc9a75c, data reload: false query1 1015483 492 483 query2 6558186018661860 query3 6737221 215 215 query4 26249 23149 22989 22989 query5 4391656 461 461 query6 300 224 191 191 query7 4618494 280 280 query8 295 248 241 241 query9 8625257225692569 query10 501 326 276 276 query11 15492 15041 14849 14849 query12 162 109 113 109 query13 1661527 395 395 query14 9498616363106163 query15 231 203 176 176 query16 7268633 491 491 query17 1202741 579 579 query18 1979410 317 317 query19 196 186 158 158 query20 167 115 120 115 query21 215 123 102 102 query22 4122416241544154 query23 34232 33053 33016 33016 query24 8433236823702368 query25 533 447 392 392 query26 1235273 151 151 query27 2732491 334 334 query28 4322211320932093 query29 752 554 434 434 query30 285 218 187 187 query31 952 840 768 768 query32 77 61 66 61 query33 573 374 305 305 query34 784 840 525 525 query35 765 809 745 745 query36 947 995 919 919 query37 113 104 77 77 query38 4210414942264149 query39 1489140115551401 query40 216 118 108 108 query41 56 54 55 54 query42 119 103 105 103 query43 496 494 489 489 query44 1280783 783 783 query45 179 172 177 172 query46 829 1036612 612 query47 1745178816951695 query48 384 403 299 299 query49 779 487 418 418 query50 625 698 399 399 query51 4105419940544054 query52 108 109 95 95 query53 222 256 187 187 query54 576 581 500 500 query55 87 80 81 80 query56 319 292 292 292 query57 1145114410951095 query58 258 256 250 250 query59 2618288526832683 query60 319 319 301 301 query61 134 130 125 125 query62 812 757 659 659 query63 229 190 188 188 query64 43601107672 672 query65 4313419442574194 query66 1126415 306 306 query67 15721 15423 15227 15227 query68 8021881 563 563 query69 475 322 264 264 query70 1171109910811081 query71 486 311 290 290 query72 5559468446274627 query73 699 576 344 344 query74 9233894786108610 query75 3875318827102710 query76 37271207740 740 query77 783 383 306 306 query78 10035 10163 92859285 query79 1928816 565 565 query80 627 512 441 441 query81 466 256 220 220 query82 449 131 153 131 query83 290 255 238 238 query84 293 104 78 78 query85 782 365 333 333 query86 336 309 283 283 query87 4479445344184418 query88 2818221822162216 query89 407 316 276 276 query90 1961227 227 227 query91 147 141 108 108 query92 74 67 58 58 query93 1208947 583 583 query94 674 411 310 310 query95 381 305 290 290 query96 485 579 281 281 query97 3161321631463146 query98 219 201 202 201 query99 1473139512801280 Total cold run time: 273798 ms Total hot run time: 185641 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
zzzxl1993 commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2823744190 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
zzzxl1993 commented on code in PR #50145:
URL: https://github.com/apache/doris/pull/50145#discussion_r2053224601
##
be/src/olap/rowset/segment_v2/segment_iterator.cpp:
##
@@ -1082,10 +1077,12 @@ Status
SegmentIterator::_init_inverted_index_iterators() {
const auto& column = _opts.tablet_schema->column(cid);
int32_t col_unique_id =
column.is_extracted_column() ? column.parent_unique_id() :
column.unique_id();
-RETURN_IF_ERROR(_segment->new_inverted_index_iterator(
-column,
-_segment->_tablet_schema->inverted_index(col_unique_id,
column.suffix_path()),
-_opts, &_inverted_index_iterators[cid]));
+auto inverted_indexs =
+_segment->_tablet_schema->inverted_indexs(col_unique_id,
column.suffix_path());
+for (const auto& inverted_index : inverted_indexs) {
+RETURN_IF_ERROR(_segment->new_inverted_index_iterator(
Review Comment:
done
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
csun5285 commented on code in PR #50145:
URL: https://github.com/apache/doris/pull/50145#discussion_r2052003526
##
be/src/olap/rowset/segment_v2/segment_iterator.cpp:
##
@@ -1082,10 +1077,12 @@ Status
SegmentIterator::_init_inverted_index_iterators() {
const auto& column = _opts.tablet_schema->column(cid);
int32_t col_unique_id =
column.is_extracted_column() ? column.parent_unique_id() :
column.unique_id();
-RETURN_IF_ERROR(_segment->new_inverted_index_iterator(
-column,
-_segment->_tablet_schema->inverted_index(col_unique_id,
column.suffix_path()),
-_opts, &_inverted_index_iterators[cid]));
+auto inverted_indexs =
+_segment->_tablet_schema->inverted_indexs(col_unique_id,
column.suffix_path());
+for (const auto& inverted_index : inverted_indexs) {
+RETURN_IF_ERROR(_segment->new_inverted_index_iterator(
Review Comment:
cache `invertefd_index_reader` in `column_reader`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
hello-stephen commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2817676757 # BE Regression P0 && UT Coverage Report Increment line coverage `55.30% (292/528)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/50145_be91a1aba342ce890325cc40fbca8724be6b8e0d_merge/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/50145_be91a1aba342ce890325cc40fbca8724be6b8e0d_merge/report/index.html) | Category | Coverage | |---|| | Function Coverage | 55.73% (14855/26655) | | Line Coverage | 45.26% (134492/297168) | | Region Coverage | 42.51% (77756/182909) | | Branch Coverage | 36.40% (37561/103200) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
doris-robot commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2816682582 # BE UT Coverage Report Increment line coverage `55.11% (291/528)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/be91a1aba342ce890325cc40fbca8724be6b8e0d_be91a1aba342ce890325cc40fbca8724be6b8e0d/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/be91a1aba342ce890325cc40fbca8724be6b8e0d_be91a1aba342ce890325cc40fbca8724be6b8e0d/report/index.html) | Category | Coverage | |---|| | Function Coverage | 53.17% (14430/27141) | | Line Coverage | 42.02% (125064/297641) | | Region Coverage | 40.84% (63911/156475) | | Branch Coverage | 35.47% (32150/90634) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
doris-robot commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2816682045 ClickBench: Total hot run time: 29.5 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit be91a1aba342ce890325cc40fbca8724be6b8e0d, data reload: false query1 0.040.030.03 query2 0.120.110.12 query3 0.250.200.19 query4 1.590.190.11 query5 0.570.540.55 query6 1.170.710.71 query7 0.020.020.02 query8 0.040.040.04 query9 0.600.540.51 query10 0.570.570.57 query11 0.160.100.10 query12 0.150.110.11 query13 0.610.590.59 query14 1.141.181.20 query15 0.870.840.84 query16 0.370.380.39 query17 1.041.000.99 query18 0.210.190.20 query19 1.931.751.75 query20 0.020.010.01 query21 15.38 0.920.53 query22 0.741.220.74 query23 14.81 1.390.63 query24 6.771.800.96 query25 0.490.140.06 query26 0.530.170.15 query27 0.050.050.04 query28 10.03 0.870.44 query29 12.54 4.043.31 query30 0.240.080.06 query31 2.840.600.39 query32 3.220.540.47 query33 3.103.003.07 query34 15.81 5.074.47 query35 4.494.494.46 query36 0.680.490.48 query37 0.080.060.06 query38 0.050.040.04 query39 0.020.020.03 query40 0.170.140.14 query41 0.080.030.03 query42 0.030.020.02 query43 0.030.040.03 Total cold run time: 103.65 s Total hot run time: 29.5 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
doris-robot commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2816680488 TPC-DS: Total hot run time: 191872 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit be91a1aba342ce890325cc40fbca8724be6b8e0d, data reload: false query1 1387109510601060 query2 6215182217731773 query3 11016 446544674465 query4 54731 25589 22961 22961 query5 5079545 457 457 query6 328 207 201 201 query7 4879494 282 282 query8 321 258 243 243 query9 5395261725962596 query10 434 321 260 260 query11 14941 15079 15159 15079 query12 156 113 104 104 query13 1061515 401 401 query14 10117 621362456213 query15 199 206 179 179 query16 7100633 463 463 query17 1074710 569 569 query18 1525400 309 309 query19 197 203 167 167 query20 135 137 121 121 query21 203 129 119 119 query22 4250442543134313 query23 34180 33318 33514 33318 query24 6672240924212409 query25 478 453 423 423 query26 680 279 151 151 query27 2220518 331 331 query28 3216218121552155 query29 579 562 422 422 query30 276 222 191 191 query31 883 875 766 766 query32 73 62 65 62 query33 439 369 317 317 query34 802 885 518 518 query35 797 817 767 767 query36 940 1028911 911 query37 122 98 73 73 query38 4168426041114111 query39 1479142514531425 query40 205 129 109 109 query41 53 53 52 52 query42 130 107 103 103 query43 491 513 471 471 query44 1349812 819 812 query45 175 184 171 171 query46 855 1037640 640 query47 1807183017871787 query48 386 458 308 308 query49 651 542 419 419 query50 677 705 416 416 query51 4287429741494149 query52 115 119 101 101 query53 243 264 183 183 query54 585 600 512 512 query55 82 81 82 81 query56 295 311 295 295 query57 1183119411171117 query58 259 276 264 264 query59 2678276227342734 query60 330 321 320 320 query61 129 127 129 127 query62 733 750 683 683 query63 223 185 186 185 query64 15561047683 683 query65 4457420442244204 query66 728 400 310 310 query67 15771 15291 15206 15206 query68 5849878 521 521 query69 526 298 264 264 query70 1180110710681068 query71 434 308 287 287 query72 5785481650044816 query73 1297659 339 339 query74 8853918889368936 query75 3255315927102710 query76 38111179742 742 query77 548 362 292 292 query78 10198 10206 92639263 query79 2396877 576 576 query80 657 512 444 444 query81 483 262 217 217 query82 270 128 97 97 query83 268 250 231 231 query84 302 99 89 89 query85 780 360 325 325 query86 374 289 287 287 query87 4467447742694269 query88 3231222622252225 query89 396 319 279 279 query90 1756208 223 208 query91 138 133 109 109 query92 79 57 61 57 query93 2206959 588 588 query94 681 409 307 307 query95 373 295 294 294 query96 489 571 279 279 query97 3183322231133113 query98 238 214 199 199 query99 1338140513141314 Total cold run time: 295021 ms Total hot run time: 191872 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
doris-robot commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2816676090 TPC-H: Total hot run time: 34092 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit be91a1aba342ce890325cc40fbca8724be6b8e0d, data reload: false -- Round 1 -- q1 26645 500650085006 q2 2052313 208 208 q3 10342 1249692 692 q4 10237 993 543 543 q5 7588240923672367 q6 187 169 132 132 q7 914 755 606 606 q8 9309132111641164 q9 6866518051145114 q10 6816230218761876 q11 505 288 279 279 q12 349 356 218 218 q13 17756 367930793079 q14 223 225 216 216 q15 527 498 488 488 q16 451 443 399 399 q17 595 877 356 356 q18 7623722472537224 q19 1208937 557 557 q20 331 327 216 216 q21 3957337424102410 q22 10221001942 942 Total cold run time: 115503 ms Total hot run time: 34092 ms - Round 2, with runtime_filter_mode=off - q1 5235510450835083 q2 245 323 228 228 q3 2151269322902290 q4 1459186714411441 q5 4442447044014401 q6 221 167 124 124 q7 2013192117411741 q8 2597249925152499 q9 7315727571777177 q10 3060314727412741 q11 591 506 493 493 q12 683 774 633 633 q13 3493386433003300 q14 300 300 274 274 q15 522 475 475 475 q16 458 501 472 472 q17 1166155114081408 q18 7813767474577457 q19 811 838 846 838 q20 1980197518191819 q21 5213500348294829 q22 10661077998 998 Total cold run time: 52834 ms Total hot run time: 50721 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
zzzxl1993 commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2816650958 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
zzzxl1993 commented on code in PR #50145:
URL: https://github.com/apache/doris/pull/50145#discussion_r2051449167
##
be/src/olap/compaction.cpp:
##
@@ -895,94 +910,104 @@ void
Compaction::construct_index_compaction_columns(RowsetWriterContext& ctx) {
return false;
}
-const auto* index_meta =
rowset->tablet_schema()->inverted_index(col_unique_id);
-
DBUG_EXECUTE_IF("Compaction::construct_skip_inverted_index_index_meta_nullptr",
-{ index_meta = nullptr; })
-if (index_meta == nullptr) {
-LOG(WARNING) << "tablet[" << _tablet->tablet_id() << "]
column_unique_id["
- << col_unique_id << "] index meta is null, will
skip index compaction";
-return false;
-}
+auto index_metas =
rowset->tablet_schema()->inverted_indexs(col_unique_id);
Review Comment:
done
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
doris-robot commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2816611308 # BE UT Coverage Report Increment line coverage `53.43% (296/554)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/a2e0a39c2ceed03f8f2b520f859d7c704eb6826a_a2e0a39c2ceed03f8f2b520f859d7c704eb6826a/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/a2e0a39c2ceed03f8f2b520f859d7c704eb6826a_a2e0a39c2ceed03f8f2b520f859d7c704eb6826a/report/index.html) | Category | Coverage | |---|| | Function Coverage | 53.16% (14427/27141) | | Line Coverage | 42.02% (125070/297647) | | Region Coverage | 40.83% (63898/156483) | | Branch Coverage | 35.46% (32144/90636) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
airborne12 commented on code in PR #50145:
URL: https://github.com/apache/doris/pull/50145#discussion_r2051367733
##
be/src/olap/compaction.cpp:
##
@@ -895,94 +910,104 @@ void
Compaction::construct_index_compaction_columns(RowsetWriterContext& ctx) {
return false;
}
-const auto* index_meta =
rowset->tablet_schema()->inverted_index(col_unique_id);
-
DBUG_EXECUTE_IF("Compaction::construct_skip_inverted_index_index_meta_nullptr",
-{ index_meta = nullptr; })
-if (index_meta == nullptr) {
-LOG(WARNING) << "tablet[" << _tablet->tablet_id() << "]
column_unique_id["
- << col_unique_id << "] index meta is null, will
skip index compaction";
-return false;
-}
+auto index_metas =
rowset->tablet_schema()->inverted_indexs(col_unique_id);
Review Comment:
maybe when index_metas.empty(), we also need to return false.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
zzzxl1993 commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2815796205 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
zzzxl1993 commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2815694152 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
zzzxl1993 commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2815546904 run beut -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
doris-robot commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2814974902 ClickBench: Total hot run time: 29.38 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 81405c603fc6897dda612fc27afb755b863cbad1, data reload: false query1 0.040.040.03 query2 0.120.110.11 query3 0.300.200.19 query4 1.630.200.20 query5 0.590.600.60 query6 1.410.720.72 query7 0.020.020.02 query8 0.040.030.03 query9 0.600.530.51 query10 0.560.570.55 query11 0.160.110.11 query12 0.150.110.11 query13 0.610.600.60 query14 1.151.161.16 query15 0.870.860.85 query16 0.390.380.40 query17 1.040.991.04 query18 0.220.190.20 query19 1.861.741.75 query20 0.010.020.01 query21 15.41 0.930.53 query22 0.761.200.64 query23 14.95 1.380.61 query24 7.180.690.74 query25 0.530.270.12 query26 0.630.160.13 query27 0.050.050.05 query28 9.450.920.41 query29 12.55 3.973.33 query30 0.250.080.06 query31 2.820.580.39 query32 3.240.540.46 query33 3.013.093.10 query34 15.82 5.104.46 query35 4.474.524.51 query36 0.660.500.48 query37 0.080.060.06 query38 0.060.040.04 query39 0.030.020.02 query40 0.160.140.13 query41 0.080.020.03 query42 0.030.020.02 query43 0.030.030.03 Total cold run time: 104.02 s Total hot run time: 29.38 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
doris-robot commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2815267761 TPC-H: Total hot run time: 34191 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit e223bc5044d186bb84e989ba17c513b2413d5647, data reload: false -- Round 1 -- q1 26214 511050655065 q2 2058308 199 199 q3 10360 1238710 710 q4 10226 986 544 544 q5 7543231623612316 q6 180 171 132 132 q7 913 740 599 599 q8 9330128611561156 q9 6975511651525116 q10 6864230518831883 q11 480 289 263 263 q12 363 362 224 224 q13 17805 364130833083 q14 216 229 217 217 q15 529 492 482 482 q16 448 452 421 421 q17 613 852 363 363 q18 7572740672837283 q19 1743958 542 542 q20 342 338 214 214 q21 4018328324092409 q22 10021008970 970 Total cold run time: 115794 ms Total hot run time: 34191 ms - Round 2, with runtime_filter_mode=off - q1 5101512250965096 q2 244 329 236 236 q3 2106257122502250 q4 1398179614271427 q5 4469437843964378 q6 219 167 125 125 q7 1969191917361736 q8 2576263525492549 q9 7281728670497049 q10 3007316327072707 q11 584 509 489 489 q12 676 753 591 591 q13 3522387532703270 q14 286 292 280 280 q15 522 484 463 463 q16 453 484 461 461 q17 1148154414141414 q18 7639763774377437 q19 830 847 873 847 q20 1978200118271827 q21 5182484248334833 q22 1066106810001000 Total cold run time: 52256 ms Total hot run time: 50465 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
doris-robot commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2815285961 ClickBench: Total hot run time: 29.61 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit e223bc5044d186bb84e989ba17c513b2413d5647, data reload: false query1 0.040.040.03 query2 0.120.100.11 query3 0.250.200.20 query4 1.590.190.20 query5 0.580.580.58 query6 1.190.720.73 query7 0.020.020.01 query8 0.040.040.03 query9 0.580.520.53 query10 0.580.560.56 query11 0.160.110.11 query12 0.150.110.11 query13 0.610.600.59 query14 1.141.191.16 query15 0.880.840.88 query16 0.380.380.38 query17 1.031.041.02 query18 0.200.200.19 query19 1.891.801.80 query20 0.010.010.02 query21 15.39 0.900.55 query22 0.761.290.62 query23 14.84 1.390.64 query24 7.450.901.03 query25 0.430.100.14 query26 0.700.160.16 query27 0.040.050.04 query28 9.750.880.41 query29 12.54 4.103.38 query30 0.250.090.07 query31 2.820.590.38 query32 3.220.560.46 query33 3.083.023.14 query34 16.24 5.114.44 query35 4.534.534.49 query36 0.670.490.48 query37 0.090.060.07 query38 0.050.040.03 query39 0.030.030.03 query40 0.180.130.13 query41 0.090.030.02 query42 0.030.020.03 query43 0.030.030.03 Total cold run time: 104.65 s Total hot run time: 29.61 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
doris-robot commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2815280479 TPC-DS: Total hot run time: 192289 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit e223bc5044d186bb84e989ba17c513b2413d5647, data reload: false query1 1397106710361036 query2 6314177117641764 query3 11032 449443734373 query4 53893 24607 23093 23093 query5 5085531 459 459 query6 348 196 189 189 query7 4904502 286 286 query8 310 237 224 224 query9 5730256125772561 query10 439 319 262 262 query11 15129 14952 14860 14860 query12 161 121 103 103 query13 1054506 394 394 query14 10135 631163336311 query15 196 199 179 179 query16 7031636 533 533 query17 1096732 597 597 query18 1530423 308 308 query19 190 197 165 165 query20 136 126 124 124 query21 203 130 107 107 query22 4644459745554555 query23 34288 33465 33590 33465 query24 6564247724352435 query25 506 513 466 466 query26 682 285 155 155 query27 2143504 337 337 query28 2917212121322121 query29 590 565 432 432 query30 270 223 186 186 query31 852 859 780 780 query32 70 59 61 59 query33 436 380 311 311 query34 761 843 526 526 query35 808 834 770 770 query36 909 1011896 896 query37 119 101 78 78 query38 4247426442404240 query39 1491145514101410 query40 223 115 109 109 query41 58 53 51 51 query42 135 106 106 106 query43 477 496 477 477 query44 1324810 804 804 query45 186 178 168 168 query46 834 1027639 639 query47 1850186218021802 query48 392 433 329 329 query49 695 543 444 444 query50 672 692 408 408 query51 4260428742474247 query52 119 118 106 106 query53 235 263 188 188 query54 623 587 561 561 query55 89 86 83 83 query56 350 317 290 290 query57 1178115311131113 query58 254 266 248 248 query59 2651279126342634 query60 337 336 312 312 query61 133 129 128 128 query62 757 735 692 692 query63 229 185 195 185 query64 14771044729 729 query65 4377419642174196 query66 708 396 306 306 query67 15736 15604 15263 15263 query68 7458883 512 512 query69 522 294 274 274 query70 1122105910851059 query71 509 316 310 310 query72 5929476548614765 query73 1457652 351 351 query74 8942916987428742 query75 3887319327252725 query76 41921292755 755 query77 626 367 274 274 query78 999510023 92819281 query79 5325796 544 544 query80 639 525 429 429 query81 495 255 225 225 query82 630 126 99 99 query83 338 249 234 234 query84 302 109 85 85 query85 783 354 314 314 query86 367 320 280 280 query87 4399430543354305 query88 3529226522402240 query89 452 307 293 293 query90 1944216 214 214 query91 145 139 112 112 query92 75 57 60 57 query93 2490924 566 566 query94 682 413 313 313 query95 376 308 282 282 query96 490 565 285 285 query97 3158316131153115 query98 228 211 207 207 query99 1412142912741274 Total cold run time: 301867 ms Total hot run time: 192289 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
zzzxl1993 commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2815216499 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
doris-robot commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2814961208 TPC-DS: Total hot run time: 185087 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 81405c603fc6897dda612fc27afb755b863cbad1, data reload: false query1 1023461 486 461 query2 6565183118171817 query3 6741228 216 216 query4 25852 24125 23160 23160 query5 5611617 450 450 query6 294 192 191 191 query7 4624493 280 280 query8 301 236 247 236 query9 8625255325642553 query10 530 324 253 253 query11 15387 15279 14768 14768 query12 163 117 109 109 query13 1667530 414 414 query14 9365610061426100 query15 209 184 175 175 query16 7319627 461 461 query17 1160743 589 589 query18 1985442 289 289 query19 180 175 153 153 query20 120 117 113 113 query21 206 119 110 110 query22 4217426742424242 query23 34041 32792 32902 32792 query24 8435240223912391 query25 533 441 392 392 query26 1229269 152 152 query27 2759493 326 326 query28 4313210320912091 query29 775 538 438 438 query30 304 219 190 190 query31 896 860 786 786 query32 71 67 63 63 query33 542 370 304 304 query34 816 848 499 499 query35 826 823 747 747 query36 943 985 870 870 query37 109 99 76 76 query38 4098423240994099 query39 1438138213821382 query40 207 115 101 101 query41 59 53 53 53 query42 118 104 103 103 query43 481 516 460 460 query44 1305813 791 791 query45 180 176 163 163 query46 855 1022634 634 query47 1721180617041704 query48 374 424 315 315 query49 828 525 421 421 query50 665 677 394 394 query51 4144416040614061 query52 105 110 102 102 query53 227 255 193 193 query54 580 572 501 501 query55 84 76 80 76 query56 282 283 293 283 query57 1158117810801080 query58 250 248 256 248 query59 2626276125222522 query60 320 323 313 313 query61 128 127 129 127 query62 794 753 635 635 query63 232 188 189 188 query64 43961031681 681 query65 4327420342624203 query66 1084447 329 329 query67 15687 15399 15315 15315 query68 7934873 507 507 query69 503 307 258 258 query70 1200112610901090 query71 455 321 281 281 query72 5563464846434643 query73 621 588 344 344 query74 8942909587188718 query75 3550328326912691 query76 34031188765 765 query77 706 360 279 279 query78 988710125 93699369 query79 2023887 557 557 query80 582 512 440 440 query81 468 257 220 220 query82 229 125 97 97 query83 243 253 228 228 query84 248 101 80 80 query85 771 361 316 316 query86 343 298 282 282 query87 4296443542794279 query88 3764224022422240 query89 393 311 274 274 query90 1926219 209 209 query91 143 140 111 111 query92 77 56 62 56 query93 1517961 571 571 query94 668 406 304 304 query95 359 292 281 281 query96 498 571 280 280 query97 3108323730913091 query98 228 201 201 201 query99 1354142012911291 Total cold run time: 273491 ms Total hot run time: 185087 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
doris-robot commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2814944411 TPC-H: Total hot run time: 34150 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 81405c603fc6897dda612fc27afb755b863cbad1, data reload: false -- Round 1 -- q1 26199 502350035003 q2 2076268 185 185 q3 10492 1262711 711 q4 10231 1013532 532 q5 7709240724012401 q6 181 171 132 132 q7 932 739 603 603 q8 9312125911621162 q9 6831511950865086 q10 6806228718861886 q11 467 280 263 263 q12 354 350 224 224 q13 17773 364630963096 q14 217 221 207 207 q15 533 486 487 486 q16 473 448 403 403 q17 612 846 395 395 q18 7679728371387138 q19 1545978 568 568 q20 342 342 243 243 q21 4255346424602460 q22 10521031966 966 Total cold run time: 116071 ms Total hot run time: 34150 ms - Round 2, with runtime_filter_mode=off - q1 5151508350975083 q2 240 323 245 245 q3 2114266922712271 q4 1443181615231523 q5 4534447643824382 q6 209 162 126 126 q7 1949190317321732 q8 2586255624882488 q9 7164713771157115 q10 2996316527742774 q11 577 503 481 481 q12 654 777 645 645 q13 3505389132933293 q14 271 285 266 266 q15 523 471 471 471 q16 464 492 456 456 q17 1181161713711371 q18 7672747873877387 q19 796 832 863 832 q20 1958201919041904 q21 5298471646244624 q22 10421002997 997 Total cold run time: 52327 ms Total hot run time: 50466 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
zzzxl1993 commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2814790941 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
zzzxl1993 commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2812628171 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feture](inverted index) Add multi inverted index support for single column [doris]
Thearas commented on PR #50145: URL: https://github.com/apache/doris/pull/50145#issuecomment-2812625348 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
