Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
github-actions[bot] commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2968791578 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
doris-robot commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2964693541 TPC-DS: Total hot run time: 195718 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 52ad49a0236eb85be0d161aecf14ed8e19a5df33, data reload: false query1 1442109610531053 query2 6446190219181902 query3 11017 456345084508 query4 26942 23739 23272 23272 query5 5031655 489 489 query6 314 216 217 216 query7 3994540 308 308 query8 278 242 240 240 query9 8520287228842872 query10 503 356 291 291 query11 15161 15160 14875 14875 query12 179 107 108 107 query13 1585604 435 435 query14 9601634363336333 query15 209 206 179 179 query16 7634682 541 541 query17 1362750 645 645 query18 2040447 333 333 query19 217 213 175 175 query20 145 134 124 124 query21 215 134 116 116 query22 4412445242514251 query23 34609 33843 33598 33598 query24 9008251425222514 query25 537 494 414 414 query26 1011282 163 163 query27 2883541 361 361 query28 4389234023442340 query29 659 583 485 485 query30 284 229 203 203 query31 904 866 814 814 query32 84 67 66 66 query33 543 385 339 339 query34 847 898 597 597 query35 827 867 770 770 query36 10111055969 969 query37 133 108 86 86 query38 4327430943254309 query39 1504145314371437 query40 230 128 113 113 query41 67 67 63 63 query42 138 123 125 123 query43 553 543 525 525 query44 1449899 934 899 query45 201 178 169 169 query46 919 1090700 700 query47 1858186017681768 query48 432 493 368 368 query49 699 525 432 432 query50 713 731 461 461 query51 4245433042624262 query52 114 116 111 111 query53 253 274 202 202 query54 656 635 583 583 query55 92 89 93 89 query56 338 340 318 318 query57 1228123111831183 query58 284 276 292 276 query59 2808286827572757 query60 357 355 339 339 query61 129 130 133 130 query62 790 756 707 707 query63 264 227 215 215 query64 34311085732 732 query65 4408425742614257 query66 969 410 322 322 query67 16195 15780 15657 15657 query68 8455953 565 565 query69 528 323 278 278 query70 1282118411311131 query71 500 347 330 330 query72 5839476649074766 query73 740 676 386 386 query74 9097887188718871 query75 4015320527262726 query76 38331227823 823 query77 789 390 318 318 query78 10123 10202 94599459 query79 2358839 622 622 query80 617 617 491 491 query81 500 257 226 226 query82 426 129 101 101 query83 297 275 245 245 query84 295 112 96 96 query85 759 373 343 343 query86 366 338 300 300 query87 4413456443224322 query88 3508243724002400 query89 415 333 296 296 query90 1933214 210 210 query91 145 223 118 118 query92 82 64 66 64 query93 18211013621 621 query94 671 422 311 311 query95 389 315 305 305 query96 559 592 295 295 query97 2800279727472747 query98 244 218 209 209 query99 1455154112521252 Total cold run time: 283881 ms Total hot run time: 195718 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
doris-robot commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2964675721 TPC-H: Total hot run time: 34584 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 52ad49a0236eb85be0d161aecf14ed8e19a5df33, data reload: false -- Round 1 -- q1 27100 503050585030 q2 2033304 200 200 q3 10197 1230731 731 q4 10222 1005544 544 q5 7561232323992323 q6 187 168 138 138 q7 914 766 640 640 q8 9336133611991199 q9 6886511951265119 q10 6892236019121912 q11 508 305 293 293 q12 361 367 226 226 q13 17790 382732643264 q14 245 242 227 227 q15 558 499 490 490 q16 438 446 386 386 q17 682 892 408 408 q18 8077711072807110 q19 1728990 601 601 q20 361 358 238 238 q21 4197340325182518 q22 10491061987 987 Total cold run time: 117322 ms Total hot run time: 34584 ms - Round 2, with runtime_filter_mode=off - q1 5206508750505050 q2 251 327 231 231 q3 2210267323522352 q4 1405193214571457 q5 4498446244324432 q6 231 173 134 134 q7 2051195917751775 q8 2610253526282535 q9 7685735374267353 q10 3107326529242924 q11 598 544 538 538 q12 748 833 699 699 q13 3855424234393439 q14 303 283 267 267 q15 533 500 472 472 q16 458 500 477 477 q17 1210160814081408 q18 7992757474247424 q19 882 950 1118950 q20 1997205819761976 q21 4915454345164516 q22 1094107910501050 Total cold run time: 53839 ms Total hot run time: 51459 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
doris-robot commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2964700417 ClickBench: Total hot run time: 30.1 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 52ad49a0236eb85be0d161aecf14ed8e19a5df33, data reload: false query1 0.040.040.04 query2 0.140.110.11 query3 0.240.200.20 query4 1.610.100.11 query5 0.430.420.43 query6 1.200.670.68 query7 0.030.020.01 query8 0.050.040.04 query9 0.590.530.53 query10 0.570.580.59 query11 0.170.120.11 query12 0.150.120.12 query13 0.640.600.60 query14 0.810.820.80 query15 0.880.870.88 query16 0.380.380.40 query17 1.061.041.04 query18 0.240.230.22 query19 1.951.841.84 query20 0.010.010.01 query21 15.40 0.980.63 query22 0.761.240.74 query23 14.82 1.430.63 query24 6.741.501.29 query25 0.530.170.17 query26 0.460.160.13 query27 0.060.060.06 query28 10.33 0.870.45 query29 12.65 4.073.44 query30 0.260.100.07 query31 2.820.600.39 query32 3.240.560.48 query33 3.143.143.15 query34 15.78 5.174.47 query35 4.554.514.53 query36 0.670.500.49 query37 0.090.060.06 query38 0.050.050.04 query39 0.030.020.02 query40 0.170.140.13 query41 0.080.020.02 query42 0.030.020.02 query43 0.040.040.03 Total cold run time: 103.89 s Total hot run time: 30.1 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
airborne12 commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2962038683 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
github-actions[bot] commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2933658117 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
doris-robot commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2921933181 ClickBench: Total hot run time: 28.62 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit d185786450afaffd763788e26c2b5a9b22508640, data reload: false query1 0.040.040.03 query2 0.120.110.10 query3 0.250.180.19 query4 1.590.200.11 query5 0.450.430.43 query6 1.190.660.67 query7 0.020.020.02 query8 0.040.030.03 query9 0.590.530.54 query10 0.570.570.57 query11 0.170.120.11 query12 0.140.110.11 query13 0.620.600.60 query14 0.790.790.80 query15 0.880.860.86 query16 0.380.380.38 query17 1.031.041.04 query18 0.230.210.21 query19 1.941.901.78 query20 0.010.010.02 query21 15.42 0.930.54 query22 0.771.190.75 query23 14.79 1.380.61 query24 7.151.630.36 query25 0.320.300.06 query26 0.550.160.15 query27 0.050.060.06 query28 8.770.900.44 query29 12.56 3.953.30 query30 0.260.090.07 query31 2.810.600.38 query32 3.230.550.46 query33 3.073.113.13 query34 15.56 5.154.48 query35 4.554.544.48 query36 0.680.510.49 query37 0.090.060.07 query38 0.050.040.04 query39 0.030.020.02 query40 0.170.150.13 query41 0.080.030.02 query42 0.040.030.03 query43 0.040.040.03 Total cold run time: 102.09 s Total hot run time: 28.62 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
doris-robot commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2921920121 TPC-DS: Total hot run time: 185616 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit d185786450afaffd763788e26c2b5a9b22508640, data reload: false query1 1009496 496 496 query2 6570184418141814 query3 6760227 222 222 query4 26512 23815 23297 23297 query5 4286633 465 465 query6 311 209 199 199 query7 4633489 287 287 query8 267 230 223 223 query9 8645270826972697 query10 488 346 277 277 query11 16025 15040 14798 14798 query12 157 105 104 104 query13 1649521 423 423 query14 9625618662156186 query15 209 197 173 173 query16 7268636 486 486 query17 1172717 552 552 query18 1982392 294 294 query19 185 183 162 162 query20 127 114 120 114 query21 216 119 105 105 query22 4149428140804080 query23 33954 33048 33113 33048 query24 8440235723912357 query25 541 465 411 411 query26 1239279 157 157 query27 2747507 341 341 query28 4310213721222122 query29 787 598 461 461 query30 288 221 193 193 query31 953 866 755 755 query32 74 70 69 69 query33 579 398 328 328 query34 798 867 535 535 query35 803 829 733 733 query36 941 988 903 903 query37 112 99 85 85 query38 4214416240744074 query39 1461142813991399 query40 211 132 115 115 query41 69 64 70 64 query42 128 111 114 111 query43 508 495 477 477 query44 1303838 829 829 query45 187 183 177 177 query46 848 1045673 673 query47 1742180617621762 query48 401 421 305 305 query49 761 488 396 396 query50 636 681 410 410 query51 4129416341364136 query52 109 104 102 102 query53 221 249 183 183 query54 576 578 507 507 query55 93 80 82 80 query56 313 312 278 278 query57 1126113310641064 query58 267 296 255 255 query59 2455263024792479 query60 328 312 302 302 query61 126 127 139 127 query62 844 749 657 657 query63 220 193 186 186 query64 43121010693 693 query65 4249412841364128 query66 1125420 319 319 query67 15818 15512 15359 15359 query68 8897891 529 529 query69 469 315 267 267 query70 1219110411361104 query71 455 364 309 309 query72 5448474245574557 query73 702 576 352 352 query74 8960918387638763 query75 4258321027062706 query76 36771177750 750 query77 876 393 290 290 query78 994810136 92489248 query79 2204821 569 569 query80 663 510 441 441 query81 463 257 220 220 query82 279 134 96 96 query83 296 250 245 245 query84 302 109 95 95 query85 753 354 319 319 query86 325 283 284 283 query87 4430446543264326 query88 2897231723162316 query89 409 308 285 285 query90 2093211 216 211 query91 145 140 113 113 query92 75 61 63 61 query93 1907941 580 580 query94 662 412 299 299 query95 379 295 285 285 query96 489 580 291 291 query97 2704278526112611 query98 281 208 213 208 query99 1413141112881288 Total cold run time: 275669 ms Total hot run time: 185616 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
doris-robot commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2921887603 TPC-H: Total hot run time: 34459 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit d185786450afaffd763788e26c2b5a9b22508640, data reload: false -- Round 1 -- q1 26422 502650585026 q2 1935303 192 192 q3 10330 1240728 728 q4 10238 996 527 527 q5 7602236023072307 q6 181 161 131 131 q7 912 746 617 617 q8 9314124911001100 q9 6789512950955095 q10 6815233418901890 q11 478 291 272 272 q12 343 350 216 216 q13 17773 368131113111 q14 229 247 225 225 q15 558 489 504 489 q16 417 424 377 377 q17 586 863 356 356 q18 7852715170717071 q19 1824958 543 543 q20 317 335 230 230 q21 3683311329702970 q22 10691032986 986 Total cold run time: 115667 ms Total hot run time: 34459 ms - Round 2, with runtime_filter_mode=off - q1 5125501949924992 q2 251 320 226 226 q3 2164266023172317 q4 1339183414621462 q5 4489441843384338 q6 207 181 127 127 q7 1980195017561756 q8 2563249925292499 q9 7227706972507069 q10 2964319727192719 q11 578 501 497 497 q12 676 761 632 632 q13 3423395232373237 q14 276 314 291 291 q15 526 471 469 469 q16 456 487 456 456 q17 1162159213861386 q18 7810739674037396 q19 797 782 841 782 q20 2004205919181918 q21 4746431242394239 q22 1067997 991 991 Total cold run time: 51830 ms Total hot run time: 49799 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
airborne12 commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2921640095 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
doris-robot commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2915437488 TPC-DS: Total hot run time: 192872 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 49c5b3fea3bb6957ef9ee1559fdfe8918bd6f45b, data reload: false query1 1454107610781076 query2 6217177917981779 query3 11194 482946284628 query4 25730 23765 23433 23433 query5 4320649 467 467 query6 325 229 206 206 query7 3984505 287 287 query8 318 272 239 239 query9 8470259826082598 query10 496 318 256 256 query11 15300 15134 14800 14800 query12 158 111 103 103 query13 1555535 394 394 query14 8209618761956187 query15 205 200 174 174 query16 7247693 499 499 query17 1217737 571 571 query18 1972431 322 322 query19 210 205 193 193 query20 128 123 120 120 query21 228 134 117 117 query22 4722461345414541 query23 34829 33934 33629 33629 query24 8490244524572445 query25 515 459 406 406 query26 1054273 148 148 query27 2823507 349 349 query28 4677218621592159 query29 697 568 458 458 query30 353 236 189 189 query31 920 896 782 782 query32 73 62 58 58 query33 532 371 333 333 query34 809 949 527 527 query35 794 831 755 755 query36 969 996 907 907 query37 109 101 75 75 query38 4263423642134213 query39 1522149314801480 query40 222 123 108 108 query41 60 59 57 57 query42 129 109 113 109 query43 508 507 481 481 query44 1340842 839 839 query45 185 175 164 164 query46 846 1039658 658 query47 1900187718391839 query48 404 450 335 335 query49 726 569 440 440 query50 657 701 401 401 query51 4239424742164216 query52 109 110 99 99 query53 233 259 186 186 query54 596 576 520 520 query55 89 86 86 86 query56 337 333 302 302 query57 1206119211281128 query58 271 263 261 261 query59 2603274825852585 query60 329 327 324 324 query61 134 132 124 124 query62 779 727 665 665 query63 228 190 190 190 query64 34851039695 695 query65 4404442743394339 query66 1006405 310 310 query67 16141 16015 15416 15416 query68 9602899 521 521 query69 503 303 262 262 query70 1188111510551055 query71 476 329 306 306 query72 5396478347914783 query73 732 624 356 356 query74 8907912986508650 query75 4401319826782678 query76 44971197750 750 query77 956 372 283 283 query78 999110202 93839383 query79 3483787 566 566 query80 680 510 438 438 query81 478 258 219 219 query82 371 124 97 97 query83 290 256 223 223 query84 291 110 83 83 query85 773 363 316 316 query86 335 306 307 306 query87 4450440442584258 query88 2856236622842284 query89 420 318 282 282 query90 2118205 205 205 query91 134 145 110 110 query92 72 61 63 61 query93 2468947 580 580 query94 691 399 312 312 query95 372 286 347 286 query96 484 558 280 280 query97 2704274926692669 query98 227 204 209 204 query99 1376145112861286 Total cold run time: 281976 ms Total hot run time: 192872 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
doris-robot commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2915799063 ClickBench: Total hot run time: 29.37 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit fd6e6dfc1d7760245cf75bf0ff329e2103d0c061, data reload: false query1 0.040.040.03 query2 0.130.120.11 query3 0.250.200.20 query4 1.600.200.12 query5 0.440.410.42 query6 1.170.660.67 query7 0.020.010.02 query8 0.040.030.03 query9 0.600.530.52 query10 0.570.580.57 query11 0.150.110.10 query12 0.160.120.12 query13 0.610.600.60 query14 0.800.810.80 query15 0.880.880.86 query16 0.390.380.38 query17 1.061.061.06 query18 0.230.200.21 query19 1.911.841.81 query20 0.010.020.01 query21 15.42 0.940.56 query22 0.771.250.74 query23 14.77 1.370.65 query24 6.992.000.79 query25 0.510.250.16 query26 0.620.170.14 query27 0.050.050.06 query28 9.220.880.45 query29 12.56 3.993.33 query30 0.260.090.06 query31 2.830.600.39 query32 3.230.550.46 query33 3.073.133.10 query34 15.78 5.114.53 query35 4.564.604.56 query36 0.650.500.48 query37 0.090.060.06 query38 0.040.040.04 query39 0.030.020.02 query40 0.170.140.12 query41 0.080.030.03 query42 0.030.020.03 query43 0.050.030.03 Total cold run time: 102.84 s Total hot run time: 29.37 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
doris-robot commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2915782140 TPC-DS: Total hot run time: 192916 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit fd6e6dfc1d7760245cf75bf0ff329e2103d0c061, data reload: false query1 1383108610831083 query2 6284178917591759 query3 11207 458344654465 query4 53980 24266 23505 23505 query5 5228546 481 481 query6 345 207 223 207 query7 4878504 277 277 query8 321 249 227 227 query9 5756260425952595 query10 428 326 271 271 query11 15002 15070 14765 14765 query12 167 115 107 107 query13 1071531 409 409 query14 10048 625863596258 query15 207 203 172 172 query16 7091694 502 502 query17 1106744 615 615 query18 1525440 334 334 query19 215 221 183 183 query20 129 136 126 126 query21 208 135 114 114 query22 4261456043054305 query23 34324 33428 33732 33428 query24 6697245824272427 query25 563 472 445 445 query26 685 278 155 155 query27 2352521 348 348 query28 2994215821572157 query29 579 563 431 431 query30 284 212 185 185 query31 842 876 792 792 query32 78 72 63 63 query33 469 362 308 308 query34 805 871 590 590 query35 799 819 778 778 query36 944 980 899 899 query37 115 106 76 76 query38 4237421942194219 query39 1528146214851462 query40 207 133 109 109 query41 61 55 56 55 query42 130 115 108 108 query43 513 519 477 477 query44 1342840 841 840 query45 186 175 161 161 query46 844 1042662 662 query47 1852190117491749 query48 406 440 334 334 query49 697 575 428 428 query50 665 699 415 415 query51 4288419242264192 query52 105 115 97 97 query53 226 258 186 186 query54 589 583 541 541 query55 87 84 86 84 query56 307 320 310 310 query57 11861196 query58 279 259 272 259 query59 2645276826752675 query60 350 318 316 316 query61 130 165 131 131 query62 734 740 670 670 query63 237 190 194 190 query64 16781051736 736 query65 4313422541994199 query66 748 454 299 299 query67 15987 15520 15534 15520 query68 6541895 525 525 query69 542 309 277 277 query70 1204116910571057 query71 515 311 297 297 query72 5909493149974931 query73 1408723 355 355 query74 8979916687378737 query75 3928316726932693 query76 42591183759 759 query77 705 407 296 296 query78 10128 10221 93389338 query79 2331821 593 593 query80 647 535 451 451 query81 493 255 222 222 query82 435 126 105 105 query83 304 248 235 235 query84 300 107 89 89 query85 801 351 325 325 query86 380 296 305 296 query87 4438443043914391 query88 3403229022902290 query89 399 315 285 285 query90 1828211 210 210 query91 146 173 131 131 query92 77 62 55 55 query93 1920953 578 578 query94 653 428 302 302 query95 372 296 290 290 query96 490 576 279 279 query97 2720282426682668 query98 231 206 198 198 query99 1405139112811281 Total cold run time: 297818 ms Total hot run time: 192916 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
doris-robot commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2915747835 TPC-H: Total hot run time: 33897 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit fd6e6dfc1d7760245cf75bf0ff329e2103d0c061, data reload: false -- Round 1 -- q1 25810 510553765105 q2 2072272 184 184 q3 10399 1234693 693 q4 10231 985 553 553 q5 7553235723162316 q6 179 161 132 132 q7 890 746 622 622 q8 9308119410641064 q9 6848514651195119 q10 6870229319031903 q11 499 293 268 268 q12 338 353 211 211 q13 17799 366930623062 q14 229 220 216 216 q15 530 486 487 486 q16 420 441 371 371 q17 616 849 375 375 q18 7498715771687157 q19 1842944 549 549 q20 360 343 237 237 q21 3928320523062306 q22 10541038968 968 Total cold run time: 115273 ms Total hot run time: 33897 ms - Round 2, with runtime_filter_mode=off - q1 5140506851105068 q2 236 321 237 237 q3 2132262622822282 q4 1334177513321332 q5 4427438444004384 q6 217 167 133 133 q7 1986193617631763 q8 2568249925272499 q9 7243713769166916 q10 3070319927702770 q11 571 505 507 505 q12 677 765 608 608 q13 3571391432733273 q14 286 297 297 297 q15 540 521 519 519 q16 461 485 424 424 q17 1122150814091409 q18 7659755073057305 q19 789 786 910 786 q20 1984209618541854 q21 4800442544024402 q22 1112106710861067 Total cold run time: 51925 ms Total hot run time: 49833 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
airborne12 commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2915634787 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
doris-robot commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2915452738 ClickBench: Total hot run time: 28.97 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 49c5b3fea3bb6957ef9ee1559fdfe8918bd6f45b, data reload: false query1 0.040.040.03 query2 0.140.100.11 query3 0.260.190.20 query4 1.590.190.19 query5 0.450.450.44 query6 1.170.680.64 query7 0.020.020.02 query8 0.040.040.03 query9 0.600.520.54 query10 0.580.590.57 query11 0.150.100.11 query12 0.140.120.11 query13 0.610.600.61 query14 0.800.820.81 query15 0.890.850.87 query16 0.380.380.38 query17 1.041.041.04 query18 0.230.200.21 query19 1.961.831.88 query20 0.010.010.01 query21 15.44 0.910.54 query22 0.761.180.83 query23 14.76 1.410.62 query24 7.411.110.42 query25 0.330.120.10 query26 0.750.170.13 query27 0.050.060.05 query28 8.390.920.44 query29 12.64 3.893.26 query30 0.260.090.06 query31 2.830.620.39 query32 3.240.560.48 query33 3.013.123.16 query34 15.89 5.144.55 query35 4.564.514.55 query36 0.690.490.48 query37 0.090.070.07 query38 0.060.050.04 query39 0.030.020.03 query40 0.170.130.13 query41 0.080.020.02 query42 0.030.020.03 query43 0.030.030.03 Total cold run time: 102.6 s Total hot run time: 28.97 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
doris-robot commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2915403610 TPC-H: Total hot run time: 33898 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 49c5b3fea3bb6957ef9ee1559fdfe8918bd6f45b, data reload: false -- Round 1 -- q1 26282 514050295029 q2 2080272 188 188 q3 10401 1247733 733 q4 10230 1020516 516 q5 7514241223422342 q6 179 160 133 133 q7 913 743 622 622 q8 9301146411191119 q9 6754516750985098 q10 6884233218991899 q11 500 293 273 273 q12 350 358 216 216 q13 17792 372130673067 q14 240 229 214 214 q15 536 490 486 486 q16 432 437 378 378 q17 605 858 376 376 q18 7973715670107010 q19 1714958 560 560 q20 344 337 238 238 q21 4253325624022402 q22 10571003999 999 Total cold run time: 116334 ms Total hot run time: 33898 ms - Round 2, with runtime_filter_mode=off - q1 5163508150985081 q2 241 327 227 227 q3 2157270723272327 q4 1335181114311431 q5 4423440143984398 q6 224 172 130 130 q7 2022197117581758 q8 2601252325712523 q9 7275717369786978 q10 3056327127842784 q11 587 509 504 504 q12 699 814 606 606 q13 3600388033283328 q14 289 292 309 292 q15 528 503 496 496 q16 440 490 443 443 q17 1167148814221422 q18 7742765974197419 q19 833 862 978 862 q20 2010197218871887 q21 4938442145004421 q22 1077103910411039 Total cold run time: 52407 ms Total hot run time: 50356 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
airborne12 commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2915158095 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
doris-robot commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2914928521 ClickBench: Total hot run time: 28.85 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 083cc03aded9a9421ca4e04a16ce56c19b5fc663, data reload: false query1 0.040.040.03 query2 0.130.100.10 query3 0.240.200.20 query4 1.590.190.19 query5 0.460.440.44 query6 1.150.660.66 query7 0.030.020.02 query8 0.040.030.03 query9 0.580.520.53 query10 0.570.580.56 query11 0.160.110.10 query12 0.140.110.12 query13 0.620.600.60 query14 0.790.800.82 query15 0.880.860.87 query16 0.380.390.37 query17 1.051.031.06 query18 0.220.210.21 query19 1.901.881.84 query20 0.010.010.02 query21 15.42 0.890.53 query22 0.761.010.59 query23 15.21 1.400.58 query24 6.831.620.63 query25 0.530.250.08 query26 0.590.180.13 query27 0.050.050.05 query28 8.820.920.43 query29 12.59 3.863.31 query30 0.260.090.07 query31 2.820.590.40 query32 3.230.540.47 query33 3.063.103.21 query34 15.78 5.134.51 query35 4.514.524.50 query36 0.670.490.48 query37 0.090.070.07 query38 0.050.040.03 query39 0.040.020.02 query40 0.160.130.12 query41 0.080.030.02 query42 0.030.020.02 query43 0.030.030.03 Total cold run time: 102.59 s Total hot run time: 28.85 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
doris-robot commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2914918144 TPC-DS: Total hot run time: 191812 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 083cc03aded9a9421ca4e04a16ce56c19b5fc663, data reload: false query1 1403108610681068 query2 6206177017901770 query3 11062 459643614361 query4 53316 25426 23168 23168 query5 5251541 487 487 query6 378 215 201 201 query7 5029533 301 301 query8 342 275 234 234 query9 6435261126052605 query10 435 327 277 277 query11 15055 15121 14837 14837 query12 163 114 107 107 query13 1148528 427 427 query14 10175 627163646271 query15 200 193 185 185 query16 7084631 514 514 query17 1123759 579 579 query18 1518384 312 312 query19 196 187 161 161 query20 128 160 120 120 query21 205 122 107 107 query22 4326425841234123 query23 34333 33377 33534 33377 query24 6747240924112409 query25 480 472 417 417 query26 721 279 151 151 query27 2403522 346 346 query28 3034217021462146 query29 581 587 423 423 query30 269 221 194 194 query31 836 861 794 794 query32 72 66 63 63 query33 463 361 307 307 query34 762 879 528 528 query35 793 840 746 746 query36 933 1005924 924 query37 123 100 84 84 query38 4152418842664188 query39 1533143814321432 query40 224 124 110 110 query41 64 57 56 56 query42 132 114 108 108 query43 467 496 469 469 query44 1341841 831 831 query45 180 178 171 171 query46 855 1068671 671 query47 1826184217631763 query48 398 426 314 314 query49 720 540 427 427 query50 678 703 421 421 query51 4203422241604160 query52 112 112 104 104 query53 229 269 184 184 query54 589 581 544 544 query55 94 83 81 81 query56 302 322 308 308 query57 1195119011181118 query58 273 266 255 255 query59 2621273126482648 query60 327 314 310 310 query61 128 125 119 119 query62 744 728 691 691 query63 233 198 192 192 query64 16811047686 686 query65 4374424642694246 query66 761 397 311 311 query67 15984 15701 15192 15192 query68 6811887 516 516 query69 539 302 267 267 query70 1228110910871087 query71 513 332 310 310 query72 5735482149094821 query73 1284676 358 358 query74 8792920190809080 query75 3830320826922692 query76 41901195759 759 query77 653 358 300 300 query78 10234 10166 92339233 query79 2490816 591 591 query80 625 514 452 452 query81 489 259 218 218 query82 497 123 94 94 query83 249 251 242 242 query84 296 108 84 84 query85 787 340 303 303 query86 389 300 299 299 query87 4413432043164316 query88 3434229823062298 query89 402 315 290 290 query90 1781208 208 208 query91 143 140 111 111 query92 72 59 60 59 query93 2243942 575 575 query94 655 412 310 310 query95 369 289 289 289 query96 503 572 279 279 query97 2747276526392639 query98 248 211 205 205 query99 1674143212931293 Total cold run time: 298463 ms Total hot run time: 191812 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
doris-robot commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2914894735 TPC-H: Total hot run time: 33960 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 083cc03aded9a9421ca4e04a16ce56c19b5fc663, data reload: false -- Round 1 -- q1 25667 506650165016 q2 2063280 179 179 q3 10405 1264681 681 q4 10215 1006525 525 q5 7568230623512306 q6 182 161 131 131 q7 902 736 614 614 q8 9299127811031103 q9 6831514150955095 q10 6873227918741874 q11 489 292 278 278 q12 340 348 210 210 q13 17806 363431063106 q14 227 228 222 222 q15 520 490 487 487 q16 433 435 374 374 q17 626 854 385 385 q18 7540735172077207 q19 1544968 563 563 q20 353 348 239 239 q21 4153327124112411 q22 10481009954 954 Total cold run time: 115084 ms Total hot run time: 33960 ms - Round 2, with runtime_filter_mode=off - q1 5130500650955006 q2 237 333 226 226 q3 2136270423112311 q4 1325175513321332 q5 4407437543664366 q6 220 167 126 126 q7 1989191117611761 q8 2617258925532553 q9 7295720569116911 q10 3033317427212721 q11 566 525 496 496 q12 688 750 606 606 q13 3521383432503250 q14 286 307 292 292 q15 536 497 475 475 q16 442 492 431 431 q17 1141153414191419 q18 7708754973947394 q19 824 851 989 851 q20 1980201718351835 q21 4896445845214458 q22 1102106610311031 Total cold run time: 52079 ms Total hot run time: 49851 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
Copilot commented on code in PR #50907:
URL: https://github.com/apache/doris/pull/50907#discussion_r2110849346
##
fe/fe-core/src/main/java/org/apache/doris/alter/SchemaChangeHandler.java:
##
@@ -1838,7 +1845,11 @@ public List>
getAllIndexChangeJobInfos() {
// which already check the ADMIN priv.
indexChangeJob.getInfo(indexChangeJobInfos);
}
-
+for (AlterJobV2 alterJob : ImmutableList.copyOf(alterJobsV2.values()))
{
Review Comment:
Consider consolidating the two iterations over 'alterJobsV2' in the
getAllIndexChangeJobInfos methods to filter by DB id once, reducing potential
redundancy and improving maintainability.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
airborne12 commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2914838398 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
github-actions[bot] commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2914654509 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
github-actions[bot] commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2914654472 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
github-actions[bot] commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2914654458 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
github-actions[bot] commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2914654498 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
eldenmoon commented on code in PR #50907:
URL: https://github.com/apache/doris/pull/50907#discussion_r2098772944
##
fe/fe-core/src/main/java/org/apache/doris/alter/SchemaChangeJobV2.java:
##
@@ -133,6 +134,8 @@ public class SchemaChangeJobV2 extends AlterJobV2 {
private boolean indexChange = false;
@SerializedName(value = "indexes")
protected List indexes = null;
+@SerializedName(value = "indexDrop")
+private boolean indexDrop = false;
Review Comment:
why adding an extra field to indicate indexDrop
##
fe/fe-core/src/main/java/org/apache/doris/analysis/BuildIndexClause.java:
##
@@ -35,43 +36,54 @@ public class BuildIndexClause extends AlterTableClause {
// in which table the index on, only used when alter = false
private TableName tableName;
// index definition class
-private IndexDef indexDef;
+private List indexDefList;
Review Comment:
is ngram bf support build index?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
eldenmoon commented on code in PR #50907:
URL: https://github.com/apache/doris/pull/50907#discussion_r2098772944
##
fe/fe-core/src/main/java/org/apache/doris/alter/SchemaChangeJobV2.java:
##
@@ -133,6 +134,8 @@ public class SchemaChangeJobV2 extends AlterJobV2 {
private boolean indexChange = false;
@SerializedName(value = "indexes")
protected List indexes = null;
+@SerializedName(value = "indexDrop")
+private boolean indexDrop = false;
Review Comment:
why adding an extra field to indicate indexDrop
##
fe/fe-core/src/main/java/org/apache/doris/analysis/BuildIndexClause.java:
##
@@ -35,43 +36,54 @@ public class BuildIndexClause extends AlterTableClause {
// in which table the index on, only used when alter = false
private TableName tableName;
// index definition class
-private IndexDef indexDef;
+private List indexDefList;
Review Comment:
is ngram bf support build index?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
doris-robot commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2911999024 TPC-H: Total hot run time: 33499 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 5be10c2cfb8cba21ba46b2689a50317c53533311, data reload: false -- Round 1 -- q1 25950 567549704970 q2 2093280 193 193 q3 10379 1254694 694 q4 10231 980 523 523 q5 7548228123312281 q6 172 158 127 127 q7 880 741 596 596 q8 9308122510611061 q9 6919512050535053 q10 6881231119011901 q11 474 289 266 266 q12 337 357 217 217 q13 17793 364330713071 q14 233 223 210 210 q15 524 488 495 488 q16 432 426 365 365 q17 582 850 362 362 q18 7687714870767076 q19 1240942 547 547 q20 334 335 225 225 q21 3802316723172317 q22 10491002956 956 Total cold run time: 114848 ms Total hot run time: 33499 ms - Round 2, with runtime_filter_mode=off - q1 5070502351015023 q2 239 327 226 226 q3 2203260622972297 q4 1328178213941394 q5 4474437244104372 q6 209 166 127 127 q7 2013192217441744 q8 2572248125882481 q9 7232718769446944 q10 3026326627612761 q11 577 504 495 495 q12 684 737 621 621 q13 3546385532613261 q14 280 306 278 278 q15 522 486 492 486 q16 449 505 464 464 q17 1134154813521352 q18 7818750774237423 q19 776 762 795 762 q20 1998209518961896 q21 4699450543154315 q22 1083104410331033 Total cold run time: 51932 ms Total hot run time: 49755 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
doris-robot commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2912047946 ClickBench: Total hot run time: 29.49 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 5be10c2cfb8cba21ba46b2689a50317c53533311, data reload: false query1 0.040.040.03 query2 0.120.110.11 query3 0.250.190.19 query4 1.580.200.18 query5 0.450.440.45 query6 1.180.670.65 query7 0.030.010.01 query8 0.050.030.04 query9 0.600.510.54 query10 0.570.580.56 query11 0.150.110.11 query12 0.160.110.12 query13 0.610.600.60 query14 0.790.800.81 query15 0.870.830.84 query16 0.390.370.39 query17 1.051.031.03 query18 0.230.210.21 query19 1.951.841.79 query20 0.010.020.01 query21 15.40 0.920.54 query22 0.761.180.65 query23 14.95 1.410.63 query24 6.731.601.35 query25 0.500.140.07 query26 0.720.160.13 query27 0.040.050.05 query28 9.160.900.44 query29 12.53 3.973.29 query30 0.250.100.06 query31 2.840.610.39 query32 3.230.570.46 query33 3.043.243.06 query34 15.72 5.104.48 query35 4.504.534.55 query36 0.670.500.48 query37 0.080.060.06 query38 0.060.040.03 query39 0.030.020.02 query40 0.160.140.13 query41 0.070.020.02 query42 0.030.030.02 query43 0.040.030.03 Total cold run time: 102.59 s Total hot run time: 29.49 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
doris-robot commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2912031471 TPC-DS: Total hot run time: 192204 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 5be10c2cfb8cba21ba46b2689a50317c53533311, data reload: false query1 1401113110531053 query2 6212194418931893 query3 11018 449544784478 query4 54638 25859 22994 22994 query5 5091600 478 478 query6 354 206 195 195 query7 4918517 295 295 query8 304 249 242 242 query9 5440261326142613 query10 445 336 264 264 query11 15163 15175 14927 14927 query12 165 114 112 112 query13 1058522 418 418 query14 10145 622362526223 query15 203 203 174 174 query16 7141662 493 493 query17 1070765 581 581 query18 1611408 303 303 query19 194 208 159 159 query20 127 125 131 125 query21 207 150 105 105 query22 4329445743094309 query23 34312 33521 33571 33521 query24 6659247624232423 query25 469 459 407 407 query26 689 278 158 158 query27 2392504 347 347 query28 3174214621332133 query29 600 620 473 473 query30 288 230 196 196 query31 872 854 759 759 query32 73 70 67 67 query33 457 382 337 337 query34 762 887 523 523 query35 829 840 774 774 query36 950 981 893 893 query37 116 106 116 106 query38 4127429741444144 query39 1497144314851443 query40 229 125 106 106 query41 54 53 56 53 query42 126 112 115 112 query43 498 503 495 495 query44 1311820 805 805 query45 213 180 165 165 query46 827 1009630 630 query47 1855184518021802 query48 393 425 323 323 query49 684 533 416 416 query50 670 697 414 414 query51 4214430842304230 query52 107 112 103 103 query53 220 259 186 186 query54 575 577 514 514 query55 84 83 79 79 query56 316 328 301 301 query57 1201121311021102 query58 264 266 257 257 query59 2773292629032903 query60 333 326 333 326 query61 143 131 151 131 query62 710 785 643 643 query63 220 186 180 180 query64 14891015670 670 query65 4299425542744255 query66 761 406 305 305 query67 15854 15591 15538 15538 query68 6973895 515 515 query69 529 304 265 265 query70 1133103610621036 query71 512 316 292 292 query72 6004477051284770 query73 1347658 348 348 query74 8976923686788678 query75 4162317726942694 query76 41791195746 746 query77 756 376 283 283 query78 10123 10006 92729272 query79 2602821 577 577 query80 653 516 447 447 query81 495 266 226 226 query82 451 126 98 98 query83 299 252 229 229 query84 297 117 94 94 query85 763 356 320 320 query86 363 304 300 300 query87 4388447744034403 query88 3594223722532237 query89 405 308 345 308 query90 1821207 203 203 query91 142 148 115 115 query92 75 62 56 56 query93 2028930 571 571 query94 658 425 289 289 query95 370 301 283 283 query96 487 585 276 276 query97 2704275226082608 query98 229 220 202 202 query99 1395140212811281 Total cold run time: 298836 ms Total hot run time: 192204 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
airborne12 commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2911915930 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
airborne12 commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2911905798 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
csun5285 commented on code in PR #50907:
URL: https://github.com/apache/doris/pull/50907#discussion_r2102060831
##
fe/fe-core/src/main/antlr4/org/apache/doris/nereids/DorisParser.g4:
##
@@ -204,6 +204,7 @@ supportedCreateStatement
name=identifier properties=propertyClause?
#createStoragePolicy
| BUILD INDEX name=identifier ON tableName=multipartIdentifier
Review Comment:
`BUILD INDEX (name=identifier) ON tableName=multipartIdentifier`
##
fe/fe-core/src/main/cup/sql_parser.cup:
##
@@ -2071,6 +2071,10 @@ create_stmt ::=
{:
RESULT = new AlterTableStmt(tableName, Lists.newArrayList(new
BuildIndexClause(tableName, indexName, partitionNames, false)));
:}
+| KW_BUILD KW_INDEX KW_ON table_name:tableName
Review Comment:
` KW_BUILD KW_INDEX (ident:indexName) KW_ON table_name:tableName
opt_partition_names:partitionNames`
##
fe/fe-core/src/main/java/org/apache/doris/alter/SchemaChangeHandler.java:
##
@@ -2102,20 +2139,26 @@ public int getAsInt() {
}
} else if (alterClause instanceof BuildIndexClause) {
BuildIndexClause buildIndexClause = (BuildIndexClause)
alterClause;
-IndexDef indexDef = buildIndexClause.getIndexDef();
-Index index = buildIndexClause.getIndex();
-if (Config.isCloudMode() && index.getIndexType() ==
IndexDef.IndexType.INVERTED) {
-throw new DdlException("BUILD INDEX operation failed:
No need to do it in cloud mode.");
-}
+List indexDefList =
buildIndexClause.getIndexDefList();
+List indexList = buildIndexClause.getIndexList();
+for (int i = 0; i < indexDefList.size(); i++) {
+IndexDef indexDef = indexDefList.get(i);
+Index index = indexList.get(i);
+if (Config.isCloudMode()
+&& index.getIndexType() ==
IndexDef.IndexType.INVERTED
+&& !index.isNonTokenizedInvertedIndex()) {
Review Comment:
add case for building tokenized index
##
fe/fe-core/src/main/java/org/apache/doris/alter/SchemaChangeHandler.java:
##
@@ -1843,6 +1850,20 @@ public List>
getAllIndexChangeJobInfos() {
return indexChangeJobInfos;
}
+public List> getAllIndexChangeJobInfosInCloud() {
Review Comment:
unused function
##
regression-test/suites/inverted_index_p0/index_format_v2/test_add_build_index_with_format_v2.groovy:
##
@@ -113,31 +146,68 @@ suite("test_add_build_index_with_format_v2",
"inverted_index_format_v2"){
String ip = backendId_to_backendIP.get(backend_id)
String port = backendId_to_backendHttpPort.get(backend_id)
-// cloud mode is directly schema change, local mode is light schema change.
// cloud mode is 12, local mode is 6
if (isCloudMode()) {
-check_nested_index_file(ip, port, tablet_id, 7, 2, "V2")
-qt_sql "SELECT * FROM $tableName WHERE name match 'andy' order by id,
name, score;"
-return
-} else {
-check_nested_index_file(ip, port, tablet_id, 7, 0, "V2")
-}
+check_nested_index_file(ip, port, tablet_id, 2, 0, "V2")
+// build index
+sql """
+BUILD INDEX idx_name ON ${tableName};
+"""
+wait_for_build_index_on_partition_finish(tableName, timeout)
+// cloud mode tablets change after index build
+def new_tablet_id = wait_for_tablet_change(tablet_id, tableName,
timeout)
+check_nested_index_file(ip, port, new_tablet_id, 2, 2, "V2")
+query = """ SELECT /*+SET_VAR(enable_profile = true, profile_level =
2)*/ * FROM $tableName WHERE name = 'andy' order by id, name, score; """
+profile("sql_select_with_name_index") {
+run {
+sql "/* sql_select_with_name_index */ ${query}"
+sleep(1000) // sleep 1s wait for the profile collection to be
completed
+}
-// build index
-sql """
-BUILD INDEX idx_name ON ${tableName};
-"""
-wait_for_build_index_on_partition_finish(tableName, timeout)
+check { profileString, exception ->
+//log.info(profileString)
+assertTrue(profileString.contains("RowsInvertedIndexFiltered:
3"))
+}
+}
+// build index
+sql """
+BUILD INDEX idx_score ON ${tableName};
+"""
+wait_for_build_index_on_partition_finish(tableName, timeout)
+def another_new_tablet_id = wait_for_tablet_change(new_tablet_id,
tableName, timeout)
+check_nested_index_file(ip, port, another_new_tablet_id, 2, 2, "V2")
-check_nested_index_file(ip, port, tablet_id, 7, 1, "V2")
+query = """ SELECT /*+SET_VAR(enable_profile = t
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
doris-robot commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2892967768 ClickBench: Total hot run time: 29.43 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 7121e2396174b51b969183afbd64e8450b469319, data reload: false query1 0.040.040.03 query2 0.130.100.11 query3 0.270.190.20 query4 1.590.200.20 query5 0.450.450.43 query6 1.460.650.66 query7 0.020.010.02 query8 0.040.030.03 query9 0.560.520.52 query10 0.580.580.56 query11 0.150.110.11 query12 0.150.110.11 query13 0.610.590.60 query14 0.800.800.81 query15 0.900.850.87 query16 0.390.390.39 query17 1.031.061.05 query18 0.220.210.22 query19 1.931.851.87 query20 0.010.010.01 query21 15.40 0.920.54 query22 0.751.410.69 query23 14.72 1.380.62 query24 7.061.051.53 query25 0.490.230.09 query26 0.670.170.14 query27 0.050.050.05 query28 9.440.930.47 query29 12.62 3.983.34 query30 0.260.090.06 query31 2.810.600.38 query32 3.230.560.48 query33 3.193.113.06 query34 16.13 5.154.50 query35 4.494.524.45 query36 0.670.510.49 query37 0.080.060.06 query38 0.060.040.04 query39 0.030.020.02 query40 0.170.130.13 query41 0.080.030.03 query42 0.040.020.02 query43 0.040.030.04 Total cold run time: 103.81 s Total hot run time: 29.43 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
doris-robot commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2892961136 TPC-DS: Total hot run time: 193625 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 7121e2396174b51b969183afbd64e8450b469319, data reload: false query1 1399110410741074 query2 6290180818041804 query3 11016 451246004512 query4 51984 24548 23594 23594 query5 5068589 459 459 query6 334 213 181 181 query7 4864523 297 297 query8 309 244 236 236 query9 5421264126392639 query10 425 340 291 291 query11 15105 15115 14880 14880 query12 162 114 107 107 query13 1038537 428 428 query14 10472 641764366417 query15 196 185 185 185 query16 7015687 491 491 query17 1117753 587 587 query18 1532422 330 330 query19 204 198 178 178 query20 132 140 118 118 query21 209 127 117 117 query22 4436443844084408 query23 34105 33722 33762 33722 query24 6252249724592459 query25 488 502 405 405 query26 741 290 159 159 query27 2202518 342 342 query28 2860215721442144 query29 589 591 452 452 query30 274 220 188 188 query31 860 866 784 784 query32 73 69 60 60 query33 446 374 304 304 query34 791 884 547 547 query35 814 814 754 754 query36 967 1029947 947 query37 113 100 78 78 query38 4316428241824182 query39 1560145714701457 query40 207 122 112 112 query41 60 52 53 52 query42 125 122 114 114 query43 520 515 481 481 query44 1383846 851 846 query45 184 177 172 172 query46 868 1045667 667 query47 1844182417721772 query48 396 458 337 337 query49 688 536 456 456 query50 683 701 434 434 query51 4287430344744303 query52 120 113 103 103 query53 239 269 192 192 query54 573 598 521 521 query55 91 88 84 84 query56 311 315 312 312 query57 1243121511341134 query58 276 265 255 255 query59 2633280826562656 query60 340 345 353 345 query61 130 126 127 126 query62 735 737 692 692 query63 238 193 192 192 query64 17901046687 687 query65 4287422542594225 query66 745 417 303 303 query67 16002 15542 15425 15425 query68 7107921 536 536 query69 539 309 272 272 query70 1219113110461046 query71 505 313 304 304 query72 5817480547414741 query73 1450622 353 353 query74 8913911586758675 query75 3974321027112711 query76 43081210773 773 query77 708 385 356 356 query78 10116 998293019301 query79 3128828 579 579 query80 646 517 448 448 query81 466 256 217 217 query82 491 130 99 99 query83 308 253 249 249 query84 295 111 88 88 query85 804 354 312 312 query86 366 306 309 306 query87 4416448042844284 query88 3491231023132310 query89 411 319 286 286 query90 1979215 211 211 query91 143 145 114 114 query92 69 62 58 58 query93 1837943 591 591 query94 703 423 309 309 query95 380 294 287 287 query96 502 581 292 292 query97 2740279227262726 query98 246 207 202 202 query99 1432141512741274 Total cold run time: 296686 ms Total hot run time: 193625 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
doris-robot commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2892922312 TPC-H: Total hot run time: 33660 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 7121e2396174b51b969183afbd64e8450b469319, data reload: false -- Round 1 -- q1 25954 503849674967 q2 2059265 186 186 q3 10403 1253683 683 q4 10231 1038548 548 q5 7555233822922292 q6 180 165 134 134 q7 919 743 610 610 q8 9309125910531053 q9 6795512952025129 q10 6892230919001900 q11 496 295 280 280 q12 350 343 211 211 q13 17813 365730553055 q14 233 225 206 206 q15 543 481 495 481 q16 415 434 375 375 q17 584 852 363 363 q18 7585715670937093 q19 1841954 535 535 q20 334 325 223 223 q21 3610320023532353 q22 10271016983 983 Total cold run time: 115128 ms Total hot run time: 33660 ms - Round 2, with runtime_filter_mode=off - q1 5133525850695069 q2 243 329 236 236 q3 2136261922762276 q4 1365180713391339 q5 4416439043864386 q6 213 166 140 140 q7 1991199918091809 q8 2576250425922504 q9 7277723668686868 q10 3061317627462746 q11 585 524 492 492 q12 689 748 622 622 q13 3468389032933293 q14 285 296 270 270 q15 529 479 480 479 q16 431 477 433 433 q17 1127151114041404 q18 7878764072957295 q19 822 786 828 786 q20 2020201718341834 q21 4735441544164415 q22 1081105910241024 Total cold run time: 52061 ms Total hot run time: 49720 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](inverted index) support light index add and build for inverted index without analyzer in cloud mode [doris]
airborne12 commented on PR #50907: URL: https://github.com/apache/doris/pull/50907#issuecomment-2892854913 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
