Re: [PR] [improve](hive) Refactor csv reader [doris]
morningman merged PR #50379: URL: https://github.com/apache/doris/pull/50379 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
github-actions[bot] commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2947797410 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
github-actions[bot] commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2947797212 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
hello-stephen commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2946007035 # BE Regression && UT Coverage Report Increment line coverage `88.10% (237/269)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/50379_5d3d0109fc32ee4e564be68bd5c289a755438b30_merge/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/50379_5d3d0109fc32ee4e564be68bd5c289a755438b30_merge/report/index.html) | Category | Coverage | |---|| | Function Coverage | 79.57% (20999/26390) | | Line Coverage | 72.64% (216853/298536) | | Region Coverage | 70.87% (127721/180212) | | Branch Coverage | 64.61% (66150/102388) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2945710347 # BE UT Coverage Report Increment line coverage `14.44% (39/270)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/5d3d0109fc32ee4e564be68bd5c289a755438b30_5d3d0109fc32ee4e564be68bd5c289a755438b30/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/5d3d0109fc32ee4e564be68bd5c289a755438b30_5d3d0109fc32ee4e564be68bd5c289a755438b30/report/index.html) | Category | Coverage | |---|| | Function Coverage | 56.30% (15094/26810) | | Line Coverage | 45.10% (134678/298640) | | Region Coverage | 44.20% (67733/153239) | | Branch Coverage | 38.76% (34715/89562) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
hello-stephen commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2945657870 # FE UT Coverage Report Increment line coverage ` 47.06% (24/51)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/50379_5d3d0109fc32ee4e564be68bd5c289a755438b30/fe_increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/50379_5d3d0109fc32ee4e564be68bd5c289a755438b30/fe_report/index.html) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2945440217 ClickBench: Total hot run time: 28.58 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 5d3d0109fc32ee4e564be68bd5c289a755438b30, data reload: false query1 0.030.040.03 query2 0.120.110.10 query3 0.260.190.20 query4 1.600.190.11 query5 0.420.410.42 query6 1.190.660.66 query7 0.030.020.02 query8 0.050.030.04 query9 0.570.520.51 query10 0.560.560.57 query11 0.160.100.12 query12 0.140.120.12 query13 0.610.600.59 query14 0.790.800.82 query15 0.890.870.86 query16 0.380.390.37 query17 1.021.061.04 query18 0.230.220.21 query19 1.921.781.90 query20 0.010.020.01 query21 15.40 0.900.55 query22 0.771.160.62 query23 15.06 1.390.65 query24 6.541.250.29 query25 0.340.290.06 query26 0.480.170.13 query27 0.060.060.05 query28 9.860.980.46 query29 12.55 3.963.37 query30 0.250.100.07 query31 2.810.600.39 query32 3.240.570.46 query33 3.053.053.09 query34 15.92 5.154.56 query35 4.564.584.57 query36 0.660.490.48 query37 0.090.070.06 query38 0.050.050.04 query39 0.030.020.02 query40 0.170.140.13 query41 0.080.020.02 query42 0.030.020.03 query43 0.040.030.03 Total cold run time: 103.02 s Total hot run time: 28.58 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2945419247 TPC-DS: Total hot run time: 186043 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 5d3d0109fc32ee4e564be68bd5c289a755438b30, data reload: false query1 1008474 483 474 query2 6551187918031803 query3 6753226 221 221 query4 26356 23772 22844 22844 query5 4326670 470 470 query6 306 213 219 213 query7 4623512 296 296 query8 264 240 221 221 query9 8604264426482644 query10 485 352 278 278 query11 15278 15052 14866 14866 query12 178 112 110 110 query13 1633553 405 405 query14 8719600160886001 query15 196 193 167 167 query16 7155673 492 492 query17 933 756 558 558 query18 1955405 289 289 query19 192 184 162 162 query20 123 120 121 120 query21 211 132 108 108 query22 4218426742174217 query23 34156 33122 33110 33110 query24 8630239624042396 query25 552 459 420 420 query26 1233285 157 157 query27 2748521 340 340 query28 4303214821152115 query29 760 595 430 430 query30 284 223 190 190 query31 943 864 758 758 query32 76 67 63 63 query33 545 367 308 308 query34 791 921 525 525 query35 792 837 741 741 query36 10091023884 884 query37 122 107 82 82 query38 4111424040194019 query39 1472143814531438 query40 217 126 116 116 query41 70 65 67 65 query42 140 121 110 110 query43 507 527 469 469 query44 1370827 828 827 query45 186 183 179 179 query46 898 1103626 626 query47 1814181117331733 query48 395 467 317 317 query49 777 533 422 422 query50 677 744 418 418 query51 4140412041114111 query52 114 112 103 103 query53 229 267 200 200 query54 600 593 518 518 query55 98 86 86 86 query56 329 308 319 308 query57 1191115710851085 query58 266 263 258 258 query59 2589267624922492 query60 320 330 314 314 query61 125 123 122 122 query62 851 768 675 675 query63 227 186 184 184 query64 4402998 681 681 query65 4339413841764138 query66 1138446 312 312 query67 15842 15829 15513 15513 query68 8559908 549 549 query69 486 314 270 270 query70 1241115210961096 query71 455 333 302 302 query72 5359473146664666 query73 701 586 355 355 query74 8891915392469153 query75 3951331827102710 query76 36271316800 800 query77 799 388 301 301 query78 10253 10094 93369336 query79 2798862 604 604 query80 748 539 448 448 query81 484 271 216 216 query82 540 139 95 95 query83 291 259 233 233 query84 297 109 91 91 query85 807 360 340 340 query86 391 302 285 285 query87 4427450243394339 query88 3719227722782277 query89 431 321 283 283 query90 1837209 207 207 query91 151 140 113 113 query92 78 71 60 60 query93 1966959 591 591 query94 655 446 309 309 query95 373 294 287 287 query96 514 618 288 288 query97 2728280926312631 query98 251 208 199 199 query99 1462149812921292 Total cold run time: 275715 ms Total hot run time: 186043 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2945376615 TPC-H: Total hot run time: 33865 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 5d3d0109fc32ee4e564be68bd5c289a755438b30, data reload: false -- Round 1 -- q1 26134 510650905090 q2 1960285 177 177 q3 10281 1262712 712 q4 10213 1010524 524 q5 7557235723612357 q6 200 164 133 133 q7 900 756 611 611 q8 9303126010391039 q9 6932509651665096 q10 6834233819121912 q11 489 294 278 278 q12 358 357 223 223 q13 17758 375730633063 q14 221 227 212 212 q15 546 490 511 490 q16 442 429 371 371 q17 603 874 372 372 q18 7521724970097009 q19 1089962 585 585 q20 353 353 230 230 q21 3810318523942394 q22 10541031987 987 Total cold run time: 114558 ms Total hot run time: 33865 ms - Round 2, with runtime_filter_mode=off - q1 5175508551895085 q2 240 316 220 220 q3 2183263823242324 q4 1350178413411341 q5 4540437944154379 q6 219 173 128 128 q7 1979186917551755 q8 2593279326422642 q9 7186710371357103 q10 2981318928142814 q11 582 505 488 488 q12 707 765 624 624 q13 3498392832873287 q14 275 294 273 273 q15 534 474 468 468 q16 430 486 459 459 q17 1168146113741374 q18 7784751674597459 q19 869 886 901 886 q20 2000200918731873 q21 4980446043494349 q22 10751025997 997 Total cold run time: 52348 ms Total hot run time: 50328 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2945338901 # Cloud UT Coverage Report Increment line coverage ` ` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/5d3d0109fc32ee4e564be68bd5c289a755438b30_5d3d0109fc32ee4e564be68bd5c289a755438b30_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/5d3d0109fc32ee4e564be68bd5c289a755438b30_5d3d0109fc32ee4e564be68bd5c289a755438b30_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 83.32% (1119/1343) | | Line Coverage | 66.80% (19194/28732) | | Region Coverage | 66.44% (9502/14302) | | Branch Coverage | 56.43% (5155/9136) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
suxiaogang223 commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2945295598 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2945147582 ClickBench: Total hot run time: 29.74 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 2c9c389c6bb477c3d66dea7cc5f7a19bb7fc9c19, data reload: false query1 0.040.040.03 query2 0.150.110.10 query3 0.350.200.20 query4 1.610.200.08 query5 0.430.410.43 query6 1.150.650.67 query7 0.030.020.02 query8 0.060.050.04 query9 0.630.520.51 query10 0.590.600.59 query11 0.260.120.13 query12 0.260.130.14 query13 0.630.610.62 query14 0.810.820.82 query15 0.970.880.89 query16 0.360.380.37 query17 1.071.031.06 query18 0.190.180.17 query19 2.011.821.92 query20 0.020.010.02 query21 15.41 0.980.67 query22 0.921.060.82 query23 14.69 1.590.76 query24 5.240.610.30 query25 0.170.090.08 query26 0.560.220.18 query27 0.080.080.09 query28 11.07 1.170.59 query29 12.60 4.173.46 query30 0.290.090.06 query31 2.810.630.43 query32 3.240.600.52 query33 3.033.083.16 query34 16.95 5.104.45 query35 4.594.524.51 query36 0.640.500.49 query37 0.200.180.16 query38 0.170.150.16 query39 0.050.040.04 query40 0.190.160.16 query41 0.120.050.05 query42 0.060.060.06 query43 0.060.050.05 Total cold run time: 104.76 s Total hot run time: 29.74 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2945133275 TPC-DS: Total hot run time: 188534 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 2c9c389c6bb477c3d66dea7cc5f7a19bb7fc9c19, data reload: false query1 1419109510541054 query2 6275184018221822 query3 8749210 208 208 query4 54140 24244 22992 22992 query5 5008502 456 456 query6 336 208 190 190 query7 5019511 280 280 query8 276 221 199 199 query9 5428265426742654 query10 468 347 260 260 query11 14907 15097 14898 14898 query12 172 111 111 111 query13 1057519 431 431 query14 10234 616064186160 query15 235 218 183 183 query16 7220658 508 508 query17 1087727 581 581 query18 1723432 325 325 query19 201 185 180 180 query20 133 128 123 123 query21 225 152 107 107 query22 5138533344424442 query23 34268 33822 33671 33671 query24 6492244624232423 query25 480 463 426 426 query26 711 279 152 152 query27 2246508 357 357 query28 3130219021812181 query29 575 563 437 437 query30 216 223 195 195 query31 874 851 762 762 query32 74 68 62 62 query33 477 371 338 338 query34 770 884 511 511 query35 788 828 760 760 query36 952 1018919 919 query37 116 100 75 75 query38 4355435843364336 query39 1528148614621462 query40 169 118 107 107 query41 59 55 58 55 query42 131 105 106 105 query43 485 525 478 478 query44 1323851 841 841 query45 186 181 174 174 query46 840 1041637 637 query47 1860188118581858 query48 405 429 320 320 query49 653 495 413 413 query50 680 699 411 411 query51 4281425442774254 query52 104 106 109 106 query53 230 257 182 182 query54 590 589 511 511 query55 86 83 81 81 query56 332 300 296 296 query57 1150119111291129 query58 276 279 253 253 query59 2660272326582658 query60 323 332 313 313 query61 132 120 124 120 query62 783 753 677 677 query63 229 192 185 185 query64 16781088694 694 query65 4283426843164268 query66 739 402 312 312 query67 16345 15753 15514 15514 query68 7224833 517 517 query69 556 294 271 271 query70 1257115811031103 query71 493 324 307 307 query72 5365479349484793 query73 1510658 350 350 query74 8923924486888688 query75 3792320926732673 query76 41801203761 761 query77 566 363 276 276 query78 995610168 94399439 query79 1545803 580 580 query80 602 519 444 444 query81 464 261 223 223 query82 173 125 97 97 query83 347 254 233 233 query84 299 111 97 97 query85 744 354 319 319 query86 337 308 289 289 query87 4430456643284328 query88 2919226522462246 query89 375 321 283 283 query90 2046204 201 201 query91 146 142 111 111 query92 76 59 57 57 query93 1114925 580 580 query94 702 393 307 307 query95 367 291 284 284 query96 509 553 339 339 query97 2724279626292629 query98 216 207 208 207 query99 1415139013191319 Total cold run time: 293886 ms Total hot run time: 188534 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2945100490 TPC-H: Total hot run time: 33678 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 2c9c389c6bb477c3d66dea7cc5f7a19bb7fc9c19, data reload: false -- Round 1 -- q1 26115 508450315031 q2 1958271 175 175 q3 10420 1231708 708 q4 10236 977 515 515 q5 7672240123082308 q6 186 167 131 131 q7 917 729 601 601 q8 9319128710771077 q9 6709508350685068 q10 6865231318881888 q11 472 290 279 279 q12 351 348 209 209 q13 17768 371330963096 q14 237 239 223 223 q15 559 484 483 483 q16 432 436 377 377 q17 612 852 371 371 q18 7697721370357035 q19 1853981 572 572 q20 340 329 223 223 q21 3662259623282328 q22 10641027980 980 Total cold run time: 115444 ms Total hot run time: 33678 ms - Round 2, with runtime_filter_mode=off - q1 5199511551085108 q2 244 316 222 222 q3 2188267023262326 q4 1338175413471347 q5 4424438143864381 q6 226 168 128 128 q7 1984191617981798 q8 2579264425112511 q9 6955680867466746 q10 2928310526622662 q11 569 497 486 486 q12 641 746 571 571 q13 3352369231343134 q14 265 287 269 269 q15 519 463 474 463 q16 434 467 433 433 q17 1127153413191319 q18 7332740375937403 q19 791 833 929 833 q20 1958209219681968 q21 4917454944344434 q22 1147105110191019 Total cold run time: 51117 ms Total hot run time: 49561 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
hello-stephen commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2945013222 # FE UT Coverage Report Increment line coverage ` 47.06% (24/51)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/50379_2c9c389c6bb477c3d66dea7cc5f7a19bb7fc9c19/fe_increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/50379_2c9c389c6bb477c3d66dea7cc5f7a19bb7fc9c19/fe_report/index.html) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
hello-stephen commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2944564880 # Cloud UT Coverage Report Increment line coverage ` ` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/2c9c389c6bb477c3d66dea7cc5f7a19bb7fc9c19_2c9c389c6bb477c3d66dea7cc5f7a19bb7fc9c19_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/2c9c389c6bb477c3d66dea7cc5f7a19bb7fc9c19_2c9c389c6bb477c3d66dea7cc5f7a19bb7fc9c19_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 83.32% (1119/1343) | | Line Coverage | 66.81% (19195/28732) | | Region Coverage | 66.47% (9507/14302) | | Branch Coverage | 56.41% (5154/9136) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
suxiaogang223 commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2944482421 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2943526434 ClickBench: Total hot run time: 29.76 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit fc3e4adc9036c348a83a0cad346689ccb7096b46, data reload: false query1 0.040.030.03 query2 0.160.110.10 query3 0.350.200.19 query4 1.610.220.09 query5 0.430.410.41 query6 1.160.660.68 query7 0.020.020.02 query8 0.060.050.05 query9 0.630.520.53 query10 0.590.580.58 query11 0.280.130.14 query12 0.260.130.14 query13 0.640.620.62 query14 0.830.820.82 query15 0.980.900.88 query16 0.370.380.38 query17 1.101.051.05 query18 0.200.180.17 query19 2.001.831.93 query20 0.020.020.02 query21 15.40 0.970.67 query22 0.931.060.86 query23 14.66 1.530.77 query24 5.430.580.29 query25 0.160.090.09 query26 0.560.240.18 query27 0.080.080.08 query28 11.04 1.220.61 query29 12.53 4.093.44 query30 0.290.080.06 query31 2.840.620.43 query32 3.250.610.50 query33 3.163.153.09 query34 16.60 5.124.41 query35 4.504.484.44 query36 0.630.520.50 query37 0.200.170.18 query38 0.170.160.15 query39 0.050.040.04 query40 0.210.160.15 query41 0.110.050.05 query42 0.060.050.05 query43 0.060.050.05 Total cold run time: 104.65 s Total hot run time: 29.76 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2943506447 TPC-DS: Total hot run time: 193278 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit fc3e4adc9036c348a83a0cad346689ccb7096b46, data reload: false query1 1440110010681068 query2 6269186218831862 query3 11065 459643974397 query4 52903 25922 22963 22963 query5 5148642 479 479 query6 351 223 209 209 query7 4928517 295 295 query8 299 232 221 221 query9 5736277327782773 query10 464 337 271 271 query11 15056 15040 14900 14900 query12 160 110 117 110 query13 1078549 429 429 query14 10188 653264366436 query15 209 185 184 184 query16 7087631 501 501 query17 1095719 584 584 query18 1597410 326 326 query19 212 191 176 176 query20 133 138 123 123 query21 207 124 113 113 query22 4479446243174317 query23 34205 33512 33809 33512 query24 6650240524422405 query25 462 484 408 408 query26 701 277 163 163 query27 2379556 361 361 query28 3060229122592259 query29 598 552 459 459 query30 271 229 197 197 query31 884 867 775 775 query32 70 67 65 65 query33 501 378 337 337 query34 808 867 550 550 query35 790 875 755 755 query36 973 1012930 930 query37 118 107 79 79 query38 4382434841674167 query39 1533153114661466 query40 216 126 109 109 query41 61 59 67 59 query42 126 112 109 109 query43 515 514 505 505 query44 1346860 884 860 query45 186 182 178 178 query46 867 1050662 662 query47 1854190417871787 query48 460 453 349 349 query49 650 500 419 419 query50 703 709 420 420 query51 4373428042214221 query52 111 113 105 105 query53 235 266 187 187 query54 601 604 522 522 query55 89 88 91 88 query56 316 315 322 315 query57 1178118611501150 query58 272 264 271 264 query59 2702281228182812 query60 342 335 315 315 query61 134 130 136 130 query62 751 753 687 687 query63 237 198 197 197 query64 20451043704 704 query65 4206417541414141 query66 723 400 309 309 query67 16022 1 15444 15444 query68 6055908 555 555 query69 543 317 289 289 query70 1267115111291129 query71 451 323 301 301 query72 5960473147754731 query73 1412629 368 368 query74 9247882491018824 query75 3189325227042704 query76 39081203773 773 query77 536 372 296 296 query78 10035 10227 93099309 query79 2712842 592 592 query80 663 532 448 448 query81 499 256 217 217 query82 446 134 101 101 query83 311 267 236 236 query84 302 113 94 94 query85 785 365 334 334 query86 354 328 295 295 query87 4403459344464446 query88 3597232023072307 query89 395 329 286 286 query90 1656207 203 203 query91 152 151 114 114 query92 76 66 58 58 query93 2060966 608 608 query94 730 408 291 291 query95 375 306 297 297 query96 525 583 291 291 query97 2722278426162616 query98 235 216 215 215 query99 1445138912771277 Total cold run time: 296856 ms Total hot run time: 193278 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2943468308 TPC-H: Total hot run time: 34120 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit fc3e4adc9036c348a83a0cad346689ccb7096b46, data reload: false -- Round 1 -- q1 26914 501450095009 q2 1981304 189 189 q3 10350 1276726 726 q4 10242 1026540 540 q5 7632236123582358 q6 187 167 135 135 q7 904 766 624 624 q8 9312129611301130 q9 6826521151045104 q10 6888233619101910 q11 478 306 311 306 q12 349 355 231 231 q13 17786 369630883088 q14 239 239 219 219 q15 570 474 487 474 q16 442 436 380 380 q17 629 861 382 382 q18 8057717772017177 q19 1821980 563 563 q20 343 342 224 224 q21 3843317123722372 q22 10301009979 979 Total cold run time: 116823 ms Total hot run time: 34120 ms - Round 2, with runtime_filter_mode=off - q1 5163509650835083 q2 236 330 220 220 q3 2160266123522352 q4 1309180414401440 q5 4564444944014401 q6 211 161 135 135 q7 2052190417401740 q8 2743267225682568 q9 7257725971627162 q10 3015321927822782 q11 586 508 489 489 q12 683 793 606 606 q13 3519392234493449 q14 300 301 288 288 q15 544 507 491 491 q16 467 501 438 438 q17 1181157213901390 q18 7795741274207412 q19 855 840 924 840 q20 1996201419011901 q21 4839449043744374 q22 1089107310381038 Total cold run time: 52564 ms Total hot run time: 50599 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
hello-stephen commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2943086604 # Cloud UT Coverage Report Increment line coverage ` ` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/fc3e4adc9036c348a83a0cad346689ccb7096b46_fc3e4adc9036c348a83a0cad346689ccb7096b46_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/fc3e4adc9036c348a83a0cad346689ccb7096b46_fc3e4adc9036c348a83a0cad346689ccb7096b46_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 83.32% (1119/1343) | | Line Coverage | 66.77% (19184/28732) | | Region Coverage | 66.47% (9506/14302) | | Branch Coverage | 56.37% (5150/9136) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
suxiaogang223 commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2943038091 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2942895448 ClickBench: Total hot run time: 29.55 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 0587de7ce408c6cdb9b6a233bb918066405641ad, data reload: false query1 0.030.040.03 query2 0.120.110.10 query3 0.250.190.19 query4 1.600.200.20 query5 0.460.450.46 query6 1.510.660.66 query7 0.030.020.02 query8 0.040.040.04 query9 0.570.520.52 query10 0.580.580.56 query11 0.160.120.12 query12 0.140.120.12 query13 0.620.590.60 query14 0.810.810.81 query15 0.880.860.86 query16 0.390.380.38 query17 1.051.041.04 query18 0.220.210.21 query19 1.921.891.86 query20 0.020.010.02 query21 15.40 0.880.55 query22 0.741.120.66 query23 15.08 1.410.64 query24 6.901.141.18 query25 0.490.160.08 query26 0.670.180.13 query27 0.060.050.05 query28 9.580.930.47 query29 12.59 4.023.32 query30 0.250.090.06 query31 2.830.610.40 query32 3.240.560.47 query33 3.003.053.14 query34 15.94 5.124.48 query35 4.594.484.55 query36 0.660.500.48 query37 0.090.060.07 query38 0.050.040.04 query39 0.030.020.02 query40 0.170.150.13 query41 0.080.030.02 query42 0.040.020.02 query43 0.040.030.03 Total cold run time: 103.92 s Total hot run time: 29.55 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2942884327 TPC-DS: Total hot run time: 185827 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 0587de7ce408c6cdb9b6a233bb918066405641ad, data reload: false query1 1011478 502 478 query2 6582182618231823 query3 6749234 230 230 query4 26227 23950 22865 22865 query5 4368634 473 473 query6 324 220 202 202 query7 4633498 298 298 query8 272 227 208 208 query9 8648266926582658 query10 490 325 280 280 query11 15267 15035 14810 14810 query12 157 113 113 113 query13 1662540 419 419 query14 9387626362906263 query15 215 204 173 173 query16 7389686 468 468 query17 1182698 552 552 query18 1964404 315 315 query19 182 184 162 162 query20 119 117 119 117 query21 215 123 110 110 query22 4048412539873987 query23 33860 32994 33266 32994 query24 8415237524162375 query25 520 451 395 395 query26 778 267 156 156 query27 2732509 350 350 query28 4288215221282128 query29 683 569 425 425 query30 287 220 187 187 query31 963 832 758 758 query32 69 73 63 63 query33 543 358 328 328 query34 807 892 521 521 query35 781 815 736 736 query36 932 993 926 926 query37 119 107 76 76 query38 4160418441154115 query39 1449139014421390 query40 208 121 105 105 query41 63 59 59 59 query42 130 109 111 109 query43 491 508 481 481 query44 1372834 828 828 query45 175 179 175 175 query46 858 1022630 630 query47 1742178417231723 query48 406 425 310 310 query49 715 509 400 400 query50 650 680 422 422 query51 4112420340634063 query52 110 107 98 98 query53 228 257 184 184 query54 586 567 504 504 query55 90 87 88 87 query56 307 301 293 293 query57 1131116811051105 query58 271 260 266 260 query59 2689272824912491 query60 327 307 317 307 query61 128 127 163 127 query62 818 737 672 672 query63 224 188 186 186 query64 33551065777 777 query65 4262415741314131 query66 1010416 305 305 query67 15682 15441 15435 15435 query68 8880893 525 525 query69 486 297 262 262 query70 1258109410751075 query71 466 330 299 299 query72 5264464946454645 query73 706 585 358 358 query74 8933915691679156 query75 4271321626842684 query76 36151188759 759 query77 812 382 346 346 query78 10026 10210 93069306 query79 2001818 604 604 query80 656 522 460 460 query81 476 257 225 225 query82 467 130 100 100 query83 281 256 230 230 query84 344 112 95 95 query85 783 354 315 315 query86 330 328 284 284 query87 4439439843394339 query88 2942229122852285 query89 388 315 277 277 query90 1962215 215 215 query91 148 147 111 111 query92 69 61 56 56 query93 1832946 587 587 query94 684 435 311 311 query95 382 293 293 293 query96 504 635 287 287 query97 2693270926552655 query98 227 205 203 203 query99 1420143412861286 Total cold run time: 272362 ms Total hot run time: 185827 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2942856644 TPC-H: Total hot run time: 34060 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 0587de7ce408c6cdb9b6a233bb918066405641ad, data reload: false -- Round 1 -- q1 26438 514349864986 q2 1974294 206 206 q3 10374 1259716 716 q4 10246 1008546 546 q5 7791234523432343 q6 178 166 133 133 q7 914 748 598 598 q8 9310130011031103 q9 6811518450985098 q10 6867232119201920 q11 498 293 270 270 q12 346 352 229 229 q13 17815 369330773077 q14 226 226 224 224 q15 554 491 491 491 q16 436 438 368 368 q17 607 866 366 366 q18 7766725371497149 q19 1660972 557 557 q20 343 342 228 228 q21 4059315524502450 q22 1086103010021002 Total cold run time: 116299 ms Total hot run time: 34060 ms - Round 2, with runtime_filter_mode=off - q1 5208512250935093 q2 243 321 219 219 q3 2128262223132313 q4 1341182514441444 q5 4582443943744374 q6 214 167 128 128 q7 1989197017981798 q8 2548262425622562 q9 7074721972117211 q10 3004322427842784 q11 581 525 494 494 q12 694 749 627 627 q13 3468392532643264 q14 285 288 276 276 q15 515 464 475 464 q16 445 475 443 443 q17 1147155613791379 q18 7768748975797489 q19 827 926 988 926 q20 1974201818841884 q21 4862425542944255 q22 10731029974 974 Total cold run time: 51970 ms Total hot run time: 50401 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
hello-stephen commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2942810969 # FE UT Coverage Report Increment line coverage ` 47.06% (24/51)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/50379_0587de7ce408c6cdb9b6a233bb918066405641ad/fe_increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/50379_0587de7ce408c6cdb9b6a233bb918066405641ad/fe_report/index.html) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2942668074 # Cloud UT Coverage Report Increment line coverage ` ` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/0587de7ce408c6cdb9b6a233bb918066405641ad_0587de7ce408c6cdb9b6a233bb918066405641ad_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/0587de7ce408c6cdb9b6a233bb918066405641ad_0587de7ce408c6cdb9b6a233bb918066405641ad_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 83.32% (1119/1343) | | Line Coverage | 66.76% (19182/28732) | | Region Coverage | 66.46% (9505/14302) | | Branch Coverage | 56.38% (5151/9136) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
suxiaogang223 commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2942647860 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2941054163 ClickBench: Total hot run time: 29.58 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit fdf333a26acbd27a5a03160a1a472c72d8684d46, data reload: false query1 0.030.040.02 query2 0.150.100.12 query3 0.340.200.20 query4 1.600.090.11 query5 0.430.420.40 query6 1.160.670.68 query7 0.020.020.01 query8 0.060.050.05 query9 0.630.530.53 query10 0.590.580.56 query11 0.260.130.13 query12 0.250.130.14 query13 0.630.620.62 query14 0.790.840.82 query15 0.970.870.88 query16 0.370.380.38 query17 1.081.061.02 query18 0.190.180.19 query19 1.961.841.86 query20 0.020.010.01 query21 15.41 0.980.67 query22 0.941.030.80 query23 14.68 1.570.75 query24 5.290.600.29 query25 0.160.090.09 query26 0.550.240.19 query27 0.090.090.08 query28 11.05 1.190.58 query29 12.54 4.033.36 query30 0.280.080.06 query31 2.820.620.43 query32 3.230.590.51 query33 3.093.133.06 query34 16.23 5.144.49 query35 4.454.474.39 query36 0.640.510.51 query37 0.190.180.17 query38 0.170.160.16 query39 0.050.040.05 query40 0.200.180.16 query41 0.110.060.06 query42 0.070.050.06 query43 0.060.050.05 Total cold run time: 103.83 s Total hot run time: 29.58 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2941038064 TPC-DS: Total hot run time: 193077 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit fdf333a26acbd27a5a03160a1a472c72d8684d46, data reload: false query1 1432108910621062 query2 6154184418151815 query3 11021 454745174517 query4 54067 24316 23439 23439 query5 5106549 470 470 query6 348 211 216 211 query7 4903510 289 289 query8 291 239 219 219 query9 5408265226392639 query10 442 368 308 308 query11 15124 15079 14979 14979 query12 165 112 105 105 query13 1045540 411 411 query14 10195 636864146368 query15 203 200 181 181 query16 7141625 506 506 query17 1103745 633 633 query18 1586409 324 324 query19 203 209 189 189 query20 134 133 124 124 query21 207 128 113 113 query22 4373434942934293 query23 34500 33480 33641 33480 query24 6639241824242418 query25 463 490 431 431 query26 696 281 154 154 query27 2341504 350 350 query28 3009220521802180 query29 583 569 428 428 query30 289 229 189 189 query31 898 848 764 764 query32 73 67 66 66 query33 482 367 306 306 query34 786 876 529 529 query35 807 847 757 757 query36 957 1019920 920 query37 115 103 76 76 query38 4331436042624262 query39 1528160814611461 query40 222 129 117 117 query41 64 58 59 58 query42 136 124 121 121 query43 519 515 480 480 query44 1349858 871 858 query45 186 182 167 167 query46 851 1116642 642 query47 1839192417901790 query48 419 436 321 321 query49 664 526 396 396 query50 667 697 404 404 query51 4245431742324232 query52 114 115 110 110 query53 228 266 185 185 query54 602 585 527 527 query55 89 83 87 83 query56 306 304 296 296 query57 1157120211171117 query58 274 271 258 258 query59 2704280126282628 query60 335 316 308 308 query61 156 124 148 124 query62 715 702 648 648 query63 221 184 188 184 query64 18561032680 680 query65 4231415341374137 query66 755 398 302 302 query67 15842 15639 15534 15534 query68 6948897 532 532 query69 533 320 263 263 query70 1187113710521052 query71 520 322 290 290 query72 6020496850584968 query73 1435705 349 349 query74 9036930188288828 query75 3851323926702670 query76 41751208737 737 query77 643 355 281 281 query78 10189 10365 92959295 query79 2197808 586 586 query80 590 521 448 448 query81 508 275 220 220 query82 253 124 92 92 query83 251 248 241 241 query84 295 111 90 90 query85 794 369 328 328 query86 366 331 267 267 query87 4516439242984298 query88 4002231123622311 query89 396 316 285 285 query90 1807201 205 201 query91 160 162 116 116 query92 73 64 58 58 query93 1812937 578 578 query94 650 413 301 301 query95 370 294 276 276 query96 509 571 283 283 query97 2741275226592659 query98 237 205 210 205 query99 1322143712961296 Total cold run time: 298280 ms Total hot run time: 193077 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2940996557 TPC-H: Total hot run time: 33921 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit fdf333a26acbd27a5a03160a1a472c72d8684d46, data reload: false -- Round 1 -- q1 26609 501050205010 q2 1956283 189 189 q3 10430 1233713 713 q4 10228 984 533 533 q5 7714236622902290 q6 188 163 130 130 q7 904 749 610 610 q8 9324129111551155 q9 6792509950885088 q10 6856230419061906 q11 501 277 275 275 q12 344 350 211 211 q13 17767 370630963096 q14 243 228 223 223 q15 571 487 494 487 q16 439 428 379 379 q17 619 856 386 386 q18 7542720472147204 q19 1994980 557 557 q20 331 329 219 219 q21 3810320123302330 q22 10451019930 930 Total cold run time: 116207 ms Total hot run time: 33921 ms - Round 2, with runtime_filter_mode=off - q1 5217500350335003 q2 243 321 219 219 q3 2166263922872287 q4 1343177613671367 q5 4481442844184418 q6 217 171 126 126 q7 2052195117731773 q8 2666253625012501 q9 7179713770637063 q10 2993320627802780 q11 556 505 503 503 q12 721 793 636 636 q13 3602386933473347 q14 288 292 266 266 q15 522 484 469 469 q16 438 499 450 450 q17 1157156513601360 q18 7796768274357435 q19 800 839 911 839 q20 1936200218231823 q21 4857453943904390 q22 1072103810161016 Total cold run time: 52302 ms Total hot run time: 50071 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
hello-stephen commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2940664271 # Cloud UT Coverage Report Increment line coverage ` ` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/fdf333a26acbd27a5a03160a1a472c72d8684d46_fdf333a26acbd27a5a03160a1a472c72d8684d46_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/fdf333a26acbd27a5a03160a1a472c72d8684d46_fdf333a26acbd27a5a03160a1a472c72d8684d46_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 83.32% (1119/1343) | | Line Coverage | 66.80% (19192/28732) | | Region Coverage | 66.44% (9502/14302) | | Branch Coverage | 56.43% (5155/9136) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
suxiaogang223 commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2940602347 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
starocean999 commented on code in PR #50379:
URL: https://github.com/apache/doris/pull/50379#discussion_r2122533569
##
fe/fe-core/src/main/java/org/apache/doris/datasource/LoadScanProvider.java:
##
@@ -95,10 +94,7 @@ public FileLoadScanNode.ParamCreateContext
createContext(Analyzer analyzer) thro
if (fileGroupInfo.getSequenceMapCol() != null) {
params.setSequenceMapCol(fileGroupInfo.getSequenceMapCol());
}
-if (fileFormatProperties.getFormatName().equals("hive_text")) {
-params.setTextSerdeType(TTextSerdeType.HIVE_TEXT_SERDE);
-}
-
params.setProperties(fileGroupInfo.getBrokerDesc().getBackendConfigProperties());
+params.setProperties(fileGroupInfo.getBrokerDesc().getProperties());
Review Comment:
looks like createContext should not be called in latest master, could you
please show an example that how this function is called?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
hello-stephen commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2930774012 # Cloud UT Coverage Report Increment line coverage ` ` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/3a662dc35fb3163b0aebab385d2348d8bb2b64d7_3a662dc35fb3163b0aebab385d2348d8bb2b64d7_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/3a662dc35fb3163b0aebab385d2348d8bb2b64d7_3a662dc35fb3163b0aebab385d2348d8bb2b64d7_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 83.31% (1118/1342) | | Line Coverage | 66.76% (19136/28663) | | Region Coverage | 66.40% (9469/14261) | | Branch Coverage | 56.35% (5131/9106) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
suxiaogang223 commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2930643102 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2921982873 # Cloud UT Coverage Report Increment line coverage ` ` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/3a662dc35fb3163b0aebab385d2348d8bb2b64d7_3a662dc35fb3163b0aebab385d2348d8bb2b64d7_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/3a662dc35fb3163b0aebab385d2348d8bb2b64d7_3a662dc35fb3163b0aebab385d2348d8bb2b64d7_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 83.31% (1118/1342) | | Line Coverage | 66.79% (19145/28663) | | Region Coverage | 66.38% (9467/14261) | | Branch Coverage | 56.37% (5133/9106) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
suxiaogang223 commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2921952540 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2910181375 TPC-H: Total hot run time: 33768 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit cfefcb593357db219db76f3389ca8974c0b938a0, data reload: false -- Round 1 -- q1 26051 501349664966 q2 2072276 184 184 q3 10392 1249720 720 q4 10238 1018525 525 q5 7554236023362336 q6 180 162 136 136 q7 899 756 613 613 q8 9311124210961096 q9 7062511550475047 q10 6830232919071907 q11 485 281 270 270 q12 333 354 222 222 q13 17773 367930883088 q14 228 225 216 216 q15 535 486 484 484 q16 435 431 374 374 q17 578 860 361 361 q18 7620735071437143 q19 1212938 558 558 q20 336 340 229 229 q21 3870258723252325 q22 10661011968 968 Total cold run time: 115060 ms Total hot run time: 33768 ms - Round 2, with runtime_filter_mode=off - q1 5104503150425031 q2 237 333 227 227 q3 2184267522812281 q4 1336177113451345 q5 4438447544254425 q6 231 172 132 132 q7 1982193517551755 q8 2560253424792479 q9 7152717671567156 q10 3038314327742774 q11 565 499 494 494 q12 679 778 657 657 q13 3601392132333233 q14 289 312 294 294 q15 511 485 467 467 q16 437 490 429 429 q17 1130149113981398 q18 7613743472857285 q19 823 814 863 814 q20 1988198518951895 q21 4881440143004300 q22 10931019989 989 Total cold run time: 51872 ms Total hot run time: 49860 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2910203456 TPC-DS: Total hot run time: 185591 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit cfefcb593357db219db76f3389ca8974c0b938a0, data reload: false query1 1026488 504 488 query2 6595187618491849 query3 6763230 224 224 query4 26242 23757 23096 23096 query5 4331620 455 455 query6 310 207 200 200 query7 4630509 298 298 query8 297 252 258 252 query9 8622259626002596 query10 500 327 272 272 query11 15928 15021 14757 14757 query12 179 115 107 107 query13 1659528 411 411 query14 9617611761886117 query15 198 202 172 172 query16 7311642 488 488 query17 1208777 578 578 query18 1965390 290 290 query19 198 210 162 162 query20 120 124 151 124 query21 212 120 103 103 query22 4094404239333933 query23 34278 33024 33098 33024 query24 8490240023812381 query25 562 469 392 392 query26 1242271 154 154 query27 2742507 340 340 query28 4322211220892089 query29 759 552 421 421 query30 318 214 193 193 query31 957 865 762 762 query32 73 66 90 66 query33 597 370 325 325 query34 811 838 525 525 query35 766 796 711 711 query36 959 978 904 904 query37 118 102 79 79 query38 4156415140344034 query39 1470141614421416 query40 212 118 108 108 query41 58 56 57 56 query42 129 110 116 110 query43 514 511 501 501 query44 1347831 826 826 query45 175 174 165 165 query46 865 1040644 644 query47 1767179717111711 query48 392 440 319 319 query49 776 539 426 426 query50 650 695 404 404 query51 4146414741904147 query52 112 109 102 102 query53 231 263 183 183 query54 581 571 508 508 query55 86 82 86 82 query56 314 331 294 294 query57 1155113510771077 query58 270 261 290 261 query59 2664274927032703 query60 344 344 298 298 query61 126 126 129 126 query62 785 770 677 677 query63 232 185 187 185 query64 4324997 677 677 query65 4332425342864253 query66 1126428 307 307 query67 16057 15572 15319 15319 query68 8495897 520 520 query69 465 314 271 271 query70 1205109211401092 query71 472 320 301 301 query72 5499477149044771 query73 751 783 359 359 query74 8886886789938867 query75 3964323127002700 query76 37261191761 761 query77 790 383 310 310 query78 10173 10205 92979297 query79 2220825 564 564 query80 611 505 440 440 query81 471 261 220 220 query82 430 130 101 101 query83 288 248 231 231 query84 297 114 82 82 query85 808 355 311 311 query86 339 292 291 291 query87 4487436443454345 query88 3127227923322279 query89 386 317 294 294 query90 1952226 211 211 query91 145 150 115 115 query92 78 69 56 56 query93 1641983 582 582 query94 663 401 303 303 query95 382 301 281 281 query96 492 583 287 287 query97 2748281926282628 query98 240 209 205 205 query99 1426139912591259 Total cold run time: 276052 ms Total hot run time: 185591 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2910212774 ClickBench: Total hot run time: 28.96 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit cfefcb593357db219db76f3389ca8974c0b938a0, data reload: false query1 0.040.030.04 query2 0.110.110.11 query3 0.240.200.19 query4 1.610.200.20 query5 0.420.410.40 query6 1.170.650.67 query7 0.020.010.01 query8 0.040.030.03 query9 0.580.510.54 query10 0.560.580.57 query11 0.150.110.11 query12 0.150.120.12 query13 0.610.610.59 query14 0.790.800.80 query15 0.880.880.85 query16 0.370.390.38 query17 1.061.011.06 query18 0.230.210.21 query19 1.911.831.81 query20 0.010.010.02 query21 15.41 0.930.55 query22 0.761.160.64 query23 14.99 1.400.65 query24 6.901.740.71 query25 0.470.120.12 query26 0.580.170.15 query27 0.050.040.05 query28 9.680.940.44 query29 12.56 4.063.32 query30 0.270.100.07 query31 2.840.600.38 query32 3.230.550.47 query33 3.053.033.13 query34 15.65 5.064.50 query35 4.494.544.50 query36 0.660.510.47 query37 0.080.060.06 query38 0.050.040.04 query39 0.030.020.02 query40 0.170.140.13 query41 0.070.040.03 query42 0.030.020.02 query43 0.040.030.03 Total cold run time: 103.01 s Total hot run time: 28.96 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
hello-stephen commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2910176343 # Cloud UT Coverage Report Increment line coverage ` ` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/cfefcb593357db219db76f3389ca8974c0b938a0_cfefcb593357db219db76f3389ca8974c0b938a0_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/cfefcb593357db219db76f3389ca8974c0b938a0_cfefcb593357db219db76f3389ca8974c0b938a0_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 83.25% (1113/1337) | | Line Coverage | 66.18% (18680/28224) | | Region Coverage | 65.85% (9271/14079) | | Branch Coverage | 55.64% (4989/8966) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
suxiaogang223 commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2910119893 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2909128620 ClickBench: Total hot run time: 30 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 67fcd97f506f6be6cafcc187cf92c8e99aadadb2, data reload: false query1 0.030.030.03 query2 0.150.110.11 query3 0.360.200.20 query4 1.590.210.20 query5 0.480.470.46 query6 1.150.640.67 query7 0.020.020.01 query8 0.060.050.05 query9 0.630.520.53 query10 0.580.580.58 query11 0.260.130.13 query12 0.250.130.13 query13 0.640.620.63 query14 0.800.830.82 query15 0.990.890.89 query16 0.360.380.38 query17 1.101.061.03 query18 0.190.190.19 query19 2.011.851.91 query20 0.010.020.01 query21 15.41 1.000.69 query22 0.931.070.76 query23 14.67 1.510.77 query24 5.430.530.28 query25 0.160.090.09 query26 0.560.210.19 query27 0.090.080.08 query28 11.03 1.210.58 query29 12.56 4.143.47 query30 0.280.090.07 query31 2.820.630.42 query32 3.230.590.50 query33 3.063.133.18 query34 16.36 5.054.45 query35 4.464.504.50 query36 0.640.500.50 query37 0.190.170.18 query38 0.170.160.16 query39 0.040.040.04 query40 0.200.150.15 query41 0.100.050.05 query42 0.060.050.06 query43 0.060.050.05 Total cold run time: 104.17 s Total hot run time: 30 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2909112915 TPC-DS: Total hot run time: 192352 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 67fcd97f506f6be6cafcc187cf92c8e99aadadb2, data reload: false query1 1419114610321032 query2 6360187218641864 query3 11048 442847584428 query4 25735 24012 22994 22994 query5 4373610 437 437 query6 299 207 197 197 query7 4002498 286 286 query8 316 237 229 229 query9 8502259326062593 query10 475 330 253 253 query11 15349 15160 14847 14847 query12 167 110 114 110 query13 1565568 405 405 query14 8350622162576221 query15 210 186 172 172 query16 7177650 496 496 query17 1220734 554 554 query18 1960414 301 301 query19 194 189 168 168 query20 124 126 126 126 query21 215 127 113 113 query22 4433450342794279 query23 34943 34050 33556 33556 query24 8631241924452419 query25 530 465 393 393 query26 1246305 154 154 query27 2818503 337 337 query28 4810218621462146 query29 721 573 436 436 query30 268 219 190 190 query31 911 900 790 790 query32 102 65 66 65 query33 554 373 315 315 query34 819 894 522 522 query35 842 835 761 761 query36 997 1006890 890 query37 112 98 77 77 query38 4296429842724272 query39 1511144714391439 query40 218 123 108 108 query41 56 52 54 52 query42 116 106 106 106 query43 522 527 484 484 query44 1322834 834 834 query45 183 180 174 174 query46 848 1027647 647 query47 1900186617571757 query48 399 422 334 334 query49 745 533 439 439 query50 680 717 426 426 query51 4219424942254225 query52 112 113 101 101 query53 235 265 194 194 query54 612 595 520 520 query55 82 84 82 82 query56 306 300 311 300 query57 1196122511321132 query58 283 278 280 278 query59 2730291326712671 query60 370 358 338 338 query61 156 149 147 147 query62 774 752 684 684 query63 231 196 200 196 query64 42541070696 696 query65 4420429244624292 query66 1030399 305 305 query67 15874 15583 15589 15583 query68 8467897 519 519 query69 479 304 266 266 query70 1209111311131113 query71 474 306 302 302 query72 5768479251814792 query73 757 672 358 358 query74 8890920286868686 query75 3826318126672667 query76 36981181767 767 query77 797 378 276 276 query78 10146 10257 94079407 query79 2158818 583 583 query80 589 497 456 456 query81 483 269 218 218 query82 475 136 96 96 query83 254 249 233 233 query84 248 117 168 117 query85 809 364 316 316 query86 381 299 304 299 query87 4434451043294329 query88 3710231123172311 query89 416 319 287 287 query90 1807221 225 221 query91 144 144 111 111 query92 74 58 58 58 query93 1690970 581 581 query94 678 415 301 301 query95 374 292 289 289 query96 488 567 282 282 query97 2695278526792679 query98 231 206 200 200 query99 1421140712601260 Total cold run time: 279547 ms Total hot run time: 192352 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2909075751 TPC-H: Total hot run time: 33901 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 67fcd97f506f6be6cafcc187cf92c8e99aadadb2, data reload: false -- Round 1 -- q1 26261 499949744974 q2 2086276 190 190 q3 10503 1244709 709 q4 10231 985 516 516 q5 7660237423552355 q6 188 174 135 135 q7 928 736 598 598 q8 9308128810821082 q9 6782509250265026 q10 6819234519041904 q11 478 285 268 268 q12 338 356 214 214 q13 17770 369731093109 q14 231 233 221 221 q15 533 481 490 481 q16 435 432 381 381 q17 585 873 374 374 q18 7540725171337133 q19 1901986 559 559 q20 345 323 227 227 q21 3797256124702470 q22 10661018975 975 Total cold run time: 115785 ms Total hot run time: 33901 ms - Round 2, with runtime_filter_mode=off - q1 5170507050885070 q2 241 323 232 232 q3 2179267522652265 q4 1325181413281328 q5 4501441444034403 q6 228 179 130 130 q7 2018193217761776 q8 2578290925472547 q9 7222717568716871 q10 3040322227742774 q11 579 505 496 496 q12 684 760 629 629 q13 3512387332963296 q14 286 288 273 273 q15 546 499 508 499 q16 449 499 460 460 q17 1169151013871387 q18 7793760874137413 q19 793 795 869 795 q20 1967205918591859 q21 4735448444414441 q22 1065105510251025 Total cold run time: 52080 ms Total hot run time: 49969 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
suxiaogang223 commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2908798979 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2908848110 # Cloud UT Coverage Report Increment line coverage ` ` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/67fcd97f506f6be6cafcc187cf92c8e99aadadb2_67fcd97f506f6be6cafcc187cf92c8e99aadadb2_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/67fcd97f506f6be6cafcc187cf92c8e99aadadb2_67fcd97f506f6be6cafcc187cf92c8e99aadadb2_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 83.25% (1113/1337) | | Line Coverage | 66.16% (18673/28224) | | Region Coverage | 65.84% (9269/14079) | | Branch Coverage | 55.58% (4983/8966) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2908009162 ClickBench: Total hot run time: 29.92 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 9dfcc92756376ccf764ec9b3ce62f40a5c6f3540, data reload: false query1 0.030.030.03 query2 0.150.100.10 query3 0.350.200.20 query4 1.580.190.19 query5 0.470.450.46 query6 1.170.670.65 query7 0.030.020.01 query8 0.060.050.05 query9 0.620.510.51 query10 0.580.580.56 query11 0.260.120.13 query12 0.250.130.14 query13 0.650.640.63 query14 0.800.820.83 query15 0.970.890.88 query16 0.360.360.37 query17 1.061.061.05 query18 0.190.220.18 query19 1.991.871.89 query20 0.020.010.01 query21 15.40 0.970.68 query22 0.961.060.90 query23 15.11 1.540.76 query24 5.480.550.28 query25 0.160.100.08 query26 0.550.220.18 query27 0.090.090.08 query28 11.03 1.210.59 query29 12.58 4.033.45 query30 0.280.090.06 query31 2.800.630.43 query32 3.240.600.51 query33 3.043.103.19 query34 16.75 5.174.42 query35 4.474.454.44 query36 0.630.510.49 query37 0.190.170.17 query38 0.180.150.16 query39 0.060.050.05 query40 0.190.160.16 query41 0.120.050.05 query42 0.060.040.05 query43 0.060.050.05 Total cold run time: 105.02 s Total hot run time: 29.92 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2908006743 TPC-DS: Total hot run time: 192421 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 9dfcc92756376ccf764ec9b3ce62f40a5c6f3540, data reload: false query1 1437109110661066 query2 6266188119241881 query3 10966 457542904290 query4 53779 25888 23111 23111 query5 5231545 489 489 query6 368 227 201 201 query7 4993524 287 287 query8 329 263 240 240 query9 6189264926182618 query10 407 330 271 271 query11 15101 15563 14800 14800 query12 162 114 105 105 query13 1102517 415 415 query14 10138 620562166205 query15 204 193 172 172 query16 7079618 483 483 query17 1083726 578 578 query18 1540404 304 304 query19 201 195 168 168 query20 132 136 120 120 query21 203 135 111 111 query22 4297450943944394 query23 34403 33524 33505 33505 query24 6510242724292427 query25 458 492 402 402 query26 702 287 153 153 query27 2189497 349 349 query28 3074218421532153 query29 586 570 429 429 query30 272 225 205 205 query31 858 877 773 773 query32 74 57 64 57 query33 446 366 325 325 query34 782 876 537 537 query35 842 841 770 770 query36 10071029920 920 query37 119 105 78 78 query38 4216420941414141 query39 1719149014491449 query40 222 123 114 114 query41 65 53 53 53 query42 126 113 117 113 query43 502 535 477 477 query44 1355851 852 851 query45 176 173 168 168 query46 849 1044644 644 query47 1837187217781778 query48 398 425 318 318 query49 704 533 472 472 query50 691 726 415 415 query51 4222431042114211 query52 114 118 108 108 query53 241 267 192 192 query54 609 600 542 542 query55 98 86 82 82 query56 334 327 330 327 query57 1217115611481148 query58 263 263 255 255 query59 2871281026592659 query60 346 332 326 326 query61 129 131 130 130 query62 749 755 648 648 query63 226 192 192 192 query64 14971057677 677 query65 4348420342484203 query66 742 402 303 303 query67 15702 15569 15640 15569 query68 6958870 519 519 query69 549 308 277 277 query70 1224113110941094 query71 470 308 311 308 query72 6007490350404903 query73 1181704 362 362 query74 8869915687358735 query75 3666320227252725 query76 40171206757 757 query77 600 386 314 314 query78 10078 10120 93809380 query79 2237812 580 580 query80 612 590 450 450 query81 487 254 214 214 query82 448 129 95 95 query83 321 245 244 244 query84 296 111 86 86 query85 792 357 313 313 query86 379 296 277 277 query87 4288443542514251 query88 3388229922832283 query89 427 339 285 285 query90 1761211 215 211 query91 140 141 113 113 query92 72 64 61 61 query93 1901976 590 590 query94 702 435 308 308 query95 367 308 291 291 query96 493 574 276 276 query97 2744275526672667 query98 233 201 209 201 query99 1425140612941294 Total cold run time: 297229 ms Total hot run time: 192421 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2908000748 TPC-H: Total hot run time: 33756 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 9dfcc92756376ccf764ec9b3ce62f40a5c6f3540, data reload: false -- Round 1 -- q1 26348 505050195019 q2 2094280 197 197 q3 10505 1240699 699 q4 10230 983 526 526 q5 7681239923302330 q6 180 161 135 135 q7 955 747 613 613 q8 9312133411071107 q9 6791507451295074 q10 6852231418971897 q11 506 325 276 276 q12 352 352 208 208 q13 17778 366330973097 q14 234 240 220 220 q15 517 488 494 488 q16 425 434 376 376 q17 601 854 368 368 q18 7575710670927092 q19 20961007568 568 q20 329 325 220 220 q21 3908250723062306 q22 10471026940 940 Total cold run time: 116316 ms Total hot run time: 33756 ms - Round 2, with runtime_filter_mode=off - q1 5237508852765088 q2 242 322 233 233 q3 2137269522822282 q4 1364178113601360 q5 4484442444104410 q6 208 171 126 126 q7 1988195717911791 q8 2575261226272612 q9 7265722569546954 q10 3038322927572757 q11 586 515 516 515 q12 700 767 650 650 q13 3525388532853285 q14 294 301 260 260 q15 504 473 477 473 q16 429 474 450 450 q17 1164158213771377 q18 7779769674347434 q19 779 783 810 783 q20 1974199018231823 q21 4846457045304530 q22 1133103510301030 Total cold run time: 52251 ms Total hot run time: 50223 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
hello-stephen commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2907935265 # Cloud UT Coverage Report Increment line coverage ` ` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/9dfcc92756376ccf764ec9b3ce62f40a5c6f3540_9dfcc92756376ccf764ec9b3ce62f40a5c6f3540_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/9dfcc92756376ccf764ec9b3ce62f40a5c6f3540_9dfcc92756376ccf764ec9b3ce62f40a5c6f3540_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 83.25% (1113/1337) | | Line Coverage | 66.19% (18681/28224) | | Region Coverage | 65.89% (9276/14079) | | Branch Coverage | 55.63% (4988/8966) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
suxiaogang223 commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2907924735 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
hello-stephen commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2904063239 # BE Regression && UT Coverage Report Increment line coverage `56.35% (173/307)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/50379_2253603deb065239177f2befdc0eac6184adfc0a_merge/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/50379_2253603deb065239177f2befdc0eac6184adfc0a_merge/report/index.html) | Category | Coverage | |---|| | Function Coverage | 60.43% (15853/26235) | | Line Coverage | 49.96% (148002/296213) | | Region Coverage | 47.21% (84305/178573) | | Branch Coverage | 40.80% (41409/101496) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
hello-stephen commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2903991856 # BE UT Coverage Report Increment line coverage `23.38% (72/308)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/2253603deb065239177f2befdc0eac6184adfc0a_2253603deb065239177f2befdc0eac6184adfc0a/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/2253603deb065239177f2befdc0eac6184adfc0a_2253603deb065239177f2befdc0eac6184adfc0a/report/index.html) | Category | Coverage | |---|| | Function Coverage | 56.06% (14943/26653) | | Line Coverage | 44.87% (132917/296227) | | Region Coverage | 43.96% (66835/152043) | | Branch Coverage | 38.60% (34300/88862) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-290378 ClickBench: Total hot run time: 29.62 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 2253603deb065239177f2befdc0eac6184adfc0a, data reload: false query1 0.040.040.03 query2 0.150.110.11 query3 0.350.200.20 query4 1.590.210.08 query5 0.420.410.41 query6 1.150.650.66 query7 0.020.020.01 query8 0.060.050.05 query9 0.640.510.54 query10 0.570.580.58 query11 0.260.120.13 query12 0.250.130.13 query13 0.640.610.62 query14 0.800.820.82 query15 0.970.880.89 query16 0.370.380.38 query17 1.081.071.04 query18 0.240.230.23 query19 1.941.871.80 query20 0.010.010.02 query21 15.39 0.960.66 query22 0.921.050.79 query23 14.72 1.530.75 query24 5.320.590.30 query25 0.160.090.09 query26 0.560.230.19 query27 0.080.080.08 query28 10.99 1.180.58 query29 12.53 4.093.49 query30 0.280.080.06 query31 2.810.620.43 query32 3.220.600.51 query33 3.183.073.08 query34 16.27 5.074.40 query35 4.464.454.42 query36 0.640.500.50 query37 0.210.170.17 query38 0.160.170.15 query39 0.050.040.04 query40 0.190.180.15 query41 0.110.050.05 query42 0.060.050.05 query43 0.050.050.04 Total cold run time: 103.91 s Total hot run time: 29.62 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2903749307 # Cloud UT Coverage Report Increment line coverage ` ` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/2253603deb065239177f2befdc0eac6184adfc0a_2253603deb065239177f2befdc0eac6184adfc0a_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/2253603deb065239177f2befdc0eac6184adfc0a_2253603deb065239177f2befdc0eac6184adfc0a_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 83.25% (1113/1337) | | Line Coverage | 66.13% (18665/28223) | | Region Coverage | 65.75% (9256/14077) | | Branch Coverage | 55.57% (4981/8964) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2903765328 TPC-DS: Total hot run time: 193905 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 2253603deb065239177f2befdc0eac6184adfc0a, data reload: false query1 1432109310801080 query2 6137186318291829 query3 11040 459146124591 query4 54036 24543 23392 23392 query5 5138538 457 457 query6 351 215 206 206 query7 4907519 302 302 query8 335 264 243 243 query9 6146263326342633 query10 407 327 295 295 query11 15073 15155 14769 14769 query12 163 111 107 107 query13 1077536 416 416 query14 10120 633264536332 query15 209 201 181 181 query16 7131652 509 509 query17 1093745 583 583 query18 1703434 311 311 query19 209 190 185 185 query20 138 132 166 132 query21 207 122 110 110 query22 4393450444854485 query23 34659 33795 33776 33776 query24 6809246224062406 query25 476 495 401 401 query26 707 282 155 155 query27 2456536 339 339 query28 3295216321522152 query29 611 570 469 469 query30 287 218 197 197 query31 885 858 774 774 query32 78 68 70 68 query33 487 357 319 319 query34 783 866 550 550 query35 825 852 740 740 query36 969 995 903 903 query37 113 106 78 78 query38 4219432442704270 query39 1524145914481448 query40 209 120 112 112 query41 90 53 63 53 query42 125 116 114 114 query43 513 518 486 486 query44 1353851 843 843 query45 179 170 167 167 query46 867 1061704 704 query47 1839189218251825 query48 401 443 310 310 query49 745 535 451 451 query50 670 697 409 409 query51 4200423842804238 query52 108 112 100 100 query53 228 262 200 200 query54 597 585 534 534 query55 83 84 79 79 query56 316 292 309 292 query57 1227113810811081 query58 260 255 256 255 query59 2590267626682668 query60 329 317 326 317 query61 127 124 123 123 query62 728 732 663 663 query63 228 184 187 184 query64 22451013691 691 query65 4325422642494226 query66 757 409 320 320 query67 16090 15677 15593 15593 query68 6648898 533 533 query69 553 320 266 266 query70 1265110511041104 query71 508 308 295 295 query72 6069485248444844 query73 1408637 354 354 query74 8938916489318931 query75 3899320026972697 query76 42341194774 774 query77 614 373 289 289 query78 10115 10238 94549454 query79 2619797 575 575 query80 603 513 450 450 query81 531 258 220 220 query82 429 131 96 96 query83 333 247 230 230 query84 289 104 94 94 query85 789 357 310 310 query86 380 283 291 283 query87 4423456243054305 query88 3463228823022288 query89 400 316 288 288 query90 1809215 223 215 query91 145 144 112 112 query92 77 60 64 60 query93 1988948 586 586 query94 656 410 294 294 query95 373 295 287 287 query96 492 578 283 283 query97 2766277526972697 query98 227 203 200 200 query99 1413140012601260 Total cold run time: 300513 ms Total hot run time: 193905 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2903734587 TPC-H: Total hot run time: 33836 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 2253603deb065239177f2befdc0eac6184adfc0a, data reload: false -- Round 1 -- q1 26313 501649544954 q2 2070286 193 193 q3 10394 1292697 697 q4 10225 1000515 515 q5 7541236923322332 q6 188 164 132 132 q7 915 766 597 597 q8 9306128210361036 q9 6910519051065106 q10 6807232019111911 q11 479 289 280 280 q12 335 347 212 212 q13 17805 371030903090 q14 223 223 226 223 q15 528 492 480 480 q16 412 440 375 375 q17 577 860 356 356 q18 7631732272057205 q19 885 953 557 557 q20 356 336 239 239 q21 3791256823652365 q22 10711018981 981 Total cold run time: 114762 ms Total hot run time: 33836 ms - Round 2, with runtime_filter_mode=off - q1 5048504050615040 q2 247 322 232 232 q3 2201263922822282 q4 1329179013311331 q5 4382439943984398 q6 219 179 129 129 q7 2048196517871787 q8 2615256525272527 q9 7294726571057105 q10 3049321127672767 q11 576 521 509 509 q12 660 757 608 608 q13 3562385933253325 q14 313 317 296 296 q15 520 476 467 467 q16 438 466 445 445 q17 1172153314001400 q18 7908763575337533 q19 783 822 858 822 q20 2031197218581858 q21 4848443044434430 q22 1153107310191019 Total cold run time: 52396 ms Total hot run time: 50310 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
suxiaogang223 commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2903673860 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
hello-stephen commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2903047649 # Cloud UT Coverage Report Increment line coverage ` ` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/43e7251cf041c9b92b6e83e38b7fbc7f18294c78_43e7251cf041c9b92b6e83e38b7fbc7f18294c78_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/43e7251cf041c9b92b6e83e38b7fbc7f18294c78_43e7251cf041c9b92b6e83e38b7fbc7f18294c78_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 83.25% (1113/1337) | | Line Coverage | 66.15% (18669/28223) | | Region Coverage | 65.81% (9264/14077) | | Branch Coverage | 55.60% (4984/8964) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
suxiaogang223 commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2903026846 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
suxiaogang223 commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2901842625 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
suxiaogang223 commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2901819070 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
suxiaogang223 commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2901807462 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2900886952 ClickBench: Total hot run time: 29.63 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit ca6fb29f8dc2beada465a1b27159efede6177ffc, data reload: false query1 0.030.030.04 query2 0.130.100.10 query3 0.270.190.19 query4 1.590.180.20 query5 0.450.440.44 query6 1.480.660.66 query7 0.020.020.01 query8 0.040.040.03 query9 0.590.510.51 query10 0.570.580.57 query11 0.150.110.12 query12 0.150.110.12 query13 0.620.600.61 query14 0.790.800.82 query15 0.890.850.87 query16 0.380.380.40 query17 1.041.061.07 query18 0.230.220.21 query19 1.931.811.87 query20 0.020.020.01 query21 15.41 0.900.53 query22 0.781.160.94 query23 15.07 1.420.66 query24 7.301.650.92 query25 0.460.140.14 query26 0.600.170.13 query27 0.040.050.06 query28 9.470.850.45 query29 12.52 3.993.34 query30 0.270.090.07 query31 2.810.570.38 query32 3.230.560.46 query33 3.043.153.07 query34 15.74 5.154.52 query35 4.554.564.52 query36 0.670.500.48 query37 0.080.060.06 query38 0.060.040.04 query39 0.030.020.02 query40 0.160.130.12 query41 0.080.020.02 query42 0.030.020.02 query43 0.040.040.03 Total cold run time: 103.81 s Total hot run time: 29.63 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2900873726 TPC-DS: Total hot run time: 186371 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit ca6fb29f8dc2beada465a1b27159efede6177ffc, data reload: false query1 980 483 504 483 query2 6560189318501850 query3 6740220 218 218 query4 26783 23850 22984 22984 query5 4333634 463 463 query6 292 204 188 188 query7 4619515 287 287 query8 276 257 223 223 query9 8564264426302630 query10 505 346 259 259 query11 15195 15060 14896 14896 query12 165 112 106 106 query13 1659533 422 422 query14 8722637763536353 query15 213 186 174 174 query16 7138669 479 479 query17 947 733 592 592 query18 1985404 307 307 query19 196 198 175 175 query20 119 123 120 120 query21 211 124 109 109 query22 4103420040414041 query23 34189 33197 32995 32995 query24 8288241524132413 query25 570 478 423 423 query26 1230281 159 159 query27 2717508 344 344 query28 4331217221472147 query29 853 568 438 438 query30 285 210 183 183 query31 921 870 757 757 query32 76 63 62 62 query33 558 373 319 319 query34 802 862 522 522 query35 782 829 739 739 query36 944 1055874 874 query37 112 103 74 74 query38 4002413540984098 query39 1467141014291410 query40 215 129 109 109 query41 57 59 54 54 query42 124 106 115 106 query43 503 522 485 485 query44 1353840 833 833 query45 174 179 180 179 query46 846 1046646 646 query47 1753176817101710 query48 381 430 304 304 query49 771 517 452 452 query50 664 678 408 408 query51 4155416341044104 query52 111 106 97 97 query53 231 267 180 180 query54 602 582 509 509 query55 88 82 86 82 query56 313 315 303 303 query57 1125114311061106 query58 261 256 248 248 query59 2614266025732573 query60 327 321 301 301 query61 129 123 128 123 query62 783 730 670 670 query63 220 190 181 181 query64 43951040721 721 query65 4350421242764212 query66 1158413 319 319 query67 15877 15683 15439 15439 query68 8593913 528 528 query69 485 324 272 272 query70 1189115010851085 query71 467 320 299 299 query72 5578476648474766 query73 753 661 360 360 query74 9130889591588895 query75 3987326427732773 query76 36441195790 790 query77 820 397 289 289 query78 10082 10185 92349234 query79 2669833 581 581 query80 643 534 458 458 query81 504 254 217 217 query82 523 128 97 97 query83 290 271 239 239 query84 296 105 90 90 query85 819 398 307 307 query86 403 323 282 282 query87 4351440243594359 query88 3354233023312330 query89 411 310 293 293 query90 1828225 222 222 query91 141 145 110 110 query92 89 64 58 58 query93 1835944 584 584 query94 685 420 303 303 query95 383 294 295 294 query96 504 582 283 283 query97 2724273926982698 query98 248 208 208 208 query99 1446138612971297 Total cold run time: 274886 ms Total hot run time: 186371 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2900841206 TPC-H: Total hot run time: 34096 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit ca6fb29f8dc2beada465a1b27159efede6177ffc, data reload: false -- Round 1 -- q1 26099 512351085108 q2 2080271 192 192 q3 10517 1270704 704 q4 10233 1010527 527 q5 7680239023362336 q6 186 166 136 136 q7 936 737 622 622 q8 9327125111071107 q9 6838513150895089 q10 6828232819031903 q11 482 293 273 273 q12 360 356 216 216 q13 17785 373031623162 q14 245 230 215 215 q15 551 498 517 498 q16 429 435 385 385 q17 619 844 377 377 q18 7479719670647064 q19 1456969 552 552 q20 342 331 226 226 q21 3958324724032403 q22 1069102410011001 Total cold run time: 115499 ms Total hot run time: 34096 ms - Round 2, with runtime_filter_mode=off - q1 5153511651445116 q2 235 324 225 225 q3 2183267023062306 q4 1390184214071407 q5 4590447143974397 q6 214 166 124 124 q7 1999190017161716 q8 2557252924842484 q9 7087703972197039 q10 3044317727882788 q11 573 503 488 488 q12 703 754 615 615 q13 3536391533443344 q14 295 311 274 274 q15 546 525 504 504 q16 464 484 437 437 q17 1150156713931393 q18 7660739874217398 q19 793 834 901 834 q20 1973202918901890 q21 5101451044554455 q22 1051104710021002 Total cold run time: 52297 ms Total hot run time: 50236 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2900587964 # Cloud UT Coverage Report Increment line coverage ` ` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/ca6fb29f8dc2beada465a1b27159efede6177ffc_ca6fb29f8dc2beada465a1b27159efede6177ffc_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/ca6fb29f8dc2beada465a1b27159efede6177ffc_ca6fb29f8dc2beada465a1b27159efede6177ffc_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 83.25% (1113/1337) | | Line Coverage | 66.14% (18668/28223) | | Region Coverage | 65.75% (9256/14077) | | Branch Coverage | 55.58% (4982/8964) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
suxiaogang223 commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2900515636 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
suxiaogang223 commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2900239323 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2899824508 ClickBench: Total hot run time: 29.79 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 52fa5c5962bbc72ffa38580cf8a1050eb0367689, data reload: false query1 0.040.030.03 query2 0.150.110.11 query3 0.340.200.20 query4 1.590.210.20 query5 0.480.450.45 query6 1.170.660.66 query7 0.020.010.02 query8 0.050.040.04 query9 0.630.530.52 query10 0.570.580.56 query11 0.260.120.13 query12 0.250.130.13 query13 0.640.610.63 query14 0.800.810.83 query15 0.950.870.86 query16 0.380.360.37 query17 1.051.071.06 query18 0.180.180.18 query19 2.001.821.82 query20 0.010.020.01 query21 15.40 0.990.67 query22 0.931.080.81 query23 14.68 1.530.77 query24 5.530.570.28 query25 0.170.090.08 query26 0.560.210.18 query27 0.090.080.08 query28 11.03 1.170.59 query29 12.54 4.013.42 query30 0.280.090.06 query31 2.800.630.44 query32 3.240.600.51 query33 3.143.113.14 query34 16.64 5.114.44 query35 4.484.454.50 query36 0.640.510.49 query37 0.200.170.17 query38 0.160.150.15 query39 0.050.050.05 query40 0.200.170.16 query41 0.110.050.05 query42 0.060.060.05 query43 0.050.040.04 Total cold run time: 104.54 s Total hot run time: 29.79 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2899818660 TPC-DS: Total hot run time: 193360 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 52fa5c5962bbc72ffa38580cf8a1050eb0367689, data reload: false query1 1423110010981098 query2 6154181918201819 query3 11006 442544774425 query4 53596 24450 23106 23106 query5 5280500 460 460 query6 349 200 206 200 query7 4949511 301 301 query8 323 258 242 242 query9 6166271127102710 query10 431 328 306 306 query11 15848 15006 14850 14850 query12 167 112 104 104 query13 1080546 455 455 query14 10216 655164386438 query15 208 198 190 190 query16 7143636 496 496 query17 1125773 607 607 query18 1605423 327 327 query19 207 208 181 181 query20 135 123 133 123 query21 207 137 123 123 query22 4431444343474347 query23 34183 33540 33585 33540 query24 6806244725002447 query25 469 454 425 425 query26 692 278 156 156 query27 2365507 342 342 query28 2929219821892189 query29 583 566 446 446 query30 280 224 191 191 query31 849 833 817 817 query32 80 65 64 64 query33 452 362 309 309 query34 776 848 551 551 query35 789 849 765 765 query36 956 1010896 896 query37 116 108 86 86 query38 4351430643164306 query39 1536146614461446 query40 207 124 110 110 query41 57 54 55 54 query42 129 119 106 106 query43 520 531 503 503 query44 1383852 871 852 query45 186 177 172 172 query46 874 1030678 678 query47 1826185518411841 query48 435 432 331 331 query49 712 526 445 445 query50 658 712 429 429 query51 4265434242374237 query52 113 112 109 109 query53 241 267 188 188 query54 593 584 524 524 query55 87 84 84 84 query56 319 304 321 304 query57 1193123410951095 query58 276 270 270 270 query59 2838279627932793 query60 342 353 333 333 query61 123 120 145 120 query62 747 739 719 719 query63 228 191 198 191 query64 14791012684 684 query65 4331423641924192 query66 722 393 310 310 query67 15724 15564 15314 15314 query68 7091876 533 533 query69 548 311 279 279 query70 1162113511361135 query71 497 301 292 292 query72 5803483749654837 query73 1346658 373 373 query74 9290917087578757 query75 3771317426862686 query76 42411276800 800 query77 623 379 283 283 query78 10069 10029 92859285 query79 5737830 567 567 query80 653 519 435 435 query81 498 264 217 217 query82 652 130 102 102 query83 347 246 236 236 query84 292 118 87 87 query85 795 386 301 301 query86 409 302 281 281 query87 4425445844134413 query88 3904234323222322 query89 450 328 279 279 query90 1790211 213 211 query91 145 145 112 112 query92 73 61 55 55 query93 3438942 577 577 query94 660 422 305 305 query95 375 299 294 294 query96 508 588 287 287 query97 2709270826562656 query98 235 226 212 212 query99 1439140912791279 Total cold run time: 304844 ms Total hot run time: 193360 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2899802997 TPC-H: Total hot run time: 34081 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 52fa5c5962bbc72ffa38580cf8a1050eb0367689, data reload: false -- Round 1 -- q1 26388 513450805080 q2 2090287 194 194 q3 10568 1312702 702 q4 10231 1014530 530 q5 7812236523492349 q6 183 163 133 133 q7 919 769 619 619 q8 9319135810911091 q9 6784509251265092 q10 6834232318921892 q11 500 279 273 273 q12 352 354 221 221 q13 17807 366630713071 q14 230 226 217 217 q15 520 476 500 476 q16 441 432 381 381 q17 590 859 379 379 q18 7875724572257225 q19 1502976 591 591 q20 325 338 231 231 q21 3821318823692369 q22 10621003965 965 Total cold run time: 116153 ms Total hot run time: 34081 ms - Round 2, with runtime_filter_mode=off - q1 5230518551355135 q2 239 335 234 234 q3 2161267422662266 q4 1356178814801480 q5 4446439644064396 q6 220 168 133 133 q7 1999194618071807 q8 2589260125192519 q9 7233717969716971 q10 3054315427912791 q11 573 528 500 500 q12 674 744 623 623 q13 3536391832783278 q14 285 300 272 272 q15 563 515 491 491 q16 445 490 442 442 q17 1138159013671367 q18 7898765776357635 q19 865 852 1117852 q20 2020195518421842 q21 4774454844714471 q22 1112108410691069 Total cold run time: 52410 ms Total hot run time: 50574 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
hello-stephen commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2899667854 # Cloud UT Coverage Report Increment line coverage ` ` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/52fa5c5962bbc72ffa38580cf8a1050eb0367689_52fa5c5962bbc72ffa38580cf8a1050eb0367689_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/52fa5c5962bbc72ffa38580cf8a1050eb0367689_52fa5c5962bbc72ffa38580cf8a1050eb0367689_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 83.25% (1113/1337) | | Line Coverage | 66.17% (18675/28223) | | Region Coverage | 65.79% (9261/14077) | | Branch Coverage | 55.63% (4987/8964) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
suxiaogang223 commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2899642989 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
suxiaogang223 commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2898179164 run external -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2895461058 TPC-DS: Total hot run time: 193265 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 998c86669cd6ff7910477c48607d3e52d5e13408, data reload: false query1 1395109810801080 query2 6342186518321832 query3 11138 464346604643 query4 25589 23951 23320 23320 query5 4369649 471 471 query6 312 218 219 218 query7 3998506 293 293 query8 311 248 251 248 query9 8501268826742674 query10 450 326 283 283 query11 15298 15173 14786 14786 query12 162 115 105 105 query13 1564559 412 412 query14 8807621762556217 query15 217 206 176 176 query16 7276646 490 490 query17 1192724 638 638 query18 2045439 324 324 query19 213 213 175 175 query20 129 127 118 118 query21 216 132 121 121 query22 4588453543004300 query23 34646 33950 33691 33691 query24 8468244024582440 query25 526 473 404 404 query26 1278281 151 151 query27 3186514 344 344 query28 4638217721812177 query29 743 575 451 451 query30 282 222 190 190 query31 930 881 795 795 query32 79 69 64 64 query33 545 410 324 324 query34 820 867 533 533 query35 801 848 734 734 query36 983 1014915 915 query37 115 104 79 79 query38 4298425542374237 query39 1524147314641464 query40 215 132 119 119 query41 65 57 54 54 query42 123 113 113 113 query43 520 529 485 485 query44 1344832 835 832 query45 191 179 171 171 query46 899 1030665 665 query47 1853186818321832 query48 432 453 320 320 query49 761 556 438 438 query50 709 717 421 421 query51 4272432441504150 query52 117 110 106 106 query53 238 268 194 194 query54 628 601 514 514 query55 87 90 91 90 query56 325 323 293 293 query57 1202125611391139 query58 279 267 271 267 query59 2713280526602660 query60 341 341 310 310 query61 131 133 125 125 query62 776 757 699 699 query63 231 198 226 198 query64 47291058711 711 query65 4443435343254325 query66 983 399 305 305 query67 15922 15650 15324 15324 query68 8650893 531 531 query69 499 308 269 269 query70 1231122911211121 query71 477 337 306 306 query72 5339467046434643 query73 681 579 360 360 query74 9314901890479018 query75 3813321126592659 query76 37561191767 767 query77 789 408 297 297 query78 10065 10266 93369336 query79 2144823 577 577 query80 603 508 487 487 query81 492 255 230 230 query82 460 125 98 98 query83 256 272 240 240 query84 246 99 93 93 query85 840 353 308 308 query86 380 297 279 279 query87 4470442943224322 query88 3620227422962274 query89 406 326 280 280 query90 1787216 204 204 query91 151 146 112 112 query92 76 63 61 61 query93 1695961 583 583 query94 665 400 306 306 query95 378 294 294 294 query96 499 571 281 281 query97 2702274526702670 query98 229 213 216 213 query99 1619139112691269 Total cold run time: 280835 ms Total hot run time: 193265 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2895474094 ClickBench: Total hot run time: 29.98 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 998c86669cd6ff7910477c48607d3e52d5e13408, data reload: false query1 0.030.030.03 query2 0.150.100.11 query3 0.340.200.20 query4 1.590.190.20 query5 0.470.460.47 query6 1.160.660.66 query7 0.020.020.02 query8 0.060.050.05 query9 0.620.520.52 query10 0.580.580.57 query11 0.260.130.12 query12 0.260.140.13 query13 0.630.620.63 query14 0.800.830.82 query15 0.960.880.89 query16 0.370.360.38 query17 1.091.071.09 query18 0.190.190.21 query19 2.051.841.86 query20 0.020.000.01 query21 15.40 0.980.68 query22 0.931.000.81 query23 14.70 1.550.77 query24 4.880.620.30 query25 0.160.100.09 query26 0.550.220.18 query27 0.080.080.08 query28 11.07 1.240.58 query29 12.54 4.123.43 query30 0.280.090.07 query31 2.850.660.43 query32 3.230.600.52 query33 3.143.123.07 query34 17.00 5.214.46 query35 4.514.534.55 query36 0.650.510.49 query37 0.200.180.18 query38 0.170.170.15 query39 0.050.050.04 query40 0.220.150.15 query41 0.100.060.06 query42 0.060.040.05 query43 0.050.050.04 Total cold run time: 104.47 s Total hot run time: 29.98 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2895430698 TPC-H: Total hot run time: 34143 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 998c86669cd6ff7910477c48607d3e52d5e13408, data reload: false -- Round 1 -- q1 26149 508551555085 q2 2063287 192 192 q3 10518 1354704 704 q4 10229 1031554 554 q5 7723232323812323 q6 188 169 132 132 q7 937 744 635 635 q8 9331130811571157 q9 6786515251145114 q10 6868233018911891 q11 500 290 276 276 q12 349 346 219 219 q13 17776 375431673167 q14 235 237 208 208 q15 526 488 493 488 q16 421 425 378 378 q17 583 850 376 376 q18 7756721971617161 q19 1877974 572 572 q20 322 332 216 216 q21 3799259823312331 q22 10501033964 964 Total cold run time: 115986 ms Total hot run time: 34143 ms - Round 2, with runtime_filter_mode=off - q1 5253510051175100 q2 246 332 233 233 q3 2137266622842284 q4 1392184814851485 q5 4437446143504350 q6 225 169 126 126 q7 1995190517741774 q8 2616258325292529 q9 7291704571697045 q10 3040320427862786 q11 588 508 500 500 q12 668 766 647 647 q13 3567391333613361 q14 283 313 279 279 q15 511 507 484 484 q16 464 484 460 460 q17 1187160213651365 q18 7765754973747374 q19 822 790 860 790 q20 1999196118381838 q21 4982455244544454 q22 1123105710561056 Total cold run time: 52591 ms Total hot run time: 50320 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2895177109 # Cloud UT Coverage Report Increment line coverage ` ` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/998c86669cd6ff7910477c48607d3e52d5e13408_998c86669cd6ff7910477c48607d3e52d5e13408_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/998c86669cd6ff7910477c48607d3e52d5e13408_998c86669cd6ff7910477c48607d3e52d5e13408_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 83.31% (1113/1336) | | Line Coverage | 66.23% (18667/28187) | | Region Coverage | 65.77% (9258/14076) | | Branch Coverage | 55.61% (4985/8964) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
suxiaogang223 commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2895087710 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2890893316 # BE UT Coverage Report Increment line coverage `11.74% (52/443)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/40558b979dafd05eeaca2d7be50b035491eb3d18_40558b979dafd05eeaca2d7be50b035491eb3d18/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/40558b979dafd05eeaca2d7be50b035491eb3d18_40558b979dafd05eeaca2d7be50b035491eb3d18/report/index.html) | Category | Coverage | |---|| | Function Coverage | 55.94% (14931/26691) | | Line Coverage | 44.76% (132492/296038) | | Region Coverage | 43.85% (66675/152052) | | Branch Coverage | 38.45% (34174/88872) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2890258713 # Cloud UT Coverage Report Increment line coverage ` ` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/40558b979dafd05eeaca2d7be50b035491eb3d18_40558b979dafd05eeaca2d7be50b035491eb3d18_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/40558b979dafd05eeaca2d7be50b035491eb3d18_40558b979dafd05eeaca2d7be50b035491eb3d18_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 83.31% (1113/1336) | | Line Coverage | 66.26% (18676/28187) | | Region Coverage | 65.86% (9270/14076) | | Branch Coverage | 55.67% (4990/8964) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
suxiaogang223 commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2890210311 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2877549038 TPC-DS: Total hot run time: 193836 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit ce0d08255e5ac9042d3c5272d45360605f1ea8d5, data reload: false query1 1409111510781078 query2 6213187918681868 query3 11064 443244924432 query4 57167 24218 23360 23360 query5 5076502 455 455 query6 404 218 202 202 query7 5119499 296 296 query8 333 269 243 243 query9 6775267127042671 query10 437 332 283 283 query11 15197 15062 14860 14860 query12 159 118 109 109 query13 1184542 413 413 query14 10165 642363416341 query15 208 206 179 179 query16 7122685 490 490 query17 1078729 595 595 query18 1622393 294 294 query19 195 203 169 169 query20 143 126 115 115 query21 213 126 113 113 query22 4486436242604260 query23 34237 33585 33630 33585 query24 6637244024532440 query25 471 471 402 402 query26 695 293 162 162 query27 2179531 350 350 query28 3123221821882188 query29 605 554 440 440 query30 275 222 201 201 query31 881 897 802 802 query32 73 66 69 66 query33 466 395 307 307 query34 784 889 541 541 query35 798 847 766 766 query36 927 1002907 907 query37 113 105 80 80 query38 4205427341644164 query39 1548143614591436 query40 218 135 117 117 query41 60 57 57 57 query42 128 117 112 112 query43 525 519 502 502 query44 1374872 881 872 query45 183 177 172 172 query46 886 1045668 668 query47 1817183618101810 query48 409 443 333 333 query49 747 527 442 442 query50 680 724 410 410 query51 4233428843314288 query52 118 110 103 103 query53 234 261 197 197 query54 600 585 530 530 query55 86 86 88 86 query56 312 307 299 299 query57 1156115011401140 query58 280 259 261 259 query59 2849289926852685 query60 352 342 326 326 query61 130 123 121 121 query62 739 796 683 683 query63 236 205 204 204 query64 16611054743 743 query65 4294422442144214 query66 713 396 311 311 query67 15861 15680 15313 15313 query68 7559910 538 538 query69 534 323 268 268 query70 1222108811051088 query71 504 318 308 308 query72 5990481349194813 query73 1281639 361 361 query74 9110907389988998 query75 3837327027282728 query76 42911194767 767 query77 712 435 301 301 query78 10035 10213 93169316 query79 2301825 590 590 query80 636 499 463 463 query81 481 249 224 224 query82 420 133 98 98 query83 382 253 227 227 query84 297 100 84 84 query85 817 360 325 325 query86 390 290 276 276 query87 4400453143524352 query88 3243229623272296 query89 400 316 286 286 query90 1940206 208 206 query91 141 141 111 111 query92 73 62 52 52 query93 1148962 587 587 query94 693 405 303 303 query95 366 296 276 276 query96 508 575 282 282 query97 3225322131143114 query98 226 217 210 210 query99 1413141513281328 Total cold run time: 303242 ms Total hot run time: 193836 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2877561343 ClickBench: Total hot run time: 29.88 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit ce0d08255e5ac9042d3c5272d45360605f1ea8d5, data reload: false query1 0.040.040.03 query2 0.140.120.11 query3 0.340.200.19 query4 1.600.220.07 query5 0.550.530.54 query6 1.170.720.73 query7 0.020.020.01 query8 0.050.050.05 query9 0.620.520.53 query10 0.560.580.58 query11 0.250.130.13 query12 0.260.140.14 query13 0.630.610.62 query14 0.800.810.82 query15 0.970.880.88 query16 0.370.380.36 query17 1.061.041.06 query18 0.190.190.18 query19 1.991.831.91 query20 0.010.010.02 query21 15.41 0.960.66 query22 0.931.040.77 query23 14.70 1.520.78 query24 5.530.540.27 query25 0.170.090.08 query26 0.570.220.18 query27 0.080.080.08 query28 11.00 1.200.59 query29 12.62 4.113.46 query30 0.280.090.06 query31 2.800.650.42 query32 3.230.590.49 query33 3.053.083.12 query34 16.64 5.084.54 query35 4.404.464.46 query36 0.640.510.50 query37 0.190.170.18 query38 0.170.160.16 query39 0.040.040.05 query40 0.190.160.15 query41 0.110.050.04 query42 0.060.060.05 query43 0.060.050.05 Total cold run time: 104.49 s Total hot run time: 29.88 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2877176943 # Cloud UT Coverage Report Increment line coverage ` ` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/ce0d08255e5ac9042d3c5272d45360605f1ea8d5_ce0d08255e5ac9042d3c5272d45360605f1ea8d5_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/ce0d08255e5ac9042d3c5272d45360605f1ea8d5_ce0d08255e5ac9042d3c5272d45360605f1ea8d5_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 83.15% (1105/1329) | | Line Coverage | 66.05% (18610/28175) | | Region Coverage | 65.59% (9259/14117) | | Branch Coverage | 55.40% (4987/9002) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
suxiaogang223 commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2877125995 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2875647259 ClickBench: Total hot run time: 29.85 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit ce8b7c5f5c3badd342ea0b9eed0829071994960c, data reload: false query1 0.040.040.02 query2 0.150.110.11 query3 0.340.200.20 query4 1.600.210.09 query5 0.550.550.55 query6 1.200.730.72 query7 0.020.010.02 query8 0.050.050.07 query9 0.620.520.52 query10 0.570.570.56 query11 0.260.140.13 query12 0.260.130.13 query13 0.620.620.62 query14 0.800.820.83 query15 0.960.890.87 query16 0.370.370.37 query17 1.061.021.06 query18 0.180.180.17 query19 2.041.851.84 query20 0.010.020.01 query21 15.43 0.970.68 query22 0.941.020.83 query23 14.69 1.530.78 query24 5.150.600.30 query25 0.160.100.08 query26 0.560.220.19 query27 0.080.080.09 query28 10.99 1.210.59 query29 12.56 4.123.41 query30 0.280.090.07 query31 2.820.630.42 query32 3.240.600.50 query33 3.113.073.18 query34 16.38 5.164.43 query35 4.504.454.47 query36 0.630.510.49 query37 0.190.170.17 query38 0.170.170.15 query39 0.050.050.05 query40 0.180.170.16 query41 0.100.050.05 query42 0.060.040.05 query43 0.050.050.05 Total cold run time: 104.02 s Total hot run time: 29.85 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2875631217 TPC-DS: Total hot run time: 194789 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit ce8b7c5f5c3badd342ea0b9eed0829071994960c, data reload: false query1 1408107810811078 query2 6294184718141814 query3 11053 455845294529 query4 54969 24247 23460 23460 query5 4957552 489 489 query6 360 215 211 211 query7 4910523 306 306 query8 327 251 250 250 query9 5702267826742674 query10 455 341 272 272 query11 15050 15109 14918 14918 query12 164 114 100 100 query13 1043529 396 396 query14 10199 640365116403 query15 200 208 174 174 query16 7108663 490 490 query17 1097732 565 565 query18 1617414 317 317 query19 202 200 160 160 query20 122 126 123 123 query21 210 124 111 111 query22 4466452343304330 query23 34273 33581 33630 33581 query24 6568245224392439 query25 525 528 443 443 query26 679 287 159 159 query27 2382533 349 349 query28 2918222121912191 query29 622 609 522 522 query30 280 223 191 191 query31 867 863 797 797 query32 72 66 59 59 query33 455 395 319 319 query34 801 866 561 561 query35 787 851 741 741 query36 940 1006917 917 query37 113 100 77 77 query38 4243432341934193 query39 1547143714601437 query40 221 124 108 108 query41 54 52 52 52 query42 122 119 110 110 query43 488 509 488 488 query44 1369863 859 859 query45 176 176 179 176 query46 871 1050717 717 query47 1915190517641764 query48 394 419 332 332 query49 692 525 459 459 query50 664 697 423 423 query51 4291444743014301 query52 103 108 104 104 query53 243 265 192 192 query54 606 592 538 538 query55 90 84 86 84 query56 331 309 288 288 query57 1177121311311131 query58 264 257 253 253 query59 2742273826562656 query60 335 330 336 330 query61 136 128 129 128 query62 759 730 701 701 query63 225 232 194 194 query64 17321056697 697 query65 4331424642124212 query66 733 400 305 305 query67 15887 15692 15643 15643 query68 6857835 525 525 query69 540 316 285 285 query70 1241107211341072 query71 486 332 304 304 query72 5789498149734973 query73 1435684 370 370 query74 9331892689208920 query75 3940323027342734 query76 43161279779 779 query77 663 366 302 302 query78 10214 10318 93139313 query79 2147817 584 584 query80 598 506 442 442 query81 500 253 222 222 query82 468 130 104 104 query83 259 271 239 239 query84 297 100 85 85 query85 774 360 316 316 query86 374 301 251 251 query87 4413459844114411 query88 3739235723332333 query89 417 319 293 293 query90 1843206 214 206 query91 142 142 118 118 query92 82 60 58 58 query93 1737932 580 580 query94 670 420 314 314 query95 365 297 286 286 query96 509 562 291 291 query97 3164324631713171 query98 227 207 201 201 query99 1416139713161316 Total cold run time: 299889 ms Total hot run time: 194789 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2875592765 TPC-H: Total hot run time: 34006 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit ce8b7c5f5c3badd342ea0b9eed0829071994960c, data reload: false -- Round 1 -- q1 26572 505450895054 q2 2097292 208 208 q3 10529 1307689 689 q4 10231 1002531 531 q5 7799239623212321 q6 179 166 138 138 q7 920 740 614 614 q8 9302126510971097 q9 6805516351915163 q10 6835233519111911 q11 487 294 274 274 q12 349 350 223 223 q13 17787 367631153115 q14 245 223 217 217 q15 528 485 481 481 q16 434 447 381 381 q17 602 871 358 358 q18 7726719170167016 q19 2164984 572 572 q20 329 320 229 229 q21 3930263524392439 q22 10381027975 975 Total cold run time: 116888 ms Total hot run time: 34006 ms - Round 2, with runtime_filter_mode=off - q1 5200508351055083 q2 248 326 231 231 q3 2191269723022302 q4 1356181314851485 q5 4454437744234377 q6 220 169 130 130 q7 2015195717801780 q8 2592266125432543 q9 7351713570357035 q10 3022321527732773 q11 584 526 497 497 q12 669 748 627 627 q13 3481395832893289 q14 286 307 288 288 q15 535 499 506 499 q16 434 493 436 436 q17 1155157614821482 q18 7779761274827482 q19 792 760 819 760 q20 2019200518691869 q21 5295470947244709 q22 1120107010131013 Total cold run time: 52798 ms Total hot run time: 50690 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
suxiaogang223 commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2875284252 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2875346594 # Cloud UT Coverage Report Increment line coverage ` ` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/ce8b7c5f5c3badd342ea0b9eed0829071994960c_ce8b7c5f5c3badd342ea0b9eed0829071994960c_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/ce8b7c5f5c3badd342ea0b9eed0829071994960c_ce8b7c5f5c3badd342ea0b9eed0829071994960c_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 83.20% (1104/1327) | | Line Coverage | 66.11% (18600/28136) | | Region Coverage | 65.68% (9259/14098) | | Branch Coverage | 55.44% (4980/8982) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
hello-stephen commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2875267488 # Cloud UT Coverage Report Increment line coverage ` ` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/f75ee7ab79d79a9234b6f57fbb1812e137a1d560_f75ee7ab79d79a9234b6f57fbb1812e137a1d560_cloud/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/f75ee7ab79d79a9234b6f57fbb1812e137a1d560_f75ee7ab79d79a9234b6f57fbb1812e137a1d560_cloud/report/index.html) | Category | Coverage | |---|| | Function Coverage | 83.20% (1104/1327) | | Line Coverage | 66.12% (18603/28136) | | Region Coverage | 65.68% (9260/14098) | | Branch Coverage | 55.40% (4976/8982) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
suxiaogang223 commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2875232000 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
suxiaogang223 commented on code in PR #50379:
URL: https://github.com/apache/doris/pull/50379#discussion_r2086029446
##
fe/fe-core/src/main/java/org/apache/doris/datasource/LoadScanProvider.java:
##
@@ -97,7 +96,8 @@ public FileLoadScanNode.ParamCreateContext
createContext(Analyzer analyzer) thro
}
if (fileGroupInfo.getFileGroup().getFileFormat() != null
&&
fileGroupInfo.getFileGroup().getFileFormat().equals("hive_text")) {
-params.setTextSerdeType(TTextSerdeType.HIVE_TEXT_SERDE);
+// TODO: set correct format type for load job
Review Comment:
fixed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
suxiaogang223 commented on code in PR #50379:
URL: https://github.com/apache/doris/pull/50379#discussion_r2080873651
##
be/src/vec/exec/format/csv/csv_reader.cpp:
##
@@ -395,14 +328,10 @@ Status CsvReader::init_reader(bool is_load) {
if (_enclose == 0) {
text_line_reader_ctx = std::make_shared(
_line_delimiter, _line_delimiter_length, _keep_cr);
-if (_text_serde_type == TTextSerdeType::HIVE_TEXT_SERDE) {
-_fields_splitter = std::make_unique(
-_trim_tailing_spaces, false, _value_separator,
_value_separator_length, -1,
-_escape);
-} else {
-_fields_splitter = std::make_unique(
-_trim_tailing_spaces, false, _value_separator,
_value_separator_length, -1);
-}
+// TODO: make sure what table this splitter is used for
Review Comment:
Just forget to rm this
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
suxiaogang223 commented on code in PR #50379:
URL: https://github.com/apache/doris/pull/50379#discussion_r2080873385
##
be/src/vec/exec/format/csv/csv_reader.cpp:
##
@@ -649,11 +577,10 @@ Status CsvReader::_fill_dest_columns(const Slice& line,
Block* block,
for (int i = 0; i < _file_slot_descs.size(); ++i) {
int col_idx = _col_idxs[i];
-// col idx is out of range, fill with null.
-const Slice& value = col_idx < _split_values.size()
- ? _split_values[col_idx]
- : Slice {_options.null_format,
_options.null_len};
-Slice slice {value.data, value.size};
+// col idx is out of range, fill with null format
+auto value = col_idx < _split_values.size()
+ ? _split_values[col_idx]
+ : Slice(_options.null_format, _options.null_len);
Review Comment:
In the process of doris load csv, "\\N" is hard-coded as a null value, but
there is no null value in the opencsv format of hive, and empty strings are
used to fill non-existent columns. When reading the hive csv table here,
null_format will be an empty string, and null_len will be 0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](hive) Refactor csv reader [doris]
doris-robot commented on PR #50379: URL: https://github.com/apache/doris/pull/50379#issuecomment-2864078504 TPC-DS: Total hot run time: 184987 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit e3ab06d3022d325590a75717a047bb43aad698c9, data reload: false query1 1050472 491 472 query2 6559178818101788 query3 6748222 217 217 query4 26151 23769 22954 22954 query5 4348611 506 506 query6 291 198 191 191 query7 4622484 273 273 query8 286 234 224 224 query9 8608252025422520 query10 468 319 267 267 query11 15382 15014 14783 14783 query12 161 109 105 105 query13 1659543 384 384 query14 8737630161576157 query15 204 195 165 165 query16 7147624 460 460 query17 1164742 578 578 query18 1967411 300 300 query19 194 189 161 161 query20 121 121 116 116 query21 216 136 105 105 query22 3993433840614061 query23 33885 33040 32891 32891 query24 8463247223952395 query25 551 441 375 375 query26 1235272 159 159 query27 2741490 327 327 query28 4324207320492049 query29 794 542 468 468 query30 283 211 183 183 query31 924 882 741 741 query32 73 65 68 65 query33 550 365 295 295 query34 823 837 525 525 query35 766 822 742 742 query36 954 962 894 894 query37 108 101 77 77 query38 4214417841244124 query39 1448139813881388 query40 212 121 107 107 query41 57 58 52 52 query42 118 112 106 106 query43 501 504 467 467 query44 1252782 776 776 query45 177 176 170 170 query46 825 1007619 619 query47 1778178917241724 query48 374 410 317 317 query49 785 485 422 422 query50 658 690 406 406 query51 3995411940874087 query52 113 107 98 98 query53 225 258 179 179 query54 594 566 495 495 query55 83 79 83 79 query56 297 327 303 303 query57 1141114710781078 query58 261 256 249 249 query59 2612267024662466 query60 327 313 301 301 query61 131 122 123 122 query62 796 727 676 676 query63 229 181 184 181 query64 4372995 696 696 query65 4316423942274227 query66 1168438 314 314 query67 15566 15471 15366 15366 query68 8626920 517 517 query69 465 300 267 267 query70 1204111310851085 query71 456 316 280 280 query72 5767483647124712 query73 756 683 350 350 query74 9173906087458745 query75 3884316626512651 query76 36951198759 759 query77 780 408 284 284 query78 10060 987693079307 query79 4767822 541 541 query80 712 527 449 449 query81 478 255 220 220 query82 636 132 96 96 query83 280 255 237 237 query84 301 110 91 91 query85 801 353 313 313 query86 395 307 290 290 query87 4526446842824282 query88 3505219222752192 query89 446 318 285 285 query90 1846217 219 217 query91 154 143 113 113 query92 69 62 60 60 query93 3395934 576 576 query94 670 407 312 312 query95 381 297 302 297 query96 488 593 282 282 query97 3183320631113111 query98 257 206 214 206 query99 1441141012921292 Total cold run time: 278772 ms Total hot run time: 184987 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
