huaxingao removed a comment on pull request #32473: URL: https://github.com/apache/spark/pull/32473#issuecomment-835899102
jdk8 ``` ================================================================================================ Parquet Read ================================================================================================ OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1046-azure Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Without bloom filter, blocksize: 524288 1035 1039 6 96.7 10.3 1.0X With bloom filter, blocksize: 524288 848 878 26 117.9 8.5 1.2X ================================================================================================ Parquet Read ================================================================================================ OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1046-azure Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Without bloom filter, blocksize: 1048576 998 1012 21 100.2 10.0 1.0X With bloom filter, blocksize: 1048576 459 484 29 218.1 4.6 2.2X ================================================================================================ Parquet Read ================================================================================================ OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1046-azure Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Without bloom filter, blocksize: 2097152 948 961 18 105.5 9.5 1.0X With bloom filter, blocksize: 2097152 275 288 13 363.3 2.8 3.4X ================================================================================================ Parquet Read ================================================================================================ OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1046-azure Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Without bloom filter, blocksize: 3145728 953 964 11 104.9 9.5 1.0X With bloom filter, blocksize: 3145728 223 236 16 448.3 2.2 4.3X ================================================================================================ Parquet Read ================================================================================================ OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1046-azure Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Without bloom filter, blocksize: 4194304 945 966 18 105.8 9.5 1.0X With bloom filter, blocksize: 4194304 195 209 15 511.8 2.0 4.8X ================================================================================================ Parquet Read ================================================================================================ OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1046-azure Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Without bloom filter, blocksize: 5242880 984 996 13 101.7 9.8 1.0X With bloom filter, blocksize: 5242880 214 224 12 468.1 2.1 4.6X ================================================================================================ Parquet Read ================================================================================================ OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1046-azure Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Without bloom filter, blocksize: 6291456 978 996 19 102.3 9.8 1.0X With bloom filter, blocksize: 6291456 281 289 10 355.6 2.8 3.5X ================================================================================================ Parquet Read ================================================================================================ OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1046-azure Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Without bloom filter, blocksize: 7340032 989 1008 19 101.1 9.9 1.0X With bloom filter, blocksize: 7340032 337 345 6 296.8 3.4 2.9X ================================================================================================ Parquet Read ================================================================================================ OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1046-azure Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Without bloom filter, blocksize: 8388608 1005 1011 8 99.5 10.0 1.0X With bloom filter, blocksize: 8388608 385 404 20 259.6 3.9 2.6X ================================================================================================ Parquet Read ================================================================================================ OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1046-azure Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Without bloom filter, blocksize: 9437184 992 1002 14 100.8 9.9 1.0X With bloom filter, blocksize: 9437184 521 538 16 191.9 5.2 1.9X ================================================================================================ Parquet Read ================================================================================================ OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1046-azure Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- Without bloom filter, blocksize: 10485760 969 998 27 103.2 9.7 1.0X With bloom filter, blocksize: 10485760 487 510 16 205.3 4.9 2.0X ``` jdk11 ``` ================================================================================================ Parquet Read ================================================================================================ OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Without bloom filter, blocksize: 524288 1214 1328 161 82.4 12.1 1.0X With bloom filter, blocksize: 524288 1192 1358 235 83.9 11.9 1.0X ================================================================================================ Parquet Read ================================================================================================ OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Without bloom filter, blocksize: 1048576 1114 1146 45 89.8 11.1 1.0X With bloom filter, blocksize: 1048576 634 705 123 157.8 6.3 1.8X ================================================================================================ Parquet Read ================================================================================================ OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Without bloom filter, blocksize: 2097152 1071 1099 40 93.4 10.7 1.0X With bloom filter, blocksize: 2097152 468 484 10 213.6 4.7 2.3X ================================================================================================ Parquet Read ================================================================================================ OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Without bloom filter, blocksize: 3145728 1081 1103 32 92.5 10.8 1.0X With bloom filter, blocksize: 3145728 332 369 44 301.6 3.3 3.3X ================================================================================================ Parquet Read ================================================================================================ OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Without bloom filter, blocksize: 4194304 1057 1070 20 94.7 10.6 1.0X With bloom filter, blocksize: 4194304 295 342 31 339.3 2.9 3.6X ================================================================================================ Parquet Read ================================================================================================ OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Without bloom filter, blocksize: 5242880 1006 1049 60 99.4 10.1 1.0X With bloom filter, blocksize: 5242880 237 278 22 422.5 2.4 4.3X ================================================================================================ Parquet Read ================================================================================================ OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Without bloom filter, blocksize: 6291456 988 1040 74 101.2 9.9 1.0X With bloom filter, blocksize: 6291456 268 305 27 373.6 2.7 3.7X ================================================================================================ Parquet Read ================================================================================================ OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Without bloom filter, blocksize: 7340032 1004 1031 38 99.6 10.0 1.0X With bloom filter, blocksize: 7340032 476 547 60 210.2 4.8 2.1X ================================================================================================ Parquet Read ================================================================================================ OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Without bloom filter, blocksize: 8388608 1452 1469 25 68.9 14.5 1.0X With bloom filter, blocksize: 8388608 658 677 17 152.0 6.6 2.2X ================================================================================================ Parquet Read ================================================================================================ OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ Without bloom filter, blocksize: 9437184 1456 1477 30 68.7 14.6 1.0X With bloom filter, blocksize: 9437184 779 825 40 128.4 7.8 1.9X ================================================================================================ Parquet Read ================================================================================================ OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- Without bloom filter, blocksize: 10485760 1472 1474 3 68.0 14.7 1.0X With bloom filter, blocksize: 10485760 777 830 65 128.7 7.8 1.9X ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org