huaxingao commented on pull request #32473:
URL: https://github.com/apache/spark/pull/32473#issuecomment-835899102
jdk8
```
================================================================================================
Parquet Read
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Read a row from 100M rows: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Without bloom filter, blocksize: 524288 1035 1039
6 96.7 10.3 1.0X
With bloom filter, blocksize: 524288 848 878
26 117.9 8.5 1.2X
================================================================================================
Parquet Read
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Read a row from 100M rows: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Without bloom filter, blocksize: 1048576 998 1012
21 100.2 10.0 1.0X
With bloom filter, blocksize: 1048576 459 484
29 218.1 4.6 2.2X
================================================================================================
Parquet Read
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Read a row from 100M rows: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Without bloom filter, blocksize: 2097152 948 961
18 105.5 9.5 1.0X
With bloom filter, blocksize: 2097152 275 288
13 363.3 2.8 3.4X
================================================================================================
Parquet Read
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Read a row from 100M rows: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Without bloom filter, blocksize: 3145728 953 964
11 104.9 9.5 1.0X
With bloom filter, blocksize: 3145728 223 236
16 448.3 2.2 4.3X
================================================================================================
Parquet Read
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Read a row from 100M rows: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Without bloom filter, blocksize: 4194304 945 966
18 105.8 9.5 1.0X
With bloom filter, blocksize: 4194304 195 209
15 511.8 2.0 4.8X
================================================================================================
Parquet Read
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Read a row from 100M rows: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Without bloom filter, blocksize: 5242880 984 996
13 101.7 9.8 1.0X
With bloom filter, blocksize: 5242880 214 224
12 468.1 2.1 4.6X
================================================================================================
Parquet Read
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Read a row from 100M rows: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Without bloom filter, blocksize: 6291456 978 996
19 102.3 9.8 1.0X
With bloom filter, blocksize: 6291456 281 289
10 355.6 2.8 3.5X
================================================================================================
Parquet Read
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Read a row from 100M rows: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Without bloom filter, blocksize: 7340032 989 1008
19 101.1 9.9 1.0X
With bloom filter, blocksize: 7340032 337 345
6 296.8 3.4 2.9X
================================================================================================
Parquet Read
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Read a row from 100M rows: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Without bloom filter, blocksize: 8388608 1005 1011
8 99.5 10.0 1.0X
With bloom filter, blocksize: 8388608 385 404
20 259.6 3.9 2.6X
================================================================================================
Parquet Read
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Read a row from 100M rows: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Without bloom filter, blocksize: 9437184 992 1002
14 100.8 9.9 1.0X
With bloom filter, blocksize: 9437184 521 538
16 191.9 5.2 1.9X
================================================================================================
Parquet Read
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Read a row from 100M rows: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
Without bloom filter, blocksize: 10485760 969 998
27 103.2 9.7 1.0X
With bloom filter, blocksize: 10485760 487 510
16 205.3 4.9 2.0X
```
jdk11
```
================================================================================================
Parquet Read
================================================================================================
OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Read a row from 100M rows: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Without bloom filter, blocksize: 524288 1214 1328
161 82.4 12.1 1.0X
With bloom filter, blocksize: 524288 1192 1358
235 83.9 11.9 1.0X
================================================================================================
Parquet Read
================================================================================================
OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Read a row from 100M rows: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Without bloom filter, blocksize: 1048576 1114 1146
45 89.8 11.1 1.0X
With bloom filter, blocksize: 1048576 634 705
123 157.8 6.3 1.8X
================================================================================================
Parquet Read
================================================================================================
OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Read a row from 100M rows: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Without bloom filter, blocksize: 2097152 1071 1099
40 93.4 10.7 1.0X
With bloom filter, blocksize: 2097152 468 484
10 213.6 4.7 2.3X
================================================================================================
Parquet Read
================================================================================================
OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Read a row from 100M rows: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Without bloom filter, blocksize: 3145728 1081 1103
32 92.5 10.8 1.0X
With bloom filter, blocksize: 3145728 332 369
44 301.6 3.3 3.3X
================================================================================================
Parquet Read
================================================================================================
OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Read a row from 100M rows: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Without bloom filter, blocksize: 4194304 1057 1070
20 94.7 10.6 1.0X
With bloom filter, blocksize: 4194304 295 342
31 339.3 2.9 3.6X
================================================================================================
Parquet Read
================================================================================================
OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Read a row from 100M rows: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Without bloom filter, blocksize: 5242880 1006 1049
60 99.4 10.1 1.0X
With bloom filter, blocksize: 5242880 237 278
22 422.5 2.4 4.3X
================================================================================================
Parquet Read
================================================================================================
OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Read a row from 100M rows: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Without bloom filter, blocksize: 6291456 988 1040
74 101.2 9.9 1.0X
With bloom filter, blocksize: 6291456 268 305
27 373.6 2.7 3.7X
================================================================================================
Parquet Read
================================================================================================
OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Read a row from 100M rows: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Without bloom filter, blocksize: 7340032 1004 1031
38 99.6 10.0 1.0X
With bloom filter, blocksize: 7340032 476 547
60 210.2 4.8 2.1X
================================================================================================
Parquet Read
================================================================================================
OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Read a row from 100M rows: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Without bloom filter, blocksize: 8388608 1452 1469
25 68.9 14.5 1.0X
With bloom filter, blocksize: 8388608 658 677
17 152.0 6.6 2.2X
================================================================================================
Parquet Read
================================================================================================
OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Read a row from 100M rows: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Without bloom filter, blocksize: 9437184 1456 1477
30 68.7 14.6 1.0X
With bloom filter, blocksize: 9437184 779 825
40 128.4 7.8 1.9X
================================================================================================
Parquet Read
================================================================================================
OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Read a row from 100M rows: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
Without bloom filter, blocksize: 10485760 1472 1474
3 68.0 14.7 1.0X
With bloom filter, blocksize: 10485760 777 830
65 128.7 7.8 1.9X
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
