Github user gengliangwang commented on a diff in the pull request:
https://github.com/apache/spark/pull/22965#discussion_r231765680
--- Diff: sql/core/benchmarks/DataSourceReadBenchmark-results.txt ---
@@ -2,268 +2,268 @@
SQL Single Numeric Column Scan
================================================================================================
-OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
-Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
+Java HotSpot(TM) 64-Bit Server VM 1.8.0_131-b11 on Mac OS X 10.13.6
+Intel(R) Core(TM) i7-6920HQ CPU @ 2.90GHz
SQL Single TINYINT Column Scan: Best/Avg Time(ms) Rate(M/s)
Per Row(ns) Relative
------------------------------------------------------------------------------------------------
-SQL CSV 21508 / 22112 0.7
1367.5 1.0X
-SQL Json 8705 / 8825 1.8
553.4 2.5X
-SQL Parquet Vectorized 157 / 186 100.0
10.0 136.7X
-SQL Parquet MR 1789 / 1794 8.8
113.8 12.0X
-SQL ORC Vectorized 156 / 166 100.9
9.9 138.0X
-SQL ORC Vectorized with copy 218 / 225 72.1
13.9 98.6X
-SQL ORC MR 1448 / 1492 10.9
92.0 14.9X
-
-OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
-Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
+SQL CSV 15974 / 16222 1.0
1015.6 1.0X
+SQL Json 5917 / 6174 2.7
376.2 2.7X
+SQL Parquet Vectorized 115 / 128 136.8
7.3 138.9X
+SQL Parquet MR 1459 / 1571 10.8
92.8 10.9X
+SQL ORC Vectorized 164 / 194 95.8
10.4 97.3X
+SQL ORC Vectorized with copy 204 / 303 77.2
12.9 78.4X
+SQL ORC MR 1095 / 1143 14.4
69.6 14.6X
+
+Java HotSpot(TM) 64-Bit Server VM 1.8.0_131-b11 on Mac OS X 10.13.6
+Intel(R) Core(TM) i7-6920HQ CPU @ 2.90GHz
Parquet Reader Single TINYINT Column Scan: Best/Avg Time(ms) Rate(M/s)
Per Row(ns) Relative
------------------------------------------------------------------------------------------------
-ParquetReader Vectorized 202 / 211 77.7
12.9 1.0X
-ParquetReader Vectorized -> Row 118 / 120 133.5
7.5 1.7X
+ParquetReader Vectorized 139 / 156 113.1
8.8 1.0X
+ParquetReader Vectorized -> Row 83 / 89 188.7
5.3 1.7X
-OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
-Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
+Java HotSpot(TM) 64-Bit Server VM 1.8.0_131-b11 on Mac OS X 10.13.6
+Intel(R) Core(TM) i7-6920HQ CPU @ 2.90GHz
SQL Single SMALLINT Column Scan: Best/Avg Time(ms) Rate(M/s)
Per Row(ns) Relative
------------------------------------------------------------------------------------------------
-SQL CSV 23282 / 23312 0.7
1480.2 1.0X
-SQL Json 9187 / 9189 1.7
584.1 2.5X
-SQL Parquet Vectorized 204 / 218 77.0
13.0 114.0X
-SQL Parquet MR 1941 / 1953 8.1
123.4 12.0X
-SQL ORC Vectorized 217 / 225 72.6
13.8 107.5X
-SQL ORC Vectorized with copy 279 / 289 56.3
17.8 83.4X
-SQL ORC MR 1541 / 1549 10.2
98.0 15.1X
-
-OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
-Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
+SQL CSV 16394 / 16643 1.0
1042.3 1.0X
+SQL Json 6014 / 6020 2.6
382.4 2.7X
+SQL Parquet Vectorized 147 / 155 106.9
9.4 111.4X
+SQL Parquet MR 1575 / 1581 10.0
100.1 10.4X
+SQL ORC Vectorized 168 / 173 93.9
10.7 97.9X
+SQL ORC Vectorized with copy 219 / 227 71.8
13.9 74.8X
+SQL ORC MR 1185 / 1187 13.3
75.3 13.8X
+
+Java HotSpot(TM) 64-Bit Server VM 1.8.0_131-b11 on Mac OS X 10.13.6
+Intel(R) Core(TM) i7-6920HQ CPU @ 2.90GHz
Parquet Reader Single SMALLINT Column Scan: Best/Avg Time(ms) Rate(M/s)
Per Row(ns) Relative
------------------------------------------------------------------------------------------------
-ParquetReader Vectorized 288 / 297 54.6
18.3 1.0X
-ParquetReader Vectorized -> Row 255 / 257 61.7
16.2 1.1X
+ParquetReader Vectorized 193 / 216 81.4
12.3 1.0X
+ParquetReader Vectorized -> Row 160 / 175 98.3
10.2 1.2X
-OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
-Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
+Java HotSpot(TM) 64-Bit Server VM 1.8.0_131-b11 on Mac OS X 10.13.6
+Intel(R) Core(TM) i7-6920HQ CPU @ 2.90GHz
SQL Single INT Column Scan: Best/Avg Time(ms) Rate(M/s)
Per Row(ns) Relative
------------------------------------------------------------------------------------------------
-SQL CSV 24990 / 25012 0.6
1588.8 1.0X
-SQL Json 9837 / 9865 1.6
625.4 2.5X
-SQL Parquet Vectorized 170 / 180 92.3
10.8 146.6X
-SQL Parquet MR 2319 / 2328 6.8
147.4 10.8X
-SQL ORC Vectorized 293 / 301 53.7
18.6 85.3X
-SQL ORC Vectorized with copy 297 / 309 52.9
18.9 84.0X
-SQL ORC MR 1667 / 1674 9.4
106.0 15.0X
-
-OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
-Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
+SQL CSV 17168 / 17306 0.9
1091.5 1.0X
+SQL Json 6167 / 6180 2.6
392.1 2.8X
+SQL Parquet Vectorized 134 / 142 117.5
8.5 128.2X
+SQL Parquet MR 1659 / 1740 9.5
105.5 10.3X
+SQL ORC Vectorized 225 / 229 69.9
14.3 76.3X
+SQL ORC Vectorized with copy 231 / 235 68.2
14.7 74.4X
+SQL ORC MR 1287 / 1388 12.2
81.8 13.3X
+
+Java HotSpot(TM) 64-Bit Server VM 1.8.0_131-b11 on Mac OS X 10.13.6
+Intel(R) Core(TM) i7-6920HQ CPU @ 2.90GHz
Parquet Reader Single INT Column Scan: Best/Avg Time(ms) Rate(M/s)
Per Row(ns) Relative
------------------------------------------------------------------------------------------------
-ParquetReader Vectorized 257 / 274 61.3
16.3 1.0X
-ParquetReader Vectorized -> Row 259 / 264 60.8
16.4 1.0X
+ParquetReader Vectorized 178 / 187 88.2
11.3 1.0X
+ParquetReader Vectorized -> Row 174 / 184 90.3
11.1 1.0X
-OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
-Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
+Java HotSpot(TM) 64-Bit Server VM 1.8.0_131-b11 on Mac OS X 10.13.6
+Intel(R) Core(TM) i7-6920HQ CPU @ 2.90GHz
SQL Single BIGINT Column Scan: Best/Avg Time(ms) Rate(M/s)
Per Row(ns) Relative
------------------------------------------------------------------------------------------------
-SQL CSV 32537 / 32554 0.5
2068.7 1.0X
-SQL Json 12610 / 12668 1.2
801.7 2.6X
-SQL Parquet Vectorized 258 / 276 61.0
16.4 126.2X
-SQL Parquet MR 2422 / 2435 6.5
154.0 13.4X
-SQL ORC Vectorized 378 / 385 41.6
24.0 86.2X
-SQL ORC Vectorized with copy 381 / 389 41.3
24.2 85.4X
-SQL ORC MR 1797 / 1819 8.8
114.3 18.1X
-
-OpenJDK 64-Bit Server VM 1.8.0_181-b13 on Linux 3.10.0-862.3.2.el7.x86_64
-Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
+SQL CSV 21253 / 21542 0.7
1351.2 1.0X
+SQL Json 8208 / 8209 1.9
521.9 2.6X
+SQL Parquet Vectorized 180 / 241 87.3
11.5 117.9X
+SQL Parquet MR 1769 / 1801 8.9
112.5 12.0X
+SQL ORC Vectorized 3271 / 3277 4.8
207.9 6.5X
--- End diff --
OK, let me re-run it.
Thanks for the check!
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
