Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/21631
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/21631#discussion_r197973962
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala
---
@@ -183,11 +183,19 @@ class UnivocityParser(
Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/21631#discussion_r197961932
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala
---
@@ -183,11 +183,19 @@ class UnivocityParser(
Github user MaxGekk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21631#discussion_r197887650
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala
---
@@ -183,11 +183,19 @@ class UnivocityParser(
Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/21631#discussion_r197679873
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/csv/CSVSuite.scala
---
@@ -1602,4 +1602,14 @@ class CSVSuite extends QueryTest
GitHub user maropu opened a pull request:
https://github.com/apache/spark/pull/21631
[SPARK-24645][SQL] Skip parsing when csvColumnPruning enabled and
partitions scanned only
## What changes were proposed in this pull request?
In the master, when `csvColumnPruning` enabled and
