[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-07-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/21657 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-07-14 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r202528977 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -197,15 +202,21 @@ class UnivocityParser(

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-07-14 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r202528933 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -38,24 +38,29 @@ class UnivocityParser(

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-07-14 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r202528931 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -223,8 +234,8 @@ class UnivocityParser(

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-07-14 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r202528391 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -197,15 +202,21 @@ class UnivocityParser(

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-07-14 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r202528267 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -38,24 +38,29 @@ class UnivocityParser(

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-07-14 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r202528372 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -223,8 +234,8 @@ class UnivocityParser(

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-07-14 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r202527982 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/csv/CSVSuite.scala --- @@ -1579,4 +1579,20 @@ class CSVSuite extends

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-07-14 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r202528247 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -38,24 +38,29 @@ class UnivocityParser(

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-07-14 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r202527784 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -38,24 +38,29 @@ class UnivocityParser(

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-07-11 Thread MaxGekk
Github user MaxGekk commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r201582494 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -38,24 +38,28 @@ class UnivocityParser(

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-07-10 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r201540833 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -38,24 +38,28 @@ class UnivocityParser(

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-07-09 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r201187928 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -38,24 +38,28 @@ class UnivocityParser(

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-07-09 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r201172532 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -38,24 +38,28 @@ class UnivocityParser(

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-07-09 Thread MaxGekk
Github user MaxGekk commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r201042748 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -38,24 +38,28 @@ class UnivocityParser(

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-07-06 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r200802851 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -38,24 +38,28 @@ class UnivocityParser(

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-07-06 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r200614027 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -38,24 +38,28 @@ class UnivocityParser(

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-07-06 Thread MaxGekk
Github user MaxGekk commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r200608015 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -38,24 +38,28 @@ class UnivocityParser(

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-07-06 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r200560873 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -38,24 +38,28 @@ class UnivocityParser(

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-07-05 Thread MaxGekk
Github user MaxGekk commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r200291945 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -38,24 +38,28 @@ class UnivocityParser(

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-07-04 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r200210431 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -82,7 +83,12 @@ class UnivocityParser(

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-07-04 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r200210434 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -197,15 +203,21 @@ class UnivocityParser(

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-07-04 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r200210059 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -82,7 +83,12 @@ class UnivocityParser(

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-07-04 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r200209800 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -197,15 +203,21 @@ class UnivocityParser(

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-07-04 Thread MaxGekk
Github user MaxGekk commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r200204856 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -197,15 +203,21 @@ class UnivocityParser(

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-07-04 Thread MaxGekk
Github user MaxGekk commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r200197165 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -82,7 +83,12 @@ class UnivocityParser(

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-07-04 Thread MaxGekk
Github user MaxGekk commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r200197250 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/UnivocityParser.scala --- @@ -82,7 +83,12 @@ class UnivocityParser(

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-06-28 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r199034387 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/csv/CSVSuite.scala --- @@ -1579,4 +1579,16 @@ class CSVSuite extends QueryTest

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-06-28 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r199033773 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVFileFormat.scala --- @@ -131,20 +132,30 @@ class CSVFileFormat

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-06-28 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r199033486 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/csv/CSVSuite.scala --- @@ -1579,4 +1579,16 @@ class CSVSuite extends QueryTest

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-06-28 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r199033429 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/csv/CSVSuite.scala --- @@ -1579,4 +1579,16 @@ class CSVSuite extends

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-06-28 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r199033421 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVFileFormat.scala --- @@ -131,20 +132,30 @@ class CSVFileFormat extends

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-06-28 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r199032884 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/csv/CSVSuite.scala --- @@ -1579,4 +1579,16 @@ class CSVSuite extends QueryTest

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-06-28 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r199021518 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/csv/CSVSuite.scala --- @@ -1579,4 +1579,16 @@ class CSVSuite extends QueryTest

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-06-28 Thread MaxGekk
Github user MaxGekk commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r198863991 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVFileFormat.scala --- @@ -131,20 +132,30 @@ class CSVFileFormat extends

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-06-28 Thread MaxGekk
Github user MaxGekk commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r198865492 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/csv/CSVSuite.scala --- @@ -1579,4 +1579,16 @@ class CSVSuite extends

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-06-28 Thread MaxGekk
Github user MaxGekk commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r198863283 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/csv/CSVSuite.scala --- @@ -1579,4 +1579,16 @@ class CSVSuite extends

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-06-28 Thread MaxGekk
Github user MaxGekk commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r198865322 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/csv/CSVSuite.scala --- @@ -1579,4 +1579,16 @@ class CSVSuite extends

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-06-28 Thread MaxGekk
Github user MaxGekk commented on a diff in the pull request: https://github.com/apache/spark/pull/21657#discussion_r198865725 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/csv/CSVSuite.scala --- @@ -1579,4 +1579,16 @@ class CSVSuite extends

[GitHub] spark pull request #21657: [SPARK-24676][SQL] Project required data from CSV...

2018-06-28 Thread maropu
GitHub user maropu opened a pull request: https://github.com/apache/spark/pull/21657 [SPARK-24676][SQL] Project required data from CSV parsed data when column pruning disabled ## What changes were proposed in this pull request? This pr modified code to project required data