Github user maropu closed the pull request at:
https://github.com/apache/spark/pull/14038
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/14038#discussion_r118045500
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileFormat.scala
---
@@ -31,6 +31,34 @@ import
Github user steveloughran commented on a diff in the pull request:
https://github.com/apache/spark/pull/14038#discussion_r89839965
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/FileSourceStrategySuite.scala
---
@@ -441,6 +441,44 @@ class
Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/14038#discussion_r69713606
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/ListingFileCatalog.scala
---
@@ -156,3 +162,10 @@ class ListingFileCatalog(
Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/14038#discussion_r69713543
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/ListingFileCatalog.scala
---
@@ -30,6 +29,13 @@ import
Github user liancheng commented on a diff in the pull request:
https://github.com/apache/spark/pull/14038#discussion_r69706488
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/fileSourceInterfaces.scala
---
@@ -230,6 +229,15 @@ trait FileFormat {
Github user liancheng commented on a diff in the pull request:
https://github.com/apache/spark/pull/14038#discussion_r69706413
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/ListingFileCatalog.scala
---
@@ -156,3 +162,10 @@ class ListingFileCatalog(
Github user liancheng commented on a diff in the pull request:
https://github.com/apache/spark/pull/14038#discussion_r69706379
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/ListingFileCatalog.scala
---
@@ -30,6 +29,13 @@ import
Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/14038#discussion_r69706249
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/ListingFileCatalog.scala
---
@@ -30,6 +29,13 @@ import
Github user liancheng commented on a diff in the pull request:
https://github.com/apache/spark/pull/14038#discussion_r69706044
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/ListingFileCatalog.scala
---
@@ -30,6 +29,13 @@ import
Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/14038#discussion_r69521137
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/fileSourceInterfaces.scala
---
@@ -230,6 +236,15 @@ trait FileFormat {
}
Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/14038#discussion_r69520870
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/fileSourceInterfaces.scala
---
@@ -172,6 +171,13 @@ case class
Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/14038#discussion_r69520532
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/fileSourceInterfaces.scala
---
@@ -172,6 +171,13 @@ case class
Github user liancheng commented on a diff in the pull request:
https://github.com/apache/spark/pull/14038#discussion_r69520473
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/fileSourceInterfaces.scala
---
@@ -437,11 +442,26 @@ private[sql] object
Github user liancheng commented on a diff in the pull request:
https://github.com/apache/spark/pull/14038#discussion_r69520156
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/fileSourceInterfaces.scala
---
@@ -172,6 +171,13 @@ case class
Github user liancheng commented on a diff in the pull request:
https://github.com/apache/spark/pull/14038#discussion_r69519931
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/fileSourceInterfaces.scala
---
@@ -172,6 +171,13 @@ case class
Github user liancheng commented on a diff in the pull request:
https://github.com/apache/spark/pull/14038#discussion_r69519846
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/fileSourceInterfaces.scala
---
@@ -230,6 +236,15 @@ trait FileFormat {
Github user liancheng commented on a diff in the pull request:
https://github.com/apache/spark/pull/14038#discussion_r69519641
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/fileSourceInterfaces.scala
---
@@ -172,6 +171,13 @@ case class
Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/14038#discussion_r69519099
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/fileSourceInterfaces.scala
---
@@ -230,6 +236,15 @@ trait FileFormat {
}
Github user liancheng commented on a diff in the pull request:
https://github.com/apache/spark/pull/14038#discussion_r69518421
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/fileSourceInterfaces.scala
---
@@ -230,6 +236,15 @@ trait FileFormat {
GitHub user maropu reopened a pull request:
https://github.com/apache/spark/pull/14038
[SPARK-16317][SQL] Add a new interface to filter files in FileFormat
## What changes were proposed in this pull request?
This pr is to add an interface for filtering files in `FileFormat` not
Github user maropu closed the pull request at:
https://github.com/apache/spark/pull/14038
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
GitHub user maropu opened a pull request:
https://github.com/apache/spark/pull/14038
[SPARK-16317][SQL] Add a new interface to filter files in FileFormat
## What changes were proposed in this pull request?
This pr is to add an interface for filtering files in `FileFormat` not to
23 matches
Mail list logo
