[GitHub] [spark] maropu commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

2020-08-30 Thread GitBox
maropu commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r479843161 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/PathFilterSuite.scala ## @@ -0,0 +1,553 @@ +/* + * Licensed to the

[GitHub] [spark] maropu commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

2020-08-25 Thread GitBox
maropu commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r476522761 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/PathFilterSuite.scala ## @@ -0,0 +1,563 @@ +/* + * Licensed to the

[GitHub] [spark] maropu commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

2020-08-18 Thread GitBox
maropu commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r472595471 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/PathFilterSuite.scala ## @@ -0,0 +1,501 @@ +/* + * Licensed to the

[GitHub] [spark] maropu commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

2020-08-18 Thread GitBox
maropu commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r472595471 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/PathFilterSuite.scala ## @@ -0,0 +1,501 @@ +/* + * Licensed to the

[GitHub] [spark] maropu commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

2020-08-18 Thread GitBox
maropu commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r472592405 ## File path: docs/sql-data-sources-generic-options.md ## @@ -119,3 +119,48 @@ To load all files recursively, you can use: {% include_example

[GitHub] [spark] maropu commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

2020-08-18 Thread GitBox
maropu commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r472591099 ## File path: docs/sql-data-sources-generic-options.md ## @@ -119,3 +119,48 @@ To load all files recursively, you can use: {% include_example

[GitHub] [spark] maropu commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

2020-08-18 Thread GitBox
maropu commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r472591183 ## File path: docs/sql-data-sources-generic-options.md ## @@ -119,3 +119,48 @@ To load all files recursively, you can use: {% include_example

[GitHub] [spark] maropu commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

2020-08-18 Thread GitBox
maropu commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r472591099 ## File path: docs/sql-data-sources-generic-options.md ## @@ -119,3 +119,48 @@ To load all files recursively, you can use: {% include_example

[GitHub] [spark] maropu commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

2020-08-18 Thread GitBox
maropu commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r472585785 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/PathFilterSuite.scala ## @@ -0,0 +1,501 @@ +/* + * Licensed to the

[GitHub] [spark] maropu commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

2020-08-18 Thread GitBox
maropu commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r472585442 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/PathFilterSuite.scala ## @@ -0,0 +1,501 @@ +/* + * Licensed to the

[GitHub] [spark] maropu commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

2020-08-18 Thread GitBox
maropu commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r472584156 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/PathFilterSuite.scala ## @@ -0,0 +1,501 @@ +/* + * Licensed to the

[GitHub] [spark] maropu commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

2020-08-18 Thread GitBox
maropu commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r472580694 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/PathFilterSuite.scala ## @@ -0,0 +1,501 @@ +/* + * Licensed to the

[GitHub] [spark] maropu commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

2020-08-18 Thread GitBox
maropu commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r472579334 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/pathFilters.scala ## @@ -0,0 +1,155 @@ +/* + * Licensed to the Apache

[GitHub] [spark] maropu commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

2020-08-18 Thread GitBox
maropu commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r472579334 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/pathFilters.scala ## @@ -0,0 +1,155 @@ +/* + * Licensed to the Apache

[GitHub] [spark] maropu commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

2020-08-18 Thread GitBox
maropu commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r472579411 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/pathFilters.scala ## @@ -0,0 +1,155 @@ +/* + * Licensed to the Apache

[GitHub] [spark] maropu commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

2020-08-18 Thread GitBox
maropu commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r472578754 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/PathFilterSuite.scala ## @@ -0,0 +1,501 @@ +/* + * Licensed to the

[GitHub] [spark] maropu commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

2020-08-13 Thread GitBox
maropu commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r469756911 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/pathFilters.scala ## @@ -0,0 +1,214 @@ +/* + * Licensed to the Apache

[GitHub] [spark] maropu commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

2020-08-11 Thread GitBox
maropu commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r468952791 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/PathFilterSuite.scala ## @@ -0,0 +1,557 @@ +/* + * Licensed to the

[GitHub] [spark] maropu commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

2020-08-11 Thread GitBox
maropu commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r468952791 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/PathFilterSuite.scala ## @@ -0,0 +1,557 @@ +/* + * Licensed to the

[GitHub] [spark] maropu commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

2020-08-11 Thread GitBox
maropu commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r468952326 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/PathFilterSuite.scala ## @@ -0,0 +1,557 @@ +/* + * Licensed to the

[GitHub] [spark] maropu commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

2020-08-11 Thread GitBox
maropu commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r468943144 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/pathfilters/PathFilterStrategy.scala ## @@ -0,0 +1,33 @@ +/* + *

[GitHub] [spark] maropu commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

2020-08-01 Thread GitBox
maropu commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r463961062 ## File path: sql/core/src/test/scala/org/apache/spark/sql/FileBasedDataSourceSuite.scala ## @@ -561,6 +564,367 @@ class FileBasedDataSourceSuite extends

[GitHub] [spark] maropu commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

2020-08-01 Thread GitBox
maropu commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r463961032 ## File path: sql/core/src/test/scala/org/apache/spark/sql/FileBasedDataSourceSuite.scala ## @@ -561,6 +564,367 @@ class FileBasedDataSourceSuite extends

[GitHub] [spark] maropu commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

2020-08-01 Thread GitBox
maropu commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r463960973 ## File path: sql/core/src/test/scala/org/apache/spark/sql/FileBasedDataSourceSuite.scala ## @@ -561,6 +564,367 @@ class FileBasedDataSourceSuite extends

[GitHub] [spark] maropu commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

2020-08-01 Thread GitBox
maropu commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r463954939 ## File path: docs/sql-data-sources-generic-options.md ## @@ -119,3 +119,37 @@ To load all files recursively, you can use: {% include_example