[GitHub] [spark] JoshRosen commented on a diff in pull request #36775: [SPARK-39389]Filesystem closed should not be considered as corrupt files

2022-07-20 Thread GitBox
JoshRosen commented on code in PR #36775: URL: https://github.com/apache/spark/pull/36775#discussion_r925281565 ## sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileScanRDD.scala: ## @@ -215,6 +215,17 @@ class FileScanRDD( } } +

[GitHub] [spark] JoshRosen commented on a diff in pull request #36775: [SPARK-39389]Filesystem closed should not be considered as corrupt files

2022-07-20 Thread GitBox
JoshRosen commented on code in PR #36775: URL: https://github.com/apache/spark/pull/36775#discussion_r925281565 ## sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileScanRDD.scala: ## @@ -215,6 +215,17 @@ class FileScanRDD( } } +

[GitHub] [spark] JoshRosen commented on a diff in pull request #36775: [SPARK-39389]Filesystem closed should not be considered as corrupt files

2022-06-06 Thread GitBox
JoshRosen commented on code in PR #36775: URL: https://github.com/apache/spark/pull/36775#discussion_r890727456 ## sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileScanRDD.scala: ## @@ -253,6 +253,9 @@ class FileScanRDD( // Throw