[GitHub] [spark] LuciferYang commented on a diff in pull request #38024: [SPARK-40591][SQL] Fix data loss caused by ignoreCorruptFiles

2022-09-27 Thread GitBox
LuciferYang commented on code in PR #38024: URL: https://github.com/apache/spark/pull/38024#discussion_r981889549 ## sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileScanRDD.scala: ## @@ -253,7 +259,7 @@ class FileScanRDD( null

[GitHub] [spark] LuciferYang commented on a diff in pull request #38024: [SPARK-40591][SQL] Fix data loss caused by ignoreCorruptFiles

2022-09-27 Thread GitBox
LuciferYang commented on code in PR #38024: URL: https://github.com/apache/spark/pull/38024#discussion_r981889549 ## sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileScanRDD.scala: ## @@ -253,7 +259,7 @@ class FileScanRDD( null