Gengliang Wang created SPARK-27291: -------------------------------------- Summary: File source V2: Ignore empty files in load Key: SPARK-27291 URL: https://issues.apache.org/jira/browse/SPARK-27291 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 3.0.0 Reporter: Gengliang Wang
In https://github.com/apache/spark/pull/23130, all empty files are excluded from target file splits in `FileSourceScanExec`. In File source V2, we should keep the same behavior. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org