Gengliang Wang created SPARK-27291:
--------------------------------------

             Summary: File source V2: Ignore empty files in load
                 Key: SPARK-27291
                 URL: https://issues.apache.org/jira/browse/SPARK-27291
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 3.0.0
            Reporter: Gengliang Wang


In https://github.com/apache/spark/pull/23130, all empty files are excluded 
from target file splits in `FileSourceScanExec`.

In File source V2, we should keep the same behavior.




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to