[ https://issues.apache.org/jira/browse/ARROW-7673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Francois Saint-Jacques reassigned ARROW-7673: --------------------------------------------- Assignee: Francois Saint-Jacques > [C++][Dataset] Revisit File discovery failure mode > -------------------------------------------------- > > Key: ARROW-7673 > URL: https://issues.apache.org/jira/browse/ARROW-7673 > Project: Apache Arrow > Issue Type: Improvement > Components: C++ - Dataset > Reporter: Francois Saint-Jacques > Assignee: Francois Saint-Jacques > Priority: Major > Fix For: 1.0.0 > > > Currently, the default `FileSystemFactoryOptions::exclude_invalid_files` will > silently ignore unsupported files (either IO error, not of the valid format, > corruption, missing compression codecs, etc...) when creating a > `FileSystemSource`. > We should change this behavior to propagate an error in the Inspect/Finish > calls by default and allow the user to toggle `exclude_invalid_files`. The > error should contain at least the file path and a decipherable error (if > possible). -- This message was sent by Atlassian Jira (v8.3.4#803005)