andygrove commented on issue #1736: URL: https://github.com/apache/arrow-datafusion/issues/1736#issuecomment-1296278634
Some notes from investigating this. This is where the `EmptyExec` gets introduced. I ran into this issue in Ballista as well in https://github.com/apache/arrow-ballista/pull/414 ```rust // if no files need to be read, return an `EmptyExec` if partitioned_file_lists.is_empty() { let schema = self.schema(); let projected_schema = project_schema(&schema, projection.as_ref())?; return Ok(Arc::new(EmptyExec::new(false, projected_schema))); } ``` The problem is I am registering a CSV data source and the filename does not end with `.csv` and we have hard-coded assumptions that CSV files must end with `".csv"`, so we cannot support `.tsv` or `.tbl`. I think we just need to add an error check for this case and prompt the user to specify the file extension they want rather than use the default. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
