pitrou commented on issue #36983:
URL: https://github.com/apache/arrow/issues/36983#issuecomment-1688591423
Ok, so here is what the the Python docstring says:
```python
def get_file_info(self, paths_or_selector):
"""
Get info for the given files.
[...]
Parameters
----------
paths_or_selector : FileSelector, path-like or list of path-likes
Either a selector object, a path-like object or a list of
path-like objects. The selector's base directory will not be
part of the results, even if it exists. If it doesn't exist,
use `allow_not_found`.
```
Quoting the relevant part above:
> The selector's base directory will not be part of the results, even if it
exists.
So with `selector = FileSelector("my_bucket/my_dataset_path/",
recursive=True)`, the `FileInfo` for `'my_bucket/my_dataset_path/'` should not
be returned as part of the results. `FSSpecHandler` should probably be fixed to
ensure that.
@danepitkin
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
