[ https://issues.apache.org/jira/browse/ARROW-18436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Antoine Pitrou updated ARROW-18436: ----------------------------------- Summary: [Python] `FileSystem.from_uri` doesn't decode %-encoded characters in path (was: [Python] `FileSystem.from_uri` doesn't decode %-encoded characters) > [Python] `FileSystem.from_uri` doesn't decode %-encoded characters in path > -------------------------------------------------------------------------- > > Key: ARROW-18436 > URL: https://issues.apache.org/jira/browse/ARROW-18436 > Project: Apache Arrow > Issue Type: Bug > Components: C++, Python > Affects Versions: 10.0.1 > Environment: - OS: macOS > - `python=3.9.15:h709bd14_0_cpython` (installed from conda-forge) > - `pyarrow=10.0.1:py39h2db5b05_1_cpu` (installed from conda-forge) > Reporter: James Bourbeau > Assignee: Antoine Pitrou > Priority: Minor > Fix For: 11.0.0 > > > When attempting to create a new filesystem object from a public dataset in > S3, where there is a space in the bucket name, an error is raised. > > Here's a minimal reproducer: > {code:java} > from pyarrow.fs import FileSystem > result = FileSystem.from_uri("s3://nyc-tlc/trip > data/fhvhv_tripdata_2022-06.parquet") {code} > which fails with the following traceback: > > {code:java} > Traceback (most recent call last): > File "/Users/james/projects/dask/dask/test.py", line 3, in <module> > result = FileSystem.from_uri("s3://nyc-tlc/trip > data/fhvhv_tripdata_2022-06.parquet") > File "pyarrow/_fs.pyx", line 470, in pyarrow._fs.FileSystem.from_uri > File "pyarrow/error.pxi", line 144, in > pyarrow.lib.pyarrow_internal_check_status > File "pyarrow/error.pxi", line 100, in pyarrow.lib.check_status > pyarrow.lib.ArrowInvalid: Cannot parse URI: 's3://nyc-tlc/trip > data/fhvhv_tripdata_2022-06.parquet'{code} > > Note that things work if I use a different dataset that doesn't have a space > in the URI, or if I replace the portion of the URI that has a space with a > `*` wildcard > > {code:java} > from pyarrow.fs import FileSystem > result = FileSystem.from_uri("s3://ursa-labs-taxi-data/2009/01/data.parquet") > # works > result = > FileSystem.from_uri("s3://nyc-tlc/*/fhvhv_tripdata_2022-06.parquet") # works > {code} > > The wildcard isn't necessarily equivalent to the original failing URI, but I > think highlights that the space is somehow problematic. -- This message was sent by Atlassian Jira (v8.20.10#820010)