hutch3232 opened a new issue, #658:
URL: https://github.com/apache/arrow-rs-object-store/issues/658
**Is your feature request related to a problem or challenge? Please describe
what you are trying to do.**
I'm a `polars` user on Microsoft Fabric. I wasn't sure if this issue was
better suited for `polars` or object-store. Decided maybe lower-level is better.
On recent versions of `polars`, in order to read from Fabric OneLake using
the `abfss://` URI, you have to pass `storage_options={"use_fabric_endpoint":
"true"}` which I believe gets passed to some object-store credential provider.
It certainly is not a major challenge, but it feels untidy and redundant to
have to specify that when I'm providing a URI that says it is fabric, e.g.,
`"abfss://<workspace id>@onelake.dfs.fabric.microsoft.com/<lakehouse id>"`
**Describe the solution you'd like**
I think whatever downstream effects this storage operation results in should
have the default vary based on the URI passed. i.e., if it sees this URI, it
should default to true.
**Describe alternatives you've considered**
An environment variable is also a possibility, and I tried a few to see if
perhaps this already was configurable based on that, but it didn't seem to me.
I tried, for example, `USE_FABRIC_ENDPOINT`.
**Additional context**
Possibly related issues:
https://github.com/apache/arrow-rs-object-store/issues/474
https://github.com/apache/arrow-rs-object-store/issues/430
https://github.com/pola-rs/polars/issues/22096
I saw this was recently discussed in the MicrosoftFabric subreddit:
https://www.reddit.com/r/MicrosoftFabric/comments/1riuzs9/using_abfss_uris_with_new_polars_versions/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
