srilman opened a new issue, #6620:
URL: https://github.com/apache/iceberg/issues/6620
### Feature Request / Improvement
I started to use PyIceberg as a dependency for an application that uses a
lot of data-science related libraries, but I started to run into issues due to
many conflicting sub-dependency versions, particularly:
- PyArrow (Optional)
- S3FS (Optional)
- Boto3 (Optional)
- FsSpec (Required, but its version is tied with s3fs I believe)
I was wondering, is it necessary for all of PyIceberg's dependencies to be
fixed to one version, or can we have more flexible options. This would be
especially helpful for optional dependencies.
I haven't done a deep-dive into the code to see how these dependencies are
used, but it looks to me that the latest version of PyArrow is not required.
### Query engine
None
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
