Fokko opened a new issue, #8442: URL: https://github.com/apache/iceberg/issues/8442
### Feature Request / Improvement When you install `s3fs` and `boto3` (`glue` or `dynamodb`), then the resolving of the dependencies takes ages. - `s3fs` depends on `aiobotocore`, which depends on a very specific version of `boto3`. For example, the latest release of `aiobotocore` depends on `botocore>=1.31.17,<1.31.18`. - `glue` installs `boto3`, which has a dependency on `botocore`. `boto3` version `1.28.38` depends on `botocore>=1.31.38,<1.32.0`, which is also very narrow. I think pypi tries to find a match between these two dependencies. The problem is that boto3 has a release almost every day: https://pypi.org/project/boto3/#history If you only install s3fs or glue then everything works fine. Another issue is that `aiobotocore` does some patching of the botocore code, and that's why it needs such a specific version. Other versions might lead to weird errors. ### Query engine None -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
