[ https://issues.apache.org/jira/browse/AIRFLOW-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kaxil Naik updated AIRFLOW-5167: -------------------------------- Fix Version/s: (was: 1.10.8) > Dependancy conflict with grpc-google-iam-v1 > ------------------------------------------- > > Key: AIRFLOW-5167 > URL: https://issues.apache.org/jira/browse/AIRFLOW-5167 > Project: Apache Airflow > Issue Type: Bug > Components: gcp > Affects Versions: 1.10.4 > Reporter: Sujay Mansingh > Priority: Trivial > Fix For: 2.0.0 > > > If we use a tool that does script requirements checking (e.g. > {{pip-compile}}) then an erroe is thrown when handling the dependencies for > {{apache-airflow[gcp_api]}} > {code:java} > $ pip-compile --version > pip-compile, version 3.7.0 > $ cat requirements.in > apache-airflow[gcp_api] > $ pip-compile -o requirements.txt requirements.in > Could not find a version that matches > grpc-google-iam-v1<0.12dev,<0.13dev,>=0.11.4,>=0.12.3 > Tried: 0.9.0, 0.10.0, 0.10.1, 0.11.1, 0.11.3, 0.11.4, 0.12.0, 0.12.1, 0.12.2, > 0.12.3 > There are incompatible versions in the resolved dependencies. > {code} > Looks like a set of inconsistent dependencies in the google libs :/ > {code:java} > $ pip-compile -v -o requirements.txt requirements.in | grep -i grpc-google-iam > google-cloud-container==0.3.0 requires > google-api-core[grpc]<2.0.0dev,>=1.14.0, grpc-google-iam-v1<0.13dev,>=0.12.3 > google-cloud-bigtable==0.33.0 requires > google-api-core[grpc]<2.0.0dev,>=1.6.0, google-cloud-core<2.0dev,>=1.0.0, > grpc-google-iam-v1<0.12dev,>=0.11.4 > google-cloud-spanner==1.9.0 requires > google-api-core[grpc,grpcgcp]<2.0.0dev,>=1.4.1, > google-cloud-core<2.0dev,>=1.0.0, grpc-google-iam-v1<0.12dev,>=0.11.4 > adding ['grpc-google-iam-v1', '<0.12dev,<0.13dev,>=0.11.4,>=0.12.3', '[]'] > grpc-google-iam-v1<0.12dev,<0.13dev,>=0.11.4,>=0.12.3 > Could not find a version that matches > grpc-google-iam-v1<0.12dev,<0.13dev,>=0.11.4,>=0.12.3 > Tried: 0.9.0, 0.10.0, 0.10.1, 0.11.1, 0.11.3, 0.11.4, 0.12.0, 0.12.1, 0.12.2, > 0.12.3 > There are incompatible versions in the resolved dependencies. > {code} > So it looks like {{google-cloud-bigtable==0.33.0}} and > {{google-cloud-spanner==1.9.0}} require a version that is {{>=0.11.4}} and > {{<0.12dev}} > {{google-cloud-container==0.3.0}} upsets everything though by specifying > version {{>=0.12.3}} and {{<0.13dev}} > For now, we can work around issue by not checking any conflicts when > installing {{apache_airflow[gcp]}}. > That isn't ideal > - All it means is that the version of {{grpc-google-iam-v1}} that is > specified last will be installed > - I'm assuming that there are no major api changes in {{grpc-google-iam}} > between {{<0.12dev}} and {{<0.13dev}}. If there are then I imagine tests > would fail, but it still feels a little wrong to allow use of a lib that > doesn't match the version required > - Relaxing the check just means that we could have a conflict elsewhere that > isn't reported > I understand this is not an issue with airflow, but more to do with the > google python libraries. > However it does affect us when we try to use airflow and be strict with > python requirements. > Any ideas on what to do? -- This message was sent by Atlassian Jira (v8.3.4#803005)