[ https://issues.apache.org/jira/browse/AIRFLOW-2266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16457765#comment-16457765 ]
ASF subversion and git services commented on AIRFLOW-2266: ---------------------------------------------------------- Commit e9b74b68aa848b6ac5602f3e435cba38efde32d5 in incubator-airflow's branch refs/heads/master from [~kaxilnaik] [ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=e9b74b6 ] [AIRFLOW-2266][AIRFLOW-2343] Remove google-cloud-dataflow dependency This is caused due to the fact that the latest release (2.4) for apache-beam[gcp] is not available for Python 3.x. Also as we are using Google's discovery based API for all google cloud related commands we don't require to import google-cloud-dataflow package Closes #3273 from kaxil/patch-3 > GCP integrations (gcp_api extras) cannot be installed from Python 3 > ------------------------------------------------------------------- > > Key: AIRFLOW-2266 > URL: https://issues.apache.org/jira/browse/AIRFLOW-2266 > Project: Apache Airflow > Issue Type: Bug > Components: contrib > Environment: OS: macOS > $ sw_vers > ProductName: Mac OS X > ProductVersion: 10.13.3 > BuildVersion: 17D102 > Python 3.6.4 > Reporter: Tim Swast` > Assignee: Kaxil Naik > Priority: Major > > As seen in https://issues.apache.org/jira/browse/AIRFLOW-2187, the > google-cloud-dataflow package only works from Python 2. This is what happens > when I try to install the gcp_api extras from a Python 3 environment: > > |pip install apache-airflow[gcp_api]| > |... > Collecting cryptography>=2.1.4 (from PyOpenSSL->apache-airflow[gcp_api]) > Downloading cryptography-2.2.1-cp34-abi3-macosx_10_6_intel.whl (1.5MB) > 100% \|████████████████████████████████\| 1.5MB 943kB/s > Collecting apache-beam[gcp]==2.3.0 (from > google-cloud-dataflow->apache-airflow[gcp_api]) > Could not find a version that satisfies the requirement > apache-beam[gcp]==2.3.0 (from google-cloud-dataflow->apache-airflow[gcp_api]) > (from versions: 0.6.0, 2.0.0, 2.1.0, 2.1.1, 2.2.0) > No matching distribution found for apache-beam[gcp]==2.3.0 (from > google-cloud-dataflow->apache-airflow[gcp_api])| > > The other GCP APIs should be accessible from Python 3. My suggestion is to > split the gcp_extras into separate extras (or at least a separate extra for > dataflow), similar to how there is a separate extra for s3. -- This message was sent by Atlassian JIRA (v7.6.3#76005)