[
https://issues.apache.org/jira/browse/AIRFLOW-2266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16457765#comment-16457765
]
ASF subversion and git services commented on AIRFLOW-2266:
----------------------------------------------------------
Commit e9b74b68aa848b6ac5602f3e435cba38efde32d5 in incubator-airflow's branch
refs/heads/master from [~kaxilnaik]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=e9b74b6 ]
[AIRFLOW-2266][AIRFLOW-2343] Remove google-cloud-dataflow dependency
This is caused due to the fact that the latest
release (2.4) for apache-beam[gcp] is not
available for Python 3.x. Also as we are using
Google's discovery based API for all google cloud
related commands we don't require to import
google-cloud-dataflow package
Closes #3273 from kaxil/patch-3
> GCP integrations (gcp_api extras) cannot be installed from Python 3
> -------------------------------------------------------------------
>
> Key: AIRFLOW-2266
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2266
> Project: Apache Airflow
> Issue Type: Bug
> Components: contrib
> Environment: OS: macOS
> $ sw_vers
> ProductName: Mac OS X
> ProductVersion: 10.13.3
> BuildVersion: 17D102
> Python 3.6.4
> Reporter: Tim Swast`
> Assignee: Kaxil Naik
> Priority: Major
>
> As seen in https://issues.apache.org/jira/browse/AIRFLOW-2187, the
> google-cloud-dataflow package only works from Python 2. This is what happens
> when I try to install the gcp_api extras from a Python 3 environment:
>
> |pip install apache-airflow[gcp_api]|
> |...
> Collecting cryptography>=2.1.4 (from PyOpenSSL->apache-airflow[gcp_api])
> Downloading cryptography-2.2.1-cp34-abi3-macosx_10_6_intel.whl (1.5MB)
> 100% \|████████████████████████████████\| 1.5MB 943kB/s
> Collecting apache-beam[gcp]==2.3.0 (from
> google-cloud-dataflow->apache-airflow[gcp_api])
> Could not find a version that satisfies the requirement
> apache-beam[gcp]==2.3.0 (from google-cloud-dataflow->apache-airflow[gcp_api])
> (from versions: 0.6.0, 2.0.0, 2.1.0, 2.1.1, 2.2.0)
> No matching distribution found for apache-beam[gcp]==2.3.0 (from
> google-cloud-dataflow->apache-airflow[gcp_api])|
>
> The other GCP APIs should be accessible from Python 3. My suggestion is to
> split the gcp_extras into separate extras (or at least a separate extra for
> dataflow), similar to how there is a separate extra for s3.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
