[
https://issues.apache.org/jira/browse/AIRFLOW-6294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17104015#comment-17104015
]
ASF GitHub Bot commented on AIRFLOW-6294:
-----------------------------------------
mik-laj commented on pull request #8809:
URL: https://github.com/apache/airflow/pull/8809#issuecomment-626441074
In my opinion, we need to add some information.
* new section which will describe the ways to run a pipeline. Currently, the
pipeline can be started using a local running executable
(DataflowCreateJavaJobOperator, DataflowCreatePythonJobOperator) or Dataflow
Template (DataflowTemplatedJobStartOperator) or via KubernetesPodOperator). A
description that describes the differences between these methods would be
useful.
* A new section that will describe the differences between asynchronic and
blocking execution modes. You should not use blocking pipelines, because it
causes a background process to run, which supervises the execution of the job,
This is not positive for two reasons - increase consumption of resources and
prevents Airflow supervision over the job
* information that Python operators allow you to specify the Apache Beam
version, but if no version is specified, the local version from the environment
will be used
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> Create guide for Dataflow service operator
> ------------------------------------------
>
> Key: AIRFLOW-6294
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6294
> Project: Apache Airflow
> Issue Type: New Feature
> Components: documentation, gcp
> Affects Versions: 1.10.6
> Reporter: Kamil Bregula
> Priority: Minor
> Labels: GoodForNewContributors
>
> Hello,
> A guide that describes how to use Dataflow service perators would be useful.
> Other guides are available:
> https://airflow.readthedocs.io/en/latest/howto/operator/gcp/index.html
> If anyone is interested in this task, I am willing to provide all the
> necessary tips and information.
> Best regards,
> Kamil
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
