mik-laj opened a new issue #8272: Cloud Life Sciences operators and hooks
URL: https://github.com/apache/airflow/issues/8272
 
 
   **Description**
   
   Hello,
   
   Airflow has extensive support for [many GCP 
services](https://airflow.readthedocs.io/en/latest/operators-and-hooks-ref.html#gcp-google-cloud-platform).
  However, we lack integration with the [Cloud Life 
Sciences](https://cloud.google.com/life-sciences) service. 
   
   I think it would be very useful to have an operator which [run the 
pipeline](https://cloud.google.com/life-sciences/docs/reference/rest/v2beta/projects.locations.pipelines/run)
 and then waits for the result.  This will facilitate the use of Airflow to 
orchestrate tasks that require a GPU. You can currently perform a [similar 
job](https://cloud.google.com/cloud-build/docs/api/reference/rest/v1/projects.builds/create)
 using Cloud Build, but this service does not support GPU.
   
   Before starting work, I recommend reading the [GCP Service Airflow 
Integration Guide]
   
(https://docs.google.com/document/d/1_rTdJSLCt0eyrAylmmgYc3yZr-_h51fVlnvMmWqhCkY/edit)
   
   The final work should contain:
   * How to guide - (Similar to 
https://airflow.readthedocs.io/en/latest/howto/operator/gcp/natural_language.html)
   * API Reference: - (Similar to 
https://airflow.readthedocs.io/en/latest/_api/airflow/providers/google/cloud/operators/natural_language/index.html#airflow.providers.google.cloud.operators.natural_language.CloudNaturalLanguageAnalyzeEntitiesOperator)
   * Example DAG: 
https://github.com/apache/airflow/tree/master/airflow/providers/google/cloud/example_dags
   * Operator
   * Hook
   * Unit test
   * System tests (Similar to 
https://github.com/apache/airflow/blob/master/tests/providers/google/cloud/operators/test_natural_language_system.py)
   
   If you haven't used the GCP yet, after creating the account you [will get 
$300](https://cloud.google.com/free), which will allow you to get to know this 
service better.
   
   The implementation of this task will allow a better understanding of GCP 
services, as well as learn methods of testing and documenting the code that is 
required by the community.  If anyone is interested in this task, I am willing 
to provide all the necessary tips and information. 
   
   **Use case / motivation**
   
   N/A
   
   **Related Issues**
   
   N/A

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

Reply via email to