shahar1 commented on code in PR #74910:
URL: https://github.com/apache/airflow/pull/74910#discussion_r4500476463
##########
providers/google/docs/operators/cloud/dataproc.rst:
##########
@@ -195,6 +195,38 @@ Generating Cluster Config
``cluster_config`` or ``virtual_cluster_config`` dictionaries directly as
arguments to the
``DataprocCreateClusterOperator``.
+Multi-zone clusters
+^^^^^^^^^^^^^^^^^^^
+
+Multi-zone clusters can create instances across multiple Compute Engine zones
within a region to improve
+resource availability and reduce stockouts. To configure a multi-zone cluster,
set ``multi_zone_config`` under
+``gce_cluster_config`` (for example, ``{"target_shape": "ANY"}`` or a native
+``google.cloud.dataproc_v1.types.MultiZoneConfig`` instance) and omit
``zone_uri``. For more information, refer to the
+`MultiZoneConfig Python reference
<https://cloud.google.com/python/docs/reference/dataproc/latest/google.cloud.dataproc_v1.types.MultiZoneConfig>`__
+and the `GceClusterConfig REST API reference
<https://cloud.google.com/dataproc/docs/reference/rest/v1/ClusterConfig#GceClusterConfig>`__.
+
+A multi-zone cluster configuration can look as follows:
+
+.. code-block:: python
Review Comment:
**nit (non-blocking):** The other examples in this file use `exampleinclude`
from a system test, so CI at least parses them. This inline block isn't
exercised by CI and can drift. An inline example is fine for this change;
`exampleinclude` is the option if a multi-zone system test gets added later.
##########
providers/google/docs/operators/cloud/dataproc.rst:
##########
@@ -195,6 +195,38 @@ Generating Cluster Config
``cluster_config`` or ``virtual_cluster_config`` dictionaries directly as
arguments to the
``DataprocCreateClusterOperator``.
+Multi-zone clusters
Review Comment:
**nit:** This section lands after the deprecated "Generating Cluster Config"
section. On `main`, the "High Obtainability (HO) mode clusters" section sits
just above that one (your branch predates it). Could you move this section
above "Generating Cluster Config", next to the High Obtainability section, so
the supported cluster options stay together?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
