This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.4 by this push: new 4fb30f74f3f [SPARK-42545][K8S][DOCS] Remove `experimental` from `Volcano` docs 4fb30f74f3f is described below commit 4fb30f74f3f49110a5e3bc8c73da7ac3b397a7cf Author: Dongjoon Hyun <dongj...@apache.org> AuthorDate: Thu Feb 23 18:04:00 2023 -0800 [SPARK-42545][K8S][DOCS] Remove `experimental` from `Volcano` docs ### What changes were proposed in this pull request? This PR aims to remove `experimental` notes from `Volcano` docs. ### Why are the changes needed? Apache Spark 3.3.0 added `Volcano` as an experimental module. Now, we can remove it from Apache Spark 3.4.0 because we don't expect breaking future behavior changes. ### Does this PR introduce _any_ user-facing change? No, this is a documentation only change. ### How was this patch tested? Manual review. Closes #40152 from dongjoon-hyun/SPARK-42545. Authored-by: Dongjoon Hyun <dongj...@apache.org> Signed-off-by: Dongjoon Hyun <dongj...@apache.org> (cherry picked from commit be745f7f3b0b970cf385e7d8cc2be42c340fd1d6) Signed-off-by: Dongjoon Hyun <dongj...@apache.org> --- docs/running-on-kubernetes.md | 2 -- resource-managers/kubernetes/integration-tests/README.md | 2 -- 2 files changed, 4 deletions(-) diff --git a/docs/running-on-kubernetes.md b/docs/running-on-kubernetes.md index 56129d38d15..e580beb8ad6 100644 --- a/docs/running-on-kubernetes.md +++ b/docs/running-on-kubernetes.md @@ -1845,8 +1845,6 @@ Spark allows users to specify a custom Kubernetes schedulers. #### Using Volcano as Customized Scheduler for Spark on Kubernetes -**This feature is currently experimental. In future versions, there may be behavioral changes around configuration, feature step improvement.** - ##### Prerequisites * Spark on Kubernetes with [Volcano](https://volcano.sh/en) as a custom scheduler is supported since Spark v3.3.0 and Volcano v1.7.0. Below is an example to install Volcano 1.7.0: diff --git a/resource-managers/kubernetes/integration-tests/README.md b/resource-managers/kubernetes/integration-tests/README.md index 0a03be42b4b..b85e57db768 100644 --- a/resource-managers/kubernetes/integration-tests/README.md +++ b/resource-managers/kubernetes/integration-tests/README.md @@ -331,8 +331,6 @@ You can also specify your specific dockerfile to build JVM/Python/R based image # Running the Volcano Integration Tests -Volcano integration is experimental in Aapche Spark 3.3.0 and the test coverage is limited. - ## Requirements - A minimum of 6 CPUs and 9G of memory is required to complete all Volcano test cases. - Volcano v1.7.0. --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org