Lu Wang created SPARK-44264:
-------------------------------
Summary: DeepSpeed Distrobutor
Key: SPARK-44264
URL: https://issues.apache.org/jira/browse/SPARK-44264
Project: Spark
Issue Type: Improvement
Components: ML, PySpark
Affects Versions: 3.4.1
Reporter: Lu Wang
To make it easier for Pyspark users to run distributed training and inference
with DeepSpeed on spark clusters using PySpark. This was a project determined
by the Databricks ML Training Team.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
