This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git
from 7e2c6c7ab23 [SPARK-42985][CONNECT][PYTHON] Fix createDataFrame to respect the SQL configs add f8751e2afeb [SPARK-42994][ML][CONNECT] PyTorch Distributor support Local Mode No new revisions were added by this update. Summary of changes: .../src/main/protobuf/spark/connect/base.proto | 3 + .../src/main/protobuf/spark/connect/commands.proto | 9 ++ .../src/main/protobuf/spark/connect/common.proto | 10 ++ .../sql/connect/planner/SparkConnectPlanner.scala | 27 ++++ .../tests/connect/test_parity_torch_distributor.py | 59 +++++---- python/pyspark/ml/torch/distributor.py | 89 +++++++++---- python/pyspark/ml/torch/tests/test_distributor.py | 30 ++++- python/pyspark/sql/connect/client.py | 16 +++ python/pyspark/sql/connect/proto/base_pb2.py | 108 ++++++++-------- python/pyspark/sql/connect/proto/base_pb2.pyi | 13 ++ python/pyspark/sql/connect/proto/commands_pb2.py | 144 ++++++++++++++------- python/pyspark/sql/connect/proto/commands_pb2.pyi | 68 ++++++++++ python/pyspark/sql/connect/proto/common_pb2.py | 16 ++- python/pyspark/sql/connect/proto/common_pb2.pyi | 30 +++++ 14 files changed, 462 insertions(+), 160 deletions(-) --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org