This is an automated email from the ASF dual-hosted git repository.

gurwls223 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.


    from 4e31000  [SPARK-38204][SS] Use StatefulOpClusteredDistribution for 
stateful operators with respecting backward compatibility
     add f84018a  [SPARK-38424][PYTHON] Warn unused casts and ignores

No new revisions were added by this update.

Summary of changes:
 dev/lint-python                                    |  1 -
 examples/src/main/python/als.py                    |  4 +-
 examples/src/main/python/kmeans.py                 |  5 ++-
 examples/src/main/python/logistic_regression.py    |  8 ++--
 .../ml/estimator_transformer_param_example.py      |  2 +-
 examples/src/main/python/ml/pipeline_example.py    |  2 +-
 examples/src/main/python/pagerank.py               | 11 ++++--
 examples/src/main/python/pi.py                     |  2 +-
 examples/src/main/python/sql/arrow.py              | 36 +++++++++--------
 examples/src/main/python/sql/basic.py              |  6 +--
 examples/src/main/python/sql/datasource.py         | 18 ++++-----
 .../structured_network_wordcount_windowed.py       |  2 +-
 examples/src/main/python/status_api_demo.py        | 15 ++++---
 .../python/streaming/network_wordjoinsentiments.py |  3 +-
 .../streaming/recoverable_network_wordcount.py     | 15 ++++---
 .../main/python/streaming/sql_network_wordcount.py |  8 ++--
 .../python/streaming/stateful_network_wordcount.py |  3 +-
 examples/src/main/python/transitive_closure.py     |  5 ++-
 python/mypy.ini                                    |  2 +
 python/pyspark/conf.py                             |  4 +-
 python/pyspark/context.py                          | 46 ++++++++--------------
 python/pyspark/ml/classification.pyi               |  2 +-
 python/pyspark/ml/clustering.py                    |  2 +-
 python/pyspark/ml/common.py                        |  8 ++--
 python/pyspark/ml/feature.pyi                      |  2 +-
 python/pyspark/ml/fpm.py                           |  2 +-
 python/pyspark/ml/param/__init__.py                |  3 +-
 python/pyspark/ml/pipeline.py                      |  2 +-
 python/pyspark/ml/regression.py                    | 18 ++++-----
 python/pyspark/ml/stat.py                          |  4 +-
 python/pyspark/ml/tests/test_wrapper.py            |  2 +-
 python/pyspark/ml/tree.py                          |  4 +-
 python/pyspark/ml/tuning.py                        |  8 ++--
 python/pyspark/ml/util.py                          |  8 +---
 python/pyspark/ml/wrapper.py                       |  2 +-
 python/pyspark/mllib/classification.py             |  8 ++--
 python/pyspark/mllib/clustering.pyi                |  2 +-
 python/pyspark/mllib/common.py                     |  8 ++--
 python/pyspark/mllib/feature.py                    |  2 +-
 python/pyspark/mllib/linalg/__init__.py            |  2 +-
 python/pyspark/mllib/regression.py                 | 12 ++----
 python/pyspark/mllib/tests/test_linalg.py          |  2 +-
 python/pyspark/mllib/tests/test_util.py            |  2 +-
 python/pyspark/pandas/accessors.py                 |  4 +-
 python/pyspark/pandas/base.py                      |  2 +-
 python/pyspark/pandas/data_type_ops/complex_ops.py |  2 +-
 .../pyspark/pandas/data_type_ops/datetime_ops.py   |  2 +-
 python/pyspark/pandas/frame.py                     |  6 +--
 python/pyspark/pandas/generic.py                   |  5 +--
 python/pyspark/pandas/groupby.py                   | 12 +++---
 python/pyspark/pandas/indexes/base.py              | 23 +++++------
 python/pyspark/pandas/indexing.py                  |  6 +--
 python/pyspark/pandas/internal.py                  |  2 +-
 python/pyspark/pandas/ml.py                        |  6 +--
 python/pyspark/pandas/plot/core.py                 |  2 +-
 python/pyspark/pandas/series.py                    | 17 ++++----
 python/pyspark/pandas/spark/functions.py           |  4 +-
 python/pyspark/pandas/tests/test_dataframe.py      |  2 +-
 python/pyspark/pandas/utils.py                     |  2 +-
 python/pyspark/rdd.py                              | 13 ++----
 python/pyspark/resource/profile.py                 | 12 +++---
 python/pyspark/resource/requests.py                |  6 +--
 python/pyspark/serializers.py                      |  4 +-
 python/pyspark/shell.py                            |  4 +-
 python/pyspark/shuffle.py                          |  2 +-
 python/pyspark/sql/avro/functions.py               |  2 +-
 python/pyspark/sql/catalog.py                      |  2 +-
 python/pyspark/sql/column.py                       | 22 +++--------
 python/pyspark/sql/conf.py                         |  4 +-
 python/pyspark/sql/context.py                      | 10 ++---
 python/pyspark/sql/dataframe.py                    | 37 +++++++----------
 python/pyspark/sql/functions.py                    |  4 +-
 python/pyspark/sql/group.py                        |  2 +-
 python/pyspark/sql/observation.py                  |  2 +-
 python/pyspark/sql/pandas/_typing/__init__.pyi     |  2 +-
 python/pyspark/sql/pandas/conversion.py            | 20 +++++-----
 python/pyspark/sql/pandas/functions.pyi            | 12 ++++--
 python/pyspark/sql/pandas/group_ops.py             |  6 +--
 python/pyspark/sql/pandas/map_ops.py               |  2 +-
 python/pyspark/sql/readwriter.py                   | 26 ++++--------
 python/pyspark/sql/session.py                      | 20 +++++-----
 python/pyspark/sql/sql_formatter.py                |  4 +-
 python/pyspark/sql/streaming.py                    |  6 +--
 python/pyspark/sql/tests/test_functions.py         |  2 +-
 python/pyspark/sql/tests/test_types.py             |  2 +-
 python/pyspark/sql/tests/typing/test_session.yml   |  2 +-
 python/pyspark/sql/types.py                        | 12 +++---
 python/pyspark/sql/udf.py                          | 11 +++---
 python/pyspark/sql/utils.py                        | 28 ++++++-------
 python/pyspark/sql/window.py                       |  2 +-
 python/pyspark/status.py                           |  4 +-
 python/pyspark/streaming/context.pyi               |  2 +-
 python/pyspark/streaming/kinesis.py                |  2 +-
 python/pyspark/taskcontext.py                      |  2 +-
 python/pyspark/testing/mlutils.py                  |  4 +-
 python/pyspark/testing/pandasutils.py              |  4 +-
 python/pyspark/testing/streamingutils.py           |  2 +-
 python/pyspark/tests/test_context.py               |  2 +-
 python/pyspark/tests/test_serializers.py           |  2 +-
 python/pyspark/util.py                             |  2 +-
 python/pyspark/worker.py                           |  2 +-
 101 files changed, 330 insertions(+), 381 deletions(-)

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Reply via email to