This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 4e31000 [SPARK-38204][SS] Use StatefulOpClusteredDistribution for
stateful operators with respecting backward compatibility
add f84018a [SPARK-38424][PYTHON] Warn unused casts and ignores
No new revisions were added by this update.
Summary of changes:
dev/lint-python | 1 -
examples/src/main/python/als.py | 4 +-
examples/src/main/python/kmeans.py | 5 ++-
examples/src/main/python/logistic_regression.py | 8 ++--
.../ml/estimator_transformer_param_example.py | 2 +-
examples/src/main/python/ml/pipeline_example.py | 2 +-
examples/src/main/python/pagerank.py | 11 ++++--
examples/src/main/python/pi.py | 2 +-
examples/src/main/python/sql/arrow.py | 36 +++++++++--------
examples/src/main/python/sql/basic.py | 6 +--
examples/src/main/python/sql/datasource.py | 18 ++++-----
.../structured_network_wordcount_windowed.py | 2 +-
examples/src/main/python/status_api_demo.py | 15 ++++---
.../python/streaming/network_wordjoinsentiments.py | 3 +-
.../streaming/recoverable_network_wordcount.py | 15 ++++---
.../main/python/streaming/sql_network_wordcount.py | 8 ++--
.../python/streaming/stateful_network_wordcount.py | 3 +-
examples/src/main/python/transitive_closure.py | 5 ++-
python/mypy.ini | 2 +
python/pyspark/conf.py | 4 +-
python/pyspark/context.py | 46 ++++++++--------------
python/pyspark/ml/classification.pyi | 2 +-
python/pyspark/ml/clustering.py | 2 +-
python/pyspark/ml/common.py | 8 ++--
python/pyspark/ml/feature.pyi | 2 +-
python/pyspark/ml/fpm.py | 2 +-
python/pyspark/ml/param/__init__.py | 3 +-
python/pyspark/ml/pipeline.py | 2 +-
python/pyspark/ml/regression.py | 18 ++++-----
python/pyspark/ml/stat.py | 4 +-
python/pyspark/ml/tests/test_wrapper.py | 2 +-
python/pyspark/ml/tree.py | 4 +-
python/pyspark/ml/tuning.py | 8 ++--
python/pyspark/ml/util.py | 8 +---
python/pyspark/ml/wrapper.py | 2 +-
python/pyspark/mllib/classification.py | 8 ++--
python/pyspark/mllib/clustering.pyi | 2 +-
python/pyspark/mllib/common.py | 8 ++--
python/pyspark/mllib/feature.py | 2 +-
python/pyspark/mllib/linalg/__init__.py | 2 +-
python/pyspark/mllib/regression.py | 12 ++----
python/pyspark/mllib/tests/test_linalg.py | 2 +-
python/pyspark/mllib/tests/test_util.py | 2 +-
python/pyspark/pandas/accessors.py | 4 +-
python/pyspark/pandas/base.py | 2 +-
python/pyspark/pandas/data_type_ops/complex_ops.py | 2 +-
.../pyspark/pandas/data_type_ops/datetime_ops.py | 2 +-
python/pyspark/pandas/frame.py | 6 +--
python/pyspark/pandas/generic.py | 5 +--
python/pyspark/pandas/groupby.py | 12 +++---
python/pyspark/pandas/indexes/base.py | 23 +++++------
python/pyspark/pandas/indexing.py | 6 +--
python/pyspark/pandas/internal.py | 2 +-
python/pyspark/pandas/ml.py | 6 +--
python/pyspark/pandas/plot/core.py | 2 +-
python/pyspark/pandas/series.py | 17 ++++----
python/pyspark/pandas/spark/functions.py | 4 +-
python/pyspark/pandas/tests/test_dataframe.py | 2 +-
python/pyspark/pandas/utils.py | 2 +-
python/pyspark/rdd.py | 13 ++----
python/pyspark/resource/profile.py | 12 +++---
python/pyspark/resource/requests.py | 6 +--
python/pyspark/serializers.py | 4 +-
python/pyspark/shell.py | 4 +-
python/pyspark/shuffle.py | 2 +-
python/pyspark/sql/avro/functions.py | 2 +-
python/pyspark/sql/catalog.py | 2 +-
python/pyspark/sql/column.py | 22 +++--------
python/pyspark/sql/conf.py | 4 +-
python/pyspark/sql/context.py | 10 ++---
python/pyspark/sql/dataframe.py | 37 +++++++----------
python/pyspark/sql/functions.py | 4 +-
python/pyspark/sql/group.py | 2 +-
python/pyspark/sql/observation.py | 2 +-
python/pyspark/sql/pandas/_typing/__init__.pyi | 2 +-
python/pyspark/sql/pandas/conversion.py | 20 +++++-----
python/pyspark/sql/pandas/functions.pyi | 12 ++++--
python/pyspark/sql/pandas/group_ops.py | 6 +--
python/pyspark/sql/pandas/map_ops.py | 2 +-
python/pyspark/sql/readwriter.py | 26 ++++--------
python/pyspark/sql/session.py | 20 +++++-----
python/pyspark/sql/sql_formatter.py | 4 +-
python/pyspark/sql/streaming.py | 6 +--
python/pyspark/sql/tests/test_functions.py | 2 +-
python/pyspark/sql/tests/test_types.py | 2 +-
python/pyspark/sql/tests/typing/test_session.yml | 2 +-
python/pyspark/sql/types.py | 12 +++---
python/pyspark/sql/udf.py | 11 +++---
python/pyspark/sql/utils.py | 28 ++++++-------
python/pyspark/sql/window.py | 2 +-
python/pyspark/status.py | 4 +-
python/pyspark/streaming/context.pyi | 2 +-
python/pyspark/streaming/kinesis.py | 2 +-
python/pyspark/taskcontext.py | 2 +-
python/pyspark/testing/mlutils.py | 4 +-
python/pyspark/testing/pandasutils.py | 4 +-
python/pyspark/testing/streamingutils.py | 2 +-
python/pyspark/tests/test_context.py | 2 +-
python/pyspark/tests/test_serializers.py | 2 +-
python/pyspark/util.py | 2 +-
python/pyspark/worker.py | 2 +-
101 files changed, 330 insertions(+), 381 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
