Tian Gao created SPARK-55020:
--------------------------------
Summary: SparkConnect triggers a gRPC call at arbitrary time
Key: SPARK-55020
URL: https://issues.apache.org/jira/browse/SPARK-55020
Project: Spark
Issue Type: Bug
Components: Connect, PySpark
Affects Versions: 4.1.0
Reporter: Tian Gao
We had a flaky test pyspark/ml/tests/test_clustering.py:test_distributed_lda
and it turned out to be a deadlock issue for our design. try_remote_del can
execute anytime and it issues a gRPC command which caused the deadlock. We
can't just send random gRPC command in `__del__`
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
