[ https://issues.apache.org/jira/browse/SPARK-45738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
xie shuiahu resolved SPARK-45738. --------------------------------- Resolution: Implemented > client will wait forever if session in spark connect server is evicted > ---------------------------------------------------------------------- > > Key: SPARK-45738 > URL: https://issues.apache.org/jira/browse/SPARK-45738 > Project: Spark > Issue Type: Bug > Components: Connect > Affects Versions: 3.5.0 > Reporter: xie shuiahu > Priority: Critical > Labels: pull-request-available, query-lifecycle > > Step1. start a spark connect server > Step2. submit a spark job which will run long > {code:java} > from pyspark.sql import SparkSession > spark = SparkSession.builder.remote(f"sc://HOST:PORT/;user_id=job").create() > spark.sql("A SQL will run longer than creating 100 sessions").show() {code} > > Step3. create more than 100 sessions > Tips: Run concurrently with step2 > {code:java} > for i in range(0, 200): > spark = > SparkSession.builder.remote(f"sc://HOST:PORT/;user_id={i}").create() > spark.sql("show databases") {code} > > *When the python code in step3 is executed, the session created in step2 will > be evicted, and the client will wait forever* > -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org