Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/22545 @cloud-fan, do we target this 2.4? Looks it might break an existing app, in particular, when a Python shell creates a session and another shell (like Zeppelin) or another session depends on a configuration in spark context. For instance, the fixed doctest: ```python s1 = SparkSession.builder.config("k1", "v1").getOrCreate() >>> s1 = SparkSession.builder.config("k1", "v1").getOrCreate() >>> s1.conf.get("k1") == s1.sparkContext.getConf().get("k1") == "v1" ``` Looks like a bug but the behaviour change by this looks potentially quite crucial.
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org