[ https://issues.apache.org/jira/browse/SPARK-32991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17201806#comment-17201806 ]
Xiao Li commented on SPARK-32991: --------------------------------- ping [~Qin Yao] [~yumwang] > RESET can clear StaticSQLConfs > ------------------------------ > > Key: SPARK-32991 > URL: https://issues.apache.org/jira/browse/SPARK-32991 > Project: Spark > Issue Type: Improvement > Components: SQL > Affects Versions: 3.0.1 > Reporter: Herman van Hövell > Priority: Major > > The RESET command can clear a sessions' static SQL configurations, when that > static SQL configuration was set on a SparkSession that uses a pre-existing > SparkContext. Here is repro: > {code:java} > // Blow away any pre-existing session thread locals > org.apache.spark.sql.SparkSession.clearDefaultSession() > org.apache.spark.sql.SparkSession.clearActiveSession() > // Create new session and explicitly set a spark context > val newSession = org.apache.spark.sql.SparkSession.builder > .sparkContext(sc) > .config("spark.sql.globalTempDatabase", "bob") > .getOrCreate() > assert(newSession.conf.get("spark.sql.globalTempDatabase") == "bob") > newSession.sql("reset") > assert(newSession.conf.get("spark.sql.globalTempDatabase") == "bob") // Boom! > {code} > The problem is that RESET assumes it can use the SparkContext's > configurations as its default. > > -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org