[ https://issues.apache.org/jira/browse/SPARK-23185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Apache Spark reassigned SPARK-23185: ------------------------------------ Assignee: (was: Apache Spark) > Make the configuration "spark.default.parallelism" can be changed on each SQL > session to decrease empty files > ------------------------------------------------------------------------------------------------------------- > > Key: SPARK-23185 > URL: https://issues.apache.org/jira/browse/SPARK-23185 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 2.2.1 > Reporter: LvDongrong > Priority: Minor > > When execute "insert into ... values ...", many empty files will be > generated.We can change the configuration "spark.default.parallelism" to > decrease the number of empty files.But there are many occasions that we want > to chang the configuration during each session so as not to influence other > sql sentences, like we may use thrift server to excute many sql sentences on > a SQL session. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org