You mean `spark.sql.shuffle.partitions`? http://spark.apache.org/docs/latest/sql-programming-guide.html#other-configuration-options
// maropu On Fri, Jul 1, 2016 at 8:42 AM, emiretsk <eugene.miret...@gmail.com> wrote: > It seems like threads are created by SQLExecution.withExecutionId, which is > called inside BroadcastExchangeExec.scala. > When does the plan executor execute a BroadcaseExchange, and is there a way > to control the number of threads? We have a job that writes DataFrames to > an > external DB, and it seems like each task creates as many threads as there > are cores. > > > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/How-are-threads-created-in-SQL-Executor-tp27260.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > > -- --- Takeshi Yamamuro
