It seems like threads are created by SQLExecution.withExecutionId, which is called inside BroadcastExchangeExec.scala. When does the plan executor execute a BroadcaseExchange, and is there a way to control the number of threads? We have a job that writes DataFrames to an external DB, and it seems like each task creates as many threads as there are cores.
-- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-are-threads-created-in-SQL-Executor-tp27260.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org
