I noticed that my spark application is broadcasting even though I set spark.sql.autoBroadcastJoinThreshold = -1. When I checked the query plan, I noticed that the physical plan was an AdaptiveSparkPlan. When I checked the adaptive settings, I noticed that there was a separate setting, spark.sql.adaptive.autoBroadcastJoinThreshold. I was wondering if the source of the broadcasting was from the adaptive query planner.
Thanks in advance Henry
