Re: broadcast fails on join

fine (btw the grouped dataframe is 1.5MB > when cached in memory and I have more than 4GB per executor with 8 > executors, the full dataframe is ~8GB) > > > > Thanks, > > Assaf. > > > > -- > View this message in context: broadcast fails on join > <http://apache-spark-user-list.1001560.n3.nabble.com/broadcast-fails-on-join-tp27623.html> > Sent from the Apache Spark User List mailing list archive > <http://apache-spark-user-list.1001560.n3.nabble.com/> at Nabble.com. > -- --- Takeshi Yamamuro

broadcast fails on join

ount() before the join everything is fine (btw the grouped dataframe is 1.5MB when cached in memory and I have more than 4GB per executor with 8 executors, the full dataframe is ~8GB) Thanks, Assaf. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble