Hey, Is the driver running OOM? Try 8g on the driver memory. Speaking of which, how do you estimate that your broadcasted dataset is 500M?
Best, Anastasios Am 29.09.2016 5:32 AM schrieb "WangJianfei" <wangjianfei15@otcaix.iscas. ac.cn>: > First thank you very much！ > My executor memeory is also 4G， but my spark version is 1.5. Does spark > version make a trouble? > > > > > -- > View this message in context: http://apache-spark- > developers-list.1001551.n3.nabble.com/Broadcast-big- > dataset-tp19127p19143.html > Sent from the Apache Spark Developers List mailing list archive at > Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org > >
