Hi, what do you mean by pretty small ? How big is your file ? Regards,
Olivier. 2014-10-21 6:01 GMT+02:00 Kevin Jung <itsjb.j...@samsung.com>: > I use Spark 1.1.0 and set these options to spark-defaults.conf > spark.scheduler.mode FAIR > spark.cores.max 48 > spark.default.parallelism 72 > > Thanks, > Kevin > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/default-parallelism-bug-tp16787p16894.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
