Hey people, sortByKey is not lazy evaluated in spark because of it will use rang partition but i have one confusion it will load whole data from source or only sample data. so if i use sortByKey it will get whole data in memory or only sample so second time when i run real action it will load the whole data in memory
-- Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org