Hi, Why there is an restriction on max file size that can be read by wholeTextFile() method.
I can read a 1.5 gigs file but get Out of memory for 2 gig file. Also, how can I raise this as an defect in spark jira. Can someone please guide. Thanks, Pradeep --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org