Hi,

Why there is an restriction on max file size that can be read by 
wholeTextFile() method.

I can read a 1.5 gigs file but get Out of memory for 2 gig file. 

Also, how can I raise this as an defect in spark jira. Can someone please guide.

Thanks,
Pradeep

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Reply via email to