Hi I am also curious about this question. The textFile function was supposed to read a hdfs file? In this case ,It is on local filesystem that the file was taken in.There are any recognization ways to identify the local filesystem and the hdfs in the textFile function?
Beside, the OOM exeception is really strange. Keeping eyes on this. 2014-04-25 13:10 GMT+08:00 Sean Owen <so...@cloudera.com>: > On Fri, Apr 25, 2014 at 2:20 AM, wxhsdp <wxh...@gmail.com> wrote: > > 14/04/25 08:38:36 WARN util.NativeCodeLoader: Unable to load > native-hadoop > > library for your platform... using builtin-java classes where applicable > > 14/04/25 08:38:36 WARN snappy.LoadSnappy: Snappy native library not > loaded > > Since this comes up regularly -- these warnings from Hadoop are > entirely safe to ignore for development and testing. >
