RE: Difference between textFile Vs hadoopFile (textInoutFormat) on HDFS data

2015-04-08 Thread Puneet Kumar Ojha
Thanks

From: Nick Pentreath [mailto:nick.pentre...@gmail.com]
Sent: Tuesday, April 07, 2015 5:52 PM
To: Puneet Kumar Ojha
Cc: user@spark.apache.org
Subject: Re: Difference between textFile Vs hadoopFile (textInoutFormat) on 
HDFS data

There is no difference - textFile calls hadoopFile with a TextInputFormat, and 
maps each value to a String.

—
Sent from Mailboxhttps://www.dropbox.com/mailbox


On Tue, Apr 7, 2015 at 1:46 PM, Puneet Kumar Ojha 
puneet.ku...@pubmatic.commailto:puneet.ku...@pubmatic.com wrote:
Hi ,


Is there any difference between Difference between textFile Vs hadoopFile 
(textInoutFormat) when data is present in HDFS? Will there be any performance 
gain that can be observed?


Puneet Kumar Ojha
Data Architect | PubMatichttp://www.pubmatic.com/





Re: Difference between textFile Vs hadoopFile (textInoutFormat) on HDFS data

2015-04-07 Thread Nick Pentreath
There is no difference - textFile calls hadoopFile with a TextInputFormat, and 
maps each value to a String. 



—
Sent from Mailbox

On Tue, Apr 7, 2015 at 1:46 PM, Puneet Kumar Ojha
puneet.ku...@pubmatic.com wrote:

 Hi ,
 Is there any difference between Difference between textFile Vs hadoopFile 
 (textInoutFormat) when data is present in HDFS? Will there be any performance 
 gain that can be observed?
 Puneet Kumar Ojha
 Data Architect | PubMatichttp://www.pubmatic.com/