Re: Null values in Date field only when RDD is saved as File.

2014-10-03 Thread manasdebashiskar
l, your message will be added to the discussion > below: > > http://apache-spark-user-list.1001560.n3.nabble.com/Null-values-in-Date-field-only-when-RDD-is-saved-as-File-tp15727p15729.html > To start a new topic under Apache Spark User List, email > ml-node+s1001560n1...@n3.nabb

Re: Null values in Date field only when RDD is saved as File.

2014-10-03 Thread manasdebashiskar
/Null-values-in-Date-field-only-when-RDD-is-saved-as-File-tp15727p15729.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional

Null values in Date field only when RDD is saved as File.

2014-10-03 Thread Manas Kar
Hi, I am using a library that parses Ais Messages. My code which follows the simple steps gives me null values in Date field. 1) Get the message from file. 2) parse the message. 3) map the message RDD to only keep the (Date, SomeInfo) 4) take top 100 element. Result = the Date field appears fine