Hi,
I am using a library that parses Ais Messages. My code which follows the
simple steps gives me null values in Date field.
1) Get the message from file.
2) parse the message.
3) map the message RDD to only keep the (Date, SomeInfo)
4) take top 100 element.
Result = the Date field appears fine
Correction to my question. (5) should read
5) save the tuple RDD(created at step 3) to HDFS using SaveAsTextFile.
Can someone please guide me in the right direction?
Thanks in advance
Manas
-
Manas Kar
--
View this message in context:
Correction to my question. (5) should read
5) save the tuple RDD(created at step 3) to HDFS using SaveAsTextFile.
Can someone please guide me in the right direction?
Thanks in advance
Manas
On Fri, Oct 3, 2014 at 11:42 PM, manasdebashiskar [via Apache Spark User
List]