Re: Array and RDDs

2014-09-07 Thread Mayur Rustagi
Your question is a bit confusing.. I assume you have a RDD containing nodes some meta data (child nodes maybe) you are trying to attach another metadata to it (bye array). if its just same byte array for all nodes you can generate rdd with the count of nodes zip the two rdd together, you can

Array and RDDs

2014-09-05 Thread Deep Pradhan
Hi, I have an input file which consists of stc_node dest_node I have created and RDD consisting of key-value pair where key is the node id and the values are the children of that node. Now I want to associate a byte with each node. For that I have created a byte array. Every time I print out the