Re: Fwd: How to get the list of available Transformations and actions for a RDD in Spark-Shell

SortByKey is available for pairedRDD. So if you RDD can be implicitly transformed to a pairedRDD you can do SortByKey then on. This magic is implicitly available if you import org.apache.spark.SparkContext._ -- View this message in context:

How to get the list of available Transformations and actions for a RDD in Spark-Shell

Hello All - In spark-shell when we press tab after . ; we could see the possible list of transformations and actions. But unable to see all the list. is there any other way to get the rest of the list. I'm mainly looking for sortByKey() val sales_RDD = sc.textFile("Data/Scala/phone_sales.txt")

Re: How to get the list of available Transformations and actions for a RDD in Spark-Shell

sortByKey() is a property of pairRDD as it requires key value pair to work. I think in scala their are transformation such as .toPairRDD(). On Sat, Dec 5, 2015 at 12:01 AM, Gokula Krishnan D wrote: > Hello All - > > In spark-shell when we press tab after . ; we could see

Re: How to get the list of available Transformations and actions for a RDD in Spark-Shell

Thanks Ayan for the updates. But in my example, I hope "sales_map" is a pair_RDD , isn't it?. Thanks & Regards, Gokula Krishnan* (Gokul)* On Fri, Dec 4, 2015 at 8:16 AM, ayan guha wrote: > sortByKey() is a property of pairRDD as it requires key value pair to > work. I

Re: How to get the list of available Transformations and actions for a RDD in Spark-Shell

Did a quick test: rdd2: org.apache.spark.rdd.RDD[(Int, Int)] = MapPartitionsRDD[1] at map at :29 I think sales_map is MapPartitionsRDD FYI On Fri, Dec 4, 2015 at 6:18 AM, Gokula Krishnan D wrote: > Thanks Ayan for the updates. > > But in my example, I hope "sales_map" is