.nabble.com/Fwd-How-to-get-the-list-of-available-Transformations-and-actions-for-a-RDD-in-Spark-Shell-tp25565p25582.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail: user-unsubscr
Did a quick test:
rdd2: org.apache.spark.rdd.RDD[(Int, Int)] = MapPartitionsRDD[1] at map at
:29
I think sales_map is MapPartitionsRDD
FYI
On Fri, Dec 4, 2015 at 6:18 AM, Gokula Krishnan D
wrote:
> Thanks Ayan for the updates.
>
> But in my example, I hope "sales_map" is a pair_RDD , isn't it
Thanks Ayan for the updates.
But in my example, I hope "sales_map" is a pair_RDD , isn't it?.
Thanks & Regards,
Gokula Krishnan* (Gokul)*
On Fri, Dec 4, 2015 at 8:16 AM, ayan guha wrote:
> sortByKey() is a property of pairRDD as it requires key value pair to
> work. I think in scala their are
sortByKey() is a property of pairRDD as it requires key value pair to work.
I think in scala their are transformation such as .toPairRDD().
On Sat, Dec 5, 2015 at 12:01 AM, Gokula Krishnan D
wrote:
> Hello All -
>
> In spark-shell when we press tab after . ; we could see the
> possible list of t
Hello All -
In spark-shell when we press tab after . ; we could see the
possible list of transformations and actions.
But unable to see all the list. is there any other way to get the rest of
the list. I'm mainly looking for sortByKey()
val sales_RDD = sc.textFile("Data/Scala/phone_sales.txt")
v
