Hi ,
I have the following rdd :
val conf = new SparkConf()
.setAppName( Testing Sorting )
val sc = new SparkContext(conf)
val L = List(
(new Student(XiaoTao, 80, 29), I'm Xiaotao),
(new Student(CCC, 100, 24), I'm CCC),
(new Student(Jack, 90, 25), I'm Jack),
See the scaladoc for how to define an implicit ordering to use with sortByKey:
http://spark.apache.org/docs/latest/api/scala/index.html#org.apache.spark.rdd.OrderedRDDFunctions
Off the top of my head, I think this is 90% correct to order by age for example:
implicit val studentOrdering:
You only need to define an ordering of student, no need to modify the class
definition of student. It's like a Comparator class in java.
Currently, you have to map the rdd to sort by value.
Liquan
On Wed, Sep 24, 2014 at 9:52 AM, Sean Owen so...@cloudera.com wrote:
See the scaladoc for how to
