Hi,
SortByKey is only for RDD[(K, V)], each tuple can only has two members, Spark
will sort with first member, if you want to use sortByKey, you have to change
your RDD[(String, String, String, String)] into RDD[(String, (String, String,
String))].
Thanks
Jerry
-Original Message-
Hi David,
Can you try val rddToSave = file.map(l = l.split(\\|)).map(r =
(r(34)+-+r(3), (r(4), r(10), r(12 ?
That should work.
Liquan
On Wed, Sep 24, 2014 at 1:29 AM, david david...@free.fr wrote:
Hi,
Does anybody know how to use sortbykey in scala on a RDD like :
val
thank's
i've already try this solution but it does not compile (in Eclipse)
I'm surprise to see that in Spark-shell, sortByKey works fine on 2
solutions :
(String,String,String,String)
(String,(String,String,String))
--
View this message in context:
Try this
Import org.apache.spark.SparkContext._
Thanks.
Zhan Zhang
On Sep 24, 2014, at 6:13 AM, david david...@free.fr wrote:
thank's
i've already try this solution but it does not compile (in Eclipse)
I'm surprise to see that in Spark-shell, sortByKey works fine on 2
solutions :
