Hi,
I have an RDD with <S,Tuple2<I,List>> which I want to reduceByKey and get
I+I and List of List
(add the integers and build a list of the lists.
BUT reduce by key requires that the return value is of the same type of the
input
so I can combine the lists.
JavaPairRDD<String,Tuple2<Integer*,List<*List<String>>>> callCount =
byCaller.*reduceByKey*(
new
Function2<Tuple2<Integer,List<String>>,Tuple2<Integer,List<String>>,Tuple2<Integer,List<List<String>>>>(){
public Tuple2<Integer,List<List<String>>> call(Tuple2<Integer,List<String>>
i1,Tuple2<Integer,List<String>> i2){
Integer count = i1._1+i2._1;
List<List<String>> combinedList = new ArrayList<List<String>>(2);
combinedList.add(i1._2);
combinedList.add(i2._2);
return new Tuple2(count,combinedList);
}
any solution for that?
--
Eran | CTO
