Re: JavaRDD, Specify number of tasks

2013-12-09 Thread Ashish Rangole
: JavaRDD, Specify number of tasks AFAIK yes. IIRC, there is a 2nd parameter numPartitions that one can provide to these operations. On Dec 9, 2013 8:19 PM, Matt Cheah mch...@palantir.com wrote: Hi When I use a JavaPairRDD's groupByKey(), reduceByKey(), or sortByKey(), is there a way for me

Re: JavaRDD, Specify number of tasks

2013-12-09 Thread Ashish Rangole
/index.html#org.apache.spark.api.java.JavaPairRDD -- *From:* Ashish Rangole [arang...@gmail.com] *Sent:* Monday, December 09, 2013 7:41 PM *To:* user@spark.incubator.apache.org *Subject:* Re: JavaRDD, Specify number of tasks AFAIK yes. IIRC, there is a 2nd parameter