Re: Secondary Sorting in Spark

2015-10-26 Thread Adrian Tanase
shuffling… -adrian From: swetha kasireddy Date: Monday, October 26, 2015 at 6:56 AM To: Adrian Tanase Cc: Bill Bejeck, "user@spark.apache.org<mailto:user@spark.apache.org>" Subject: Re: Secondary Sorting in Spark Hi, Does the use of custom partitioner in Streaming affect performance

Re: Secondary Sorting in Spark

2015-10-26 Thread swetha kasireddy
f a custom partitioner. >> >> Also, sorting by multiple fields by creating a tuple out of them is an >> awesome, easy to miss, Scala feature. >> >> Sent from my iPhone >> >> On 04 Oct 2015, at 21:41, Bill Bejeck <bbej...@gmail.com> wrote: >> >&

Re: Secondary Sorting in Spark

2015-10-25 Thread swetha kasireddy
is an > awesome, easy to miss, Scala feature. > > Sent from my iPhone > > On 04 Oct 2015, at 21:41, Bill Bejeck <bbej...@gmail.com> wrote: > > I've written blog post on secondary sorting in Spark and I'd thought I'd > share it with the group > > http://codingjunkie.net/spark-secondary-sort/ > > Thanks, > Bill > >

Re: Secondary Sorting in Spark

2015-10-05 Thread Adrian Tanase
I've written blog post on secondary sorting in Spark and I'd thought I'd share it with the group http://codingjunkie.net/spark-secondary-sort/ Thanks, Bill

Re: Secondary Sorting in Spark

2015-10-04 Thread Koert Kuipers
See also https://github.com/tresata/spark-sorted On Oct 5, 2015 3:41 AM, "Bill Bejeck" <bbej...@gmail.com> wrote: > I've written blog post on secondary sorting in Spark and I'd thought I'd > share it with the group > > http://codingjunkie.net/spark-secondary-sort/ > > Thanks, > Bill >

Secondary Sorting in Spark

2015-10-04 Thread Bill Bejeck
I've written blog post on secondary sorting in Spark and I'd thought I'd share it with the group http://codingjunkie.net/spark-secondary-sort/ Thanks, Bill