Re: How to use scala.math.Ordering in java

2016-02-13 Thread shcher
JavaPaidRDD class creates instances of scala.math.Ordering. I've been able to view the code with Fernflower decompiler in IntelliJ IDEA. For K=Integer, one can do: "Ordering ordering = Ordering$.MODULE$.comparatorToOrdering(Comparator.naturalOrder())" or implement Comparator directly. But

Re: How to use scala.math.Ordering in java

2016-01-21 Thread Dave
Thanks Ted. On 20/01/16 18:24, Ted Yu wrote: Please take a look at the following files for some examples: sql/core/src/main/java/org/apache/spark/sql/execution/UnsafeKVExternalSorter.java sql/catalyst/src/main/java/org/apache/spark/sql/execution/UnsafeExternalRowSorter.java Cheers On Wed,

Re: How to use scala.math.Ordering in java

2016-01-20 Thread Ted Yu
Please take a look at the following files for some examples: sql/core/src/main/java/org/apache/spark/sql/execution/UnsafeKVExternalSorter.java sql/catalyst/src/main/java/org/apache/spark/sql/execution/UnsafeExternalRowSorter.java Cheers On Wed, Jan 20, 2016 at 1:03 AM, ddav

How to use scala.math.Ordering in java

2016-01-20 Thread ddav
Hi, I am writing my Spark application in java and I need to use a RangePartitioner. JavaPairRDD progRef1 = sc.textFile(programReferenceDataFile, 12).filter( (String s) -> !s.startsWith("#")).mapToPair(