JavaPaidRDD class creates instances of scala.math.Ordering.
I've been able to view the code with Fernflower decompiler in IntelliJ IDEA.
For K=Integer, one can do:
"Ordering ordering =
Ordering$.MODULE$.comparatorToOrdering(Comparator.naturalOrder())"
or implement Comparator directly.
But
Thanks Ted.
On 20/01/16 18:24, Ted Yu wrote:
Please take a look at the following files for some examples:
sql/core/src/main/java/org/apache/spark/sql/execution/UnsafeKVExternalSorter.java
sql/catalyst/src/main/java/org/apache/spark/sql/execution/UnsafeExternalRowSorter.java
Cheers
On Wed,
Please take a look at the following files for some examples:
sql/core/src/main/java/org/apache/spark/sql/execution/UnsafeKVExternalSorter.java
sql/catalyst/src/main/java/org/apache/spark/sql/execution/UnsafeExternalRowSorter.java
Cheers
On Wed, Jan 20, 2016 at 1:03 AM, ddav
Hi,
I am writing my Spark application in java and I need to use a
RangePartitioner.
JavaPairRDD progRef1 =
sc.textFile(programReferenceDataFile, 12).filter(
(String s) -> !s.startsWith("#")).mapToPair(