Thanks Imran. That's exactly what I needed to know.
Darin.
From: Imran Rashid iras...@cloudera.com
To: Darin McBeath ddmcbe...@yahoo.com
Cc: User user@spark.apache.org
Sent: Tuesday, February 17, 2015 8:35 PM
Subject: Re: How do you get the partitioner for
a JavaRDD is just a wrapper around a normal RDD defined in scala, which is
stored in the rdd field. You can access everything that way. The
JavaRDD wrappers just provide some interfaces that are a bit easier to work
with in Java.
If this is at all convincing, here's me demonstrating it inside
In an 'early release' of the Learning Spark book, there is the following
reference:
In Scala and Java, you can determine how an RDD is partitioned using its
partitioner property (or partitioner() method in Java)
However, I don't see the mentioned 'partitioner()' method in Spark 1.2 or a way
Where did you look?
BTW, it is defined in the RDD class as a val:
val partitioner: Option[Partitioner]
Mohammed
-Original Message-
From: Darin McBeath [mailto:ddmcbe...@yahoo.com.INVALID]
Sent: Tuesday, February 17, 2015 1:45 PM
To: User
Subject: How do you get the partitioner for
