Re: Re: is there any easier way to define a custom RDD in Java

2015-05-25 Thread Ted Yu
Please take a look at: core/src/main/scala/org/apache/spark/api/java/JavaRDD.scala core/src/test/java/org/apache/spark/JavaJdbcRDDSuite.java Cheers On Mon, May 25, 2015 at 8:39 PM, swaranga sarma.swara...@gmail.com wrote: Has this changed now? Can a new RDD be implemented in Java? --

is there any easier way to define a custom RDD in Java

2014-06-04 Thread bluejoe2008
hi, folks, is there any easier way to define a custom RDD in Java? I am wondering if I have to define a new java class which extends RDD from scratch? It is really a hard job for developers! 2014-06-04 bluejoe2008

Re: is there any easier way to define a custom RDD in Java

2014-06-04 Thread Andrew Ash
Just curious, what do you want your custom RDD to do that the normal ones don't? On Wed, Jun 4, 2014 at 6:30 AM, bluejoe2008 bluejoe2...@gmail.com wrote: hi, folks, is there any easier way to define a custom RDD in Java? I am wondering if I have to define a new java class which

Re: is there any easier way to define a custom RDD in Java

2014-06-04 Thread Patrick Wendell
Hey There, This is only possible in Scala right now. However, this is almost never needed since the core API is fairly flexible. I have the same question as Andrew... what are you trying to do with your RDD? - Patrick On Wed, Jun 4, 2014 at 7:49 AM, Andrew Ash and...@andrewash.com wrote: Just

Re: Re: is there any easier way to define a custom RDD in Java

2014-06-04 Thread bluejoe2008
i want to use spark to handle data from non-sql databases (RDF triple store, for example) however, i am not familiar with Scala so i want to know how to create a RdfTriplesRDD rapidly 2014-06-05 bluejoe2008 From: Patrick Wendell Date: 2014-06-05 01:25 To: user Subject: Re: is there any