Re: conversion from java collection type to scala JavaRDD

Sat, 04 Apr 2015 04:57:07 -0700

Hi I have tried with parallelize but i got the below exception

java.io.NotSerializableException: pacific.dr.VendorRecord

Here is my code

List<VendorRecord>
vendorRecords=blockingKeys.getMatchingRecordsWithscan(matchKeysOutput);
JavaRDD<VendorRecord> lines = sc.parallelize(vendorRecords)


On 2 April 2015 at 21:11, Dean Wampler <deanwamp...@gmail.com> wrote:

> Use JavaSparkContext.parallelize.
>
>
> http://spark.apache.org/docs/latest/api/java/org/apache/spark/api/java/JavaSparkContext.html#parallelize(java.util.List)
>
> Dean Wampler, Ph.D.
> Author: Programming Scala, 2nd Edition
> <http://shop.oreilly.com/product/0636920033073.do> (O'Reilly)
> Typesafe <http://typesafe.com>
> @deanwampler <http://twitter.com/deanwampler>
> http://polyglotprogramming.com
>
> On Thu, Apr 2, 2015 at 11:33 AM, Jeetendra Gangele <gangele...@gmail.com>
> wrote:
>
>> Hi All
>> Is there an way to make the JavaRDD<Object> from existing java collection
>> type List<Object>?
>> I know this can be done using scala , but i am looking how to do this
>> using java.
>>
>>
>> Regards
>> Jeetendra
>>
>
>

Reply via email to