Calling a method parallel

Hi All, I want to call a method X(int i) from my Spark program for different values of i. This means. X(1), X(2).. X(n).. Each time it returns the one object. Currently I am doing this sequentially. Is there any way to run these in parallel and I get back the list of objects? Sorry for this

K Means Explanation

Hi All, In the KMeans example provided under mllib, it traverse the outcome of KMeansModel to know the cluster centers like this: KMeansModel model = KMeans.train(points.rdd(), k, iterations, runs, KMeans.K_MEANS_PARALLEL()); System.out.println("Cluster centers:"); for (Vector center :

Iterating over JavaRDD

Hi All, I am a newbie. I want to achieve following scenario. I would like to iterate over a JavaRDD of Complex type (user defined class, say X). I need to calculate the sum of integers stored in X and return. Which method do I need to call of JavaRDD? Thanks -- View this message in context:

Re: Reading Binary files in Spark program

at 12:42 PM, Akhil Das ak...@sigmoidanalytics.com wrote: If you can share the complete code and a sample file, may be i can try to reproduce it on my end. Thanks Best Regards On Wed, May 20, 2015 at 7:00 AM, Tapan Sharma tapan.sha...@gmail.com wrote: Problem is still there. Exception

Reading Binary files in Spark program

Hi Team, I am new to Spark and learning. I am trying to read image files into spark job. This is how I am doing: Step 1. Created sequence files with FileName as Key and Binary image as value. i.e. Text and BytesWritable. I am able to read these sequence files into Map Reduce programs. Step 2. I

Re: Reading Binary files in Spark program

, org.apache.hadoop.mapreduce.lib.input.SequenceFileInputFormat.class, IntWritable.class, Text.class, new Job().getConfiguration()); With the type of input format that you require. Thanks Best Regards On Tue, May 19, 2015 at 3:57 PM, Tapan Sharma tapan.sha...@gmail.com wrote: Hi Team, I am new to Spark

Re: Reading Binary files in Spark program

().getConfiguration()); With the type of input format that you require. Thanks Best Regards On Tue, May 19, 2015 at 3:57 PM, Tapan Sharma tapan.sha...@gmail.com wrote: Hi Team, I am new to Spark and learning. I am trying to read image files into spark job. This is how I am doing: Step 1. Created