flatmap pair

2016-12-08 Thread im281
The class 'Detector' has a function 'detectFeature(cluster) However, the method has changed to return a list of features as opposed to one feature as it is below. How do I change this so it returns a list of feature objects instead // creates key-value pairs for Isotope cluster ID and Isotope

Running spark from Eclipse and then Jar

2016-12-07 Thread im281
Hello, I have a simple word count example in Java and I can run this in Eclipse (code at the bottom) I then create a jar file from it and try to run it from the cmd java -jar C:\Users\Owner\Desktop\wordcount.jar Data/testfile.txt But I get this error? I think the main error is: *Exception in

RDD flatmap to multiple key/value pairs

2016-12-02 Thread im281
Here is a MapReduce Example implemented in Java. It reads each line of text and for each word in the line of text determines if it starts with an upper case. If so, it creates a key value pair public class CountUppercaseMapper extends Mapper { @Override

TallSkinnyQR

2016-11-07 Thread im281
I am getting the correct rows but they are out of order. Is this a bug or am I doing something wrong? public class CoordinateMatrixDemo { public static void main(String[] args) { //boiler plate needed to run locally SparkConf conf = new

Re: mLIb solving linear regression with sparse inputs

2016-11-06 Thread im281
Publications Co. http://www.manning.com/books/spark-graphx-in-action On 3 Nov 2016, at 18:12, im281 [via Apache Spark User List] <[hidden email] <http:///user/SendEmail.jtp?type=node=28027=0>> wrote: I would like to use it. But how do I do the following 1) Read sparse d

Re: mLIb solving linear regression with sparse inputs

2016-11-06 Thread im281
> One point: In the example you give the b’s are exactly the same as col 2 > in the A matrix. I presume this is just a quick hacked together example > because that would give a trivial result. > > > ---

Re: mLIb solving linear regression with sparse inputs

2016-11-06 Thread im281
ogether example because that would give a trivial result. ---Robin EastSpark GraphX in Action Michael Malak and Robin EastManning Publications Co.http://www.manning.com/books/spark-graphx-in-action On 3 Nov 2016, at 18:12, im281 [via Apache Spark User List] <[hidden email]> wrote: