Re: Performance benchmarking of Spark Vs other languages

2016-05-02 Thread Jörn Franke
Hallo, Spark is a general framework for distributed in-memory processing. You can always write a highly-specified piece of code which is faster than Spark, but then it can do only one thing and if you need something else you will have to rewrite everything from scratch . This is why Spark is

Performance benchmarking of Spark Vs other languages

2016-05-02 Thread Abhijith Chandraprabhu
Hello, I am trying to find some performance figures of spark vs various other languages for ALS based recommender system. I am using 20 million ratings movielens dataset. The test environment involves one big 30 core machine with 132 GB memory. I am using the scala version of the script provided