Re: status of spark analytics functions? over, rank, percentile, row_number, etc.

2015-01-10 Thread Will Benton
Hi Kevin, I'm currently working on implementing windowing. If you'd like to see something that's not covered by a JIRA, please file one! best, wb - Original Message - From: Kevin Burton bur...@spinn3r.com To: user@spark.apache.org Sent: Saturday, January 10, 2015 12:12:38 PM

Some techniques for improving application performance

2014-09-10 Thread Will Benton
Spark friends, I recently wrote up a blog post with examples of some of the standard techniques for improving Spark application performance: http://chapeau.freevariable.com/2014/09/improving-spark-application-performance.html The idea is that we start with readable but poorly-performing

Re: How to create a RPM package

2014-04-07 Thread Will Benton
For issue #2 I was concerned that the build packaging had to be internal. So I am using the already packaged make-distribution.sh (modified to use a maven build) to create a tar ball which I then package it using a RPM spec file. Hi Rahul, so the issue for downstream operating system

Re: How to create a RPM package

2014-04-05 Thread Will Benton
Hi Rahul, As Christophe pointed out, Spark has been in Fedora Rawhide (which will become Fedora 21) for a little while now. (I haven't announced it here because Rawhide is a little too bleeding-edge for most end-users.) With native packages of any kind, there are a couple of considerations: