Re: Ideas on how to use Spark for anomaly detection on a stream of data

2014-11-25 Thread Sean Owen
Yes, and I prepared a basic talk on this exact topic. Slides here: http://www.slideshare.net/srowen/anomaly-detection-with-apache-spark-41975155 This is elaborated in a chapter of an upcoming book that's available in early release; you can look at the accompanying source code to get some ideas

Re: Ideas on how to use Spark for anomaly detection on a stream of data

2014-11-25 Thread Natu Lauchande
Fantastic!!! Exactly what i was looking for. Thanks, Natu On Tue, Nov 25, 2014 at 10:46 AM, Sean Owen so...@cloudera.com wrote: Yes, and I prepared a basic talk on this exact topic. Slides here: http://www.slideshare.net/srowen/anomaly-detection-with-apache-spark-41975155 This is

Ideas on how to use Spark for anomaly detection on a stream of data

2014-11-24 Thread Natu Lauchande
Hi all, I am getting started with Spark. I would like to use for a spike on anomaly detection in a massive stream of metrics. Can Spark easily handle this use case ? Thanks, Natu