Re: Suggestions on Lambda Architecture in Spark

You do not describe use cases, but technologies. First be aware on your needs and then check technologies. Otherwise nobody can help you properly and you will end up with an inefficient stack for your needs. > On 14 Jun 2016, at 00:52, KhajaAsmath Mohammed > wrote: >

Re: Suggestions on Lambda Architecture in Spark

Our labs project oryx is intended to be pretty much a POC of the lambda architecture on Spark (for ML): http://oryx.io/ You might consider reusing bits of that. On Mon, Jun 13, 2016 at 11:52 PM, KhajaAsmath Mohammed wrote: > Hi, > > In my current project, we are planning

Re: Suggestions on Lambda Architecture in Spark

This might be useful: https://spark-summit.org/east-2016/events/lambda-at-weather-scale/ On Monday, June 13, 2016, KhajaAsmath Mohammed wrote: > Hi, > > In my current project, we are planning to implement POC for lambda > architecture using spark streaming. My use case

Suggestions on Lambda Architecture in Spark

Hi, In my current project, we are planning to implement POC for lambda architecture using spark streaming. My use case would be Kafka --> bacth layer --> Saprk SQL --> Cassandra Kafka --> Speed layer --> Spark Streaming --> Cassandra Serving later --> Contact both the layers but I am not sure