Very interested, Evan, thanks for the link. It has given me some food for thought.
I’m also in the process of building a web application which leverage Spark on the back-end for some heavy lifting. I would be curious about your thoughts on my proposed architecture: I was planning on running a spark-streaming app which listens for incoming messages on a dedicated queue, and then returns them on a separate one. The RESTful web service would handle incoming requests by putting an appropriate message on the input queue, and then listen for a response on the output queue, transforming the output message into an appropriate HTTP response. How do you think this will fair vs. interacting with the spark job service? I was hoping that I could minimize the time to launch spark jobs by keeping a streaming app running in the background. > On Mar 10, 2016, at 12:40 PM, velvia.github <velvia.git...@gmail.com> wrote: > > Hi, > > I just wrote a blog post which might be really useful to you -- I have just > benchmarked being able to achieve 700 queries per second in Spark. So, yes, > web speed SQL queries are definitely possible. Read my new blog post: > > http://velvia.github.io/Spark-Concurrent-Fast-Queries/ > > and feel free to email me (at vel...@gmail.com) if you would like to follow > up. > > -Evan > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Can-we-use-spark-inside-a-web-service-tp26426p26451.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
