Ron,
On Tue, Sep 9, 2014 at 11:27 AM, Ron's Yahoo! zlgonza...@yahoo.com.invalid
wrote:
I’m trying to figure out how I can run Spark Streaming like an API.
The goal is to have a synchronous REST API that runs the spark data flow
on YARN.
I guess I *may* develop something similar in the
Tobias,
Let me explain a little more.
I want to create a synchronous REST API that will process some data that is
passed in as some request.
I would imagine that the Spark Streaming Job on YARN is a long running job
that waits on requests from something. What that something is is still not
Tobias,
Let me explain a little more.
I want to create a synchronous REST API that will process some data that is
passed in as some request.
I would imagine that the Spark Streaming Job on YARN is a long running job
that waits on requests from something. What that something is is still not
Hi,
On Tue, Sep 9, 2014 at 12:59 PM, Ron's Yahoo! zlgonza...@yahoo.com wrote:
I want to create a synchronous REST API that will process some data that
is passed in as some request.
I would imagine that the Spark Streaming Job on YARN is a long
running job that waits on requests from
Hi Tobias,
So I guess where I was coming from was the assumption that starting up a new
job to be listening on a particular queue topic could be done asynchronously.
For example, let’s say there’s a particular topic T1 in a Kafka queue. If I
have a new set of requests coming from a
Hi,
On Tue, Sep 9, 2014 at 2:02 PM, Ron's Yahoo! zlgonza...@yahoo.com wrote:
So I guess where I was coming from was the assumption that starting up a
new job to be listening on a particular queue topic could be done
asynchronously.
No, with the current state of Spark Streaming, all data
