The short answer is yes.
How you do it depends on a number of factors. Assuming you want to build an RDD
from the responses and then analyze the responses using Spark core (not Spark
Streaming), here is one simple way to do it:
1) Implement a class or function that connects to a web service and
Try something like the following.
Create a function to make the HTTP call, e.g.
using org.apache.commons.httpclient.HttpClient as in below.
def getUrlAsString(url: String): String = {
val client = new org.apache.http.impl.client.DefaultHttpClient()
val request = new
Hi Kaspar,
This is definitely doable, but in my opinion, it's important to remember
that, at its core, Spark is based around a functional programming paradigm
- you're taking input sets of data and, by applying various
transformations, you end up with a dataset that represents your answer.
