Re: [External Sender] Having access to spark results

2018-10-25 Thread Affan Syed
Femi, We have a solution that needs to be both on-prem and also in the cloud. Not sure how that impacts anything, what we want is to run an analytical query on a large dataset (ours is over Cassandra) -- so batch in that sense, but think on-demand --- and then have the result be entirely (not

Fwd: Having access to spark results

2018-10-25 Thread onmstester onmstester
What about using cache() or save as a global temp tableĀ  for subsequent access? Sent using Zoho Mail Forwarded message From : Affan Syed To : "spark users" Date : Thu, 25 Oct 2018 10:58:43 +0330 Subject : Having access to spark results Forward

Re: [External Sender] Having access to spark results

2018-10-25 Thread Femi Anthony
What sort of environment are you running Spark on - in the cloud, on premise ? Is its a real-time or batch oriented application? Please provide more details. Femi On Thu, Oct 25, 2018 at 3:29 AM Affan Syed wrote: > Spark users, > We really would want to get an input here about how the results

Having access to spark results

2018-10-25 Thread Affan Syed
Spark users, We really would want to get an input here about how the results from a Spark Query will be accessible to a web-application. Given Spark is a well used in the industry I would have thought that this part would have lots of answers/tutorials about it, but I didnt find anything. Here