Re: OData compliant API for Spark

2018-12-06 Thread Affan Syed
ata in > https://ckan.org/. We used Spark for the data pipeline and > transformation. Hih. > > jg > > > On Dec 4, 2018, at 21:14, Affan Syed wrote: > > All, > > We have been thinking about exposing our platform for analytics an OData > server (for its ease of complian

OData compliant API for Spark

2018-12-04 Thread Affan Syed
All, We have been thinking about exposing our platform for analytics an OData server (for its ease of compliance with 3rd party BI tools like Tableau, etc) -- so Livy is not in the picture right now. Has there been any effort on this regards? Is there any interest or has there been any

Re: [External Sender] Having access to spark results

2018-10-25 Thread Affan Syed
What sort of environment are you running Spark on - in the cloud, on > premise ? Is its a real-time or batch oriented application? > Please provide more details. > Femi > > On Thu, Oct 25, 2018 at 3:29 AM Affan Syed wrote: > >> Spark users, >> We really would want to get a

Having access to spark results

2018-10-25 Thread Affan Syed
Spark users, We really would want to get an input here about how the results from a Spark Query will be accessible to a web-application. Given Spark is a well used in the industry I would have thought that this part would have lots of answers/tutorials about it, but I didnt find anything. Here

Re: Spark based Data Warehouse

2017-11-13 Thread Affan Syed
Another option that we are trying internally is to uses Mesos for isolating different jobs or groups. Within a single group, using Livy to create different spark contexts also works. - Affan On Tue, Nov 14, 2017 at 8:43 AM, ashish rawat wrote: > Thanks Sky Yin. This really