Re: Extend Dataframe API

2016-07-08 Thread Rishi Mishra 
Or , you can extend SQLContext to add your plans . Not sure if it fits your
requirement , but answered to highlight an option.

Regards,
Rishitesh Mishra,
SnappyData . (http://www.snappydata.io/)

https://in.linkedin.com/in/rishiteshmishra

On Thu, Jul 7, 2016 at 8:39 PM, tan shai  wrote:

> That was what I am thinking to do.
>
> Do you have any idea about this? Or any documentations?
>
> Many thanks.
>
> 2016-07-07 17:07 GMT+02:00 Koert Kuipers :
>
>> i dont see any easy way to extend the plans, beyond creating a custom
>> version of spark.
>>
>> On Thu, Jul 7, 2016 at 9:31 AM, tan shai  wrote:
>>
>>> Hi,
>>>
>>> I need to add new operations to the dataframe API.
>>> Can any one explain to me how to extend the plans of query execution?
>>>
>>> Many thanks.
>>>
>>
>>
>

Re: Extend Dataframe API

2016-07-07 Thread tan shai 
That was what I am thinking to do.

Do you have any idea about this? Or any documentations?

Many thanks.

2016-07-07 17:07 GMT+02:00 Koert Kuipers :

> i dont see any easy way to extend the plans, beyond creating a custom
> version of spark.
>
> On Thu, Jul 7, 2016 at 9:31 AM, tan shai  wrote:
>
>> Hi,
>>
>> I need to add new operations to the dataframe API.
>> Can any one explain to me how to extend the plans of query execution?
>>
>> Many thanks.
>>
>
>

Re: Extend Dataframe API

2016-07-07 Thread Koert Kuipers 
i dont see any easy way to extend the plans, beyond creating a custom
version of spark.

On Thu, Jul 7, 2016 at 9:31 AM, tan shai  wrote:

> Hi,
>
> I need to add new operations to the dataframe API.
> Can any one explain to me how to extend the plans of query execution?
>
> Many thanks.
>