Re: Datasets combineByKey

2016-04-10 Thread Koert Kuipers 
yes it is
On Apr 10, 2016 3:17 PM, "Amit Sela"  wrote:

> I think *org.apache.spark.sql.expressions.Aggregator* is what I'm looking
> for, makes sense ?
>
> On Sun, Apr 10, 2016 at 4:08 PM Amit Sela  wrote:
>
>> I'm mapping RDD API to Datasets API and I was wondering if I was missing
>> something or is this functionality is missing.
>>
>>
>> On Sun, Apr 10, 2016 at 3:00 PM Ted Yu  wrote:
>>
>>> Haven't found any JIRA w.r.t. combineByKey for Dataset.
>>>
>>> What's your use case ?
>>>
>>> Thanks
>>>
>>> On Sat, Apr 9, 2016 at 7:38 PM, Amit Sela  wrote:
>>>
 Is there (planned ?) a combineByKey support for Dataset ?
 Is / Will there be a support for combiner lifting ?

 Thanks,
 Amit

>>>
>>>

Re: Datasets combineByKey

2016-04-10 Thread Amit Sela 
I think *org.apache.spark.sql.expressions.Aggregator* is what I'm looking
for, makes sense ?

On Sun, Apr 10, 2016 at 4:08 PM Amit Sela  wrote:

> I'm mapping RDD API to Datasets API and I was wondering if I was missing
> something or is this functionality is missing.
>
>
> On Sun, Apr 10, 2016 at 3:00 PM Ted Yu  wrote:
>
>> Haven't found any JIRA w.r.t. combineByKey for Dataset.
>>
>> What's your use case ?
>>
>> Thanks
>>
>> On Sat, Apr 9, 2016 at 7:38 PM, Amit Sela  wrote:
>>
>>> Is there (planned ?) a combineByKey support for Dataset ?
>>> Is / Will there be a support for combiner lifting ?
>>>
>>> Thanks,
>>> Amit
>>>
>>
>>

Re: Datasets combineByKey

2016-04-10 Thread Amit Sela 
I'm mapping RDD API to Datasets API and I was wondering if I was missing
something or is this functionality is missing.

On Sun, Apr 10, 2016 at 3:00 PM Ted Yu  wrote:

> Haven't found any JIRA w.r.t. combineByKey for Dataset.
>
> What's your use case ?
>
> Thanks
>
> On Sat, Apr 9, 2016 at 7:38 PM, Amit Sela  wrote:
>
>> Is there (planned ?) a combineByKey support for Dataset ?
>> Is / Will there be a support for combiner lifting ?
>>
>> Thanks,
>> Amit
>>
>
>

Re: Datasets combineByKey

2016-04-10 Thread Ted Yu 
Haven't found any JIRA w.r.t. combineByKey for Dataset.

What's your use case ?

Thanks

On Sat, Apr 9, 2016 at 7:38 PM, Amit Sela  wrote:

> Is there (planned ?) a combineByKey support for Dataset ?
> Is / Will there be a support for combiner lifting ?
>
> Thanks,
> Amit
>

Datasets combineByKey

2016-04-09 Thread Amit Sela 
Is there (planned ?) a combineByKey support for Dataset ?
Is / Will there be a support for combiner lifting ?

Thanks,
Amit