roupBy(0).reduceGroup((v, out : Collector[GenomicRegionType]) =>
> while(v.hasNext) out.collect(v.next))
>
>
> then in my custom output writer, write record checks whether the current
> stream is the right one
> if it is then write
> otherwise close it and open a new one
>
> since
utFormat interface
>>>> in flink which can be extended.
>>>> I believe that for this kind of specific formats as mentioned by
>>>> Michele, each can develop the appropriate format.
>>>> On the other hand, having more outputformats I believe is somethi
, 2015 11:34 AM
To: user@flink.apache.org<mailto:user@flink.apache.org>
Subject: Re: output writer
Hi Michele, hi Radu
Flink does not have such an OutputFormat, but I agree, it would be a valuable
addition.
Radu's approach looks like the way to go to implement this feature.
@Radu, is there a way t
udo...@huawei.com <radu.tudo...@huawei.com>*
>> Mobile: +49 15209084330
>> Telephone: +49 891588344173
>>
>> HUAWEI TECHNOLOGIES Duesseldorf GmbH
>> Hansaallee 205, 40549 Düsseldorf, Germany, www.huawei.com
>> Registered Office: Düsseldorf, Register Cou
gt; (e.g. memory buffer)
>>>
>>>
>>>
>>> Dr. Radu Tudoran
>>> Research Engineer
>>> IT R Division
>>>
>>>
>>> HUAWEI TECHNOLOGIES Duesseldorf GmbH
>>> European Research Center
>>> Riesstrass
dorf, HRB 56063,
Managing Director: Jingwen TAO, Wanzhou MENG, Lifang CHEN
Sitz der Gesellschaft: Düsseldorf, Amtsgericht Düsseldorf, HRB 56063,
Geschäftsführer: Jingwen TAO, Wanzhou MENG, Lifang CHEN
From: Fabian Hueske [mailto:fhue...@gmail.com]
Sent: Thursday, July 30, 2015 11:34 AM
To: user@flink.
lschaft: Düsseldorf, Amtsgericht Düsseldorf, HRB 56063,
> Geschäftsführer: Jingwen TAO, Wanzhou MENG, Lifang CHEN
>
> *From:* Fabian Hueske [mailto:fhue...@gmail.com <fhue...@gmail.com>]
> *Sent:* Thursday, July 30, 2015 11:34 AM
> *To:* user@flink.apache.org
> *Subject:
Düsseldorf, HRB 56063,
Geschäftsführer: Jingwen TAO, Wanzhou MENG, Lifang CHEN
From: Fabian Hueske [mailto:fhue...@gmail.com]
Sent: Thursday, July 30, 2015 11:34 AM
To: user@flink.apache.org<mailto:user@flink.apache.org>
Subject: Re: output writer
Hi Michele, hi Radu
Flink does not have s
Hi everybody,
I have a question about the writer
I have to save my dataset in different files according to a field of the tuples
let’s assume I have a groupId in the tuple, I need to store each group in a
different file, with a custom name: any idea on how i can do that?
thanks!
Michele
, Wanzhou MENG, Lifang CHEN
-Original Message-
From: Michele Bertoni [mailto:michele1.bert...@mail.polimi.it]
Sent: Thursday, July 30, 2015 10:15 AM
To: user@flink.apache.org
Subject: output writer
Hi everybody,
I have a question about the writer
I have to save my dataset in different files
: Düsseldorf, Amtsgericht Düsseldorf, HRB 56063,
Geschäftsführer: Jingwen TAO, Wanzhou MENG, Lifang CHEN
From: Fabian Hueske [mailto:fhue...@gmail.com]
Sent: Thursday, July 30, 2015 11:34 AM
To: user@flink.apache.org
Subject: Re: output writer
Hi Michele, hi Radu
Flink does not have
AM
To: user@flink.apache.org
Subject: Re: output writer
Hi Michele, hi Radu
Flink does not have such an OutputFormat, but I agree, it would be a valuable
addition.
Radu's approach looks like the way to go to implement this feature.
@Radu, is there a way to contribute your OutputFormat to Flink
12 matches
Mail list logo