icRegionType]) =>
> while(v.hasNext) out.collect(v.next))
>
>
> then in my custom output writer, write record checks whether the current
> stream is the right one
> if it is then write
> otherwise close it and open a new one
>
> since they are grouped, only one stream per slot
pBy(0).reduceGroup((v, out : Collector[GenomicRegionType]) =>
while(v.hasNext) out.collect(v.next))
then in my custom output writer, write record checks whether the current stream
is the right one
if it is then write
otherwise close it and open a new one
since they are grouped, only one stream per slot
Radu Tudoran <
>>>> radu.tudo...@huawei.com> ha scritto:
>>>>
>>>> Re-hi,
>>>>
>>>> I have double –checked and actually there is an OutputFormat interface
>>>> in flink which can be extended.
>>>> I believe t
July 30, 2015 11:34 AM
To: user@flink.apache.org<mailto:user@flink.apache.org>
Subject: Re: output writer
Hi Michele, hi Radu
Flink does not have such an OutputFormat, but I agree, it would be a valuable
addition.
Radu's approach looks like the way to go to implement this feature.
@Rad
ng more outputformats I believe is something that
>>> could be contributed. We should identify a couple of common formats. The
>>> first one that comes in my mind is to have something for writing to memory
>>> (e.g. memory buffer)
>>>
>>>
>>>
>>
anaging Director: Jingwen TAO, Wanzhou MENG, Lifang CHEN
Sitz der Gesellschaft: Düsseldorf, Amtsgericht Düsseldorf, HRB 56063,
Geschäftsführer: Jingwen TAO, Wanzhou MENG, Lifang CHEN
From: Fabian Hueske [mailto:fhue...@gmail.com]
Sent: Thursday, July 30, 2015 11:34 AM
To: user@flink.apache.org<mail
09084330
>> Telephone: +49 891588344173
>>
>> HUAWEI TECHNOLOGIES Duesseldorf GmbH
>> Hansaallee 205, 40549 Düsseldorf, Germany, www.huawei.com
>> Registered Office: Düsseldorf, Register Court Düsseldorf, HRB 56063,
>> Managing Director: Jingwen TAO, Wanzhou MENG,
ursday, July 30, 2015 11:34 AM
To: user@flink.apache.org<mailto:user@flink.apache.org>
Subject: Re: output writer
Hi Michele, hi Radu
Flink does not have such an OutputFormat, but I agree, it would be a valuable
addition.
Radu's approach looks like the way to go to implement this feature.
@Radu,
> Geschäftsführer: Jingwen TAO, Wanzhou MENG, Lifang CHEN
>
> *From:* Fabian Hueske [mailto:fhue...@gmail.com ]
> *Sent:* Thursday, July 30, 2015 11:34 AM
> *To:* user@flink.apache.org
> *Subject:* Re: output writer
>
>
> Hi Michele, hi Radu
> Flink does not have such an Ou
apache.org<mailto:user@flink.apache.org>
Subject: Re: output writer
Hi Michele, hi Radu
Flink does not have such an OutputFormat, but I agree, it would be a valuable
addition.
Radu's approach looks like the way to go to implement this feature.
@Radu, is there a way to contribute y
0, 2015 11:34 AM
To: user@flink.apache.org
Subject: Re: output writer
Hi Michele, hi Radu
Flink does not have such an OutputFormat, but I agree, it would be a valuable
addition.
Radu's approach looks like the way to go to implement this feature.
@Radu, is there a way to contribute your Output
sellschaft: Düsseldorf, Amtsgericht Düsseldorf, HRB 56063,
Geschäftsführer: Jingwen TAO, Wanzhou MENG, Lifang CHEN
From: Fabian Hueske [mailto:fhue...@gmail.com]
Sent: Thursday, July 30, 2015 11:34 AM
To: user@flink.apache.org
Subject: Re: output writer
Hi Michele, hi Radu
Flink does not ha
aging Director: Jingwen TAO, Wanzhou MENG, Lifang CHEN
> Sitz der Gesellschaft: Düsseldorf, Amtsgericht Düsseldorf, HRB 56063,
> Geschäftsführer: Jingwen TAO, Wanzhou MENG, Lifang CHEN
>
> -Original Message-
> From: Michele Bertoni [mailto:michele1.bert...@mail.polimi.it]
>
r: Jingwen TAO, Wanzhou MENG, Lifang CHEN
-Original Message-
From: Michele Bertoni [mailto:michele1.bert...@mail.polimi.it]
Sent: Thursday, July 30, 2015 10:15 AM
To: user@flink.apache.org
Subject: output writer
Hi everybody,
I have a question about the writer
I have to save my dataset in d
Hi everybody,
I have a question about the writer
I have to save my dataset in different files according to a field of the tuples
let’s assume I have a groupId in the tuple, I need to store each group in a
different file, with a custom name: any idea on how i can do that?
thanks!
Michele
15 matches
Mail list logo