Re: output writer

2015-09-09 Thread Fabian Hueske
roupBy(0).reduceGroup((v, out : Collector[GenomicRegionType]) => > while(v.hasNext) out.collect(v.next)) > > > then in my custom output writer, write record checks whether the current > stream is the right one > if it is then write > otherwise close it and open a new one > > since

Re: output writer

2015-09-09 Thread Fabian Hueske
utFormat interface >>>> in flink which can be extended. >>>> I believe that for this kind of specific formats as mentioned by >>>> Michele, each can develop the appropriate format. >>>> On the other hand, having more outputformats I believe is somethi

Re: output writer

2015-09-08 Thread Michele Bertoni
, 2015 11:34 AM To: user@flink.apache.org<mailto:user@flink.apache.org> Subject: Re: output writer Hi Michele, hi Radu Flink does not have such an OutputFormat, but I agree, it would be a valuable addition. Radu's approach looks like the way to go to implement this feature. @Radu, is there a way t

Re: output writer

2015-09-08 Thread Fabian Hueske
udo...@huawei.com <radu.tudo...@huawei.com>* >> Mobile: +49 15209084330 >> Telephone: +49 891588344173 >> >> HUAWEI TECHNOLOGIES Duesseldorf GmbH >> Hansaallee 205, 40549 Düsseldorf, Germany, www.huawei.com >> Registered Office: Düsseldorf, Register Cou

Re: output writer

2015-09-08 Thread Fabian Hueske
gt; (e.g. memory buffer) >>> >>> >>> >>> Dr. Radu Tudoran >>> Research Engineer >>> IT R Division >>> >>> >>> HUAWEI TECHNOLOGIES Duesseldorf GmbH >>> European Research Center >>> Riesstrass

Re: output writer

2015-09-08 Thread Michele Bertoni
dorf, HRB 56063, Managing Director: Jingwen TAO, Wanzhou MENG, Lifang CHEN Sitz der Gesellschaft: Düsseldorf, Amtsgericht Düsseldorf, HRB 56063, Geschäftsführer: Jingwen TAO, Wanzhou MENG, Lifang CHEN From: Fabian Hueske [mailto:fhue...@gmail.com] Sent: Thursday, July 30, 2015 11:34 AM To: user@flink.

Re: output writer

2015-09-08 Thread Fabian Hueske
lschaft: Düsseldorf, Amtsgericht Düsseldorf, HRB 56063, > Geschäftsführer: Jingwen TAO, Wanzhou MENG, Lifang CHEN > > *From:* Fabian Hueske [mailto:fhue...@gmail.com <fhue...@gmail.com>] > *Sent:* Thursday, July 30, 2015 11:34 AM > *To:* user@flink.apache.org > *Subject:

Re: output writer

2015-09-08 Thread Michele Bertoni
Düsseldorf, HRB 56063, Geschäftsführer: Jingwen TAO, Wanzhou MENG, Lifang CHEN From: Fabian Hueske [mailto:fhue...@gmail.com] Sent: Thursday, July 30, 2015 11:34 AM To: user@flink.apache.org<mailto:user@flink.apache.org> Subject: Re: output writer Hi Michele, hi Radu Flink does not have s

output writer

2015-07-30 Thread Michele Bertoni
Hi everybody, I have a question about the writer I have to save my dataset in different files according to a field of the tuples let’s assume I have a groupId in the tuple, I need to store each group in a different file, with a custom name: any idea on how i can do that? thanks! Michele

RE: output writer

2015-07-30 Thread Radu Tudoran
, Wanzhou MENG, Lifang CHEN -Original Message- From: Michele Bertoni [mailto:michele1.bert...@mail.polimi.it] Sent: Thursday, July 30, 2015 10:15 AM To: user@flink.apache.org Subject: output writer Hi everybody, I have a question about the writer I have to save my dataset in different files

RE: output writer

2015-07-30 Thread Radu Tudoran
: Düsseldorf, Amtsgericht Düsseldorf, HRB 56063, Geschäftsführer: Jingwen TAO, Wanzhou MENG, Lifang CHEN From: Fabian Hueske [mailto:fhue...@gmail.com] Sent: Thursday, July 30, 2015 11:34 AM To: user@flink.apache.org Subject: Re: output writer Hi Michele, hi Radu Flink does not have

RE: output writer

2015-07-30 Thread Radu Tudoran
AM To: user@flink.apache.org Subject: Re: output writer Hi Michele, hi Radu Flink does not have such an OutputFormat, but I agree, it would be a valuable addition. Radu's approach looks like the way to go to implement this feature. @Radu, is there a way to contribute your OutputFormat to Flink