Thank You. On Wed, Jul 29, 2020 at 2:07 AM Ravi Bhushan Ratnakar < ravibhushanratna...@gmail.com> wrote:
> Yes, flink-compress module is supported from 1.10.0 and onward. > > Regards, > Ravi > > On Tue 28 Jul, 2020, 23:11 Vijayendra Yadav, <contact....@gmail.com> > wrote: > >> Thank You Ravi for Quick help. One Last Question is this compression >> supported with Flink Version 1.10.0 ? >> >> Regards, >> Vijay >> >> On Tue, Jul 28, 2020 at 1:20 PM Ravi Bhushan Ratnakar < >> ravibhushanratna...@gmail.com> wrote: >> >>> Hi Vijayendra, >>> >>> As far as rowFormat is concerned, it doesn't support compression. >>> >>> >>> Regards, >>> Ravi >>> >>> On Tue 28 Jul, 2020, 22:08 Vijayendra Yadav, <contact....@gmail.com> >>> wrote: >>> >>>> Hi Ravi, >>>> >>>> Thanks for your response. But your example is for *forBulkForma**t*. >>>> How about *forRowFormat* ?. >>>> >>>> Regards, >>>> Vijay >>>> >>>> On Tue, Jul 28, 2020 at 11:28 AM Ravi Bhushan Ratnakar < >>>> ravibhushanratna...@gmail.com> wrote: >>>> >>>>> Hi Vijayendra, >>>>> >>>>> You could achieve row encoded with like this as well >>>>> >>>>> codecName = "org.apache.hadoop.io.compress.GzipCodec" >>>>> >>>>> val streamingFileSink:StreamingFileSink[String] = >>>>> StreamingFileSink.forBulkFormat(new >>>>> Path(outputPath),CompressWriters.forExtractor(new >>>>> DefaultExtractor[String]).withHadoopCompression(codecName)).build() >>>>> >>>>> Regards, >>>>> Ravi >>>>> >>>>> On Tue, Jul 28, 2020 at 8:03 PM Vijayendra Yadav < >>>>> contact....@gmail.com> wrote: >>>>> >>>>>> Hi Team, >>>>>> >>>>>> Is there a way to enable compression in StreamingFileSink API for >>>>>> Row-encoded formats ?. >>>>>> >>>>>> val sink: StreamingFileSink[String] = StreamingFileSink >>>>>> .forRowFormat(new Path(outputPath), new >>>>>> SimpleStringEncoder[String]("UTF-8")) >>>>>> >>>>>> >>>>>> Regards, >>>>>> Vijay >>>>>> >>>>>