Yes, flink-compress module is supported from 1.10.0 and onward.
Regards,
Ravi
On Tue 28 Jul, 2020, 23:11 Vijayendra Yadav, <contact....@gmail.com> wrote:
> Thank You Ravi for Quick help. One Last Question is this compression
> supported with Flink Version 1.10.0 ?
>
> Regards,
> Vijay
>
> On Tue, Jul 28, 2020 at 1:20 PM Ravi Bhushan Ratnakar <
> ravibhushanratna...@gmail.com> wrote:
>
>> Hi Vijayendra,
>>
>> As far as rowFormat is concerned, it doesn't support compression.
>>
>>
>> Regards,
>> Ravi
>>
>> On Tue 28 Jul, 2020, 22:08 Vijayendra Yadav, <contact....@gmail.com>
>> wrote:
>>
>>> Hi Ravi,
>>>
>>> Thanks for your response. But your example is for *forBulkForma**t*.
>>> How about *forRowFormat* ?.
>>>
>>> Regards,
>>> Vijay
>>>
>>> On Tue, Jul 28, 2020 at 11:28 AM Ravi Bhushan Ratnakar <
>>> ravibhushanratna...@gmail.com> wrote:
>>>
>>>> Hi Vijayendra,
>>>>
>>>> You could achieve row encoded with like this as well
>>>>
>>>> codecName = "org.apache.hadoop.io.compress.GzipCodec"
>>>>
>>>> val streamingFileSink:StreamingFileSink[String] =
>>>> StreamingFileSink.forBulkFormat(new
>>>> Path(outputPath),CompressWriters.forExtractor(new
>>>> DefaultExtractor[String]).withHadoopCompression(codecName)).build()
>>>>
>>>> Regards,
>>>> Ravi
>>>>
>>>> On Tue, Jul 28, 2020 at 8:03 PM Vijayendra Yadav <contact....@gmail.com>
>>>> wrote:
>>>>
>>>>> Hi Team,
>>>>>
>>>>> Is there a way to enable compression in StreamingFileSink API for
>>>>> Row-encoded formats ?.
>>>>>
>>>>> val sink: StreamingFileSink[String] = StreamingFileSink
>>>>> .forRowFormat(new Path(outputPath), new
>>>>> SimpleStringEncoder[String]("UTF-8"))
>>>>>
>>>>>
>>>>> Regards,
>>>>> Vijay
>>>>>
>>>>
