Re: Row format or bulk format

2018-12-27 Thread Andrey Zagrebin
Hi Taher, The row format is used to append data to part files record by record. When you implement Encoder interface, you can decide how to serialise record into bytes and write the bytes into the OutputStream of current part file. At the moment I do not see any facility classes in Flink code base

Row format or bulk format

2018-12-27 Thread Taher Koitawala
Hi All, I am currently working on flink 1.7 with StreamingFileSink and need to write AVRO data on S3 Filesystem and the plan is to move from the old bucketing sink to the new sink which is much more compatible. Application is also using check pointing right now. Can someone pleas