Re: Flink Serialization as stable (kafka) output format?

onntag, 19. April 2020 08:23:42 Betreff: Re: Flink Serialization as stable (kafka) output format? Hey Theo, we recently published a blog post that answers your request for a comparison between Kryo and Avro in Flink: [ https://flink.apache.org/news/2020/04/15/flink-serialization-tuning-vol-

Re: Flink Serialization as stable (kafka) output format?

Hey Theo, we recently published a blog post that answers your request for a comparison between Kryo and Avro in Flink: https://flink.apache.org/news/2020/04/15/flink-serialization-tuning-vol-1.html On Tue, Mar 10, 2020 at 9:27 AM Arvid Heise wrote: > Hi Theo, > > I strongly discourage the use

Re: Flink Serialization as stable (kafka) output format?

Hi Theo, I strongly discourage the use of flink serialization for persistent storage of data. It was never intended to work in this way and does not offer the benefits of Avro of lazy schema evolution and maturity. Unless you can explicitly measure that Avro is a bottleneck in your setup, stick

Re: Flink Serialization as stable (kafka) output format?

Hi Theo, However, in most benchmarks, avro turns out to be rather slow in terms of > CPU cycles ( e.g. [1] ) Avro is slower compared to what? You should not only benchmark the CPU cycles for serializing the data. If you are sending JSON strings

Flink Serialization as stable (kafka) output format?

Hi, Without knowing too much about flink serialization, I know that Flinks states that it serializes POJOtypes much faster than even the fast Kryo for Java. I further know that it supports schema evolution in the same way as avro. In our project, we have a star architecture, where one flink