Hi, all:
I like to update some information about Avro message on Kafka. Avro
message include schema ID instead of Schema at each message
http://stackoverflow.com/questions/31204201/apache-kafka-with-avro-and-schema-repo-where-in-the-message-does-the-schema-id
sincerely,
Selina
On Wed, Nov 18, 2015 at 3:49 PM, Selina Tech <swucaree...@gmail.com> wrote:
> Dear All:
>
> I need to generate some data by Samza to Kafka and then write to
> Parquet formate file. I was asked why I choose Avro type as my Samza
> output to Kafka instead of Protocol Buffer. Since currently our data on
> Kafka are all Protocol buffer type message.
>
> I explained that Avro encoded message has advantages such as, the
> encoded size smaller, no extra code compile, implementation easier. fast
> to serialize/deserialize and supporting a lot language. However some
> people believe when encoded the Avro message take as much space as Protocol
> buffer, but with schema, the size could be much bigger.
>
> I am wondering if there are any other advantages make you choose
> Avro as your message type at Kafka? How you consider the data size for Avro
> vs Protocol buffer?
>
> Sincerely,
> Selina
>
