I was wondering, do the kafka consumer shell scripts (high and low level
ones) and kafkacat do any pre-processing of the topic messages before
outputting to stdout or does it just output "as is" in the format the
message originally came in through kafka from the producer?

Meaning pretty printed JSON produced is consumed as pretty printed JSON,
line delimited JSON blobs (not pretty printed) is consumed the same way.

I'm asking this as I notice some topics I'm consuming with the shell
scripts (and kafkacat) are pretty printed and some not. So just wanted to
confirm this while also checking with the developers of the topic producers
on whether they are pretty printing on their end or not.

In general, I'm assuming as best practice, it's better not to pretty print
the JSON as a producer to save on message size for network transmission and
file storage by kafka, since those extra newlines and spaces/tabs add up
over time?

Reply via email to