Re: Apache Kafka messages which are in JSON to Parquet

Viju, JSon data are not *typed* - Parquet requires types - and Avro is a perfect packaging as it provides the typing in the parquet format So you will need to convert your messages into Avro ( and that's a best practice in *Kafka* by the way ). The reason you need to do that is that for example

[jira] [Commented] (PARQUET-725) Parquet AVRO tests fail

[ https://issues.apache.org/jira/browse/PARQUET-725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15532822#comment-15532822 ] Niels Basjes commented on PARQUET-725: -- Note that AVRO 1.8.2 (as it stands currently) is likely to

[jira] [Commented] (PARQUET-725) Parquet AVRO tests fail

[ https://issues.apache.org/jira/browse/PARQUET-725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15532225#comment-15532225 ] Niels Basjes commented on PARQUET-725: -- After AVRO 1.8.2. has been released this problem can easily