[
https://issues.apache.org/jira/browse/DRILL-5940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17352092#comment-17352092
]
ASF GitHub Bot commented on DRILL-5940:
---------------------------------------
vvysotskyi opened a new pull request #2239:
URL: https://github.com/apache/drill/pull/2239
# [DRILL-5940](https://issues.apache.org/jira/browse/DRILL-5940): Add
support for Avro messages with schema registry for Kafka
## Description
- Refactored `KafkaRecordReader` to use EVF.
- Updated `JsonMessageReader` to use V2 JSON reader
- Added `AvroMessageReader` for processing messages serialized as Avro
records and added schema registry support.
To be able to deserialize Kafka messages of Avro type, schema registry URL
should be specified in the Kafka storage plugin `kafkaConsumerProps` (and other
schema registry options if required):
```
"schema.registry.url": "http://localhost:8081";
```
After that, `store.kafka.record.reader` session option should be set to
`org.apache.drill.exec.store.kafka.decoders.AvroMessageReader`.
## Documentation
NA
## Testing
Added UT that reads Avro messages.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> Avro with schema registry support for Kafka
> -------------------------------------------
>
> Key: DRILL-5940
> URL: https://issues.apache.org/jira/browse/DRILL-5940
> Project: Apache Drill
> Issue Type: New Feature
> Components: Storage - Avro, Storage - Kafka
> Reporter: AnilKumar B
> Assignee: Vova Vysotskyi
> Priority: Major
>
> Support Avro messages with Schema registry for Kafka storage plugin
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
