[ https://issues.apache.org/jira/browse/BEAM-7310?focusedWorklogId=380060&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-380060 ]
ASF GitHub Bot logged work on BEAM-7310: ---------------------------------------- Author: ASF GitHub Bot Created on: 31/Jan/20 15:56 Start Date: 31/Jan/20 15:56 Worklog Time Spent: 10m Work Description: aromanenko-dev commented on issue #10563: [BEAM-7310] Add support of Confluent Schema Registry for KafkaIO URL: https://github.com/apache/beam/pull/10563#issuecomment-580790722 As we discussed before, I simplified KafkaIO API to use it with Confluent Schema Registry. I added a `CSRClientProvider` interface and two implementations - `BasicCSRClientProvider` (used by default in KafkaIO) and `TestCSRClientProvider` (for unit tests). The instance of provider should create and return the instance of `SchemaRegistryClient` which is used to fetch Avro schema from CSR. Also, I added several another tests to test reading of key and values if they Avro serialised in different combinations. I'm still on the subject if we need to support different schemas from different CSR subjects if user reads from multiple topics. Any ideas will be very welcomed. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking ------------------- Worklog Id: (was: 380060) Time Spent: 10h (was: 9h 50m) > Confluent Schema Registry support in KafkaIO > -------------------------------------------- > > Key: BEAM-7310 > URL: https://issues.apache.org/jira/browse/BEAM-7310 > Project: Beam > Issue Type: Improvement > Components: io-java-kafka > Affects Versions: 2.12.0 > Reporter: Yohei Shimomae > Assignee: Alexey Romanenko > Priority: Minor > Time Spent: 10h > Remaining Estimate: 0h > > Confluent Schema Registry is useful when we manage Avro Schema but KafkaIO > does not support Confluent Schema Registry as discussed here. > https://stackoverflow.com/questions/56035121/unable-to-connect-from-dataflow-job-to-schema-registry-when-schema-registry-requ > https://lists.apache.org/thread.html/7695fccddebd08733b80ae1e43b79b636b63cd5fe583a2bdeecda6c4@%3Cuser.beam.apache.org%3E -- This message was sent by Atlassian Jira (v8.3.4#803005)