rahulkg31 opened a new issue, #13757: URL: https://github.com/apache/druid/issues/13757
Hi, I want to ingest base64 encoded avro messages in druid. I am getting the following error - Avro's unnecessary EOFException, detail: https://issues.apache.org/jira/browse/AVRO-813 Going through the code (line 88) https://github.com/apache/druid/blob/master/extensions-core/avro-extensions/src/main/java/org/apache/druid/data/input/avro/InlineSchemaAvroBytesDecoder.java , it does not seem to be decoding the messages using base64 decoder. Am I missing something? How can we configure druid to parse base64 encoded avro messages? Spec used - ``` "inputFormat": { "type": "avro_stream", "avroBytesDecoder": { "type": "schema_inline", "schema": { "namespace": "org.apache.druid.data", "name": "User", "type": "record", "fields": [ { "name": "id", "type": "string" }, { "name": "price", "type": "int" } ] } }, "flattenSpec": { "useFieldDiscovery": true, "fields": [ { "type": "path", "name": "someRecord_subInt", "expr": "$.someRecord.subInt" } ] }, "binaryAsString": false } ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
