I'm trying to pull records from a database, split them, encode each record separately, send the encoded record over the network, and finally decode the record at the receiving end.
The processors I'm using are ExecuteSQL => ConvertAvroToJSON => SplitText => ExecuteScript => InvokeHTTP ExecuteScript encodes JSON records using Avro APIs. I'm facing a problem because of the way ExecuteSQL generates the Avro schema. ExecuteSQL creates a union type for all SQL types like ["null", "string"], for example. See here <https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/main/java/org/apache/nifi/processors/standard/util/JdbcCommon.java#L177> I believe it was designed this way to support schema evolution. However, Avro on the other hand will not parse JSON records using this schema. See here <http://mail-archives.apache.org/mod_mbox/avro-user/201412.mbox/%3CCALEq1Z-sKNT-fBpMhAa%3DGTjLq5wuKf5mAuvLYos4Ba17hUi%2Bfw%40mail.gmail.com%3E> Appreciate your input. -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/ExecuteSQL-generated-Avro-schema-tp13020.html Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.
