[
https://issues.apache.org/jira/browse/NIFI-751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14626274#comment-14626274
]
ASF GitHub Bot commented on NIFI-751:
-------------------------------------
Github user joewitt commented on the pull request:
https://github.com/apache/incubator-nifi/pull/70#issuecomment-121218552
i just want to add how easy this was to test. We're definitely going to
build an avro viewer like we have for JSON, XML, etc.. because of this cool use
case.
I setup a 'generate flow file' and replace text to make some CSV lines then
ran that into "Convert CSV to Avro" and a "ConvertAvroSchema" all using Alan's
example schemas. And i didn't have it right at first because my id wasn't a
long and my revenue wasn't a double. But that was obvious as it told me right
in context. So i could just easily iterate and go.
It is a good example of taking a cool project, Kite, and combining it with
the power NiFi has to make these things interactive to quickly iterate and
building something useful.
Nice job Alan and Ryan!
> Add Processor To Convert Avro Formats
> -------------------------------------
>
> Key: NIFI-751
> URL: https://issues.apache.org/jira/browse/NIFI-751
> Project: Apache NiFi
> Issue Type: Improvement
> Components: Extensions
> Affects Versions: 0.1.0
> Reporter: Alan Jackoway
>
> When working with data from external sources, such as complex WSDL, I
> frequently wind up with complex nested data that is difficult to work with
> even when converted to Avro format. Specifically, I often have two needs:
> * Converting types of data, usually from string to long, double, etc. when
> APIs give only string data back.
> * Flattening data by taking fields out of nested records and putting them on
> the top level of the Avro file.
> Unfortunately the Kite JSONToAvro processor only supports exact conversions
> from JSON to a matching Avro schema and will not do data transformations of
> this type. Proposed processor to come.
> Discussed this with [~rdblue], so tagging him here as I don't have permission
> to set a CC for some reason.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
