Nicholas Hughes created NIFI-4398: ------------------------------------- Summary: FlattenRecord Processor Key: NIFI-4398 URL: https://issues.apache.org/jira/browse/NIFI-4398 Project: Apache NiFi Issue Type: New Feature Reporter: Nicholas Hughes
Requesting a "FlattenRecord" processor, which performs much like the "Field Flattener" processor included in StreamSets Data Collector [2] This should be able to act on all supported record types, and would take nested data and bring it out to the top level of the record by adding a prefix to the property name (or potentially other strategies). The easiest way to demonstrate the desired effect is with the following JSON example. For input data like that shown below from Yahoo [1] { "query": { "count": 1, "created": "2017-09-15T11:20:26Z", "lang": "en-US", "results": { "channel": { "item": { "condition": { "code": "33", "date": "Fri, 15 Sep 2017 06:00 AM EDT", "temp": "63", "text": "Mostly Clear" } } } } } } ...we'd end up with output something like this: { "query.count": 1, "query.created": "2017-09-15T11:20:26Z", "query.lang": "en-US", "query.results.channel.item.condition.code": "33", "query.results.channel.item.condition.date": "Fri, 15 Sep 2017 06:00 AM EDT", "query.results.channel.item.condition.temp": "63", "query.results.channel.item.condition.text": "Mostly Clear" } [1] https://query.yahooapis.com/v1/public/yql?q=select%20item.condition%20from%20weather.forecast%20where%20woeid%20%3D%202383558&format=json&env=store%3A%2F%2Fdatatables.org%2Falltableswithkeys [2] https://github.com/streamsets/datacollector/tree/master/basic-lib/src/main/java/com/streamsets/pipeline/stage/processor/fieldflattener -- This message was sent by Atlassian JIRA (v6.4.14#64029)