Malthe Borch created NIFI-6496:
----------------------------------

             Summary: Add compression support to record reader processor
                 Key: NIFI-6496
                 URL: https://issues.apache.org/jira/browse/NIFI-6496
             Project: Apache NiFi
          Issue Type: Improvement
          Components: Extensions
            Reporter: Malthe Borch


Text-based record formats such as CSV, JSON and XML compress well and will 
often be transmitted in a compressed format. If compression support is added to 
the relevant processors, users will not need to explicitly unpack files before 
processing (which may not be feasible or practical due to space requirements).

There are at least two ways of implementing this, using either a generic 
approach where a {{CompressedRecordReaderFactory}} is the basis for a new 
controller service that wraps the underlying record reader controller service 
(e.g. {{CSVReader}}); or adding the functionality at the relevant record reader 
implementations.

The latter option may provide a better UX because no additional 
{{ControllerService}} has to be configured.




--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

Reply via email to