Andrew Glowacki created NIFI-7320:
-------------------------------------

             Summary: HDFS Content Repository
                 Key: NIFI-7320
                 URL: https://issues.apache.org/jira/browse/NIFI-7320
             Project: Apache NiFi
          Issue Type: New Feature
          Components: Extensions
    Affects Versions: 1.12.0
            Reporter: Andrew Glowacki
             Fix For: 1.12.0


This issue is for a new content repository that stores FlowFile content in HDFS 
instead of the local disk. While storage capacity for a NiFi cluster can be 
expanded by adding more nodes, this doesn't make sense if the only reason is to 
increase content repository storage or I/O capacity.

In addition to just storing all content in HDFS, the repository can also:
 * Store content in the local disk as normal, and fallback to HDFS when the 
local disk is full
 * Store content in HDFS but fallback to a local disk if a failure occurs.
 * Store content in the local disk as normal, and only store archived content 
in HDFS for longer retention.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to