[
https://issues.apache.org/jira/browse/NIFI-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16699221#comment-16699221
]
Otto Fowler commented on NIFI-3126:
-----------------------------------
I was thinking, maybe instead of deprecation, there should be a
PerformanceWarning equivalent? What we want to say is the "This processor
could cause OOM if very large JSON files are used because it reads the whole
file into memory, for large files prefer the SplitRecord processor"
> A large JSON file consisting of an array of many json elements can cause an
> out of memory error if passed to SplitJSON
> ----------------------------------------------------------------------------------------------------------------------
>
> Key: NIFI-3126
> URL: https://issues.apache.org/jira/browse/NIFI-3126
> Project: Apache NiFi
> Issue Type: Bug
> Components: Core Framework
> Affects Versions: 1.0.0
> Environment: RHEL 6.5 - single instance of Nifi
> Reporter: Olav Jordens
> Assignee: Otto Fowler
> Priority: Major
>
> Create a flowfile containing a large JSON array (large=many elements in the
> array) with many attributes. Do this in such a way that a set of flowfiles
> corresponding to the individual json elements in the array (with all the
> attributes) would require more RAM than available in your nifi JVM. Now feed
> this flowfile into a SplitJSON processor. I did not see an OOM error in the
> logs and saw very strange behavior as the whole Nifi instance hangs.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
