[
https://issues.apache.org/jira/browse/NIFI-994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14980744#comment-14980744
]
Mark Payne commented on NIFI-994:
---------------------------------
[~jskora] - I agree that the Linux "tail" application may not guarantee every
bit of content will be sign. However, for our purposes, we should certainly
strive to ensure that we always obtain every bit of data, if possible.
I definitely like the idea of the checksums. But I think it's prudent to
perform the checksum across the entire file, not just a few bytes. If
performance were to become a concern, then we can certainly look at other
options, but for at least the initial pass I think this is the correct approach.
> Processor to tail files
> -----------------------
>
> Key: NIFI-994
> URL: https://issues.apache.org/jira/browse/NIFI-994
> Project: Apache NiFi
> Issue Type: New Feature
> Affects Versions: 0.4.0
> Reporter: Joseph Percivall
> Assignee: Mark Payne
> Fix For: 0.4.0
>
> Attachments: 0001-NIFI-994-Initial-import-of-TailFile.patch,
> 0002-NIFI-994-Ensure-that-processor-is-not-valid-due-to-t.patch
>
>
> It's a very common data ingest situation to want to input text into the
> system by "tailing" a file, most commonly log files. Currently we don't have
> an easy way to do this.
> A simple processor to tail a file would benefit many users. There would need
> to be an option to not just tail a file but pick up where the processor left
> off if it is interrupted.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
