[
https://issues.apache.org/jira/browse/NIFI-4000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16034381#comment-16034381
]
Koji Kawamura commented on NIFI-4000:
-------------------------------------
[~YANGFEIRAN] Thanks for updating. I am not sure if I understand it correctly,
but are you looking for some mechanism to persist things like last id queried
or last timestamp that some processors executed, not limited to GetFTP
processor but in general?
If so, NiFi has a feature called 'State' that can be used from processors
annotated with @Stateful. Please have a look on the ListFTP processor. When a
processor runs after restart, it can restore its state. But it needs some
coding to do so.
https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/main/java/org/apache/nifi/processors/standard/ListFTP.java#L56
Also, if you're looking for querying database table incrementally, NiFi has
QueryDatabaseTable and GenerateTableFetch, those use State to store the latest
maximum value.
> Auto-Incremental For GetFTP processor
> --------------------------------------
>
> Key: NIFI-4000
> URL: https://issues.apache.org/jira/browse/NIFI-4000
> Project: Apache NiFi
> Issue Type: Improvement
> Components: Extensions
> Affects Versions: 1.1.1
> Environment: linux
> Reporter: YANGFEIRAN
> Labels: features
>
> Hello,
> I am a NIFI user. When I am using the GetFTP processor, I realized that the
> processor can auto-incrementally import files from FTP only if I configure
> the processor "Delete Original" as "true".
> However, sometimes it is forbidden for me to delete any file in the FTP. So,
> I added a property in the GetFTP and GetFileTransfer processor (it is just a
> property in the JAVA class, can not see it in the UI) in order to record the
> last-modified time for files I have imported. And next time this value can be
> used to filter out those files that I have imported. Never the less, if I
> restart the NIFI, this value will be set back to the beginning.
> I figured out that if I wanted to make it stay still even if NIFI is
> restarted, I have to set this property back to the processor, as those
> properties in the UI. But there is no such a set function, those properties
> as initialized as the processor init.
> Can anyone add a set function, so the property in the UI can change by it
> self as the processor is running? Or it is only me that missing something
> that can achieve this?
> Sorry for my poor English, if I am not clear, just leave comments below.
> Best regards,
> Feiran
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
