[
https://issues.apache.org/jira/browse/NIFI-6462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alessandro D'Armiento updated NIFI-6462:
----------------------------------------
Description:
h2. Current Situation
ListHDFS is designed to be (only) the entry point of a data integration
pipeline, and therefore can only be triggered on a cron or time base.
h2. Improvement Proposal
ListHDFS should be able to be used as part of your pipeline even if you do not
expect to have it as the entry point. To obtain it:
* It has to be triggerable
* Trigger flowfile should be able to bring the listing directory as an
attribute
was:
h2. Current Situation
ListHDFS is designed to be (only) the entry point of a data integration
pipeline, and therefore can only be triggered on a cron or time base.
h2. Improvement Proposal
ListHDFS should be able to be used as part of your pipeline even if you do not
expect to have it as the entry point. To obtain it:
* It has to be triggerable
* Trigger flowfile should be able to bring the listing directory as an
attribute
* Some logic, such as the "skip the last file in the listing directory" should
be made optional
** Because if you are triggering the execution of the ListHDFS and you are
sure that the job which writes on the listing folder is over, is pointless to
skip a file for the next execution
> ListHDFS should be triggerable
> ------------------------------
>
> Key: NIFI-6462
> URL: https://issues.apache.org/jira/browse/NIFI-6462
> Project: Apache NiFi
> Issue Type: Improvement
> Components: Core Framework
> Affects Versions: 1.9.2
> Reporter: Alessandro D'Armiento
> Priority: Minor
>
> h2. Current Situation
> ListHDFS is designed to be (only) the entry point of a data integration
> pipeline, and therefore can only be triggered on a cron or time base.
> h2. Improvement Proposal
> ListHDFS should be able to be used as part of your pipeline even if you do
> not expect to have it as the entry point. To obtain it:
> * It has to be triggerable
> * Trigger flowfile should be able to bring the listing directory as an
> attribute
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
