[jira] [Commented] (NIFI-632) Documentation Generation: Nar ClassLoader
[ https://issues.apache.org/jira/browse/NIFI-632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580488#comment-14580488 ] Mark Payne commented on NIFI-632: - Ahhh okay, makes sense. Thanks for the clarification. Documentation Generation: Nar ClassLoader - Key: NIFI-632 URL: https://issues.apache.org/jira/browse/NIFI-632 Project: Apache NiFi Issue Type: Bug Components: Core Framework Affects Versions: 0.1.0 Reporter: Matt Gilman Assignee: Dan Bress Priority: Minor Fix For: 0.2.0 Attachments: 0001-Squashed-commit-of-the-following.patch When auto generating component documentation the NarThreadContextClassLoader needs to be set in case the component attempts to load anything off of its classpath. Without this, the documentation generation fails. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (NIFI-669) Unable to add property to UpdateAttribute if property was just deleted
[ https://issues.apache.org/jira/browse/NIFI-669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580495#comment-14580495 ] Matt Gilman commented on NIFI-669: -- [~markap14] Good catch. Thanks. Unable to add property to UpdateAttribute if property was just deleted -- Key: NIFI-669 URL: https://issues.apache.org/jira/browse/NIFI-669 Project: Apache NiFi Issue Type: Bug Components: Core UI Affects Versions: 0.2.0 Reporter: Dan Bress Assignee: Matt Gilman Priority: Minor Attachments: 0001-NIFI-669.patch Steps to reproduce: 1) drag an UpdateAttribute to the graph 2) right click-configure-properties 3) add a new property, A=B 4) delete that property 5) add a new property A... At this point the UI will kick out saying a property with this name already exists When from the users perspective they cannot see a property with such a name(it was deleted). I'd recommend either updating the error message you are adding a property that was recently deleted, please press 'apply' before readding this property Or making it so you can re-add a property that was just deleted. *UPDATE* This affects all processors -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (NIFI-632) Documentation Generation: Nar ClassLoader
[ https://issues.apache.org/jira/browse/NIFI-632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580463#comment-14580463 ] Mark Payne commented on NIFI-632: - Dan, The concepts sound good. I've not had a chance yet to checkout the branch and check it out. I looked at the patch though for the ReflectionUtils. Can you explain the idea there? I wasn't quite following what you were doing there, just looking at the patch - why are you calling methods with annotations? Is it just for testing purposes? Regarding the service files: I think that's the correct way to go. I think this was a bug, and when you starting using NarCloseable it exposed the bug. Please make sure that you include in those files though the VolatileContentRepository and VolatileFlowFileRepository. Documentation Generation: Nar ClassLoader - Key: NIFI-632 URL: https://issues.apache.org/jira/browse/NIFI-632 Project: Apache NiFi Issue Type: Bug Components: Core Framework Affects Versions: 0.1.0 Reporter: Matt Gilman Assignee: Dan Bress Priority: Minor Fix For: 0.2.0 Attachments: 0001-Squashed-commit-of-the-following.patch When auto generating component documentation the NarThreadContextClassLoader needs to be set in case the component attempts to load anything off of its classpath. Without this, the documentation generation fails. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (NIFI-669) Unable to add property to UpdateAttribute if property was just deleted
[ https://issues.apache.org/jira/browse/NIFI-669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Gilman updated NIFI-669: - Attachment: (was: 0001-NIFI-669.patch) Unable to add property to UpdateAttribute if property was just deleted -- Key: NIFI-669 URL: https://issues.apache.org/jira/browse/NIFI-669 Project: Apache NiFi Issue Type: Bug Components: Core UI Affects Versions: 0.2.0 Reporter: Dan Bress Assignee: Matt Gilman Priority: Minor Steps to reproduce: 1) drag an UpdateAttribute to the graph 2) right click-configure-properties 3) add a new property, A=B 4) delete that property 5) add a new property A... At this point the UI will kick out saying a property with this name already exists When from the users perspective they cannot see a property with such a name(it was deleted). I'd recommend either updating the error message you are adding a property that was recently deleted, please press 'apply' before readding this property Or making it so you can re-add a property that was just deleted. *UPDATE* This affects all processors -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (NIFI-669) Unable to add property to UpdateAttribute if property was just deleted
[ https://issues.apache.org/jira/browse/NIFI-669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Gilman updated NIFI-669: - Attachment: 0001-NIFI-669.patch Unable to add property to UpdateAttribute if property was just deleted -- Key: NIFI-669 URL: https://issues.apache.org/jira/browse/NIFI-669 Project: Apache NiFi Issue Type: Bug Components: Core UI Affects Versions: 0.2.0 Reporter: Dan Bress Assignee: Matt Gilman Priority: Minor Attachments: 0001-NIFI-669.patch Steps to reproduce: 1) drag an UpdateAttribute to the graph 2) right click-configure-properties 3) add a new property, A=B 4) delete that property 5) add a new property A... At this point the UI will kick out saying a property with this name already exists When from the users perspective they cannot see a property with such a name(it was deleted). I'd recommend either updating the error message you are adding a property that was recently deleted, please press 'apply' before readding this property Or making it so you can re-add a property that was just deleted. *UPDATE* This affects all processors -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (NIFI-632) Documentation Generation: Nar ClassLoader
[ https://issues.apache.org/jira/browse/NIFI-632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580480#comment-14580480 ] Matt Gilman commented on NIFI-632: -- I haven't looked at the patch but just some background on what I think is happening with the annotations. The annotation invocation is based on my comment above [1]. Since the processors are being instantiated to extract properties/relationships, they are given the chance to do some initialization logic. In one of my cases, this involved setting up an ExecutorService for running a background thread. My processor expects to be given the opportunity to shut this down as part of the normal processor life cycle. This was missing initially. [1] https://issues.apache.org/jira/browse/NIFI-632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573597#comment-14573597 Documentation Generation: Nar ClassLoader - Key: NIFI-632 URL: https://issues.apache.org/jira/browse/NIFI-632 Project: Apache NiFi Issue Type: Bug Components: Core Framework Affects Versions: 0.1.0 Reporter: Matt Gilman Assignee: Dan Bress Priority: Minor Fix For: 0.2.0 Attachments: 0001-Squashed-commit-of-the-following.patch When auto generating component documentation the NarThreadContextClassLoader needs to be set in case the component attempts to load anything off of its classpath. Without this, the documentation generation fails. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
incubator-nifi git commit: Typo in documentation for EncryptContent
Repository: incubator-nifi Updated Branches: refs/heads/develop 86cbfab14 - 976cfaf60 Typo in documentation for EncryptContent Signed-off-by: Mark Payne marka...@hotmail.com Project: http://git-wip-us.apache.org/repos/asf/incubator-nifi/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-nifi/commit/976cfaf6 Tree: http://git-wip-us.apache.org/repos/asf/incubator-nifi/tree/976cfaf6 Diff: http://git-wip-us.apache.org/repos/asf/incubator-nifi/diff/976cfaf6 Branch: refs/heads/develop Commit: 976cfaf60253e54b18248b7ee58b982a0749e9d1 Parents: 86cbfab Author: Jon Anderson andersoniii@gmail.com Authored: Tue May 19 20:55:59 2015 -0400 Committer: Mark Payne marka...@hotmail.com Committed: Wed Jun 10 10:41:18 2015 -0400 -- .../additionalDetails.html | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/incubator-nifi/blob/976cfaf6/nifi/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/main/resources/docs/org.apache.nifi.processors.standard.EncryptContent/additionalDetails.html -- diff --git a/nifi/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/main/resources/docs/org.apache.nifi.processors.standard.EncryptContent/additionalDetails.html b/nifi/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/main/resources/docs/org.apache.nifi.processors.standard.EncryptContent/additionalDetails.html index b0603c6..e6417b3 100644 --- a/nifi/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/main/resources/docs/org.apache.nifi.processors.standard.EncryptContent/additionalDetails.html +++ b/nifi/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/main/resources/docs/org.apache.nifi.processors.standard.EncryptContent/additionalDetails.html @@ -16,7 +16,7 @@ -- head meta charset=utf-8/ -titleEvaluateJsonPath/title +titleEncryptContent/title link rel=stylesheet href=../../css/component-usage.css type=text/css/ /head
[jira] [Commented] (NIFI-632) Documentation Generation: Nar ClassLoader
[ https://issues.apache.org/jira/browse/NIFI-632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580604#comment-14580604 ] Dan Bress commented on NIFI-632: Mark, Will do VolatileContentRepository and VolatileFlowFileRepository. I may be missing a provenance repo too. Will double check that. Also, I noticed you opened [NIFI-674|https://issues.apache.org/jira/browse/NIFI-674] which I addressed in here. How do you want to handle that? Honestly, I could see a case being made for four tickets total for all the things I mentioned(you already created in in NIFI-674), and pulling the fixes out of this branch and putting it in the respective tickets. Then leave this ticket JUST for fixing Matt's original finding. What do you think? Overkill? Documentation Generation: Nar ClassLoader - Key: NIFI-632 URL: https://issues.apache.org/jira/browse/NIFI-632 Project: Apache NiFi Issue Type: Bug Components: Core Framework Affects Versions: 0.1.0 Reporter: Matt Gilman Assignee: Dan Bress Priority: Minor Fix For: 0.2.0 Attachments: 0001-Squashed-commit-of-the-following.patch When auto generating component documentation the NarThreadContextClassLoader needs to be set in case the component attempts to load anything off of its classpath. Without this, the documentation generation fails. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (NIFI-669) Unable to add property to UpdateAttribute if property was just deleted
[ https://issues.apache.org/jira/browse/NIFI-669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Gilman updated NIFI-669: - Attachment: 0001-NIFI-669.patch Unable to add property to UpdateAttribute if property was just deleted -- Key: NIFI-669 URL: https://issues.apache.org/jira/browse/NIFI-669 Project: Apache NiFi Issue Type: Bug Components: Core UI Affects Versions: 0.2.0 Reporter: Dan Bress Assignee: Matt Gilman Priority: Minor Attachments: 0001-NIFI-669.patch Steps to reproduce: 1) drag an UpdateAttribute to the graph 2) right click-configure-properties 3) add a new property, A=B 4) delete that property 5) add a new property A... At this point the UI will kick out saying a property with this name already exists When from the users perspective they cannot see a property with such a name(it was deleted). I'd recommend either updating the error message you are adding a property that was recently deleted, please press 'apply' before readding this property Or making it so you can re-add a property that was just deleted. *UPDATE* This affects all processors -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (NIFI-674) FileSystemRepository should not create new threads in its constructor
[ https://issues.apache.org/jira/browse/NIFI-674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580757#comment-14580757 ] Dan Bress commented on NIFI-674: The fix described in this ticket will be addressed as part of NIFI-632 FileSystemRepository should not create new threads in its constructor - Key: NIFI-674 URL: https://issues.apache.org/jira/browse/NIFI-674 Project: Apache NiFi Issue Type: Bug Components: Core Framework Reporter: Mark Payne Priority: Minor Fix For: 0.2.0 FileSystemRepository creates two different ExecutorServices in its constructor. This is problematic because we iterate over the ServiceLoader, which creates an instance of FileSystemRepository and then throws it away. Instead, these executors should be created in the initialize method. It should also be documented in the ContentRepository interface that any time that initialize() is called, it is expected that the shutdown() method will also be called, as this is where we can cleanup the things that we did during initialization. This was the intended lifecycle but never was clearly documented. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (NIFI-677) DBCPService should allow user to specify Connection URL
Mark Payne created NIFI-677: --- Summary: DBCPService should allow user to specify Connection URL Key: NIFI-677 URL: https://issues.apache.org/jira/browse/NIFI-677 Project: Apache NiFi Issue Type: Bug Affects Versions: 0.1.0 Reporter: Mark Payne Fix For: 0.2.0 Currently the service requires a database type, a hostname, and a port. These properties should be removed and replaced with a single Connection URL property. This allows more flexibility in how to connect to databases. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (NIFI-678) DBCPService should not require password
Mark Payne created NIFI-678: --- Summary: DBCPService should not require password Key: NIFI-678 URL: https://issues.apache.org/jira/browse/NIFI-678 Project: Apache NiFi Issue Type: Bug Affects Versions: 0.1.0 Reporter: Mark Payne Fix For: 0.2.0 Many databases support connecting without a password. The service should not enforce that a password be used. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (NIFI-632) Documentation Generation: Nar ClassLoader
[ https://issues.apache.org/jira/browse/NIFI-632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580735#comment-14580735 ] Mark Payne commented on NIFI-632: - Dan, Personally, I'd try to make life simple and just comment on ticket 674 that the work was done as part of a large changeset that needed to occur as part of NIFI-632, add a link between the tickets that indicates that they are related, and just leave it at that. Documentation Generation: Nar ClassLoader - Key: NIFI-632 URL: https://issues.apache.org/jira/browse/NIFI-632 Project: Apache NiFi Issue Type: Bug Components: Core Framework Affects Versions: 0.1.0 Reporter: Matt Gilman Assignee: Dan Bress Priority: Minor Fix For: 0.2.0 Attachments: 0001-Squashed-commit-of-the-following.patch When auto generating component documentation the NarThreadContextClassLoader needs to be set in case the component attempts to load anything off of its classpath. Without this, the documentation generation fails. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (NIFI-589) Add processors that can run Apache Flume sources/sinks
[ https://issues.apache.org/jira/browse/NIFI-589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581047#comment-14581047 ] ASF GitHub Bot commented on NIFI-589: - Github user markap14 commented on the pull request: https://github.com/apache/incubator-nifi/pull/51#issuecomment-110906821 @joey generally @OnStopped is the best place to do something like that. If you want to call onTrigger() multiple times without the @OnScheduled, @OnUnscheduled being called, you can pass in flags to the run() method to specify this. Or alternatively, if it makes sense in your unit test, you can use .run(int) to run some specified number of times. Add processors that can run Apache Flume sources/sinks -- Key: NIFI-589 URL: https://issues.apache.org/jira/browse/NIFI-589 Project: Apache NiFi Issue Type: New Feature Components: Extensions Affects Versions: 0.1.0 Reporter: Joey Echeverria -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (NIFI-589) Add processors that can run Apache Flume sources/sinks
[ https://issues.apache.org/jira/browse/NIFI-589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580998#comment-14580998 ] ASF GitHub Bot commented on NIFI-589: - Github user joey commented on the pull request: https://github.com/apache/incubator-nifi/pull/51#issuecomment-110892315 @rdblue and @joewitt See the latest. I think this addresses all of the Ryan's feedback. I do have one open question: Currently I'm stopping the Sinks and Sources in an `@OnUnscheduled` callback, but I'm not sure if that's the right place to do it. I'm not sure about the intention of the API generally, but the `TestRunner#run()` method will call `@OnUnscheduled` callbacks immediately after the first call to `Processor#onTrigger()`. That means that effectively only a single `onTrigger()` happens in any of my tests. Should this be delayed until an `@OnStopped` callback? Add processors that can run Apache Flume sources/sinks -- Key: NIFI-589 URL: https://issues.apache.org/jira/browse/NIFI-589 Project: Apache NiFi Issue Type: New Feature Components: Extensions Affects Versions: 0.1.0 Reporter: Joey Echeverria -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (NIFI-669) Unable to add property to UpdateAttribute if property was just deleted
[ https://issues.apache.org/jira/browse/NIFI-669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580819#comment-14580819 ] Mark Payne commented on NIFI-669: - [~mcgilman]: new patch looks good! +1 Unable to add property to UpdateAttribute if property was just deleted -- Key: NIFI-669 URL: https://issues.apache.org/jira/browse/NIFI-669 Project: Apache NiFi Issue Type: Bug Components: Core UI Affects Versions: 0.2.0 Reporter: Dan Bress Assignee: Matt Gilman Priority: Minor Attachments: 0001-NIFI-669.patch Steps to reproduce: 1) drag an UpdateAttribute to the graph 2) right click-configure-properties 3) add a new property, A=B 4) delete that property 5) add a new property A... At this point the UI will kick out saying a property with this name already exists When from the users perspective they cannot see a property with such a name(it was deleted). I'd recommend either updating the error message you are adding a property that was recently deleted, please press 'apply' before readding this property Or making it so you can re-add a property that was just deleted. *UPDATE* This affects all processors -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (NIFI-679) InvokeHTTP - Add support for basic authentication
Matt Gilman created NIFI-679: Summary: InvokeHTTP - Add support for basic authentication Key: NIFI-679 URL: https://issues.apache.org/jira/browse/NIFI-679 Project: Apache NiFi Issue Type: Improvement Components: Extensions Reporter: Matt Gilman Priority: Minor InvokeHTTP should optionally support username/password for web services that do not employ certificate based authentication. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (NIFI-656) Release Manager: Release 0.2.0
[ https://issues.apache.org/jira/browse/NIFI-656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Gilman reassigned NIFI-656: Assignee: Matt Gilman (was: Joseph Witt) Release Manager: Release 0.2.0 -- Key: NIFI-656 URL: https://issues.apache.org/jira/browse/NIFI-656 Project: Apache NiFi Issue Type: Task Components: Tools and Build Reporter: Joseph Witt Assignee: Matt Gilman Fix For: 0.2.0 This is a ticket to track general commits needed to conduct the release management activities themselves. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (NIFI-627) ControlRate processor does not accurately control the rate
[ https://issues.apache.org/jira/browse/NIFI-627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580940#comment-14580940 ] Aldrin Piri commented on NIFI-627: -- I can see potentially needing a dual approach to this case: one by data volume prioritized (what Mike is looking for) and one time prioritized (current approach). To the data volume prioritized approach, my question is how the user specified time period is concerned. Do we scale Mike's example of 5KB/s to the 5 minute window a processor shows? To an hour? User configurable interval? While these rates are linearly proportional to each other, I feel like they have semantically different interpretations, but I could just be stuck on the time prioritized perspective. ControlRate processor does not accurately control the rate -- Key: NIFI-627 URL: https://issues.apache.org/jira/browse/NIFI-627 Project: Apache NiFi Issue Type: Bug Components: Extensions Affects Versions: 0.1.0 Reporter: Michael Moser Assignee: Aldrin Piri Priority: Minor Fix For: 0.2.0 Set a ControlRate processor to something like 5 KB per 1 sec. Generate flow files that are about 300 KB in size and feed a bunch to this processor. This should allow about 5 files through per 5 minutes. But it allows a lot more data through than it should. The difference seems to get worse with really low Time Duration values. And people tend to think in number of bytes per second so the temptation to set Time Duration to 1 sec is great. Also, if ControlRate has multiple input queues, it seems to output even more data than it should. This seems to be caused by the code at the beginning of ControlRate onTrigger(). Under some conditions when the number of files that are allowed through per Time Duration is less than 1, the Throttle is being removed from the throttleMap while it actually still should be in use. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (NIFI-589) Add processors that can run Apache Flume sources/sinks
[ https://issues.apache.org/jira/browse/NIFI-589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581050#comment-14581050 ] ASF GitHub Bot commented on NIFI-589: - Github user joey commented on the pull request: https://github.com/apache/incubator-nifi/pull/51#issuecomment-110907254 Thanks @markap14! Add processors that can run Apache Flume sources/sinks -- Key: NIFI-589 URL: https://issues.apache.org/jira/browse/NIFI-589 Project: Apache NiFi Issue Type: New Feature Components: Extensions Affects Versions: 0.1.0 Reporter: Joey Echeverria -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (NIFI-642) Eliminate hardcoded HDFS compression codec classnames.
[ https://issues.apache.org/jira/browse/NIFI-642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580857#comment-14580857 ] Mark Payne commented on NIFI-642: - Hi Tim, Thanks for contributing this. Can you explain the motivation here? My guess is that the intent is to allow arbitrary compression mechanisms that were not originally part of the Allowable Values? The problem that I have with this approach is that the user now has to know the fully qualified classname of the desired compression codec. This might be okay for a hadoop developer, but many of the users of NiFi are not developers at all but have more sys admin/operations types of roles. I don't know if requiring the user to come up with the appropriate classname is worth the tradeoff. It is easy enough to simply update the Allowable Values to include new compression codecs as needed. Do others have thoughts on this? Thanks -Mark Eliminate hardcoded HDFS compression codec classnames. -- Key: NIFI-642 URL: https://issues.apache.org/jira/browse/NIFI-642 Project: Apache NiFi Issue Type: Improvement Reporter: Tim Reardon Priority: Minor Fix For: 0.2.0 Available HDFS compression codec classes were hardcoded as part of NIFI-600. This ticket will allow PutHDFS to discover the available codecs via CompressionCodecFactory, and allow GetHDFS to choose the codec to use based on file extension. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (NIFI-454) Distributed cache server unit tests should use random ports
[ https://issues.apache.org/jira/browse/NIFI-454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580864#comment-14580864 ] Mark Payne commented on NIFI-454: - [~mcgilman] I updated the patch with your suggestion. Distributed cache server unit tests should use random ports --- Key: NIFI-454 URL: https://issues.apache.org/jira/browse/NIFI-454 Project: Apache NiFi Issue Type: Improvement Components: Extensions, Tools and Build Reporter: Mark Payne Assignee: Mark Payne Labels: beginner Fix For: 0.2.0 Attachments: 0001-NIFI-454-Use-random-ports-instead-of-specific-ports-.patch the distributed-map-cache-server (and maybe the distributed-set-cache-server) have unit tests that start the servers but don't set the port. The tests should be updated to set the port to 0 so that it will use a random port. This means that the service implementation will also need to expose the port that it's listening on so that the unit tests can know the port. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[1/2] incubator-nifi git commit: NIFI-669: - Allowing a property that as been removed to be re-added before the configuration is saved. Previously this was not allowed as the property was hidden but s
Repository: incubator-nifi
Updated Branches:
refs/heads/develop 976cfaf60 - 1404275bd
NIFI-669:
- Allowing a property that as been removed to be re-added before the
configuration is saved. Previously this was not allowed as the property was
hidden but still present (until that save action). Now in that case the values
are cleared and user is allowed to edit the property again.
Project: http://git-wip-us.apache.org/repos/asf/incubator-nifi/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-nifi/commit/9480c7a9
Tree: http://git-wip-us.apache.org/repos/asf/incubator-nifi/tree/9480c7a9
Diff: http://git-wip-us.apache.org/repos/asf/incubator-nifi/diff/9480c7a9
Branch: refs/heads/develop
Commit: 9480c7a9c54a64f36a178875aa0ebd082190f644
Parents: 86cbfab
Author: Matt Gilman matt.c.gil...@gmail.com
Authored: Wed Jun 10 12:27:00 2015 -0400
Committer: Matt Gilman matt.c.gil...@gmail.com
Committed: Wed Jun 10 12:27:00 2015 -0400
--
.../propertytable/jquery.propertytable.js | 51 +---
1 file changed, 34 insertions(+), 17 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/incubator-nifi/blob/9480c7a9/nifi/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-ui/src/main/webapp/js/jquery/propertytable/jquery.propertytable.js
--
diff --git
a/nifi/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-ui/src/main/webapp/js/jquery/propertytable/jquery.propertytable.js
b/nifi/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-ui/src/main/webapp/js/jquery/propertytable/jquery.propertytable.js
index ca53709..de257fa 100644
---
a/nifi/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-ui/src/main/webapp/js/jquery/propertytable/jquery.propertytable.js
+++
b/nifi/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-ui/src/main/webapp/js/jquery/propertytable/jquery.propertytable.js
@@ -1142,11 +1142,10 @@
var target = $(e.target);
if (target.hasClass('delete-property')) {
-// mark the property in question for removal
-property.hidden = true;
-
-// refresh the table
-propertyData.updateItem(property.id, property);
+// mark the property in question for removal and refresh
the table
+propertyData.updateItem(property.id, $.extend(property, {
+hidden: true
+}));
// prevents standard edit logic
e.stopImmediatePropagation();
@@ -1381,15 +1380,15 @@
var propertyData = propertyGrid.getData();
// ensure the property name is unique
-var existingPropertyId = null;
+var existingItem = null;
$.each(propertyData.getItems(), function (_,
item) {
if (propertyName === item.property) {
-existingPropertyId = item.id;
+existingItem = item;
return false;
}
});
-if (existingPropertyId === null) {
+if (existingItem === null) {
// load the descriptor and add the property
options.descriptorDeferred(propertyName).done(function(response) {
var descriptor =
response.propertyDescriptor;
@@ -1418,15 +1417,29 @@
propertyGrid.editActiveCell();
});
} else {
-nf.Dialog.showOkDialog({
-dialogContent: 'A property with this
name already exists.',
-overlayBackground: false
-});
-
-// select the existing properties row
-var row =
propertyData.getRowById(existingPropertyId);
-propertyGrid.setSelectedRows([row]);
-propertyGrid.scrollRowIntoView(row);
+// if this row is currently hidden, clear
the value and show it
+if
[2/2] incubator-nifi git commit: Merge branch 'develop' of https://git-wip-us.apache.org/repos/asf/incubator-nifi into develop
Merge branch 'develop' of https://git-wip-us.apache.org/repos/asf/incubator-nifi into develop Project: http://git-wip-us.apache.org/repos/asf/incubator-nifi/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-nifi/commit/1404275b Tree: http://git-wip-us.apache.org/repos/asf/incubator-nifi/tree/1404275b Diff: http://git-wip-us.apache.org/repos/asf/incubator-nifi/diff/1404275b Branch: refs/heads/develop Commit: 1404275bdfbd85ef405c269f48fddc7db103fb6c Parents: 9480c7a 976cfaf Author: Matt Gilman matt.c.gil...@gmail.com Authored: Wed Jun 10 12:28:42 2015 -0400 Committer: Matt Gilman matt.c.gil...@gmail.com Committed: Wed Jun 10 12:28:42 2015 -0400 -- .../additionalDetails.html | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) --
[jira] [Updated] (NIFI-454) Distributed cache server unit tests should use random ports
[ https://issues.apache.org/jira/browse/NIFI-454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Payne updated NIFI-454: Attachment: (was: 0001-NIFI-454-Use-random-ports-instead-of-specific-ports-.patch) Distributed cache server unit tests should use random ports --- Key: NIFI-454 URL: https://issues.apache.org/jira/browse/NIFI-454 Project: Apache NiFi Issue Type: Improvement Components: Extensions, Tools and Build Reporter: Mark Payne Assignee: Mark Payne Labels: beginner Fix For: 0.2.0 Attachments: 0001-NIFI-454-Use-random-ports-instead-of-specific-ports-.patch the distributed-map-cache-server (and maybe the distributed-set-cache-server) have unit tests that start the servers but don't set the port. The tests should be updated to set the port to 0 so that it will use a random port. This means that the service implementation will also need to expose the port that it's listening on so that the unit tests can know the port. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (NIFI-627) ControlRate processor does not accurately control the rate
[ https://issues.apache.org/jira/browse/NIFI-627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580915#comment-14580915 ] Mark Payne commented on NIFI-627: - I can see both algorithms being useful here. [~mosermw] In the case that you are sending it 300 KB files and have it configured for 5 KB every 1 second, are you proposing that it should allow the first file through and then wait 60 seconds before sending another file through? If so, that could definitely be done, with a new property allowing the user to specify which strategy to use. Another useful feature, I think (maybe this belongs in a new processor, not sure), is to have another option that allows the user to have an overflow type of relationship. So that instead of backing up data, it can route data to a different path through the flow. ControlRate processor does not accurately control the rate -- Key: NIFI-627 URL: https://issues.apache.org/jira/browse/NIFI-627 Project: Apache NiFi Issue Type: Bug Components: Extensions Affects Versions: 0.1.0 Reporter: Michael Moser Assignee: Aldrin Piri Priority: Minor Fix For: 0.2.0 Set a ControlRate processor to something like 5 KB per 1 sec. Generate flow files that are about 300 KB in size and feed a bunch to this processor. This should allow about 5 files through per 5 minutes. But it allows a lot more data through than it should. The difference seems to get worse with really low Time Duration values. And people tend to think in number of bytes per second so the temptation to set Time Duration to 1 sec is great. Also, if ControlRate has multiple input queues, it seems to output even more data than it should. This seems to be caused by the code at the beginning of ControlRate onTrigger(). Under some conditions when the number of files that are allowed through per Time Duration is less than 1, the Throttle is being removed from the throttleMap while it actually still should be in use. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (NIFI-669) Unable to add property to UpdateAttribute if property was just deleted
[ https://issues.apache.org/jira/browse/NIFI-669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580824#comment-14580824 ] ASF subversion and git services commented on NIFI-669: -- Commit 9480c7a9c54a64f36a178875aa0ebd082190f644 in incubator-nifi's branch refs/heads/develop from [~mcgilman] [ https://git-wip-us.apache.org/repos/asf?p=incubator-nifi.git;h=9480c7a ] NIFI-669: - Allowing a property that as been removed to be re-added before the configuration is saved. Previously this was not allowed as the property was hidden but still present (until that save action). Now in that case the values are cleared and user is allowed to edit the property again. Unable to add property to UpdateAttribute if property was just deleted -- Key: NIFI-669 URL: https://issues.apache.org/jira/browse/NIFI-669 Project: Apache NiFi Issue Type: Bug Components: Core UI Affects Versions: 0.2.0 Reporter: Dan Bress Assignee: Matt Gilman Priority: Minor Attachments: 0001-NIFI-669.patch Steps to reproduce: 1) drag an UpdateAttribute to the graph 2) right click-configure-properties 3) add a new property, A=B 4) delete that property 5) add a new property A... At this point the UI will kick out saying a property with this name already exists When from the users perspective they cannot see a property with such a name(it was deleted). I'd recommend either updating the error message you are adding a property that was recently deleted, please press 'apply' before readding this property Or making it so you can re-add a property that was just deleted. *UPDATE* This affects all processors -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (NIFI-454) Distributed cache server unit tests should use random ports
[ https://issues.apache.org/jira/browse/NIFI-454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Payne updated NIFI-454: Attachment: 0001-NIFI-454-Use-random-ports-instead-of-specific-ports-.patch Distributed cache server unit tests should use random ports --- Key: NIFI-454 URL: https://issues.apache.org/jira/browse/NIFI-454 Project: Apache NiFi Issue Type: Improvement Components: Extensions, Tools and Build Reporter: Mark Payne Assignee: Mark Payne Labels: beginner Fix For: 0.2.0 Attachments: 0001-NIFI-454-Use-random-ports-instead-of-specific-ports-.patch the distributed-map-cache-server (and maybe the distributed-set-cache-server) have unit tests that start the servers but don't set the port. The tests should be updated to set the port to 0 so that it will use a random port. This means that the service implementation will also need to expose the port that it's listening on so that the unit tests can know the port. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (NIFI-589) Add processors that can run Apache Flume sources/sinks
[
https://issues.apache.org/jira/browse/NIFI-589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581093#comment-14581093
]
ASF GitHub Bot commented on NIFI-589:
-
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/incubator-nifi/pull/51#discussion_r32166926
--- Diff:
nifi/nifi-nar-bundles/nifi-flume-bundle/nifi-flume-processors/src/main/java/org/apache/nifi/processors/flume/FlumeSinkProcessor.java
---
@@ -0,0 +1,146 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the License); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an AS IS BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.nifi.processors.flume;
+
+import com.google.common.base.Throwables;
+import com.google.common.collect.ImmutableList;
+import com.google.common.collect.ImmutableSet;
+import java.util.List;
+import java.util.Set;
+import org.apache.flume.Context;
+import org.apache.flume.EventDeliveryException;
+import org.apache.flume.Sink;
+import org.apache.flume.conf.Configurables;
+import org.apache.nifi.annotation.documentation.CapabilityDescription;
+import org.apache.nifi.annotation.documentation.Tags;
+import org.apache.nifi.annotation.lifecycle.OnScheduled;
+import org.apache.nifi.annotation.lifecycle.OnUnscheduled;
+
+import org.apache.nifi.components.PropertyDescriptor;
+import org.apache.nifi.components.Validator;
+import org.apache.nifi.processor.ProcessContext;
+import org.apache.nifi.processor.ProcessSession;
+import org.apache.nifi.processor.ProcessorInitializationContext;
+import org.apache.nifi.processor.Relationship;
+import org.apache.nifi.processor.SchedulingContext;
+import org.apache.nifi.processor.exception.ProcessException;
+import org.apache.nifi.processor.util.StandardValidators;
+
+/**
+ * This processor runs a Flume sink
+ */
+@Tags({flume, hadoop, get, sink})
+@CapabilityDescription(Write FlowFile data to a Flume sink)
+public class FlumeSinkProcessor extends AbstractFlumeProcessor {
+
+public static final PropertyDescriptor SINK_TYPE = new
PropertyDescriptor.Builder()
+.name(Sink Type)
+.description(The fully-qualified name of the Sink class)
+.required(true)
+.addValidator(createSinkValidator())
+.build();
+public static final PropertyDescriptor AGENT_NAME = new
PropertyDescriptor.Builder()
+.name(Agent Name)
+.description(The name of the agent used in the Flume sink
configuration)
+.required(true)
+.defaultValue(tier1)
+.addValidator(StandardValidators.NON_EMPTY_VALIDATOR)
+.build();
+public static final PropertyDescriptor SOURCE_NAME = new
PropertyDescriptor.Builder()
+.name(Sink Name)
+.description(The name of the sink used in the Flume sink
configuration)
+.required(true)
+.defaultValue(sink-1)
+.addValidator(StandardValidators.NON_EMPTY_VALIDATOR)
+.build();
+public static final PropertyDescriptor FLUME_CONFIG = new
PropertyDescriptor.Builder()
+.name(Flume Configuration)
+.description(The Flume configuration for the sink copied from
the flume.properties file)
+.required(true)
+.defaultValue()
+.addValidator(Validator.VALID)
+.build();
+
+public static final Relationship SUCCESS = new
Relationship.Builder().name(success).build();
+public static final Relationship FAILURE = new
Relationship.Builder().name(failure).build();
+
+private ListPropertyDescriptor descriptors;
+private SetRelationship relationships;
+
+private volatile Sink sink;
+private volatile NifiSinkSessionChannel channel;
+
+@Override
+protected void init(final ProcessorInitializationContext context) {
+this.descriptors = ImmutableList.of(SINK_TYPE, AGENT_NAME,
[jira] [Commented] (NIFI-589) Add processors that can run Apache Flume sources/sinks
[
https://issues.apache.org/jira/browse/NIFI-589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581108#comment-14581108
]
ASF GitHub Bot commented on NIFI-589:
-
Github user joewitt commented on a diff in the pull request:
https://github.com/apache/incubator-nifi/pull/51#discussion_r32168365
--- Diff:
nifi/nifi-nar-bundles/nifi-flume-bundle/nifi-flume-processors/src/main/java/org/apache/nifi/processors/flume/FlumeSinkProcessor.java
---
@@ -0,0 +1,146 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the License); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an AS IS BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.nifi.processors.flume;
+
+import com.google.common.base.Throwables;
+import com.google.common.collect.ImmutableList;
+import com.google.common.collect.ImmutableSet;
+import java.util.List;
+import java.util.Set;
+import org.apache.flume.Context;
+import org.apache.flume.EventDeliveryException;
+import org.apache.flume.Sink;
+import org.apache.flume.conf.Configurables;
+import org.apache.nifi.annotation.documentation.CapabilityDescription;
+import org.apache.nifi.annotation.documentation.Tags;
+import org.apache.nifi.annotation.lifecycle.OnScheduled;
+import org.apache.nifi.annotation.lifecycle.OnUnscheduled;
+
+import org.apache.nifi.components.PropertyDescriptor;
+import org.apache.nifi.components.Validator;
+import org.apache.nifi.processor.ProcessContext;
+import org.apache.nifi.processor.ProcessSession;
+import org.apache.nifi.processor.ProcessorInitializationContext;
+import org.apache.nifi.processor.Relationship;
+import org.apache.nifi.processor.SchedulingContext;
+import org.apache.nifi.processor.exception.ProcessException;
+import org.apache.nifi.processor.util.StandardValidators;
+
+/**
+ * This processor runs a Flume sink
+ */
+@Tags({flume, hadoop, get, sink})
+@CapabilityDescription(Write FlowFile data to a Flume sink)
+public class FlumeSinkProcessor extends AbstractFlumeProcessor {
+
+public static final PropertyDescriptor SINK_TYPE = new
PropertyDescriptor.Builder()
+.name(Sink Type)
+.description(The fully-qualified name of the Sink class)
+.required(true)
+.addValidator(createSinkValidator())
+.build();
+public static final PropertyDescriptor AGENT_NAME = new
PropertyDescriptor.Builder()
+.name(Agent Name)
+.description(The name of the agent used in the Flume sink
configuration)
+.required(true)
+.defaultValue(tier1)
+.addValidator(StandardValidators.NON_EMPTY_VALIDATOR)
+.build();
+public static final PropertyDescriptor SOURCE_NAME = new
PropertyDescriptor.Builder()
+.name(Sink Name)
+.description(The name of the sink used in the Flume sink
configuration)
+.required(true)
+.defaultValue(sink-1)
+.addValidator(StandardValidators.NON_EMPTY_VALIDATOR)
+.build();
+public static final PropertyDescriptor FLUME_CONFIG = new
PropertyDescriptor.Builder()
+.name(Flume Configuration)
+.description(The Flume configuration for the sink copied from
the flume.properties file)
+.required(true)
+.defaultValue()
+.addValidator(Validator.VALID)
+.build();
+
+public static final Relationship SUCCESS = new
Relationship.Builder().name(success).build();
+public static final Relationship FAILURE = new
Relationship.Builder().name(failure).build();
+
+private ListPropertyDescriptor descriptors;
+private SetRelationship relationships;
+
+private volatile Sink sink;
+private volatile NifiSinkSessionChannel channel;
+
+@Override
+protected void init(final ProcessorInitializationContext context) {
+this.descriptors = ImmutableList.of(SINK_TYPE, AGENT_NAME,
[jira] [Commented] (NIFI-589) Add processors that can run Apache Flume sources/sinks
[
https://issues.apache.org/jira/browse/NIFI-589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581116#comment-14581116
]
ASF GitHub Bot commented on NIFI-589:
-
Github user joey commented on a diff in the pull request:
https://github.com/apache/incubator-nifi/pull/51#discussion_r32168929
--- Diff:
nifi/nifi-nar-bundles/nifi-flume-bundle/nifi-flume-processors/src/main/java/org/apache/nifi/processors/flume/FlumeSinkProcessor.java
---
@@ -0,0 +1,146 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the License); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an AS IS BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.nifi.processors.flume;
+
+import com.google.common.base.Throwables;
+import com.google.common.collect.ImmutableList;
+import com.google.common.collect.ImmutableSet;
+import java.util.List;
+import java.util.Set;
+import org.apache.flume.Context;
+import org.apache.flume.EventDeliveryException;
+import org.apache.flume.Sink;
+import org.apache.flume.conf.Configurables;
+import org.apache.nifi.annotation.documentation.CapabilityDescription;
+import org.apache.nifi.annotation.documentation.Tags;
+import org.apache.nifi.annotation.lifecycle.OnScheduled;
+import org.apache.nifi.annotation.lifecycle.OnUnscheduled;
+
+import org.apache.nifi.components.PropertyDescriptor;
+import org.apache.nifi.components.Validator;
+import org.apache.nifi.processor.ProcessContext;
+import org.apache.nifi.processor.ProcessSession;
+import org.apache.nifi.processor.ProcessorInitializationContext;
+import org.apache.nifi.processor.Relationship;
+import org.apache.nifi.processor.SchedulingContext;
+import org.apache.nifi.processor.exception.ProcessException;
+import org.apache.nifi.processor.util.StandardValidators;
+
+/**
+ * This processor runs a Flume sink
+ */
+@Tags({flume, hadoop, get, sink})
+@CapabilityDescription(Write FlowFile data to a Flume sink)
+public class FlumeSinkProcessor extends AbstractFlumeProcessor {
+
+public static final PropertyDescriptor SINK_TYPE = new
PropertyDescriptor.Builder()
+.name(Sink Type)
+.description(The fully-qualified name of the Sink class)
+.required(true)
+.addValidator(createSinkValidator())
+.build();
+public static final PropertyDescriptor AGENT_NAME = new
PropertyDescriptor.Builder()
+.name(Agent Name)
+.description(The name of the agent used in the Flume sink
configuration)
+.required(true)
+.defaultValue(tier1)
+.addValidator(StandardValidators.NON_EMPTY_VALIDATOR)
+.build();
+public static final PropertyDescriptor SOURCE_NAME = new
PropertyDescriptor.Builder()
+.name(Sink Name)
+.description(The name of the sink used in the Flume sink
configuration)
+.required(true)
+.defaultValue(sink-1)
+.addValidator(StandardValidators.NON_EMPTY_VALIDATOR)
+.build();
+public static final PropertyDescriptor FLUME_CONFIG = new
PropertyDescriptor.Builder()
+.name(Flume Configuration)
+.description(The Flume configuration for the sink copied from
the flume.properties file)
+.required(true)
+.defaultValue()
+.addValidator(Validator.VALID)
+.build();
+
+public static final Relationship SUCCESS = new
Relationship.Builder().name(success).build();
+public static final Relationship FAILURE = new
Relationship.Builder().name(failure).build();
+
+private ListPropertyDescriptor descriptors;
+private SetRelationship relationships;
+
+private volatile Sink sink;
+private volatile NifiSinkSessionChannel channel;
+
+@Override
+protected void init(final ProcessorInitializationContext context) {
+this.descriptors = ImmutableList.of(SINK_TYPE, AGENT_NAME,
[jira] [Commented] (NIFI-589) Add processors that can run Apache Flume sources/sinks
[
https://issues.apache.org/jira/browse/NIFI-589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581115#comment-14581115
]
ASF GitHub Bot commented on NIFI-589:
-
Github user joey commented on a diff in the pull request:
https://github.com/apache/incubator-nifi/pull/51#discussion_r32168806
--- Diff:
nifi/nifi-nar-bundles/nifi-flume-bundle/nifi-flume-processors/src/main/java/org/apache/nifi/processors/flume/FlumeSourceProcessor.java
---
@@ -0,0 +1,203 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the License); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an AS IS BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.nifi.processors.flume;
+
+import com.google.common.base.Throwables;
+import com.google.common.collect.ImmutableList;
+import com.google.common.collect.ImmutableSet;
+import java.util.List;
+import java.util.Set;
+import java.util.concurrent.atomic.AtomicReference;
+import org.apache.flume.EventDeliveryException;
+import org.apache.flume.EventDrivenSource;
+import org.apache.flume.PollableSource;
+import org.apache.flume.Source;
+import org.apache.flume.channel.ChannelProcessor;
+import org.apache.flume.conf.Configurables;
+import org.apache.flume.source.EventDrivenSourceRunner;
+import org.apache.nifi.annotation.documentation.CapabilityDescription;
+import org.apache.nifi.annotation.documentation.Tags;
+import org.apache.nifi.annotation.lifecycle.OnScheduled;
+import org.apache.nifi.annotation.lifecycle.OnStopped;
+import org.apache.nifi.annotation.lifecycle.OnUnscheduled;
+
+import org.apache.nifi.components.PropertyDescriptor;
+import org.apache.nifi.components.Validator;
+import org.apache.nifi.processor.ProcessContext;
+import org.apache.nifi.processor.ProcessSession;
+import org.apache.nifi.processor.ProcessSessionFactory;
+import org.apache.nifi.processor.ProcessorInitializationContext;
+import org.apache.nifi.processor.Relationship;
+import org.apache.nifi.processor.SchedulingContext;
+import org.apache.nifi.processor.exception.ProcessException;
+import org.apache.nifi.processor.util.StandardValidators;
+
+/**
+ * This processor runs a Flume source
+ */
+@Tags({flume, hadoop, get, source})
+@CapabilityDescription(Generate FlowFile data from a Flume source)
+public class FlumeSourceProcessor extends AbstractFlumeProcessor {
+
+public static final PropertyDescriptor SOURCE_TYPE = new
PropertyDescriptor.Builder()
+.name(Source Type)
+.description(The fully-qualified name of the Source class)
+.required(true)
+.addValidator(createSourceValidator())
+.build();
+public static final PropertyDescriptor AGENT_NAME = new
PropertyDescriptor.Builder()
+.name(Agent Name)
+.description(The name of the agent used in the Flume source
configuration)
+.required(true)
+.defaultValue(tier1)
+.addValidator(StandardValidators.NON_EMPTY_VALIDATOR)
+.build();
+public static final PropertyDescriptor SOURCE_NAME = new
PropertyDescriptor.Builder()
+.name(Source Name)
+.description(The name of the source used in the Flume source
configuration)
+.required(true)
+.defaultValue(src-1)
+.addValidator(StandardValidators.NON_EMPTY_VALIDATOR)
+.build();
+public static final PropertyDescriptor FLUME_CONFIG = new
PropertyDescriptor.Builder()
+.name(Flume Configuration)
+.description(The Flume configuration for the source copied from
the flume.properties file)
+.required(true)
+.defaultValue()
+.addValidator(Validator.VALID)
+.build();
+
+public static final Relationship SUCCESS = new
Relationship.Builder().name(success)
+.build();
+
+private ListPropertyDescriptor descriptors;
+private SetRelationship relationships;
+
+private volatile Source source;
+
+private final
[jira] [Commented] (NIFI-589) Add processors that can run Apache Flume sources/sinks
[
https://issues.apache.org/jira/browse/NIFI-589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581122#comment-14581122
]
ASF GitHub Bot commented on NIFI-589:
-
Github user joey commented on a diff in the pull request:
https://github.com/apache/incubator-nifi/pull/51#discussion_r32169514
--- Diff:
nifi/nifi-nar-bundles/nifi-flume-bundle/nifi-flume-processors/src/main/java/org/apache/nifi/processors/flume/FlumeSourceProcessor.java
---
@@ -0,0 +1,203 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the License); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an AS IS BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.nifi.processors.flume;
+
+import com.google.common.base.Throwables;
+import com.google.common.collect.ImmutableList;
+import com.google.common.collect.ImmutableSet;
+import java.util.List;
+import java.util.Set;
+import java.util.concurrent.atomic.AtomicReference;
+import org.apache.flume.EventDeliveryException;
+import org.apache.flume.EventDrivenSource;
+import org.apache.flume.PollableSource;
+import org.apache.flume.Source;
+import org.apache.flume.channel.ChannelProcessor;
+import org.apache.flume.conf.Configurables;
+import org.apache.flume.source.EventDrivenSourceRunner;
+import org.apache.nifi.annotation.documentation.CapabilityDescription;
+import org.apache.nifi.annotation.documentation.Tags;
+import org.apache.nifi.annotation.lifecycle.OnScheduled;
+import org.apache.nifi.annotation.lifecycle.OnStopped;
+import org.apache.nifi.annotation.lifecycle.OnUnscheduled;
+
+import org.apache.nifi.components.PropertyDescriptor;
+import org.apache.nifi.components.Validator;
+import org.apache.nifi.processor.ProcessContext;
+import org.apache.nifi.processor.ProcessSession;
+import org.apache.nifi.processor.ProcessSessionFactory;
+import org.apache.nifi.processor.ProcessorInitializationContext;
+import org.apache.nifi.processor.Relationship;
+import org.apache.nifi.processor.SchedulingContext;
+import org.apache.nifi.processor.exception.ProcessException;
+import org.apache.nifi.processor.util.StandardValidators;
+
+/**
+ * This processor runs a Flume source
+ */
+@Tags({flume, hadoop, get, source})
+@CapabilityDescription(Generate FlowFile data from a Flume source)
+public class FlumeSourceProcessor extends AbstractFlumeProcessor {
+
+public static final PropertyDescriptor SOURCE_TYPE = new
PropertyDescriptor.Builder()
+.name(Source Type)
+.description(The fully-qualified name of the Source class)
+.required(true)
+.addValidator(createSourceValidator())
+.build();
+public static final PropertyDescriptor AGENT_NAME = new
PropertyDescriptor.Builder()
+.name(Agent Name)
+.description(The name of the agent used in the Flume source
configuration)
+.required(true)
+.defaultValue(tier1)
+.addValidator(StandardValidators.NON_EMPTY_VALIDATOR)
+.build();
+public static final PropertyDescriptor SOURCE_NAME = new
PropertyDescriptor.Builder()
+.name(Source Name)
+.description(The name of the source used in the Flume source
configuration)
+.required(true)
+.defaultValue(src-1)
+.addValidator(StandardValidators.NON_EMPTY_VALIDATOR)
+.build();
+public static final PropertyDescriptor FLUME_CONFIG = new
PropertyDescriptor.Builder()
+.name(Flume Configuration)
+.description(The Flume configuration for the source copied from
the flume.properties file)
+.required(true)
+.defaultValue()
+.addValidator(Validator.VALID)
+.build();
+
+public static final Relationship SUCCESS = new
Relationship.Builder().name(success)
+.build();
+
+private ListPropertyDescriptor descriptors;
+private SetRelationship relationships;
+
+private volatile Source source;
+
+private final
[jira] [Commented] (NIFI-589) Add processors that can run Apache Flume sources/sinks
[
https://issues.apache.org/jira/browse/NIFI-589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581101#comment-14581101
]
ASF GitHub Bot commented on NIFI-589:
-
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/incubator-nifi/pull/51#discussion_r32167493
--- Diff:
nifi/nifi-nar-bundles/nifi-flume-bundle/nifi-flume-processors/src/main/java/org/apache/nifi/processors/flume/FlumeSinkProcessor.java
---
@@ -0,0 +1,146 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the License); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an AS IS BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.nifi.processors.flume;
+
+import com.google.common.base.Throwables;
+import com.google.common.collect.ImmutableList;
+import com.google.common.collect.ImmutableSet;
+import java.util.List;
+import java.util.Set;
+import org.apache.flume.Context;
+import org.apache.flume.EventDeliveryException;
+import org.apache.flume.Sink;
+import org.apache.flume.conf.Configurables;
+import org.apache.nifi.annotation.documentation.CapabilityDescription;
+import org.apache.nifi.annotation.documentation.Tags;
+import org.apache.nifi.annotation.lifecycle.OnScheduled;
+import org.apache.nifi.annotation.lifecycle.OnUnscheduled;
+
+import org.apache.nifi.components.PropertyDescriptor;
+import org.apache.nifi.components.Validator;
+import org.apache.nifi.processor.ProcessContext;
+import org.apache.nifi.processor.ProcessSession;
+import org.apache.nifi.processor.ProcessorInitializationContext;
+import org.apache.nifi.processor.Relationship;
+import org.apache.nifi.processor.SchedulingContext;
+import org.apache.nifi.processor.exception.ProcessException;
+import org.apache.nifi.processor.util.StandardValidators;
+
+/**
+ * This processor runs a Flume sink
+ */
+@Tags({flume, hadoop, get, sink})
+@CapabilityDescription(Write FlowFile data to a Flume sink)
+public class FlumeSinkProcessor extends AbstractFlumeProcessor {
+
+public static final PropertyDescriptor SINK_TYPE = new
PropertyDescriptor.Builder()
+.name(Sink Type)
+.description(The fully-qualified name of the Sink class)
+.required(true)
+.addValidator(createSinkValidator())
+.build();
+public static final PropertyDescriptor AGENT_NAME = new
PropertyDescriptor.Builder()
+.name(Agent Name)
+.description(The name of the agent used in the Flume sink
configuration)
+.required(true)
+.defaultValue(tier1)
+.addValidator(StandardValidators.NON_EMPTY_VALIDATOR)
+.build();
+public static final PropertyDescriptor SOURCE_NAME = new
PropertyDescriptor.Builder()
+.name(Sink Name)
+.description(The name of the sink used in the Flume sink
configuration)
+.required(true)
+.defaultValue(sink-1)
+.addValidator(StandardValidators.NON_EMPTY_VALIDATOR)
+.build();
+public static final PropertyDescriptor FLUME_CONFIG = new
PropertyDescriptor.Builder()
+.name(Flume Configuration)
+.description(The Flume configuration for the sink copied from
the flume.properties file)
+.required(true)
+.defaultValue()
+.addValidator(Validator.VALID)
+.build();
+
+public static final Relationship SUCCESS = new
Relationship.Builder().name(success).build();
+public static final Relationship FAILURE = new
Relationship.Builder().name(failure).build();
+
+private ListPropertyDescriptor descriptors;
+private SetRelationship relationships;
+
+private volatile Sink sink;
+private volatile NifiSinkSessionChannel channel;
+
+@Override
+protected void init(final ProcessorInitializationContext context) {
+this.descriptors = ImmutableList.of(SINK_TYPE, AGENT_NAME,
[jira] [Commented] (NIFI-589) Add processors that can run Apache Flume sources/sinks
[
https://issues.apache.org/jira/browse/NIFI-589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581110#comment-14581110
]
ASF GitHub Bot commented on NIFI-589:
-
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/incubator-nifi/pull/51#discussion_r32168462
--- Diff:
nifi/nifi-nar-bundles/nifi-flume-bundle/nifi-flume-processors/src/main/java/org/apache/nifi/processors/flume/FlumeSourceProcessor.java
---
@@ -0,0 +1,203 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the License); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an AS IS BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.nifi.processors.flume;
+
+import com.google.common.base.Throwables;
+import com.google.common.collect.ImmutableList;
+import com.google.common.collect.ImmutableSet;
+import java.util.List;
+import java.util.Set;
+import java.util.concurrent.atomic.AtomicReference;
+import org.apache.flume.EventDeliveryException;
+import org.apache.flume.EventDrivenSource;
+import org.apache.flume.PollableSource;
+import org.apache.flume.Source;
+import org.apache.flume.channel.ChannelProcessor;
+import org.apache.flume.conf.Configurables;
+import org.apache.flume.source.EventDrivenSourceRunner;
+import org.apache.nifi.annotation.documentation.CapabilityDescription;
+import org.apache.nifi.annotation.documentation.Tags;
+import org.apache.nifi.annotation.lifecycle.OnScheduled;
+import org.apache.nifi.annotation.lifecycle.OnStopped;
+import org.apache.nifi.annotation.lifecycle.OnUnscheduled;
+
+import org.apache.nifi.components.PropertyDescriptor;
+import org.apache.nifi.components.Validator;
+import org.apache.nifi.processor.ProcessContext;
+import org.apache.nifi.processor.ProcessSession;
+import org.apache.nifi.processor.ProcessSessionFactory;
+import org.apache.nifi.processor.ProcessorInitializationContext;
+import org.apache.nifi.processor.Relationship;
+import org.apache.nifi.processor.SchedulingContext;
+import org.apache.nifi.processor.exception.ProcessException;
+import org.apache.nifi.processor.util.StandardValidators;
+
+/**
+ * This processor runs a Flume source
+ */
+@Tags({flume, hadoop, get, source})
+@CapabilityDescription(Generate FlowFile data from a Flume source)
+public class FlumeSourceProcessor extends AbstractFlumeProcessor {
+
+public static final PropertyDescriptor SOURCE_TYPE = new
PropertyDescriptor.Builder()
+.name(Source Type)
+.description(The fully-qualified name of the Source class)
+.required(true)
+.addValidator(createSourceValidator())
+.build();
+public static final PropertyDescriptor AGENT_NAME = new
PropertyDescriptor.Builder()
+.name(Agent Name)
+.description(The name of the agent used in the Flume source
configuration)
+.required(true)
+.defaultValue(tier1)
+.addValidator(StandardValidators.NON_EMPTY_VALIDATOR)
+.build();
+public static final PropertyDescriptor SOURCE_NAME = new
PropertyDescriptor.Builder()
+.name(Source Name)
+.description(The name of the source used in the Flume source
configuration)
+.required(true)
+.defaultValue(src-1)
+.addValidator(StandardValidators.NON_EMPTY_VALIDATOR)
+.build();
+public static final PropertyDescriptor FLUME_CONFIG = new
PropertyDescriptor.Builder()
+.name(Flume Configuration)
+.description(The Flume configuration for the source copied from
the flume.properties file)
+.required(true)
+.defaultValue()
+.addValidator(Validator.VALID)
+.build();
+
+public static final Relationship SUCCESS = new
Relationship.Builder().name(success)
+.build();
+
+private ListPropertyDescriptor descriptors;
+private SetRelationship relationships;
+
+private volatile Source source;
+
+private final
[jira] [Assigned] (NIFI-589) Add processors that can run Apache Flume sources/sinks
[ https://issues.apache.org/jira/browse/NIFI-589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joey Echeverria reassigned NIFI-589: Assignee: Joey Echeverria Add processors that can run Apache Flume sources/sinks -- Key: NIFI-589 URL: https://issues.apache.org/jira/browse/NIFI-589 Project: Apache NiFi Issue Type: New Feature Components: Extensions Affects Versions: 0.1.0 Reporter: Joey Echeverria Assignee: Joey Echeverria -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (NIFI-589) Add processors that can run Apache Flume sources/sinks
[
https://issues.apache.org/jira/browse/NIFI-589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581164#comment-14581164
]
ASF GitHub Bot commented on NIFI-589:
-
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/incubator-nifi/pull/51#discussion_r32173669
--- Diff:
nifi/nifi-nar-bundles/nifi-flume-bundle/nifi-flume-processors/src/main/java/org/apache/nifi/processors/flume/FlumeSinkProcessor.java
---
@@ -0,0 +1,146 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the License); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an AS IS BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.nifi.processors.flume;
+
+import com.google.common.base.Throwables;
+import com.google.common.collect.ImmutableList;
+import com.google.common.collect.ImmutableSet;
+import java.util.List;
+import java.util.Set;
+import org.apache.flume.Context;
+import org.apache.flume.EventDeliveryException;
+import org.apache.flume.Sink;
+import org.apache.flume.conf.Configurables;
+import org.apache.nifi.annotation.documentation.CapabilityDescription;
+import org.apache.nifi.annotation.documentation.Tags;
+import org.apache.nifi.annotation.lifecycle.OnScheduled;
+import org.apache.nifi.annotation.lifecycle.OnUnscheduled;
+
+import org.apache.nifi.components.PropertyDescriptor;
+import org.apache.nifi.components.Validator;
+import org.apache.nifi.processor.ProcessContext;
+import org.apache.nifi.processor.ProcessSession;
+import org.apache.nifi.processor.ProcessorInitializationContext;
+import org.apache.nifi.processor.Relationship;
+import org.apache.nifi.processor.SchedulingContext;
+import org.apache.nifi.processor.exception.ProcessException;
+import org.apache.nifi.processor.util.StandardValidators;
+
+/**
+ * This processor runs a Flume sink
+ */
+@Tags({flume, hadoop, get, sink})
+@CapabilityDescription(Write FlowFile data to a Flume sink)
+public class FlumeSinkProcessor extends AbstractFlumeProcessor {
+
+public static final PropertyDescriptor SINK_TYPE = new
PropertyDescriptor.Builder()
+.name(Sink Type)
+.description(The fully-qualified name of the Sink class)
+.required(true)
+.addValidator(createSinkValidator())
+.build();
+public static final PropertyDescriptor AGENT_NAME = new
PropertyDescriptor.Builder()
+.name(Agent Name)
+.description(The name of the agent used in the Flume sink
configuration)
+.required(true)
+.defaultValue(tier1)
+.addValidator(StandardValidators.NON_EMPTY_VALIDATOR)
+.build();
+public static final PropertyDescriptor SOURCE_NAME = new
PropertyDescriptor.Builder()
+.name(Sink Name)
+.description(The name of the sink used in the Flume sink
configuration)
+.required(true)
+.defaultValue(sink-1)
+.addValidator(StandardValidators.NON_EMPTY_VALIDATOR)
+.build();
+public static final PropertyDescriptor FLUME_CONFIG = new
PropertyDescriptor.Builder()
+.name(Flume Configuration)
+.description(The Flume configuration for the sink copied from
the flume.properties file)
+.required(true)
+.defaultValue()
+.addValidator(Validator.VALID)
+.build();
+
+public static final Relationship SUCCESS = new
Relationship.Builder().name(success).build();
+public static final Relationship FAILURE = new
Relationship.Builder().name(failure).build();
+
+private ListPropertyDescriptor descriptors;
+private SetRelationship relationships;
+
+private volatile Sink sink;
+private volatile NifiSinkSessionChannel channel;
+
+@Override
+protected void init(final ProcessorInitializationContext context) {
+this.descriptors = ImmutableList.of(SINK_TYPE, AGENT_NAME,
[jira] [Commented] (NIFI-589) Add processors that can run Apache Flume sources/sinks
[
https://issues.apache.org/jira/browse/NIFI-589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581103#comment-14581103
]
ASF GitHub Bot commented on NIFI-589:
-
Github user joey commented on a diff in the pull request:
https://github.com/apache/incubator-nifi/pull/51#discussion_r32167734
--- Diff:
nifi/nifi-nar-bundles/nifi-flume-bundle/nifi-flume-processors/src/main/java/org/apache/nifi/processors/flume/FlumeSinkProcessor.java
---
@@ -0,0 +1,146 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the License); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an AS IS BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.nifi.processors.flume;
+
+import com.google.common.base.Throwables;
+import com.google.common.collect.ImmutableList;
+import com.google.common.collect.ImmutableSet;
+import java.util.List;
+import java.util.Set;
+import org.apache.flume.Context;
+import org.apache.flume.EventDeliveryException;
+import org.apache.flume.Sink;
+import org.apache.flume.conf.Configurables;
+import org.apache.nifi.annotation.documentation.CapabilityDescription;
+import org.apache.nifi.annotation.documentation.Tags;
+import org.apache.nifi.annotation.lifecycle.OnScheduled;
+import org.apache.nifi.annotation.lifecycle.OnUnscheduled;
+
+import org.apache.nifi.components.PropertyDescriptor;
+import org.apache.nifi.components.Validator;
+import org.apache.nifi.processor.ProcessContext;
+import org.apache.nifi.processor.ProcessSession;
+import org.apache.nifi.processor.ProcessorInitializationContext;
+import org.apache.nifi.processor.Relationship;
+import org.apache.nifi.processor.SchedulingContext;
+import org.apache.nifi.processor.exception.ProcessException;
+import org.apache.nifi.processor.util.StandardValidators;
+
+/**
+ * This processor runs a Flume sink
+ */
+@Tags({flume, hadoop, get, sink})
+@CapabilityDescription(Write FlowFile data to a Flume sink)
+public class FlumeSinkProcessor extends AbstractFlumeProcessor {
+
+public static final PropertyDescriptor SINK_TYPE = new
PropertyDescriptor.Builder()
+.name(Sink Type)
+.description(The fully-qualified name of the Sink class)
+.required(true)
+.addValidator(createSinkValidator())
+.build();
+public static final PropertyDescriptor AGENT_NAME = new
PropertyDescriptor.Builder()
+.name(Agent Name)
+.description(The name of the agent used in the Flume sink
configuration)
+.required(true)
+.defaultValue(tier1)
+.addValidator(StandardValidators.NON_EMPTY_VALIDATOR)
+.build();
+public static final PropertyDescriptor SOURCE_NAME = new
PropertyDescriptor.Builder()
+.name(Sink Name)
+.description(The name of the sink used in the Flume sink
configuration)
+.required(true)
+.defaultValue(sink-1)
+.addValidator(StandardValidators.NON_EMPTY_VALIDATOR)
+.build();
+public static final PropertyDescriptor FLUME_CONFIG = new
PropertyDescriptor.Builder()
+.name(Flume Configuration)
+.description(The Flume configuration for the sink copied from
the flume.properties file)
+.required(true)
+.defaultValue()
+.addValidator(Validator.VALID)
+.build();
+
+public static final Relationship SUCCESS = new
Relationship.Builder().name(success).build();
+public static final Relationship FAILURE = new
Relationship.Builder().name(failure).build();
+
+private ListPropertyDescriptor descriptors;
+private SetRelationship relationships;
+
+private volatile Sink sink;
+private volatile NifiSinkSessionChannel channel;
+
+@Override
+protected void init(final ProcessorInitializationContext context) {
+this.descriptors = ImmutableList.of(SINK_TYPE, AGENT_NAME,
[jira] [Commented] (NIFI-589) Add processors that can run Apache Flume sources/sinks
[
https://issues.apache.org/jira/browse/NIFI-589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581105#comment-14581105
]
ASF GitHub Bot commented on NIFI-589:
-
Github user joewitt commented on a diff in the pull request:
https://github.com/apache/incubator-nifi/pull/51#discussion_r32167935
--- Diff:
nifi/nifi-nar-bundles/nifi-flume-bundle/nifi-flume-processors/src/main/java/org/apache/nifi/processors/flume/FlumeSinkProcessor.java
---
@@ -0,0 +1,146 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the License); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an AS IS BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.nifi.processors.flume;
+
+import com.google.common.base.Throwables;
+import com.google.common.collect.ImmutableList;
+import com.google.common.collect.ImmutableSet;
+import java.util.List;
+import java.util.Set;
+import org.apache.flume.Context;
+import org.apache.flume.EventDeliveryException;
+import org.apache.flume.Sink;
+import org.apache.flume.conf.Configurables;
+import org.apache.nifi.annotation.documentation.CapabilityDescription;
+import org.apache.nifi.annotation.documentation.Tags;
+import org.apache.nifi.annotation.lifecycle.OnScheduled;
+import org.apache.nifi.annotation.lifecycle.OnUnscheduled;
+
+import org.apache.nifi.components.PropertyDescriptor;
+import org.apache.nifi.components.Validator;
+import org.apache.nifi.processor.ProcessContext;
+import org.apache.nifi.processor.ProcessSession;
+import org.apache.nifi.processor.ProcessorInitializationContext;
+import org.apache.nifi.processor.Relationship;
+import org.apache.nifi.processor.SchedulingContext;
+import org.apache.nifi.processor.exception.ProcessException;
+import org.apache.nifi.processor.util.StandardValidators;
+
+/**
+ * This processor runs a Flume sink
+ */
+@Tags({flume, hadoop, get, sink})
+@CapabilityDescription(Write FlowFile data to a Flume sink)
+public class FlumeSinkProcessor extends AbstractFlumeProcessor {
+
+public static final PropertyDescriptor SINK_TYPE = new
PropertyDescriptor.Builder()
+.name(Sink Type)
+.description(The fully-qualified name of the Sink class)
+.required(true)
+.addValidator(createSinkValidator())
+.build();
+public static final PropertyDescriptor AGENT_NAME = new
PropertyDescriptor.Builder()
+.name(Agent Name)
+.description(The name of the agent used in the Flume sink
configuration)
+.required(true)
+.defaultValue(tier1)
+.addValidator(StandardValidators.NON_EMPTY_VALIDATOR)
+.build();
+public static final PropertyDescriptor SOURCE_NAME = new
PropertyDescriptor.Builder()
+.name(Sink Name)
+.description(The name of the sink used in the Flume sink
configuration)
+.required(true)
+.defaultValue(sink-1)
+.addValidator(StandardValidators.NON_EMPTY_VALIDATOR)
+.build();
+public static final PropertyDescriptor FLUME_CONFIG = new
PropertyDescriptor.Builder()
+.name(Flume Configuration)
+.description(The Flume configuration for the sink copied from
the flume.properties file)
+.required(true)
+.defaultValue()
+.addValidator(Validator.VALID)
+.build();
+
+public static final Relationship SUCCESS = new
Relationship.Builder().name(success).build();
+public static final Relationship FAILURE = new
Relationship.Builder().name(failure).build();
+
+private ListPropertyDescriptor descriptors;
+private SetRelationship relationships;
+
+private volatile Sink sink;
+private volatile NifiSinkSessionChannel channel;
+
+@Override
+protected void init(final ProcessorInitializationContext context) {
+this.descriptors = ImmutableList.of(SINK_TYPE, AGENT_NAME,
[jira] [Commented] (NIFI-589) Add processors that can run Apache Flume sources/sinks
[
https://issues.apache.org/jira/browse/NIFI-589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581104#comment-14581104
]
ASF GitHub Bot commented on NIFI-589:
-
Github user joey commented on a diff in the pull request:
https://github.com/apache/incubator-nifi/pull/51#discussion_r32167867
--- Diff:
nifi/nifi-nar-bundles/nifi-flume-bundle/nifi-flume-processors/src/main/java/org/apache/nifi/processors/flume/FlumeSinkProcessor.java
---
@@ -0,0 +1,146 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the License); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an AS IS BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.nifi.processors.flume;
+
+import com.google.common.base.Throwables;
+import com.google.common.collect.ImmutableList;
+import com.google.common.collect.ImmutableSet;
+import java.util.List;
+import java.util.Set;
+import org.apache.flume.Context;
+import org.apache.flume.EventDeliveryException;
+import org.apache.flume.Sink;
+import org.apache.flume.conf.Configurables;
+import org.apache.nifi.annotation.documentation.CapabilityDescription;
+import org.apache.nifi.annotation.documentation.Tags;
+import org.apache.nifi.annotation.lifecycle.OnScheduled;
+import org.apache.nifi.annotation.lifecycle.OnUnscheduled;
+
+import org.apache.nifi.components.PropertyDescriptor;
+import org.apache.nifi.components.Validator;
+import org.apache.nifi.processor.ProcessContext;
+import org.apache.nifi.processor.ProcessSession;
+import org.apache.nifi.processor.ProcessorInitializationContext;
+import org.apache.nifi.processor.Relationship;
+import org.apache.nifi.processor.SchedulingContext;
+import org.apache.nifi.processor.exception.ProcessException;
+import org.apache.nifi.processor.util.StandardValidators;
+
+/**
+ * This processor runs a Flume sink
+ */
+@Tags({flume, hadoop, get, sink})
+@CapabilityDescription(Write FlowFile data to a Flume sink)
+public class FlumeSinkProcessor extends AbstractFlumeProcessor {
+
+public static final PropertyDescriptor SINK_TYPE = new
PropertyDescriptor.Builder()
+.name(Sink Type)
+.description(The fully-qualified name of the Sink class)
+.required(true)
+.addValidator(createSinkValidator())
+.build();
+public static final PropertyDescriptor AGENT_NAME = new
PropertyDescriptor.Builder()
+.name(Agent Name)
+.description(The name of the agent used in the Flume sink
configuration)
+.required(true)
+.defaultValue(tier1)
+.addValidator(StandardValidators.NON_EMPTY_VALIDATOR)
+.build();
+public static final PropertyDescriptor SOURCE_NAME = new
PropertyDescriptor.Builder()
+.name(Sink Name)
+.description(The name of the sink used in the Flume sink
configuration)
+.required(true)
+.defaultValue(sink-1)
+.addValidator(StandardValidators.NON_EMPTY_VALIDATOR)
+.build();
+public static final PropertyDescriptor FLUME_CONFIG = new
PropertyDescriptor.Builder()
+.name(Flume Configuration)
+.description(The Flume configuration for the sink copied from
the flume.properties file)
+.required(true)
+.defaultValue()
+.addValidator(Validator.VALID)
+.build();
+
+public static final Relationship SUCCESS = new
Relationship.Builder().name(success).build();
+public static final Relationship FAILURE = new
Relationship.Builder().name(failure).build();
+
+private ListPropertyDescriptor descriptors;
+private SetRelationship relationships;
+
+private volatile Sink sink;
+private volatile NifiSinkSessionChannel channel;
+
+@Override
+protected void init(final ProcessorInitializationContext context) {
+this.descriptors = ImmutableList.of(SINK_TYPE, AGENT_NAME,
[jira] [Commented] (NIFI-589) Add processors that can run Apache Flume sources/sinks
[
https://issues.apache.org/jira/browse/NIFI-589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581112#comment-14581112
]
ASF GitHub Bot commented on NIFI-589:
-
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/incubator-nifi/pull/51#discussion_r32168616
--- Diff:
nifi/nifi-nar-bundles/nifi-flume-bundle/nifi-flume-processors/src/main/java/org/apache/nifi/processors/flume/FlumeSourceProcessor.java
---
@@ -0,0 +1,203 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the License); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an AS IS BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.nifi.processors.flume;
+
+import com.google.common.base.Throwables;
+import com.google.common.collect.ImmutableList;
+import com.google.common.collect.ImmutableSet;
+import java.util.List;
+import java.util.Set;
+import java.util.concurrent.atomic.AtomicReference;
+import org.apache.flume.EventDeliveryException;
+import org.apache.flume.EventDrivenSource;
+import org.apache.flume.PollableSource;
+import org.apache.flume.Source;
+import org.apache.flume.channel.ChannelProcessor;
+import org.apache.flume.conf.Configurables;
+import org.apache.flume.source.EventDrivenSourceRunner;
+import org.apache.nifi.annotation.documentation.CapabilityDescription;
+import org.apache.nifi.annotation.documentation.Tags;
+import org.apache.nifi.annotation.lifecycle.OnScheduled;
+import org.apache.nifi.annotation.lifecycle.OnStopped;
+import org.apache.nifi.annotation.lifecycle.OnUnscheduled;
+
+import org.apache.nifi.components.PropertyDescriptor;
+import org.apache.nifi.components.Validator;
+import org.apache.nifi.processor.ProcessContext;
+import org.apache.nifi.processor.ProcessSession;
+import org.apache.nifi.processor.ProcessSessionFactory;
+import org.apache.nifi.processor.ProcessorInitializationContext;
+import org.apache.nifi.processor.Relationship;
+import org.apache.nifi.processor.SchedulingContext;
+import org.apache.nifi.processor.exception.ProcessException;
+import org.apache.nifi.processor.util.StandardValidators;
+
+/**
+ * This processor runs a Flume source
+ */
+@Tags({flume, hadoop, get, source})
+@CapabilityDescription(Generate FlowFile data from a Flume source)
+public class FlumeSourceProcessor extends AbstractFlumeProcessor {
+
+public static final PropertyDescriptor SOURCE_TYPE = new
PropertyDescriptor.Builder()
+.name(Source Type)
+.description(The fully-qualified name of the Source class)
+.required(true)
+.addValidator(createSourceValidator())
+.build();
+public static final PropertyDescriptor AGENT_NAME = new
PropertyDescriptor.Builder()
+.name(Agent Name)
+.description(The name of the agent used in the Flume source
configuration)
+.required(true)
+.defaultValue(tier1)
+.addValidator(StandardValidators.NON_EMPTY_VALIDATOR)
+.build();
+public static final PropertyDescriptor SOURCE_NAME = new
PropertyDescriptor.Builder()
+.name(Source Name)
+.description(The name of the source used in the Flume source
configuration)
+.required(true)
+.defaultValue(src-1)
+.addValidator(StandardValidators.NON_EMPTY_VALIDATOR)
+.build();
+public static final PropertyDescriptor FLUME_CONFIG = new
PropertyDescriptor.Builder()
+.name(Flume Configuration)
+.description(The Flume configuration for the source copied from
the flume.properties file)
+.required(true)
+.defaultValue()
+.addValidator(Validator.VALID)
+.build();
+
+public static final Relationship SUCCESS = new
Relationship.Builder().name(success)
+.build();
+
+private ListPropertyDescriptor descriptors;
+private SetRelationship relationships;
+
+private volatile Source source;
+
+private final
[jira] [Commented] (NIFI-589) Add processors that can run Apache Flume sources/sinks
[
https://issues.apache.org/jira/browse/NIFI-589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581117#comment-14581117
]
ASF GitHub Bot commented on NIFI-589:
-
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/incubator-nifi/pull/51#discussion_r32168957
--- Diff:
nifi/nifi-nar-bundles/nifi-flume-bundle/nifi-flume-processors/src/main/java/org/apache/nifi/processors/flume/FlumeSourceProcessor.java
---
@@ -0,0 +1,203 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the License); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an AS IS BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.nifi.processors.flume;
+
+import com.google.common.base.Throwables;
+import com.google.common.collect.ImmutableList;
+import com.google.common.collect.ImmutableSet;
+import java.util.List;
+import java.util.Set;
+import java.util.concurrent.atomic.AtomicReference;
+import org.apache.flume.EventDeliveryException;
+import org.apache.flume.EventDrivenSource;
+import org.apache.flume.PollableSource;
+import org.apache.flume.Source;
+import org.apache.flume.channel.ChannelProcessor;
+import org.apache.flume.conf.Configurables;
+import org.apache.flume.source.EventDrivenSourceRunner;
+import org.apache.nifi.annotation.documentation.CapabilityDescription;
+import org.apache.nifi.annotation.documentation.Tags;
+import org.apache.nifi.annotation.lifecycle.OnScheduled;
+import org.apache.nifi.annotation.lifecycle.OnStopped;
+import org.apache.nifi.annotation.lifecycle.OnUnscheduled;
+
+import org.apache.nifi.components.PropertyDescriptor;
+import org.apache.nifi.components.Validator;
+import org.apache.nifi.processor.ProcessContext;
+import org.apache.nifi.processor.ProcessSession;
+import org.apache.nifi.processor.ProcessSessionFactory;
+import org.apache.nifi.processor.ProcessorInitializationContext;
+import org.apache.nifi.processor.Relationship;
+import org.apache.nifi.processor.SchedulingContext;
+import org.apache.nifi.processor.exception.ProcessException;
+import org.apache.nifi.processor.util.StandardValidators;
+
+/**
+ * This processor runs a Flume source
+ */
+@Tags({flume, hadoop, get, source})
+@CapabilityDescription(Generate FlowFile data from a Flume source)
+public class FlumeSourceProcessor extends AbstractFlumeProcessor {
+
+public static final PropertyDescriptor SOURCE_TYPE = new
PropertyDescriptor.Builder()
+.name(Source Type)
+.description(The fully-qualified name of the Source class)
+.required(true)
+.addValidator(createSourceValidator())
+.build();
+public static final PropertyDescriptor AGENT_NAME = new
PropertyDescriptor.Builder()
+.name(Agent Name)
+.description(The name of the agent used in the Flume source
configuration)
+.required(true)
+.defaultValue(tier1)
+.addValidator(StandardValidators.NON_EMPTY_VALIDATOR)
+.build();
+public static final PropertyDescriptor SOURCE_NAME = new
PropertyDescriptor.Builder()
+.name(Source Name)
+.description(The name of the source used in the Flume source
configuration)
+.required(true)
+.defaultValue(src-1)
+.addValidator(StandardValidators.NON_EMPTY_VALIDATOR)
+.build();
+public static final PropertyDescriptor FLUME_CONFIG = new
PropertyDescriptor.Builder()
+.name(Flume Configuration)
+.description(The Flume configuration for the source copied from
the flume.properties file)
+.required(true)
+.defaultValue()
+.addValidator(Validator.VALID)
+.build();
+
+public static final Relationship SUCCESS = new
Relationship.Builder().name(success)
+.build();
+
+private ListPropertyDescriptor descriptors;
+private SetRelationship relationships;
+
+private volatile Source source;
+
+private final
[jira] [Commented] (NIFI-589) Add processors that can run Apache Flume sources/sinks
[ https://issues.apache.org/jira/browse/NIFI-589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581118#comment-14581118 ] ASF GitHub Bot commented on NIFI-589: - Github user rdblue commented on the pull request: https://github.com/apache/incubator-nifi/pull/51#issuecomment-110921016 +1 Looks great! Add processors that can run Apache Flume sources/sinks -- Key: NIFI-589 URL: https://issues.apache.org/jira/browse/NIFI-589 Project: Apache NiFi Issue Type: New Feature Components: Extensions Affects Versions: 0.1.0 Reporter: Joey Echeverria -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (NIFI-675) Move local provenace configuration to UI under flow settings
[ https://issues.apache.org/jira/browse/NIFI-675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581183#comment-14581183 ] Joseph Witt commented on NIFI-675: -- awesome idea Matt. Definitely a must do. Move local provenace configuration to UI under flow settings - Key: NIFI-675 URL: https://issues.apache.org/jira/browse/NIFI-675 Project: Apache NiFi Issue Type: Improvement Components: Core Framework Affects Versions: 0.1.0 Reporter: Matthew Clarke Priority: Minor Labels: features Now that reporting tasks and controller services have been moved in to the UI, it would be nice to see the provenance configuration moved in to the UI as well. It would be beneficial to provide the following configuration: 1. max storage time *** UI should display current configured storage space (not editable via the UI) and how much of that space is in use along with age of the oldest available record. 2. query threads 3. indexed fields *** check boxes since these are predefined fields 4. indexed attributes*** user defined 5. manual purge capability to purge select records or time frames. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (NIFI-675) Move local provenace configuration to UI under flow settings
Matthew Clarke created NIFI-675: --- Summary: Move local provenace configuration to UI under flow settings Key: NIFI-675 URL: https://issues.apache.org/jira/browse/NIFI-675 Project: Apache NiFi Issue Type: Improvement Components: Core Framework Affects Versions: 0.1.0 Reporter: Matthew Clarke Priority: Minor Now that reporting tasks and controller services have been moved in to the UI, it would be nice to see the provenance configuration moved in to the UI as well. It would be beneficial to provide the following configuration: 1. max storage time *** UI should display current configured storage space (not editable via the UI) and how much of that space is in use along with age of the oldest available record. 2. query threads 3. indexed fields *** check boxes since these are predefined fields 4. indexed attributes*** user defined 5. manual purge capability to purge select records or time frames. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (NIFI-589) Add processors that can run Apache Flume sources/sinks
[ https://issues.apache.org/jira/browse/NIFI-589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580626#comment-14580626 ] ASF GitHub Bot commented on NIFI-589: - Github user joey commented on the pull request: https://github.com/apache/incubator-nifi/pull/51#issuecomment-110790585 @rdblue yes, I need to extend `AbstractSessionFactoryProcessor` instead of `AbstractProcessor`. The current problem that I'm seeing is that my source continues to run after the processor is stopped. I'm looking to see if this is a bug in Flume or a problem with how I'm using the Flume API. Add processors that can run Apache Flume sources/sinks -- Key: NIFI-589 URL: https://issues.apache.org/jira/browse/NIFI-589 Project: Apache NiFi Issue Type: New Feature Components: Extensions Affects Versions: 0.1.0 Reporter: Joey Echeverria -- This message was sent by Atlassian JIRA (v6.3.4#6332)
