Should I postpone submitting PR's on seriously breaking changes until prep for 2.0?

2018-04-23 Thread Peter Wicks (pwicks)
I have a couple ideas for changes that would cause wide spread breakage (like moving the DatabaseAdapter selection into the DBCP Service). >From what I've seen, this level of non-backwards compatibility should be >postponed until a major version change? Thanks, Peter

[GitHub] nifi-fds issue #1: [NIFIREG-168] upgrade to angular v5.2.0, angular-material...

2018-04-23 Thread mcgilman
Github user mcgilman commented on the issue: https://github.com/apache/nifi-fds/pull/1 Will review... ---

[GitHub] nifi-fds pull request #1: [NIFIREG-168] upgrade to angular v5.2.0, angular-m...

2018-04-23 Thread scottyaslan
GitHub user scottyaslan opened a pull request: https://github.com/apache/nifi-fds/pull/1 [NIFIREG-168] upgrade to angular v5.2.0, angular-material v5.2.0, cov… …alent v1.0.1 You can merge this pull request into a Git repository by running: $ git pull

Re: Contribution on NIFI-3620?

2018-04-23 Thread Joe Witt
Hello There isn't anyone working on this that I'm aware of so if you're in a position to help progress it that would be great. Thanks On Mon, Apr 23, 2018 at 4:39 PM, PREVOST Romain wrote: > Hello, > > > I have a need on my current projet, matching >

Contribution on NIFI-3620?

2018-04-23 Thread PREVOST Romain
Hello, I have a need on my current projet, matching https://issues.apache.org/jira/browse/NIFI-3620 As this issue seems to have spent quite some time in progress, I am really willing to help. If there is already some work in progress somewhere (I did not find a branch), or some pointers

Re: ExecuteGroovyScript processor unable to resolve IOUtils

2018-04-23 Thread Matt Burgess
Max, ExecuteGroovyScript does not (yet) automatically include some Apache Commons libraries such as commons-lang3, commons-io, commons-net, etc. However ExecuteScript does already include those, so you can put your Groovy script in there and not have to @Grab the library. Of course, you won't

Re: Recommended hardware specs to run sandbox environments on workstation

2018-04-23 Thread Mike Thomsen
Depending on what you want to do with them, you can run NiFi, Kafka and Storm together with about 4GB-5GB of RAM and get good results locally. For NiFi and Kafka, the Docker images will be the safest bet. You'll also need to factor in the memory for running ZooKeeper if you want that, but about

Recommended hardware specs to run sandbox environments on workstation

2018-04-23 Thread Butts, Eric
Any hardware specs recommendations to able to run sandbox environments of NIFI, Kafka, Storm and SAM on developer workstation? Developer purposes only

Re: BUG: AbstractListProcessor stops to call performListing after primary node reelection to same node

2018-04-23 Thread Max Viazovskyi
Thanks Bryan. Will do it a bit later. -- Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/

Re: BUG: AbstractListProcessor stops to call performListing after primary node reelection to same node

2018-04-23 Thread Bryan Bende
Max, Thanks for reporting this. I've only glanced at the code quickly, but I see what you are saying about the boolean never getting set to false when it hits the context.yield(). I would recommend creating a JIRA with all of this info, and then you could submit your proposed fix as a pull

Re: How can I pass a flowfile attribute to a controller service?

2018-04-23 Thread Bryan Bende
I'm not sure if this helps, but you mentioned not being able to use the variable.registry because it requires a restart. That is true for the file-based variable registry, however it is not true for the UI-based variable registry [1]. Keep in mind that neither of the variable registries are

Re: How can I pass a flowfile attribute to a controller service?

2018-04-23 Thread Mike Thomsen
Rishab, > Also, is there a way where we can postpone the evaluation of expression language used til the processor starts running? No because the controller service is a dependency of the processor and evaluating the expression language in the CS property descriptors must be done when enabling

Re: How can I pass a flowfile attribute to a controller service?

2018-04-23 Thread rishabprasad005
Hi, Thanks for the reply. From the above replies I understand that the flowfile attributes were not available by the DBCPConnectionPool service because the expression langugage used by me were evaluated at the time of service enable. Thus, the service is starting before any other processor used

Adjust the GenerateTableFetch processor for handling big tables.

2018-04-23 Thread 黃黃彥周
Hello, I have utilize GenerateTableFetch processor to handle incremental record fetching for a period of time. It’s works quite well for normal tables. While speak to big tables, it has some potential problems. For example, we have source table has more than 100 billion records at source.

RE: Apache nifi isuues-while ingesting data to hdfs of aws instance

2018-04-23 Thread Sudheer Nulu
Hi Matt, Thanks for looking into this issue. Previously, I have made this entry in hdfs-site.xml file .But there was No Luck.. Regards, Sudheer Nulu -Original Message- From: Matt Burgess [mailto:mattyb...@apache.org] Sent: Thursday, April 19, 2018 6:00 PM To: dev@nifi.apache.org