Oracle ODBCConnectionPool driver

2018-10-16 Thread Mark Bean
What driver is required to connect to an Oracle database using the DBCPConnectionPool Controller Service? Will the same driver work for both 11g and 12c databases? Thanks, Mark

Re: [DISCUSS] Closing in on a release of NiFi 1.8.0?

2018-10-16 Thread Jeff
A quick update on RC1 for NiFi 1.8.0. There are some L issues that are currently being worked, so I'd like to hold off on creating the RC until they are resolved. Sorry for the delay! On Tue, Oct 16, 2018 at 3:46 PM Nathan Gough wrote: > So, taking a closer look at this PR and doing some

Re: Compiling custom processor

2018-10-16 Thread Bryan Bende
Any reason why the commons-lang3 dependency is provided and not normal compile scope? Generally the only cases where a dependency should be provided are when a parent NAR provides it (the API scenario earlier), or when it is a jar directly in lib which means it is on the classpath of everything

Re: Compiling custom processor

2018-10-16 Thread John McGinn
I have a directory /home/user/nifi-nars, which is listed in the nifi.properties file located under the nifi-assembly directory from the nifi-master code. That's where I redropped my NAR file at. The error was "due to uncaught Exception: java.lang.NoClassDefFoundError:

Re: Compiling custom processor

2018-10-16 Thread Bryan Bende
There shouldn't be any issue doing that, generally you just copy the new NAR into the lib directory and restart. What were the specifics of the class not found error? On Tue, Oct 16, 2018 at 3:24 PM John McGinn wrote: > > And I'm back. > > So, I had my processor running, no errors, so things

Re: License of NLKBufferedReader

2018-10-16 Thread Joe Witt
Yeah that looks super sketchy frankly and we need to address that immediately. JeffStorck: This is an RC blocker. I'll file a JIRA shortly. I am shocked this hasn't been caught before. On Tue, Oct 16, 2018 at 3:11 PM Peter Wicks (pwicks) wrote: > > While digging into ReplaceText today, I

Re: Compiling custom processor

2018-10-16 Thread John McGinn
And I'm back. So, I had my processor running, no errors, so things were good. I then add 2 if statements with logger messages, run the same mvn command, copied the new NAR on top of the old one, same versionId and all, and now I get a class not found error, that didn't occur before I stopped,

License of NLKBufferedReader

2018-10-16 Thread Peter Wicks (pwicks)
While digging into ReplaceText today, I noticed that org.apache.nifi.processors.standard.util.NLKBufferedReader is actually a direct copy of the JDK version of BufferedReader, with a few minor code edits made on top of it so that new line characters are kept. This code was in the original code

RE: [EXT] Calcite version used in Nifi 1.7+

2018-10-16 Thread Ruurd Schoonheim
Thnx Peter! Then, somehow CROSS APPLY should work in Nifi 1.7.x+... 樂 On 16 Oct 2018, 15:38 +0200, Peter Wicks (pwicks) , wrote: > In NiFi 1.7.0 it was Calcite v1.12.0. In NiFi 1.8 it will be Calcite v1.17.0 > > -Original Message- > From: ruurd.schoonh...@dbiq.nl

Re: Compiling custom processor

2018-10-16 Thread John McGinn
Thanks Bryan, I restarted with a fresh maven generate, and only added the API to the processor pom, and then the API-NAR to the NAR pom. I then figured out a subsequent dependency (lang3), and got that in, and now my processor shows up in local NiFi instance. Regarding the copying of the

Re: Fixing unstable nifi cluster.

2018-10-16 Thread Jeff
Hello, Pierre's suggestions should be helpful for you, since you are running Zookeeper on the same nodes as NiFi. If it's possible for you to run Zookeeper on separate hosts from NiFi so that ZK and NiFi are not colocated, you should see better results. - Jeff On Tue, Oct 16, 2018 at 8:03 AM

Re: [DISCUSS] Closing in on a release of NiFi 1.8.0?

2018-10-16 Thread Andrew Lim
I created a Jira to document the new load balancing functionality [1] and just submitted a PR for it [2]. I think it would be beneficial for users if it could be reviewed and included in the release. [1] https://issues.apache.org/jira/browse/NIFI-5701 [2]

Re: [DISCUSS] Closing in on a release of NiFi 1.8.0?

2018-10-16 Thread Jeff
Since NIFI-5562 is an improvement JIRA, and we're cutting it very close to the release candidate, it may not make it into the release. However, since Mark Payne is investigating some issues that may have been introduced in 1.8.0, I can delay creating RC1. On Tue, Oct 16, 2018 at 10:24 AM Mark

Re: [DISCUSS] Closing in on a release of NiFi 1.8.0?

2018-10-16 Thread Nathan Gough
Hi Mike, Sure I can look at fixing up PR-2977 today. Nathan On 10/16/18, 6:13 AM, "Mike Thomsen" wrote: Does 5562 need to be addressed in 1.8? https://github.com/apache/nifi/pull/2977 On Mon, Oct 15, 2018 at 6:33 PM Jeff wrote: > NiFi Devs, > > The

Re: Compiling custom processor

2018-10-16 Thread Mike Thomsen
If you want to look at a large Maven project that builds several custom NARs from one unified build system, take a look at my data generation bundle here: https://github.com/MikeThomsen/nifi-datageneration-bundle On Tue, Oct 16, 2018 at 9:53 AM Bryan Bende wrote: > In general, if your

Re: [DISCUSS] Closing in on a release of NiFi 1.8.0?

2018-10-16 Thread Mark Payne
Jeff / all, I ran into an issue with NIFI-375 and re-opened the ticket. If a processor is stopped or started in a cluster, the stats that come back in the response are incorrect because the response is not being properly merged from all nodes in the cluster. I also have run into a couple of

Re: Cluster Warnings

2018-10-16 Thread Joe Witt
please keep this thread on users. On Sun, Oct 14, 2018, 11:53 PM Karthik Kothareddy (karthikk) [CONT - Type 2] wrote: > Hello, > > We're running a 4-node cluster on NiFi 1.7.1. The fourth node was added > recently and as soon as we added the 4th node, we started seeing below > warnings > >

Re: Compiling custom processor

2018-10-16 Thread Bryan Bende
In general, if your processor uses a controller service then the processors pom file needs a provided dependency on the API of the CS, and your NAR pom needs a NAR dependency on the NAR where the CS API is. Example is shown here in the section linking processors and controller services -

RE: [EXT] Calcite version used in Nifi 1.7+

2018-10-16 Thread Peter Wicks (pwicks)
In NiFi 1.7.0 it was Calcite v1.12.0. In NiFi 1.8 it will be Calcite v1.17.0 -Original Message- From: ruurd.schoonh...@dbiq.nl [mailto:ruurd.schoonh...@dbiq.nl] Sent: Tuesday, October 16, 2018 6:58 AM To: dev@nifi.apache.org Subject: [EXT] Calcite version used in Nifi 1.7+ Hi guys,

Compiling custom processor

2018-10-16 Thread John McGinn
Ok, I am far from a maven expert, and am struggling on this problem. I created a new project using the maven generate process, and compiled that sample processor and everything was fine, and I could see it in my local NiFi instance. I then copied over the Wait processor on top of the

Calcite version used in Nifi 1.7+

2018-10-16 Thread ruurd . schoonheim
Hi guys, Which version of calcite is used by QueryRecord processor in Nifi 1.7 or above? I’m looking for CROSS APPLY suport in my query as introduced in Calcite 1.11 (january 2017) Or has anyone a solution to perform select on self joined dataset (recursive) Kind regards Ruurd Schoonheim

Re: Fixing unstable nifi cluster.

2018-10-16 Thread Pierre Villard
Hi, Can you try increasing the below parameters? That's usually what I recommend, our default values being probably a bit too aggressively low. nifi.zookeeper.connect.timeout=15 secs nifi.zookeeper.session.timeout=15 secs nifi.cluster.node.read.timeout=30 sec Pierre Le mar. 16 oct. 2018 à

Fixing unstable nifi cluster.

2018-10-16 Thread ashwin konale
Hi, We have a 3 node nifi cluster (With separate zookeper instances running in the same machines) which pulls the data from mysql and write to hdfs. I am frequently running into problems with cluster. Nodes keeps disconnecting from each other, primary nodes keeps switching and sometimes it just

Re: [DISCUSS] Closing in on a release of NiFi 1.8.0?

2018-10-16 Thread Mike Thomsen
Does 5562 need to be addressed in 1.8? https://github.com/apache/nifi/pull/2977 On Mon, Oct 15, 2018 at 6:33 PM Jeff wrote: > NiFi Devs, > > The Release page [1] for 1.8.0 now reports that all issues are done! I'd > like to start the release candidate preparation tomorrow, around 1200 EST. >