Re: Failed to amend logback.xml to force reporting task log entries to different file...

2016-07-14 Thread Russell Bateman
Incidentally, I took the information on how to do this from: https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi.controller.ControllerStatusReportingTask/additionalDetails.html On Thu, Jul 14, 2016 at 11:02 AM, Russell Bateman < russell.bate...@perfectsearchcorp.com> wrote: >

Re: Passwords in EncryptContent

2016-07-14 Thread Michael Moser
If you modify a flow.xml by hand and put a plaintext value into any sensitive property, then the next time you start NiFi and it saves the flow.xml.gz NiFi will encrypt the plaintext value. Any change to the flow (such as starting, stopping, reconfiguring, creating, deleting or moving a

Re: Nifi cluster nodes regularly stop processing any flowfiles

2016-07-14 Thread Mark Payne
Aaron, My guess would be that you are hitting a Full Garbage Collection. With such a huge Java heap, that will cause a "stop the world" pause for quite a long time. Which garbage collector are you using? Have you tried reducing the heap from 48 GB to say 4 or 8 GB? Thanks -Mark > On Jul 14,

RE: Passwords in EncryptContent

2016-07-14 Thread Hite, Brett
Hi Andy, I think I need a little time to review your post, but this sounds exactly like what I was looking for. I was looking for a way to create the encrypted value stored within the “enc{ … }” tag. Thank you for translating my question and for the quick response! Brett Hite

Re: Passwords in EncryptContent

2016-07-14 Thread Andy LoPresto
Hi Brett, I’m not sure I understand your question completely, so let me try to describe it and you can correct me where I get it wrong. You have some deployment system which uses a Ruby process to replace tokens in a flow template with the “real” values, and one of the values that needs to be

Passwords in EncryptContent

2016-07-14 Thread Hite, Brett
Hello, I have a flow file that is created from a Ruby template file (flow.xml.erb). The template contains variables that the user can set that then get populated when NiFi is set up. I have an EncryptContent processor and would like to create a template variable for the Password property.

Failed to amend logback.xml to force reporting task log entries to different file...

2016-07-14 Thread Russell Bateman
First, I'm using ControllerStatusReportingTask whose output I see in *nifi-app.log.* This seems to do report what I want to see. However, I'd like the status reports to go out to a different log file. I bounced NiFi after enhancing the log-back file: I inserted this near the top of

RE: Increase the number of threads available to a Node

2016-07-14 Thread Kevin Verhoeven
Thank you Joe, that was exactly what I was looking for. Kevin -Original Message- From: Joe Witt [mailto:joe.w...@gmail.com] Sent: Wednesday, July 13, 2016 4:27 PM To: users@nifi.apache.org Subject: Re: Increase the number of threads available to a Node Hello Take a look here

Re: Nifi startup fails with EncryptionOperationNotPossibleException

2016-07-14 Thread Ashraf Hasson
Andy, Thanks for your reply. I think I must have changed the file at an earlier stage indeed. Reverted the nifi.sensitive.props.key to an empty string and it came back up. Thanks, From: Andy LoPresto Sent: July 13, 2016 4:42:15 PM To:

Nifi cluster nodes regularly stop processing any flowfiles

2016-07-14 Thread Aaron Longfield
Hi, I'm having an issue with a small (two node) NiFi cluster where the nodes will stop processing any queued flowfiles. I haven't seen any error messages logged related to it, and when attempting to restart the service, NiFi doesn't respond and the script forcibly kills it. This causes multiple

Re: nifi process running at 114% of node CPU !!?

2016-07-14 Thread Andy LoPresto
Mike, You can adjust the processor properties for the HandleHTTPRequest processor in the scheduling tab. “Concurrent tasks” limits the number of threads this processor will use (default is 1) “Run schedule” determines the frequency that this processor will be run (default is ‘0 sec’ which

Re: export from Teradata

2016-07-14 Thread Anuj Handa
Hi Dima, You will have to create an über jar from the JDBC drivers provided by Teradata and copy the uberjar into the lib folder of nifi. As Matt pointed out the instructions are in the email thread. You can refer them. Anuj > On Jul 14, 2016, at 9:35 AM, Matt Burgess

Re: export from Teradata

2016-07-14 Thread Matt Burgess
Dima, There was a discussion on how to get the SQL processors working with Teradata a little while ago: http://mail-archives.apache.org/mod_mbox/nifi-users/201605.mbox/%3CCAEXY4srXZkb2pMGiOFGs%3DrSc_mHCFx%2BvjW32RjPhz_K1pMr%2B%2Bg%40mail.gmail.com%3E Looks like it involves making a fat JAR to