Re: NiFi SplitAvro processor giving extra records

Hi Mark, after changing relationship, its working fine. Thanks... -- Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/

Re: [discuss] nifi 1.6.0 release

I’d like to finish reviewing PR 2085 [1] for OAuth2 controller service inclusion as well as NIFI-4942 [2]. What is the expected timeframe for a release candidate? [1] https://github.com/apache/nifi/pull/2085 [2]

[RESULT][VOTE] Establish Fluid Design System, a sub-project of Apache NiFi

All, This vote has ended with: 15 binding +1s 2 non-binding +1s 0 <= 0 The vote to establish Fluid Design System as a sub-project of the Apache NiFi TLP has passed. Thank you all for your participation in this important vote. I will submit the necessary information to infra to get the ball

Re: HiveConnectionPool URL with trustStorePasswrd

Milan, I am also not aware of any way to use an encrypted value in the JDBC connection string. In my understanding, the truststore password is only used to verify the integrity of the truststore which is used locally (i.e. not transmitted) to accept the remote endpoint’s TLS certificate. You

Re: HiveConnectionPool URL with trustStorePasswrd

Hi Milan, As far as I know, there is not. It's the same when you connect with the beeline client from a node. Note that you can set the chmod/chown of the truststore file to be only readable by the user running nifi. It should help preventing unauthorized access. Pierre 2018-03-12 14:49

Re: [discuss] nifi 1.6.0 release

Joe, Nope, not a 1.6 blocker, just a nice to have. On Mon, Mar 12, 2018 at 1:47 PM, Joe Witt wrote: > Mike, Michael, > > Both items noted seem fair for inclusion in whatever release vehicle > follows them being merged but neither look like they'd impact release > timing.

Re: [discuss] nifi 1.6.0 release

Mike, Michael, Both items noted seem fair for inclusion in whatever release vehicle follows them being merged but neither look like they'd impact release timing. Please advise if I'm misreading either of those. Thanks Joe On Mon, Mar 12, 2018 at 5:42 PM, Michael Moser

Re: [discuss] nifi 1.6.0 release

I would like to finish up NIFI-3599 , which just needs some contributer / review agreement. -- Another Mike On Mon, Mar 12, 2018 at 1:28 PM, Mike Thomsen wrote: > If we could get this patch for HBase visibility labels

Re: [discuss] nifi 1.6.0 release

If we could get this patch for HBase visibility labels merged before, I'd appreciate it. https://github.com/apache/nifi/pull/2518 If anyone else has patches they'd like to see merged, feel to ping me on GitHub, and I'll help out with a code review. Thanks, Mike On Mon, Mar 12, 2018 at 12:56

[discuss] nifi 1.6.0 release

Team, Looks like a ton of great work already in JIRA making a nifi 1.6.0 release pretty easily justified. Lots of nice bug fixes/improvements and notable we relaxed the http header corruption restrictions which fixed a potential security risk but also created operations challenges. Any glaring

Re: [VOTE] Establish Fluid Design System, a sub-project of Apache NiFi

+1 (non-binding) > On Mar 9, 2018, at 3:10 PM, Scott Aslan wrote: > > All, > > Following a solid discussion for the past couple of weeks [1] regarding the > establishment of Fluid Design System as a sub-project of Apache NiFi, I'd > like to > call a formal vote to record

Re: DBCPConnectionPool encrypted password

Toivo, I think there needs to be some improvements around variables & sensitive property handling, but it is a challenging situation. Some things you could investigate with the current capabilities.. - With the registry scenario, you could define a DBCPConnectionPool at the root process group

Re: DBCPConnectionPool encrypted password

Hi Bryan, We start using Registry soon anyway, so this is useful info. But it would be event better when we don’t need to enter passwords manually each time we deploy template. Any ideas how to do this? Thank you Toivo -- Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/

HiveConnectionPool URL with trustStorePasswrd

Hello folks, I am connecting to Hive environment with TLS security on. In order to do that need to send trustStorePasswrd  in Hive2 URL . As the configuration is in controller services, not able to find a way to set the trustStorePassword in encrypted format. Wondering if there is a way to

Re: NiFi SplitAvro processor giving extra records

Hi Rohit, The SplitAvro processor has 3 relationships: failure, split, and original. Did you by chance connect both the original and split relationships to the AvroToJson processor? If you did, then that would explain the behavior. You're routing both the individually split Avro records as

Re: DBCPConnectionPool encrypted password

You may want to consider moving from templates to NiFi Registry for your deployment approach. The idea of this approach is that your flow will get saved to registry with no sensitive values, when you import the flow to the next environment you enter the sensitive values there the first time and

Re: DBCPConnectionPool encrypted password

Hi Bryan, >> Are you saying you are trying to externalize the value outside the >> w and keep it encrypted somewhere else? Yes, exactly. We have different passwords on different environments (dev, test, production). After development flow (using template currently) will be deployed to test

Re: NiFi SplitAvro processor giving extra records

Rohit, Are you routing both the "split" and "original" relationships to the downstream processor? If so, and you don't want the 6th flowfile containing all 5 records, then do not route the original relationship to the downstream processor. You can route it to some other processor or

Re: [VOTE] Establish Fluid Design System, a sub-project of Apache NiFi

+1 (non-binding) On 3/12/18, 09:01, "Matt Gilman" wrote: +1 On Sun, Mar 11, 2018 at 11:40 PM, Koji Kawamura wrote: > +1 > > On Mon, Mar 12, 2018 at 3:10 AM, Matt Burgess > wrote:

Re: DBCPConnectionPool encrypted password

Toivo, The password property on DBCPConnectionPool is a "sensitive" property which means it is already encrypted in the flow.xml.gz using nifi.sensitive.props.key. Are you saying you are trying to externalize the value outside the flow and keep it encrypted somewhere else? -Bryan On Mon, Mar

Re: [VOTE] Establish Fluid Design System, a sub-project of Apache NiFi

+1 On Sun, Mar 11, 2018 at 11:40 PM, Koji Kawamura wrote: > +1 > > On Mon, Mar 12, 2018 at 3:10 AM, Matt Burgess > wrote: > > +1 > > > > On Sun, Mar 11, 2018 at 1:00 PM, Jeff wrote: > >> +1 > >> > >> On Sat, Mar 10, 2018 at 8:42

NiFi SplitAvro processor giving extra records

Hi, I am reading data from hive table using ExecuteHQL having 5 records in hive table, its generating 1 avro file having total 5 records and using splitAvro processor i am splitting separate records but SplitAvro processor generating total 6 records which having 5 separate records and 6'th record

NiFi SplitAvro processor giving extra records

Hi, I am reading data from hive table using ExecuteHQL having 5 records in hive table, its generating 1 avro file having total 5 records and using splitAvro processor i am splitting separate records but SplitAvro processor generating total 6 records which having 5 separate records and 6'th record

NiFi SplitAvro processor giving extra records

Hi, I am reading data from hive table having 5 records and its generating 1 avro file and using splitAvro processor i am splitting data but splitAvro generating 6 records which having 5 individual row and one row containing all 5 row. My Teamplate:- ExecuteHQL->SplitAvro->AvroToJson->PutCouch

DBCPConnectionPool encrypted password

Hi, I need to encrypt DBCPConnectionPool password. I have working decryption code. Problem is how to make decrypted password available to DBCPConnectionPool. I thought to use expression language and JVM System Property’s. DBCPConnectionPool is capable to read System property value. But how to