Re: [E] After upgrade to 1.11.4, flowController fails to start due to invalid clusterCoordinator port 0

2021-02-13 Thread Pat White
lison. Thanks again for folks providing info and feedback! On Wed, Feb 10, 2021 at 1:57 PM Pat White wrote: > Thank you Jorge, appreciate the help and feedback! > > > > > On Wed, Feb 10, 2021 at 1:32 PM Jorge Machado wrote: > >> For cluster mode check the configs

Re: [E] After upgrade to 1.11.4, flowController fails to start due to invalid clusterCoordinator port 0

2021-02-10 Thread Pat White
gt; ) > > On 9. Feb 2021, at 02:19, Pat White wrote: > > Thanks very much for the feedback Joe, much appreciated. Checking as you > suggested, nothing yet but that's got to be it, some config issue on my > part, that's messing up property parsing. > > > > > > On Mon,

Re: [E] Re: After upgrade to 1.11.4, flowController fails to start due to invalid clusterCoordinator port 0

2021-02-08 Thread Pat White
ort=6342 > > Thanks > > On Mon, Feb 8, 2021 at 2:47 PM Pat White > wrote: > >> Hi Folks, >> >> Appreciate any debugging help on a very odd error, after upgrading a Nifi >> cluster from 1.6.0 to 1.11.4, flowController fails to start due to: >> &

After upgrade to 1.11.4, flowController fails to start due to invalid clusterCoordinator port 0

2021-02-08 Thread Pat White
Hi Folks, Appreciate any debugging help on a very odd error, after upgrading a Nifi cluster from 1.6.0 to 1.11.4, flowController fails to start due to: Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'flowService': FactoryBean threw exception on

Re: [E] Re: Site to Site with multi-entry keystore?

2020-08-26 Thread Pat White
resto.apa...@gmail.com * > He/Him > PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > > On Aug 25, 2020, at 8:09 AM, Pat White wrote: > > Hi Folks, > > Does S2S require use of a single entry keystore, or will multiple entries > work ok? > > I thought

Site to Site with multi-entry keystore?

2020-08-25 Thread Pat White
Hi Folks, Does S2S require use of a single entry keystore, or will multiple entries work ok? I thought i saw documentation which stated S2S will only work with single entry keystores, but i'm not able to find the reference. Trying to track down a 401 Unauthorized error trying to do S2S with a

Re: Use of SNI routing in Nifi ?

2020-05-23 Thread Pat White
apache.org > *alopresto.apa...@gmail.com * > He/Him > PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > > On May 22, 2020, at 12:05 PM, Pat White wrote: > > Hi Andy, > Thanks very much for the feedback, and my apologies for being vague. I > have n

Re: Can jetty reload keystore credentials dynamically?

2020-02-11 Thread Pat White
nked epic. > > [1] https://github.com/eclipse/jetty.project/issues/918 > [2] https://issues.apache.org/jira/browse/NIFI-5458 > > Andy LoPresto > alopre...@apache.org > *alopresto.apa...@gmail.com * > PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > >

Can jetty reload keystore credentials dynamically?

2020-02-11 Thread Pat White
Hi Folks, Can Nifi's jetty automatically detect and reload its keystore when the keystore is changed, such as during credentials update or rotation? Thank you patw

H2 DB locking error - Timeout trying to lock table "ACTION"

2019-10-04 Thread Pat White
Hi Folks, We recently encountered an error on a prod cluster where Nifi couldn't acquire an H2 database lock when the canvas UI was modified, 'Timeout trying to lock table "ACTION"'. I wasn't able to track down who held the lock, or even where the lock was at. Ended up restarting the cluster,

Re: Question running OIDC with Okta behind reverse proxy

2019-08-22 Thread Pat White
ion but thats an easier problem to solve than building SAML * > OpenID connect support into NiFi core. > > Erik Anderson > Bloomberg > > On Thu, Aug 22, 2019, at 12:15 PM, Pat White wrote: > > Hi Folks, > Trying to get Nifi working with OpenID Connect authentication using

Question running OIDC with Okta behind reverse proxy

2019-08-22 Thread Pat White
Hi Folks, Trying to get Nifi working with OpenID Connect authentication using Okta as the OIDC provider. When Nifi has direct access to Okta, works fine. However i have to run with a reverse proxy, that fails well into the OIDC token fetch and redirect cycles with 401 'Unable to continue login

Re: Using Nifi OIDC authentication through a proxy?

2019-08-13 Thread Pat White
that I have successfully used for my setup: > https://github.com/ijokarumawak/nifi-reverseproxy > > Also, check the following thread: > > http://apache-nifi-users-list.2361937.n4.nabble.com/Invalid-CORS-request-error-on-NiFi-v1-8-0-and-1-9-0-behind-nginx-td7030.html > > Best regards, &

Using Nifi OIDC authentication through a proxy?

2019-08-12 Thread Pat White
Hi Folks, Wondered if anyone has been able to configure Nifi to use oidc identity provider through a reverse proxy? I've been able to configure oidc and successfully work with an authentication provider directly, however i need to do this through a proxy, and not able to get the callback

Re: Debugging info for a stuck SelectHiveQL processor

2019-07-26 Thread Pat White
wait(AbstractQueuedSynchronizer.java:2039) > > Once you get the thread dump, please share it with us for further > investigation. > > Thanks, > Koji > > On Fri, Jul 26, 2019 at 1:57 AM Pat White > wrote: > > > > Hi Folks, > > > > Would like to ask

Debugging info for a stuck SelectHiveQL processor

2019-07-25 Thread Pat White
Hi Folks, Would like to ask for suggestions on debugging SelectHiveQL processors, we've seen a very odd error mode twice now, where a SelectHiveQL processor which had been running fine suddenly becomes "stuck". This is on 1.6.0, so a bit dated compared to 1.9.2, but i'm still very puzzled at the

Re: When do I download the older releases of Apache NiFi

2019-02-27 Thread Pat White
Hi Vijay, Think there's a link towards the bottom of the download page, which points to the archive, which goes here: https://archive.apache.org/dist/nifi/ patw On Wed, Feb 27, 2019 at 11:52 AM Vijay Chhipa wrote: > Hi, > > Noticed that with the release of NiFi 1.9.0 there is not a link to

Re: Asymmetric push/pull throughput with S2S, possibly related to openConnectionForReceive compression?

2019-02-15 Thread Pat White
; I will try benchmarking before and after "gzip.setExcludedPath()" that > Mark has suggested if it helps improving S2S HTTP throughput. > > Koji > > On Fri, Feb 15, 2019 at 9:31 AM Pat White > wrote: > > > > Hi Andy, > > > > My requirement is to use

Re: Asymmetric push/pull throughput with S2S, possibly related to openConnectionForReceive compression?

2019-02-14 Thread Pat White
onnection must be HTTPS or it just must be secure? > What about Websockets over TLS (wss://)? > > Andy LoPresto > alopre...@apache.org > *alopresto.apa...@gmail.com * > PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > > On Feb 14, 2019, at 9:56 AM, Pat W

Re: Asymmetric push/pull throughput with S2S, possibly related to openConnectionForReceive compression?

2019-02-14 Thread Pat White
Thank you Bryan, i have a lot to look at using raw protocol, will be sure to keep this setting in mind. patw On Thu, Feb 14, 2019 at 12:05 PM Bryan Bende wrote: > You can use TLS with raw s2s by setting nifi.remote.input.secure=true > > On Thu, Feb 14, 2019 at 12:56 PM Pat White

Re: Asymmetric push/pull throughput with S2S, possibly related to openConnectionForReceive compression?

2019-02-14 Thread Pat White
dd a "gzip.setExcludedPath()" call to exclude > anything that goes to the site-to-site path. > > Thanks > -Mark > > > On Feb 14, 2019, at 11:46 AM, Joe Witt wrote: > > ...interesting. I dont have an answer but will initiate some research. > Hopefully someone else re

Re: Asymmetric push/pull throughput with S2S, possibly related to openConnectionForReceive compression?

2019-02-14 Thread Pat White
guides, as well as looking at JettyServer and web/webdefault.xml for such controls but i'm clearly missing something, changes have no effect on the server behavior. Appreciate any help on how to set jetty configs properly, thank you. patw On Tue, Feb 5, 2019 at 9:07 AM Pat White wrote: > Hi M

Re: Asymmetric push/pull throughput with S2S, possibly related to openConnectionForReceive compression?

2019-02-05 Thread Pat White
ork-bundle/nifi-framework/nifi-web/nifi-jetty/src/main/java/org/apache/nifi/web/server/JettyServer.java > > > On Feb 4, 2019, at 5:58 PM, Pat White wrote: > > This looks like a thrashing behavior in compress/decompress, found that if > i enable compression in the output p

Re: Asymmetric push/pull throughput with S2S, possibly related to openConnectionForReceive compression?

2019-02-04 Thread Pat White
thing i can think of is if jetty's enforcing compression, and with an uncompressed stream has an issue, but not sure why only in one direction. Could someone point me to where Nifi's embedded jetty configuration code is, or equiv controls? patw On Fri, Feb 1, 2019 at 4:13 PM Pat White wrote

Asymmetric push/pull throughput with S2S, possibly related to openConnectionForReceive compression?

2019-02-01 Thread Pat White
Hi Folks, I'm trying to track a very odd performance issue, this is on 1.6.0 using S2S, would like to ask if there are any known issues like this or if my flow configuration is broken. From point of view of the RPG, receiving takes ~15x longer to xsfr the same 1.5gb file as a send from that RPG.

Re: Question regarding krb tgt renewal for Hive processors and connection pools

2018-12-23 Thread Pat White
issue. Also, > thanks to Shawn and Bryan the helpful comments! > > - Jeff > > On Sun, Dec 23, 2018 at 10:13 AM Pat White wrote: > >> Update, cherrypicking the fix from NIFI-5134 into 1.6.0 looks good to >> resolve hive connectionpool tgt renew/fetch issue we're

Re: Question regarding krb tgt renewal for Hive processors and connection pools

2018-12-23 Thread Pat White
134 that fixes this issue. Prior to that the hive connection > pool did not renew its Kerberos ticket correctly. > > Sent from my iPhone > > On Dec 19, 2018, at 5:15 PM, Pat White wrote: > > Thanks much Bryan and Shawn, we're currently on 1.6.0 with some > cherrypicks fro

Re: Question regarding krb tgt renewal for Hive processors and connection pools

2018-12-19 Thread Pat White
1.5 I think. The patch is in the hortonworks hdf 3.1.2 release. > > If you go search for me in the archives I mentioned it a few months back. > > Thanks > Shawn > > Sent from my iPhone > > > On Dec 19, 2018, at 3:59 PM, Pat White wrote: > > > > Hi Fol

Question regarding krb tgt renewal for Hive processors and connection pools

2018-12-19 Thread Pat White
Hi Folks, Using kerberos auth in Nifi clusters communicating with hdfs and for hive access, the ticket life is 24 hours. Hdfs works fine, however we're seeing issues with hive where the tgt doesn't seem to renew, or fetch a new ticket, as the 24hr limit approaches. Hence, hive access works fine