NiFi 1.6

2018-04-05 Thread dan young
any updates on when 1.6 is going to drop? dano

Re: First steps with Nifi

2018-05-11 Thread dan young
Awesome! NiFi is an amazing tool. As Joe mentioned the docs are a great place to start along with the Hortonworks forums. Although we don't use HDP, the content is still very relevant. Start simple and iterate...Install on your laptop and start moving bits! Regards Dano On Fri, May 11, 2018, 7:

Nifi toolkit grape dependecies

2018-05-22 Thread dan young
Hello, I'm trying to run the Nifi Expression testing groovy tool with 1.6.0 and am getting the following dep errorNifi 1.4 and 1.5 works fine. I tried to also download via grape in the groovy cli the jackson-core and it doesn;t work for the 2.9.4 version 2.9.5 works fineany ideas? I can

Re: Nifi toolkit grape dependecies

2018-05-24 Thread dan young
Roger that! NIFI-5234 <https://issues.apache.org/jira/browse/NIFI-5234> On Thu, May 24, 2018 at 2:03 AM Pierre Villard wrote: > Hey Dan, > > I think it's worth filing a JIRA for it. > > Pierre > > 2018-05-22 19:27 GMT+02:00 dan young : > >> Hello, &g

Re: [ClojureVerse] Summaryb

2018-06-14 Thread dan young
On Wed, Jun 13, 2018, 9:19 PM ClojureVerse summary < notificati...@clojureverse.org> wrote: > A brief summary since your last visit on May 31 > [image: ClojureVerse] > > > > Since your last visit > *16* *1* >

Re: Title: Feature needed - ConvertJSONToCSV processor

2018-08-07 Thread dan young
You could look at using ExecuteStreamCommand + JQ. We use this pattern a lot... Regards Dano On Tue, Aug 7, 2018, 5:09 AM Mahendra prabhu wrote: > Expected behaivor is similiar to this task created - > https://issues.apache.org/jira/browse/NIFI-4398 I couldnt achieve this > using ConvertRecord

Re: Anyone using HashAttribute?

2018-09-05 Thread dan young
We're using it as well, in the same/similar fashion as being discussed in the thread... Dano On Wed, Sep 5, 2018, 10:07 AM Brandon DeVries wrote: > Andy, > > We use it pretty much how Joe is... to create a unique composite key. It > seems as though that shouldn't be a difficult functionality t

Re: Anyone using HashAttribute?

2018-09-05 Thread dan young
dy LoPresto > alopre...@apache.org > *alopresto.apa...@gmail.com * > PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > > On Sep 5, 2018, at 4:09 PM, dan young wrote: > > We're using it as well, in the same/similar fashion as being discussed in > the thr

NiFi 1.8 release date?

2018-10-16 Thread dan young
Any ideas on when 1.8 might be dropping? Regards, Dano

Available SQL fn in QueryRecord??

2018-10-26 Thread dan young
Hello, Is there a list or somewhere we can find all the available SQL functions available in QueryRecord? Regards Dano

NiFi 1.8 and stuck flowfile in Load Balanced enabled queue

2018-11-12 Thread dan young
Hello, We have two processor groups connected via the new Load Balancing/Round Robin queue. It seems that a flowfile is "stuck" in this queue. I've been watching it for some time now. Is there any way to trouble shoot what is stuck in the queue and why? or maybe remove it? I've tried to stop

Re: NiFi 1.8 and stuck flowfile in Load Balanced enabled queue

2018-11-12 Thread dan young
til we reboot the next one to get as much performance as possible. It > must be a bug in this new Load Balancing/Round Robin queue… any comments > from the devs? > > > > Cheers Josef > > > > *From: *dan young > *Reply-To: *"users@nifi.apache.org" > *Dat

Re: NiFi 1.8 and stuck flowfile in Load Balanced enabled queue

2018-11-16 Thread dan young
pache.org" > *Subject: *Re: NiFi 1.8 and stuck flowfile in Load Balanced enabled queue > > Hey Dan, > > Have looked through the logs to see if there are any WARN or ERROR's > indicating what's going on? > > Thanks > -Mark > > > > On Nov 12, 2018, at 9:06

Re: Load Balancing connection issue

2018-12-03 Thread dan young
We've been seeing issues , three times now, where it seems like a flowfile is stuck in a load balanced queue. We're not able to empty the queue or view the flowfile that appears to be in the queue. The only resolution for use right now is to detach the node where the Flowfile is in the queue, then

Re: NiFi 1.8 and stuck flowfile in Load Balanced enabled queue

2018-12-15 Thread dan young
t; > Have looked through the logs to see if there are any WARN or ERROR's > indicating what's going on? > > > > Thanks > > -Mark > > > > > > On Nov 12, 2018, at 9:06 AM, dan young wrote: > > > > Hello, > > > > We have tw

Re: flowfiles stuck in load balanced queue; nifi 1.8

2018-12-19 Thread dan young
the > REST endpoint (in your browser is fine) > /nifi-api/processors//diagnostics > > Where is the UUID of either the source or the destination > of the Connection in question. This gives us > a lot of information about the internals of Connection. The easiest way to > get that

Re: flowfiles stuck in load balanced queue; nifi 1.8

2018-12-19 Thread dan young
the threads > with no work to do. Which is what I would expect. > The question is: "Why does it not think there's work to do?" So the > diagnostics and DEBUG logs will hopefully answer that, > once you get back into that state again. > > Thanks > -Mark > >

Re: flowfiles stuck in load balanced queue; nifi 1.8

2018-12-23 Thread dan young
rce or the destination > of the Connection in question. This gives us > a lot of information about the internals of Connection. The easiest way to > get that Processor ID is to just click on the > processor on the canvas and look at the Operate palette on the left-hand > side. You

Re: flowfiles stuck in load balanced queue; nifi 1.8

2018-12-23 Thread dan young
24136] o.a.n.w.a.c.AccessDeniedExceptionMapper identity[anonymous], groups[none] does not have permission to access the requested resource. Unknown user with identity 'anonymous'. Returning Unauthorized response. On Sun, Dec 23, 2018 at 3:50 PM dan young wrote: > Hello Mark, > > I have a q

Re: flowfiles stuck in load balanced queue; nifi 1.8

2018-12-23 Thread dan young
I forgot to mention that we're using the OpenId Connect SSO . Is there a way to run these command via curl when we have the cluster configured this way? If so would anyone be able to provide some insight/examples. Happy Holidays! Regards, Dano On Sun, Dec 23, 2018 at 3:53 PM dan young

Re: flowfiles stuck in load balanced queue; nifi 1.8

2018-12-26 Thread dan young
ilities: > > 1) The Queue's Count is wrong, because it somehow did not get decremented > (perhaps a threading bug?) > > Or > > 2) The Count is correct and the FlowFile exists, but somehow the reference > to the FlowFile was lost by the FlowFile Queue (again, perhaps

Re: flowfiles stuck in load balanced queue; nifi 1.8

2018-12-26 Thread dan young
ting that you restart with the connection’s source and destination > stopped. Just to make sure that the FlowFile didn’t just get processed > quickly on restart. > > Sent from my iPhone > > On Dec 26, 2018, at 7:55 PM, dan young wrote: > > Heya Mark, > > If we restart t

Re: flowfiles stuck in load balanced queue; nifi 1.8

2018-12-28 Thread dan young
t out without you spending the time to debug the issue! > > Thanks > -Mark > > [1] https://issues.apache.org/jira/browse/NIFI-5919 > > > On Dec 26, 2018, at 10:31 PM, dan young wrote: > > Hello Mark, > > I just stopped the destination processor, and then disconnected the nod

Re: flowfiles stuck in load balanced queue; nifi 1.8

2018-12-28 Thread dan young
e it out without you spending the time to debug the issue! > > Thanks > -Mark > > [1] https://issues.apache.org/jira/browse/NIFI-5919 > > > On Dec 26, 2018, at 10:31 PM, dan young wrote: > > Hello Mark, > > I just stopped the destination processor, and then disconnected the node &

Re: flowfiles stuck in load balanced queue; nifi 1.8

2019-01-05 Thread dan young
diagnose this and figure > it all out - would not have been able to > figure it out without you spending the time to debug the issue! > > Thanks > -Mark > > [1] https://issues.apache.org/jira/browse/NIFI-5919 > > > On Dec 26, 2018, at 10:31 PM, dan young wrote:

Re: Preferred schema registry

2019-01-15 Thread dan young
We used the AvroSchemaRegistry Dano On Tue, Jan 15, 2019, 12:51 PM Mike Thomsen What schema registry are others using in production use cases? We tried > out the HortonWorks registry, but it seemed to stop accepting updates once > we hit "v3" of our schema (we didn't name it v3, that's the versi

Re: flowfiles stuck in load balanced queue; nifi 1.8

2019-01-17 Thread dan young
> > Sent from my iPhone > > On Jan 17, 2019, at 6:59 PM, dan young wrote: > > Hello Mark, > > We're seeing "stuck" flow files again, this time within a PG...see > attached screen shots :( > > > > On Fri, Dec 28, 2018 at 8:43 AM Mark Payne wrote

Re: flowfiles stuck in load balanced queue; nifi 1.8

2019-02-08 Thread dan young
he rest of the flow or > do they get lost/dropped? > > -Chad > > *From: *dan young > *Reply-To: *"users@nifi.apache.org" > *Date: *Thursday, January 17, 2019 at 7:49 PM > *To: *NiFi Mailing List > *Subject: *Re: flowfiles stuck in load balanced queue; nifi 1.

1.9 release date?

2019-02-16 Thread dan young
Heya folks, Any insight on 1.9 release date? Looks like a lot of goodies and fixes included... Regards, Dano

Re: DistributeLoad across a NiFi cluster

2019-07-09 Thread dan young
If you're going to upgrade, I would recommend jumping to the latest version, 1.9.2 as of today. We ran into some issues in 1.8 with this feature that was fixed in 1.9.x. We're running 1.9.2 now with this feature now in production. Regards Dano On Tue, Jul 9, 2019, 6:58 AM wrote: > The feature

UI/canvas question.

2019-07-25 Thread dan young
Hello, We have a processor that we terminated via the UI, and now on the canvas I see what I believe is the active thread count and then a 1 between parenthesis (1) .. See attached screen shot. Also in on the processor that we killed, we see that an indicator in red with the (1). What do these

Re: UI/canvas question.

2019-07-26 Thread dan young
Thanks > -Mark > > > On Jul 25, 2019, at 11:21 PM, dan young wrote: > > Hello, > > We have a processor that we terminated via the UI, and now on the canvas I > see what I believe is the active thread count and then a 1 between > parenthesis (1) .. See attached screen s

Re: Running NiFi on Google Cloud

2019-07-28 Thread dan young
Hello Márcio, We've been running NiFi clusters for almost 3 years now at Looker on AWS. We will be moving these over to GCP in the future. My main recommendation is to ensure that you're using something like Ansible to help with the deployment and configuration of the cluster. We use a lot of exec

Re: can't ush data to bigQuery

2019-09-26 Thread dan young
yea, the arrayswe use jq to flatten and format all our JSON glad to see you got it! dano On Thu, Sep 26, 2019 at 6:54 AM Nicolas Delsaux wrote: > Oh well, i've understood my last error : incorrect flow files (with JSOn > arrays) were stuck in the queue. > > I removed them and ... to m

Re: Most popular processors

2017-03-17 Thread dan young
Hey Pere, Here's a list of the processors we use the most often, not in any order... UpdateAttribute InvokeHTTP ExecuteScriptCommand ExecuteScript PutS3Object PutSNS GetFile/PutFile RouteOnAttribute HandleHttpRequest/Response GenerateFlowFile EvaluateJsonPath GenerateTableFetch ExecuteSQL Convert

NiFi 1.2?

2017-03-22 Thread dan young
Any update on when 1.2 might be released into the wild? Regards, Dano

Re: NiFi 1.2?

2017-03-22 Thread dan young
Cool beans, thanx! Dano On Wed, Mar 22, 2017, 4:45 PM Joe Witt wrote: > Dan > > No but we really do need to push it as many folks have asked. I'll try my > best to start swirling the release management process soon. > > Thanks > Joe > > On Mar 22, 2017 6:34

Re: Parameterizing the nifi flow

2017-08-13 Thread dan young
We've done something similar as Carlos outlines here. Works really great Dano On Sun, Aug 13, 2017, 9:39 AM Carlos Manuel Fernandes (DSI) < carlos.antonio.fernan...@cgd.pt> wrote: > Hi Vikram, > > > > I had the same requirements like you , and my solution is a service: > > > > HandleHttpRequest

Re: Nifi 1.4: problem with QueryRecord Precessor

2017-10-04 Thread dan young
We're seeing the same thing. Works fine in 1.3 Dano On Wed, Oct 4, 2017, 8:13 AM Uwe Geercken wrote: > Hello, > > I have created a flow: GetFile >> QueryRecord >> Putfile. GetFile reads an > avro file. QueryRecord has one property/sql and the result is routed to > PutFile. > > When I run the pr

Re: Re: Nifi 1.4: problem with QueryRecord Precessor

2017-10-04 Thread dan young
It might be...maybe others can share experience with 1.4... On Wed, Oct 4, 2017, 8:37 AM Uwe Geercken wrote: > thanks Dano. > > Any other comments? Is this a bug in 1.4 then? > > Rgds, > > Uwe > > *Gesendet:* Mittwoch, 04. Oktober 2017 um 16:33 Uhr > *Von:* "d

Re: Nifi 1.4: problem with QueryRecord Precessor

2017-10-04 Thread dan young
> the processor attempts > to route the FlowFile to 'failure'. This occurs most often when there is a > problem obtaining the > schema for the Record. Can you check your logs and see what other error > may be present > in the logs? > > Thanks > -Mark > > > O

Re: Re: Nifi 1.4: problem with QueryRecord Precessor

2017-10-04 Thread dan young
> > > Rgds, > > > > Uwe > > > > > > Gesendet: Mittwoch, 04. Oktober 2017 um 16:55 Uhr > > Von: "Mark Payne" > > An: "users@nifi.apache.org" > > > > Betreff: Re: Nifi 1.4: problem with QueryRecord Precessor > >

Re: Re: Nifi 1.4: problem with QueryRecord Precessor

2017-10-04 Thread dan young
gds, > > > > Uwe > > > > > > Gesendet: Mittwoch, 04. Oktober 2017 um 16:55 Uhr > > Von: "Mark Payne" > > An: "users@nifi.apache.org" > > > > Betreff: Re: Nifi 1.4: problem with QueryRecord Precessor > > Dan, Uwe, > >

Re: How to start a flow with attributes from the state store?

2017-10-20 Thread dan young
Same here, works great! On Fri, Oct 20, 2017 at 7:27 AM Mike Thomsen wrote: > I can vouch for this method. I have two flows for a client that use > GenerateFlowFile to build a JSON DSL query for ElasticSearch and are > executed on a timer. Works quite well with InvokeHttp. > > On Thu, Oct 19, 20

Re: Authorization and Multi-Tenancy functionnalities Evaluation -> Unable to locate initial admin error

2017-11-17 Thread dan young
Thanx Bryan, On a side note, after beating my skull against a sharp pen all for a few hours and losing about a pint of blood... I was able to get this working. One thing to note that wasn't clear to me initially, is that you need to add all the cluster nodes into both the userGroupProvider and acc

unable to start InvokeHTTP processor in secure Nifi 1.4.0 cluster....

2017-12-04 Thread dan young
Hello, I'm working on migrating some flows over to a secure cluster with OIDC. When I try to start an InvokeHTTP processor, I'm getting the following errors in the logs. Is there some permission/policy that I need to set for this to work? or is this something else? Nifi 1.4.0 2017-12-04 17:

Re: unable to start InvokeHTTP processor in secure Nifi 1.4.0 cluster....

2017-12-05 Thread dan young
e a JIRA for this. There is definitely a bug that > needs to be addressed if you can make an NPE happen. > > Thanks > > On Mon, Dec 4, 2017 at 12:27 PM, dan young wrote: > > Hello, > > > > > > I'm working on migrating some flows over to a secure cluster with

Re: unable to start InvokeHTTP processor in secure Nifi 1.4.0 cluster....

2017-12-06 Thread dan young
ame properties already defined for your truststore and I > believe your processor will start working. > > Please let me know if I have misdiagnosed or if there are issues with the > workaround. > > Thanks, > Josh > > On Tue, Dec 5, 2017 at 9:42 AM, dan young wrote: > &g

unable to search provenance repository

2018-01-16 Thread dan young
Hello, We're running a secure 3 node 1.4 cluster, and for some reason we're not able to search processor provenance event. i.e. trying to search a for a particular event by filename, but the results always come back empty, even though when I view the provenance event history I can see the event.

Re: unable to search provenance repository

2018-01-17 Thread dan young
the system. > I believe you can activate more detailed logging for that class and > others to see information about the queries themselves. I'll try some > of this tomorrow and share more findings if able. > > If no luck then please be sure to file a JIRA. > > Thanks >

Re: unable to search provenance repository

2018-01-17 Thread dan young
i'm hoping it was the restart and not the change of > shard size because one I can understand and the other I cannot :) > > If you think you run into this again can you please get thread dumps > and share them? > > Thanks! > > On Wed, Jan 17, 2018 at 10:41 AM, dan young

all of our schedule tasks not running/being scheduled....

2018-01-29 Thread dan young
Hello, We're running a secure 3 node 1.4 cluster. Has anyone seen any behaviour where the cluster just stops scheduling the running of flowfiles/tasks? i.e. cron/timer, just don't run when they're suppose to. I've tried to stop and restart a processor that is say set to run ever 900sec, but noth

Re: all of our schedule tasks not running/being scheduled....

2018-01-30 Thread dan young
ead is doing. > > Other than that, I've encountered unexpected behavior with a NiFi > cluster if a node encountered OutOfMemory error. > The cluster started to behave incorrectly as it can not replicate REST > requests among nodes. I'd search any ERR logs in nifi-app.log. > >

Re: all of our schedule tasks not running/being scheduled....

2018-01-30 Thread dan young
; > And ideally send the full contents of the logs directory in a tar.gz > > tar czvf nifilogs.tar.gz logs > > Thanks > Joe > > On Tue, Jan 30, 2018 at 8:43 AM, dan young wrote: > > Hello Koji, > > > > I don't see any OOM errors in the logs,

ExecuteStreamCommand - 1.5

2018-02-02 Thread dan young
Just wanted to shout out and thank you for adding the "nonzero status" to the ExecuteStreamCommand in NiFi 1.5! Has really simplified my exception handling kudos! Regards, Dano

zookeeper error message - nifi 1.11.1/zookeeper 3.5.6

2020-02-12 Thread dan young
Hello, We're seeing the following messages in nifi logs on our cluster nodes. Using Nifi 1.11.1 and zookeeper (not embedded) version 3.5.6 Functionality seems not to be impacted, but wondering if there's something else going on or the version of zookeeper we're using is causing this. 2020-02-12

Re: zookeeper error message - nifi 1.11.1/zookeeper 3.5.6

2020-02-12 Thread dan young
2=10.190.3.172:2888 :3888:participant} Regards, Dano On Wed, Feb 12, 2020 at 9:49 AM Joe Witt wrote: > Dan, > > Not sure what others see but for me your email cuts off in the middle of a > line. > > You might want to file a JIRA with your observation/logs. > > Thanks >

Re: zookeeper error message - nifi 1.11.1/zookeeper 3.5.6

2020-02-12 Thread dan young
3.5.6/zookeeperReconfig.html On Wed, Feb 12, 2020, 5:53 PM 노대호Daeho Ro wrote: > In my memory, > > zookeepr 3.5.6 needs the new form of zookeeper string such as > > server.1=0.0.0.0:2888:3888;2181 > > > where the ip is yours. > > Hope this help you. > > > 2020년 2월

timing on release of 1.11.2 ?

2020-02-18 Thread dan young
Howdy folks, Just curious what the word on the street for releasing 1.11.2 Regards, Dano

Re: timing on release of 1.11.2 ?

2020-02-18 Thread dan young
Great, thank you Joe! Regards Dano On Tue, Feb 18, 2020, 8:41 AM Joe Witt wrote: > it is under vote now. so within a day or so possibly > > thanks > > On Tue, Feb 18, 2020 at 9:26 AM dan young wrote: > >> Howdy folks, >> >> Just curious what the wor

zookeeper connection string question/clarification

2020-02-20 Thread dan young
Hello, Using Nifi 1.11.1 in cluster mode with external zookeeper. Does the nifi.zookeeper.connect string in the nifi.properties need to change from say: nifi.zookeeper.connect.string= 10.xxx.x.xxx:2181,10.xxx.x.xxx:2181,10.xxx.x.xxx:2181 nifi.zookeeper.connect.string= 10.xxx.x.xxx;2181,10.xxx

Re: zookeeper connection string question/clarification

2020-02-20 Thread dan young
alopre...@apache.org > *alopresto.apa...@gmail.com * > PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > > On Feb 20, 2020, at 3:18 PM, dan young wrote: > > Hello, > > Using Nifi 1.11.1 in cluster mode with external zookeeper. Does the > nifi.zookeeper.co

Re: zookeeper connection string question/clarification

2020-02-20 Thread dan young
on+Guidance > > Andy LoPresto > alopre...@apache.org > *alopresto.apa...@gmail.com * > PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > > On Feb 20, 2020, at 3:18 PM, dan young wrote: > > Hello, > > Using Nifi 1.11.1 in cluster mode with e

nifi toolkit 1.11.x expression language test.

2020-02-21 Thread dan young
Hello, I'm using this as a reference to test some expression language on the command line: https://gist.github.com/mattyb149/13b9bceeace1f7db76f648dfb200b680 This works fine; λ ~/software/nifi-tools groovy testEL-1.9.2.groovy -D dt "2020-02-21 12:00:00" '${dt:toDate("-MM-dd HH:mm:ss"):minus(

what happen to the 1.11.2 download?

2020-02-25 Thread dan young
Hello, I see the 1.11.2 download is not working, there's a 1.11.3 now. Is there a reason it was pulled and should we not be running it in production? Regards, Dano

Re: what happen to the 1.11.2 download?

2020-02-25 Thread dan young
'll want to grab 1.11.3. > > Thanks > > > > On Tue, Feb 25, 2020 at 8:18 AM dan young wrote: > >> Hello, >> >> I see the 1.11.2 download is not working, there's a 1.11.3 now. Is there >> a reason it was pulled and should we not be running it in production? >> >> Regards, >> >> Dano >> >

UpdateAttribute processor question...

2020-04-22 Thread dan young
Hello, I haven't been able to figure out if this is doable with a single UpdateAttrbute processor, but is it possible to create an attribute that references a different attribute you're setting in the same UpdateAttribute processor? ie. UpdateAttribute a = "foo" b = "bar" c = ${allAttributes("a"

Re: UpdateAttribute processor question...

2020-04-22 Thread dan young
> would require a code change there, with a default practice being “order as > received". > > > Andy LoPresto > alopre...@apache.org > *alopresto.apa...@gmail.com * > He/Him > PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > > On Apr 22, 2020

Re: Move flow into process group

2020-06-17 Thread dan young
Did you try to copy and then paste them? On Wed, Jun 17, 2020, 9:12 AM PeterEttery wrote: > Good day - > > I'm busy getting to grips with Nifi, using v1.11.4, and would like to move > some processors into a group. > > I can select the processors on the canvas, but can't get them into a group: >

Zookeeper ACL question

2020-06-26 Thread dan young
Hello, I was looking at setting up zookeeper with basic password ACL in a small cluster. Looking at the Nifi docs it mentions something about Username/Password,vs using Kerberos, in the Zookeeper Access Control under the state providers. https://nifi.apache.org/docs/nifi-docs/html/administration-

zookeeper SASL/Digest authentication....

2020-07-06 Thread dan young
Hello everyone, I'm trying to configure the zookeeper state provider in NiFi to use the Access Policy of CreatorOnly vs Open using DIGEST vs Kerberos. I believe I've setup zookeeper correctly for this, and partly Nifi, but when I startup nifi cluster, we seem to get stuck with the following: 2

Re: zookeeper SASL/Digest authentication....

2020-07-06 Thread dan young
when we run in kerberos env? Dano On Mon, Jul 6, 2020 at 10:36 AM dan young wrote: > Hello everyone, > > I'm trying to configure the zookeeper state provider in NiFi to use the > Access Policy of CreatorOnly vs Open using DIGEST vs Kerberos. I believe > I've setup

Re: zookeeper SASL/Digest authentication....

2020-07-06 Thread dan young
Bende wrote: > Have you configured this in nifi.properties? > > nifi.zookeeper.auth.type=sasl > > > On Mon, Jul 6, 2020 at 12:43 PM dan young wrote: > >> Hello, >> >> And a follow up on this, if I delete the znode in zookeeper, the leaders >> is writt

Re: zookeeper SASL/Digest authentication....

2020-07-06 Thread dan young
operties? > > nifi.zookeeper.auth.type=sasl > > > On Mon, Jul 6, 2020 at 12:43 PM dan young wrote: > >> Hello, >> >> And a follow up on this, if I delete the znode in zookeeper, the leaders >> is written to the /nifi znode, but the ACL is open, 'world';'anyone

Re: zookeeper SASL/Digest authentication....

2020-07-06 Thread dan young
Hello Bryan, Making some progressany insight into this error with GenerateTableFectch processor? On Mon, Jul 6, 2020 at 10:47 AM Bryan Bende wrote: > Have you configured this in nifi.properties? > > nifi.zookeeper.auth.type=sasl > > > On Mon, Jul 6, 2020 at 12:43 P

Re: zookeeper SASL/Digest authentication....

2020-07-06 Thread dan young
org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.createNode(ZooKeeperStateProvider.java:360) at org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.setState(ZooKeeperStateProvider.java:321) ... 17 common frames omitted On Mon, Jul 6, 2020 at 11:39 AM dan young wrote: > Hello Bryan, > &g

Re: zookeeper SASL/Digest authentication....

2020-07-06 Thread dan young
org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.setState(ZooKeeperStateProvider.java:321) ... 17 common frames omitted On Mon, Jul 6, 2020 at 11:59 AM Bryan Bende wrote: > You set CreatorOnly in the ZK > state manager ? > > On Mon, Jul 6, 2020 at 1:40 PM dan young wrote: > >> Fat fingere

Re: zookeeper SASL/Digest authentication....

2020-07-06 Thread dan young
;); > > Any ZK client code should be seeing the same JAAS entry you configured, so > not sure how it could be authenticating as different identities. > > > On Mon, Jul 6, 2020 at 2:27 PM dan young wrote: > >> Correct, the leader seems to work, but not the compo

cluster stick in "Attempted to register Leader Election for role 'Cluster Coordinator' but this role is already registered"

2020-08-05 Thread dan young
Hello, Running nifi 1.11.4, 3 X secure cluster mode and have enabled kerberos/sasl, upon trying to startup the cluster, they seem to get stuck in : 2020-08-05 17:10:18,907 WARN [main] o.a.nifi.controller.StandardFlowService There is currently no Cluster Coordinator. This often happens upon restart

Re: cluster stick in "Attempted to register Leader Election for role 'Cluster Coordinator' but this role is already registered"

2020-08-05 Thread dan young
uld be changed to a DEBUG level, > really. It should not be concerning. A thread dump, though, would show us > exactly where it’s at. > > Thanks > -Mark > > > On Aug 5, 2020, at 2:02 PM, dan young wrote: > > Hello, > Running nifi 1.11.4, 3 X secure cluster mode and have

Re: cluster stick in "Attempted to register Leader Election for role 'Cluster Coordinator' but this role is already registered"

2020-08-05 Thread dan young
ot; when Sasl/Kerberos is setup correctly? > > In addition to the nifi configs you showed, you would also need a jaas > conf file specified in bootstrap.conf and in that file you would need the > jaas entry for the ZK client. > > On Wed, Aug 5, 2020 at 3:02 PM dan young wrote: >

Re: cluster stick in "Attempted to register Leader Election for role 'Cluster Coordinator' but this role is already registered"

2020-08-05 Thread dan young
cified in bootstrap.conf and in that file you would need the > jaas entry for the ZK client. > > On Wed, Aug 5, 2020 at 3:02 PM dan young wrote: > >> Hello Mark, >> >> Attached is a dump from one of the nodesI replaced the domain related >> entries with

Re: cluster stick in "Attempted to register Leader Election for role 'Cluster Coordinator' but this role is already registered"

2020-08-05 Thread dan young
tor" when Sasl/Kerberos is setup correctly? > > In addition to the nifi configs you showed, you would also need a jaas > conf file specified in bootstrap.conf and in that file you would need the > jaas entry for the ZK client. > > On Wed, Aug 5, 2020 at 3:02 PM dan young wrot

Re: cluster stick in "Attempted to register Leader Election for role 'Cluster Coordinator' but this role is already registered"

2020-08-05 Thread dan young
7;anyone : r On Wed, Aug 5, 2020 at 1:56 PM Mark Payne wrote: > No worries, thanks for following up and letting us know! > > Thanks > -Mark > > > On Aug 5, 2020, at 3:42 PM, dan young wrote: > > Hello, > > Sorry for all the noise...doohwas due to the realm i

Access Policy required to call REST endpoint?

2020-08-17 Thread dan young
Hello, I have a secure cluster that we just brought up, and have a flow that downloads the main Process groups via: GET /process-groups/{id}/download Gets a process group for download but we're seeing a 403 error, I think it's a policy issue, but not sure which one that should be set on. The

Re: Securing Nifi 1.11.4

2021-01-09 Thread dan young
Did you grant access to the provenance events to all the cluster nodes too? On Fri, Jan 8, 2021, 11:35 PM Cenk Aktas wrote: > Hello, > > > > We configured to admin UI on SSL with a self-signed certificate. > > Only one user is defined and it has all policies. > > We are not able to see any prove

Unsubscribe

2023-03-03 Thread dan young

unsubscribe

2023-03-08 Thread dan young
unsubscribe