Re: Adding a node to a cluster

2022-04-11 Thread James McMahon
This is an external zookeeper, Mein Herr. And this team’s current thought is that the easiest way to add a node is to modify their CloudFormation script, and use it to tear down and re-standup their N-cluster + 1. I’m wondering that there might be a less-disruptive way to add the “+1”. Is there?

Re: Adding a node to a cluster

2022-04-11 Thread Jorge Machado
Hey, Are you using the zookeeper internally or an external one. I think you need to check at least two things: * Zookeeper connections. The node needs to register into zookeeper. * The node needs to connect to the cluster and replicate the flow files let’s say so. Overall scaling up is

Re: Unexpected Behaviour In LookupRecord With "Route To success" Strategy

2022-04-11 Thread Mark Payne
Yeah, I just created one [1]. Thanks -Mark [1] https://issues.apache.org/jira/browse/NIFI-9903 On Apr 11, 2022, at 10:16 AM, stephen.hindma...@bt.com wrote: Thanks Mark, Is there a JIRA open for this? Regards Steve From: Mark Payne

RE: Unexpected Behaviour In LookupRecord With "Route To success" Strategy

2022-04-11 Thread stephen.hindmarch
Thanks Mark, Is there a JIRA open for this? Regards Steve From: Mark Payne Sent: 11 April 2022 14:34 To: users@nifi.apache.org Subject: Re: Unexpected Behaviour In LookupRecord With "Route To success" Strategy Steve, Thanks for the note. Ironically, I ran into this issue just yesterday.

Re: Unexpected Behaviour In LookupRecord With "Route To success" Strategy

2022-04-11 Thread Mark Payne
Steve, Thanks for the note. Ironically, I ran into this issue just yesterday. Unfortunately, it’s a bug that will have to be addressed. In the meantime, if you define the schema for your Record Writer explicitly, it should work as expected. The issue comes down to the fact that the first

Adding a node to a cluster

2022-04-11 Thread James McMahon
A nifi cluster has been created using a CloudFormation script. The cluster is running, and the customer now wishes to scale up the cluster by adding a node. What is the optimal way to add a node to a running nifi cluster established through CloudFormation? My instinct tells me to do it within the

Unexpected Behaviour In LookupRecord With "Route To success" Strategy

2022-04-11 Thread stephen.hindmarch
Hi all, I am trying to set up a simple enrichment pipeline where flow records get enriched from a Redis Distributed Map cache and I use a sequence of LookupRecord processors to gather the enrichment data. I am using the "Route to success" routing strategy because I would like to avoid