RE: simple JMS pub-sub not working

2018-07-02 Thread Kelsey RIDER
JIRA ticket created: https://issues.apache.org/jira/browse/NIFI-5360 From: Kelsey RIDER Sent: vendredi 29 juin 2018 09:12 To: users@nifi.apache.org Subject: RE: simple JMS pub-sub not working Hi Mark, I see what you’re saying, but conceptually, it doesn’t seem like a good idea to me. From w

Clustered Flow Execution Help

2018-07-02 Thread Joe Trite
I have a question/need confirmation about cluster execution. I have a 3 node - 1.6 NiFi cluster. My use case is extracting data from Hive and deposting it into an RDBMS. Here is my flow. 1. SelectHiveQL - executes a "show paritions" command. 2. SplitText - splits the returned partition (7) into

Re: Clustered Flow Execution Help

2018-07-02 Thread Matt Burgess
Joe, Only the first (source) processor needs to be set to Primary Node Only. Once that happens, the flow files will only proceed down the flow on the primary node, so step 5 will also only run on the primary node. In order to redistribute the flow files among the cluster, you'll want a Remote Proc

Re: Clustered Flow Execution Help

2018-07-02 Thread Ravi Papisetti (rpapiset)
In my experience, if you set first processor to run on "Primary Node", then remaining flow that directly connects to it will run on that node independent of how sub-sequent processors are configured to run. If you really want to distribute the flow, after first step, insert a RPG processors, th

Re: Clustered Flow Execution Help

2018-07-02 Thread Joe Trite
thx, the flow is executing as expected now. On Mon, Jul 2, 2018 at 10:09 AM, Matt Burgess wrote: > Joe, > > Only the first (source) processor needs to be set to Primary Node > Only. Once that happens, the flow files will only proceed down the > flow on the primary node, so step 5 will also only