;>>>
>>>>Supporting to Tijo’s thought, have one scenario.
>>>>
>>>> we are trying to use Nifi for a data pipeline solution. The scenario is
>> to coordinate between various services and provide a solution for big data
>> ana
e being implemented on top of various
> components like Yarn, Hbase, Spark, DB etc.
> >>
> >> One issue we are seeing is all these processors to be
> run on primary node [like spark execution, yarn/mr job execution etc.. ]
> and it is only one.
> >>
; We are thinking of having multiple primary nodes and assign
>> the activities using some distribution algorithm.
>> The idea is to handle the coordination and failover
>> mechanism using zookeeper.
>>
>> Any thought
nd assign
>the activities using some distribution algorithm.
> The idea is to handle the coordination and failover mechanism
>using zookeeper.
>
> Any thoughts on this ?
>
> Regards
> Nijel
>
> From: Jeff [mailto:jtsw...@gmail.com]
>
of nodes to be deployed and managed separately.
Regards
-nijel
-Original Message-
From: Tijo Thomas [mailto:tijopara...@yahoo.in.INVALID]
Sent: Wednesday, September 21, 2016 10:20 PM
To: dev@nifi.apache.org
Subject: Re: enforce run only in promary node $ multiple primary n
Any thoughts on this ?
>
> Regards
> Nijel
>
> From: Jeff [mailto:jtsw...@gmail.com]
> Sent: Monday, September 19, 2016 11:17 PM
> To: Tijo Thomas; us...@nifi.apache.org
> Subject: Re: enforce run only in promary node $ multiple primary node
>
> Tijo,
&g
algorithm.
>The idea is to handle the coordination and failover mechanism
> using zookeeper.
>
>Any thoughts on this ?
>
> Regards
> Nijel
>
> From: Jeff [mailto:jtsw...@gmail.com]
> Sent: Monday, September 19, 2016 11:17 PM
> To: Tijo Thomas; us..
ailto:jtsw...@gmail.com]
Sent: Monday, September 19, 2016 11:17 PM
To: Tijo Thomas; us...@nifi.apache.org
Subject: Re: enforce run only in promary node $ multiple primary node
Tijo,
To give you some information on your second question, you can design your flow
to redistribute the flowfiles coming o
