Re: Nifi cluster features - Questions

2016-01-11 Thread Chakrader Dewaragatla
: Mark Payne mailto:marka...@hotmail.com>> Reply-To: "users@nifi.apache.org<mailto:users@nifi.apache.org>" mailto:users@nifi.apache.org>> Date: Monday, January 11, 2016 at 12:29 PM To: "users@nifi.apache.org<mailto:users@nifi.apache.org>" mailto:users@nifi.apa

Re: Nifi cluster features - Questions

2016-01-11 Thread Mark Payne
her > means). > Thanks, > -Chakri > > From: Mark Payne mailto:marka...@hotmail.com>> > Reply-To: "users@nifi.apache.org <mailto:users@nifi.apache.org>" > mailto:users@nifi.apache.org>> > Date: Monday, January 11, 2016 at 5:24 AM > To: "users@n

Re: Nifi cluster features - Questions

2016-01-11 Thread Chakrader Dewaragatla
gt; Date: Monday, January 11, 2016 at 5:24 AM To: "users@nifi.apache.org<mailto:users@nifi.apache.org>" mailto:users@nifi.apache.org>> Subject: Re: Nifi cluster features - Questions Chakri, This line in the logs is particularly interesting (on primary node): 2016-01-1

Re: Nifi cluster features - Questions

2016-01-11 Thread Mark Payne
re > clearly not there yet in having the right operator/admin experience. > > Thanks > Joe > > On Sun, Jan 10, 2016 at 3:41 PM, Chakrader Dewaragatla > <mailto:chakrader.dewaraga...@lifelock.com>> wrote: > > I was able to get site-to-site work. > > I tr

Re: Nifi cluster features - Questions

2016-01-10 Thread Chakrader Dewaragatla
t;mailto:users@nifi.apache.org>" mailto:users@nifi.apache.org>> Date: Sunday, January 10, 2016 at 2:43 PM To: "users@nifi.apache.org<mailto:users@nifi.apache.org>" mailto:users@nifi.apache.org>> Subject: Re: Nifi cluster features - Questions Chakri, Glad you got site-to-s

Re: Nifi cluster features - Questions

2016-01-10 Thread Bryan Bende
> > However, data is only written to one slave (Secondary slave). Primary > slave > > has not data. > > > > Image screenshot : > > http://tinyurl.com/jjvjtmq > > > > From: Chakrader Dewaragatla > > Date: Sunday, January 10, 2016 at 11:26 AM > > &g

Re: Nifi cluster features - Questions

2016-01-10 Thread Joe Witt
one slave (Secondary slave). Primary slave > has not data. > > Image screenshot : > http://tinyurl.com/jjvjtmq > > From: Chakrader Dewaragatla > Date: Sunday, January 10, 2016 at 11:26 AM > > To: "users@nifi.apache.org" > Subject: Re: Nifi cluster features - Qu

Re: Nifi cluster features - Questions

2016-01-10 Thread Chakrader Dewaragatla
:users@nifi.apache.org>> Date: Saturday, January 9, 2016 at 11:22 AM To: "users@nifi.apache.org<mailto:users@nifi.apache.org>" mailto:users@nifi.apache.org>> Subject: Re: Nifi cluster features - Questions The sending node (where the remote process group is) will distr

Re: Nifi cluster features - Questions

2016-01-10 Thread Chakrader Dewaragatla
urday, January 9, 2016 at 11:22 AM To: "users@nifi.apache.org<mailto:users@nifi.apache.org>" mailto:users@nifi.apache.org>> Subject: Re: Nifi cluster features - Questions The sending node (where the remote process group is) will distribute the data evenly across the two nod

Re: Nifi cluster features - Questions

2016-01-09 Thread Bryan Bende
t; From your above comment, It should put file on two nodes. It put files on >> primary node only. Any thoughts ? >> >> Thanks, >> -Chakri >> >> From: Mark Payne > > >> Reply-To: "users@nifi.apache.org >> " < >> users@nifi.apache.

Re: Nifi cluster features - Questions

2016-01-09 Thread Chakrader Dewaragatla
ply-To: "users@nifi.apache.org<mailto:users@nifi.apache.org>" mailto:users@nifi.apache.org>> Date: Friday, January 8, 2016 at 3:44 PM To: "users@nifi.apache.org<mailto:users@nifi.apache.org>" mailto:users@nifi.apache.org>> Subject: Re: Nifi clust

Re: Nifi cluster features - Questions

2016-01-08 Thread Bryan Bende
only). > From your above comment, It should put file on two nodes. It put files on > primary node only. Any thoughts ? > > Thanks, > -Chakri > > From: Mark Payne > Reply-To: "users@nifi.apache.org" > Date: Wednesday, October 7, 2015 at 11:28 AM > > To: "

Re: Nifi cluster features - Questions

2016-01-08 Thread Chakrader Dewaragatla
gt;> Date: Wednesday, October 7, 2015 at 11:28 AM To: "users@nifi.apache.org<mailto:users@nifi.apache.org>" mailto:users@nifi.apache.org>> Subject: Re: Nifi cluster features - Questions Chakri, Correct - when NiFi instances are clustered, they do not transfer data betwe

Re: Nifi cluster features - Questions

2015-10-07 Thread Mark Payne
om: Mark Payne mailto:marka...@hotmail.com>> > Reply-To: "users@nifi.apache.org <mailto:users@nifi.apache.org>" > mailto:users@nifi.apache.org>> > Date: Wednesday, October 7, 2015 at 7:00 AM > To: "users@nifi.apache.org <mailto:users@nifi.apache.org>"

Re: Nifi cluster features - Questions

2015-10-07 Thread Chakrader Dewaragatla
@nifi.apache.org<mailto:users@nifi.apache.org>" mailto:users@nifi.apache.org>> Subject: Re: Nifi cluster features - Questions Hello Chakro, When you create a cluster of NiFi instances, each node in the cluster is acting independently and in exactly the same way. I.e., if you have 5 nod

Re: Nifi cluster features - Questions

2015-10-07 Thread Mark Payne
Hello Chakro, When you create a cluster of NiFi instances, each node in the cluster is acting independently and in exactly the same way. I.e., if you have 5 nodes, all 5 nodes will run exactly the same flow. However, they will be pulling in different data and therefore operating on different dat

Nifi cluster features - Questions

2015-10-06 Thread Chakrader Dewaragatla
Nifi Team – I would like to understand the advantages of Nifi clustering setup. Questions : - How does workflow work on multiple nodes ? Does it share the resources intra nodes ? Lets say I need to pull data 10 1Gig files from S3, how does work load distribute ? Setting concurrent tasks as 5.