Re: high task count

2019-10-16 Thread Mark Payne
Mark, I think you’ll see this behavior when the flowfile is penalized. It’s something that we should really clean up at some point, but it’s mostly harmless so it’s just something that we’ve not gotten around to addressing. Thanks -Mark Sent from my iPhone > On Oct 16, 2019, at 4:27 PM,

high task count

2019-10-16 Thread Mark Bean
We have a PostHTTP with the failure relationship going to a downstream processor. The downstream processor has a huge task count - over 100 million tasks across the cluster in the 5-minute stats window. Yet, there are only between 4,000-18,000 FlowFiles that are processed in that same time. The

Minimum NiFi Hardware Requirements

2019-10-16 Thread Bradley Barber
Hi all, I have a client who wants to deploy several instances of NiFi, each within its own VM, to ingest data from primary sources before sending the data to a common location where a large, clustered NiFi instance can ingest the data into their database. These primary sources aren't expected to

Re: Jira contributor access request

2019-10-16 Thread Matt Burgess
Andrew, Welcome! I have added you as a Contributor to all the NiFi projects. Looking forward to your contributions! Regards, Matt On Wed, Oct 16, 2019 at 11:31 AM Andrew Rodriguez wrote: > > Hello, > > I was hoping to gain access to contribute, as I'm able. My Jira username is > atrodriguez. >

Jira contributor access request

2019-10-16 Thread Andrew Rodriguez
Hello, I was hoping to gain access to contribute, as I'm able. My Jira username is atrodriguez. Thanks, Andrew

Re: [discuss] approaching a NiFi 1.10.0 release

2019-10-16 Thread Mike Thomsen
Before we go to RC, has anyone tested at least PutElasticsearchHttpRecord against Elastic 7.X? I know there were API changes that might need to be accounted for when 7.X was created. If no one's tried that out, I can try to find some time to do some testing. On Tue, Oct 15, 2019 at 1:36 PM Joe

Re: Re: NiFi backpressure not work

2019-10-16 Thread wangl...@geekplus.com.cn
CaptureChangeMySQLSelf is from CaptureChangeMySQL and I fix a small bug about binlog parsing. But i am sure there's no change that will affect the backpressure mechanism. Actually I don't quite understand it. It is related with the implementation of the processor? In order to use the

NiFi backpressure not work

2019-10-16 Thread wangl...@geekplus.com.cn
As the picture shows. I have set the backpressure object threshold to 1, but picture shows there's more than 1,000,000. Why this happens? Thanks, Lei wangl...@geekplus.com.cn