Re: NiFi Extension Registry?

The best mechanism is the dev mailing list. The Slack workspace provides an opportunity for live conversation, but interaction is limited by timezones, and the system of record for Apache discussions is the mailing list. A thread here will allow people to contribute across time/location and

Re: Re: MergeRecord can not guarantee the ordering of the input sequence?

Hi Koji, Actually i have set all connections to FIFO and concurrency tasks to 1 for all processors. Before and after the MergeRecord, I add a LogAttribute to debug. Before MergeRecord，the order in logfile is A,B,C in three flowfile After MergeRecord, the order becomes {A,C,B} in one flowfile

Re: MergeRecord can not guarantee the ordering of the input sequence?

Hi Lei, How about setting FIFO prioritizer at all the preceding connections before the MergeRecord? Without setting any prioritizer, FlowFile ordering is nondeterministic. Thanks, Koji On Tue, Oct 15, 2019 at 8:56 PM wangl...@geekplus.com.cn wrote: > > > If FlowFile A, B, C enter the

Re: Data inconsistency happens when using CDC to replicate my database

Hi Lei, To address FlowFile ordering issue related to CaptureChangeMySQL, I'd recommend using EnforceOrder processor and FIFO prioritizer before a processor that requires precise ordering. EnforceOrder can use "cdc.sequence.id" attribute. Thanks, Koji On Tue, Oct 15, 2019 at 1:14 PM

Re: NiFi Extension Registry?

You're very welcome, it's every bit deserved, Andy :) I was actually talking to a good friend and colleague about this today, so if you wouldn't mind giving me a few more minutes of your time... We're early into our journey, but I suspect that we'll be coming up with cases in the near future.

Re: NiFi Extension Registry?

Thanks for the kind words Shalin. This is something that is in development as Bryan mentioned. It’s a great time to contribute ideas and suggestions, as well as get involved with contributing code if you’re interested. We always welcome input from the community, especially if you have a real

Re: Jira contributor access

Hello Koji already replied to your request giving you contributor access. Thanks Joe On Tue, Oct 15, 2019 at 2:09 PM Seokwon Yang wrote: > I am requesting the contributor role again. Please add me (Jira username : > sjyang18) as a contributor. > > Thanks > Seokwon > > From: Seokwon

Jira contributor access

I am requesting the contributor role again. Please add me (Jira username : sjyang18) as a contributor. Thanks Seokwon From: Seokwon Yang Sent: Wednesday, October 9, 2019 2:47 PM To: dev@nifi.apache.org Subject: Jira contributor access

Maxmind enterprise DB lookup

Hi all, Does NiFi have any processor for IP lookup through MaxMind Enterprise DB? I am able to do the lookup using GeoEnrichIp processor with MaxMind City DB, but when trying on Enterprise DB, I got GeoEnrichIP[id=118a108f-1dd6-1c66-3b33-bf04d4ed1275]

Re: [discuss] approaching a NiFi 1.10.0 release

rgr mark - that one is easy - i'll take care of it shortly On Tue, Oct 15, 2019 at 12:51 PM Mark Bean wrote: > Trivial pull request waiting on review; would be nice to get in 1.10.0. > > https://github.com/apache/nifi/pull/3810 > > Thanks. > > On Tue, Oct 15, 2019 at 10:58 AM Joe Witt wrote:

Re: [discuss] approaching a NiFi 1.10.0 release

Trivial pull request waiting on review; would be nice to get in 1.10.0. https://github.com/apache/nifi/pull/3810 Thanks. On Tue, Oct 15, 2019 at 10:58 AM Joe Witt wrote: > Thanks team. Progressing RC for 1.10.0 tasks now. > > > > On Thu, Oct 3, 2019 at 12:55 PM Bryan Bende wrote: > > >

Re: [discuss] approaching a NiFi 1.10.0 release

Thanks team. Progressing RC for 1.10.0 tasks now. On Thu, Oct 3, 2019 at 12:55 PM Bryan Bende wrote: > Done! > > On Thu, Oct 3, 2019 at 12:37 PM Mike Thomsen > wrote: > > > > Could we get this small PR merged (reviews appear to be done)? > > > > https://github.com/apache/nifi/pull/3723 > >

PutDataBaseRecord performance issues.

I am using CaptureChangeMySQL to extract bin log and do some transformations and then write to another database using PutDataBaseRecord. Now the PutDataBaseRecord processor is a performance bottleneck If i set the PutDataBaseRecord processor concurrency lager than 1, there will be ordering

MergeRecord can not guarantee the ordering of the input sequence?

If FlowFile A, B, C enter the MergeRecord sequentially, the output should be one FlowFile {A, B, C} However, when testing with large data volume, sometimes the output order will be not the same as they enter. And this result is nondeterministic This really confuses me a lot. Anybody has any

PutDataBaseRecord performance issues.

I am using CaptureChangeMySQL to extract bin log and do some transformations and then write to another database using PutDataBaseRecord. Now the PutDataBaseRecord processor is a performance bottleneck If i set the PutDataBaseRecord processor concurrency lager than 1, there will be ordering