Data inconsistency happens when using CDC to replicate my database

2019-10-14 Thread wangl...@geekplus.com.cn
Using CaptureChangeMySQL to extract binlog, do some translation and then put to another database with PutDatabaseRecord processor. But there's always data inconsitency between destination database and souce database. To debug this, I have do the following settings. CaptureChangeMySQL only

Re: NiFi Extension Registry?

2019-10-14 Thread Shalin Mehta
Hey Bryan, Thanks for the information, especially the 1.10.0 dependency. I know that there's been a lot of motion toward that release in the last couple weeks, so I'll continue keeping an eye on that while looking into the functionality in NiFi Registry 0.5.0. If there are any further suggestions

Re: NiFi Extension Registry?

2019-10-14 Thread Bryan Bende
Hi Shalin, There is a minimal version of an extension registry as part of NiFi Registry 0.5.0. You can see an example of how to upload a NAR in the user guide [1]. The issue is that in order to use those end-points, your NAR needs to be built with NiFi 1.10.0 which hasn't been released yet. So

NiFi Extension Registry?

2019-10-14 Thread Shalin Mehta
Hey all, I'm starting to cut my teeth on the extensibility of NiFi through Custom Processors, and one of the big things on my mind is being able to manage a catalog of them across an organization. While watching the "BYOP" presentation given by Andy at DataWorks Summit Barcelona earlier this

Re: Nifi Database repository backup & restore

2019-10-14 Thread Koji Kawamura
Hi Ganesh, Thanks for the update. But it's still unclear to me about following points: 1. What files did you back up and restore exactly? If you can share how did you take backup and restore with granular details such as exact command list, then I can try reproducing the issue on my end. I have