Re: PutDataBaseRecord performance issues.

2019-10-15 Thread Matt Burgess
Lei, What are your MergeRecord settings? Unfortunately since CaptureChangeMySQL was developed before the Record API was available, the processor emits one flow file per event. This can certainly cause performance issues at PutDatabaseRecord. This may be the first time I've suggested this :) but yo

PutDataBaseRecord performance issues.

2019-10-15 Thread wangl...@geekplus.com.cn
I am using CaptureChangeMySQL to extract bin log and do some transformations and then write to another database using PutDataBaseRecord. Now the PutDataBaseRecord processor is a performance bottleneck If i set the PutDataBaseRecord processor concurrency lager than 1, there will be ordering