This is really an interesting problem but not sure if camel is the right technology. Have you explored using CDC and Kafka
Thanks Rajib Get Outlook for Android<https://aka.ms/ghei36> ________________________________ From: Michael Joyner <michaelwjoy...@gmail.com> Sent: Sunday, April 28, 2019 10:22:53 AM To: users@camel.apache.org Subject: Re: transfer data between 2 database without data lost in camel [**EXTERNAL EMAIL**] Maryam, Very interesting business problem. 2 questions. 1) On the source side, how do you know where to start as you left off around 15 minutes into sending messages into the queue. 2) After you get a message from the queue are you going to use Hibernate to go to the second database? On Sat, Apr 27, 2019 at 11:44 PM Maryam Eslahi <me.maryam.esl...@gmail.com> wrote: > Hi all, > > we want to transfer big amount of data from one mysql database(database1) > to a remote database(database2) by using camel. the local > database(database1) is isolated with the help of dmz, implemented by > firewall rules. firewall rule, open and close the connection port for every > 15 minutes.(the port is open for 15 minutes and will be close for next 15 > minutes.) I need to transfer my data from database1 into database2 in order > they have been received to database1 and without any data lost. (for > example msg1,msg2,msg3,...) > > I've tried using a activemq broker between two databases.and now the > firewall is between database1 and broker. but when connection is > interrupted for 15 minutes, some of my data will be lost. and I can not > recognize them from others. > > So my main problem is to transfer data from a database to another database > with camel. without any data lost and changing the order of messages in > that 15 min disconnecting condition. If there are some other suggestions > instead of using broker between databases or anything else, please let me > know. > > > any suggestions would be appreciated. > > > > -- > *Maryam Eslahi* > -- Sincerely, Michael Joyner
