Try run second data import or any other indexing jobs after the replication of the first data import is completed.
My observation is during the replication period (when there is docs in queue), tlog clean up will not triggered. So when queue is 0, and submit second batch and monitor the queue and tlogs again. -- Thank you Sean From: jmyatt <jmy...@wayfair.com<mailto:jmy...@wayfair.com>> Date: Wednesday, Jul 12, 2017, 6:58 PM To: solr-user@lucene.apache.org <solr-user@lucene.apache.org<mailto:solr-user@lucene.apache.org>> Subject: [EXTERNAL] Re: CDCR - how to deal with the transaction log files glad to hear you found your solution! I have been combing over this post and others on this discussion board many times and have tried so many tweaks to configuration, order of steps, etc, all with absolutely no success in getting the Source cluster tlogs to delete. So incredibly frustrating. If anyone has other pearls of wisdom I'd love some advice. Quick hits on what I've tried: - solrconfig exactly like Sean's (target and source respectively) expect no autoSoftCommit - I am also calling cdcr?action=DISABLEBUFFER (on source as well as on target) explicitly before starting since the config setting of defaultState=disabled doesn't seem to work - when I create the collection on source first, I get the warning "The log reader for target collection {collection name} is not initialised". When I reverse the order (create the collection on target first), no such warning - tlogs replicate as expected, hard commits on both target and source cause tlogs to rollover, etc - all of that works as expected - action=QUEUES on source reflects the queueSize accurately. Also *always* shows updateLogSynchronizer state as "stopped" - action=LASTPROCESSEDVERSION on both source and target always seems correct (I don't see the -1 that Sean mentioned). - I'm creating new collections every time and running full data imports that take 5-10 minutes. Again, all data replication, log rollover, and autocommit activity seems to work as expected, and logs on target are deleted. It's just those pesky source tlogs I can't get to delete. -- View this message in context: http://lucene.472066.n3.nabble.com/CDCR-how-to-deal-with-the-transaction-log-files-tp4345062p4345715.html Sent from the Solr - User mailing list archive at Nabble.com. Confidentiality Notice:: This email, including attachments, may include non-public, proprietary, confidential or legally privileged information. If you are not an intended recipient or an authorized agent of an intended recipient, you are hereby notified that any dissemination, distribution or copying of the information contained in or transmitted with this e-mail is unauthorized and strictly prohibited. If you have received this email in error, please notify the sender by replying to this message and permanently delete this e-mail, its attachments, and any copies of it immediately. You should not retain, copy or use this e-mail or any attachment for any purpose, nor disclose all or any part of the contents to any other person. Thank you.
