Why it’s enabled by default: Really it shouldn’t be. Raise a JIRA? Why it’s there in the first place: It’s a leftover from before there was the “full sync” capability so you could intentionally queue up the updates while performing maintenance on the target cluster.
Not great reasons, but…. > On Oct 23, 2019, at 1:41 PM, Webster Homer <webster.ho...@milliporesigma.com> > wrote: > > Tlogs will accumulate if you have buffers "enabled". Make sure that you > explicitly disable buffering from the cdcr endpoint > https://lucene.apache.org/solr/guide/7_7/cdcr-api.html#disablebuffer > Make sure that they're disabled on both the source and targets > > I believe that sometimes buffers get enabled on their own. We added > monitoring of CDCR to check for the buffer setting > This endpoint shows you the status > https://lucene.apache.org/solr/guide/7_7/cdcr-api.html#cdcr-status-example > > I don't understand the use case for enabling buffers, or why it is enabled > by default. > > -----Original Message----- > From: Erick Erickson <erickerick...@gmail.com> > Sent: Wednesday, October 23, 2019 7:23 AM > To: solr-user@lucene.apache.org > Subject: Re: tlogs are not deleted > > My first guess is that your CDCR setup isn’t running. CDCR uses tlogs as a > queueing mechanism. If CDCR can’t send docs to the target collection, they’ll > accumulate forever. > > Best, > Erick > >> On Oct 22, 2019, at 7:48 PM, Woo Choi <richkingmyst...@gmail.com> wrote: >> >> Hi, >> >> We are using solr 7.7 cloud with CDCR(every collection has 3 replicas, >> 1 shard). >> >> In solrconfig.xml, >> >> tlog configuration is super simple like : <updateLog/> >> >> There is also daily data import and commit is called after data import >> every time. >> >> Indexing works fine, but the problem is that the number of tlogs keeps >> growing. >> >> According to the documentation >> here(https://lucene.apache.org/solr/guide/6_6/updatehandlers-in-solrco >> nfig.html), I expected tlog will remain as many as 10(default value of >> maxNumLogsToKeep=10). >> >> However I still have a bunch of tlogs - the oldest one is Sep 6..! >> >> I did an experiment by running data import with commit option from >> solr admin ui, but any of tlogs were not deleted. >> >> tlog.0000000000000000002.1643995079881261056 >> tlog.0000000000000000018.1645444642733293568 >> tlog.0000000000000000034.1646803619099443200 >> tlog.0000000000000000003.1644085718240198656 >> tlog.0000000000000000019.1645535304072822784 >> tlog.0000000000000000035.1646894195509559296 >> tlog.0000000000000000004.1644176284537847808 >> tlog.0000000000000000020.1645625651261079552 >> tlog.0000000000000000036.1646984623121498112 >> tlog.0000000000000000005.1644357373324689408 >> tlog.0000000000000000021.1645625651316654083 >> tlog.0000000000000000037.1647076244416626688 >> tlog.0000000000000000006.1644447899616018432 >> tlog.0000000000000000022.1645716477747134464 >> tlog.0000000000000000038.1647165801017376768 >> tlog.0000000000000000007.1644538486210953216 >> tlog.0000000000000000023.1645806853961023488 >> tlog.0000000000000000039.1647165801042542594 >> tlog.0000000000000000008.1644629084296183808 >> tlog.0000000000000000024.1645897663703416832 >> tlog.0000000000000000040.1647256590865137664 >> tlog.0000000000000000009.1644719895268556800 >> tlog.0000000000000000025.1645988248838733824 >> tlog.0000000000000000041.1647347172490870784 >> tlog.0000000000000000010.1644810493331767296 >> tlog.0000000000000000026.1646078905702940672 >> tlog.0000000000000000042.1647437758859313152 >> tlog.0000000000000000011.1644901113324896256 >> tlog.0000000000000000027.1646169478772293632 >> tlog.0000000000000000043.1647528345005457408 >> tlog.0000000000000000012.1645031030684385280 >> tlog.0000000000000000028.1646259838395613184 >> tlog.0000000000000000044.1647618793025830912 >> tlog.0000000000000000013.1645031030777708545 >> tlog.0000000000000000029.1646350429145006080 >> tlog.0000000000000000045.1647709579019026432 >> tlog.0000000000000000014.1645082080252526592 >> tlog.0000000000000000030.1646441456502571008 >> tlog.0000000000000000046.1647890587519549440 >> tlog.0000000000000000015.1645172929206419456 >> tlog.0000000000000000031.1646531802044563456 >> tlog.0000000000000000047.1647981403286011904 >> tlog.0000000000000000016.1645263488829882368 >> tlog.0000000000000000032.1646622220615680000 >> tlog.0000000000000000048.1648071989042085888 >> tlog.0000000000000000017.1645353861842468864 >> tlog.0000000000000000033.1646712822719053824 >> tlog.0000000000000000049.1648135546466205696 >> >> Did I miss something in the solrconfig file? >> >> >> >> -- >> Sent from: https://lucene.472066.n3.nabble.com/Solr-User-f472068.html > > This message and any attachment are confidential and may be privileged or > otherwise protected from disclosure. If you are not the intended recipient, > you must not copy this message or attachment or disclose the contents to any > other person. If you have received this transmission in error, please notify > the sender immediately and delete the message and any attachment from your > system. Merck KGaA, Darmstadt, Germany and any of its subsidiaries do not > accept liability for any omissions or errors in this message which may arise > as a result of E-Mail-transmission or for damages resulting from any > unauthorized changes of the content of this message and any attachment > thereto. Merck KGaA, Darmstadt, Germany and any of its subsidiaries do not > guarantee that this message is free of viruses and does not accept liability > for any damages caused by any virus transmitted therewith. Click > http://www.merckgroup.com/disclaimer to access the German, French, Spanish > and Portuguese versions of this disclaimer.
