Hi, The performance impact is governed less by the size of the data store (aws bucket size) but more on the size of the repository and on the number of blobs. The performance impact of it running should be minimal. DataStore garbage collection (DSGC) has 2 phases and the mark phase where it has to collect all the references from the node store could impact performance a little when it's running but should not by much. The second phase when it collects all the blob ids from S3 will not impact the node store and only lists the ids and sends deletion requests.
Nevertheless, DSGC is also enabled with the `datastore` command option of the oak-run cli and can also be run out of process and is documented at [1]. Thanks Amit [1] https://github.com/apache/jackrabbit-oak/tree/trunk/oak-run On Wed, Jul 22, 2020 at 6:34 PM Tanvi Shah <[email protected]> wrote: > Any update on this? > > From: Tanvi Shah > Sent: 09 July 2020 16:18 > To: '[email protected]' > Subject: S3 Garbage Collection > > Hi, > We have implemented the S3 garbage Collection with jackrabbit oak library > as > documentNodeStore.createBlobGarbageCollector( seconds, > repository.toString(), > wb, > new > DefaultStatisticsProvider(Executors.newScheduledThreadPool(1))). > collectGarbage(markOnly); > > We wanted to know that will this have any impact on repository connection > or on AWS S3 as the data we have on S3 is 2TB. > Please let us know what is the impact and what precautions can we take for > this action to be safe . > > > Regards, > > Tanvi Shah > Software Developer > SpringerNature Technology and Publishing Solutions > Tower 8 & 9, Magarpatta City SEZ, Hadapsar, Pune 411 013, Maharashtra, > India > T +91 20 7100 7061 > [email protected]<mailto:[email protected]> > www.springernature.com<http://www.springernature.com/> > --- > Springer Nature is one of the world's leading global research, educational > and professional publishers, created in 2015 through the combination of > Nature Publishing Group, > Palgrave Macmillan, Macmillan Education and Springer Science+Business > Media. > > ********************************************************************** > Disclaimer: This e-mail is confidential and should not be used by anyone > who is not the original intended recipient. If you have received this > e-mail in error please inform the sender and delete it from your mailbox or > any other storage mechanism. Springer Nature Technology and Publishing > Solutions Private Limited does not accept liability for any statements made > which are clearly the sender's own and not expressly made on behalf of > Springer Nature Technology and Publishing Solutions Private Limited or one > of their agents. > Please note that Springer Nature Technology and Publishing Solutions > Private Limited and their agents and affiliates do not accept any > responsibility for viruses or malware that may be contained in this e-mail > or its attachments and it is your responsibility to scan the e-mail and > attachments (if any). > Springer Nature Technology and Publishing Solutions Private Limited. > Registered office: Upper Ground Floor, Wing B, Tower 8, Magarpatta City > SEZ, Hadapsar Pune MH 411013 IN > Registered number: U72200PN2006FTC128967 >
