Hi, We tried running S3 garbage collection on Live environment with oak 1.22.3 version. Here the data in S3 is more than 2.5TB and blob ids are more than 20 million.
While running garbage collection we get following logs : Starting Blob garbage collection with markOnly [false] No content length specified for stream data. Stream contents will be buffered in memory and could result in out of memory errors. Blob garbage collection Mark completed in 10.77 min (646458 ms). And after this either it gets stuck and then there is connection lost to repository or it runs out of heap memory . Please help me to solve this issue. Thank you. From: Tanvi Shah Sent: 22 July 2020 12:10 To: '[email protected]' Subject: RE: S3 Garbage Collection Any update on this? From: Tanvi Shah Sent: 09 July 2020 16:18 To: '[email protected]' Subject: S3 Garbage Collection Hi, We have implemented the S3 garbage Collection with jackrabbit oak library as documentNodeStore.createBlobGarbageCollector( seconds, repository.toString(), wb, new DefaultStatisticsProvider(Executors.newScheduledThreadPool(1))). collectGarbage(markOnly); We wanted to know that will this have any impact on repository connection or on AWS S3 as the data we have on S3 is 2TB. Please let us know what is the impact and what precautions can we take for this action to be safe . Regards, Tanvi Shah Software Developer SpringerNature Technology and Publishing Solutions Tower 8 & 9, Magarpatta City SEZ, Hadapsar, Pune 411 013, Maharashtra, India T +91 20 7100 7061 [email protected]<mailto:[email protected]> www.springernature.com<http://www.springernature.com/> --- Springer Nature is one of the world's leading global research, educational and professional publishers, created in 2015 through the combination of Nature Publishing Group, Palgrave Macmillan, Macmillan Education and Springer Science+Business Media. ********************************************************************** Disclaimer: This e-mail is confidential and should not be used by anyone who is not the original intended recipient. If you have received this e-mail in error please inform the sender and delete it from your mailbox or any other storage mechanism. Springer Nature Technology and Publishing Solutions Private Limited does not accept liability for any statements made which are clearly the sender's own and not expressly made on behalf of Springer Nature Technology and Publishing Solutions Private Limited or one of their agents. Please note that Springer Nature Technology and Publishing Solutions Private Limited and their agents and affiliates do not accept any responsibility for viruses or malware that may be contained in this e-mail or its attachments and it is your responsibility to scan the e-mail and attachments (if any). Springer Nature Technology and Publishing Solutions Private Limited. Registered office: Upper Ground Floor, Wing B, Tower 8, Magarpatta City SEZ, Hadapsar Pune MH 411013 IN Registered number: U72200PN2006FTC128967
