Hm, this does sound like a problem, I may not have noticed it myself as I typically do put in Context commits within my performItem() implementation anyway. Could it be as simple as doing a commit after calling performObject in distribute(), and maybe decaching the dso at the end of distribute()?
It would mean a lot of unnecessary commits, though (for objects that didn't actually have changes made) 0CCB D957 0C35 F5C1 497E CDCF FC4B ABA3 2A1A FAEC <http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail> Virus-free. www.avg.com <http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2> On Sat, 12 Feb 2022 at 08:13, Mark H. Wood <mwoodiu...@gmail.com> wrote: > The other day I had reason to run a curation task over our entire > repository. It found a large number of Items that needed > modification, and I watched as it got slower...and slower...and > s l o w e r ... until it ran out of memory and crashed, leaving no work > completed. I got a list of the Collections to be affected, and ran > the curator over each one separately, and the job was (eventually) > completed. > > It seems to me that the proper unit of work for a curation run is not > the whole set of affected objects, but the task. We should be > committing work each time a task returns. I would expect that a > well-designed task can be re-run in the same scope without causing > problems. > > Comments? > > -- > Mark H. Wood > Lead Technology Analyst > > University Library > Indiana University - Purdue University Indianapolis > 755 W. Michigan Street > Indianapolis, IN 46202 > 317-274-0749 > www.ulib.iupui.edu > > -- > All messages to this mailing list should adhere to the Code of Conduct: > https://www.lyrasis.org/about/Pages/Code-of-Conduct.aspx > --- > You received this message because you are subscribed to the Google Groups > "DSpace Developers" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to dspace-devel+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/dspace-devel/Yga1QDfIQ%2B0%2BFe5m%40IUPUI.Edu > . > -- All messages to this mailing list should adhere to the Code of Conduct: https://www.lyrasis.org/about/Pages/Code-of-Conduct.aspx --- You received this message because you are subscribed to the Google Groups "DSpace Developers" group. To unsubscribe from this group and stop receiving emails from it, send an email to dspace-devel+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/dspace-devel/CAKZKfqpe2CX%2BpuWRto-viosUdxKigX8GuQvw-8qr9fm8zK2WLA%40mail.gmail.com.
