Hi Alvaro Thank you for responding! I did try lowering the batch commit but it doesn't appear to even get to the part where it starts processing records. I think it gets stuck on fetching the records.
Aleisha On 30/04/21 3:39 am, Alvaro Cornejo wrote: > Hi Aleisha > > Have you tried to lower the batch commit? > > see > https://perldoc.koha-community.org/misc/search_tools/rebuild_elasticsearch.html > <https://perldoc.koha-community.org/misc/search_tools/rebuild_elasticsearch.html> > > Regards, > > Alvaro > > > > |----------------------------------------------------------------------------------------| > Stay safe / Cuídate/ Reste sécurisé > */7/* Switch off as you go / Apaga lo que no usas / Débranchez au fur > et à mesure. > *q *Recycle always / Recicla siempre / Recyclez toujours > P Print only if absolutely necessary / Imprime solo si es necesario / > Imprimez seulement si nécessaire > > > Le mer. 28 avr. 2021 à 23:52, Aleisha Amohia <alei...@catalyst.net.nz > <mailto:alei...@catalyst.net.nz>> a écrit : > > Hi all, > > We have a site with around 600,000 authority records and have enabled > elasticsearch. Reindexing and searching has worked easily for biblios > (there are just over 10,000 biblios) but fails for authorities. > > $ sudo koha-elasticsearch --rebuild -d -a -v <instance> > [19024] Checking state of authorities index > [19024] Dropping and recreating authorities index > [19024] Indexing authorities > > And then it just hangs there for ages until the server runs out of > memory and dies. > > We're running ES 6.x on Koha 20.05.x. > > I tried running the script directly and specifying an authid and that > worked as expected. > > $ perl /usr/share/koha/bin/search_tools/rebuild_elasticsearch.pl > <http://rebuild_elasticsearch.pl> -a -d > -v -ai 2135575 > [17684] Checking state of authorities index > [17684] Dropping and recreating authorities index > [17684] Indexing authorities > [17684] Committing final records... > [17684] Total 1 records indexed > > It feels like this is happening because we have too many authority > records. Is there a way to fix this? Has anyone come across this > before? > > Thanks! > > -- > *Aleisha Amohia*(she/her) > _______________________________________________ > > Koha mailing list http://koha-community.org > <http://koha-community.org> > Koha@lists.katipo.co.nz <mailto:Koha@lists.katipo.co.nz> > Unsubscribe: https://lists.katipo.co.nz/mailman/listinfo/koha > <https://lists.katipo.co.nz/mailman/listinfo/koha> > -- *Aleisha Amohia*(she/her) Koha Developer Catalyst IT - Expert Open Source Solutions Mob: +64 21 024 04004 | Tel: +64 4 499 2267 | www.catalyst.net.nz <http://www.catalyst.net.nz> Catalyst Logo CONFIDENTIALITY NOTICE: This email is intended for the named recipients only. It may contain privileged, confidential or copyright information. If you are not the named recipient, any use, reliance upon, disclosure or copying of this email or its attachments is unauthorised. If you have received this email in error, please reply via email or call +64 4 499 2267. _______________________________________________ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz Unsubscribe: https://lists.katipo.co.nz/mailman/listinfo/koha