[Koha] OAI-PMH missing code in Repository.pm ?
Hi, The code that 'prints' the html code to the browser seems to be missing from the new sub in Repository.pm or where it is created in oai.pl. There was an update in the HTTP::OAI classes on cpanm that cause koha runtime errors when harvesters try to access oai. The required info is collected in the response variable but it does not get back to the harvester or browser. I am accessing oai via: https://my_koha_url/cgi-bin/koha/oai.pl?verb=Identify Is oai no longer supported or am I missing something. There is very little info in the documentation about how for example to access it from a harvester. Best Regards, David ___ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz https://lists.katipo.co.nz/mailman/listinfo/koha
[Koha] Is zebra server needed when using Elastic Search with 17.11-02 ?
Hi, Starting from version 17.11-02 we have made extensive changes to koha to get elastic search working in koha. We don't run the zebra server but we see an error in the about box saying that it is not running. Everything seems to work but we are wondering what functions need zebra even though we only use ES ? Best Regards, Dave ___ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz https://lists.katipo.co.nz/mailman/listinfo/koha
[Koha] Getting Elastic search 5.X working with authority searching and presentation in the Koha staff intranet
Hi, We would like to see this feature working. Do we just report what is not working in Bugzilla and submit patches for the items or is their some kind of coordination with other people that we need to take into account ? Is there a plan or roadmap for elastic search work or do we just do what we want ? Is this the right mailing group for this question ? Best Regards, Dave ___ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz https://lists.katipo.co.nz/mailman/listinfo/koha
Re: [Koha] How are authority records connected with biblio records ?
Hi , Thanks for your answer Chris. Is there some kind of plan / road map to get it working or should I just go ahead and try to fix it in a side branch of my own ? Is anyone coordinating the work for this ? Best Regards, Dave On 08/03/2017 10:42 PM, Chris Cormack wrote: * David Holoshka (david.holos...@ub.lu.se) wrote: Hi, I am migrating several million records from an existing vtls system to koha. We are using mariadb, koha 17.05 (have pulled from master yesterday ), elastic search 5.4 and plack on debian systems. As I wanted to preserve all the authority to biblio record links I wrote my own migration script based on the relevant koha source. Hi David Did you really mean master, or did you pull from the 17.05.x branch? If you meant master you aren't running 17.05 but the unreleased code that will be 17.11.0 eventually. The ES authority support is still a work in progress. Chris Searching in the koha authorities intra will find the authority record but usually lists the number of biblio records having the auth as zero, but not always. If I check the biblio index in ES the items have the correct auth id in the "an" field. I can find no difference between the biblio records in the ES index that are reported as linked to the auth record to the ones that are not. I connect the biblio recs to the authorities in the marc21 structure by putting the koha auth id in field 100 sub field 9 (if it is a name auth). These marc records are now in the new biblio_metadata table. How does koha find the biblio records connected to a paticular auth record ? Is this done dynamically by searching the ES indexes ? Is this an issue with the zebra database? Is it still required ? I haven't been loading data into it since we switched to ES. Best Regards, Dave ___ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz https://lists.katipo.co.nz/mailman/listinfo/koha ___ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz https://lists.katipo.co.nz/mailman/listinfo/koha
Re: [Koha] How are authority records connected with biblio records ?
Hi Micheal, I originally tried the script link_bibs_to_authorities.pl but there were two issues with it: 1. After running for days it would use up all available memory and stop working 2. It does not preserve the links we have today between auths and biblios but does its best to connect records based on various pattern matching algorithms. Best Regards, Dave On 08/09/2017 02:59 PM, Michael Kuhn wrote: Hi David I am migrating several million records from an existing vtls system to koha. We are using mariadb, koha 17.05 (have pulled from master yesterday ), elastic search 5.4 and plack on debian systems. As I wanted to preserve all the authority to biblio record links I wrote my own migration script based on the relevant koha source. Searching in the koha authorities intra will find the authority record but usually lists the number of biblio records having the auth as zero, but not always. If I check the biblio index in ES the items have the correct auth id in the "an" field. I can find no difference between the biblio records in the ES index that are reported as linked to the auth record to the ones that are not. I connect the biblio recs to the authorities in the marc21 structure by putting the koha auth id in field 100 sub field 9 (if it is a name auth). These marc records are now in the new biblio_metadata table. How does koha find the biblio records connected to a paticular auth record ? Is this done dynamically by searching the ES indexes ? Is this an issue with the zebra database? Is it still required ? I haven't been loading data into it since we switched to ES. I don't really know about the differences between Zebra and Elasticsearch. Also I don't know how you're exactly massaging your data, of course. However, using Zebra it is necessary to use Perl script "link_bibs_to_authorities.pl" to check each bibliographic record in the Koha database and attempting to link each of its headings to the matching authority record. The script is also able to do a test run. Also note the system preferences in Koha menu "Administration > authorities" as well as "IncludeSeeFromInSearches". Hope this helps. Someone may correct me if I'm wrong. Best wishes: Michael ___ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz https://lists.katipo.co.nz/mailman/listinfo/koha
[Koha] How are authority records connected with biblio records ?
Hi, I am migrating several million records from an existing vtls system to koha. We are using mariadb, koha 17.05 (have pulled from master yesterday ), elastic search 5.4 and plack on debian systems. As I wanted to preserve all the authority to biblio record links I wrote my own migration script based on the relevant koha source. Searching in the koha authorities intra will find the authority record but usually lists the number of biblio records having the auth as zero, but not always. If I check the biblio index in ES the items have the correct auth id in the "an" field. I can find no difference between the biblio records in the ES index that are reported as linked to the auth record to the ones that are not. I connect the biblio recs to the authorities in the marc21 structure by putting the koha auth id in field 100 sub field 9 (if it is a name auth). These marc records are now in the new biblio_metadata table. How does koha find the biblio records connected to a paticular auth record ? Is this done dynamically by searching the ES indexes ? Is this an issue with the zebra database? Is it still required ? I haven't been loading data into it since we switched to ES. Best Regards, Dave ___ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz https://lists.katipo.co.nz/mailman/listinfo/koha
Re: [Koha] when will koha master work with elastic search 5.X
Hi, Thank you for your prompt replies. We have tried reseting the mappings (yesterday was the 2nd time we tried) and rebuilt the ES indexes with similar results. Now that I know that koha should work with ES 5 I can re check our configuration. We have been using stuff from the koha unstable main and the koha nightly as per instructions: https://wiki.koha-community.org/wiki/Elasticsearch . I will try to rebuild the indexes with out using these repositories as I see that apt-get complains of some dependency issues. Our system is: Debian, Koha cloned from master into /usr/local/koha using git Mysql ES 5.3 (it seems to be working fine) on oracle java 8 ( I could not find the open jdk 8 on the debian package list). Marc 21 All perl catmandu modules are the latest from cpanm. Best Regards, Dave On 05/16/2017 03:13 PM, Tomas Cohen Arazi wrote: Dave, you can reset your mappings using /cgi-bin/koha/admin/searchengine/elasticsearch/mappings.pl?op=reset_know_what_i_am_doing=1 <http://mappings.pl?op=reset_know_what_i_am_doing=1> Regards El mar., 16 may. 2017 a las 10:09, Nick Clemens (<n...@bywatersolutions.com <mailto:n...@bywatersolutions.com>>) escribió: Hi Dave, Echoing what Tomas said you should find things working on master. If you are having issues please report them here, or better yet, file a bug in the community so that we can investigate and/or fix the issue. It is important to make sure your mappings are updated to the latest version as well to ensure things will work. Sorting will break on indexes where sorting is not defined, but should work for common categories. Can you share some of the warnings you are seeing as well as some info about your environment? i.e. type of Koha install (assuming dev instal) MARC21/UNIMARC, OS, Catmandu/ES dependency versions? -Nick On Tue, May 16, 2017 at 8:54 AM David Holoshka <david.holos...@ub.lu.se <mailto:david.holos...@ub.lu.se>> wrote: > Nau Mai, > > I am working with migrating an vtls ILS to koha for a uni library. > Mostly I have been recoding and optimizing some old bywater scripts and > some koha import utilities to import our 3.2 M+ holdings into koha. > > We are trying to run koha master with elastic search due to performance > issues with zebra. Our initial impression was that koha worked with ES > 5.X so we installed 5.3, but we can not get it to work at all with > authorities. The indexing processes generates a 7 Gbyte file filled > with warnings and several key fields in elastic search contain nulls. > It is possible to perform some searches on the biblio index if the sort > is turned off, but it does not seem to work fully either. > > We have been studying bugzilla to try and figure out what is supposed to > work. I have tried to apply several new patches to koha ES with out > seeing any improvement. > > My questions are : > > 1/ Can koha be made to work with elastic search 5.X ? > > 2/ If not are when will Koha work with ES 5.x ? > > 3/ Does some version of Koha work with an older version of ES ? > > Best Regards, > > Dave > > ___ > Koha mailing list http://koha-community.org > Koha@lists.katipo.co.nz <mailto:Koha@lists.katipo.co.nz> > https://lists.katipo.co.nz/mailman/listinfo/koha > ___ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz <mailto:Koha@lists.katipo.co.nz> https://lists.katipo.co.nz/mailman/listinfo/koha -- Tomás Cohen Arazi Theke Solutions (https://theke.io <http://theke.io/>) ✆ +54 9351 3513384 GPG: B2F3C15F ___ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz https://lists.katipo.co.nz/mailman/listinfo/koha
[Koha] when will koha master work with elastic search 5.X
Nau Mai, I am working with migrating an vtls ILS to koha for a uni library. Mostly I have been recoding and optimizing some old bywater scripts and some koha import utilities to import our 3.2 M+ holdings into koha. We are trying to run koha master with elastic search due to performance issues with zebra. Our initial impression was that koha worked with ES 5.X so we installed 5.3, but we can not get it to work at all with authorities. The indexing processes generates a 7 Gbyte file filled with warnings and several key fields in elastic search contain nulls. It is possible to perform some searches on the biblio index if the sort is turned off, but it does not seem to work fully either. We have been studying bugzilla to try and figure out what is supposed to work. I have tried to apply several new patches to koha ES with out seeing any improvement. My questions are : 1/ Can koha be made to work with elastic search 5.X ? 2/ If not are when will Koha work with ES 5.x ? 3/ Does some version of Koha work with an older version of ES ? Best Regards, Dave ___ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz https://lists.katipo.co.nz/mailman/listinfo/koha
