Hi,

I have been trying to resolve the Z39.50 encoding mystery and two more questions have emerged in the process:

1) What actually happens in Evergreen when one submits a yaz query like find matoušek (via Z39.50)?

From config.index_normalizer (and also from http://wiki.evergreen-ils.org/doku.php?id=documentation:indexing) it is clear that during indexing diacritics are thrown away (Strip Diacritics - Convert text to NFD form and remove non-spacing combining marks.). I would then assume that similar normalization would be performed on OPAC (or staff client) queries to make sure strings from indexes and from queries have a chance to meet. Is it also the case of Z39.50 queries?

2) How does this process differ from what happens when one searches a specific field (or index), such as author or title?

Apart from our (Jabok) catalog I have also tried to send a query to Laurentian Univesity catalog (using access information from http://irspy.indexdata.com/ap.html?id=Z39.50:laurentian.concat.ca:210/OSUL&set=bib-1). It works okay when no search fields such as author or title are specified but when they are, it only works okay for queries without diacritics:

Z> open laurentian.concat.ca:210/OSUL
Connecting...OK.
Sent initrequest.
Connection accepted by v3 target.
ID     : 81/81
Name   : Simple2ZOOM Universal Gateway/GFS/YAZ
Version: 1.04/5.15.2 738b345708b245e67cded6d917393a80b5bd4eca
Options: search present delSet triggerResourceCtrl scan sort namedResultSets
Elapsed: 0.990590
Z> find @attr 1=21 francais
Sent searchRequest.
Received SearchResponse.
Search was a success.
Number of hits: 7879, setno 1
records returned: 0
Elapsed: 7.993394
Z> find @attr 1=21 français
Sent searchRequest.
Received SearchResponse.
Search was a success.
Number of hits: 0, setno 2
records returned: 0
Elapsed: 1.658774

So it is not probably just our issue...

Linda

On 24.2.2016 07:50, Linda Jansova wrote:

Hi,

We have still haven't sorted out our Z39.50 server encoding issues but hopefully have made some steps which may help us locate and solve the problem. (We currently work with Evergreen 2.8.3.)

Problem summary:

When querying our Z39.50 server (mojzis.jabok.cuni.cz:9999/Jabok) via yaz, query find matoušek works okay, so does query find @attr 1=1016 Matousek. But with find @attr 1=1016 Matoušek zero number of hits is returned.

When searching directly via SRU (in our case http://mojzis.jabok.cuni.cz/opac/extras/sru) all queries (with the exception of find dc.creator=matoušek) seem to work okay, e.g. find eg.author=matoušek reports 32 hits.

A more detailed view:

We have been digging into this for quite some time now (our previous posts are available at https://www.mail-archive.com/open-ils-general@list.georgialibraries.org/msg11117.html and<https://www.mail-archive.com/open-ils-general%40list.georgialibraries.org/msg11442.html>https://www.mail-archive.com/open-ils-general%40list.georgialibraries.org/msg11442.html).

We have also tried to get in touch with the yaz community (http://lists.indexdata.dk/pipermail/yazlist/2016-February/004159.html). They have advised us to have a look at the indexes.

We have had a look at the config.z3950_index_field_map. It looks like this in our installation:

id | label | metabib_field | record_attr | z3950_attr | z3950_attr_type

----+-----------+---------------+-------------+------------+-----------------

1 | Title | 5 | | | title

2 | Author | 8 | | | author

3 | ISBN | 18 | | | isbn

4 | ISSN | 19 | | | issn

5 | LCCN | 30 | | | lccn

6 | Pubdate | | pubdate | | pubdate

7 | Item Type | | item_type | | item_type

(7 rows)

But we are not sure whether it is a configuration related to Evergreen Z39.50 server or to Evergreen Z39.50 client. If it is a server configuration, is everything included or are some data missing?

Our current dgo.conf looks like this:

<client>

<database name="Jabok">

<zurl>http://mojzis.jabok.cuni.cz/opac/extras/sru</zurl>

<option name="sru">get</option>

<charset>utf-8</charset>

<search>

<querytype>cql</querytype>

<map use="4"><index>eg.title</index></map>

<map use="7"><index>eg.keyword</index></map>

<map use="8"><index>eg.keyword</index></map>

<map use="21"><index>eg.subject</index></map>

<map use="1003"><index>eg.author</index></map>

<map use="1018"><index>eg.publisher</index></map>

<map use="1035"><index>eg.keyword</index></map>

<map use="1016"><index>eg.keyword</index></map>

</search>

</database>

</client>

But where are the indexes actually defined? Is it in the config.metabib_field table?
(Our current config.metabib_field table is attached to this message.)

Any hints that could help us have our Z39.50 server work as expected are more than welcome!

Thank you in advance!

Linda


Reply via email to