[OPEN-ILS-GENERAL] Evergreen 3.0 development update #7

2017-05-26 Thread Galen Charlton
Hi,

The latest blog post is now available:

https://evergreen-ils.org/evergreen-3-0-development-update-7/

Regards,

Galen
-- 
Galen Charlton
Infrastructure and Added Services Manager
Equinox Open Library Initiative
phone:  1-877-OPEN-ILS (673-6457)
email:  g...@equinoxinitiative.org
web:  https://equinoxInitiative.org
direct: +1 770-709-5581
cell:   +1 404-984-4366


Re: [OPEN-ILS-GENERAL] Synonym Dictionary - Numbers,

2017-05-26 Thread Josh Stompro
Mike, thanks for the tips, I hadn't thought about stacking dictionaries, that 
works great.



I'm trying out using 4 dictionaries in two config groups now.



Group 1 - 1 - Normal text synonyms (Roman numeral to text)

Group 1 - 2 - INT to text

Group 2 - 3 - Roman Numeral Int to text

Gropu 2 - 4 - Roman Numeral text to Int



So if the cataloger enters

- "Scary Movie 5" it is indexed with "V" and "Five"

- "Scary Movie V" it is indexed with "5" and "Five"

- "Scary Movie Five" it is indexed with "5" and "V"



This could really cut down on the need to add variations of the title (246) 
tags.



Now I need to see what I can do about hyphenated numbers.  We have about 500 
titles like "A history of America in thirty-six postage stamps".  The above 
setup adds "30","6","xxx","vi" to the index since thirty-six is treated as two 
separate words.  I don't know if that is going to be a problem yet in real life 
usage.  And while it is possible to have a synonym dictionary with 36 -> 
thirty-six, it doesn't work because I believe the search subsystem would never 
send "thirty-six", it will break it up into two words.


For your suggestion about handling & and other special characters there is one 
thing that I don't understand.  Would the normalizer translate & into ☃,and 
then the synonym dictionary would map ☃ to & along with ☃ to ‘and’ ?  Or would 
this method not be using the synonym dictionaries at all?



Josh Stompro - LARL IT Director





-Original Message-
From: Open-ils-general 
[mailto:open-ils-general-boun...@list.georgialibraries.org] On Behalf Of Mike 
Rylander
Sent: Thursday, May 25, 2017 11:19 AM
To: Evergreen Discussion Group
Subject: Re: [OPEN-ILS-GENERAL] Synonym Dictionary - Numbers, &



Josh,



To cover numbers, it looks like you just need to add dictionaries (I probably 
wouldn't use just one for everything) for uint, etc.  Note, you can stack 
dictionaries.



As for & (along with |, !, and maybe parens), it may be best to simply map 
those to some well-known token in search_normalize() that's very unlikely to be 
used in the real world.  Perhaps some unicode codepoint, like ☃ and friends.  
Those are special characters used by tsearch itself.



HTH,

--

Mike Rylander

| President

| Equinox Open Library Initiative

| phone:  1-877-OPEN-ILS (673-6457)

| email:  mi...@equinoxinitiative.org

| web:  http://equinoxinitiative.org





On Thu, May 25, 2017 at 11:05 AM, Josh Stompro 
> wrote:

> Hello, I’ve followed the steps in the following wiki pages to enable a

> synonym dictionary but I’m not getting the results I expect.

>

>

>

> https://wiki.evergreen-ils.org/doku.php?id=scratchpad:brush_up_search#

> synonym_dictionary

>

>

>

> Spelled out numbers do get translated to digits (six -> 6) but digits

> don’t get translated ( 6 -> six).

>

>

>

> When I test the synonym dictionary with something like the following

> it looks like it works:

>

> select ts_lexize('synonym_larl', '6');

>

> ts_lexize

>

> ---

>

> {six}

>

> (1 row)

>

>

>

> But when I look at the the metabib.title_field_entry for a record that

> has been reindexed I see the following.

>

> select * from metabib.title_field_entry where source=102449 limit 100;

>

>id| source | field |  value

> |

> index_vector

>

> -++---+--+-

>

> 2402931 | 102449 | 6 | Little house on the prairie Season 6 [disc 2]

> test seven | '2':9A,13C,20C '6':7A,12C,18C '7':14C 'disc':8A,19C

> 'hous':13C 'house':2A 'littl':12C 'little':1A 'on':3A,14C 'prairi':16C

> 'prairie':5A 'season':6A,17C 'seven':11A,22C 'test':10A,21C

> 'the':4A,15C

>

>

>

> Seven gets added as ‘seven’ and ‘7’, but the ‘2’ and ‘6’ do not.

>

>

>

> So I’m wondering if the search configuration needs to cover numeric

> tokens to make that work?

>

>

>

> select * from ts_debug('synonym_larl', '6');

>

> alias |   description| token | dictionaries | dictionary | lexemes

>

> ---+--+---+--++---

> ---+--+---+--++--

>

> uint  | Unsigned integer | 6 | {simple} | simple | {6}

>

>

>

> \dF+ synonym_larl;

>

> Text search configuration "public.synonym_larl"

>

> Parser: "pg_catalog.default"

>

>   Token  | Dictionaries

>

> -+--

>

> asciihword  | synonym_larl

>

> asciiword   | synonym_larl

>

> email   | simple

>

> file| simple

>

> float   | simple

>

> host| simple

>

> hword   | simple

>

> 

Re: [OPEN-ILS-GENERAL] Notifying faculty about new books in their discipline

2017-05-26 Thread Jane Sandberg
It could, theoretically.  Its flaw right now, though, is that the
process of adding/removing email recipients is pretty manual and
tedious.  Perhaps somebody else who is familiar with Python could take
my code as a starting place, and build an interface that made it
simple to manage hundreds of patrons efficiently.

On Fri, May 26, 2017 at 9:07 AM, Diane Disbro
 wrote:
> This sounds great! Could it be adapted to pull author information and send 
> notices to hundreds of patrons?
>
> Diane Disbro
> Circulation Coordinator/Branch Manager
> Union Branch
> Scenic Regional Library
> 308 Hawthorne Drive
> Union, MO 63084
> 636-583-3224
> ddis...@scenicregional.org
> www.scenicregional.org
>
>
>
> -Original Message-
> From: Open-ils-general 
> [mailto:open-ils-general-boun...@list.georgialibraries.org] On Behalf Of Jane 
> Sandberg
> Sent: Friday, May 26, 2017 9:01 AM
> To: Evergreen Discussion Group
> Subject: [OPEN-ILS-GENERAL] Notifying faculty about new books in their 
> discipline
>
> Hi Evergreeners,
>
> Our Library sends monthly emails to our faculty that feature recently 
> acquired books that might be of interest to them.  This is a nice, automated 
> process that pulls data from Evergreen and then uses call number ranges that 
> we've defined to match books with departments.  The emails include cover 
> images and links to place holds, and we're pretty proud of this system.
>
> We've got our code up on GitHub: 
> https://github.com/sandbergja/faculty_notifier
>
> I'm very happy to share more details if you're interested.
>
>-Jane
>
> --
> Jane Sandberg
> Electronic Resources Librarian
> Linn-Benton Community College
> sand...@linnbenton.edu / 541-917-4655
> Pronouns: she/her/hers or they/them/theirs
>



-- 
Jane Sandberg
Electronic Resources Librarian
Linn-Benton Community College
sand...@linnbenton.edu / 541-917-4655
Pronouns: she/her/hers or they/them/theirs


[OPEN-ILS-GENERAL] Notifying faculty about new books in their discipline

2017-05-26 Thread Jane Sandberg
Hi Evergreeners,

Our Library sends monthly emails to our faculty that feature recently
acquired books that might be of interest to them.  This is a nice,
automated process that pulls data from Evergreen and then uses call
number ranges that we've defined to match books with departments.  The
emails include cover images and links to place holds, and we're pretty
proud of this system.

We've got our code up on GitHub: https://github.com/sandbergja/faculty_notifier

I'm very happy to share more details if you're interested.

   -Jane

-- 
Jane Sandberg
Electronic Resources Librarian
Linn-Benton Community College
sand...@linnbenton.edu / 541-917-4655
Pronouns: she/her/hers or they/them/theirs