Re: [CODE4LIB] internet archive experiment -- bad metadata

[Barnett, Jeffrey]

How common is the kind of meta data mismatch* associated with this record?
http://openlibrary.org/books/OL23383343M/Cisco_Networking_Academy_Program
What is the point of contact for making corrections?

*The metadata is about Unix (2004), the Book is about Ben Franklin (1908)
"Contributed by Google"

-Original Message-
From: Code for Libraries [mailto:code4...@listserv.nd.edu] On Behalf Of Eric 
Lease Morgan
Sent: Friday, May 14, 2010 2:05 PM
To: CODE4LIB@LISTSERV.ND.EDU
Subject: [CODE4LIB] internet archive experiment

We are doing a tiny experiment here at Notre Dame with the Internet Archive, 
specifically, we are determining whether or not we can supplement a special 
collection with full text content.

We are hosting at site colloquially called the Catholic Portal -- a collection 
of rare, infrequently held, and uncommon materials of a Catholic nature. [1] 
Much of the content of the Portal is metadata -- MARC and EAD records/files. I 
think the Portal would be more useful if it contained full text content. If it 
did, then indexing would be improved and services against the texts could be 
implemented.

How can we get full text content? This is what we are going to try:

  1. parse out identifying information from
 metadata (author names, titles, dates,
 etc.)

  2. construct a URL in the form of a
 Advanced Search query and send it to the
 Archive

  3. get back a list of matches in an XML
 format

  4. parse the result looking for the "best"
 matches

  5. save Internet Archive keys identifying
 full text items

  6. mirror Internet Archive content locally
 using keys as pointers

  7. update local metadata files pointing to
 Archive content as well as locally
 mirrored content

  8. re-index local metadata

If we are (somewhat) successful, then search results would not only have 
pointers to the physical items, but they would also have pointers to the 
digitized items. Not only could they have pointers to the digitized items, but 
they could also have pointers to "services against the texts" such as make word 
cloud, display concordance, plot word/phrase frequency, etc. These later 
services are spaces where I think there is great potential for librarianship.

Frankly, because of the Portal's collection policy, I don't expect to find very 
much material. On the other hand, the same process could be applied to more 
generic library collections where more content may have already been digitized. 

Wish us luck.

[1] Catholic Portal - http://www.catholicresearch.net/
[2] Advanced search - http://www.archive.org/advancedsearch.php

-- 
Eric Lease Morgan
University of Notre Dame

Re: [CODE4LIB] Approaches to "Did You Mean" Query Spelling Suggestions

[Barnett, Jeffrey]

And others disagree... (but all use Solr)

-Original Message-
From: Code for Libraries [mailto:code4...@listserv.nd.edu] On Behalf Of Brad 
Dewar
Sent: Friday, April 30, 2010 5:18 PM
To: CODE4LIB@LISTSERV.ND.EDU
Subject: Re: [CODE4LIB] Approaches to "Did You Mean" Query Spelling Suggestions

Seconded.  We use Solr's SpellCheckComponent to accomplish exactly this.

Brad Dewar
bde...@stfx.ca



-Original Message-
From: Code for Libraries [mailto:code4...@listserv.nd.edu] On Behalf Of Genny 
Engel
Sent: April-30-10 6:00 PM
To: CODE4LIB@LISTSERV.ND.EDU
Subject: Re: [CODE4LIB] Approaches to "Did You Mean" Query Spelling Suggestions

I am not a fan of services that give spelling suggestions based on their own 
web-wide universe of terms.  It's better to suggest only terms that are 
actually found within the smaller universe of your own materials.  That way the 
user isn't offered a link that's guaranteed to get them zero results.  However, 
this only works if you're actually indexing the contents of all your sources 
into a local index -- not if you're dynamically retrieving the results from 
different sources.

I don't have personal experience with any of the options you list, but from 
briefly looking at them, I would be inclined toward Aspell since you'd control 
the dictionary.  

Ideally the dictionary would auto-populate from the index the search engine 
builds.  We use Thunderstone Webinator http://www.thunderstone.com for our 
website search and it uses its own index for the spelling suggestions.  It also 
lists in parentheses the number of results that match each suggestion.   
http://www.sonomalibrary.org/search 


Genny Engel
Sonoma County Library
gen...@sonoma.lib.ca.us
707 545-0831 x581
www.sonomalibrary.org



>>> cory_l...@ncsu.edu 04/30/10 06:55AM >>>
I'm exploring options for implementing a spelling suggestion or basic query 
reformulation service in our home grown search application (searches library 
website, catalog, summon, and a few other bins). Right now, my thought is to 
provide results for whatever was searched for 'as is' and generate a link for 
an alternate search -- sort of like what The Google does.  I am concerned only 
with correcting spelling errors, not so much with topically related search 
suggestions.

The 3 options I've found that seem worth further investigation are:

- Yahoo Search spellingSuggestion service: 
http://developer.yahoo.com/search/web/V1/spellingSuggestion.html 

- GNU Aspell: http://aspell.net 

- Ockham Spell service: http://spell.ockham.org/about/index.html . There is a 
thread on Code4Lib back in 2005 about this: 
http://serials.infomotions..com/code4lib/sru/?operation=searchRetrieve&version=1.1&stylesheet=/code4lib/sru/style.xsl&query=spelling+server
 

Anyone doing something like this? What tools are you using? What have you 
tried? What worked well? Have I overlooked an option that I should consider?

Thanks,

Cory


Cory Lown
NCSU Libraries
Raleigh, NC
cory_l...@ncsu.edu

[CODE4LIB] Position Open - Yale University Library IT Office

[Barnett, Jeffrey]

Systems Programmer II

Library Systems Group

Yale University

Band III-Grade 25


General Purpose
In a dynamic 24x7x365 production data center environment, working independently 
and collaboratively as a senior member of an interdepartmental team, provides 
Unix and Windows system administration, storage and backup administration, and 
application administration for Yale University Library, consortia, and 
development partner's servers and web services. Plays a leadership role in the 
acquisition and deployment of new hardware.

Responsibilities
Ensures performance, reliability and security on Solaris, Linux and Windows 
servers, supporting critical staff and public services for the University 
Library, campus partners, and national and international consortia members.  
Provides performance tuning, capacity planning, automation, and documentation 
for systems and applications.

Installs, configures, documents, and maintains operating systems, applications, 
and system management tools including:
* Apache, Netbackup, RedHat, SAMBA, Solaris "Zones" and ZFS, SVN, Tomcat, VMWare
* Open source applications CNRI handles system, Fedora, VUFind,
* Informix, Oracle, MySQL and Progres, databases;
* Library applications GFA/LAS, MetaLib, SFX, URSA, Verde, Voyager and locally 
developed.
Ensures performance, reliability and security of tape libraries and backup 
systems:
* Monitor storage and backup systems and components to ensure capacity, 
performance and availability.
* Consult with clients on backup/restore issues.
* Perform storage and backup related software installs and upgrades.
Collaborates as part of a development team, as a technical lead, providing 
systems expertise in research projects related to new web services for the 
discovery and delivery of content, digital archives, and repositories.  Plays a 
leadership role as knowledge expert in the specification, design, and 
deployment of hardware. Independently manages special projects, such as 
capacity replacements and architecture improvements.  Tracks developments in 
new technologies.  Supports and collaborates with developers at Yale and in the 
open source community, data center operations staff, vendors, and service 
providers.  Performs off-shift work with rotating on-call coverage.  Mentors 
junior system programmers and other technology staff in Library units.  May be 
required to assist with disaster recovery efforts.  May be assigned to work at 
the West Campus location in West Haven, CT.

Qualifications
Bachelor's degree in a related field and at least four years experience as a 
systems programmer in a mixed-platform environment; or an equivalent 
combination of education and experience.  Extensive experience configuring and 
supporting a variety of disk arrays and RAID controllers.  Extensive experience 
and skill troubleshooting and resolving a variety of hardware, network, and 
application-related issues in a multi-platform computing environment.

Demonstrated expert knowledge with Linux/Solaris/Unix and/or Windows operating 
systems, utilities and applications.  Comprehensive, demonstrated leadership 
and project management skills.  Demonstrated ability with administration of web 
services (Tomcat, Apache), databases, and web applications.  Ability to produce 
well-crafted documentation, specifications, and recommendations. Excellent 
communication and organizational skills.  Expert skill in developing scripts to 
monitor, maintain, and secure systems.  Demonstrated competence working with a 
range of hardware related to enterprise-class services (servers, storage, and 
backup).



Salary and Benefits
Rank and competitive salary will be based upon the successful candidate's 
qualifications and experience.  Full benefits package including pro-rated 22 
vacation days; 18 holiday, recess and personal days; comprehensive health care; 
TIAA/CREF or Yale retirement plan; and relocation assistance.  Applications 
consisting of a cover letter, resume, and the names of three professional 
references should be sent by creating an account and applying online at 
www.yale.edu/jobs for immediate consideration - the 
STARS req ID for this position is 8624BR.  Please be sure to reference #8624BR 
in your cover letter.

Re: [CODE4LIB] AquaBrowser Libraries Group

[Barnett, Jeffrey]

Good point Ed, but I think by the phrase "Licensed sites only" the intent of 
the AquaBrowser discussion _is_ to exclude open source.  Interesting 
difference... 

-Original Message-
From: Code for Libraries [mailto:code4...@listserv.nd.edu] On Behalf Of Ed 
Summers
Sent: Wednesday, October 21, 2009 9:19 PM
To: CODE4LIB@LISTSERV.ND.EDU
Subject: Re: [CODE4LIB] AquaBrowser Libraries Group

You should also feel free to discuss AquaBrowser on here too ... the
code4lib discussion isn't limited to opensource software.

//Ed

On Wed, Oct 21, 2009 at 4:32 PM, Kathryn Frederick
 wrote:
> Please excuse cross-posting.
>
> I've set up an AquaBrowser Google Group to share tips and post
> questions. If your library uses AquaBrowser, please consider joining.
> This group is restricted, email me at kfred...@skidmore.edu and I'll
> send you an invite.
>
> Licensed sites only, please.
>
> Thanks,
> Kathryn
>

Re: [CODE4LIB] can code4lib survive Oracle's takeover of Sun?

[Barnett, Jeffrey]

IBM has an RDBMS horse in the OSS race (Called "Derby").  It doesn't seem to 
have much of a following.  I imagine they must have forseen the possiblity of 
an Oracle takeover when they broke off their own acquisition proposal earlier 
this (?last) year.  I agree there is probably more to come.  That's why I posed 
the question.
Netbeans is probably in the weakest position.  It already has strong OSS 
competition from Eclipse (originally IBM sponsored), and IBM, Oracle, and uSoft 
all have in-house IDEs.

-Original Message-
From: Code for Libraries [mailto:code4...@listserv.nd.edu] On Behalf Of Thomas 
Dowling
Sent: Monday, April 20, 2009 10:42 AM
To: CODE4LIB@LISTSERV.ND.EDU
Subject: Re: [CODE4LIB] can code4lib survive Oracle's takeover of Sun?

On 04/20/2009 10:13 AM, Barnett, Jeffrey wrote:
> I know the answer is yes, but does anyone care to speculate on the
> impact of Oracle's takeover of Sun, which controls in addition to open
> source workhorse JAVA, MySQL, OpenOffice, and Netbeans (all of which
> complete with proprietary products from Oracle).


Meh.  I don't know the intricacies of Java or NetBeans, but with MySQL, a
non-nurturing environment at Ora-Sun will either lead to a fork handled by
someone more invested in it, or a gradual move to PostgreSQL; if that spurs
some development to simplify psql, it's arguably a win all around.

OO.o development doesn't seem to be in the fast lane as it is, so I'm not sure
it could suffer much if Sun bails on it.  And isn't IBM contributing at least
as much as Sun these days?  Maybe it needs something like this to shake it up.


-- 
Thomas Dowling
tdowl...@ohiolink.edu

[CODE4LIB] can code4lib survive Oracle's takeover of Sun?

[Barnett, Jeffrey]

I know the answer is yes, but does anyone care to speculate on the impact of 
Oracle's takeover of Sun, which controls in addition to open source workhorse 
JAVA, MySQL, OpenOffice, and Netbeans (all of which complete with proprietary 
products from Oracle).  I haven't heard anything quotable recently from Larry 
Ellison, but he has in the pass been an ardent opponent of OSS and I find it 
hard to imagine him not taking advantage of this opportunity to place 
roadblocks and/or booby traps in the way of the OSS community.

Re: [CODE4LIB] Vote for NE code4lib meetup location

[Barnett, Jeffrey]

I joined myself to the group just today, too late to vote, but what I see is 23 
votes for Boston and 43 for anywhere else.  Shouldn't there at least be a 
runoff?

-Original Message-
From: Code for Libraries [mailto:[EMAIL PROTECTED] On Behalf Of Jay Luker
Sent: Wednesday, October 15, 2008 4:48 PM
To: CODE4LIB@LISTSERV.ND.EDU
Subject: Re: [CODE4LIB] Vote for NE code4lib meetup location

Sorry to leave you all in suspense all day. The results are in:

23 Boston, MA
18 Northampton, MA
14 Concord, NH
11 Portland, ME

Michael Klein has said he will now check when a suitable space will be
available at BPL. Then we'll update the WhenIsGood page and hope for
some availability intersection goodness.

--jay