Re: [CODE4LIB] Mapping book locations
It does get a bit involved, there is some recursion needed for a reasonable implementation, eg a magazine in a file placed on a shelf or an archive that has boxes on shelves. I implemented it for my books and manuals, example :- http://www.collection.archivist.info/shelfview.php?src=artitle=197 All items and locations have a barcode, the database has a location id(one per shelf+ a special for containers), and a status(lost,confirmed,etc) on each item plus another field if the locid is in/on an item/shelf. A stock check routine, scan shelf, (mark items located), scan items(mark confirmed on shelf/add to shelf), finish(mark unscanned as lost) The shelf locations have a room and xy location and orientation. There is a linking table to tie together and a live map drawing and and arrow image tool. Dave Caroline
Re: [CODE4LIB] Google can give you answers, but librarians give you the right answers
I think some should get off their pedestals and think how the unknown to you patron is to find you, your library and your content. To assume the user has come and ask you is to put too much burden on the user to find and access what you have. This weeks furthest patron for me was the other side of the world in AU Google will find unique sources and send the users to that resource. Yes I hate the tracking and bias of ANY search including those talked about on this list for academic libraries. If the catalogue is not detailed enough, it cannot be found. Dave Caroline
Re: [CODE4LIB] Mayor of Libraries
As long as there is an index on the fields then it is not taxing for the database. if displaying on and off shift then select persons from the_database order by onsite,rank (0 off shift, 1 on shift) a status update is just setting that persons shift status add limit 1 if you just want the top of the pile Dave Caroline
Re: [CODE4LIB] talking about digital collections vs electronic resources
And what percentage try the web before they come you your search, knowing from experience you separated all the data into some silos with obscure names. I settled on one overall search with facets in the result. Dave Caroline
Re: [CODE4LIB] Wireless barcode scanners
I use an old Wasp barcode scanner to scan my spine barcodes when stock checking a shelf or box of manuals. I think ease of use matters. The laser line makes it easy to point and fast, it looks so wrong to me watching people use pads to take pictures, also no waiting for mechanical focus. Dave Caroline On 03/11/2014, Cary Gordon listu...@chillco.com wrote: You could simply use an iPad as a barcode scanner. Disintermediate! On Nov 3, 2014, at 12:58 PM, Edward M. Corrado ecorr...@ecorrado.us wrote: This is slightly off-topic but I can't think of a better place to ask. I have been asked to investigate wireless barcode scanners, and preferably ones that can work with an iPad (or be connected to an iPad), for inventory purposes. I have found a few used in the retail environment but I was wondering of anyone has bought any recently that they like. Even if you have a wireless barcode scanner that isn't designed to work with an iPad that you recommend, I'd like to hear about it. I know this is vaugue, but that is intentional, I am trying to cast a wide net in hopes to hear what others have done that might be of interest since we are just starting to look into this. Thanks, Edward
Re: [CODE4LIB] Why learn Unix?
On 27/10/2014, Matthew Sherman matt.r.sher...@gmail.com wrote: Eric hit the nail on the head, Unix is not inherently needed for many libraries, but it can be useful for more technically inclined librarians to know Linux. I am a digital content librarian at my institution and I actually know neither system, though I wish I had a better understanding of Linux. Yet I am able to do a lot of work on assorted projects due to knowledge in XML, scripting, and other such technical skills. So if you really want to promote people learning Unix, and probably actually Linux, you should help them to see where it will empower them to do more in their work. On Mon, Oct 27, 2014 at 10:09 AM, Eric Lease Morgan emor...@nd.edu wrote: Learning Unix is not necessarily the problem to solve. Instead it is means to an end. To my mind, there are number of skills and technologies a person needs to know in order to provide (digital) library service. Some of those skills/technologies include: indexing, content management (databases), programming/scripting, HTTP server management, XML manipulation, etc. While these technologies exist in a Windows environment, they are oftentimes more robust and specifically designed for a Unix (read Linux) environment. -- Eric Morgan
Re: [CODE4LIB] Why learn Unix?
oops, ignore the accidental blank but anyway, Linux/unix have a nicer idea of permissions and security so often you get better uptimes, less need for reboots. You can serve apache etc on other OSs but often not all modules are ported to the less popular serving platforms. Dave Caroline On 27/10/2014, Dave Caroline dave.thearchiv...@gmail.com wrote: On 27/10/2014, Matthew Sherman matt.r.sher...@gmail.com wrote: Eric hit the nail on the head, Unix is not inherently needed for many libraries, but it can be useful for more technically inclined librarians to know Linux. I am a digital content librarian at my institution and I actually know neither system, though I wish I had a better understanding of Linux. Yet I am able to do a lot of work on assorted projects due to knowledge in XML, scripting, and other such technical skills. So if you really want to promote people learning Unix, and probably actually Linux, you should help them to see where it will empower them to do more in their work. On Mon, Oct 27, 2014 at 10:09 AM, Eric Lease Morgan emor...@nd.edu wrote: Learning Unix is not necessarily the problem to solve. Instead it is means to an end. To my mind, there are number of skills and technologies a person needs to know in order to provide (digital) library service. Some of those skills/technologies include: indexing, content management (databases), programming/scripting, HTTP server management, XML manipulation, etc. While these technologies exist in a Windows environment, they are oftentimes more robust and specifically designed for a Unix (read Linux) environment. -- Eric Morgan
Re: [CODE4LIB] Is Anyone Doing RFID Book Location or Stack Mapping?
My system is a private collection but operates with a public interface (web) it uses unique barcodes which operate in a similar way to an rfid per item way. 1, me 2, not that long (add an input shelving screen, draw some maps(auto drawn in my case), and add a link in the search results to a map display) 3, not a lot(nothing) I wrote it for my own collection/archive 4, a barcode scanner, both hand held/and a wifi barcode scanner 5, uses the search screen, gets a link to the map 6, no difference in my case 7, yes, sure makes finding stuff easy, also makes for easy stock control I dont see much difference software wise between rfid and barcode just the way scanning is done. The web interface has no map interface for security reasons but internal screens get the map link. I have saved a grab here http://www.collection.archivist.info/archive/mirror/shelfview.php I save an XY location, size and rotation for a shelf and the basic room size in a table then draw automatically the room with an arrow pointing to a highlighted stack. one day the arrow position will show the approx offset along the shelf as I always scan left to right. Dave Caroline On 28/08/2014, Jarrell, Mark mjarr...@richlandlibrary.com wrote: Are there any libraries out there that are making use of RFID hardware/software to help patrons know the precise location of books/items on the shelves? Or is anyone use other stack mapping software to help patrons know the general location of items on the shelf? If so, I have a few questions for you. Please feel free to message me directly and I can compile the results into an anonymous set to share with the group. 1. Name of software vendor 2. Approximate time to implement 3. Approximate cost to implement 4. What types of hardware/software is involved in the process that wasn't used previously? 5. How does the customer locate the item on the shelf (e.g. Via handheld tool, map linked to catalog record, etc.) 6. Is there a way for the patron to find out the location of items that are shelved in non-public areas (if a library branch is undergoing renovations)? 7. Would you recommend this software/hardware method to other libraries? Why or why not? [cid:B062E8AC-43B8-4564-9851-3B3E64D2EDF1] Mark W. Jarrell Online Applications Developer | Richland Library 1431 Assembly St. | Columbia, SC 29201 (p) 803.553.9818 | (GTalk, Skype) mark.jarrell Access Freely at RichlandLibrary.comhttp://www.richlandlibrary.com/. Interested in helping to shape RichlandLibrary.com? Join an advisory grouphttp://www.richlandlibrary.com/website-advisory-groups. Watch Freely: My Pick | The Boy in the Striped Pajamashttp://www.richlandlibrary.com/search/detail/309477
Re: [CODE4LIB] Barcode scanner
The wasp and others come with a browser, I just have the home page on mine set to the shelf.php page on my web server. Dave Caroline On 07/07/2014, Riley Childs rchi...@cucawarriors.com wrote: Ok, we use koha (if any one cares ;). I was looking at the Wasp unit that was recommended, but the only draw back is that I can't run a web browser on it to open a tiny inventory php script I wrote to pull data from koha and verify info then add the book to a csv. Does any one have a grocery store style unit that they integrate some how with their ILS? Riley Childs Junior IT Admin email: rchi...@cucawarriors.com office: +1 (704) 537-0031 x101 cell: +1 (704) 497-2086 Please Think Before Hitting Reply All I Do Web Design! RileyChilds.net/services From: Code for Libraries [CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Harper, Cynthia [char...@vts.edu] Sent: Monday, July 07, 2014 11:39 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] Barcode scanner It's your choice of a CSV or text file. At a previous library, we used the III Millennium inventory system. You could edit this file with a macro to make it suitable for ingestion into the inventory system, and then upload it to III and process it from there. I don't think III is still selling this old text-based inventory system, but it still works for the libraries that have it. So this barcode scanner is not compatible with the new III Circa inventory system, AFAIK. Other systems are out of my knowledge-base scope. I mostly suggested this option thinking Riley may be processing the data outside the ILS. That's what I've done with our small-scale periodicals counting project. Cindy Harper char...@vts.edu -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Elizabeth Leonard Sent: Monday, July 07, 2014 11:24 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] Barcode scanner Cindy- A couple questions: The data is dumped into what type of file? Do you have an option? And then how do you move that data into your ILS? (I know this is ILS dependent but I am trying to envision workflow). Do you the use an attached barcode reader to scan them into your system? Or do you have a way to import? Elizabeth Leonard Seton Hall University 400 South Orange Avenue South Orange, NJ 07079 973-761-9445 -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Harper, Cynthia Sent: Wednesday, July 2, 2014 8:30 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] Barcode scanner We use one of this family of scanners - Opticon OPN200x - for print periodicals use counts. It's standalone or USB, collects a time-stamped barcode file, and you can download when you care to. The battery seems to last forever before needing recharging under my use conditions. http://www.opticonusa.com/products/companion-scanners/opn2001.html Cindy Harper Electronic Services and Serials Librarian Virginia Theological Seminary 3737 Seminary Road Alexandria VA 22304 703-461-1794 char...@vts.edu -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Riley Childs Sent: Tuesday, July 01, 2014 5:37 PM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] Barcode scanner We use code39 for everything, I am trying to find something that I can give to 2 volunteers to run inventory twice a year without having to be tied to an ipad Riley Childs Student Asst. Head of IT Services Charlotte United Christian Academy (704) 497-2086 RileyChilds.net Sent from my Windows Phone, please excuse mistakes From: Riesner, Giles W.mailto:gries...@ccbcmd.edu Sent: 7/1/2014 3:51 PM To: CODE4LIB@LISTSERV.ND.EDUmailto:CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] Barcode scanner Riley, Basically ANY barcode scanner would work for you. Barcode scanners simply read in data as though it was typed in from a keyboard. What matters is that you have the symbologies you need enabled. Library barcodes tend to be Codabar (which is not always enabled by default), while stores often use UPC/EAN (which is usually enabled). And the barcodes for our students and staff at the College are in Code 128. If you can attach the barcode reader to a laptop and scan the barcodes into a blank text file, then it's enabled. If you grab a copy of the manual for the barcode reader you can see how to program in any prefixes or suffixes you need and more - things like being able to tell which symbology is being used. If all you're doing is scanning in barcode numbers to say that this piece of equipment is here, you don't even need a special program, just a text file that can be imported into Excel. We do something similar and upload data to our library system to update the inventory of our collection at the various Branches
Re: [CODE4LIB] Barcode scanner
Any barcode scanner will do is not true, some fail on certain code types others need large type as they are blind as a bat. I only mentioned the ones that worked on the tiny barcodes I use. I have a shelf.php screen that is either used on the main PC via USB or the same php via wifi, one selects the location field and scan it, the contents that were there are listed and the status changed from confirmed to located, then scan all the items in the box/on the shelf, all the items scanned are then marked confirmed, when finished at the end there is a button to set lost for all the items that were awol. If lucky they get located as one scans other shelves else...dont panic might turn up one day. Dave Caroline On 01/07/2014, Ruth Collings cont...@ruthcollings.ca wrote: I agree with Giles' opinion that your regular handheld barcode scanner is sufficient for 95% of use cases and it's a very simple machine -- brand means almost nothing. If the issue is cost, when I wanted one for scanning my own home collection I got a used library barcode scanner (Symbol 1908T-X) on eBay for $9 (+$20 shipping) and then looked up the manual online to customize the settings. Riesner, Giles W. mailto:gries...@ccbcmd.edu July 1, 2014 at 3:42 PM Riley, Basically ANY barcode scanner would work for you. Barcode scanners simply read in data as though it was typed in from a keyboard. What matters is that you have the symbologies you need enabled. Library barcodes tend to be Codabar (which is not always enabled by default), while stores often use UPC/EAN (which is usually enabled). And the barcodes for our students and staff at the College are in Code 128. If you can attach the barcode reader to a laptop and scan the barcodes into a blank text file, then it's enabled. If you grab a copy of the manual for the barcode reader you can see how to program in any prefixes or suffixes you need and more - things like being able to tell which symbology is being used. If all you're doing is scanning in barcode numbers to say that this piece of equipment is here, you don't even need a special program, just a text file that can be imported into Excel. We do something similar and upload data to our library system to update the inventory of our collection at the various Branches. There are indeed apps for Android and IOS devices that might enable you to use a phone to do it too. Just my .02 worth. Regards, Giles W. Riesner, Jr. | Lead Library Technician , Library Technology The Community College of Baltimore County | 800 South Rolling Road | Catonsville, MD 21228 USA Phone: 1-443-840-2736 | Fax: 1-410-455-6436 | Email: gries...@ccbcmd.edu CCBC. The incredible value of education. -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Riley Childs Sent: Monday, June 30, 2014 9:24 PM To: CODE4LIB@LISTSERV.ND.EDU Subject: [CODE4LIB] Barcode scanner I am trying to find a barcode scanner that i can do inventory with, I was looking at the KDC20, but it is a tad out of my price range, what barcode scanner do you like? I have a Metroset Voyager (Honeywell branded) that i like, but am trying to see what others have and get some better suggestions. Riley Childs Student Asst. Head of IT Services Charlotte United Christian Academy (704) 497-2086 RileyChilds.net Sent from my Windows Phone, please excuse mistakes Riley Childs mailto:rchi...@cucawarriors.com June 30, 2014 at 9:23 PM I am trying to find a barcode scanner that i can do inventory with, I was looking at the KDC20, but it is a tad out of my price range, what barcode scanner do you like? I have a Metroset Voyager (Honeywell branded) that i like, but am trying to see what others have and get some better suggestions. Riley Childs Student Asst. Head of IT Services Charlotte United Christian Academy (704) 497-2086 RileyChilds.net Sent from my Windows Phone, please excuse mistakes -- Ruth Collings Web Librarian ruthcollings.ca http://ruthcollings.ca
Re: [CODE4LIB] Barcode scanner
I have a couple I use, a Symbol LS2208 with a USB lead and for portable I use one of the units like supermarkets use, a Wasp WPA206 it is old and has WinCE on it and talks to the wifi. I use these because they work with the very small barcode labels I got hold of. The system uses html data collection so not that difficult to use. Dave Caroline On 01/07/2014, Riley Childs rchi...@cucawarriors.com wrote: I am trying to find a barcode scanner that i can do inventory with, I was looking at the KDC20, but it is a tad out of my price range, what barcode scanner do you like? I have a Metroset Voyager (Honeywell branded) that i like, but am trying to see what others have and get some better suggestions. Riley Childs Student Asst. Head of IT Services Charlotte United Christian Academy (704) 497-2086 RileyChilds.net Sent from my Windows Phone, please excuse mistakes
Re: [CODE4LIB] CFP: A Librarian's Introduction to Programming Languages
And do not forget the basics of data structures and why they are used (B tree etc) Dave Caroline On 26/03/2014, Edward M. Corrado ecorr...@ecorrado.us wrote: One thing I haven't seen mentioned in this thread, although maybe I missed it, is that we don't know what the editors already have in mind to either 1) write themselves, or 2) recruited people directly to write. I think there were many good ideas in this thread (and I hope the editors are listening because incorporating much of this input will make the end-result a better book) but it doesn't necessarily mean we should assume that the editors weren't planning to cover them. I know multiple people who have edited books, including myself, who only did an open call for a portion of the book and contacted other people directly to write some chapters on specific topics. Edward
Re: [CODE4LIB] University of Toronto Libraries' Responsive Catalogue Now Live
I would second the comment on the constant tile, that is a google nono, using webmaster tools, it tells you, you have duplicate pages. One other comment, the default image of a book for a letter seemed odd. Dave Caroline On Tue, Aug 27, 2013 at 7:00 PM, Lisa Gayhart lisa.gayh...@utoronto.ca wrote: Hi everyone, A short message to let everyone know that UTL's new responsive library catalogue went live today. Check it out here: http://search.library.utoronto.ca. We would love your feedback! Feel free to send any thoughts my way or submit them to the feedback form in the catalogue. Thank you, Lisa Gayhart | Digital Communications Services Librarian| University of Toronto Libraries | Information Technology Services | lisa.gayh...@utoronto.camailto:lisa.gayh...@utoronto.ca | 416-946-0959
Re: [CODE4LIB] University of Toronto Libraries' Responsive Catalogue Now Live
I would second the comment on the constant tile, that is a google nono, it tells you you have duplicate pages One other comment, the default image of a book for a letter seemed odd. Dave Caroline On Tue, Aug 27, 2013 at 7:00 PM, Lisa Gayhart lisa.gayh...@utoronto.ca wrote: Hi everyone, A short message to let everyone know that UTL's new responsive library catalogue went live today. Check it out here: http://search.library.utoronto.ca. We would love your feedback! Feel free to send any thoughts my way or submit them to the feedback form in the catalogue. Thank you, Lisa Gayhart | Digital Communications Services Librarian| University of Toronto Libraries | Information Technology Services | lisa.gayh...@utoronto.camailto:lisa.gayh...@utoronto.ca | 416-946-0959
Re: [CODE4LIB] phone app for barcode-to-textfile?
On Thu, Jun 6, 2013 at 7:47 PM, Ken Irwin kir...@wittenberg.edu wrote: This (CLZ Barry) looks like it could be perfect! $8/phone beats many other options! Except the easy to use option I am using a wifi winCE device with a web app, I can see where the scanner (laser) is pointing, works in poor light. I have been working with a customer with qr codes on a iPhone and it is not something I would choose for a production job far too awkward, rather slow to focus, tends to need two hands on the phone to hold steady and point. Something that is OK for occasional use by a user but as a tool in production I am not so sure. Dave Caroline
Re: [CODE4LIB] Open Library Internet Archive BookReader
On Thu, May 30, 2013 at 10:01 PM, Robinson, Lakeisha lakeisha.robin...@yale.edu wrote: Hello Everyone, is anybody using the Open Library Internet Archive BookReader for page turning? If so, I have a couple of questions regarding the development of it. Thanks, You missed out the questions! Should all the list answer yes/no/maybe, with IRC and mailing lists please include the real questions up front so those in the know can answer. Dave Caroline
Re: [CODE4LIB] Image de-duping and file identification
I had a project to de duplicate many images and other files too. I wrote a little ditty in PHP but the idea can by used in any language. I have a set of tables in MySQL. give the utility a set of root directories to test and compare trawl the filestems for filename location and size and store in the first table issue sql insert into duplicatesizetable Select filesize,count(filesize) as qty from nametable group by filesize having qty1 you now have the sizes of possible duplicates only now do you crc/md5sum the files of that size update the nametable with crc/md5 values as calculated there can be false positives if two different files crc values are the same then a final bit of sql Select filesize,count(crc) as qty from nametable group by filesize,crc having qty1 I store in a table so I can leave the job and come back join the results to the nametable which gets the real duplication sizes and crc, which can now be used to guide a human to to clean the mess I give the user a table showing the n files with buttons to delete, view, ignore (you may want to keep two/more copies) for safety one can leave part of the filesystem write protected also the form oly allows one button per group http://www.archivist.info/Screenshot_Delete_duplicates.png that took a few minutes only to get the duplicates from a 9gb picture directory Dave Caroline
Re: [CODE4LIB] Displaying archival books on ipad and android tablets
On Sat, Feb 23, 2013 at 12:50 AM, Kyle Banerjee kyle.baner...@gmail.com wrote: We have a few digitized books, (some of them are old -- we're talking 500 years). Sizes are all over the place but the big ones are easily the size of a large briefcase. We want to make these works more accessible/usable and there's some demand to make them available for tablets. What experience do people have with stuff like that, and what software/services/methods do you recommend? Source files are 600 dpi uncompressed tiffs so they're pretty big and there's nothing special about a book being over 10GB in size. Thanks, kyle I have tried an open source project Diva I have greyscale images in TIFF for the online zoomable display of some manuals Here is a scan of a photocopy 36 page http://www.collection.archivist.info/diva/#z=4p=32 and here a technical manual http://www.collection.archivist.info/diva/lucastp1.html I have two copies so the user can see two views at the same time on the second example. They are served on an ADSL line direct from home so you can get the idea of its speed due to the way it is only sending tiles as needed for display and not bloat like whole PDF. Dave Caroline
Re: [CODE4LIB] You *are* a coder. So what am I?
On Thu, Feb 14, 2013 at 4:12 PM, Cornel Darden Jr. corneldarde...@gmail.com wrote: Hello, It now seems that the Librarian of Congress is the Pope of Librarianship methinks not as the Bodleian predates the LoC by a small amount :) http://www.bodleian.ox.ac.uk/bodley/about/history Dave Caroline Thanks, Cornel Darden Jr. MSLIS Librarian Kennedy-King College City Colleges of Chicago Work 773-602-5449 Cell 708-705-2945 On Feb 14, 2013, at 9:09 AM, Devon dec...@gmail.com wrote: If you want to call yourself a librarian, just do it. There's no pope of librarianship to tell you otherwise. On Wed, Feb 13, 2013 at 7:22 PM, Maccabee Levine levi...@uwosh.edu wrote: Andromeda's talk this afternoon really struck a chord, as I shared with her afterwards, because I have the same issue from the other side of the fence. I'm among the 1/3 of the crowd today with a CS degree and and IT background (and no MLS). I've worked in libraries for years, but when I have a point to make about how technology can benefit instruction or reference or collection development, I generally preface it with I'm not a librarian, but I shouldn't have to be defensive about that. Problem is, 'coder' doesn't imply a particular degree -- just the experience from doing the task, and as Andromeda said, she and most C4Lers definitely are coders. But 'librarian' *does* imply MLS/MSLS/etc., and I respect that. What's a library word I can use in the same way as coder? Maccabee -- Maccabee Levine Head of Library Technology Services University of Wisconsin Oshkosh levi...@uwosh.edu 920-424-7332 -- Sent from my GMail account.
Re: [CODE4LIB] #libtechwomen (was Re: Question abt the code4libwomen idea)
On Fri, Dec 7, 2012 at 7:06 PM, Lisa Rabey lra...@grcc.edu wrote: Good afternoon, Myself, Becky Yoose, and feelers out to a couple other people, are currently in the very early stages of thinking we should do something (tm) that is outside of Code4Lib. The idea is a group (for a lack of a better word) that is independent / inclusive that won't be segregated from the rest of library land. This should be encompassing for anyone who identifies themselves as female, and works in technology and in libraries. You seem to be discriminating against men hardly inclusive Dave Caroline
Re: [CODE4LIB] What is a coder?
On Thu, Nov 29, 2012 at 1:45 PM, Friscia, Michael michael.fris...@yale.edu wrote: Thought process of a coder: 1- I need to open a file in my program 2- ok, I'll import IO into my application and read the definition 3- i create methods and functions around the definition and open my file Total time to deliver code: 5 mins Must be a youngun :) Now code in assembler! Dave Caroline
Re: [CODE4LIB] CODE4LIB equivalent in UK?
On Mon, Oct 8, 2012 at 9:48 AM, Ian Ibbotson ian.ibbot...@k-int.com wrote: +1 another UK lurker here.. FWIW tho, I'd be pro reusing one of the existing (many) uk channels where, what, a list of lists kplsthnks? rather than starting up another list to subscribe to :) I did go to the last mashcat which was mentioned on the NGC4LIB list. Dave Caroline
Re: [CODE4LIB] CODE4LIB equivalent in UK?
On Tue, Oct 2, 2012 at 8:55 AM, Michael Hopwood mich...@editeur.org wrote: I know that CODE4LIB isn't per se in the USA but it seems like a large number of its active users are. Is there an equivalent list that you folks know of? I dont know of an equivalent British list but there are a few of us brits about lurking in #cod4lib too (archivist) Dave Caroline
Re: [CODE4LIB] Seeking examples of outstanding discovery layers
There are plenty users who go beyond screen 2, I know I do. Dave Caroline
Re: [CODE4LIB] responsiveness and Wordpress
I always understood responsive to be opposed to sluggish and a reference to speed. Do I see a redefinition starting up? Dave Caroline
Re: [CODE4LIB] e-journals lists, database lists
On Thu, May 24, 2012 at 7:44 PM, Tod Olson t...@uchicago.edu wrote: Code4Lib, What, short of a full-blown ERM, are you using to manage and provide your e-journals lists and database lists? We're looking for something that we can use for just a couple years. We already have the data in a database, and would like to dump it into something and have the lists and searching of the lists come out. We could certainly build something ourselves, but if something already exists, we'd love to take a look at it. Im inclined to say if you have the data in a database, just use its power to show the data in the form you need. You didn't really say what output you are looking for. searching/discovery Solr what database? perhaps just the right inverted index needs creating perhaps just a few join tables need creating Dave Caroline
Re: [CODE4LIB] archiving a wiki
On Tue, May 22, 2012 at 10:04 PM, Carol Hassler carol.hass...@wicourts.gov wrote: My organization would like to archive/export our internal wiki in some kind of end-user friendly format. The concept is to copy the wiki contents annually to a format that can be used on any standard computer in case of an emergency (i.e. saved as an HTML web-style archive, saved as PDF files, saved as Word files). something like ? http://www.mediawiki.org/wiki/Extension:DumpHTML Dave Caroline
Re: [CODE4LIB] viewer for TIFFs on iPad
On Thu, May 10, 2012 at 4:16 PM, Edward Iglesias edwardigles...@gmail.com wrote: Hello All, I was wondering if any of you had experience viewing large ~300MB and up TIFF files on an iPad. I can get them to the iPad but the photo viewer is less than optimal. It stops enlarging after a while and I'm looking at Medieval manuscripts so... You need something at the server end so you only need to view the part you are zoomed into I have tried diva http://www.collection.archivist.info/diva/systrondonner1626.html#p=99z=3 their demo is at http://ddmal.music.mcgill.ca/diva/demo/ Dave Caroline
Re: [CODE4LIB] crowdsourced book scanning
This makes a lot of sense for archives and out of copyright stuff Dave Caroline
Re: [CODE4LIB] Project Management Software Question
Even bigger list at http://en.wikipedia.org/wiki/Comparison_of_project_management_software Dave Caroline
Re: [CODE4LIB] Local catalog records and Google, Bing, Yahoo!
To avoid sessions and other silliness just expose a search engine friendly format without sessions. As I dont have local visitors google traffic matters. 86.62% Search Traffic 2.41% Referral Traffic 10.98% Direct Traffic For my tiny corner on the web Dave Caroline
Re: [CODE4LIB] Linux Laptop
You just cannot do the technical futzing easily on mac or doze, I too am a Ubuntu user on my desktop and servers getting stuff done web wise is faster that way.I expect to run the apache,php,mysql and replicate systems that are servers windows and mac screw with stupid things like case in the file system! Dave Caroline
Re: [CODE4LIB] Any ideas for free pdf to excel conversion?
Are you sure the pdf has any structure that can be used. Dave Caroline On Wed, Dec 14, 2011 at 6:08 PM, Matt Amory matt.am...@gmail.com wrote: Just looking to preserve column structure. -- Matt Amory (917) 771-4157 matt.am...@gmail.com http://www.linkedin.com/pub/matt-amory/8/515/239
Re: [CODE4LIB] jQuery Ajax request to update a PHP variable
I dont understand the thinking and waste of time scanning entire csv files where a database table with good indexing can be a lot faster and use less server memory. Do the work once up front when the data becomes available not on every page draw. I subscribe to the read/send and mangle as little as possible(server and client) on a web page view Dave Caroline
Re: [CODE4LIB] jQuery Ajax request to update a PHP variable
php has some nice and fast csv parsing abilities, use them as a source
for your database.
can then remove any regexp need
still simple for the users
snippet taken from one of my csv readers showing the prints in
comments so you can see the data in an array
this also keeps memory footprint down
$row = 1;
$fp = fopen ($fromdir.$file,r);
while ($data = fgetcsv ($fp, 1000, ,)) {//readlines in csv
$num = count ($data);
//print p $num fields in line $row: br;
$row++;
//for ($c=0; $c$num; $c++) {
//print '.$data[$c] . ' ;
//}
//print BR;
}
Dave Caroline
On Tue, Dec 6, 2011 at 6:32 PM, Nate Hill nathanielh...@gmail.com wrote:
csv files are what I have- they are easy for the not-technically inclined
staff to create and then save to a folder. I was really just hoping to
make this easy on the people who make the reports.
On Tue, Dec 6, 2011 at 10:21 AM, Dave Caroline
dave.thearchiv...@gmail.comwrote:
I dont understand the thinking and waste of time scanning entire csv
files where a database table with good indexing can be a lot faster
and use less server memory.
Do the work once up front when the data becomes available not on every
page draw.
I subscribe to the read/send and mangle as little as possible(server
and client) on a web page view
Dave Caroline
--
Nate Hill
nathanielh...@gmail.com
http://www.natehill.net
Re: [CODE4LIB] opening a pdf file
On Mon, Oct 3, 2011 at 2:58 PM, Eric Lease Morgan emor...@nd.edu wrote: Are any of you able to open the following URL with an Android-based tablet device: http://dh.crc.nd.edu/sandbox/cyl/corpus/canarybird00schm.pdf It is educational to look at memory use in the pc when that pdf is loaded. Evince here is using 600meg do you have space for such objects on these little toys try something like diva so you dont suck the resources dry on the client an experiment here http://www.collection.archivist.info/diva/systrondonner1626.html http://www.collection.archivist.info/diva/lucastp1.html Dave Caroline
Re: [CODE4LIB] opening a pdf file
The problem is PDF and the viewers. some/most expand ALL the compressed images and create thumbs from the images before they start display, This uses huge amounts of memory, a technology fail, they just dont fit certain work. If you are lucky the viewer keeps it compressed so it fits in memory and only uncompresses a single image that is being displayed, this stops niceties like thumbs unless a background thread goes through the images and caches the thumbs (slow), this is where even a tiled tiff viewer could be a lot better. Someone needs to do a tiled compressed format along with a viewer and banish PDF to the other side of the moon. Dave Caroline
Re: [CODE4LIB] mysql subquery response time
Sub queries are not well optimised till very recently therefore rewrite subquery as a join for speed. eg for A not in B the following SELECT a.* FROM a LEFT JOIN b ON a.id = b.id WHERE b.id IS NULL; also if you have two sets from the same table use derived tables and then join them (SELECT distinct institution FROM `renewals` WHERE snap_date '2011-07-01') as b (SELECT distinct institution from renewals) as a Dave Caroline On Wed, Sep 28, 2011 at 5:41 PM, Ken Irwin kir...@wittenberg.edu wrote: Hi all, I've not done much with MySQL subqueries, and I'm trying right now with what I find to be surprising results. I wonder if someone can help me understand. I have a pile of data that with columns for institution and date. Institution gets repeated a lot, with many different dates. I want to select all the institutions that *only* have dates after July 1 and don't appear in the table before that. My solution was to do a first query for all the institutions that DO have dates before July 1 SELECT distinct institution FROM `renewals` WHERE snap_date '2011-07-01' And then to do a SELECT query on all the institutions: SELECT distinct institution from renewals And then try to do a NOT IN subquery subtracting the smaller query from the larger one: SELECT distinct institution from renewals WHERE institution not in (SELECT distinct institution FROM `renewals` WHERE snap_date '2011-07-01') ...only it doesn't seem to work. Or rather, the query has been running for several minutes and never comes back with an answer. Each of these two queries takes just a few milliseconds to run on its own. Can someone tell me (a) am I just formatting the query wrong, (b) do subqueries like this just take forever, and/or (c) is there a better way to do this? (I don't really understand about JOIN queries, but from what I can tell they are only for mixing the results of two different tables so I think they might not apply here.) Any advice would be most welcome. Thanks Ken
Re: [CODE4LIB] Web platform for digitized books
I am just trying out https://github.com/DDMAL/diva.js/wiki Dual window served on an ADSL line http://www.collection.archivist.info/diva/lucastp1.html Dave Caroline
Re: [CODE4LIB] memory management for grownups
Build multiple insert strings to max=packet size and only then send to
mysql it gives a similar speed up to load data infile, and you dont
need the arrays.
INSERT [INTO] tbl_name [(col_name,...)]
{VALUES | VALUE} ({expr | DEFAULT},...),(...),...
in a test I did years ago on a slow (compared to now) ide disk, 800
meg athlon it went from 26 inserts a sec to 2800 inserts a sec
Dave Caroline
Re: [CODE4LIB] Apps to reduce large file on the fly when it's requested
One method is to dispense with PDF and just view the scanned pages online as images or OCR'd text or point the user to a directory with the scans for the document. He then only needs an image viewer using a lot less of his machines memory. Large PDF's also cause problems in the viewing computer. I was reviewing someones 25mb PDF the other day and it peaked at 3.3 gig memory use, which on a 2.5gig memory box meant it went into swap and slowed to a crawl. The viewer used there was evince. I scan to jpg and only produce a PDF if nagged http://www.collection.archivist.info/archive/manuals/IS44_Tektronix_602_display_unit/ As I serve from home and the upload is on the slow side individual pages helps there too. And when in a good mood I finish off a document thus http://www.collection.archivist.info/searchv13.php?searchstr=lucas+tp1 where all pages are web viewable. Been too lazy to write a page to page link on the page view so far (need a round tuit). Dave Caroline
Re: [CODE4LIB] Precision and Recall
The questions seem related to search engines or should you be googling for full text indexes or the other more correct name inverted index. Because in the normal scheme of events databases return exactly what you ask for. Dave Caroline On Fri, Jun 3, 2011 at 4:18 PM, Fleming, Declan dflem...@ucsd.edu wrote: Hi folks! I got an interesting question from one of our librarians working on a paper, and we want to include a bit about the qualities of a database, such as precision and recall. She is looking for references. I did the Google/Wikipedia lookups, but I'm sure she's done that too. http://en.wikipedia.org/wiki/Information_retrieval and here: http://en.wikipedia.org/wiki/Precision_and_recall If this subject resonates with anyone, give me a shout and maybe some links. Thanks! Declan
Re: [CODE4LIB] ajaxy CRUD / weeding helper
Why ajax! just a plain html form and add a barcode scanner, to pick that books data from the db Scan shelf, scan contents, you now have updated list of contents and books gone awol jump to updating page scan book, update, rinse repeat Dave Caroline
Re: [CODE4LIB] distributed library alpha server up, feedback welcome
I am another self coder using my own ideas not stuck with legacy ideas and using a web design with mysql db I happen to use php and dont use a cms like many seem to these days. I find use of a CMS somewhat restricting to the use of the database for full speed. You may get a CMS up quickly but it can bite you when you try to scale later, some have poor use of the database behind, I have lurked and helped in #mysql for a number of years and seen that problem a number of times. Search is possible on smaller systems you just need to implement an inverted index on the data you want to search this can be complex and large, Solr, or Sphinx or even the one mysql has built in a fulltext index. I went the way of creating the index in my application, that gives me a multi table search. http://www.collection.archivist.info/searchv13.php?searchstr=steam I went beyond marc because I store subject info in the database. http://www.collection.archivist.info/searchv13.php?searchstr=proceedings A good example is http://www.collection.archivist.info/searchv13.php?searchstr=bk2108 As mine is for my own personal book collection, some data is only available on an internal view of the data eg shelf, or if I've lent to someone and who. The search engine can be separated out from the code and used in other db schemas, I tried this on a partial marc import cherry picking a few of the fields, this is web viewable too http://www.marc.archivist.info/searchv10.php?searchstr=james applied to another set of data with computer manuals http://manx.archivist.info/search.php?search=altos I thought this would easily fit your system till I looked at django, wrong language I use PHP, which will run anywhere almost. If running your own server on own IP address then you just need to buy a domain name and have it pointed to you, I happen to do similar except I run the dns name server too so I can add as many sub domains as I wish. Running a name server means you need a secondary name server, get a friend to do that. Dave Caroline
Re: [CODE4LIB] Ranking factors for library resources: Who really uses what?
I wrote my own search engine for my system and thought long and hard about relevancy, in the end went for none! and display alphabetical. Dave Caroline On Tue, Feb 15, 2011 at 8:32 PM, Till Kinstler kinst...@gbv.de wrote: There is a vivid discussion about relevance ranking for library resources in discovery interfaces in recent years. In articles, blog posts and presentations on this topic, again and again possible ranking factors are discussed beyond well known term statistic based methods like the vector space retrieval model with tf*idf weighting (often after claiming term statistics based approaches wouldn't work on library data, of course without proofing that). Usually the following possible factors are mentioned: - popularity (often after stressing Google's success with PageRank), measured in several ways like holding quantities, circulation statistics, clicks in catalogues, explicit user ratings, number of citations, ... - freshness: rank newer items higher (ok, we have that in many old school Boolean OPACs as sort by date, but not in combination with other ranking factors like term statistics) - availability - contextual/individual factors, eg. if (user.status=student) boost(textbook); if (user.faculty=economics) boost(Karl Marx); if season=christmas boost(gingerbread recipes); ... - ... I tried to find examples where such factors beyond term statistics are used to rank search results in libraryland. But I hardly find them, only lots of theoretical discussions about all the pros and cons of all thinkable factors going on since the 1980s. I mean, all that is doable with search engines like Solr today. But it seems, it is hardly implemented somewhere in real systems (beyond simple cases, for example we slightly boost hits in collections a user has immediate online access to, but we never asked users, if they like it or notice at all). WorldCat does a little bit something, it seems. They, of course, boost resources with local holdings in WorldCat local. And they use language preferences (Accept-Language HTTP header) for boosting titles in users' preferred languages. And there might be more in WorldCat ranking. But there is not much published on that, it seems? So, if you implemented something beyond term statistics based ranking, speak up and show. I am very interested in real world implementations and experiences (like user feedback, user studies etc.). Thanks, Till
Re: [CODE4LIB] HTML Load Time
Two comments, 1. Break up to multiple pages. 2. A site search of the data That would be relatively simple in a database driven site. One could then add more functionality to the searches (dates, names or whatever) Dave Caroline On Mon, Dec 6, 2010 at 7:49 PM, Nathan Tallman ntall...@gmail.com wrote: Hi Cod4Libers, I've got a LARGE finding aid that was generated from EAD. It's over 5 MB and has caused even Notepad++ and Dreamweaver to crash. My main concern is client-side load time. The collection is our most heavily used and the finding aid will see a lot of traffic. I'm fairly adept with HTML, but I can't think of anything. Does anyone have any tricks or tips to decrease the load time? The finding aid can be viewed at http://www.americanjewisharchives.com/aja/FindingAids/ms0361.html. Thanks, Nathan Tallman Associate Archivist American Jewish Archives
Re: [CODE4LIB] locator
I do suggest you look at your locations carefully before you dive in. For the reserved stock held in boxes the location is in the box, the box has its own location. Moving the box to a new shelf in another room becomes a simple single update to the boxes location. Some contain other items in the sleeve or pocket so a location is in an item and its ID. And people like to move shelves around but thats covered in the code4lib article. I am implementing barcodes so I can stock check and update the locations of books on a shelf or box etc, I put the barcode on the spines and on the loose contents of a book (as the loose contents were in a book the shelf check will assume they are still in the book) so its just a few seconds to check, this also sets any book that was supposed to be there to a missing state. Dave Caroline
Re: [CODE4LIB] Any web services that can help sort out this for me.
what definition of large list 10,100,1000,. yes google copy title part Progress in Smart Materials and Structures paste in google box press return first hit for the first line has the isbn, or you could script it and use the Open Library API and get the isbn back possibly Dave Caroline On Thu, Jun 17, 2010 at 9:59 AM, David Kane dk...@wit.ie wrote: Hi, I have large amounts of data like this: yawn Reece, P. L., (2006), Progress in Smart Materials and Structures, Nova Ghosh, S. K., (2008), Self-healing materials: fundamentals, design strategies and applications, Wiley A.Y.K. Chan, Biomedical Device Technology: Principles Design, Charles C. Thomas, 2008. L.J. Street, Introduction to Biomedical Engineering Technology, CRC Press, 2007. /yawn ... one book per line. they are not in any order. I am lazy. So, is there a web service out there that I can throw this stuff at to organise it for me and ideally find the ISBNs. Long shot, I know. But thanks, David. -- David Kane Systems Librarian Waterford Institute of Technology Ireland http://library.wit.ie/ davidfk...@googlewave.com T: ++353.51302838 M: ++353.876693212
