Re: [CODE4LIB] Code4Lib Community google custom search

2011-10-12 Thread Jonathan Rochkind

On 10/11/2011 1:45 PM, Mark Jordan wrote:

Love the idea, but the form is now throwing a 404 error on submission.


Hmm, weird. I'll try to figure out why. I think 404 is what the google 
CSE gives you if you have a syntax error in your config files, but I 
don't think I've changed em since it last worked!


Very odd. This may end up being too much work to support/maintain for 
what I was hoping was a implement and forget project, we'll see.


There's some kind of lesson in this about something or other.


Re: [CODE4LIB] Code4Lib Community google custom search

2011-10-12 Thread Jonathan Rochkind

Love the idea, but the form is now throwing a 404 error on submission.
Any chance it can be fixed?



Okay, it's fixed, at http://www.code4lib.org/custom_search/search_form.html


But the thing I can't fix, is the Google CSE is _weird_ with what 
results it finds. It is kind of non-deterministic. You get 10 results 
for a query one minute, 500k an hour later, and 0 two hours after that.


Sometimes you'll get only, say, 10 hits, but if you refine to what 
should be a subset of those 10 hits, you'll get MORE than 10 hits.


I think that's just Google CSE, doesn't work quite as predictably as one 
might want. Oh well, still perhaps useful.


Re: [CODE4LIB] Code4Lib Community google custom search

2011-10-12 Thread Peter Murray
Yep -- works now.  Thanks for your efforts.


Peter

On Oct 12, 2011, at 1:19 PM, Jonathan Rochkind wrote:
 Love the idea, but the form is now throwing a 404 error on submission.
 Any chance it can be fixed?
 
 
 Okay, it's fixed, at http://www.code4lib.org/custom_search/search_form.html
 
 
 But the thing I can't fix, is the Google CSE is _weird_ with what 
 results it finds. It is kind of non-deterministic. You get 10 results 
 for a query one minute, 500k an hour later, and 0 two hours after that.
 
 Sometimes you'll get only, say, 10 hits, but if you refine to what 
 should be a subset of those 10 hits, you'll get MORE than 10 hits.
 
 I think that's just Google CSE, doesn't work quite as predictably as one 
 might want. Oh well, still perhaps useful.



-- 
Peter Murray peter.mur...@lyrasis.orgtel:+1-678-235-2955
 
Ass't Director, Technology Services Development   http://dltj.org/about/
LYRASIS   --Great Libraries. Strong Communities. Innovative Answers.
The Disruptive Library Technology Jesterhttp://dltj.org/ 
Attrib-Noncomm-Share   http://creativecommons.org/licenses/by-nc-sa/2.5/


Re: [CODE4LIB] Code4Lib Community google custom search

2011-10-11 Thread Peter Murray
Love the idea, but the form is now throwing a 404 error on submission.  Any 
chance it can be fixed?


Peter

On Oct 6, 2011, at 9:35 PM, Jonathan Rochkind wrote:
 So I was in #code4lib, and skome asked about ideas for library hours. 
 And I recalled that there have been at least two articles in the C4L 
 Journal on this topic, so suggested them.
 
 Then I realized that there's enough body of work in the Journal to be 
 worth searching there whenever you have an ideas for dealing with X 
 question. You might not find anything, but I think there's enough chance 
 you will, illustrated by that encounter with skome.
 
 Then I realized it's not just the journal -- what about a Google Custom 
 Search that searches over the Journal, the Code4Lib wiki, the Code4Lib 
 website, and perhaps most interestinly -- all the sites listed in Planet 
 Code4Lib.
 
 Then I made it happen. Cause it seemed interesting and I'm a 
 perfectionist, I even set things up so a cronjob automatically syncs the 
 list of sites in the Planet with the Google custom search every night.
 
 The Planet stuff ends up potentially being a lot of noise -- I tried to 
 custom 'boost' stuff from the Journal, but I'm not sure it worked. But I 
 did configure things with facet-like limits including a just the 
 planet limit, if you do want that. But even though it's sometimes a lot 
 of noise, it's also potentially the most interesting/useful part of the 
 search, otherwise it'd pretty much just be a Journal search, but now it 
 includes a bunch of people's blogs, as well as other sites deemed of 
 interest to Code4Lib community (including a couple other open source 
 library tech journals) -- without any extra curatorial work, just using 
 the list already compiled for the Planet.
 
 I'm curious what people think of it. Try some searches for library tech 
 questions or information and see how good your results are. If people 
 find this useful, I'll try to include it on the main code4lib.org 
 webpage in some prominent place, spruce up the look and feel etc. (Or 
 try to draft someone else to do that, I think my time to work on this 
 might be _just_ about up after staying until 9.30 hacking on this cause 
 it seemed cool).
 
 http://www.code4lib.org/custom_search/search_form.html



-- 
Peter Murray peter.mur...@lyrasis.orgtel:+1-678-235-2955
 
Ass't Director, Technology Services Development   http://dltj.org/about/
LYRASIS   --Great Libraries. Strong Communities. Innovative Answers.
The Disruptive Library Technology Jesterhttp://dltj.org/ 
Attrib-Noncomm-Share   http://creativecommons.org/licenses/by-nc-sa/2.5/


Re: [CODE4LIB] Code4Lib Community google custom search

2011-10-11 Thread Mark Jordan
Actually, he asked me about it on Friday and I told him it would be posted 
soon. I'm meeting with him this afternoon to go over the media stuff so I'll 
mention it then.

Mark

Mark Jordan
Head of Library Systems
W.A.C. Bennett Library, Simon Fraser University
Burnaby, British Columbia, V5A 1S6, Canada
Voice: 778.782.5753 / Fax: 778.782.3023 / Skype: mark.jordan50
mjor...@sfu.ca

- Original Message -
 Love the idea, but the form is now throwing a 404 error on submission.
 Any chance it can be fixed?
 
 
 Peter
 
 On Oct 6, 2011, at 9:35 PM, Jonathan Rochkind wrote:
  So I was in #code4lib, and skome asked about ideas for library
  hours.
  And I recalled that there have been at least two articles in the C4L
  Journal on this topic, so suggested them.
 
  Then I realized that there's enough body of work in the Journal to
  be
  worth searching there whenever you have an ideas for dealing with
  X
  question. You might not find anything, but I think there's enough
  chance
  you will, illustrated by that encounter with skome.
 
  Then I realized it's not just the journal -- what about a Google
  Custom
  Search that searches over the Journal, the Code4Lib wiki, the
  Code4Lib
  website, and perhaps most interestinly -- all the sites listed in
  Planet
  Code4Lib.
 
  Then I made it happen. Cause it seemed interesting and I'm a
  perfectionist, I even set things up so a cronjob automatically syncs
  the
  list of sites in the Planet with the Google custom search every
  night.
 
  The Planet stuff ends up potentially being a lot of noise -- I tried
  to
  custom 'boost' stuff from the Journal, but I'm not sure it worked.
  But I
  did configure things with facet-like limits including a just the
  planet limit, if you do want that. But even though it's sometimes a
  lot
  of noise, it's also potentially the most interesting/useful part of
  the
  search, otherwise it'd pretty much just be a Journal search, but now
  it
  includes a bunch of people's blogs, as well as other sites deemed of
  interest to Code4Lib community (including a couple other open source
  library tech journals) -- without any extra curatorial work, just
  using
  the list already compiled for the Planet.
 
  I'm curious what people think of it. Try some searches for library
  tech
  questions or information and see how good your results are. If
  people
  find this useful, I'll try to include it on the main code4lib.org
  webpage in some prominent place, spruce up the look and feel etc.
  (Or
  try to draft someone else to do that, I think my time to work on
  this
  might be _just_ about up after staying until 9.30 hacking on this
  cause
  it seemed cool).
 
  http://www.code4lib.org/custom_search/search_form.html
 
 
 
 --
 Peter Murray peter.mur...@lyrasis.org tel:+1-678-235-2955
 Ass't Director, Technology Services Development http://dltj.org/about/
 LYRASIS -- Great Libraries. Strong Communities. Innovative Answers.
 The Disruptive Library Technology Jester http://dltj.org/
 Attrib-Noncomm-Share http://creativecommons.org/licenses/by-nc-sa/2.5/


[CODE4LIB] I am king of the idiots: Re: [CODE4LIB] Code4Lib Community google custom search

2011-10-11 Thread Mark Jordan
Sorry everybody, I reponded to the wrong message. #lookuponceinawhile

- Original Message -
 Actually, he asked me about it on Friday and I told him it would be
 posted soon. I'm meeting with him this afternoon to go over the media
 stuff so I'll mention it then.
 
 Mark
 
 Mark Jordan
 Head of Library Systems
 W.A.C. Bennett Library, Simon Fraser University
 Burnaby, British Columbia, V5A 1S6, Canada
 Voice: 778.782.5753 / Fax: 778.782.3023 / Skype: mark.jordan50
 mjor...@sfu.ca
 
 - Original Message -
  Love the idea, but the form is now throwing a 404 error on
  submission.
  Any chance it can be fixed?
 
 
  Peter
 
  On Oct 6, 2011, at 9:35 PM, Jonathan Rochkind wrote:
   So I was in #code4lib, and skome asked about ideas for library
   hours.
   And I recalled that there have been at least two articles in the
   C4L
   Journal on this topic, so suggested them.
  
   Then I realized that there's enough body of work in the Journal to
   be
   worth searching there whenever you have an ideas for dealing with
   X
   question. You might not find anything, but I think there's enough
   chance
   you will, illustrated by that encounter with skome.
  
   Then I realized it's not just the journal -- what about a Google
   Custom
   Search that searches over the Journal, the Code4Lib wiki, the
   Code4Lib
   website, and perhaps most interestinly -- all the sites listed in
   Planet
   Code4Lib.
  
   Then I made it happen. Cause it seemed interesting and I'm a
   perfectionist, I even set things up so a cronjob automatically
   syncs
   the
   list of sites in the Planet with the Google custom search every
   night.
  
   The Planet stuff ends up potentially being a lot of noise -- I
   tried
   to
   custom 'boost' stuff from the Journal, but I'm not sure it worked.
   But I
   did configure things with facet-like limits including a just the
   planet limit, if you do want that. But even though it's sometimes
   a
   lot
   of noise, it's also potentially the most interesting/useful part
   of
   the
   search, otherwise it'd pretty much just be a Journal search, but
   now
   it
   includes a bunch of people's blogs, as well as other sites deemed
   of
   interest to Code4Lib community (including a couple other open
   source
   library tech journals) -- without any extra curatorial work, just
   using
   the list already compiled for the Planet.
  
   I'm curious what people think of it. Try some searches for library
   tech
   questions or information and see how good your results are. If
   people
   find this useful, I'll try to include it on the main code4lib.org
   webpage in some prominent place, spruce up the look and feel etc.
   (Or
   try to draft someone else to do that, I think my time to work on
   this
   might be _just_ about up after staying until 9.30 hacking on this
   cause
   it seemed cool).
  
   http://www.code4lib.org/custom_search/search_form.html
 
 
 
  --
  Peter Murray peter.mur...@lyrasis.org tel:+1-678-235-2955
  Ass't Director, Technology Services Development
  http://dltj.org/about/
  LYRASIS -- Great Libraries. Strong Communities. Innovative Answers.
  The Disruptive Library Technology Jester http://dltj.org/
  Attrib-Noncomm-Share
  http://creativecommons.org/licenses/by-nc-sa/2.5/


Re: [CODE4LIB] Code4Lib Community google custom search

2011-10-07 Thread Susan Kane
I agree -- my search results were relevant and therefore -- it's useful!


Re: [CODE4LIB] Code4Lib Community google custom search

2011-10-07 Thread Roy Zimmer

I tried it, I like it, I thank you, Jonathan.
Already found something new and interesting.

Roy Zimmer
Western Michigan University


On 10/6/2011 9:35 PM, Jonathan Rochkind wrote:
So I was in #code4lib, and skome asked about ideas for library hours. 
And I recalled that there have been at least two articles in the C4L 
Journal on this topic, so suggested them.


Then I realized that there's enough body of work in the Journal to be 
worth searching there whenever you have an ideas for dealing with X 
question. You might not find anything, but I think there's enough 
chance you will, illustrated by that encounter with skome.


Then I realized it's not just the journal -- what about a Google 
Custom Search that searches over the Journal, the Code4Lib wiki, the 
Code4Lib website, and perhaps most interestinly -- all the sites 
listed in Planet Code4Lib.


Then I made it happen. Cause it seemed interesting and I'm a 
perfectionist, I even set things up so a cronjob automatically syncs 
the list of sites in the Planet with the Google custom search every 
night.


The Planet stuff ends up potentially being a lot of noise -- I tried 
to custom 'boost' stuff from the Journal, but I'm not sure it worked. 
But I did configure things with facet-like limits including a just 
the planet limit, if you do want that. But even though it's sometimes 
a lot of noise, it's also potentially the most interesting/useful part 
of the search, otherwise it'd pretty much just be a Journal search, 
but now it includes a bunch of people's blogs, as well as other sites 
deemed of interest to Code4Lib community (including a couple other 
open source library tech journals) -- without any extra curatorial 
work, just using the list already compiled for the Planet.


I'm curious what people think of it. Try some searches for library 
tech questions or information and see how good your results are. If 
people find this useful, I'll try to include it on the main 
code4lib.org webpage in some prominent place, spruce up the look and 
feel etc. (Or try to draft someone else to do that, I think my time to 
work on this might be _just_ about up after staying until 9.30 hacking 
on this cause it seemed cool).


http://www.code4lib.org/custom_search/search_form.html


Re: [CODE4LIB] Code4Lib Community google custom search

2011-10-07 Thread Sam Kome
Thanks! 
Also thanks for the human search engine answers via irc.  
-skome

-Original Message-
From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of 
Jonathan Rochkind
Sent: Thursday, October 06, 2011 6:35 PM
To: CODE4LIB@LISTSERV.ND.EDU
Subject: [CODE4LIB] Code4Lib Community google custom search

So I was in #code4lib, and skome asked about ideas for library hours. 
And I recalled that there have been at least two articles in the C4L Journal on 
this topic, so suggested them.

Then I realized that there's enough body of work in the Journal to be worth 
searching there whenever you have an ideas for dealing with X 
question. You might not find anything, but I think there's enough chance you 
will, illustrated by that encounter with skome.

Then I realized it's not just the journal -- what about a Google Custom Search 
that searches over the Journal, the Code4Lib wiki, the Code4Lib website, and 
perhaps most interestinly -- all the sites listed in Planet Code4Lib.

Then I made it happen. Cause it seemed interesting and I'm a perfectionist, I 
even set things up so a cronjob automatically syncs the list of sites in the 
Planet with the Google custom search every night.

The Planet stuff ends up potentially being a lot of noise -- I tried to custom 
'boost' stuff from the Journal, but I'm not sure it worked. But I did configure 
things with facet-like limits including a just the planet limit, if you do 
want that. But even though it's sometimes a lot of noise, it's also potentially 
the most interesting/useful part of the search, otherwise it'd pretty much just 
be a Journal search, but now it includes a bunch of people's blogs, as well as 
other sites deemed of interest to Code4Lib community (including a couple other 
open source library tech journals) -- without any extra curatorial work, just 
using the list already compiled for the Planet.

I'm curious what people think of it. Try some searches for library tech 
questions or information and see how good your results are. If people find this 
useful, I'll try to include it on the main code4lib.org webpage in some 
prominent place, spruce up the look and feel etc. (Or try to draft someone else 
to do that, I think my time to work on this might be _just_ about up after 
staying until 9.30 hacking on this cause it seemed cool).

http://www.code4lib.org/custom_search/search_form.html


[CODE4LIB] Code4Lib Community google custom search

2011-10-06 Thread Jonathan Rochkind
So I was in #code4lib, and skome asked about ideas for library hours. 
And I recalled that there have been at least two articles in the C4L 
Journal on this topic, so suggested them.


Then I realized that there's enough body of work in the Journal to be 
worth searching there whenever you have an ideas for dealing with X 
question. You might not find anything, but I think there's enough chance 
you will, illustrated by that encounter with skome.


Then I realized it's not just the journal -- what about a Google Custom 
Search that searches over the Journal, the Code4Lib wiki, the Code4Lib 
website, and perhaps most interestinly -- all the sites listed in Planet 
Code4Lib.


Then I made it happen. Cause it seemed interesting and I'm a 
perfectionist, I even set things up so a cronjob automatically syncs the 
list of sites in the Planet with the Google custom search every night.


The Planet stuff ends up potentially being a lot of noise -- I tried to 
custom 'boost' stuff from the Journal, but I'm not sure it worked. But I 
did configure things with facet-like limits including a just the 
planet limit, if you do want that. But even though it's sometimes a lot 
of noise, it's also potentially the most interesting/useful part of the 
search, otherwise it'd pretty much just be a Journal search, but now it 
includes a bunch of people's blogs, as well as other sites deemed of 
interest to Code4Lib community (including a couple other open source 
library tech journals) -- without any extra curatorial work, just using 
the list already compiled for the Planet.


I'm curious what people think of it. Try some searches for library tech 
questions or information and see how good your results are. If people 
find this useful, I'll try to include it on the main code4lib.org 
webpage in some prominent place, spruce up the look and feel etc. (Or 
try to draft someone else to do that, I think my time to work on this 
might be _just_ about up after staying until 9.30 hacking on this cause 
it seemed cool).


http://www.code4lib.org/custom_search/search_form.html


Re: [CODE4LIB] Code4Lib Community google custom search

2011-10-06 Thread Jonathan Rochkind
(PS: Thanks a lot to ryan wick for spending time helping to get a 
reasonable ruby environment installed on the code4lib.org server, so I 
could then get my scripting done quickly and pleasantly.)


On 10/6/2011 9:35 PM, Jonathan Rochkind wrote:
So I was in #code4lib, and skome asked about ideas for library hours. 
And I recalled that there have been at least two articles in the C4L 
Journal on this topic, so suggested them.


Then I realized that there's enough body of work in the Journal to be 
worth searching there whenever you have an ideas for dealing with X 
question. You might not find anything, but I think there's enough 
chance you will, illustrated by that encounter with skome.


Then I realized it's not just the journal -- what about a Google 
Custom Search that searches over the Journal, the Code4Lib wiki, the 
Code4Lib website, and perhaps most interestinly -- all the sites 
listed in Planet Code4Lib.


Then I made it happen. Cause it seemed interesting and I'm a 
perfectionist, I even set things up so a cronjob automatically syncs 
the list of sites in the Planet with the Google custom search every 
night.


The Planet stuff ends up potentially being a lot of noise -- I tried 
to custom 'boost' stuff from the Journal, but I'm not sure it worked. 
But I did configure things with facet-like limits including a just 
the planet limit, if you do want that. But even though it's sometimes 
a lot of noise, it's also potentially the most interesting/useful part 
of the search, otherwise it'd pretty much just be a Journal search, 
but now it includes a bunch of people's blogs, as well as other sites 
deemed of interest to Code4Lib community (including a couple other 
open source library tech journals) -- without any extra curatorial 
work, just using the list already compiled for the Planet.


I'm curious what people think of it. Try some searches for library 
tech questions or information and see how good your results are. If 
people find this useful, I'll try to include it on the main 
code4lib.org webpage in some prominent place, spruce up the look and 
feel etc. (Or try to draft someone else to do that, I think my time to 
work on this might be _just_ about up after staying until 9.30 hacking 
on this cause it seemed cool).


http://www.code4lib.org/custom_search/search_form.html


Re: [CODE4LIB] Code4Lib Community google custom search

2011-10-06 Thread Rob Casson
jrochkind++ # very cool, and
wickr++ # for the assist.

beyond my personal use, this will be my first suggestion for a lot of
my colleagues' questions/etc.  cheers.

On Thu, Oct 6, 2011 at 9:46 PM, Jonathan Rochkind rochk...@jhu.edu wrote:
 (PS: Thanks a lot to ryan wick for spending time helping to get a reasonable
 ruby environment installed on the code4lib.org server, so I could then get
 my scripting done quickly and pleasantly.)

 On 10/6/2011 9:35 PM, Jonathan Rochkind wrote:

 So I was in #code4lib, and skome asked about ideas for library hours. And
 I recalled that there have been at least two articles in the C4L Journal on
 this topic, so suggested them.

 Then I realized that there's enough body of work in the Journal to be
 worth searching there whenever you have an ideas for dealing with X
 question. You might not find anything, but I think there's enough chance you
 will, illustrated by that encounter with skome.

 Then I realized it's not just the journal -- what about a Google Custom
 Search that searches over the Journal, the Code4Lib wiki, the Code4Lib
 website, and perhaps most interestinly -- all the sites listed in Planet
 Code4Lib.

 Then I made it happen. Cause it seemed interesting and I'm a
 perfectionist, I even set things up so a cronjob automatically syncs the
 list of sites in the Planet with the Google custom search every night.

 The Planet stuff ends up potentially being a lot of noise -- I tried to
 custom 'boost' stuff from the Journal, but I'm not sure it worked. But I did
 configure things with facet-like limits including a just the planet limit,
 if you do want that. But even though it's sometimes a lot of noise, it's
 also potentially the most interesting/useful part of the search, otherwise
 it'd pretty much just be a Journal search, but now it includes a bunch of
 people's blogs, as well as other sites deemed of interest to Code4Lib
 community (including a couple other open source library tech journals) --
 without any extra curatorial work, just using the list already compiled for
 the Planet.

 I'm curious what people think of it. Try some searches for library tech
 questions or information and see how good your results are. If people find
 this useful, I'll try to include it on the main code4lib.org webpage in some
 prominent place, spruce up the look and feel etc. (Or try to draft someone
 else to do that, I think my time to work on this might be _just_ about up
 after staying until 9.30 hacking on this cause it seemed cool).

 http://www.code4lib.org/custom_search/search_form.html



Re: [CODE4LIB] Code4Lib Community google custom search

2011-10-06 Thread Andrew Nagy
Nice job Jonathan - my first test search seemed to bring back rather
relevant materials with the first coming from the journal:
http://www.google.com/cse?cref=http%3A%2F%2Fcode4lib.org%2Ftest%2Fgoogle_cse_context.xmlq=virtual+referencesa=Searchsiteurl=www.code4lib.org%2Fcustom_search%2Fsearch_form.html#gsc.tab=0gsc.q=virtual%20referencegsc.page=1

Very cool and very useful

Andrew

On Thu, Oct 6, 2011 at 9:35 PM, Jonathan Rochkind rochk...@jhu.edu wrote:

 So I was in #code4lib, and skome asked about ideas for library hours. And I
 recalled that there have been at least two articles in the C4L Journal on
 this topic, so suggested them.

 Then I realized that there's enough body of work in the Journal to be worth
 searching there whenever you have an ideas for dealing with X question.
 You might not find anything, but I think there's enough chance you will,
 illustrated by that encounter with skome.

 Then I realized it's not just the journal -- what about a Google Custom
 Search that searches over the Journal, the Code4Lib wiki, the Code4Lib
 website, and perhaps most interestinly -- all the sites listed in Planet
 Code4Lib.

 Then I made it happen. Cause it seemed interesting and I'm a perfectionist,
 I even set things up so a cronjob automatically syncs the list of sites in
 the Planet with the Google custom search every night.

 The Planet stuff ends up potentially being a lot of noise -- I tried to
 custom 'boost' stuff from the Journal, but I'm not sure it worked. But I did
 configure things with facet-like limits including a just the planet limit,
 if you do want that. But even though it's sometimes a lot of noise, it's
 also potentially the most interesting/useful part of the search, otherwise
 it'd pretty much just be a Journal search, but now it includes a bunch of
 people's blogs, as well as other sites deemed of interest to Code4Lib
 community (including a couple other open source library tech journals) --
 without any extra curatorial work, just using the list already compiled for
 the Planet.

 I'm curious what people think of it. Try some searches for library tech
 questions or information and see how good your results are. If people find
 this useful, I'll try to include it on the main code4lib.org webpage in
 some prominent place, spruce up the look and feel etc. (Or try to draft
 someone else to do that, I think my time to work on this might be _just_
 about up after staying until 9.30 hacking on this cause it seemed cool).

 http://www.code4lib.org/**custom_search/search_form.htmlhttp://www.code4lib.org/custom_search/search_form.html