Another option to get this to work more consistently for users who haven't set their BibTeX preference in Google Scholar is to use the "Related Links" URL in each entry to craft a URL that leads to the BibTeX. For example, the "related links" for a piece might look like
http://scholar.google.com/scholar?num=100&hl=en&lr=&client=firefox&q=related:O1sOP5RcQI0J:scholar.google.com/ while the "BibTeX" link looks like this: http://scholar.google.com/scholar.bib?num=100&hl=en&lr=&client=firefox&q=info:O1sOP5RcQI0J:scholar.google.com/&output=citation&oe=MACINTOSH&oi=citation As for decreasing the number of requests: My guess is that the scraper currently depends upon the BibTeX links, and would have to be rewritten to scrape the HTML directly (which is also usually a bad idea, since the format is usually subject to change) -AHM On Nov 9, 2007, at 12:30 PM, Hendrik wrote: > It could just be the fast sequence of requests for the BibTeX > entries that triggers it. In which case it might make sense to > change the scraper to only request the pages with the BibTeX upon > request. That is, when the user clicks on items in the second pane. > > Hendrik > > On 9-Nov-07, at 2:54 AM, Christiaan Hofman cmhofman-at-gmail.com | > Sourceforge| wrote: > >> I've also seen that. It seems they block you when you're doing too >> many searches under some conditions. I wonder what those conditions >> are, so we could correct it. Perhaps they require some kind of HTTP >> headers, like originating application info? >> >> Christiaan >> >> On 9 Nov 2007, at 10:52 AM, Hendrik wrote: > >>> However after trying a few successful queries (maybe 6-8 overall) >>> Google now seems to have blocked me. I get this now: >>> We're sorry... >>> ... but your query looks similar to automated requests from a >>> computer virus or spyware application. To protect our users, we >>> can't process your request right now. >>> >>> We'll restore your access as quickly as possible, so try again >>> soon. In the meantime, if you suspect that your computer or >>> network has been infected, you might want to run a virus checker >>> or spyware remover to make sure that your systems are free of >>> viruses and other spurious software. >>> >>> We apologize for the inconvenience, and hope we'll see you again >>> on Google. >>> >>> >>> >>> And answering the captcha below it doesn't help. >>> I guess Google does not like being scraped? >>> >>> Hendrik >>> > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Splunk Inc. > Still grepping through log files to find problems? Stop. > Now Search log events and configuration files using AJAX and a > browser. > Download your FREE copy of Splunk now >> > http://get.splunk.com/_______________________________________________ > Bibdesk-users mailing list > Bibdesk-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bibdesk-users ------------------------------------------------------------------------- This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ Bibdesk-users mailing list Bibdesk-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bibdesk-users
