>>>>> "Reinier" == Reinier Post <[EMAIL PROTECTED]> writes:

Reinier> On Mon, Mar 04, 2002 at 04:33:37PM +0530, kavitha malar wrote:
>> I want to search a text in a website how to do that through perl.

Reinier>    perl -MLWP::Simple -e \
Reinier>     'getprint http://www.google.com/search?q=$word+site:$site'

Reinier> I'm serious.  (This is what I use to find my own pages.)

Except now, Google has gotten fairly upset about "automated" page
fetches.  There's a thread on use.perl.org about it.

And last time I checked, Google *specifically* blocks the default
agent type that LWP uses, so you'll get no response.  You have
to change the agent type to something with "Mozilla" in it. :)

Gisle - would it be unfair to have a special useragent string
when LWP detects that it is visiting Google? :)

-- 
Randal L. Schwartz - Stonehenge Consulting Services, Inc. - +1 503 777 0095
<[EMAIL PROTECTED]> <URL:http://www.stonehenge.com/merlyn/>
Perl/Unix/security consulting, Technical writing, Comedy, etc. etc.
See PerlTraining.Stonehenge.com for onsite and open-enrollment Perl training!

Reply via email to