Re: [techtalk] Linux Agents/Robots ??

[Kelly Lynn Martin]

On Mon, 6 Mar 2000 17:52:13 -0500, Subba Rao <[EMAIL PROTECTED]> said:

>Are there any command line search agents/bots/crawlers for Linux? I
>want to search a few engines at the same time for some key topics.

If you do perl, check out the LWP module.  It includes a relatively
easy to customize generic crawler component.

Kelly

************
[EMAIL PROTECTED]   http://www.linuxchix.org