[techtalk] Linux Agents/Robots ??

[Kelly Lynn Martin]

On Mon, 6 Mar 2000 17:52:13 -0500, Subba Rao <subb3 at attglobal.net> said:

>Are there any command line search agents/bots/crawlers for Linux? I
>want to search a few engines at the same time for some key topics.

If you do perl, check out the LWP module.  It includes a relatively
easy to customize generic crawler component.

Kelly

************
techtalk at linuxchix.org   http://www.linuxchix.org