[techtalk] Linux Agents/Robots ??

Kelly Lynn Martin kelly at poverty.bloomington.in.us
Mon Mar 6 21:26:12 EST 2000

On Mon, 6 Mar 2000 17:52:13 -0500, Subba Rao <subb3 at attglobal.net> said:

>Are there any command line search agents/bots/crawlers for Linux? I
>want to search a few engines at the same time for some key topics.

If you do perl, check out the LWP module.  It includes a relatively
easy to customize generic crawler component.


techtalk at linuxchix.org   http://www.linuxchix.org

More information about the Techtalk mailing list