[techtalk] Linux Agents/Robots ??
Kelly Lynn Martin
kelly at poverty.bloomington.in.us
Mon Mar 6 21:26:12 EST 2000
On Mon, 6 Mar 2000 17:52:13 -0500, Subba Rao <subb3 at attglobal.net> said:
>Are there any command line search agents/bots/crawlers for Linux? I
>want to search a few engines at the same time for some key topics.
If you do perl, check out the LWP module. It includes a relatively
easy to customize generic crawler component.
techtalk at linuxchix.org http://www.linuxchix.org
More information about the Techtalk