[Techtalk] Scraping a webpage from a website.

EevaJärvinen eeva.jarvinen1 at luukku.com
Fri May 2 22:45:44 EST 2003

On pe, 2003-05-02 at 18:49, Jennifer Davis wrote:
> Hi.  I was wondering if there was a simple way to script and download a
> website so it can be placed somewhere else.  Essentially I need to
> retreive a site for a non-profit provided that is disbanding.  I would
> assume a shell or perl script could do it, but my scripting skills are not
> quite there yet.  Thanks...

If I understand you correctly, you simply want to copy a website
completely to another location.  I'd use either GNU wget (GPL) or curl
(MPL, MIT/X), both of which are available as free software.  If,
however, you'd like to copy a site's scripting facilities as well, I
think that is not possible, unless you get access to the site's
directory tree, in which case a simple rsync will do, *provided* you
have all the necessary utilities in your system to run the site.  (i.e.
if the site has php-scripts, you have to have php and so on)


...women are not obedient, chaste, scented, and exquisitely apparelled
by nature.  They can only attain these graces, without which they may
enjoy none of the delights of life, by the most tedious discipline.

                                                  V. Woolf, Orlando

More information about the Techtalk mailing list