Home > Simple web spidering trick for wget

Simple web spidering trick for wget

29th April 2009

If you want to spider a site from a path far down a branch of the document tree, try the following wget invocation:

wget --mirror --relative --no-parent [URL]

This prevents wget from traversing back up the parent and fetching the whole site.

Tags: computers, programming, wget