Home > Simple web spidering trick for wget
Simple web spidering trick for wget
29th April 2009
If you want to spider a site from a path far down a branch of the document tree, try the following wget invocation:
wget --mirror --relative --no-parent [URL]
This prevents wget from traversing back up the parent and fetching the whole site.