For our example, suppose that http://www.example.org is a video hosting site and there is a little button "Download" below the videos.
We tell wget to download the page recursively (r), upto 2 levels, without making directories for domains (nd):
wget -r -l 2 -nd http://www.example.org
Now, this will also download all html pages linked with this page. We can exclude them if we want:
wget -r -l 2 -nd http://www.example.org -R *.html
If you have a slow system, make wget use less CPU power:
nice wget -r -l 2 -nd http://www.example.orgMake this process automatically occur everyday at 6 in the morning - open your crontab file using the command
crontab -eand add the following line
0 6 0 0 0 nice wget -r -l 2 -nd http://www.example.org
No comments:
Post a Comment