How to Download an Entire Website with WGET. -------------------------------------------------------- Wget is a command line program available on Liunux, Windows & OS X. the name of the program is typed into a terminal followed by the required arguments. To download a single file with wget we use the command: "wget website/file.ext" To download recursively all files linked to a page you want to download, -r is used. "wget -r website/index.html" In the case a web server does not allow download managers, -U can be used to tell the web server you are using a common web browser: "wget -r -U Mozilla website/index.html" Some web servers may blacklist an IP if it notices that the all pages are being downloaded quickly. the –wait=15 option will prevent this: "wget --wait=15 -r -U Mozilla website/index.html" The download rate can also be set with the –limit-rate=64K option. limit rate defaults to bytes so a K must be placed after a number for kilobytes: "wget --wait=15 --limit-rate=64K -r -U Mozilla website/index.html" To make sure that wget does not download files from parent directories, –no-parent can be used: "wget --wait=15 --limit-rate=64K --no-parent -r -U Mozilla website/index.html"
Posted on: Sat, 03 Aug 2013 07:50:35 +0000