Mirror entire website with wget:
Example (Replace example.com with wanted website):
wget --wait=2 --level=inf --limit-rate=2M --recursive --page-requisites --user-agent="Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36" --no-parent --convert-links --adjust-extension --no-clobber -e robots=off https://example.com
*This will clone entire website, not Just a page.
Some advice:
- You want the --limit-rate slow enough so the website wont quickly ban you. But fast enough that you wont constantly time out. Around 2M is a decent speed in Jan 2024.
- For the user agent. Its best to update it with a common current web browser such as a recent version of chrome on a common OS and ISA.
The one posted above is one currently used by Vivaldi (Linux X86_64) as of Jan 2024.
- Images may not re-point to local mirror. Might have to manually fix them.
--------------------------------------------------------------------------------------------
Source | Date: Date in Vivaldi: December 27th 2023
Back