How do you download an entire website?

brian crackout

Im just wondering is it possible to download an entire website rather that saving each page individually? i have an assignment to do for college on reviewing websites and some of them are prettybig, i dont fancy spending all day saving pages... can anybody tell me if this is possible and if so how is it done???

thanks

quazzy

Google: WebZip

quazzy

Link: http://www.spidersoft.com/

Standard Toaster

Httrack

quazzy

The_Edge wrote:

Httrack

Must give that a try...

brian crackout

thanks for your help guys,
sorry for seeming so stupid but what does Httrack mean??

parasite

not sure, maybe HyperText track or something, it's the best prog for the job

Standard Toaster

www.httrack.com

zuma

I downloaded the komplett.ie website 1.5 years ago using httrack!

Worked great when I used the computer without an Internet connection and needed prices and other such info.

MrVestek

zuma wrote:

I downloaded the komplett.ie website 1.5 years ago using httrack!

Worked great when I used the computer without an Internet connection and needed prices and other such info.

Wow that's just.... that's just.... wow.

Laguna

sitesucker for mac.

Orion

Another vote for HtTrack - it's the bog's dollox.

Capt'n Midnight

another thumbs up for winhttrack - don't forget to check the options to avoid certain file types to speed it up.

Karoma

winhttrack gets a thumb up..
just be careful of the options that you choose, both from a performance point of view and from a getting-your-ip-banned point of view:)

zuma

Achilles wrote:

Wow that's just.... that's just.... wow.

I might try it again today...for the fun of it!!!

When I last downloaded the website it was only 150MB in size but crawled along at about 15KBYtes while downloading:rolleyes:

========================================================

Just started downloading it again...getting an average of 65KBytes after about a minute...will tell you the websites current size when finished!!

Capt'n Midnight

If using IE you might want to look at xpantispy. it gives an option to allow up to 10 connections per site. ( yes there is/was an option in IE to down load sites or at least linked pages , but ain't worth the hassel )

zuma

Downloade komplett.ie in about 1.5hours a couple of hours ago and it came in at about ~325MB for the data...but due t the massive amount of small files it takes up ~370 on my NTFS partitioned HDD!!!!

It works perfectly and I cant view everything I need.

I got it working easily as I have used it before but once you set connections to 32 and a couple of other settings your flying!!

httrack all the way!!!

WizZard

:rolleyes: Now try boards.ie

SouperComputer

WizZard wrote:

:rolleyes: Now try boards.ie

that could take a while!

Capt'n Midnight

WizZard wrote:

:rolleyes: Now try boards.ie

Don't forget to run a second pass on the off chance there are any new posts since you started.

Skrynesaver

I tend to use wget, can restrict it to individual servers, directories or everthing the site points at to a defined level.
mirror is also quite good, and if you are analysing web pages and text in general a copy of Perl is a useful thing to have about the machine