If you have a new account but are having problems posting or verifying your account, please email us on hello@boards.ie for help. Thanks :)

Hello all! Please ensure that you are posting a new thread or question in the appropriate forum. The Feedback forum is overwhelmed with questions that are having to be moved elsewhere. If you need help to verify your account contact hello@boards.ie

Muti-threaded command line download util

cgarvey · 2006-09-14 17:45:55

Does anyone know of a multi-threaded download command-line util that supports resume and user auth (HTTP Auth-Basic, at least). wget does all except the multi-thread aget and mget do all except the user auth is there such a thing that does all of the above?

14-09-2006 06:45PM

#1

cgarvey

Registered Users, Registered Users 2 Posts: 3,890 ✭✭✭

Join Date: April 2002

Posts: 3752

Does anyone know of a multi-threaded download command-line util that supports resume and user auth (HTTP Auth-Basic, at least).

wget does all except the multi-thread
aget and mget do all except the user auth

is there such a thing that does all of the above?

0

Comments

#2 14-09-2006 07:37PM

Steveire

Registered Users, Registered Users 2 Posts: 1,421 ✭✭✭

Join Date: June 2004

Posts: 1239

I think python can do those things. Look up urllib2 on python.org.

0
#3 14-09-2006 11:10PM

cgarvey

Registered Users, Registered Users 2 Posts: 3,890 ✭✭✭

Join Date: April 2002

Posts: 3752

Had a look at http://www.python.org/doc/2.3.5/lib/module-urllib2.html , but I don't see any mention of download ranges or multithreaded downloads.

0
#4 15-09-2006 11:15PM

bushy...

Closed Accounts Posts: 1,462 ✭✭✭

Join Date: July 2005

Posts: 1454

Would lftp do it ?

0
#5 16-09-2006 04:57AM

cgarvey

Registered Users, Registered Users 2 Posts: 3,890 ✭✭✭

Join Date: April 2002

Posts: 3752

Oooo close, but either it doesn't do HTTP Auth for multi-threaded downloads, or there is no reference in the docs on how to do it. If you use it, there's a "pget" command, but that doesn't seem to take -u or -p options, and if i set them at the lftp prompt, I get 401 (not auth) when using pget.

0