Re: Download Manager

2004-07-14 Thread Adam R. B. Jack
Markus:

 Would you be willing to take the DownloadManager development on? I think
the
 'sharing' we'd get discussing it, and how to implement it, would be
 education for this team as a whole. I think we'd work out more details
with
 doing it this way.

?

regards

Adam



Re: Download Manager

2004-07-13 Thread Mark R. Diggory
Adam R. B. Jack wrote:
Ought we simple download it using Download-Manager w/ trusted? :)
Ought we not simple copy it down to the local repository location?
 

- copy file to a tmp-Directory with tmp-Name
- check tmp file to MD5
- if correct, copy tmp file to local repository with correct name
   

One thing I can chime in on here is that the mirror folks sure do like 
the idea of uploading to a staging area then copying to the desired 
location. It benefits their server side scripts to do this since an 
upload could take much longer time than a server side copy operation. 
I'm not sure how rsync handles partially complete uploaded files, but I 
know the signature scripts Henning is running via cron will generate an 
md5 for a partial file. Then when you upload your md5 they clearly don't 
match. Though this is a shortfall of his script, uploading to a staging 
area just seems more robust in the long run.

2cents,
Mark
begin:vcard
fn:Mark Diggory
n:Diggory;Mark
org:Harvard University;Harvard MIT Data Center
adr:Harvard University;;G-6 Littauer Center (North Yard);Cambridge;Ma;02138-2901;United States
email;internet:[EMAIL PROTECTED]
title:Software Engineer
tel;work:617 496 7246
tel;fax:617 495 0438
tel;home:617 718 2033 
tel;cell:617 285 4106
url:http://www.hmdc.harvard.edu
version:2.1
end:vcard



Re: Download Manager

2004-07-13 Thread Nick Chalko
Markus M. May wrote:
Hello, here are some ideas for the Download-Manager. What do you think?
- how to unit test this, without a download? - not possible, so the 
internet connection should be up and running for the testcase
For test check the files into cvs and use a repo url of 
file:///${basedir}/src/test-repo

R,
Nick