Re: using jigdo or/and rsync to keep images freshen.

2010-12-21 Thread Chris Davies
shirish शिरीष  wrote:
> I had been trying (unsuccessfully though) to use jigdo. Here's what I
> have been trying/wanting to do.

> From what I know Debian released Squeeze 6.0 b2 about 3-4 days  (on
> 6th IIRC). Now I know that debian also has a weekly build which is
> built every week which has all the updates as well has the latest
> updates to the debian-installer (specifically the graphical installer).

> What I want to do is keep the image current to whatever would be the
> weekly build.

You want the install image to remain as up-to-date as possible? OK. If
you want to use jigdo, your dependency is on the jigdo template.

Here's an example of how I would use jigdo for a CD image:

http://www.debian.org/CD/jigdo-cd/
http://cdimage.debian.org/cdimage/weekly-builds/i386/jigdo-cd/

- Install and run "jigdo-lite"

jigdo: 
http://cdimage.debian.org/cdimage/weekly-builds/i386/jigdo-cd/debian-testing-i386-CD-1.jigdo
Files to scan: {none}
Debian mirror: http://ftp.uk.debian.org/debian/

- This will download the ".jigdo" and ".template" files, which define
  the set of packages required, and where in the CD image each is to sit

- It will then download the packages for the CD image one at a time,
  and every so often will write those to the CD image defined by the
  template file

Here's the "clever" part. Should you want to update the image you have
previously (part) built, you simply mount it as a loopback (file-based)
CD image, and reference its mountpoint in the "Files to scan" prompt
from jigdo-lite:

sudo mkdir /mnt/iso
sudo mount -o loop debian-testing-i386-CD-1.iso.tmp /mnt/iso


I should point out that I tend to jigdo only rarely, as my systems have
online access and I can run an "aptitude update; aptitude dist-upgrade"
pair immediately after a minimal installation. This also means I usually
only download the first CD rather than a full DVD set.

Chris


-- 
To UNSUBSCRIBE, email to debian-user-requ...@lists.debian.org 
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/ggb6u7x1gd@news.roaima.co.uk



Re: using jigdo or/and rsync to keep images freshen.

2010-12-16 Thread Russell L. Harris
* shirish ???  [101216 21:21]:
> Hi all,
>  Disregard the above, re-read the mirroring page and this is what it
> should look like -
> 
> rsync --times --links --hard-links --partial -archive -verbose
> -compress --block-size=8192 --exclude=source/
> --exclude='*businesscard*.iso' --exclude='*netinst*.iso'
> --exclude=alpha/ --exclude=arm/ --exclude=hppa/ --exclude=hurd/
> --exclude=ia64/ --exclude=m68k/ --exclude=mips/ --exclude=mipsel/
> --exclude=powerpc/ --exclude=s390/ --exclude=sh/ --exclude=sparc/
> --exclude=i386/ --include='*-dvd.iso' ftp.de.debian.org::debian-cd/ .
> 
> or something like this. Now I wish there was a simpler way/command to do this.

Mirroring a repository is one matter, and is fairly complicated.  

But if your need is simply to keep a set of CD/DVD images up to date,
you really should be using jigdo (that is, jigdo-lite).  Jigdo minimizes
the load on the servers, and guarantees an accurate image.

You can write a set of bash scripts to automate the jigdo process, and
you even could run them via cron.  Note that several instances of
jigdo may run in parallel.

RLH


-- 
To UNSUBSCRIBE, email to debian-user-requ...@lists.debian.org 
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/20101216215501.gb3...@rlharris.org



Re: using jigdo or/and rsync to keep images freshen.

2010-12-16 Thread shirish शिरीष
Hi all,
 Disregard the above, re-read the mirroring page and this is what it
should look like -

rsync --times --links --hard-links --partial -archive -verbose
-compress --block-size=8192 --exclude=source/
--exclude='*businesscard*.iso' --exclude='*netinst*.iso'
--exclude=alpha/ --exclude=arm/ --exclude=hppa/ --exclude=hurd/
--exclude=ia64/ --exclude=m68k/ --exclude=mips/ --exclude=mipsel/
--exclude=powerpc/ --exclude=s390/ --exclude=sh/ --exclude=sparc/
--exclude=i386/ --include='*-dvd.iso' ftp.de.debian.org::debian-cd/ .

or something like this. Now I wish there was a simpler way/command to do this.
-- 
          Regards,
          Shirish Agarwal  शिरीष अग्रवाल
  My quotes in this email licensed under CC 3.0
http://creativecommons.org/licenses/by-nc/3.0/
http://flossexperiences.wordpress.com
065C 6D79 A68C E7EA 52B3  8D70 950D 53FB 729A 8B17


--
To UNSUBSCRIBE, email to debian-user-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: 
http://lists.debian.org/aanlktin48b=gyr_8syptlpfunx_cme_se+ptkxe3g...@mail.gmail.com



Re: using jigdo or/and rsync to keep images freshen.

2010-12-16 Thread shirish शिरीष
Hi all,
Now reading through the whole thing it seems it should be something like this :-

rsync -avzP --exclude=source/ --exclude='*businesscard*.iso'
--exclude='*netinst*.iso' --exclude=alpha/ --exclude=arm/
--exclude=hppa/ --exclude=hurd/ --exclude=ia64/ --exclude=m68k/
--exclude=mips/ --exclude=mipsel/ --exclude=powerpc/ --exclude=s390/
--exclude=sh/ --exclude=sparc/ --exclude=i386/ --include='*-dvd.iso'
ftp.de.debian.org::debian-cd/ .

What is missing is how do I also exclude the 5.0.x series as well and
only have live-current as the only download . Any ideas people ?
-- 
          Regards,
          Shirish Agarwal  शिरीष अग्रवाल
  My quotes in this email licensed under CC 3.0
http://creativecommons.org/licenses/by-nc/3.0/
http://flossexperiences.wordpress.com
065C 6D79 A68C E7EA 52B3  8D70 950D 53FB 729A 8B17


--
To UNSUBSCRIBE, email to debian-user-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: 
http://lists.debian.org/aanlkti=zzmjgbxtxc3-=p_h0h_74vpbrveps7ix3k...@mail.gmail.com



Re: using jigdo or/and rsync to keep images freshen.

2010-12-16 Thread shirish शिरीष
In-line :-

2010/12/16 Andrew McGlashan :
> Andrew McGlashan wrote:
>>
>> Andrew McGlashan wrote:
>> The dry run shows ONLY version 5.0.7 downlaods, plus a little more in
>> "project" files.
>>
>> To get a dry run with rsync, use the "n" option, just like you added the
>> "P" option before.
>>
>> The SITE I am using is as follows:
>>   SITE=mirrors.kernel.org
>
> I've downloaded about 27GB and with that I have 12 iso files, there are 294
> to go!  39 of which will be DVD iso files.  That's crazy, I won't be
> continuing through with the whole deal.  There are also many other files
> too, I have all the img files though.
>
> So, only 5.0.7 and then for EVERY architecture going. not a good idea to
> download the lot, my fun is over  ;-)
>
> --
> Kind Regards
> AndrewM
>
> Andrew McGlashan
> Broadband Solutions now including VoIP

I think we missed something, did you read
http://www.debian.org/CD/mirroring/#exclude

I think that's the key.

-- 
          Regards,
          Shirish Agarwal  शिरीष अग्रवाल
  My quotes in this email licensed under CC 3.0
http://creativecommons.org/licenses/by-nc/3.0/
http://flossexperiences.wordpress.com
065C 6D79 A68C E7EA 52B3  8D70 950D 53FB 729A 8B17


--
To UNSUBSCRIBE, email to debian-user-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: 
http://lists.debian.org/aanlktik8oazlansgf50yyuzyr2bt9ysbuqoqehcrg...@mail.gmail.com



Re: using jigdo or/and rsync to keep images freshen.

2010-12-16 Thread Andrew McGlashan

Andrew McGlashan wrote:

Andrew McGlashan wrote:
The dry run shows ONLY version 5.0.7 downlaods, plus a little more in 
"project" files.


To get a dry run with rsync, use the "n" option, just like you added the 
"P" option before.


The SITE I am using is as follows:
   SITE=mirrors.kernel.org


I've downloaded about 27GB and with that I have 12 iso files, there are 
294 to go!  39 of which will be DVD iso files.  That's crazy, I won't be 
continuing through with the whole deal.  There are also many other files 
too, I have all the img files though.


So, only 5.0.7 and then for EVERY architecture going. not a good 
idea to download the lot, my fun is over  ;-)


--
Kind Regards
AndrewM

Andrew McGlashan
Broadband Solutions now including VoIP


--
To UNSUBSCRIBE, email to debian-user-requ...@lists.debian.org 
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org

Archive: http://lists.debian.org/4d0a2c4b.20...@affinityvision.com.au



Re: using jigdo or/and rsync to keep images freshen.

2010-12-16 Thread Andrew McGlashan

Andrew McGlashan wrote:
I might do a dry run, just to get a full listing as well.  There are 
sure to be many files that I'm downloading that will have no real use 
for me as most of the time I just use a netinst iso.  And of course, the 
whole deal starts again when there is a newer release, a minor or a 
major one!


The dry run shows ONLY version 5.0.7 downlaods, plus a little more in 
"project" files.


To get a dry run with rsync, use the "n" option, just like you added the 
"P" option before.


The SITE I am using is as follows:
   SITE=mirrors.kernel.org

Cheers

--
Kind Regards
AndrewM

Andrew McGlashan
Broadband Solutions now including VoIP


--
To UNSUBSCRIBE, email to debian-user-requ...@lists.debian.org 
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org

Archive: http://lists.debian.org/4d0a28a1.9080...@affinityvision.com.au



Re: using jigdo or/and rsync to keep images freshen.

2010-12-16 Thread Andrew McGlashan

Hi,

shirish शिरीष wrote:

I followed the discussion on the web. So from what I learnt it should
be something like this :-

$ rsync -avzP ftp.de.debian.org::debian-cd/ /sda8/


I tried it too, with the $SITE variable set, this is my take:

rsync -avzP --delete ${SITE}::debian-cd/ ./debian-cd-mirror

I found that some mirrors didn't work as expected and others worked to a 
point, then I found one that kept on working and cleaned up the mess 
left behind by an old out of sync mirror (with the --delete option).



Ok I cancelled it, as it was downloading the 5.0.7 how do I tell it to
download  6.0 squeeze beta2 ?


I don't have an answer, it depends what is on the mirror I support, then 
you _might_ be able to path it to the right area.



Due to connection limitations at my end the download will not happen
in one go but over few days. So how do I set it up so that each time I
just run some command and it takes from where it left.


rsync will sort it out itself, you can stop it anytime and start it 
again and it'll work through the list again, provided it's not 
completely different, you won't be downloading the same files again.



$wget -c something.something


Yep, it doesn't work with all servers though, but the -c for continue is 
quite handy at times.


Further on this topic, the rsync I am doing has all kinds of files, such as:
   .tar.gz
   .iso
   .img
   .squashfs

I hope that one of the files that will download will tell me "how" all 
this is to be used somehow ;-)


I might do a dry run, just to get a full listing as well.  There are 
sure to be many files that I'm downloading that will have no real use 
for me as most of the time I just use a netinst iso.  And of course, the 
whole deal starts again when there is a newer release, a minor or a 
major one!


Cheers

--
Kind Regards
AndrewM

Andrew McGlashan
Broadband Solutions now including VoIP


--
To UNSUBSCRIBE, email to debian-user-requ...@lists.debian.org 
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org

Archive: http://lists.debian.org/4d0a227a.40...@affinityvision.com.au



Re: using jigdo or/and rsync to keep images freshen.

2010-12-16 Thread shirish शिरीष
In-line :-

2010/12/10 shirish शिरीष :



> rsync, have really no idea.

I followed the discussion on the web. So from what I learnt it should
be something like this :-

$ rsync -avzP ftp.de.debian.org::debian-cd/ /sda8/

where /sda8/ is where the download will happen.
> So ideas, ways please. I want to be able to in a place where I can use
> the new images as well as help out friends in case they need Debian
> images.

This is what I tried :-

$ mkdir beta2rsync
$ cd beta2rsync/
$ pwd /home/shirish/beta2rsync

~/beta2rsync$ rsync -avzP ftp.de.debian.org::debian-cd/ .

Welcome to the FTP Server of the Department of Computer Science,
 Dresden University of Technology, Germany.

General administration:   ftp...@inf.tu-dresden.de
Debian mirror related feedback:   debian-...@ftp.inf.tu-dresden.de

 Hint: Don't use checksum'ing (-c), it's disabled.

Module  | Content and size
+

receiving incremental file list
./
current -> 5.0.7
current-live -> 5.0.7-live
5.0.7-live/
5.0.7-live/amd64/
5.0.7-live/amd64/bt-cd/
5.0.7-live/amd64/bt-cd/debian-live-507-amd64-gnome-desktop.iso.torrent
   27623 100%  195.48kB/s0:00:00 (xfer#1, to-check=1057/1073)
5.0.7-live/amd64/bt-cd/debian-live-507-amd64-kde-desktop.iso.torrent
   27561 100%   78.93kB/s0:00:00 (xfer#2, to-check=1056/1073)
5.0.7-live/amd64/bt-cd/debian-live-507-amd64-lxde-desktop.iso.torrent
   36302 100%   56.01kB/s0:00:00 (xfer#3, to-check=1055/1073)
5.0.7-live/amd64/bt-cd/debian-live-507-amd64-rescue.iso.torrent
   26796 100%   33.25kB/s0:00:00 (xfer#4, to-check=1054/1073)
5.0.7-live/amd64/bt-cd/debian-live-507-amd64-standard.iso.torrent
8037 100%9.71kB/s0:00:00 (xfer#5, to-check=1053/1073)
5.0.7-live/amd64/bt-cd/debian-live-507-amd64-xfce-desktop.iso.torrent
   38462 100%   19.11kB/s0:00:01 (xfer#6, to-check=1052/1073)
5.0.7-live/amd64/bt-hdd/
5.0.7-live/amd64/bt-hdd/debian-live-507-amd64-gnome-desktop.img.torrent
 252 100%2.26kB/s0:00:00 (xfer#7, to-check=1051/1073)
5.0.7-live/amd64/bt-hdd/debian-live-507-amd64-kde-desktop.img.torrent
 250 100%2.24kB/s0:00:00 (xfer#8, to-check=1050/1073)
5.0.7-live/amd64/bt-hdd/debian-live-507-amd64-lxde-desktop.img.torrent
 251 100%2.25kB/s0:00:00 (xfer#9, to-check=1049/1073)
5.0.7-live/amd64/bt-hdd/debian-live-507-amd64-rescue.img.torrent
 245 100%2.20kB/s0:00:00 (xfer#10, to-check=1048/1073)
5.0.7-live/amd64/bt-hdd/debian-live-507-amd64-standard.img.torrent
 247 100%2.21kB/s0:00:00 (xfer#11, to-check=1047/1073)
5.0.7-live/amd64/bt-hdd/debian-live-507-amd64-xfce-desktop.img.torrent
 251 100%2.25kB/s0:00:00 (xfer#12, to-check=1046/1073)
5.0.7-live/amd64/iso-cd/
5.0.7-live/amd64/iso-cd/MD5SUMS
1820 100%6.53kB/s0:00:00 (xfer#13, to-check=1045/1073)
5.0.7-live/amd64/iso-cd/MD5SUMS.sign
 198 100%0.71kB/s0:00:00 (xfer#14, to-check=1044/1073)
5.0.7-live/amd64/iso-cd/SHA1SUMS
2012 100%7.20kB/s0:00:00 (xfer#15, to-check=1043/1073)
5.0.7-live/amd64/iso-cd/SHA1SUMS.sign
 198 100%0.71kB/s0:00:00 (xfer#16, to-check=1042/1073)
5.0.7-live/amd64/iso-cd/SHA256SUMS
2588 100%9.26kB/s0:00:00 (xfer#17, to-check=1041/1073)
5.0.7-live/amd64/iso-cd/SHA256SUMS.sign
 198 100%0.71kB/s0:00:00 (xfer#18, to-check=1040/1073)
5.0.7-live/amd64/iso-cd/debian-live-507-amd64-gnome-desktop.iso
  858441   0%   31.63kB/s6:17:32  ^C
rsync error: received SIGINT, SIGTERM, or SIGHUP (code 20) at
rsync.c(543) [receiver=3.0.7]
rsync error: received SIGINT, SIGTERM, or SIGHUP (code 20) at
rsync.c(543) [generator=3.0.7]

Ok I cancelled it, as it was downloading the 5.0.7 how do I tell it to
download  6.0 squeeze beta2 ?

Due to connection limitations at my end the download will not happen
in one go but over few days. So how do I set it up so that each time I
just run some command and it takes from where it left.

In wget its simple,

$wget something.something.

Do a CTRL+C in case you want to quit or connection goes out or anything.

then do

$wget -c something.something

It will check how much it has downloaded and get the rest.

This of course depends on the server supporting download resuming.

Sorry for the long mail.

Please CC me as I'm not subscribed to the list.
-- 
          Regards,
          Shirish Agarwal  शिरीष अग्रवाल
  My quotes in this email licensed under CC 3.0
http://creativecommons.org/licenses/by-nc/3.0/
http://flossexperiences.wordpress.com
065C 6D79 A68C E7EA 52B3  8D70 950D 53FB 729A 8B17


--
To UNSUBSCRIBE, email to debian-user-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: 
http://lists.debian.org/aanlktikvmf3uacplljx=x+up_moj59g2v_hpi5u47...@mail.gmail.com



Re: using jigdo or/and rsync to keep images freshen.

2010-12-11 Thread Hugo Vanwoerkom

Rob Owens wrote:

On Fri, Dec 10, 2010 at 11:28:03AM -0600, Hugo Vanwoerkom wrote:







Try using the '-P' switch for rsync.



Thanks!

Hugo


--
To UNSUBSCRIBE, email to debian-user-requ...@lists.debian.org 
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org

Archive: http://lists.debian.org/ie0865$rk...@dough.gmane.org



Re: using jigdo or/and rsync to keep images freshen.

2010-12-10 Thread Rob Owens
On Fri, Dec 10, 2010 at 11:28:03AM -0600, Hugo Vanwoerkom wrote:
> Hugo Vanwoerkom wrote:
>> Hugo Vanwoerkom wrote:
>>> shirish शिरीष wrote:
 Hi all,
 I had been trying (unsuccessfully though) to use jigdo. Here's what I
 have been trying/wanting to do.

> From what I know Debian released Squeeze 6.0 b2 about 3-4 days  (on
 6th IIRC). Now I know that debian also has a weekly build which is
 built every week which has all the updates as well has the latest
 updates to the debian-installer (specifically the graphical installer)
 . What I want to do is keep the image current to whatever would be the
 weekly build.

 There are 4 ways in which this can be achieved.

 a. Do the straight download through the server using a download
 manager/wget whatever.
 b. Do a torrent download every week.

 Both the above ideas aren't bandwidth efficient as I would have to
 download say in 2 weeks something like 1.2 GB even if I'm thinking
 about having a CD downloaded.

 Also IIRC on many of these images, there is no resume available and
 hence would have to download from start.

 So two ways remain .

 1. jigdo
 2. rsync

> From what little I know the idea behind both of these is that it will
 download only the diff between the files. Instead of downloading 600
 MB to 4.4 GB again, one might save 60-70% in bandwidth (supposedly)
 using either of these ways.

 I tried jigdo but it didn't work for me. It was downloading files and
 after an hour or more of downloading files I did a CTRL+C or something
 like that to know if it can resume from there. It said something about
 merging and when I did again it started right from the beginning . I
 did read a mini howto online but that didn't help. There are two
 things which I didn't like specifically.

 While it is verbose, it isn't verbose as in how much (in percentage
 and time estimation) about how much time it will take to do the whole
 thing first time.

 One way I see out of this is to download the file first through a
 torrent, then put the same file using jigdo and then next week when a
 new jigdo file comes work through that, is my logic sound ?

 Also I do know that jigdo is in maintenance mode so don't see any
 possibility of a GUIfied version of it.

 rsync, have really no idea.

>>>
>>> Did you try http://www.debian.org/CD/mirroring/rsync-mirrors ?
>>>
>>
>> I did. And I got this. But what's next?
>>
>
> So if you make that 'rsync -avz ftp.de.debian.org::debian-cd/ /sda8/' he  
> starts downloading everything. But the problem remains: you have no idea  
> how long that takes, while the wget approach tells you clearly when the  
> process is finished...
>
Try using the '-P' switch for rsync.

-Rob


-- 
To UNSUBSCRIBE, email to debian-user-requ...@lists.debian.org 
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/20101210174634.gb14...@aurora.owens.net



Re: using jigdo or/and rsync to keep images freshen.

2010-12-10 Thread Hugo Vanwoerkom

Hugo Vanwoerkom wrote:

Hugo Vanwoerkom wrote:

shirish शिरीष wrote:

Hi all,
I had been trying (unsuccessfully though) to use jigdo. Here's what I
have been trying/wanting to do.


From what I know Debian released Squeeze 6.0 b2 about 3-4 days  (on

6th IIRC). Now I know that debian also has a weekly build which is
built every week which has all the updates as well has the latest
updates to the debian-installer (specifically the graphical installer)
. What I want to do is keep the image current to whatever would be the
weekly build.

There are 4 ways in which this can be achieved.

a. Do the straight download through the server using a download
manager/wget whatever.
b. Do a torrent download every week.

Both the above ideas aren't bandwidth efficient as I would have to
download say in 2 weeks something like 1.2 GB even if I'm thinking
about having a CD downloaded.

Also IIRC on many of these images, there is no resume available and
hence would have to download from start.

So two ways remain .

1. jigdo
2. rsync


From what little I know the idea behind both of these is that it will

download only the diff between the files. Instead of downloading 600
MB to 4.4 GB again, one might save 60-70% in bandwidth (supposedly)
using either of these ways.

I tried jigdo but it didn't work for me. It was downloading files and
after an hour or more of downloading files I did a CTRL+C or something
like that to know if it can resume from there. It said something about
merging and when I did again it started right from the beginning . I
did read a mini howto online but that didn't help. There are two
things which I didn't like specifically.

While it is verbose, it isn't verbose as in how much (in percentage
and time estimation) about how much time it will take to do the whole
thing first time.

One way I see out of this is to download the file first through a
torrent, then put the same file using jigdo and then next week when a
new jigdo file comes work through that, is my logic sound ?

Also I do know that jigdo is in maintenance mode so don't see any
possibility of a GUIfied version of it.

rsync, have really no idea.



Did you try http://www.debian.org/CD/mirroring/rsync-mirrors ?



I did. And I got this. But what's next?



So if you make that 'rsync -avz ftp.de.debian.org::debian-cd/ /sda8/' he 
starts downloading everything. But the problem remains: you have no idea 
how long that takes, while the wget approach tells you clearly when the 
process is finished...


Hugo






--
To UNSUBSCRIBE, email to debian-user-requ...@lists.debian.org 
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org

Archive: http://lists.debian.org/idtnv5$i0...@dough.gmane.org



Re: using jigdo or/and rsync to keep images freshen.

2010-12-10 Thread Hugo Vanwoerkom

Hugo Vanwoerkom wrote:

shirish शिरीष wrote:

Hi all,
I had been trying (unsuccessfully though) to use jigdo. Here's what I
have been trying/wanting to do.


From what I know Debian released Squeeze 6.0 b2 about 3-4 days  (on

6th IIRC). Now I know that debian also has a weekly build which is
built every week which has all the updates as well has the latest
updates to the debian-installer (specifically the graphical installer)
. What I want to do is keep the image current to whatever would be the
weekly build.

There are 4 ways in which this can be achieved.

a. Do the straight download through the server using a download
manager/wget whatever.
b. Do a torrent download every week.

Both the above ideas aren't bandwidth efficient as I would have to
download say in 2 weeks something like 1.2 GB even if I'm thinking
about having a CD downloaded.

Also IIRC on many of these images, there is no resume available and
hence would have to download from start.

So two ways remain .

1. jigdo
2. rsync


From what little I know the idea behind both of these is that it will

download only the diff between the files. Instead of downloading 600
MB to 4.4 GB again, one might save 60-70% in bandwidth (supposedly)
using either of these ways.

I tried jigdo but it didn't work for me. It was downloading files and
after an hour or more of downloading files I did a CTRL+C or something
like that to know if it can resume from there. It said something about
merging and when I did again it started right from the beginning . I
did read a mini howto online but that didn't help. There are two
things which I didn't like specifically.

While it is verbose, it isn't verbose as in how much (in percentage
and time estimation) about how much time it will take to do the whole
thing first time.

One way I see out of this is to download the file first through a
torrent, then put the same file using jigdo and then next week when a
new jigdo file comes work through that, is my logic sound ?

Also I do know that jigdo is in maintenance mode so don't see any
possibility of a GUIfied version of it.

rsync, have really no idea.



Did you try http://www.debian.org/CD/mirroring/rsync-mirrors ?



I did. And I got this. But what's next?



Script started on Fri 10 Dec 2010 10:56:41 AM CST
/sda8Fri Dec 10-10:56:41# rsync ftp.de.debian.org::debian-cd/

Welcome to the FTP Server of the Department of Computer Science,
 Dresden University of Technology, 
Germany.


General administration:   ftp...@inf.tu-dresden.de
Debian mirror related feedback:   debian-...@ftp.inf.tu-dresden.de

 Hint: Don't use checksum'ing (-c), it's disabled.

Module  | Content and size
+

drwxr-xr-x  82 2010/12/06 08:29:11 .
lrwxrwxrwx   5 2010/11/30 03:32:26 current
lrwxrwxrwx  10 2010/12/06 08:29:04 current-live
drwxr-xr-x  42 2010/11/29 15:11:31 5.0.7-live
drwxr-sr-x4096 2010/11/28 15:47:50 5.0.7
drwxr-xr-x  30 2005/05/23 11:50:12 project
/sda8Fri Dec 10-10:56:48# exit
exit

Script done on Fri 10 Dec 2010 10:56:51 AM CST
















--
To UNSUBSCRIBE, email to debian-user-requ...@lists.debian.org 
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org

Archive: http://lists.debian.org/idtmap$6k...@dough.gmane.org



Re: using jigdo or/and rsync to keep images freshen.

2010-12-10 Thread Hugo Vanwoerkom

shirish शिरीष wrote:

Hi all,
I had been trying (unsuccessfully though) to use jigdo. Here's what I
have been trying/wanting to do.


From what I know Debian released Squeeze 6.0 b2 about 3-4 days  (on

6th IIRC). Now I know that debian also has a weekly build which is
built every week which has all the updates as well has the latest
updates to the debian-installer (specifically the graphical installer)
. What I want to do is keep the image current to whatever would be the
weekly build.

There are 4 ways in which this can be achieved.

a. Do the straight download through the server using a download
manager/wget whatever.
b. Do a torrent download every week.

Both the above ideas aren't bandwidth efficient as I would have to
download say in 2 weeks something like 1.2 GB even if I'm thinking
about having a CD downloaded.

Also IIRC on many of these images, there is no resume available and
hence would have to download from start.

So two ways remain .

1. jigdo
2. rsync


From what little I know the idea behind both of these is that it will

download only the diff between the files. Instead of downloading 600
MB to 4.4 GB again, one might save 60-70% in bandwidth (supposedly)
using either of these ways.

I tried jigdo but it didn't work for me. It was downloading files and
after an hour or more of downloading files I did a CTRL+C or something
like that to know if it can resume from there. It said something about
merging and when I did again it started right from the beginning . I
did read a mini howto online but that didn't help. There are two
things which I didn't like specifically.

While it is verbose, it isn't verbose as in how much (in percentage
and time estimation) about how much time it will take to do the whole
thing first time.

One way I see out of this is to download the file first through a
torrent, then put the same file using jigdo and then next week when a
new jigdo file comes work through that, is my logic sound ?

Also I do know that jigdo is in maintenance mode so don't see any
possibility of a GUIfied version of it.

rsync, have really no idea.



Did you try http://www.debian.org/CD/mirroring/rsync-mirrors ?

Hugo


--
To UNSUBSCRIBE, email to debian-user-requ...@lists.debian.org 
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org

Archive: http://lists.debian.org/idtlmr$6k...@dough.gmane.org



using jigdo or/and rsync to keep images freshen.

2010-12-10 Thread shirish शिरीष
Hi all,
I had been trying (unsuccessfully though) to use jigdo. Here's what I
have been trying/wanting to do.

>From what I know Debian released Squeeze 6.0 b2 about 3-4 days  (on
6th IIRC). Now I know that debian also has a weekly build which is
built every week which has all the updates as well has the latest
updates to the debian-installer (specifically the graphical installer)
. What I want to do is keep the image current to whatever would be the
weekly build.

There are 4 ways in which this can be achieved.

a. Do the straight download through the server using a download
manager/wget whatever.
b. Do a torrent download every week.

Both the above ideas aren't bandwidth efficient as I would have to
download say in 2 weeks something like 1.2 GB even if I'm thinking
about having a CD downloaded.

Also IIRC on many of these images, there is no resume available and
hence would have to download from start.

So two ways remain .

1. jigdo
2. rsync

>From what little I know the idea behind both of these is that it will
download only the diff between the files. Instead of downloading 600
MB to 4.4 GB again, one might save 60-70% in bandwidth (supposedly)
using either of these ways.

I tried jigdo but it didn't work for me. It was downloading files and
after an hour or more of downloading files I did a CTRL+C or something
like that to know if it can resume from there. It said something about
merging and when I did again it started right from the beginning . I
did read a mini howto online but that didn't help. There are two
things which I didn't like specifically.

While it is verbose, it isn't verbose as in how much (in percentage
and time estimation) about how much time it will take to do the whole
thing first time.

One way I see out of this is to download the file first through a
torrent, then put the same file using jigdo and then next week when a
new jigdo file comes work through that, is my logic sound ?

Also I do know that jigdo is in maintenance mode so don't see any
possibility of a GUIfied version of it.

rsync, have really no idea.

So ideas, ways please. I want to be able to in a place where I can use
the new images as well as help out friends in case they need Debian
images.
-- 
  Regards,
  Shirish Agarwal  शिरीष अग्रवाल
  My quotes in this email licensed under CC 3.0
http://creativecommons.org/licenses/by-nc/3.0/
http://flossexperiences.wordpress.com
065C 6D79 A68C E7EA 52B3  8D70 950D 53FB 729A 8B17


--
To UNSUBSCRIBE, email to debian-user-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
Archive: 
http://lists.debian.org/aanlktins7uuvtzp7m7vbufo5e9t6cpgm715yu4-av...@mail.gmail.com