Bug#240900: acknowledged by developer (Re: Bug#240900: debian-www: Mirror Size page needs updating)
On Wed, Apr 21, 2004 at 07:06:33PM +0200, Frank Lichtenheld wrote: > I finally got around to calculate the arch totals: > > alpha 7351 > arm 5835 > hppa 6610 > hurd-i386 688 > i386 8345 > ia64 7898 > m68k 5654 > mips 5794 > mipsel 5746 > powerpc 7087 > s390 6168 > sparc 6324 > all 7579 > > Have changed the webpage accordingly. Since mmagelle hasn't answered, > the link just stays removed. > Closing the bug. Thanks a lot! Ryan
Bug#240900: debian-www: Mirror Size page needs updating
* Frank Lichtenheld <[EMAIL PROTECTED]> [040422 00:06]: > > Are you sure stable takes 8GB? I thought woody came with 7 CDs, 7*650MB > > = 4.5 GB ? > I never said that stable takes 8 GB... stable+testing+unstable takes > 8 GB (plus 8 GB for the all packages). Makes the 15 GB you have. > (Yeah, I know that I took ceil(size)...) Sorry, small missinderstanding. Yours sincerely, Alexander
Bug#240900: debian-www: Mirror Size page needs updating
Thanks for your findings guys. I'm a bit surprised since one debmirror run seemed to chew up more than 8GB for the binary portion of sid. I must have done something peculiar. Ryan
Bug#240900: debian-www: Mirror Size page needs updating
On Wed, Apr 21, 2004 at 11:26:29PM +0200, Jens Seidel wrote: > On Wed, Apr 21, 2004 at 10:00:57PM +0200, Frank Lichtenheld wrote: > > The numbers are for all suites (stable/testing/unstable) in total. Since all > > packages are stored under pool/ it is a rather complex task to mirror > > only one suite. Therefor it is recommended to always mirror whole > > architectures. > > Are you sure? It seems to be trivial to mirror only one flavour > (stable/testing/unstable) by downloading the file specified in the > Packages file: > Filename: pool/contrib/a/acl-installer/acl-installer_1.12_i386.deb I consider "rsync --exclude *.deb --include *_.deb --include *_all.deb" to be way simpler. I didn't say you can't do it... Gruesse, -- Frank Lichtenheld <[EMAIL PROTECTED]> www: http://www.djpig.de/
Bug#240900: debian-www: Mirror Size page needs updating
On Wed, Apr 21, 2004 at 09:57:15PM +0200, Alexander Schmehl wrote: > Are you sure stable takes 8GB? I thought woody came with 7 CDs, 7*650MB > = 4.5 GB ? I never said that stable takes 8 GB... stable+testing+unstable takes 8 GB (plus 8 GB for the all packages). Makes the 15 GB you have. (Yeah, I know that I took ceil(size)...) Gruesse, -- Frank Lichtenheld <[EMAIL PROTECTED]> www: http://www.djpig.de/
Bug#240900: debian-www: Mirror Size page needs updating
On Wed, Apr 21, 2004 at 10:00:57PM +0200, Frank Lichtenheld wrote: > On Wed, Apr 21, 2004 at 10:23:38AM -0700, Ryan Lovett wrote: > > On Wed, Apr 21, 2004 at 07:06:33PM +0200, Frank Lichtenheld wrote: > > > Ok, I did some quick tests: > > > the whole Debian archive is about 95 GB today, plus 3 GB for contrib > > > and non-free. > > > > > > i386 is about 8 GB, all too. So the 8 GB seems to be correct, probably > > > the 4 is too low. I download from time to time binary Debian Sid DVDs and the sizes are 4.4GB and 3.8GB. > > Thank you for looking into this for me. Is the 8 GB for i386 the total for > > stable? If so, do you have the breakdown for unstable? (I should've > > mentioned > > this before.) If its not too much trouble, are there figures for binary and > > source as well? > > The numbers are for all suites (stable/testing/unstable) in total. Since all > packages are stored under pool/ it is a rather complex task to mirror > only one suite. Therefor it is recommended to always mirror whole > architectures. Are you sure? It seems to be trivial to mirror only one flavour (stable/testing/unstable) by downloading the file specified in the Packages file: Filename: pool/contrib/a/acl-installer/acl-installer_1.12_i386.deb > I only did some quick searches with du on gluck.d.o. To actually divide > that into binaries and source I would have to think of something smarter > than that or find a existing solution ;) So no, can't provide you > more information right now. But I can: Disk usage for binary sid packages (as of today): $ for f in /var/lib/apt/lists/ftp.debian.org_debian_dists_sid_*Packages; do sum=0 for i in $(sed -n 's/^Size: //p' $f); do sum=$(echo $sum+$i | bc) done echo $f $sum done /var/lib/apt/lists/ftp.debian.org_debian_dists_sid_contrib_binary-i386_Packages 245933488 /var/lib/apt/lists/ftp.debian.org_debian_dists_sid_main_binary-i386_Packages 8521006576 /var/lib/apt/lists/ftp.debian.org_debian_dists_sid_non-free_binary-i386_Packages 354617754 stable: /var/lib/apt/lists/ftp.debian.org_debian_dists_stable_contrib_binary-i386_Packages 110185752 /var/lib/apt/lists/ftp.debian.org_debian_dists_stable_main_binary-i386_Packages 4021300712 /var/lib/apt/lists/ftp.debian.org_debian_dists_stable_non-free_binary-i386_Packages 238591288 testing: /var/lib/apt/lists/ftp.debian.org_debian_dists_testing_contrib_binary-i386_Packages 130586332 /var/lib/apt/lists/ftp.debian.org_debian_dists_testing_main_binary-i386_Packages 7766420252 /var/lib/apt/lists/ftp.debian.org_debian_dists_testing_non-free_binary-i386_Packages 325034070 stable source packages: $ for f in /var/lib/apt/lists/ftp.debian.org_debian_dists_stable_*_source_Sources; do sum=0 for i in $(egrep '(\.dsc|\.orig\.tar\.gz|\.diff\.gz)$' $f | cut -d" " -f3); do sum=$(echo $sum+$i | bc) done echo $f $sum done /var/lib/apt/lists/ftp.debian.org_debian_dists_stable_contrib_source_Sources 136718458 /var/lib/apt/lists/ftp.debian.org_debian_dists_stable_main_source_Sources 3858595919 /var/lib/apt/lists/ftp.debian.org_debian_dists_stable_non-free_source_Sources 248088230 testing: /var/lib/apt/lists/ftp.debian.org_debian_dists_testing_contrib_source_Sources 163720054 /var/lib/apt/lists/ftp.debian.org_debian_dists_testing_main_source_Sources 7131949892 /var/lib/apt/lists/ftp.debian.org_debian_dists_testing_non-free_source_Sources 337639440 unstable: /var/lib/apt/lists/ftp.debian.org_debian_dists_unstable_contrib_source_Sources 276999688 /var/lib/apt/lists/ftp.debian.org_debian_dists_unstable_main_source_Sources 7680484622 /var/lib/apt/lists/ftp.debian.org_debian_dists_unstable_non-free_source_Sources 351156728 I hope it helps, Jens
Bug#240900: debian-www: Mirror Size page needs updating
* Ryan Lovett <[EMAIL PROTECTED]> [040421 19:23]: > Thank you for looking into this for me. Is the 8 GB for i386 the total for > stable? If so, do you have the breakdown for unstable? (I should've mentioned > this before.) If its not too much trouble, are there figures for binary and > source as well? One moment... $ du -s /pub/debian 14988752/pub/debian Our stable, testing and unstable mirror (i386 without source) takes currently 15GB. Are you sure stable takes 8GB? I thought woody came with 7 CDs, 7*650MB = 4.5 GB ? Yours sincerely, Alexander signature.asc Description: Digital signature
Bug#240900: debian-www: Mirror Size page needs updating
On Wed, Apr 21, 2004 at 10:23:38AM -0700, Ryan Lovett wrote: > On Wed, Apr 21, 2004 at 07:06:33PM +0200, Frank Lichtenheld wrote: > > Ok, I did some quick tests: > > the whole Debian archive is about 95 GB today, plus 3 GB for contrib > > and non-free. > > > > i386 is about 8 GB, all too. So the 8 GB seems to be correct, probably > > the 4 is too low. > > Thank you for looking into this for me. Is the 8 GB for i386 the total for > stable? If so, do you have the breakdown for unstable? (I should've mentioned > this before.) If its not too much trouble, are there figures for binary and > source as well? The numbers are for all suites (stable/testing/unstable) in total. Since all packages are stored under pool/ it is a rather complex task to mirror only one suite. Therefor it is recommended to always mirror whole architectures. I only did some quick searches with du on gluck.d.o. To actually divide that into binaries and source I would have to think of something smarter than that or find a existing solution ;) So no, can't provide you more information right now. Gruesse, -- Frank Lichtenheld <[EMAIL PROTECTED]> www: http://www.djpig.de/
Bug#240900: debian-www: Mirror Size page needs updating
On Wed, Apr 21, 2004 at 07:06:33PM +0200, Frank Lichtenheld wrote: > On Mon, Mar 29, 2004 at 01:08:05PM -0800, Ryan Lovett wrote: > > http://www.debian.org/mirror/size > > > > has a link to http://ftp-master.debian.org/~mmagallo/ labeled "graphs of > > Debian archive size growth" which is currently 404 Not Found. Also, > > reports on the web indicate the 'released architecture' size of 4-8 GB > > may be out of date. > > > > http://braindamage.alal.com/archives/debian-user/20030916/4295.html > > > > This is only going by web reports since I don't run a mirror. (I'd like > > to run a local mirror, but I need to know how big it needs to be > > initially.) > > Ok, I did some quick tests: > the whole Debian archive is about 95 GB today, plus 3 GB for contrib > and non-free. > > i386 is about 8 GB, all too. So the 8 GB seems to be correct, probably > the 4 is too low. > > I will update the info on the website accordingly (and try to contact > mmagello, if his site is coming back). Thank you for looking into this for me. Is the 8 GB for i386 the total for stable? If so, do you have the breakdown for unstable? (I should've mentioned this before.) If its not too much trouble, are there figures for binary and source as well? Regards, Ryan
Bug#240900: debian-www: Mirror Size page needs updating
On Mon, Mar 29, 2004 at 01:08:05PM -0800, Ryan Lovett wrote: > http://www.debian.org/mirror/size > > has a link to http://ftp-master.debian.org/~mmagallo/ labeled "graphs of > Debian archive size growth" which is currently 404 Not Found. Also, > reports on the web indicate the 'released architecture' size of 4-8 GB > may be out of date. > > http://braindamage.alal.com/archives/debian-user/20030916/4295.html > > This is only going by web reports since I don't run a mirror. (I'd like > to run a local mirror, but I need to know how big it needs to be > initially.) Ok, I did some quick tests: the whole Debian archive is about 95 GB today, plus 3 GB for contrib and non-free. i386 is about 8 GB, all too. So the 8 GB seems to be correct, probably the 4 is too low. I will update the info on the website accordingly (and try to contact mmagello, if his site is coming back). Gruesse, -- Frank Lichtenheld <[EMAIL PROTECTED]> www: http://www.djpig.de/