Bug#240900: acknowledged by developer (Re: Bug#240900: debian-www: Mirror Size page needs updating)

2004-04-28 Thread Ryan Lovett
On Wed, Apr 21, 2004 at 07:06:33PM +0200, Frank Lichtenheld wrote:
> I finally got around to calculate the arch totals:
> 
> alpha 7351
> arm 5835
> hppa 6610
> hurd-i386 688
> i386 8345
> ia64 7898
> m68k 5654
> mips 5794
> mipsel 5746
> powerpc 7087
> s390 6168
> sparc 6324
> all 7579
> 
> Have changed the webpage accordingly. Since mmagelle hasn't answered,
> the link just stays removed.
> Closing the bug.

Thanks a lot!

Ryan



Bug#240900: debian-www: Mirror Size page needs updating

2004-04-21 Thread Alexander Schmehl
* Frank Lichtenheld <[EMAIL PROTECTED]> [040422 00:06]:

> > Are you sure stable takes 8GB? I thought woody came with 7 CDs, 7*650MB
> > = 4.5 GB ?
> I never said that stable takes 8 GB... stable+testing+unstable takes
> 8 GB (plus 8 GB for the all packages). Makes the 15 GB you have.
> (Yeah, I know that I took ceil(size)...)

Sorry, small missinderstanding.


Yours sincerely,
  Alexander



Bug#240900: debian-www: Mirror Size page needs updating

2004-04-21 Thread Ryan Lovett
Thanks for your findings guys. I'm a bit surprised since one debmirror run
seemed to chew up more than 8GB for the binary portion of sid. I must have done
something peculiar.

Ryan



Bug#240900: debian-www: Mirror Size page needs updating

2004-04-21 Thread Frank Lichtenheld
On Wed, Apr 21, 2004 at 11:26:29PM +0200, Jens Seidel wrote:
> On Wed, Apr 21, 2004 at 10:00:57PM +0200, Frank Lichtenheld wrote:
> > The numbers are for all suites (stable/testing/unstable) in total. Since all
> > packages are stored under pool/ it is a rather complex task to mirror
> > only one suite. Therefor it is recommended to always mirror whole
> > architectures.
> 
> Are you sure? It seems to be trivial to mirror only one flavour
> (stable/testing/unstable) by downloading the file specified in the
> Packages file:
> Filename: pool/contrib/a/acl-installer/acl-installer_1.12_i386.deb

I consider "rsync --exclude *.deb --include *_.deb --include
*_all.deb" to be way simpler. I didn't say you can't do it...

Gruesse,
-- 
Frank Lichtenheld <[EMAIL PROTECTED]>
www: http://www.djpig.de/



Bug#240900: debian-www: Mirror Size page needs updating

2004-04-21 Thread Frank Lichtenheld
On Wed, Apr 21, 2004 at 09:57:15PM +0200, Alexander Schmehl wrote:
> Are you sure stable takes 8GB? I thought woody came with 7 CDs, 7*650MB
> = 4.5 GB ?

I never said that stable takes 8 GB... stable+testing+unstable takes
8 GB (plus 8 GB for the all packages). Makes the 15 GB you have.
(Yeah, I know that I took ceil(size)...)

Gruesse,
-- 
Frank Lichtenheld <[EMAIL PROTECTED]>
www: http://www.djpig.de/



Bug#240900: debian-www: Mirror Size page needs updating

2004-04-21 Thread Jens Seidel
On Wed, Apr 21, 2004 at 10:00:57PM +0200, Frank Lichtenheld wrote:
> On Wed, Apr 21, 2004 at 10:23:38AM -0700, Ryan Lovett wrote:
> > On Wed, Apr 21, 2004 at 07:06:33PM +0200, Frank Lichtenheld wrote:
> > > Ok, I did some quick tests:
> > >  the whole Debian archive is about 95 GB today, plus 3 GB for contrib
> > >  and non-free.
> > > 
> > >  i386 is about 8 GB, all too. So the 8 GB seems to be correct, probably
> > >  the 4 is too low.

I download from time to time binary Debian Sid DVDs and the sizes are 4.4GB and 
3.8GB.

> > Thank you for looking into this for me. Is the 8 GB for i386 the total for
> > stable? If so, do you have the breakdown for unstable? (I should've 
> > mentioned
> > this before.) If its not too much trouble, are there figures for binary and
> > source as well?
> 
> The numbers are for all suites (stable/testing/unstable) in total. Since all
> packages are stored under pool/ it is a rather complex task to mirror
> only one suite. Therefor it is recommended to always mirror whole
> architectures.

Are you sure? It seems to be trivial to mirror only one flavour
(stable/testing/unstable) by downloading the file specified in the
Packages file:
Filename: pool/contrib/a/acl-installer/acl-installer_1.12_i386.deb

> I only did some quick searches with du on gluck.d.o. To actually divide
> that into binaries and source I would have to think of something smarter
> than that or find a existing solution ;) So no, can't provide you
> more information right now.

But I can:

Disk usage for binary sid packages (as of today):

$ for f in /var/lib/apt/lists/ftp.debian.org_debian_dists_sid_*Packages; do
sum=0
for i in $(sed -n 's/^Size: //p' $f); do 
  sum=$(echo $sum+$i | bc)
done
echo $f $sum
  done
/var/lib/apt/lists/ftp.debian.org_debian_dists_sid_contrib_binary-i386_Packages 
245933488
/var/lib/apt/lists/ftp.debian.org_debian_dists_sid_main_binary-i386_Packages 
8521006576
/var/lib/apt/lists/ftp.debian.org_debian_dists_sid_non-free_binary-i386_Packages
 354617754

stable:
/var/lib/apt/lists/ftp.debian.org_debian_dists_stable_contrib_binary-i386_Packages
 110185752
/var/lib/apt/lists/ftp.debian.org_debian_dists_stable_main_binary-i386_Packages 
4021300712
/var/lib/apt/lists/ftp.debian.org_debian_dists_stable_non-free_binary-i386_Packages
 238591288

testing:
/var/lib/apt/lists/ftp.debian.org_debian_dists_testing_contrib_binary-i386_Packages
 130586332
/var/lib/apt/lists/ftp.debian.org_debian_dists_testing_main_binary-i386_Packages
 7766420252
/var/lib/apt/lists/ftp.debian.org_debian_dists_testing_non-free_binary-i386_Packages
 325034070

stable source packages:
$ for f in 
/var/lib/apt/lists/ftp.debian.org_debian_dists_stable_*_source_Sources; do
sum=0
for i in $(egrep '(\.dsc|\.orig\.tar\.gz|\.diff\.gz)$' $f | cut -d" " -f3); 
do
  sum=$(echo $sum+$i | bc)
done
echo $f $sum
  done
/var/lib/apt/lists/ftp.debian.org_debian_dists_stable_contrib_source_Sources 
136718458
/var/lib/apt/lists/ftp.debian.org_debian_dists_stable_main_source_Sources 
3858595919
/var/lib/apt/lists/ftp.debian.org_debian_dists_stable_non-free_source_Sources 
248088230

testing:
/var/lib/apt/lists/ftp.debian.org_debian_dists_testing_contrib_source_Sources 
163720054
/var/lib/apt/lists/ftp.debian.org_debian_dists_testing_main_source_Sources 
7131949892
/var/lib/apt/lists/ftp.debian.org_debian_dists_testing_non-free_source_Sources 
337639440

unstable:
/var/lib/apt/lists/ftp.debian.org_debian_dists_unstable_contrib_source_Sources 
276999688
/var/lib/apt/lists/ftp.debian.org_debian_dists_unstable_main_source_Sources 
7680484622
/var/lib/apt/lists/ftp.debian.org_debian_dists_unstable_non-free_source_Sources 
351156728

I hope it helps,
Jens



Bug#240900: debian-www: Mirror Size page needs updating

2004-04-21 Thread Alexander Schmehl
* Ryan Lovett <[EMAIL PROTECTED]> [040421 19:23]:

> Thank you for looking into this for me. Is the 8 GB for i386 the total for
> stable? If so, do you have the breakdown for unstable? (I should've mentioned
> this before.) If its not too much trouble, are there figures for binary and
> source as well?

One moment...

$ du -s /pub/debian
14988752/pub/debian


Our stable, testing and unstable mirror (i386 without source) takes
currently 15GB.


Are you sure stable takes 8GB? I thought woody came with 7 CDs, 7*650MB
= 4.5 GB ?


Yours sincerely,
  Alexander


signature.asc
Description: Digital signature


Bug#240900: debian-www: Mirror Size page needs updating

2004-04-21 Thread Frank Lichtenheld
On Wed, Apr 21, 2004 at 10:23:38AM -0700, Ryan Lovett wrote:
> On Wed, Apr 21, 2004 at 07:06:33PM +0200, Frank Lichtenheld wrote:
> > Ok, I did some quick tests:
> >  the whole Debian archive is about 95 GB today, plus 3 GB for contrib
> >  and non-free.
> > 
> >  i386 is about 8 GB, all too. So the 8 GB seems to be correct, probably
> >  the 4 is too low.
> 
> Thank you for looking into this for me. Is the 8 GB for i386 the total for
> stable? If so, do you have the breakdown for unstable? (I should've mentioned
> this before.) If its not too much trouble, are there figures for binary and
> source as well?

The numbers are for all suites (stable/testing/unstable) in total. Since all
packages are stored under pool/ it is a rather complex task to mirror
only one suite. Therefor it is recommended to always mirror whole
architectures.

I only did some quick searches with du on gluck.d.o. To actually divide
that into binaries and source I would have to think of something smarter
than that or find a existing solution ;) So no, can't provide you
more information right now.

Gruesse,
-- 
Frank Lichtenheld <[EMAIL PROTECTED]>
www: http://www.djpig.de/



Bug#240900: debian-www: Mirror Size page needs updating

2004-04-21 Thread Ryan Lovett
On Wed, Apr 21, 2004 at 07:06:33PM +0200, Frank Lichtenheld wrote:
> On Mon, Mar 29, 2004 at 01:08:05PM -0800, Ryan Lovett wrote:
> > http://www.debian.org/mirror/size
> > 
> > has a link to http://ftp-master.debian.org/~mmagallo/ labeled "graphs of
> > Debian archive size growth" which is currently 404 Not Found. Also,
> > reports on the web indicate the 'released architecture' size of 4-8 GB
> > may be out of date.
> > 
> > http://braindamage.alal.com/archives/debian-user/20030916/4295.html
> > 
> > This is only going by web reports since I don't run a mirror. (I'd like
> > to run a local mirror, but I need to know how big it needs to be
> > initially.)
> 
> Ok, I did some quick tests:
>  the whole Debian archive is about 95 GB today, plus 3 GB for contrib
>  and non-free.
> 
>  i386 is about 8 GB, all too. So the 8 GB seems to be correct, probably
>  the 4 is too low.
> 
> I will update the info on the website accordingly (and try to contact
> mmagello, if his site is coming back).


Thank you for looking into this for me. Is the 8 GB for i386 the total for
stable? If so, do you have the breakdown for unstable? (I should've mentioned
this before.) If its not too much trouble, are there figures for binary and
source as well?

Regards,
Ryan



Bug#240900: debian-www: Mirror Size page needs updating

2004-04-21 Thread Frank Lichtenheld
On Mon, Mar 29, 2004 at 01:08:05PM -0800, Ryan Lovett wrote:
> http://www.debian.org/mirror/size
> 
> has a link to http://ftp-master.debian.org/~mmagallo/ labeled "graphs of
> Debian archive size growth" which is currently 404 Not Found. Also,
> reports on the web indicate the 'released architecture' size of 4-8 GB
> may be out of date.
> 
> http://braindamage.alal.com/archives/debian-user/20030916/4295.html
> 
> This is only going by web reports since I don't run a mirror. (I'd like
> to run a local mirror, but I need to know how big it needs to be
> initially.)

Ok, I did some quick tests:
 the whole Debian archive is about 95 GB today, plus 3 GB for contrib
 and non-free.

 i386 is about 8 GB, all too. So the 8 GB seems to be correct, probably
 the 4 is too low.

I will update the info on the website accordingly (and try to contact
mmagello, if his site is coming back).

Gruesse,
-- 
Frank Lichtenheld <[EMAIL PROTECTED]>
www: http://www.djpig.de/