Re: [opensuse-factory] ludicrous software management

2006-12-02 Thread Christoph Thiel
Hi Eberhard,

On Fri, Dec 01, 2006 at 01:02:14AM +0100, Eberhard Moenkeberg wrote:

> > > Interesting.
> > > What is the delivery bandwidth of ftp.skynet.be?
> > > 
> > > Maybe Christoph should extend the redirect algorithm at 
> > > download.opensuse.org to respect outgoing bandwidth...
> > 
> > Sure, that would be nice to have -- but how should d.o.o get an idea of the
> > current load on a mirror? Any suggestions? :)
> 
> By the number of taken redirections within the last "time window". We
> could further refine that with a load measure of the servers at a counted
> number of sessions.

Might be an option, but I would rathe like to have the mirrors somehow
notify the redirector about their status. Ie. be able to automatically
influence it.


> BTW: even 3000 http sessions are no problem at ftp-1.gwdg.de - network
> delivery currently is 78 MB/sec, while disk I/O is 7 MB/sec. The huge
> RAM/buffer cache of 32 MB really is the biggest helper...
  ^ I wish I had 32 MB as well ;)

Best,
Christoph
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]



Re: [opensuse-factory] ludicrous software management

2006-11-30 Thread Eberhard Moenkeberg
Hi.

On Fri, 1 Dec 2006, Christoph Thiel wrote:
> On Fri, Dec 01, 2006 at 12:05:33AM +0100, Eberhard Moenkeberg wrote:

> > Interesting.
> > What is the delivery bandwidth of ftp.skynet.be?
> > 
> > Maybe Christoph should extend the redirect algorithm at 
> > download.opensuse.org to respect outgoing bandwidth...
> 
> Sure, that would be nice to have -- but how should d.o.o get an idea of the
> current load on a mirror? Any suggestions? :)

By the number of taken redirections within the last "time window".
We could further refine that with a load measure of the servers at a 
counted number of sessions.

BTW: even 3000 http sessions are no problem at ftp-1.gwdg.de - network 
delivery currently is 78 MB/sec, while disk I/O is 7 MB/sec. The huge 
RAM/buffer cache of 32 MB really is the biggest helper...
 
Cheers -e
-- 
Eberhard Moenkeberg ([EMAIL PROTECTED], [EMAIL PROTECTED])
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]



Re: [opensuse-factory] ludicrous software management

2006-11-30 Thread Christoph Thiel
On Fri, Dec 01, 2006 at 12:05:33AM +0100, Eberhard Moenkeberg wrote:
[...]

> Interesting.
> What is the delivery bandwidth of ftp.skynet.be?
> 
> Maybe Christoph should extend the redirect algorithm at 
> download.opensuse.org to respect outgoing bandwidth...

Sure, that would be nice to have -- but how should d.o.o get an idea of the
current load on a mirror? Any suggestions? :)


Best,
Christoph
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]



Re: [opensuse-factory] ludicrous software management

2006-11-30 Thread Eberhard Moenkeberg
Hi,

On Thu, 30 Nov 2006, Pascal Bleser wrote:
> Eberhard Moenkeberg wrote:
> > On Thu, 30 Nov 2006, Felix Miata wrote:
> >> On 2006/11/30 16:39 (GMT+0100) Eberhard Moenkeberg apparently typed:
  
> >>> Use
> >>> http://ftp-1.gwdg.de/pub/opensuse/distribution/SL-OSS-factory/inst-source

> >>> ftp-1 is my best server these days for all suse and opensuse directories, 
> >>> both regarding performance and actuality.

> >> I switched to this for this update. I started over 5 hours ago. It still
> >> shows >2 hours remaining. I can't tell exactly how dismal this is
> >> because yast doesn't bother to tell the download rate, but I suspect
> >> it's in the modem speed range. From good performing mirrors I can
> >> download an average CD iso in less than 20 minutes. I should have been
> >> done >4 hours ago.
> > 
> > Believe me, this is the best you can do.
> > I have a bandwidth shaping of 800 MBit/sec since 8 minutes (500 MBit/sec 
> > before), and about 2200 sessions currently.
> > The server is delivering 73 MByte/sec at the moment - so please calculate 
> > if "your part" is fair.
> > 
> > BTW: the remaining 27 MByte/sec get delivered by ftp.gwdg.de. ;-))
> > 
> > I can only guarantee the server stability, not the individual throughput. 
> > But the summary. Yes, I can. ;->>
> 
> As a side note, and to lighten the load on gwdg.de ;)
> 
> http://ftp.skynet.be/pub/ is damn fast too for
> 
> - - stable releases:
> http://ftp.skynet.be/pub/ftp.opensuse.org/opensuse/distribution/SL-10.1/
> 
> - - online updates:
> http://ftp.skynet.be/pub/ftp.suse.com/suse/update/
> 
> - - 10.2 RC CD ISOs:
> http://ftp.skynet.be/pub/ftp.opensuse.org/opensuse/distribution/openSUSE-10.2-RC1/iso
> 
> - - Packman mirror:
> http://ftp.skynet.be/pub/packman/
> 
> - - guru mirror:
> http://ftp.skynet.be/pub/suser-guru/
> 
> - - build service mirror:
> http://ftp.skynet.be/pub/software.opensuse.org/
> 
> For some of those repositories, you also have the bigger boys in the
> European mirror scene: ftp.belnet.be and ftp.heanet.ie

Interesting.
What is the delivery bandwidth of ftp.skynet.be?

Maybe Christoph should extend the redirect algorithm at 
download.opensuse.org to respect outgoing bandwidth...

Cheers -e
-- 
Eberhard Moenkeberg ([EMAIL PROTECTED], [EMAIL PROTECTED])
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]



Re: [opensuse-factory] ludicrous software management

2006-11-30 Thread jdd
succes of RC1 is incredible. My bittorent azureus has 
already 13 clients and I served 8 times my download of the 5 cd


last week, for beta, 4 days after the release I had no more 
clients...


jdd

--
http://www.dodin.net
http://dodin.org/mediawiki/index.php/GPS_Lowrance_GO
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]



Re: [opensuse-factory] ludicrous software management

2006-11-30 Thread Pascal Bleser
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Eberhard Moenkeberg wrote:
> Hi,
> 
> On Thu, 30 Nov 2006, Felix Miata wrote:
>> On 2006/11/30 16:39 (GMT+0100) Eberhard Moenkeberg apparently typed:
>  
>>> Use
>>> http://ftp-1.gwdg.de/pub/opensuse/distribution/SL-OSS-factory/inst-source
>>> ftp-1 is my best server these days for all suse and opensuse directories, 
>>> both regarding performance and actuality.
>> I switched to this for this update. I started over 5 hours ago. It still
>> shows >2 hours remaining. I can't tell exactly how dismal this is
>> because yast doesn't bother to tell the download rate, but I suspect
>> it's in the modem speed range. From good performing mirrors I can
>> download an average CD iso in less than 20 minutes. I should have been
>> done >4 hours ago.
> 
> Believe me, this is the best you can do.
> I have a bandwidth shaping of 800 MBit/sec since 8 minutes (500 MBit/sec 
> before), and about 2200 sessions currently.
> The server is delivering 73 MByte/sec at the moment - so please calculate 
> if "your part" is fair.
> 
> BTW: the remaining 27 MByte/sec get delivered by ftp.gwdg.de. ;-))
> 
> I can only guarantee the server stability, not the individual throughput. 
> But the summary. Yes, I can. ;->>

As a side note, and to lighten the load on gwdg.de ;)

http://ftp.skynet.be/pub/ is damn fast too for

- - stable releases:
http://ftp.skynet.be/pub/ftp.opensuse.org/opensuse/distribution/SL-10.1/

- - online updates:
http://ftp.skynet.be/pub/ftp.suse.com/suse/update/

- - 10.2 RC CD ISOs:
http://ftp.skynet.be/pub/ftp.opensuse.org/opensuse/distribution/openSUSE-10.2-RC1/iso

- - Packman mirror:
http://ftp.skynet.be/pub/packman/

- - guru mirror:
http://ftp.skynet.be/pub/suser-guru/

- - build service mirror:
http://ftp.skynet.be/pub/software.opensuse.org/

For some of those repositories, you also have the bigger boys in the
European mirror scene: ftp.belnet.be and ftp.heanet.ie

- --
  -o) Pascal Bleser http://linux01.gwdg.de/~pbleser/
  /\\ <[EMAIL PROTECTED]>   <[EMAIL PROTECTED]>
 _\_v The more things change, the more they stay insane.
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.2 (GNU/Linux)

iD8DBQFFb2GSr3NMWliFcXcRAlG5AKCgIx/watOcv7XdRRrxu06kRrpsegCaA1by
aSgAoC0yGhn3yPMEHJgla48=
=/Vv+
-END PGP SIGNATURE-
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]



Re: [opensuse-factory] ludicrous software management

2006-11-30 Thread Eberhard Moenkeberg
Hi,

On Thu, 30 Nov 2006, Felix Miata wrote:
> On 2006/11/30 16:39 (GMT+0100) Eberhard Moenkeberg apparently typed:
 
> > Use
> > http://ftp-1.gwdg.de/pub/opensuse/distribution/SL-OSS-factory/inst-source
> 
> > ftp-1 is my best server these days for all suse and opensuse directories, 
> > both regarding performance and actuality.
> 
> I switched to this for this update. I started over 5 hours ago. It still
> shows >2 hours remaining. I can't tell exactly how dismal this is
> because yast doesn't bother to tell the download rate, but I suspect
> it's in the modem speed range. From good performing mirrors I can
> download an average CD iso in less than 20 minutes. I should have been
> done >4 hours ago.

Believe me, this is the best you can do.
I have a bandwidth shaping of 800 MBit/sec since 8 minutes (500 MBit/sec 
before), and about 2200 sessions currently.
The server is delivering 73 MByte/sec at the moment - so please calculate 
if "your part" is fair.

BTW: the remaining 27 MByte/sec get delivered by ftp.gwdg.de. ;-))

I can only guarantee the server stability, not the individual throughput. 
But the summary. Yes, I can. ;->>

Cheers -e
-- 
Eberhard Moenkeberg ([EMAIL PROTECTED], [EMAIL PROTECTED])
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]



Re: [opensuse-factory] ludicrous software management

2006-11-30 Thread Felix Miata
On 2006/11/30 16:39 (GMT+0100) Eberhard Moenkeberg apparently typed:

> Use
> http://ftp-1.gwdg.de/pub/opensuse/distribution/SL-OSS-factory/inst-source

> ftp-1 is my best server these days for all suse and opensuse directories, 
> both regarding performance and actuality.

I switched to this for this update. I started over 5 hours ago. It still
shows >2 hours remaining. I can't tell exactly how dismal this is
because yast doesn't bother to tell the download rate, but I suspect
it's in the modem speed range. From good performing mirrors I can
download an average CD iso in less than 20 minutes. I should have been
done >4 hours ago.
-- 
"Rejoice and be glad, because great is your reward in heaven."
Matthew 5:12 NIV

 Team OS/2 ** Reg. Linux User #211409

Felix Miata  ***  http://mrmazda.no-ip.com/
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]



Re: [opensuse-factory] ludicrous software management

2006-11-30 Thread Andras Mantia
On Thursday 30 November 2006 17:26, Marcus Meissner wrote:
> Is there a bugreport for this?
#22 is similar, but for 3rd party repo (I have not tested with the 
remote factory).

Andras
-- 
Quanta Plus developer - http://quanta.kdewebdev.org
K Desktop Environment - http://www.kde.org


pgpQKrRpduvCt.pgp
Description: PGP signature


Re: [opensuse-factory] ludicrous software management

2006-11-30 Thread Andreas Hanke
Marcus Meissner schrieb:
> Is there a bugreport for this?

It's a combination of multiple things.

(1) Installation sources in offline mode

https://bugzilla.novell.com/show_bug.cgi?id=223600

(2) Metadata shouldn't be refreshed when starting yast2 inst_source

Currently not reported (AFAIK).

(3) download.opensuse.org often redirects to ftp.opensuse.org

Currently not reported (AFAIK).
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]



Re: [opensuse-factory] ludicrous software management

2006-11-30 Thread Eberhard Moenkeberg
Hi,

On Thu, 30 Nov 2006, Felix Miata wrote:

> Now while I was waiting for a response the downloading has halted with
> this message in a window:
> 
> ERROR:
> 
> There were errors when restoring the source configuration.
> Not all sources are available for configuration.
> 
> http://ftp.gwdg.de/pub/linux/suse/opensuse/distribution/SL-OSS-factory/inst-source/:
> Cannot create the installation source.

Don't use this symlink. It will disappear, and no other server is carrying 
it.

Use
http://ftp-1.gwdg.de/pub/opensuse/distribution/SL-OSS-factory/inst-source

ftp-1 is my best server these days for all suse and opensuse directories, 
both regarding performance and actuality.

Cheers -e
-- 
Eberhard Moenkeberg ([EMAIL PROTECTED], [EMAIL PROTECTED])
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]



Re: [opensuse-factory] ludicrous software management

2006-11-30 Thread Felix Miata
On 2006/11/30 16:13 (GMT+0100) Marcus Meissner apparently typed:

> On Thu, Nov 30, 2006 at 10:12:02AM -0500, Felix Miata wrote:

>> I just booted in order to update to the latest factory ftp tree. I
>> opened YaST to check and see which installation source was set, because
>> I already found out that my usual mirror is out of sync.

>> Couldn't do it. zypp-updater was running and preventing access to the
>> DB. So, I killed zypp-updater and tried again. Now Yast is stuck
>> downloading God only know what files, when all I wanted to know was what
>> installation source was set.

>> Simply ludicrous software management system.

> You are getting progress bars, right?

Sure, little narrow ones that show less than half the URL that I have to
keep widening by more than 100% each time they close and reopen.

The bigger question is why does anything need to be downloaded just so
that I can check to see what my installation source is set to?

Also, why didn't the updater quit when I brought it up from the taskbar
and selected to quit?

Why does it have to lock the database so tight I can't even look at it?

> Its likely just your slow network connection.

My network connection is about as fast as a network connection can be.
The problem is mirrors in sync are in such short supply that it's
pointless to try anywhere but ftp.gwdg.de for factory ftp, which is
hopelessly slow nearly always.


Now while I was waiting for a response the downloading has halted with
this message in a window:

ERROR:

There were errors when restoring the source configuration.
Not all sources are available for configuration.

http://ftp.gwdg.de/pub/linux/suse/opensuse/distribution/SL-OSS-factory/inst-source/:
Cannot create the installation source.

Do you want to immediately remove these sources?

Yes No

:-(
-- 
"Rejoice and be glad, because great is your reward in heaven."
Matthew 5:12 NIV

 Team OS/2 ** Reg. Linux User #211409

Felix Miata  ***  http://mrmazda.no-ip.com/
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]



Re: [opensuse-factory] ludicrous software management

2006-11-30 Thread Marcus Meissner
On Thu, Nov 30, 2006 at 04:22:49PM +0100, Andreas Hanke wrote:
> Marcus Meissner schrieb:
> > You are getting progress bars, right?
> > 
> > Its likely just your slow network connection.
> 
> But it's a deadlock problem and a must-fix for the next release.
> 
> There is _no_way_ to get the configuration fixed if it's broken (e.g. by
> a bad and slow mirror, bad connection or the like).
> 
> - If the connection to a mirror is slow, there is no way to disable it
> because YaST doesn't give the user access to it before the metadata are
> downloaded, which can take up to 24 hours if an unlucky user managed to
> get a _really_ slow mirror like ftp.opensuse.org.
> 
> - If the user tries to trick YaST into giving him access by going
> offline, it doesn't work either because then YaST thinks it's a good
> idea to hide the remote sources.
> 
> The only way I'm aware of is a brute-force attack, going into
> /var/lib/zypp/db/sources and deleting the XML file directly.
> 
> It's broken and can't stay this way.

Is there a bugreport for this?

Ciao, Marcus
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]



Re: [opensuse-factory] ludicrous software management

2006-11-30 Thread Andreas Hanke
Marcus Meissner schrieb:
> You are getting progress bars, right?
> 
> Its likely just your slow network connection.

But it's a deadlock problem and a must-fix for the next release.

There is _no_way_ to get the configuration fixed if it's broken (e.g. by
a bad and slow mirror, bad connection or the like).

- If the connection to a mirror is slow, there is no way to disable it
because YaST doesn't give the user access to it before the metadata are
downloaded, which can take up to 24 hours if an unlucky user managed to
get a _really_ slow mirror like ftp.opensuse.org.

- If the user tries to trick YaST into giving him access by going
offline, it doesn't work either because then YaST thinks it's a good
idea to hide the remote sources.

The only way I'm aware of is a brute-force attack, going into
/var/lib/zypp/db/sources and deleting the XML file directly.

It's broken and can't stay this way.

Andreas
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]



Re: [opensuse-factory] ludicrous software management

2006-11-30 Thread Marcus Meissner
On Thu, Nov 30, 2006 at 10:12:02AM -0500, Felix Miata wrote:
> I just booted in order to update to the latest factory ftp tree. I
> opened YaST to check and see which installation source was set, because
> I already found out that my usual mirror is out of sync.
> 
> Couldn't do it. zypp-updater was running and preventing access to the
> DB. So, I killed zypp-updater and tried again. Now Yast is stuck
> downloading God only know what files, when all I wanted to know was what
> installation source was set.
> 
> Simply ludicrous software management system.

You are getting progress bars, right?

Its likely just your slow network connection.

Ciao, Marcus
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]



[opensuse-factory] ludicrous software management

2006-11-30 Thread Felix Miata
I just booted in order to update to the latest factory ftp tree. I
opened YaST to check and see which installation source was set, because
I already found out that my usual mirror is out of sync.

Couldn't do it. zypp-updater was running and preventing access to the
DB. So, I killed zypp-updater and tried again. Now Yast is stuck
downloading God only know what files, when all I wanted to know was what
installation source was set.

Simply ludicrous software management system.
-- 
"Rejoice and be glad, because great is your reward in heaven."
Matthew 5:12 NIV

 Team OS/2 ** Reg. Linux User #211409

Felix Miata  ***  http://mrmazda.no-ip.com/
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]