Re: mirror.bytemark.co.uk appears to have removed all OpenBSD content?

2024-02-28 Thread Stuart Henderson
On 2024-02-28, Pontus Stenetorp  wrote:
> On Wed 28 Feb 2024, Stuart Henderson wrote:
>> On 2024-02-28, Pontus Stenetorp  wrote:
>> > On Tue 27 Feb 2024, Stuart Henderson wrote:
>> >> On 2024-02-27, Stuart Henderson  wrote:
>> >> > On 2024-02-27, Peter Kay  wrote:
>> >> >>
>> >> >> Just been to upgrade a rather old system I keep OpenBSD on for fun all
>> >> >> the way up from 6.9, and found bytemark no longer seem to be hosting
>> >> >> any OpenBSD content.
>> >> >
>> >> > That's why they have been removed from the mirrors list since 2022.
>> >> 
>> >> Oh hmm, seems I readded them as they had started working again, I'll drop 
>> >> them again.
>> >
>> > Since it has crossed my mind that scripting together some sort of "mirror 
>> > health" tool would be a fairly easy (yet probably valuable) contribution 
>> > to the community, is there currently anything akin to that in use by you 
>> > or others when maintaining the mirrors list? A few searches of mine turned 
>> > up empty, but it could equally well be that my search skills were lacking.
>> 
>> No need for another tool, we have mirmon and mirrorcheck.sh. The problem
>> is finding time to review results of checks, and making decisions
>> about what to include in ftp.html (for parts of the world with low
>> connectivity, a mirror which is slightly behind on snapshots can still
>> be very useful).
>
> Firstly, thank you of course for all your efforts maintaining the list. 
> Agreed about usefulness being very much circumstancial and thank you for 
> pointing me in the directions of two tools I have overlooked. mirmon is of 
> course net/mirmon in ports, but I have failed to locate mirrorcheck.sh in 
> both ports and src (even with a grep -ir), as well as with a web search. 
> Where does it live?

It's in the www tree.




Re: mirror.bytemark.co.uk appears to have removed all OpenBSD content?

2024-02-28 Thread Pontus Stenetorp
On Wed 28 Feb 2024, Stuart Henderson wrote:
> On 2024-02-28, Pontus Stenetorp  wrote:
> > On Tue 27 Feb 2024, Stuart Henderson wrote:
> >> On 2024-02-27, Stuart Henderson  wrote:
> >> > On 2024-02-27, Peter Kay  wrote:
> >> >>
> >> >> Just been to upgrade a rather old system I keep OpenBSD on for fun all
> >> >> the way up from 6.9, and found bytemark no longer seem to be hosting
> >> >> any OpenBSD content.
> >> >
> >> > That's why they have been removed from the mirrors list since 2022.
> >> 
> >> Oh hmm, seems I readded them as they had started working again, I'll drop 
> >> them again.
> >
> > Since it has crossed my mind that scripting together some sort of "mirror 
> > health" tool would be a fairly easy (yet probably valuable) contribution to 
> > the community, is there currently anything akin to that in use by you or 
> > others when maintaining the mirrors list? A few searches of mine turned up 
> > empty, but it could equally well be that my search skills were lacking.
> 
> No need for another tool, we have mirmon and mirrorcheck.sh. The problem
> is finding time to review results of checks, and making decisions
> about what to include in ftp.html (for parts of the world with low
> connectivity, a mirror which is slightly behind on snapshots can still
> be very useful).

Firstly, thank you of course for all your efforts maintaining the list. Agreed 
about usefulness being very much circumstancial and thank you for pointing me 
in the directions of two tools I have overlooked. mirmon is of course 
net/mirmon in ports, but I have failed to locate mirrorcheck.sh in both ports 
and src (even with a grep -ir), as well as with a web search. Where does it 
live?



Re: mirror.bytemark.co.uk appears to have removed all OpenBSD content?

2024-02-28 Thread Nowarez Market
I think to have already advised about Stu smelling of ChapGPT


Feb 28, 2024 11:54:24 Crystal Kolipe :

> On Wed, Feb 28, 2024 at 11:26:31AM +0100, Janne Johansson wrote:
>> Stuart is already testing listed mirrors.
> 
> And tests have indeed shown that Stuart locked in a room with a workstation
> for 15 hours a day repeatedly and reliably outperforms an AI running on any of
> the top 500 supercomputers for this task :-).



Re: mirror.bytemark.co.uk appears to have removed all OpenBSD content?

2024-02-28 Thread Stuart Henderson
On 2024-02-28, Pontus Stenetorp  wrote:
> On Tue 27 Feb 2024, Stuart Henderson wrote:
>> On 2024-02-27, Stuart Henderson  wrote:
>> > On 2024-02-27, Peter Kay  wrote:
>> >>
>> >> Just been to upgrade a rather old system I keep OpenBSD on for fun all
>> >> the way up from 6.9, and found bytemark no longer seem to be hosting
>> >> any OpenBSD content.
>> >
>> > That's why they have been removed from the mirrors list since 2022.
>> 
>> Oh hmm, seems I readded them as they had started working again, I'll drop 
>> them again.
>
> Since it has crossed my mind that scripting together some sort of "mirror 
> health" tool would be a fairly easy (yet probably valuable) contribution to 
> the community, is there currently anything akin to that in use by you or 
> others when maintaining the mirrors list? A few searches of mine turned up 
> empty, but it could equally well be that my search skills were lacking.

No need for another tool, we have mirmon and mirrorcheck.sh. The problem
is finding time to review results of checks, and making decisions
about what to include in ftp.html (for parts of the world with low
connectivity, a mirror which is slightly behind on snapshots can still
be very useful).

-- 
Please keep replies on the mailing list.



Re: mirror.bytemark.co.uk appears to have removed all OpenBSD content?

2024-02-28 Thread Crystal Kolipe
On Wed, Feb 28, 2024 at 11:26:31AM +0100, Janne Johansson wrote:
> Stuart is already testing listed mirrors.

And tests have indeed shown that Stuart locked in a room with a workstation
for 15 hours a day repeatedly and reliably outperforms an AI running on any of
the top 500 supercomputers for this task :-).



Re: mirror.bytemark.co.uk appears to have removed all OpenBSD content?

2024-02-28 Thread Janne Johansson
> > >> Just been to upgrade a rather old system I keep OpenBSD on for fun all
> > >> the way up from 6.9, and found bytemark no longer seem to be hosting
> > >> any OpenBSD content.
> > >
> > > That's why they have been removed from the mirrors list since 2022.
> >
> > Oh hmm, seems I readded them as they had started working again, I'll drop 
> > them again.
>
> Since it has crossed my mind that scripting together some sort of "mirror 
> health" tool would be a fairly easy (yet probably valuable) contribution to 
> the community, is there currently anything akin to that in use by you or 
> others when maintaining the mirrors list? A few searches of mine turned up 
> empty, but it could equally well be that my search skills were lacking.

Stuart is already testing listed mirrors.

-- 
May the most significant bit of your life be positive.



Re: mirror.bytemark.co.uk appears to have removed all OpenBSD content?

2024-02-28 Thread Pontus Stenetorp
On Wed 28 Feb 2024, Crystal Kolipe wrote:
> On Wed, Feb 28, 2024 at 09:25:35AM +, Pontus Stenetorp wrote:
> > scripting together some sort of "mirror health" tool would be a fairly easy
> > (yet probably valuable)
> 
> In principle it might sound 'fairly easy', but once you start to add code to
> deal with things such as sites going down for planned maintenance, being
> unavailable from certain locations due to network problems and so on, your
> simple tool would quickly start to grow in complexity.
> 
> In any case, the list of mirrors needs to be manually reviewed.  I vaguely
> remember some years ago a previously good mirror started serving a pre-release
> copy of the distribution as if it was the actual release, and was subsequently
> removed.
> 
> A simple mirror health tool likely wouldn't catch that.

Agreed, I do not think the task should be fully automated. Rather, I think it 
would be helpful to have a couple of easy checks that could indicate the health 
of a mirror, rather than fully determine the health of it. I for example was on 
a Japanese mirror last year that "lagged" behind security patches for days, if 
not all the way up to a week, and this is a fairly easy check to automate. I 
would imagine just a list of all the mirrors on the mirrors list coupled with 
say a list of outage events, "lag events", releases available, etc. that could 
be used to get a better overview of the health of a mirror than a sample of a 
single point in time, while still not aiming for any sort of complete 
automation. Hopefully this is just a few hundred lines of Perl feeding data 
into a static page served by httpd(8).



Re: mirror.bytemark.co.uk appears to have removed all OpenBSD content?

2024-02-28 Thread Crystal Kolipe
On Wed, Feb 28, 2024 at 09:25:35AM +, Pontus Stenetorp wrote:
> scripting together some sort of "mirror health" tool would be a fairly easy
> (yet probably valuable)

In principle it might sound 'fairly easy', but once you start to add code to
deal with things such as sites going down for planned maintenance, being
unavailable from certain locations due to network problems and so on, your
simple tool would quickly start to grow in complexity.

In any case, the list of mirrors needs to be manually reviewed.  I vaguely
remember some years ago a previously good mirror started serving a pre-release
copy of the distribution as if it was the actual release, and was subsequently
removed.

A simple mirror health tool likely wouldn't catch that.



Re: mirror.bytemark.co.uk appears to have removed all OpenBSD content?

2024-02-28 Thread Pontus Stenetorp
On Tue 27 Feb 2024, Stuart Henderson wrote:
> On 2024-02-27, Stuart Henderson  wrote:
> > On 2024-02-27, Peter Kay  wrote:
> >>
> >> Just been to upgrade a rather old system I keep OpenBSD on for fun all
> >> the way up from 6.9, and found bytemark no longer seem to be hosting
> >> any OpenBSD content.
> >
> > That's why they have been removed from the mirrors list since 2022.
> 
> Oh hmm, seems I readded them as they had started working again, I'll drop 
> them again.

Since it has crossed my mind that scripting together some sort of "mirror 
health" tool would be a fairly easy (yet probably valuable) contribution to the 
community, is there currently anything akin to that in use by you or others 
when maintaining the mirrors list? A few searches of mine turned up empty, but 
it could equally well be that my search skills were lacking.



Re: mirror.bytemark.co.uk appears to have removed all OpenBSD content?

2024-02-27 Thread Stuart Henderson
On 2024-02-27, Kirill A  Korinsky  wrote:
> On Tue, 27 Feb 2024 14:59:32 +0100,
> Kenneth Gober wrote:
>> 
>> Slightly off topic, but does anyone know of any archives that have
>> packages for 3.0, 3.1, 3.2, and/or 3.3?  Especially 3.0 -- the only
>> site I've ever found with 3.0 packages may have been incomplete.
>>
>
> https://mirror.leaseweb.com/pub/OpenBSD
>
> whcih also has rsync mirror BTW

That depends where you are, it is a geo distributed DNS and they use
different upstreams in different places, some fetch from ftp.eu (which has
many old versions, though not 3.0-3.3), others from ftp3.usa (which doesn't).




Re: mirror.bytemark.co.uk appears to have removed all OpenBSD content?

2024-02-27 Thread Janne Johansson
Den tis 27 feb. 2024 kl 17:42 skrev Kirill A. Korinsky :
>
> On Tue, 27 Feb 2024 14:59:32 +0100,
> Kenneth Gober wrote:
> >
> > Slightly off topic, but does anyone know of any archives that have
> > packages for 3.0, 3.1, 3.2, and/or 3.3?  Especially 3.0 -- the only
> > site I've ever found with 3.0 packages may have been incomplete.
> >
>
> https://mirror.leaseweb.com/pub/OpenBSD
>
> whcih also has rsync mirror BTW

But not the packages for 3.0->3.3 which was what was asked for.

-- 
May the most significant bit of your life be positive.



Re: mirror.bytemark.co.uk appears to have removed all OpenBSD content?

2024-02-27 Thread Kirill A . Korinsky
On Tue, 27 Feb 2024 14:59:32 +0100,
Kenneth Gober wrote:
> 
> Slightly off topic, but does anyone know of any archives that have
> packages for 3.0, 3.1, 3.2, and/or 3.3?  Especially 3.0 -- the only
> site I've ever found with 3.0 packages may have been incomplete.
>

https://mirror.leaseweb.com/pub/OpenBSD

whcih also has rsync mirror BTW

-- 
wbr, Kirill



Re: mirror.bytemark.co.uk appears to have removed all OpenBSD content?

2024-02-27 Thread Stuart Henderson
On 2024-02-27, Stuart Henderson  wrote:
> On 2024-02-27, Peter Kay  wrote:
>> Just been to upgrade a rather old system I keep OpenBSD on for fun all
>> the way up from 6.9, and found bytemark no longer seem to be hosting
>> any OpenBSD content.
>
> That's why they have been removed from the mirrors list since 2022.

Oh hmm, seems I readded them as they had started working again, I'll drop them 
again.



Re: mirror.bytemark.co.uk appears to have removed all OpenBSD content?

2024-02-27 Thread Stuart Henderson
On 2024-02-27, Peter Kay  wrote:
> Just been to upgrade a rather old system I keep OpenBSD on for fun all
> the way up from 6.9, and found bytemark no longer seem to be hosting
> any OpenBSD content.

That's why they have been removed from the mirrors list since 2022.




Re: mirror.bytemark.co.uk appears to have removed all OpenBSD content?

2024-02-27 Thread Kenneth Gober
On Mon, Feb 26, 2024 at 9:01 PM Peter Kay 
wrote:

> Fortunately there's a couple of archives with pretty much every
> OpenBSD release ever, so sysupgrade is currently rather busy
>

Slightly off topic, but does anyone know of any archives that have
packages for 3.0, 3.1, 3.2, and/or 3.3?  Especially 3.0 -- the only
site I've ever found with 3.0 packages may have been incomplete.

-ken


mirror.bytemark.co.uk appears to have removed all OpenBSD content?

2024-02-26 Thread Peter Kay
Just been to upgrade a rather old system I keep OpenBSD on for fun all
the way up from 6.9, and found bytemark no longer seem to be hosting
any OpenBSD content.

Fortunately there's a couple of archives with pretty much every
OpenBSD release ever, so sysupgrade is currently rather busy

PK