Re: [TYPO3-english] Setting of TER mirror in TYPO3 6.x? Or change mirror concept?

2014-01-11 Thread Philipp Gampe
Hi Steffen,

Steffen Gebert wrote:

 Is there already a date set for that sprint?

No, not yet.

Best regards
-- 
Philipp Gampe – PGP-Key 0AD96065 – TYPO3 UG Bonn/Köln
Documentation – Active contributor TYPO3 CMS
TYPO3  inspiring people to share!

___
TYPO3-english mailing list
TYPO3-english@lists.typo3.org
http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english

Re: [TYPO3-english] Setting of TER mirror in TYPO3 6.x? Or change mirror concept?

2014-01-10 Thread Philipp Gampe
Hi Steffen,

Steffen Gebert wrote:

 I think one has to do some checks, like if the EM really follows our
 redirects and such things..

We should do those checks during the next TER sprint which might take place 
in Q1 2014.

The EM (at least for older versions of TYPO3) might not follow redirects, 
depending on the server/TYPO3 configuration.

Therefore we should try as hard as we can to push updated URLs to the sites.

I also would like to mention that such a step would simplify a lot of the 
TER handling, especially the stat counting.

Best regards
-- 
Philipp Gampe – PGP-Key 0AD96065 – TYPO3 UG Bonn/Köln
Documentation – Active contributor TYPO3 CMS
TYPO3  inspiring people to share!

___
TYPO3-english mailing list
TYPO3-english@lists.typo3.org
http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english

Re: [TYPO3-english] Setting of TER mirror in TYPO3 6.x? Or change mirror concept?

2014-01-10 Thread Steffen Gebert
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Hi Philipp,

exactly, it makes things a lot easier.

If we know that there are constellations, when the EM does not follow
the redirect, we might still proxy it from the old URL to the new one
- - but if we wouldn't have to do so, a redirect would be preferred, of
course.

Is there already a date set for that sprint?

Kind regards
Steffen

- -- 
Steffen Gebert
TYPO3 Server Administration Team Member

TYPO3  inspiring people to share!
Get involved: http://typo3.org

My wish list:
https://www.amazon.de/registry/wishlist/922E3JYSQ7CV/ref=cm_wl_sb_v?sort=priority

On 10/01/14 10:39, Philipp Gampe wrote:
 Hi Steffen,
 
 Steffen Gebert wrote:
 
 I think one has to do some checks, like if the EM really follows
 our redirects and such things..
 
 We should do those checks during the next TER sprint which might
 take place in Q1 2014.
 
 The EM (at least for older versions of TYPO3) might not follow
 redirects, depending on the server/TYPO3 configuration.
 
 Therefore we should try as hard as we can to push updated URLs to
 the sites.
 
 I also would like to mention that such a step would simplify a lot
 of the TER handling, especially the stat counting.
 
 Best regards
 
-BEGIN PGP SIGNATURE-
Version: GnuPG/MacGPG2 v2.0.22 (Darwin)
Comment: GPGTools - http://gpgtools.org
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iQEcBAEBAgAGBQJSz9S6AAoJEIskG/rSlyw4Uw8H/3vNE/s1JEhm6DrV1seF7KcT
KhwT24DUuAYWQWfiqFyT1IIT0ot7C/yx4xKgjL4Gk/OH5bkX6LJrM0e7/0MKbn7R
Wh0IZjXyTbCGugm/kYElUb3Q+hrtiMCvkiGkAyPjKjRkBT6wivOae+sC4OxJ+Fai
si09QArpdCLzRnrJZCwBidpiCCjzlPc1apUSacCmQUgnWoP9950qHzNasDT3S1Do
+i2cOQZhi73ScYZ+kC2U6KRrPF8N4yBvK7I6bxQR7AAGXu1hcEqO4wh/OifWLiUm
PvSaZG7h6351soobI5K1JY4vfxdAOzHEaZWA5hO31Dyjo43aqvSU6v82tIZhMX8=
=uWZB
-END PGP SIGNATURE-
___
TYPO3-english mailing list
TYPO3-english@lists.typo3.org
http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english


Re: [TYPO3-english] Setting of TER mirror in TYPO3 6.x? Or change mirror concept?

2014-01-09 Thread Steffen Gebert
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Hi,

I'm revisiting that topic, as the server sponsor finally wants to shut
down the old typo3.org servers (which is totally reasonable).

So I'd like to have a decision for that soon - unfortunately, only
Philipp contributed to the notes document.

Should I sum it up and maybe re-post it to the core-team list?

I think one has to do some checks, like if the EM really follows our
redirects and such things..

Can I get 4 eyes from the Active Contributors Team that collaborate to
sort out these issues, please?

Thanks!
Steffen

- -- 
Steffen Gebert
TYPO3 Server Administration Team Member

TYPO3  inspiring people to share!
Get involved: http://typo3.org

My wish list:
https://www.amazon.de/registry/wishlist/922E3JYSQ7CV/ref=cm_wl_sb_v?sort=priority

On 06/10/13 11:10, Steffen Gebert wrote:
 Hi,
 
 I've written together some TODOs: 
 https://notes.typo3.org/p/deactivating-TER-mirrors
 
 Please extend that with your comments.
 
 Kind regards Steffen
 
 
-BEGIN PGP SIGNATURE-
Version: GnuPG/MacGPG2 v2.0.22 (Darwin)
Comment: GPGTools - http://gpgtools.org
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iQEcBAEBAgAGBQJSzxQ8AAoJEIskG/rSlyw4w1sIALcBkegrCPbRTw18dtpq0F4S
FBpU6dZeAHtp0CWj9TR13BZz7wQ6UpN53W7Q3yQHHmmJ89f07kpAmkfdGSpq1yx8
5Ibyixfd8cfPcLyQWC63CQTo/Ssmd2YvgKS6FT2NZzni+kU8qkThyOXbJhSKbAsB
NZs+2WYHva61HsgdYhIRAIlvIe7XknCUgk5m1bcdF18TmXVKtuT6EbCxpW7oyKrH
ZICd7rfQcztV/5NS7oJiPWWi8l+NPO66w9yAnI+2NnOaM0s0VYyy9aW1Kj/Cge+8
EEVDZN5M12kzVOIquQlIKDK1Pu8ncMxLRXgHNaxp5i/toOhqk21db2uDZCfA7FU=
=ftJS
-END PGP SIGNATURE-
___
TYPO3-english mailing list
TYPO3-english@lists.typo3.org
http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english


Re: [TYPO3-english] Setting of TER mirror in TYPO3 6.x? Or change mirror concept?

2013-10-06 Thread Jigal van Hemert

Hi,

On 5-10-2013 21:46, Philipp Gampe wrote:

I think we should concentrate on a composer integration, instead of trying
to bring private repositories to EM once more again.
This will bring all those features we never had time to implement.


The idea of composer integration needs more thought, simply because 
there are not only benefits but also potential problems which need to be 
solved. See [1] for a thread about composer.
It's unfortunately not as simple as if we have composer support all 
problems with dependencies are solved.


[1] http://forum.typo3.org/index.php?t=msgth=198285goto=691201#msg_691201

--
Jigal van Hemert
TYPO3 CMS Active Contributor

TYPO3  inspiring people to share!
Get involved: typo3.org
___
TYPO3-english mailing list
TYPO3-english@lists.typo3.org
http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english


Re: [TYPO3-english] Setting of TER mirror in TYPO3 6.x? Or change mirror concept?

2013-10-06 Thread Steffen Gebert
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Hi,

I've written together some TODOs:
https://notes.typo3.org/p/deactivating-TER-mirrors

Please extend that with your comments.

Kind regards
Steffen

- -- 
Steffen Gebert
TYPO3 Server Administration Team Member

TYPO3  inspiring people to share!
Get involved: http://typo3.org

My wish list:
https://www.amazon.de/registry/wishlist/922E3JYSQ7CV/ref=cm_wl_sb_v?sort=priority

On 10/5/13 5:48 PM, Christian Kuhn wrote:
 Hey,
 
 On 10/05/2013 12:16 PM, Steffen Gebert wrote:
 Christian, thanks for the offer. I think that should be discussed.
 The one good thing with the mirrors.xml was that we could easily adjust
 the URL of the mirror. So before you now hard-code
 typo3.org/fileadmin/ter/, we might want to move that to ter.typo3.org
 (which could just be the same nginx pointing to the old directory.
 
 At the moment I don't really see an issue with hardcoding the link. It
 may be not optimal, but we could remove a whole layer of complexity from
 em if we kill the mirrors, and also typo3.org handling could get more
 simple.
 
 This random mirror selection with current synchronisation issues really
 sucks, this is for example obvious with a caretaker server that may
 toggle 'security' status of extensions if one mirror got the new info,
 but another not. We're experiencing those issues for a long time already
 with a task that updates the extension list on a regular basis. Our
 solution was to hardcode the mirror to typo3.org ;)
 
 For b/w compatibility we could just hardcode the mirrors.xml.gz file on
 typo3.org pointing to the main system only and don't touch it anymore
 afterwards. This way we could also clean up the typo3.org codebase quickly.
 
 Regards
 Christian
-BEGIN PGP SIGNATURE-
Version: GnuPG/MacGPG2 v2.0.20 (Darwin)
Comment: GPGTools - http://gpgtools.org
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iQEcBAEBAgAGBQJSUSj0AAoJEIskG/rSlyw4DxwIALxG0UwWl6bcI+g7377Q+Bbk
6Ih8ooESLfEziiNl3wmiao7OQny7EJQ4lRtPAtVkRPIkRPRPmNFvNiJJZT3bUqhM
ZLkKN3N7++SK/ErNFJLjNEKUk4vOA0S+2dSXN00FBlsP20Y2aouoy9g6urmwwoNF
a8QfNmFqPJIY6+WaQn5BRMZZc4FseVWpbD4Foc7RR0zwytDIksM7O3HHtzwME7W9
IWzsqK5hAh0+CxLAD1Y14m9TVopFMtCp32/JDLII6dlwXrSadMHuoOYFc26oFH0j
0HUpqsq11Kj3h9IY+xHIGah2dbj3/gSaOsCCmkKgDzra2E/GsLDnZsvq9pg3Jyw=
=T4V6
-END PGP SIGNATURE-
___
TYPO3-english mailing list
TYPO3-english@lists.typo3.org
http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english


Re: [TYPO3-english] Setting of TER mirror in TYPO3 6.x? Or change mirror concept?

2013-10-05 Thread Christian Kuhn

On 10/04/2013 07:26 PM, Steffen Gebert wrote:

That (unfortunately) still hasn't happened, from my side because I very
much think the that implemented concept is bad. Especially when it comes
to download counter, it's horrible (there's a script that was only
active on the old typo3.org server that goes through the access log
every night and reports the download stats via a SOAP request).


The mirror handling *is* implemented in 6.0 em.

As far as I recall, the mirror handling was implemented in a time when 
typo3.org was unstable and offline pretty often, so the main reason was 
not load but stability.


Since typo3.org is very stable nowadays, we could imho drop the whole 
mirror stuff to not face all those issues with synchronisation, 
organising external systems, download counters, timing issues and so on. 
As far as I know the codebase beyond that on typo3.org is also not 
really nice nor maintained.


So, if nobody objects, we could just create a patch for em 6.0 to drop 
all that stuff, what do you think?


Regards
Christian
___
TYPO3-english mailing list
TYPO3-english@lists.typo3.org
http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english


Re: [TYPO3-english] Setting of TER mirror in TYPO3 6.x? Or change mirror concept?

2013-10-05 Thread Philipp Gampe
Hi Christian,

Christian Kuhn wrote:

 So, if nobody objects, we could just create a patch for em 6.0 to drop
 all that stuff, what do you think?

+1

In the past, t3o was down each night one or two hours for the doc rendering 
... that is history now :)

Best regards
-- 
Philipp Gampe – PGP-Key 0AD96065 – TYPO3 UG Bonn/Köln
Documentation – Active contributor TYPO3 CMS
TYPO3  inspiring people to share!

___
TYPO3-english mailing list
TYPO3-english@lists.typo3.org
http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english

Re: [TYPO3-english] Setting of TER mirror in TYPO3 6.x? Or change mirror concept?

2013-10-05 Thread Steffen Gebert
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Christian, thanks for the offer. I think that should be discussed.
The one good thing with the mirrors.xml was that we could easily adjust
the URL of the mirror. So before you now hard-code
typo3.org/fileadmin/ter/, we might want to move that to ter.typo3.org
(which could just be the same nginx pointing to the old directory.

I see (esp. Asian) people crying out loud because the can't use any
mirrors near them, however I don't see problems for T3X downloads, but
only for the icons in the EM (huge number of requests with high delay
would really slow the loading process down).

Other than that (from my limited point of view) I don't expect lot of
problems. In Sept. the T3X downloads from the typo3.org server were 92GB
only. Compared to our Git server (580GB in September, btw. thanks
Speedpartner / Stefan Neufeind for sponsoring) that's nothing.

How does that all relate to the concept of own TERs? Should that still
be possible? Will this be influenced by such a change?

Kind regards
Steffen

- -- 
Steffen Gebert
TYPO3 Server Administration Team Member

TYPO3  inspiring people to share!
Get involved: http://typo3.org

My wish list:
https://www.amazon.de/registry/wishlist/922E3JYSQ7CV/ref=cm_wl_sb_v?sort=priority

On 10/5/13 11:41 AM, Christian Kuhn wrote:
 On 10/04/2013 07:26 PM, Steffen Gebert wrote:
 That (unfortunately) still hasn't happened, from my side because I very
 much think the that implemented concept is bad. Especially when it comes
 to download counter, it's horrible (there's a script that was only
 active on the old typo3.org server that goes through the access log
 every night and reports the download stats via a SOAP request).
 
 The mirror handling *is* implemented in 6.0 em.
 
 As far as I recall, the mirror handling was implemented in a time when
 typo3.org was unstable and offline pretty often, so the main reason was
 not load but stability.
 
 Since typo3.org is very stable nowadays, we could imho drop the whole
 mirror stuff to not face all those issues with synchronisation,
 organising external systems, download counters, timing issues and so on.
 As far as I know the codebase beyond that on typo3.org is also not
 really nice nor maintained.
 
 So, if nobody objects, we could just create a patch for em 6.0 to drop
 all that stuff, what do you think?
 
 Regards
 Christian
-BEGIN PGP SIGNATURE-
Version: GnuPG/MacGPG2 v2.0.20 (Darwin)
Comment: GPGTools - http://gpgtools.org
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iQEcBAEBAgAGBQJST+bmAAoJEIskG/rSlyw4n8gH/i43AWTFQMPOS9HsTtUVfh5G
E3KfOJ6+k8fc+QOTjRctH/HPnf81RsM0EOkPmUf7EwuoTTynLwFpu5Fbmqtfu0tn
TJ0dz0aqwwvvXLcVVQgJCEpZjsXu25jrfA6Xy8rxa83Y/aSNETh++gZ2gDTwKsj3
/wY2nk2gMEqueavPyyCGQsgDWrjYGFTuOdwJZFLRPvg0hS3QbLZHuuBfYrRFZtJB
EfBrK990jfrGnyU1C+pczXX5yF5+Ds5ODfypleEJ6XClRfX/GFpwC4VM3/4VYNMM
pOuikbQ/+zHOgZs6H5zlAshAQGaNxueMXzq3UM0PQvKRe4Y9QoI+1WDLnvxqPtU=
=qONj
-END PGP SIGNATURE-
___
TYPO3-english mailing list
TYPO3-english@lists.typo3.org
http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english


Re: [TYPO3-english] Setting of TER mirror in TYPO3 6.x? Or change mirror concept?

2013-10-05 Thread Markus Klein
Hi!

IMHO we need to fixes here. A short term and a long term.
The short term fix is to either to bring a UI to select a mirror manually, or 
to always use the typo3.org mirror (removing the random selection in the code). 
ASAP!
The long term is to get of course all the stuff you described below, but I 
still think some clever solution to have local TERs (either private or for 
continents) shall be given.

Kind regards
Markus


Markus Klein
TYPO3 CMS Active Contributors Team Member

 -Original Message-
 From: typo3-english-boun...@lists.typo3.org [mailto:typo3-english-
 boun...@lists.typo3.org] On Behalf Of Steffen Gebert
 Sent: Saturday, October 05, 2013 12:16 PM
 To: typo3-english@lists.typo3.org
 Subject: Re: [TYPO3-english] Setting of TER mirror in TYPO3 6.x? Or change
 mirror concept?
 
 -BEGIN PGP SIGNED MESSAGE-
 Hash: SHA1
 
 Christian, thanks for the offer. I think that should be discussed.
 The one good thing with the mirrors.xml was that we could easily adjust the
 URL of the mirror. So before you now hard-code typo3.org/fileadmin/ter/,
 we might want to move that to ter.typo3.org (which could just be the same
 nginx pointing to the old directory.
 
 I see (esp. Asian) people crying out loud because the can't use any mirrors
 near them, however I don't see problems for T3X downloads, but only for
 the icons in the EM (huge number of requests with high delay would really
 slow the loading process down).
 
 Other than that (from my limited point of view) I don't expect lot of
 problems. In Sept. the T3X downloads from the typo3.org server were 92GB
 only. Compared to our Git server (580GB in September, btw. thanks
 Speedpartner / Stefan Neufeind for sponsoring) that's nothing.
 
 How does that all relate to the concept of own TERs? Should that still be
 possible? Will this be influenced by such a change?
 
 Kind regards
 Steffen
 
 - --
 Steffen Gebert
 TYPO3 Server Administration Team Member
 
 TYPO3  inspiring people to share!
 Get involved: http://typo3.org
 
 My wish list:
 https://www.amazon.de/registry/wishlist/922E3JYSQ7CV/ref=cm_wl_sb_v?
 sort=priority
 
 On 10/5/13 11:41 AM, Christian Kuhn wrote:
  On 10/04/2013 07:26 PM, Steffen Gebert wrote:
  That (unfortunately) still hasn't happened, from my side because I
  very much think the that implemented concept is bad. Especially when
  it comes to download counter, it's horrible (there's a script that
  was only active on the old typo3.org server that goes through the
  access log every night and reports the download stats via a SOAP
 request).
 
  The mirror handling *is* implemented in 6.0 em.
 
  As far as I recall, the mirror handling was implemented in a time when
  typo3.org was unstable and offline pretty often, so the main reason
  was not load but stability.
 
  Since typo3.org is very stable nowadays, we could imho drop the whole
  mirror stuff to not face all those issues with synchronisation,
  organising external systems, download counters, timing issues and so on.
  As far as I know the codebase beyond that on typo3.org is also not
  really nice nor maintained.
 
  So, if nobody objects, we could just create a patch for em 6.0 to drop
  all that stuff, what do you think?
 
  Regards
  Christian
 -BEGIN PGP SIGNATURE-
 Version: GnuPG/MacGPG2 v2.0.20 (Darwin)
 Comment: GPGTools - http://gpgtools.org
 Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
 
 iQEcBAEBAgAGBQJST+bmAAoJEIskG/rSlyw4n8gH/i43AWTFQMPOS9HsTtUVf
 h5G
 E3KfOJ6+k8fc+QOTjRctH/HPnf81RsM0EOkPmUf7EwuoTTynLwFpu5Fbmqtfu0
 tn
 TJ0dz0aqwwvvXLcVVQgJCEpZjsXu25jrfA6Xy8rxa83Y/aSNETh++gZ2gDTwKsj3
 /wY2nk2gMEqueavPyyCGQsgDWrjYGFTuOdwJZFLRPvg0hS3QbLZHuuBfYrRFZ
 tJB
 EfBrK990jfrGnyU1C+pczXX5yF5+Ds5ODfypleEJ6XClRfX/GFpwC4VM3/4VYNM
 M
 pOuikbQ/+zHOgZs6H5zlAshAQGaNxueMXzq3UM0PQvKRe4Y9QoI+1WDLnvx
 qPtU=
 =qONj
 -END PGP SIGNATURE-
 ___
 TYPO3-english mailing list
 TYPO3-english@lists.typo3.org
 http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english

___
TYPO3-english mailing list
TYPO3-english@lists.typo3.org
http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english


Re: [TYPO3-english] Setting of TER mirror in TYPO3 6.x? Or change mirror concept?

2013-10-05 Thread Christian Kuhn

Hey,

On 10/05/2013 02:36 PM, Markus Klein wrote:

The long term is to get of course all the stuff you described below, but I still think 
some clever solution to have local TERs (either private or for continents) 
shall be given.


Please don't mix up  mirror handling with repository handling. The 
latter never really worked (was broken in old em, too) and it has 
nothing to do with the mirror stuff.
The repo handling is not fully implemented in new em and I personally 
also have only very little interest in fixing this detail.


Regards
Christian
___
TYPO3-english mailing list
TYPO3-english@lists.typo3.org
http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english


Re: [TYPO3-english] Setting of TER mirror in TYPO3 6.x? Or change mirror concept?

2013-10-05 Thread Christian Kuhn

Hey,

On 10/05/2013 12:16 PM, Steffen Gebert wrote:

Christian, thanks for the offer. I think that should be discussed.
The one good thing with the mirrors.xml was that we could easily adjust
the URL of the mirror. So before you now hard-code
typo3.org/fileadmin/ter/, we might want to move that to ter.typo3.org
(which could just be the same nginx pointing to the old directory.


At the moment I don't really see an issue with hardcoding the link. It 
may be not optimal, but we could remove a whole layer of complexity from 
em if we kill the mirrors, and also typo3.org handling could get more 
simple.


This random mirror selection with current synchronisation issues really 
sucks, this is for example obvious with a caretaker server that may 
toggle 'security' status of extensions if one mirror got the new info, 
but another not. We're experiencing those issues for a long time already 
with a task that updates the extension list on a regular basis. Our 
solution was to hardcode the mirror to typo3.org ;)


For b/w compatibility we could just hardcode the mirrors.xml.gz file on 
typo3.org pointing to the main system only and don't touch it anymore 
afterwards. This way we could also clean up the typo3.org codebase quickly.


Regards
Christian
___
TYPO3-english mailing list
TYPO3-english@lists.typo3.org
http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english


Re: [TYPO3-english] Setting of TER mirror in TYPO3 6.x? Or change mirror concept?

2013-10-05 Thread Philipp Gampe
Hi Christian,

Christian Kuhn wrote:

 The long term is to get of course all the stuff you described below, but
 I still think some clever solution to have local TERs (either private
 or for continents) shall be given.
 
 Please don't mix up  mirror handling with repository handling. The
 latter never really worked (was broken in old em, too) and it has
 nothing to do with the mirror stuff.
 The repo handling is not fully implemented in new em and I personally
 also have only very little interest in fixing this detail.

I think we should concentrate on a composer integration, instead of trying 
to bring private repositories to EM once more again.
This will bring all those features we never had time to implement.

I also think that such a common solution will be more beneficial to TYPO3 
(both CMS and Flow), than trying to hack up our own stuff.

At least, I guess nobody will have to for bigger changes for the EM this 
week, thus we can safely postpone any discussion about private repositories, 
etc. till next year.

Best regards
-- 
Philipp Gampe – PGP-Key 0AD96065 – TYPO3 UG Bonn/Köln
Documentation – Active contributor TYPO3 CMS
TYPO3  inspiring people to share!

___
TYPO3-english mailing list
TYPO3-english@lists.typo3.org
http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english

Re: [TYPO3-english] Setting of TER mirror in TYPO3 6.x? Or change mirror concept?

2013-10-04 Thread André Spindler
Hello,

I see that this threat is now going into a different direction.

I think the mirroring concept should be changed. 
What about separating the extension management from extension download?
On typo3.org, there should stay the complete management of extensions like
version and security handling, documentation and so on.
When downloading a file, this could be done by delivering 301-headers to one
of the mirrors instead.
But this can only work if typo3.org is notified about the sync status of the
mirrors.
Perhaps it makes things easier if typo3.org has its own download mirror
(at ter.typo3.org). If this is an own vhost and separated from the
management, its sync should be easier done using rsync or some similar tool.

Has anyone here informations on how sourcefourge does the mirroring?

Regards,
André


-Ursprüngliche Nachricht-
Von: typo3-english-boun...@lists.typo3.org
[mailto:typo3-english-boun...@lists.typo3.org] Im Auftrag von Markus Klein
Gesendet: Donnerstag, 3. Oktober 2013 15:04
An: 'TYPO3 English'
Betreff: Re: [TYPO3-english] Setting of TER mirror in TYPO3 6.x?

 
 Hi,
 
  do you mean we should hardcode the typo3.org mirror in the Core, or
shall
 we simply modify the mirror-list downloaded by the EM?
 
 How often are the mirrors synchronized? Is it possible to synchronize a
bit
 more often?
 
 Fetching the list of extensions from t3o but then fetching the actual
 extension from a mirror which is not yet ready will fail.
 
 Purpose of the mirrors is to spread load but it gives other problems such
as
 synchronizing the download counter (does somebody know if this finally
 works or if only t3o is taken into account?).

Do we really encounter so much load that it justifies the overhead of
mirrors?

 
 Waiting a few hours was not a problem for a long time because we did not
 have cron jobs to automatically reload the list, to monitor what's going
on, to
 alert if a security release is out, etc. Nowadays, we are getting pinged
really
 quickly when something happens and we see that users expect much more
 than before with the concept of synced mirror.
 
 Or maybe we should delay the notification for a few hours until mirrors
are in
 sync? This leads to other issues :)
 
 --
 Xavier Perseguers
 Release Manager TYPO3 4.6
 
 TYPO3  inspiring people to share!
 Get involved: http://typo3.org


Kind regards
Markus


Markus Klein
TYPO3 CMS Active Contributors Team Member

___
TYPO3-english mailing list
TYPO3-english@lists.typo3.org
http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english

___
TYPO3-english mailing list
TYPO3-english@lists.typo3.org
http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english


Re: [TYPO3-english] Setting of TER mirror in TYPO3 6.x? Or change mirror concept?

2013-10-04 Thread Philipp Gampe
Hi André,

André Spindler wrote:

 Has anyone here informations on how sourcefourge does the mirroring?

AFAIK it is not done via sourceforge, but via normal webserver and rsync is 
used.

Best regards
-- 
Philipp Gampe – PGP-Key 0AD96065 – TYPO3 UG Bonn/Köln
Documentation – Active contributor TYPO3 CMS
TYPO3  inspiring people to share!

___
TYPO3-english mailing list
TYPO3-english@lists.typo3.org
http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english

Re: [TYPO3-english] Setting of TER mirror in TYPO3 6.x? Or change mirror concept?

2013-10-04 Thread Xavier Perseguers
Hi,

 Has anyone here informations on how sourcefourge does the mirroring?
 
 AFAIK it is not done via sourceforge, but via normal webserver and rsync is 
 used.

Yes, SourceForge is only used for distributing TYPO3 itself, not
extensions nor the language packages.

Older guys from the server team (I typically think of Michael) should
be able to properly answer about the internals. But AFAIK/R it's really
a rsync (no clue what is suggested as interval) initiated by the mirrors
themselves against typo3.org.

-- 
Xavier Perseguers
Release Manager TYPO3 4.6

TYPO3  inspiring people to share!
Get involved: http://typo3.org

___
TYPO3-english mailing list
TYPO3-english@lists.typo3.org
http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english


Re: [TYPO3-english] Setting of TER mirror in TYPO3 6.x? Or change mirror concept?

2013-10-04 Thread Steffen Gebert
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Hi,

luckily, also younger ones can answer this :-)

I had a look at the TER magic more than a year ago, when typo3.org was
relaunched (and the problem with the mirrors forgotten/ignored/whatever).

As described, it works by rsync transfers initiated by the mirror
servers. And we had the plan to have a ter.typo3.org that will be the
new server hosting the TER and maybe even allowing others to just sync
from it. Unfortunately, until now everything is very tightly coupled
with the typo3.org web site.

As the mirrors are not used with the 6.0 EM (correct my if I'm wrong),
nobody (at least me) had the motivation to pick up that topic. The
really bad thing is that the mirrors don't sync from the new typo3.org
server, they really still sync from the old one. One reason is that we
would have to contact the mirror admins to change the host name (they
all use a .t3o.punkt.de host name) and accept the new SSH key and so on.

That (unfortunately) still hasn't happened, from my side because I very
much think the that implemented concept is bad. Especially when it comes
to download counter, it's horrible (there's a script that was only
active on the old typo3.org server that goes through the access log
every night and reports the download stats via a SOAP request).

With things like composer integration coming sooner or later, I agree
that the whole concept has to be rethought. So I agree with André that
things should better be implemented differently. But I'm really not
sure, what a good solution would be (just use a CDN?) and what the plans
from developer's perspective are (probably composer..).

Yours
Steffen

- -- 
Steffen Gebert
TYPO3 Server Administration Team Member

TYPO3  inspiring people to share!
Get involved: http://typo3.org

My wish list:
https://www.amazon.de/registry/wishlist/922E3JYSQ7CV/ref=cm_wl_sb_v?sort=priority

On 10/4/13 1:35 PM, Xavier Perseguers wrote:
 Hi,
 
 Has anyone here informations on how sourcefourge does the mirroring?

 AFAIK it is not done via sourceforge, but via normal webserver and rsync is 
 used.
 
 Yes, SourceForge is only used for distributing TYPO3 itself, not
 extensions nor the language packages.
 
 Older guys from the server team (I typically think of Michael) should
 be able to properly answer about the internals. But AFAIK/R it's really
 a rsync (no clue what is suggested as interval) initiated by the mirrors
 themselves against typo3.org.
 
-BEGIN PGP SIGNATURE-
Version: GnuPG/MacGPG2 v2.0.20 (Darwin)
Comment: GPGTools - http://gpgtools.org
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iQEcBAEBAgAGBQJSTvpWAAoJEIskG/rSlyw48wwH/izP5S6z7dLxTgDCIQ8BHCxu
FPdGtGxSqrnWpEfhiomkXPD/wYUVuCO4BeMRenh1wdQACa92tyVdtmnVvQFYTwqf
r9TJ/sEKW7/PaDIGxkm7wk4VCMr3J4n3dw5UkIbWpD1y6NeSBifVlQBYIzBaM2jC
vis0TZv8rnWrvBkmHfgEJsHD3+rl5pnF5Agc9k3GTnIQ0AKJexBe4muu9/VZImdN
sETHXcAapq9dLd2smkiGLp3zfQUrEPOzQ9VP1v4nxq96xsSGuEehKrDQDT5VqL2e
ahH8TsOJePzyl3achMFWkuorqb9JeLuyyWHE9qGVq4ENkl34c9nAHUghQrfjb9M=
=6w7a
-END PGP SIGNATURE-
___
TYPO3-english mailing list
TYPO3-english@lists.typo3.org
http://lists.typo3.org/cgi-bin/mailman/listinfo/typo3-english