[Python-buildbots] Moving Python.org to Buildbot 9 + Python 3

2017-09-20 Thread Craig Rodrigues
In the past two years, I've put a lot of effort into porting the following to Python 3: Twisted: https://www.slideshare.net/CraigRodrigues1/the-onward- journey-porting-twisted-to-python-3 Buildbot: https://github.com/buildbot/buildbot/pulls?utf8=%E2%9C%93&; q=is%3Aclosed%20is%3Apr%20author%3Arodr

Re: [Python-buildbots] Moving Python.org to Buildbot 9 + Python 3

2017-09-20 Thread Craig Rodrigues
s, David > > On Wed, Sep 20, 2017 at 6:27 AM, Craig Rodrigues > wrote: > > In the past two years, I've put a lot of effort into porting the > following > > to Python 3: > > > > Twisted: > > https://www.slideshare.net/CraigRodrigues1/the-onward- >

Re: [Python-buildbots] Moving Python.org to Buildbot 9 + Python 3

2017-09-21 Thread Craig Rodrigues
On Wed, Sep 20, 2017 at 8:02 AM, R. David Murray wrote: > > In response to your posting on core-mentorship Victor mentioned there > were issues with the proof-of-concept, so figuring out those issues is > presumably the first step. > > Zach reported his progress of setting up http://buildbot.pyth

Re: [Python-buildbots] Moving Python.org to Buildbot 9 + Python 3

2017-09-21 Thread Craig Rodrigues
On Thu, Sep 21, 2017 at 11:12 AM, Zachary Ware wrote: > > That seems to be a theme with this test instance; pretty much > everything I click on looks incomplete whether logged in or not, and > no errors appear in the logs. Is there something missing/broken in > the configuration? > I'm not sure

Re: [Python-buildbots] Moving Python.org to Buildbot 9 + Python 3

2017-09-22 Thread Craig Rodrigues
On Wed, Sep 20, 2017 at 8:02 AM, R. David Murray wrote: > The question most relevant to this list is, what are the consequences on > the slave maintainers? Assuming we convert the master, will the slaves > be required to run python3/0.9? (That would certainly be desirable, > but would it be req

Re: [Python-buildbots] Moving Python.org to Buildbot 9 + Python 3

2017-10-06 Thread Craig Rodrigues
On Wed, Sep 20, 2017 at 8:02 AM, R. David Murray wrote: > > In response to your posting on core-mentorship Victor mentioned there > were issues with the proof-of-concept, so figuring out those issues is > presumably the first step. > > I've been working with Zach quite a lot, and I believe we ha

Re: [Python-buildbots] Moving Python.org to Buildbot 9 + Python 3

2017-10-06 Thread Craig Rodrigues
On Fri, Oct 6, 2017 at 1:20 PM, Victor Stinner wrote: > > By the way, it like the idea of eating our own dog food: migrate from > Python 2 to Python 3 :-) > = I performed some interop testing between Python 2 buildbot worker and Python 3 buildbot master: https://lists.buildbot.net/pipermail/d

[Python-buildbots] Buildbot 9 + Postgres backend

2017-10-06 Thread Craig Rodrigues
I'd like to suggest that when we upgrade the buildbot master, we use a Postgres backend instead of sqlite: http://docs.buildbot.net/latest/manual/cfg-global.html#postgres This is for better performance. Since postgres is involved, this would require coordination with the Python infra team. -- C

Re: [Python-buildbots] Buildbot 9 + Postgres backend

2017-10-06 Thread Craig Rodrigues
On Fri, Oct 6, 2017 at 1:42 PM, Zachary Ware wrote: > On Fri, Oct 6, 2017 at 3:36 PM, Craig Rodrigues > wrote: > > I'd like to suggest that when we upgrade the buildbot master, > > we use a Postgres backend instead of sqlite: > > > > http://docs.buildbo

Re: [Python-buildbots] Moving Python.org to Buildbot 9 + Python 3

2017-10-06 Thread Craig Rodrigues
On Fri, Oct 6, 2017 at 1:46 PM, David Bolen wrote: > > Over a longer period, I'm curious about the preferences - are there > concrete benefits in our environment of 0.9 over 0.8 on the worker > side? E.g., what does upgrading bring on the worker side? > On the worker side, the are no performan

Re: [Python-buildbots] Looking up status of build bots?

2017-10-10 Thread Craig Rodrigues
On Mon, Oct 9, 2017 at 12:29 PM, Zachary Ware wrote: > > Craig, is there anything more comparable to > /waterfall?show=Builder1&show=Builder2 in Buildbot 0.9.x? > There is not a 1:1 mapping of that buildbot 0.8 feature to buildbot 0.9, unfortunately. It's not the same, but one thing you can do

[Python-buildbots] Outdated wiki information

2017-10-13 Thread Craig Rodrigues
This page: https://www.python.org/dev/buildbot/ should probably be changed to from "buildbot slave" to "buildbot worker" These two wiki pages related to buildbots have really oudated information: https://wiki.python.org/moin/BuildBot * references to "buildbot slave" should be changed to "build

Re: [Python-buildbots] Moving Python.org to Buildbot 9 + Python 3

2017-10-13 Thread Craig Rodrigues
On Fri, Oct 6, 2017 at 1:46 PM, David Bolen wrote: > > Oh, and I can offer any of my Windows workers for interoperability > testing if you'd like me to temporarily configure them to an > additional master. At least one of them (XP) is probably not worth > the effort of getting to (a) vs. (b). >

Re: [Python-buildbots] Moving Python.org to Buildbot 9 + Python 3

2017-10-13 Thread Craig Rodrigues
if that might be the same issue with kloth-win64. > > -- David > > > On Fri, Oct 13, 2017 at 3:59 PM, Craig Rodrigues > wrote: > >> On Fri, Oct 6, 2017 at 1:46 PM, David Bolen wrote: >> >>> >>> Oh, and I can offer any of my Windows workers for interope

Re: [Python-buildbots] Moving Python.org to Buildbot 9 + Python 3

2017-10-13 Thread Craig Rodrigues
On Fri, Oct 13, 2017 at 1:36 PM, David Bolen wrote: > Does testing include a mixture with a master under 3.x? I only ask since > I'd guess that a master under 2.x might be sending parameters down as > strings rather than unicode. > I've tested the following combinations of master 3.x <==> work

Re: [Python-buildbots] Outdated wiki information

2017-10-13 Thread Craig Rodrigues
On Fri, Oct 13, 2017 at 7:57 PM, Berker Peksağ wrote: > > > Can't we refer people to https://devguide.python.org/buildslave/ and > update all outdated information there? It looks like the buildbot > pages on the wiki mostly contain outdated and duplicate information. > That sounds like a perfect

Re: [Python-buildbots] Outdated wiki information

2017-11-10 Thread Craig Rodrigues
I've made these changes to the wiki. On Fri, Oct 13, 2017 at 12:55 PM, Craig Rodrigues wrote: > This page: > https://www.python.org/dev/buildbot/ > > should probably be changed to from "buildbot slave" to "buildbot worker" > > These two wiki pages

Re: [Python-buildbots] __Janitor buildbot

2018-07-03 Thread Craig Rodrigues
__Janitor is an internal builder used by buildbot to clean things up: http://docs.buildbot.net/latest/manual/installation/nine-upgrade.html#data-lifetime There has been some talk about hiding it from the UI since it can be confusing to end-users of buildbot: https://github.com/buildbot/buildbot/

[Python-buildbots] Buildbot 2.1.0 and TLS between master and worker

2019-04-11 Thread Craig Rodrigues
Buildbot 2.1.0 (which is running at https://buildbot.python.org/all/ ) now supports TLS between a buildbot worker and the buildbot master. There is an example of setting this up here: http://docs.buildbot.net/current/manual/installation/worker.html#worker-tls-configuration For folks interested i