[Cloud] Re: Python upgrade on the Toolforge

2021-09-28 Thread Taavi Väänänen
On 9/28/21 8:42 PM, Roy Smith wrote: Also, please note, I'm just speaking as a Toolforge user. I can't promise what the folks who run Toolforge think about this.  They haven't told me I can't do it, but I don't know if they're totally on board with the idea. I certainly don't like the manual

[Cloud] Re: Python upgrade on the Toolforge

2021-09-28 Thread Roy Smith
> On Sep 28, 2021, at 12:56 PM, Huji Lee wrote: > > Do you have any links to share about building python from source? First, download the source tarball. If I were doing this today, I'd use Python 3.9.7, which is at https://www.python.org/downloads/release/python-397/

[Cloud] Re: Python upgrade on the Toolforge

2021-09-28 Thread Huji Lee
Do you have any links to share about building python from source? And is it safe to assume that if I build python from source and put it inside of a venv, when I submit to grid it'll use my python for the job? On Sun, Sep 26, 2021 at 10:12 PM Roy Smith wrote: > I don't know if it's generally

[Cloud] Re: Python upgrade on the Toolforge

2021-09-26 Thread Roy Smith
I don't know if it's generally available yet, but I've been using tools-sgebastion-11, which is running Debian Buster with Python 3.7. On the other hand, I don't actually use the system Python. Quite a while ago, before the Buster machine was available, I built Python 3.7 from source and I've

[Cloud] Re: Python upgrade on the Toolforge

2021-09-26 Thread AntiCompositeNumber
The grid and bastions only support Python 3.5; that won't change until they get an OS upgrade (https://phabricator.wikimedia.org/T275864). As you noted, python 3.7 and 3.9 are available on Kubernetes but writing YAML configuration can be complex. There is a project to build a tool similar to jsub