[Python-ideas] Re: python interpreter docker builder

2020-07-15 Thread Wes Turner
Re: manylinux wheels in Alpine docker (musl (with glibc optionally also installed)) "Clarify that pip wheels are incompatible with alpine-based images" https://github.com/docker-library/docs/issues/904 "Install manylinux wheel although it's not officially supported by the host" https://github.com

[Python-ideas] Re: python interpreter docker builder

2020-04-07 Thread João Santos
On Tuesday, 7 April 2020 10:52:36 CEST M.-A. Lemburg wrote: > Hi Antonio, > > you may want to have a look at the Alpine images for Python > and this optimized variant: > > https://github.com/jfloff/alpine-python > > They also come with dev tools installed. Still, they are overall > rather clunky

[Python-ideas] Re: python interpreter docker builder

2020-04-07 Thread M.-A. Lemburg
Hi Antonio, you may want to have a look at the Alpine images for Python and this optimized variant: https://github.com/jfloff/alpine-python They also come with dev tools installed. Still, they are overall rather clunky to ship around. On the plus side, you can layer images in docker, so that app

[Python-ideas] Re: python interpreter docker builder

2020-04-04 Thread Christopher Barker
Conda can supply (in principle ) anything. And it certainly supply compilers. And conda-forge has them, at least for some packages. It seems that conda could provide your SDK. And if you want it, you could use constructor to build an installer with everything in one package. -CHB On Fri, Apr 3

[Python-ideas] Re: python interpreter docker builder

2020-04-03 Thread Antonio Cavallo
Hi Marc-Andre, yes pyrun is sort of what I had in mind :) That would be like the jre part of the jdk if you're familiar with java. Ideally users will download the jre and use for running applications (eg. pyrun) but if there's a need for an extension build one need to have a compiler.. now given

[Python-ideas] Re: python interpreter docker builder

2020-04-03 Thread M.-A. Lemburg
Hi Antonio, could you please spell out your requirements a bit more clearly ? I have a hard time trying to understand what you're after. It seems to be about some sort of Python extension building environment for Linux, but I could be wrong. You normally don't need to build Python itself just to

[Python-ideas] Re: python interpreter docker builder

2020-04-02 Thread Wes Turner
It should be possible to do rootless manylinux builds in containers with podman/buildah: https://developers.redhat.com/blog/2019/02/21/podman-and-buildah-for-docker-users/ Last I checked, rootless within rootless as you'd need for CI builds is problematic due to overlayfs within overlayfs not work

[Python-ideas] Re: python interpreter docker builder

2020-04-02 Thread Antonio Cavallo
Probably, but I'm still convinced a sdk would be nice. Yes, I'm aware of manylinux. DEB/RP suffer from the fact that need to be "root" installed and manylinux needs docker to be used, so same issue. Thanks On Thu, 2 Apr 2020 at 20:55, Wes Turner wrote: > No, I think you might be doing it wron

[Python-ideas] Re: python interpreter docker builder

2020-04-02 Thread Wes Turner
No, I think you might be doing it wrong. FWIW, I haven't needed to compile CPython in 10 years (iot to build something other than CPython) because official builds of Conda, DEB, RPM, or Docker containers are generally sufficient. Are you familiar with the manylinux specs? I should've thought to me

[Python-ideas] Re: python interpreter docker builder

2020-04-02 Thread Antonio Cavallo
To distribute python binaries (interpreter + extensions) on linux one need to compile it using the lowest common denominator (eg. some linux distro really old, like rhel6). Later when a user need to build an extension that might not be possible (because the running host might not have a compatible

[Python-ideas] Re: python interpreter docker builder

2020-04-02 Thread Wes Turner
So you want to import from / call into what would be in $prefix/lib & $prefix/include? How is the SDK archive use case different from the package archive use case? On Thu, Apr 2, 2020, 8:32 PM Antonio Cavallo wrote: > Yes, I'm aware of those.. providing an application wouldn't be what I have >

[Python-ideas] Re: python interpreter docker builder

2020-04-02 Thread Antonio Cavallo
Yes, I'm aware of those.. providing an application wouldn't be what I have in mind. The point would be providing a python sdk, similar to what node/java/.net provide. something it would possible to build upon. Those are distributed as stand alone "zip" to the general public. On Thu, 2 Apr 2020

[Python-ideas] Re: python interpreter docker builder

2020-04-02 Thread Wes Turner
Would e.g. pyinstaller or constructor solve the problem? https://pyinstaller.readthedocs.io/en/stable/ > PyInstaller bundles a Python application and all its dependencies into a single package. The user can run the packaged app without installing a Python interpreter or any modules. PyInstaller s

[Python-ideas] Re: python interpreter docker builder

2020-04-02 Thread Antonio Cavallo
Not quite, my hope is to have a python tarball similar to the "Windows x86 embeddable zip file" but for linux. Similar to miniconda but for plain python, or sort of python "sdk", if that makes sense. Thanks PS. I didn't know about the core workflow, thanks On Thu, 2 Apr 2020 at 19:55, Wes Turne

[Python-ideas] Re: python interpreter docker builder

2020-04-02 Thread Wes Turner
https://devguide.python.org/buildbots/ These run in Docker containers: - https://github.com/python/cpython/blob/master/.travis.yml - https://github.com/conda-forge/python-feedstock/blob/master/recipe/build.sh These are all of the current builds; are you proposing another? https://github.com/pytho