On Thu, 7 Sep 2023, Markus Schaaf wrote:
Hi,
in the Archlinux32 repos, a lot of packages that install Python modules need
rebuilding. It would be nice, if upgrading Python and such packages could
somehow be coordinated, such that a new release of the Python interpreter and
these packages are only pushed after all of them have been rebuilt. I don't
know how Archlinux handles this, but I never noticed such problem there.
A cursory look through the logs seems to show that many of the packages I'm
complaining about failed building, because a dependency wasn't built/updated
first. For instance Borg failed because of python-jaraco.functools, which
failed because the dependency python-setuptools is missing, which should have
been pulled in by python-setuptools-scm.
Here is part of the build log for python-jaraco.functools:
(2/3) installing python [######################]
100%
Optional dependencies for python
python-setuptools
python-pip
sqlite [installed]
mpdecimal: for decimal
xz: for lzma [installed]
tk: for tkinter
(3/3) installing python-more-itertools [----------------------]
0%
(3/3) installing python-more-itertools [######################]
100%
[?25h==> Checking buildtime dependencies...
==> Installing missing dependencies...
[?25lresolving dependencies...
looking for conflicting packages...
Packages (15) perl-error-0.17029-5.0 perl-mailtools-2.21-7.0
perl-timedate-2.33-5.0 python-iniconfig-2.0.0-2.1
python-packaging-23.1-1.1 python-pep517-0.1-1.3
python-pluggy-1.0.0-2.1 python-typing_extensions-4.7.1-1.0
git-2.40.1-1.0 python-build-0.1-1.3
python-installer-0.1-1.3
python-jaraco.classes-3.2.3-1.1 python-pytest-7.4.0-1.0
python-setuptools-scm-7.1.0-4.1 python-wheel-0.1-1.3
Total Installed Size: 49.66 M
As you can see, python-setuptools-scm gets installed without its dependency
python-setuptools. Could someone please have a look at this?
BR
Hi Markus,
theoretically, this should not happen:
Packages are moved together with their dependencies from *-staging to
*-testing and from *-testing to *. However, we are forced to relieve this
restriction and move packages no-matter-what after a certain time (I
think, it's currently 14 days), because: If we would strictly follow the
restriction, basically all packages would get stuck in *-staging at some
point. The reason for that is, that any no-matter-how-unimportant python
package, that fails to compile, will block the transition of the built
python, which in turn blocks all python packages.
On the other hand, python itself seems to make trouble when compiling,
mostly probably due to bootstrap issues. Upstream Archlinux does not have
these issues, because they compile all packages manually - but they do not
necessarily publish all those versions. I.e. upgrading python may (or may
not - I'm not an Arch maintainer) involve some "bootstrap" or "shim"
packages along the way, which never make it into the official repositories
or - at least - never make it into core or extra.
That being said: We're always happy about an additional pair of hands
(plus eyes, and a brain), which run our testing repositories, notify us
early about problems, send in patches to address compilation troubles,
etc. pp.
If you want to get started looking into python compilation errors, here is
a list of problems:
https://archlinux32.org/buildmaster/build-list.php?sort=blocks&q=python
If you're more into reading my obscure bash and mysql code, then I
challenge you to find (and report) bugs, so we can get rid of them:
https://git.archlinux32.org/builder
In any case, I'm always happy to hear from someone, that they're using
archlinux32 :-D
regards,
Erich
