Re: Partial mass rebuild for Python 2.7 coming soon (I hope)

[Florent Le Coz]

  On 26/07/2010 13:42, Thomas Spura wrote:
> '--scratch' means, that it will be build, you can see the logs and
> after a while, everything is deleted again...
>
> You need to build *without* '--scratch', so this will be a proper build
> in koji. I don't think that will work without bumping the release and
> you get the same error like above.
>
> So you need to bumb the release and rebuild.
>
>   Thomas
Ok, done:
http://koji.fedoraproject.org/koji/taskinfo?taskID=2351167

 Florent
-- 
devel mailing list
devel@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/devel

Re: Partial mass rebuild for Python 2.7 coming soon (I hope)

[Thomas Spura]

Am Mon, 26 Jul 2010 10:45:33 +0200
schrieb Florent Le Coz :

>   On 25/07/2010 13:47, Thomas Spura wrote:
> > Am Fri, 23 Jul 2010 14:54:40 +0200
> > schrieb Florent Le Coz:
> >
> >>On 22/07/2010 17:28, David Malcolm wrote:
> >>> louizatakk (1):
> >>>  python-pgu
> >>>  
> >> I fixed the .spec file, it should work properly now, but I can't
> >> build on Koji to check.
> >> I first built it on devel, and I then tried on the target
> >> dist-f14-py27-rebuild
> >> 
> >> but it failed with "GenericError: Build already exists"
> >>
> >> http://koji.fedoraproject.org/koji/buildinfo?buildID=185984
> >> http://koji.fedoraproject.org/koji/taskinfo?taskID=2346535
> >>
> >> Anyway, this should be fixed.
> > Not yet. This is now only build in rawhide, but not in
> > dist-f14-py27-rebuild.
> >
> > Because you already build 0.12.3-5 in rawhide, you cannot build the
> > same version in another tag. Please bump the release and build it
> > again in the target dist-f14-py27-rebuild.
> >
> > Thomas
> I've done  the
> 
>make srpm
>koji build --scratch dist-f14-py27-rebuild SRPM-FILE
> 
> You gave in another thread, and this worked 
> (http://koji.fedoraproject.org/koji/taskinfo?taskID=2350803)
> Is this OK or should I really bump the release and rebuild?

'--scratch' means, that it will be build, you can see the logs and
after a while, everything is deleted again...

You need to build *without* '--scratch', so this will be a proper build
in koji. I don't think that will work without bumping the release and
you get the same error like above.

So you need to bumb the release and rebuild.

Thomas
-- 
devel mailing list
devel@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/devel

Re: Partial mass rebuild for Python 2.7 coming soon (I hope)

[Florent Le Coz]

  On 25/07/2010 13:47, Thomas Spura wrote:
> Am Fri, 23 Jul 2010 14:54:40 +0200
> schrieb Florent Le Coz:
>
>>On 22/07/2010 17:28, David Malcolm wrote:
>>> louizatakk (1):
>>>  python-pgu
>>>  
>> I fixed the .spec file, it should work properly now, but I can't
>> build on Koji to check.
>> I first built it on devel, and I then tried on the target
>> dist-f14-py27-rebuild
>> 
>> but it failed with "GenericError: Build already exists"
>>
>> http://koji.fedoraproject.org/koji/buildinfo?buildID=185984
>> http://koji.fedoraproject.org/koji/taskinfo?taskID=2346535
>>
>> Anyway, this should be fixed.
> Not yet. This is now only build in rawhide, but not in
> dist-f14-py27-rebuild.
>
> Because you already build 0.12.3-5 in rawhide, you cannot build the
> same version in another tag. Please bump the release and build it again
> in the target dist-f14-py27-rebuild.
>
>   Thomas
I've done  the

   make srpm
   koji build --scratch dist-f14-py27-rebuild SRPM-FILE

You gave in another thread, and this worked 
(http://koji.fedoraproject.org/koji/taskinfo?taskID=2350803)
Is this OK or should I really bump the release and rebuild?

 Florent
-- 
devel mailing list
devel@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/devel

Re: Partial mass rebuild for Python 2.7 coming soon (I hope)

[Thomas Spura]

Am Fri, 23 Jul 2010 14:54:40 +0200
schrieb Florent Le Coz :

>   On 22/07/2010 17:28, David Malcolm wrote:
> > louizatakk (1):
> > python-pgu
> >  
> I fixed the .spec file, it should work properly now, but I can't
> build on Koji to check.
> I first built it on devel, and I then tried on the target 
> dist-f14-py27-rebuild 
>  
> but it failed with "GenericError: Build already exists"
> 
> http://koji.fedoraproject.org/koji/buildinfo?buildID=185984
> http://koji.fedoraproject.org/koji/taskinfo?taskID=2346535
> 
> Anyway, this should be fixed.

Not yet. This is now only build in rawhide, but not in
dist-f14-py27-rebuild.

Because you already build 0.12.3-5 in rawhide, you cannot build the
same version in another tag. Please bump the release and build it again
in the target dist-f14-py27-rebuild.

Thomas
-- 
devel mailing list
devel@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/devel

Re: Partial mass rebuild for Python 2.7 coming soon (I hope)

[Florent Le Coz]

  On 22/07/2010 17:28, David Malcolm wrote:
> louizatakk (1):
> python-pgu
>  
I fixed the .spec file, it should work properly now, but I can't build 
on Koji to check.
I first built it on devel, and I then tried on the target 
dist-f14-py27-rebuild 
 
but it failed with "GenericError: Build already exists"

http://koji.fedoraproject.org/koji/buildinfo?buildID=185984
http://koji.fedoraproject.org/koji/taskinfo?taskID=2346535

Anyway, this should be fixed.


 Florent
-- 
devel mailing list
devel@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/devel

Re: Partial mass rebuild for Python 2.7 coming soon (I hope)

[Thomas Spura]

Am Thu, 22 Jul 2010 22:37:56 -0500
schrieb Conan Kudo (ニール・ゴンパ) :

> I just got a new report from Koji saying there were errors recorded in
> root.log for the build of OggConvert on the PPC machines.
> 
> http://koji.fedoraproject.org/koji/getfile?taskID=2344902&name=root.log

From root.log:
DEBUG util.py:255:  Error: Package:
gstreamer-python-0.10.16-1.fc12.i686 (build) DEBUG
util.py:255: Requires: libpython2.6.so.1.0 DEBUG
util.py:255:   You could try using --skip-broken to work around the
problem DEBUG util.py:255:  Error: Package:
gstreamer-python-0.10.16-1.fc12.i686 (build) DEBUG
util.py:255: Requires: python(abi) = 2.6 DEBUG
util.py:255: Installing: python-2.7-5.fc14.i686 (build)
DEBUG util.py:255: python(abi) = 2.7 DEBUG
util.py:255: Available: python3-3.1.2-12.fc14.i686 (build)
DEBUG util.py:255: python(abi) = 3.1

So gstreamer-python needs a rebuild against python2.7, which happend
here:
http://koji.fedoraproject.org/koji/buildinfo?buildID=185134

-> The next build is successful:
http://koji.fedoraproject.org/koji/taskinfo?taskID=2346427

Thomas
-- 
devel mailing list
devel@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/devel

Re: Partial mass rebuild for Python 2.7 coming soon (I hope)

[ニール・ゴンパ]

I just got a new report from Koji saying there were errors recorded in
root.log for the build of OggConvert on the PPC machines.

http://koji.fedoraproject.org/koji/getfile?taskID=2344902&name=root.log

On Thu, Jul 22, 2010 at 6:55 PM, David Malcolm  wrote:

> On Thu, 2010-07-22 at 17:04 -0400, David Malcolm wrote:
> > On Thu, 2010-07-22 at 13:43 -0400, David Malcolm wrote:
> > > On Thu, 2010-07-22 at 13:07 -0400, David Malcolm wrote:
> > >
> > > [snip]
> > >
> > > > I messed up, and there's a bug in which python doesn't startup if
> > > > python-devel is not installed, which led to the majority of the
> "noarch"
> > > > builds failing.  [1]
> > > >
> > > > Sorry about that.  I'm working on a fixed python package.
> > >
> > > Hopefully this python build will fix it:
> > > http://koji.fedoraproject.org/koji/taskinfo?taskID=2343025
> > >
> >
> > That one didn't, but this one did:
> > http://koji.fedoraproject.org/koji/taskinfo?taskID=2343301
> > (python-2.7-5.fc14)
> > and it's now in the repo for the buildroot.
> >
> > Simple noarch builds seem to now be working (I've tested a few)
>
> I fixed the numpy issue (bug 617384) and this is now built; the
> buildroot repo is about to be repopulated, with the 2.7 numpy.
>
> Once that's done I'll rebuild pygtk2.
>
> Once that's done I'll try a mass run of all noarch builds that failed,
> since I believe many of them failed due to the python issue referred to
> above.
>
> At that point I _hope_ the failure list will become meaningful and
> manageable (and I'll post it).
>
> Dave
>
> --
> devel mailing list
> devel@lists.fedoraproject.org
> https://admin.fedoraproject.org/mailman/listinfo/devel
>
-- 
devel mailing list
devel@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/devel

Re: Partial mass rebuild for Python 2.7 coming soon (I hope)

[David Malcolm]

On Thu, 2010-07-22 at 17:04 -0400, David Malcolm wrote:
> On Thu, 2010-07-22 at 13:43 -0400, David Malcolm wrote:
> > On Thu, 2010-07-22 at 13:07 -0400, David Malcolm wrote:
> > 
> > [snip]
> > 
> > > I messed up, and there's a bug in which python doesn't startup if
> > > python-devel is not installed, which led to the majority of the "noarch"
> > > builds failing.  [1]
> > > 
> > > Sorry about that.  I'm working on a fixed python package.
> > 
> > Hopefully this python build will fix it:
> > http://koji.fedoraproject.org/koji/taskinfo?taskID=2343025
> > 
> 
> That one didn't, but this one did:
> http://koji.fedoraproject.org/koji/taskinfo?taskID=2343301
> (python-2.7-5.fc14)
> and it's now in the repo for the buildroot.
> 
> Simple noarch builds seem to now be working (I've tested a few)

I fixed the numpy issue (bug 617384) and this is now built; the
buildroot repo is about to be repopulated, with the 2.7 numpy.

Once that's done I'll rebuild pygtk2.

Once that's done I'll try a mass run of all noarch builds that failed,
since I believe many of them failed due to the python issue referred to
above.

At that point I _hope_ the failure list will become meaningful and
manageable (and I'll post it).

Dave

-- 
devel mailing list
devel@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/devel

Re: Partial mass rebuild for Python 2.7 coming soon (I hope)

[David Malcolm]

On Thu, 2010-07-22 at 15:52 +0900, Mamoru Tasaka wrote:
> Jeff Spaleta wrote, at 07/22/2010 03:11 PM +9:00:
> > On Wed, Jul 21, 2010 at 10:00 PM, David Malcolm  wrote:
> >> - numpy is segfaulting during %check; am waiting on a gdb build to
> >> finish (linked against 2.7) before I debug; this blocks pygtk2 which
> >> blocks various things
> >
> > Sigh... of course it does.  Since numpy pretty much blocks all the
> > packages important to me personally that I maintain...shoot me a
> > pointer to the failure logs if you need help tracking this down.
> >
> > -jef
> 
> build.log on koji can be found at:
> http://koji.fedoraproject.org/koji/taskinfo?taskID=2337411
> 
I've filed:
https://bugzilla.redhat.com/show_bug.cgi?id=617384
"Segfault in %check when building numpy against python 2.7" with more
information.

Dave

-- 
devel mailing list
devel@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/devel

Re: Partial mass rebuild for Python 2.7 coming soon (I hope)

[David Malcolm]

On Thu, 2010-07-22 at 13:43 -0400, David Malcolm wrote:
> On Thu, 2010-07-22 at 13:07 -0400, David Malcolm wrote:
> 
> [snip]
> 
> > I messed up, and there's a bug in which python doesn't startup if
> > python-devel is not installed, which led to the majority of the "noarch"
> > builds failing.  [1]
> > 
> > Sorry about that.  I'm working on a fixed python package.
> 
> Hopefully this python build will fix it:
> http://koji.fedoraproject.org/koji/taskinfo?taskID=2343025
> 

That one didn't, but this one did:
http://koji.fedoraproject.org/koji/taskinfo?taskID=2343301
(python-2.7-5.fc14)
and it's now in the repo for the buildroot.

Simple noarch builds seem to now be working (I've tested a few)

Dave

-- 
devel mailing list
devel@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/devel

Re: Partial mass rebuild for Python 2.7 coming soon (I hope)

[David Malcolm]

On Thu, 2010-07-22 at 13:07 -0400, David Malcolm wrote:

[snip]

> I messed up, and there's a bug in which python doesn't startup if
> python-devel is not installed, which led to the majority of the "noarch"
> builds failing.  [1]
> 
> Sorry about that.  I'm working on a fixed python package.

Hopefully this python build will fix it:
http://koji.fedoraproject.org/koji/taskinfo?taskID=2343025


Dave

-- 
devel mailing list
devel@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/devel

Re: Partial mass rebuild for Python 2.7 coming soon (I hope)

[David Malcolm]

On Thu, 2010-07-22 at 11:28 -0400, David Malcolm wrote:
> On Thu, 2010-07-22 at 08:39 -0400, Orcan Ogetbil wrote:
> > On Thu, Jul 22, 2010 at 3:24 AM, Kevin Fenzi wrote:
> > > On Thu, 22 Jul 2010 02:00:45 -0400
> > > David Malcolm wrote:
> > >
> > > ...snip...
> > >
> > >> - build ordering was much more important than I hoped; most of the
> > >> failures in this run seem to be due to incomplete deps in root.log.  I
> > >> intend to retry these from the now-existing CVS tags, with a better
> > >> build ordering (but I need to sleep first).
> > >
> > > Note that if you are not needing any changes in those packages you
> > > could just resubmit the failed builds. So, perhaps list all the fails
> > > and resubmit them all and see how many still fail?
> > >
> > 
> > What if we need to make changes to make them build? Shall we wait
> > until the mass rebuild is over or can we fix and build rightaway? If
> > the latter, under which tag should we build?
> 
> Updated status:
> 
> The first set of builds are done:
>   - 535 builds succeeded
>   - 436 build failed
>   - 1 build is stuck (python-cherrypy2-2.3.0-12.fc14.src.rpm, noarch
> http://koji.fedoraproject.org/koji/taskinfo?taskID=2337424 )
> 
> Many of the build failures seem to be purely due to missing build
> dependencies (because I didn't get ordering correct): you can see these
> by the failure happening in the "root.log", rather than the "build.log"
> 
> I've kicked off a simple rebuild of everything that failed, using the
> same CVS tag, into "dist-f14-py27-rebuild".  This will generate more
> koji activity and notification spam (sorry), but shouldn't foul CVS and
> changelogs in specfiles.
> 
> Hopefully this will shake out some more successful builds (python-nose
> wasn't available in the buildroot for much of last night).
> 
> Once that's done, we can start looking at the more difficult failures.
> 
> Attached is the list of failures from the first build.  Having said
> that, it's probably not particularly helpful yet, as I believe many of
> these failed due to missing build deps.  You may want to wait until the
> 2nd attempt at rebuilding is done: I'll post an updated list of failures
> then, and we can plan the next steps.
> 
> Having said that, some of the failures seem to be simple but real
> issues, like extension modules missing a BuildRequires: python-devel
This turned out to be a bug in my python-2.7 package.

I messed up, and there's a bug in which python doesn't startup if
python-devel is not installed, which led to the majority of the "noarch"
builds failing.  [1]

Sorry about that.  I'm working on a fixed python package.

Dave

[1] for reference, here's the traceback:
Executing(%build): /bin/sh -e /var/tmp/rpm-tmp.eEtMlg
main()
  File "/usr/lib/python2.7/site.py", line 531, in main
known_paths = addusersitepackages(known_paths)
  File "/usr/lib/python2.7/site.py", line 264, in addusersitepackages
user_site = getusersitepackages()
  File "/usr/lib/python2.7/site.py", line 239, in getusersitepackages
user_base = getuserbase() # this will also set USER_BASE
  File "/usr/lib/python2.7/site.py", line 229, in getuserbase
USER_BASE = get_config_var('userbase')
  File "/usr/lib/python2.7/sysconfig.py", line 518, in get_config_var
return get_config_vars().get(name)
  File "/usr/lib/python2.7/sysconfig.py", line 421, in get_config_vars
_init_posix(_CONFIG_VARS)
  File "/usr/lib/python2.7/sysconfig.py", line 285, in _init_posix
raise IOError(msg)
IOError: invalid Python installation: unable to
open /usr/include/python2.7/pyconfig.h (No such file or directory)


-- 
devel mailing list
devel@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/devel

Re: Partial mass rebuild for Python 2.7 coming soon (I hope)

[David Malcolm]

On Thu, 2010-07-22 at 08:39 -0400, Orcan Ogetbil wrote:
> On Thu, Jul 22, 2010 at 3:24 AM, Kevin Fenzi wrote:
> > On Thu, 22 Jul 2010 02:00:45 -0400
> > David Malcolm wrote:
> >
> > ...snip...
> >
> >> - build ordering was much more important than I hoped; most of the
> >> failures in this run seem to be due to incomplete deps in root.log.  I
> >> intend to retry these from the now-existing CVS tags, with a better
> >> build ordering (but I need to sleep first).
> >
> > Note that if you are not needing any changes in those packages you
> > could just resubmit the failed builds. So, perhaps list all the fails
> > and resubmit them all and see how many still fail?
> >
> 
> What if we need to make changes to make them build? Shall we wait
> until the mass rebuild is over or can we fix and build rightaway? If
> the latter, under which tag should we build?

Updated status:

The first set of builds are done:
  - 535 builds succeeded
  - 436 build failed
  - 1 build is stuck (python-cherrypy2-2.3.0-12.fc14.src.rpm, noarch
http://koji.fedoraproject.org/koji/taskinfo?taskID=2337424 )

Many of the build failures seem to be purely due to missing build
dependencies (because I didn't get ordering correct): you can see these
by the failure happening in the "root.log", rather than the "build.log"

I've kicked off a simple rebuild of everything that failed, using the
same CVS tag, into "dist-f14-py27-rebuild".  This will generate more
koji activity and notification spam (sorry), but shouldn't foul CVS and
changelogs in specfiles.

Hopefully this will shake out some more successful builds (python-nose
wasn't available in the buildroot for much of last night).

Once that's done, we can start looking at the more difficult failures.

Attached is the list of failures from the first build.  Having said
that, it's probably not particularly helpful yet, as I believe many of
these failed due to missing build deps.  You may want to wait until the
2nd attempt at rebuilding is done: I'll post an updated list of failures
then, and we can plan the next steps.

Having said that, some of the failures seem to be simple but real
issues, like extension modules missing a BuildRequires: python-devel

If you happen to see a genuine issue with one of your packages, feel
free to try and fix it: I've been doing rebuilds by hand on a few
high-importance packages.

You may have to wait until one of your BuildRequires is ready, of course
(or chase that one up).

The way I've been doing these manual rebuilds is to run this frmo a CVS
checkout of "devel":
  koji build dist-f14-py27-rebuild $(make cvsurl)
so that it rebuilds from the CVS tag into the correct
"dist-f14-py27-rebuild" target.   (Note that the normal target still has
python 2.6, not 2.7)

Q: How long does it take to populate the buildroot with this package?
A: It can take a while: as I understand it, once a build succeeds, a
"newRepo" koji task starts (unless one is already running) and that can
take a while.  Only when that's done does the buildroot have the new rpm
to build against.  As I understand it, there has to be a newRepo task
that started after the first build finished, and has finished, if that
makes sense

Hope this is helpful; sorry for the notification spam some of you are
getting from Koji.

Dave


425 failed builds:


abbot (1):
protobuf
ajax (3):
libxcb
system-config-display
xcb-proto
alexlan (4):
Miro
dblatex
picard
python-biopython
ant (1):
gget
awjb (1):
libopensync
behdad (1):
vte
belegdol (1):
museek+
bernie (1):
etckeeper
berrange (1):
gtk-vnc
bioinfornatics (1):
spe
bjohnson (2):
conduit
pygoocanvas
bkonrath (1):
caribou
bouska (1):
gnome-specimen
bpepple (4):
farsight2
gupnp-igd
papyon
telepathy-farsight
byronclark (1):
lazygal
caolanm (3):
libgsf
openoffice.org
planner
carllibpst (1):
libpst
cassmodiah (1):
fife
chkr (1):
anki
chrisw (1):
asciidoc
davidz (1):
orca
dcantrel (1):
pyparted
dcbw (1):
plague
dchen (2):
libsvm
tomoe-gtk
deji (3):
exaile
galternatives
referencer
dledford (1):
openmpi
dougsland (1):
zbar
dsd (1):
bitfrost
dtimms (1):
pyvnc2swf
dwayne (1):
pootle
eponyme (2):
gestikk
phatch
erikos (3):
hulahop
sugar
sugar-toolkit
fab (8):
onboard
pipviewer
pypoppler
pyrrd
python-altgraph
python-jabberbot
python-upoints
vhybridize
firewing (1):
gnofract4d
giallu (1):
buildbot
green (1):
lash
hadess (4):
gnome-dvb-daemon
gnome-lirc-properties
gstreamer-rtsp
libgpod
hguemar (7):
gazpacho
glom
pessulus
python-kiwi
python-mpd
python-sexy
sonata
hpejakle (1):
subdownloader
huff (2):
appliance-tools
livecd-tools
ianweller (3):
fedora-business-cards
python-flickrapi
python-mwlib
icon (1):
epylog
itamarjp (3):
pyclutter
python-Lightbox
python-Scriptaculous
ivazquez (2):
django-sct
pywebkitgtk
ixs (1):
pyzor
jafo (1):
python-pydns
jamatos (3):
pygsl
python-amara
rpy
james (1):
python-urlgrabber
janderson (1):
mumbles
jbowes (1):
ipython
jcollie (10):
bcfg2
desktopcouch
pyflakes
python-dns
python-lxml
python-musicbrainz2
python-openid
python-paramiko
python-xmpp
quo

Re: Partial mass rebuild for Python 2.7 coming soon (I hope)

[Mike McGrath]

On Thu, 22 Jul 2010, David Malcolm wrote:

> On Tue, 2010-07-20 at 20:02 -0400, David Malcolm wrote:
> > I'm planning to do a partial mass-rebuild for Python 2.7.
> >
> > This would cover all Python 2 users within the distribution, roughly
> > 1000 src.rpms.
> >
> > Some notes can be seen at:
> > https://fedoraproject.org/wiki/Features/Python_2.7/MassRebuild
> >
> [snip]
>
> Status: IN PROGRESS
> - IRC chat with nirik, pjones and others confirmed not to wait for gold
> - the infrastructure outage took somewhat longer that expected, so I
> didn't start until about 6pm EDT iirc.
> - The mass-rebuild script is running, and has done about 600 out of 1000
> packages.  All of this is into dist-f14-py27-rebuild, so it won't hit
> rawhide until rel-eng push it there.
> - We're at a roughly 50:50 success/fail rate
> - build ordering was much more important than I hoped; most of the
> failures in this run seem to be due to incomplete deps in root.log.  I
> intend to retry these from the now-existing CVS tags, with a better
> build ordering (but I need to sleep first).
> - numpy is segfaulting during %check; am waiting on a gdb build to
> finish (linked against 2.7) before I debug; this blocks pygtk2 which
> blocks various things
> - I've applied some fixes directly to some packages to get things to
> build.  I hope my changes are acceptable.
> - Sorry about all of the email notification spam some of you will have
> received
>
> Notes:
> - There was a snag with python-nose: I needed to cherrypick 2.7 compat
> fixes from upstream: DONE
> - There are some loops in the dep graph: python-nose and python-jinja2
> both BR: python-sphinx  but are in the BR for that package.  I've turned
> off doc generation for these for now; am waiting on repo to rebuild
> before I can build python-sphinx (deps appear to be ready).
>

If you want some help open up an FES ticket, I'll see what we can do:

https://fedorahosted.org/fedora-engineering-services/

A list of failing builds would be good.

-Mike
-- 
devel mailing list
devel@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/devel

Re: Partial mass rebuild for Python 2.7 coming soon (I hope)

[Paul W. Frields]

On Thu, Jul 22, 2010 at 02:00:45AM -0400, David Malcolm wrote:
> On Tue, 2010-07-20 at 20:02 -0400, David Malcolm wrote:
> > I'm planning to do a partial mass-rebuild for Python 2.7.
> > 
> > This would cover all Python 2 users within the distribution, roughly
> > 1000 src.rpms.
> > 
> > Some notes can be seen at:
> > https://fedoraproject.org/wiki/Features/Python_2.7/MassRebuild
> > 
> [snip]
> 
> Status: IN PROGRESS
> - IRC chat with nirik, pjones and others confirmed not to wait for gold
> - the infrastructure outage took somewhat longer that expected, so I
> didn't start until about 6pm EDT iirc.
> - The mass-rebuild script is running, and has done about 600 out of 1000
> packages.  All of this is into dist-f14-py27-rebuild, so it won't hit
> rawhide until rel-eng push it there.
> - We're at a roughly 50:50 success/fail rate
> - build ordering was much more important than I hoped; most of the
> failures in this run seem to be due to incomplete deps in root.log.  I
> intend to retry these from the now-existing CVS tags, with a better
> build ordering (but I need to sleep first).
> - numpy is segfaulting during %check; am waiting on a gdb build to
> finish (linked against 2.7) before I debug; this blocks pygtk2 which
> blocks various things
> - I've applied some fixes directly to some packages to get things to
> build.  I hope my changes are acceptable.
> - Sorry about all of the email notification spam some of you will have
> received
> 
> Notes:
> - There was a snag with python-nose: I needed to cherrypick 2.7 compat
> fixes from upstream: DONE
> - There are some loops in the dep graph: python-nose and python-jinja2
> both BR: python-sphinx  but are in the BR for that package.  I've turned
> off doc generation for these for now; am waiting on repo to rebuild
> before I can build python-sphinx (deps appear to be ready).
> 
> [snip]
> 
> Hope this makes sense

It does -- in my case (and probably many others) the pygtk2 rebuild
and reordering should take care of what went wrong.  Thanks for taking
this on Dave!

-- 
Paul W. Frieldshttp://paul.frields.org/
  gpg fingerprint: 3DA6 A0AC 6D58 FEC4 0233  5906 ACDB C937 BD11 3717
  http://redhat.com/   -  -  -  -   http://pfrields.fedorapeople.org/
  Where open source multiplies: http://opensource.com
-- 
devel mailing list
devel@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/devel

Re: Partial mass rebuild for Python 2.7 coming soon (I hope)

[Orcan Ogetbil]

On Thu, Jul 22, 2010 at 3:24 AM, Kevin Fenzi wrote:
> On Thu, 22 Jul 2010 02:00:45 -0400
> David Malcolm wrote:
>
> ...snip...
>
>> - build ordering was much more important than I hoped; most of the
>> failures in this run seem to be due to incomplete deps in root.log.  I
>> intend to retry these from the now-existing CVS tags, with a better
>> build ordering (but I need to sleep first).
>
> Note that if you are not needing any changes in those packages you
> could just resubmit the failed builds. So, perhaps list all the fails
> and resubmit them all and see how many still fail?
>

What if we need to make changes to make them build? Shall we wait
until the mass rebuild is over or can we fix and build rightaway? If
the latter, under which tag should we build?

Thanks,
Orcan
-- 
devel mailing list
devel@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/devel

Re: Partial mass rebuild for Python 2.7 coming soon (I hope)

[Kevin Fenzi]

On Thu, 22 Jul 2010 02:00:45 -0400
David Malcolm  wrote:

...snip...

> - build ordering was much more important than I hoped; most of the
> failures in this run seem to be due to incomplete deps in root.log.  I
> intend to retry these from the now-existing CVS tags, with a better
> build ordering (but I need to sleep first).

Note that if you are not needing any changes in those packages you
could just resubmit the failed builds. So, perhaps list all the fails
and resubmit them all and see how many still fail?

kevin


signature.asc
Description: PGP signature
-- 
devel mailing list
devel@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/devel

Re: Partial mass rebuild for Python 2.7 coming soon (I hope)

[Mamoru Tasaka]

Jeff Spaleta wrote, at 07/22/2010 03:11 PM +9:00:
> On Wed, Jul 21, 2010 at 10:00 PM, David Malcolm  wrote:
>> - numpy is segfaulting during %check; am waiting on a gdb build to
>> finish (linked against 2.7) before I debug; this blocks pygtk2 which
>> blocks various things
>
> Sigh... of course it does.  Since numpy pretty much blocks all the
> packages important to me personally that I maintain...shoot me a
> pointer to the failure logs if you need help tracking this down.
>
> -jef

build.log on koji can be found at:
http://koji.fedoraproject.org/koji/taskinfo?taskID=2337411

Regards,
Mamoru
-- 
devel mailing list
devel@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/devel

Re: Partial mass rebuild for Python 2.7 coming soon (I hope)

[Jeff Spaleta]

On Wed, Jul 21, 2010 at 10:00 PM, David Malcolm  wrote:
> - numpy is segfaulting during %check; am waiting on a gdb build to
> finish (linked against 2.7) before I debug; this blocks pygtk2 which
> blocks various things

Sigh... of course it does.  Since numpy pretty much blocks all the
packages important to me personally that I maintain...shoot me a
pointer to the failure logs if you need help tracking this down.

-jef
-- 
devel mailing list
devel@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/devel

Re: Partial mass rebuild for Python 2.7 coming soon (I hope)

[David Malcolm]

On Tue, 2010-07-20 at 20:02 -0400, David Malcolm wrote:
> I'm planning to do a partial mass-rebuild for Python 2.7.
> 
> This would cover all Python 2 users within the distribution, roughly
> 1000 src.rpms.
> 
> Some notes can be seen at:
> https://fedoraproject.org/wiki/Features/Python_2.7/MassRebuild
> 
[snip]

Status: IN PROGRESS
- IRC chat with nirik, pjones and others confirmed not to wait for gold
- the infrastructure outage took somewhat longer that expected, so I
didn't start until about 6pm EDT iirc.
- The mass-rebuild script is running, and has done about 600 out of 1000
packages.  All of this is into dist-f14-py27-rebuild, so it won't hit
rawhide until rel-eng push it there.
- We're at a roughly 50:50 success/fail rate
- build ordering was much more important than I hoped; most of the
failures in this run seem to be due to incomplete deps in root.log.  I
intend to retry these from the now-existing CVS tags, with a better
build ordering (but I need to sleep first).
- numpy is segfaulting during %check; am waiting on a gdb build to
finish (linked against 2.7) before I debug; this blocks pygtk2 which
blocks various things
- I've applied some fixes directly to some packages to get things to
build.  I hope my changes are acceptable.
- Sorry about all of the email notification spam some of you will have
received

Notes:
- There was a snag with python-nose: I needed to cherrypick 2.7 compat
fixes from upstream: DONE
- There are some loops in the dep graph: python-nose and python-jinja2
both BR: python-sphinx  but are in the BR for that package.  I've turned
off doc generation for these for now; am waiting on repo to rebuild
before I can build python-sphinx (deps appear to be ready).

[snip]

Hope this makes sense
Dave

-- 
devel mailing list
devel@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/devel

Re: Partial mass rebuild for Python 2.7 coming soon (I hope)

[David Malcolm]

On Tue, 2010-07-20 at 17:18 -0800, Jeff Spaleta wrote:
> On Tue, Jul 20, 2010 at 4:02 PM, David Malcolm  wrote:
> > I'm planning to do a partial mass-rebuild for Python 2.7.
> 
> 
> Please, when you hit build failures, and you will if you can
> provide a link to a failure report that is easily searchable(if not
> sorted by) primary package owner.  That will help me,help you, do any
> clean up for packages I have some modicum of clue about and feel
> accountable for.
Good idea - they're much easier to deal with that way.

It looks like the find-failures.py script [1] is already written to
provide results in this form.

> 
> Good luck.

Thanks!

Dave

[1]
http://git.fedorahosted.org/git/?p=releng;a=blob;f=scripts/find-failures.py

-- 
devel mailing list
devel@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/devel

Re: Partial mass rebuild for Python 2.7 coming soon (I hope)

[Thomas Moschny]

2010/7/21 David Malcolm :
> Some notes can be seen at:
> https://fedoraproject.org/wiki/Features/Python_2.7/MassRebuild
>> TODO: do we need a compat-python-2.6 temporarily to resolve loops in the dep 
>> graph?

Wouldn't such a compat package also make yum upgrades from f13->f14 or
rawhide-with-py2.6->rawhide-with-py2.7 easier, and thus should not
only provided temporarily, but for a longer time?

- Thomas
-- 
devel mailing list
devel@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/devel

Re: Partial mass rebuild for Python 2.7 coming soon (I hope)

[Jeff Spaleta]

On Tue, Jul 20, 2010 at 4:02 PM, David Malcolm  wrote:
> I'm planning to do a partial mass-rebuild for Python 2.7.


Please, when you hit build failures, and you will if you can
provide a link to a failure report that is easily searchable(if not
sorted by) primary package owner.  That will help me,help you, do any
clean up for packages I have some modicum of clue about and feel
accountable for.

Good luck.

-jef
-- 
devel mailing list
devel@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/devel

Partial mass rebuild for Python 2.7 coming soon (I hope)

[David Malcolm]

I'm planning to do a partial mass-rebuild for Python 2.7.

This would cover all Python 2 users within the distribution, roughly
1000 src.rpms.

Some notes can be seen at:
https://fedoraproject.org/wiki/Features/Python_2.7/MassRebuild

I hoped to start this tomorrow (2010-07-21) at 16:00 UTC, but it looks
like I need to wait until at least after the outage that's due for that
time [1]. Further, I'm still waiting to hear back to see if the build
should be done with the "gold" linker, rather than "gnu-ld" [2].  I will
delay the build until after a decision is made on this.

This may mean that I'll wait until 2010-07-22.

Some areas of uncertainty remain:
- the script to do this, as written, assumes no build ordering is
needed.  I know that some ordering is needed, and plan to manually order
the first four builds which I hope is the bulk of it, but it's not clear
to me if more is needed; I'm running some tests to try to better
determine this.

Hope this makes sense
Dave

[1] https://fedorahosted.org/fedora-infrastructure/ticket/2280
[2] https://fedoraproject.org/wiki/Features/GoldLinkerDefault


-- 
devel mailing list
devel@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/devel