Re: [Reproducible-builds] Bug#821777: Bug#821777: diffoscope fails with "pkg_resources.DistributionNotFound: python-magic"

2016-04-19 Thread Reiner Herrmann 
On Tue, Apr 19, 2016 at 09:57:45PM +, Mattia Rizzolo wrote:
> > There it simply doesn't clean up requires.txt.
> 
> Do you think it's safe and sane enough to just ignore all the python egg
> foo and empty the file during the build in d/rules or something on that
> line?
> I'm afraid I know nothing about distutils/setuptools and in general
> stuff to generate a python package for distribution, so I can't really
> judge on this...

I'm not yet sure what a good solution for this is, as I'm also not
really experienced with setuptools.
It might be nice for non-distribution installations, but it messes a bit
more with everything than I like (see also the auto-generated diffoscope
script...).


signature.asc
Description: Digital signature
___
Reproducible-builds mailing list
Reproducible-builds@lists.alioth.debian.org
http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/reproducible-builds

Re: [Reproducible-builds] Bug#821777: diffoscope fails with "pkg_resources.DistributionNotFound: python-magic"

2016-04-19 Thread Reiner Herrmann 
On Tue, Apr 19, 2016 at 10:25:41AM +0200, Holger Levsen wrote:
> I'd expect this problem would be intercepted and a helpful error message
> would be displayed.

What I also just saw is that /usr/bin/diffoscope is a auto-generated
script from easy_install coming from "entry_points={ 'console_scripts' ... }"
in setup.py. Not bin/diffoscope from the source directory.
So this auto-generated script is actually throwing the error (because of
requires.txt described in the previous mail), not diffoscope.



signature.asc
Description: Digital signature
___
Reproducible-builds mailing list
Reproducible-builds@lists.alioth.debian.org
http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/reproducible-builds

Re: [Reproducible-builds] Bug#821777: diffoscope fails with "pkg_resources.DistributionNotFound: python-magic"

2016-04-19 Thread Reiner Herrmann 
On Tue, Apr 19, 2016 at 10:25:41AM +0200, Holger Levsen wrote:
> $ diffoscope piuparts_0.70_source.changes piuparts_0.70~bpo8+1_source.changes
> Traceback (most recent call last):
>   File "/usr/bin/diffoscope", line 5, in 
> from pkg_resources import load_entry_point
>   File "/usr/lib/python3/dist-packages/pkg_resources.py", line 2876, in 
> 
> working_set = WorkingSet._build_master()
>   File "/usr/lib/python3/dist-packages/pkg_resources.py", line 449, in 
> build_master
> ws.require(__requires__)
>   File "/usr/lib/python3/dist-packages/pkg_resources.py", line 745, in require
> needed = self.resolve(parse_requirements(requirements))
>   File "/usr/lib/python3/dist-packages/pkg_resources.py", line 639, in resolve
> raise DistributionNotFound(req)
> pkg_resources.DistributionNotFound: python-magic

As Mattia found out, this is because the requires.txt of the backported
diffoscope is non-empty.

It contains the lines:
> python-magic
> libarchive-c

... which are the dependencies listed in setup.py as install_requires.
On unstable, those lines are _also_ in requires.txt _before_ dh_python3
runs. After it runs, it got cleaned up and the file is empty.
I saw in the changelog of dh-python that cleaning this file up is a recent
change [1], which explains why dh-python in stable behaves differently.
There it simply doesn't clean up requires.txt.

[1]: https://tracker.debian.org/media/packages/d/dh-python/changelog-2.20151103


signature.asc
Description: Digital signature
___
Reproducible-builds mailing list
Reproducible-builds@lists.alioth.debian.org
http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/reproducible-builds

Re: [Reproducible-builds] Blacklist packages for armhf

2016-04-19 Thread Holger Levsen 
Hi Vagrant,

On Sun, Apr 17, 2016 at 01:05:23PM -0700, Vagrant Cascadian wrote:
> Doing some sql queires and a bit of eyeball heuristics, I've determined
> the packages listed below frequently FTBFS due to timeout on armhf.

cool, thanks! though… ;-)
 
[...]

… I've taken this and changed the timeouts for maintenance scripts so
that I could change the 1st builders timeout to 18h and the 2nd builders
to 24h timeout.

So I guess it's rather time to unblacklist some packages, definitly on
armhf but probably even on amd64/i386? Could you maybe come up with such
a list? Probably just "all which are not blacklisted on amd64"… :)
 
> My rough process went like so:

It's great to have this documented now, even if only on the list. But I
guess thats good enough for now…

> I excluded packages from the submitted that had a recent completed build
> (reproducible or unreproducible), or where the FTBFS usually didn't take
> more than 12 hours. It maybe wasn't a perfect process, but hopefully
> will allow for better coverage of most of the rest of the archive.

seems reasonable, yes.

> It would be really helpful if we could mark failures due to timeouts
> separately from "normal" FTBFS

thanks for this suggestion, noted.

> and then packages could be rescheduled
> differently (e.g. an incremental delay for rescheduling, or not at
> all). Alternately or additionally, if the FTBFS rescheduling could
> adjust the frequency based on number of times a package has (recently)
> FTBFS, that might help too.

I'm not convinced the scheduled should be much more complicated than it
already is. KISS is good. (btw, I think depwaits should be scheduled
more often…)

> I think Holger at one point mentioned increasing the timeouts higher
> (currently 12h for 1st build, and 18h for 2nd build?), although
> with all the suites tested, some builds are over 45 days old, so I'm not
> sure if that would be ideal.

as said, this has been implemented now. The build network can definitly
catch up easily with new uploads *and* we will get more arm hw this
year, so… :)


-- 
cheers,
Holger


signature.asc
Description: Digital signature
___
Reproducible-builds mailing list
Reproducible-builds@lists.alioth.debian.org
http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/reproducible-builds

[Reproducible-builds] Bug#821785: sipwitch: FTBFS: service.cpp:256:28: error: invalid conversion from 'const sockaddr*' to 'sockaddr*' [-fpermissive]

2016-04-19 Thread Chris Lamb 
Source: sipwitch
Version: 1.6.1-2
Severity: serious
Justification: fails to build from source
User: reproducible-builds@lists.alioth.debian.org
Usertags: ftbfs
X-Debbugs-Cc: reproducible-builds@lists.alioth.debian.org

Dear Maintainer,

sipwitch fails to build from source in unstable/amd64:

  [..]

if test -e $i.cdbs-orig ; then \
mv $i.cdbs-orig $i ; \
fi ; \
  done
  rm -f debian/copyright_newhints
  rm -f debian/cdbs-install-list debian/cdbs-package-list 
debian/stamp-copyright-check
  rm -rf "debian/upstream-cruft"
  rm -f debian/stamp-upstream-cruft
  rm -f debian/stamp-autotools-files
  dh_clean 
  for file in Makefile.in common/Makefile.in inc/Makefile.in 
inc/sipwitch/Makefile.in server/Makefile.in test/Makefile.in utils/Makefile.in 
aclocal.m4 autoconf/ltmain.sh configure sipwitch.spec; do \
[ ! -e $file.upstream ] || mv -f $file.upstream $file; \
  done
  rm -f debian/stamp-upstreamtmpstuff
  rm -rf m4
  rm -f autoconf/compile autoconf/test-driver
  rm -f debian/sipwitch.init
  rm -f debian/stamp-local-shlibs-libsipwitch
   debian/rules build
  sed -e 's/__LIBPKGNAME__/libsipwitch1/g' debian/control.in
  test -x debian/rules
  mkdir -p "."
  /usr/share/cdbs/1/rules/buildcore.mk:110: CDBS WARNING:DEB_DH_STRIP_ARGS 
is deprecated since 0.4.85
  
  Scanning upstream source for new/changed copyright notices...
  
  licensecheck -c '.*' -r --copyright -i 
'^debian/(changelog|copyright(|_hints|_newhints))' -l '9' * | 
/usr/lib/cdbs/licensecheck2dep5 > debian/copyright_newhints
  16 combinations of copyright and licensing found.
  WARNING: The following (and possibly more) new or changed notices discovered:
  
   server/system.cpp
   utils/cgiserver.cpp
   utils/sippasswd.cpp
   utils/sipquery.cpp
   utils/sipwitch.cpp
   README
  Copyright: 1994-2002, 2003-2011, Free Software
   utils/sippasswd.1
2010, David Sugar 
   autoconf/ltmain.sh
  Copyright: 1992-1999, 2000-2012, Free Software Foundation, …
1996-1997, 1999-2000, 2002-2006, 2008-2012, Free Software …
1996-2001, 2003-2006, 2007-2011, Free Software Foundation…
1999-2000, 2003-2007, 2009-2010, 2011-2012, Free Software …
and license
  Copyright: 1996-2004, 2005-2011, Free Software Foundation,
  Files: configure
  Copyright: 1992-1996, 1998-2012, Free Software Foundation, …
  Copyright: 2007, Free Software Foundation, Inc.

[Reproducible-builds] Bug#821786: trivial-features: FTBFS: dh_install: Cannot find (any matches for) "*.lisp" (tried in "." and "debian/tmp")

2016-04-19 Thread Chris Lamb 
Source: trivial-features
Version: 0.6-1
Severity: serious
Justification: fails to build from source
User: reproducible-builds@lists.alioth.debian.org
Usertags: ftbfs
X-Debbugs-Cc: reproducible-builds@lists.alioth.debian.org

Dear Maintainer,

trivial-features fails to build from source in unstable/amd64:

  [..]

  dh_testdir
  dh_testroot
  dh_prep
  dh_testdir
  dh_testroot
  dh_install
  dh_installdocs
  dh_installchangelogs
  dh_compress
  dh_fixperms
  dh_installdeb
  dh_gencontrol
  dh_md5sums
  dh_builddeb
  dpkg-deb: building package 'trivial-features-build-deps' in 
'../trivial-features-build-deps_0.6-1_all.deb'.
  
  The package has been created.
  Attention, the package has been created in the current directory,
  not in ".." as indicated by the message above!
  Selecting previously unselected package trivial-features-build-deps.
  (Reading database ... 22993 files and directories currently installed.)
  Preparing to unpack trivial-features-build-deps_0.6-1_all.deb ...
  Unpacking trivial-features-build-deps (0.6-1) ...
  Reading package lists...
  Building dependency tree...
  Reading state information...
  Correcting dependencies... Done
  The following additional packages will be installed:
dh-lisp
  The following NEW packages will be installed:
dh-lisp
  0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
  1 not fully installed or removed.
  Need to get 9620 B of archives.
  After this operation, 34.8 kB of additional disk space will be used.
  Get:1 http://httpredir.debian.org/debian sid/main amd64 dh-lisp all 
0.7.1+nmu1 [9620 B]
  Fetched 9620 B in 0s (236 kB/s)
  Selecting previously unselected package dh-lisp.
  (Reading database ... 
(Reading database ... 5%
(Reading database ... 10%
(Reading database ... 15%
(Reading database ... 20%
(Reading database ... 25%
(Reading database ... 30%
(Reading database ... 35%
(Reading database ... 40%
(Reading database ... 45%
(Reading database ... 50%
(Reading database ... 55%
(Reading database ... 60%
(Reading database ... 65%
(Reading database ... 70%
(Reading database ... 75%
(Reading database ... 80%
(Reading database ... 85%
(Reading database ... 90%
(Reading database ... 95%
(Reading database ... 100%
(Reading database ... 22997 files and directories currently installed.)
  Preparing to unpack .../dh-lisp_0.7.1+nmu1_all.deb ...
  Unpacking dh-lisp (0.7.1+nmu1) ...
  Processing triggers for man-db (2.7.5-1) ...
  Setting up dh-lisp (0.7.1+nmu1) ...
  Setting up trivial-features-build-deps (0.6-1) ...
   dpkg-buildpackage -rfakeroot -D -us -uc -b
  dpkg-buildpackage: source package trivial-features
  dpkg-buildpackage: source version 0.6-1
  dpkg-buildpackage: source distribution unstable
  dpkg-buildpackage: source changed by Peter Van Eynde 
   dpkg-source --before-build trivial-features-0.6
  dpkg-buildpackage: host architecture amd64
   fakeroot debian/rules clean
  dh_testdir
  dh_testroot
  rm -f build-stamp configure-stamp
  # Add here commands to clean up after the build process.
  dh_clean
   debian/rules build
  dh_testdir
  # Add here commands to configure the package.
  touch configure-stamp
  dh_testdir
  # Add here commands to compile the package.
  touch build-stamp
   fakeroot debian/rules binary
  dh_testdir
  dh_testroot
  dh_prep
  # Add here commands to install the package into debian/xmls.
  dh_installdirs 
  dh_install 
  dh_install: Cannot find (any matches for) "*.lisp" (tried in "." and 
"debian/tmp")
  dh_install: missing files, aborting
  debian/rules:23: recipe for target 'install' failed
  make: *** [install] Error 255

  [..]

The full build log is attached.


Regards,

-- 
  ,''`.
 : :'  : Chris Lamb
 `. `'`  la...@debian.org / chris-lamb.co.uk
   `-


trivial-features.0.6-1.unstable.amd64.log.txt.gz
Description: Binary data
___
Reproducible-builds mailing list
Reproducible-builds@lists.alioth.debian.org
http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/reproducible-builds