Re: new cowbuilder tool: make local package cache available
On Wednesday 24 September 2014 06:24 PM, Thorsten Glaser wrote: I’ve just written a hookscript for pbuilder which makes the locally cached files available during a package build. Just chmod +x it, drop it into the --hookdir, and you’re set¹². Usage scenario here is mostly debian-ports: when building packages that depend on each other, you no longer have to wait until the first package is Installed until you can build the second package³. It also makes older packages, e.g. arch:all ones, available so that you can, with some APT pinning⁴, build packages against others that have temporarily become uninstallable in unstable, e.g. to break build dependency cycles. Hi Thorsten: I think I did the same with some settings in pbuilder. ## IF you do not bind mount, precious tmpfs space is wasted, and you will very soon ## run out of it when building a big package like Bespin/IceDove/KDE #APTCACHE=/var/cache/apt/archives/ ### We set this to off because we are already bind-mounting it. ## Aslo settings cachelink to no becasue we are bind mounting it, thus no need to create a link APTCACHE= BINDMOUNTS=/var/cache/apt/archives/ APTCACHEHARDLINK=no AUTOCLEANAPTCACHE=no EXTRAPACKAGES=eatmydata apt-utils debdelta ## Use these when you have a package build-dep that is not yet pushed into archive. ## For details, see: http://wiki.debian.org/PbuilderTricks #OTHERMIRROR=deb file:///var/tmp/Debian-Build/pbuilder-deps ./ #BINDMOUNTS=$BINDMOUNTS /var/tmp/Debian-Build/pbuilder-deps # Comment HOOKDIR when you are at home with very slow internet connection because # it runs apt-get update on each pbuilder build invocation #HOOKDIR=/home/rrs/.pbuilder/hooks #ALLOWUNTRUSTED=yes -- Given the large number of mailing lists I follow, I request you to CC me in replies for quicker response -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: https://lists.debian.org/0f4dfb-5t2@news.researchut.com
Re: new cowbuilder tool: make local package cache available
On Thu, 25 Sep 2014, Ritesh Raj Sarraf wrote: I think I did the same with some settings in pbuilder. I see nothing there that actually generates a Packages file. ## For details, see: http://wiki.debian.org/PbuilderTricks This also indicates you need a “D” hook script to do that. I just wrote one, which requires less local configuration, and avoids pulling the local packages into builds that do not need them by adding the sources.list line late. But sure, use either. I just felt like sharing. bye, //mirabilos -- Sometimes they [people] care too much: pretty printers [and syntax highligh- ting, d.A.] mechanically produce pretty output that accentuates irrelevant detail in the program, which is as sensible as putting all the prepositions in English text in bold font. -- Rob Pike in Notes on Programming in C -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: https://lists.debian.org/alpine.deb.2.11.1409251518130.21...@tglase.lan.tarent.de
new cowbuilder tool: make local package cache available
Hi *, I’ve just written a hookscript for pbuilder which makes the locally cached files available during a package build. Just chmod +x it, drop it into the --hookdir, and you’re set¹². Usage scenario here is mostly debian-ports: when building packages that depend on each other, you no longer have to wait until the first package is Installed until you can build the second package³. It also makes older packages, e.g. arch:all ones, available so that you can, with some APT pinning⁴, build packages against others that have temporarily become uninstallable in unstable, e.g. to break build dependency cycles. Do make sure to not put untrusted packages into the /var/cache/pbuilder/aptcache directory⁵. It does protocol all made-available packages into the pbuilder log, just so people inspecting it later can know. https://www.mirbsd.org/cvs.cgi/contrib/hosted/tg/deb/hookdir/D00local?rev=HEAD This script will be updated this week or the next, or so, because Guillem has just committed a change to dpkg that allows dpkg-scanpackages to skip generating the SHA-1 and SHA-256 hashes for the packages, so this will take only a third of the time on our slow m68k machines. (Thanks!) ① You can also share the package cache with your live system: • rm -rf /var/cache/apt/archives • ln -s /var/cache/pbuilder/aptcache /var/cache/apt/archives • echo 'Dir::Cache::Archives /var/cache/pbuilder/aptcache;' \ /etc/apt/apt.conf The first two are not strictly necessary, but help e.g. scripts or people who assume the default location. Trust me. Oh, and be careful of an “apt-get clean” afterwards… ② I forgot what I wanted to write in this footnote. Maybe later… ③ Or when you upload several packages that depend on previous ones, especially when they are NEW. ④ Example paragraph (we do have current glib-networking by now): Package: glib-networking-common Pin: version 2.36.1-2~m68k.1 Pin-Priority: 1001 ⑤ Do distinguish between /var/cache/pbuilder/aptcache-debian and /var/cache/pbuilder/aptcache-ubuntu when you use my cool https://www.mirbsd.org/cvs.cgi/contrib/hosted/tg/deb/pbuilderrc?rev=HEAD Have fun, //mirabilos -- Uli Du hast Recht. Uli Du hast Recht! -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: https://lists.debian.org/alpine.deb.2.11.1409241440030.13...@tglase.lan.tarent.de
Re: new cowbuilder tool: make local package cache available
On Wed, 24 Sep 2014, Thorsten Glaser wrote: Usage scenario here is mostly debian-ports: when building packages that depend on each other, you no longer have to wait until the first package is Installed until you can build the second package³. It also makes older packages, Hrm. Just, there seems to be no hook for running before a cowbuilder --update so an update to, say, gcc-4.9 will not be made available, unless the resolver picks this up during B-D installation. bye, //mirabilos -- Sometimes they [people] care too much: pretty printers [and syntax highligh- ting, d.A.] mechanically produce pretty output that accentuates irrelevant detail in the program, which is as sensible as putting all the prepositions in English text in bold font. -- Rob Pike in Notes on Programming in C -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: https://lists.debian.org/alpine.deb.2.11.1409241554140.13...@tglase.lan.tarent.de