from:"Projects"

On 1/17/20 8:19 AM, Vladimir Panteleev wrote:
> If the user has a non-canonical (i.e. symlinked on Arch) location in
> front of their $PATH, such as /usr/sbin, shutil.which will return
> locations with that path. This later causes the rule to fail to find
> the binary in any packages, causing spurious
> library-no-package-associated and dependency-not-needed warnings.
> 
> Fix this by resolving all symlinks for executables (using
> os.path.realpath) before trying to find them among installed packages.

FWIW a lot of software will break if you do this, not just namcap.
There's an exceedingly good reason why /usr/sbin and other symlink
directories are *not* added to the $PATH on archlinux, unless the user
has unwisely added it by hand.

-- 
Eli Schwartz
Bug Wrangler and Trusted User



signature.asc
Description: OpenPGP digital signature

Re: [arch-projects] [namcap] [PATCH 4/5] README: Document how to submit patches

2020-01-18 Thread Artur Juraszek via arch-projects


Vladimir Panteleev writes:

> ---
>  README | 10 --
>  1 file changed, 8 insertions(+), 2 deletions(-)
>
> diff --git a/README b/README
> index 83b406b..b018466 100644
> --- a/README
> +++ b/README
> @@ -21,8 +21,14 @@ Minimal examples (very simple packages forged to exhibit 
> unexpected
>  behaviour from namcap) are also welcome to extend namcap's test suite.
>  
>  If you've a patch (fixing a bug or a new namcap module), then you can send 
> it 
> -to the arch-projects mailing list. Namcap development is managed with git, so
> -git-formatted patches are preferred. 
> +to the arch-projects mailing list.
> +
> +Namcap development is managed with git, so git-formatted patches are 
> preferred.
> +When sending patches to the mailing list, make sure to set a valid
> +subjectprefix, otherwise the email will be rejected by Mailman.  Git can be
> +configured as follows:
> +
> +git config format.subjectprefix namcap] [PATCH'

Looks like a typo, I believe it is?

>  
>  Namcap's source is available on:



signature.asc
Description: PGP signature

WARN: project in Attic but not in 'retired' category: http://svn.apache.org/repos/asf/ode/trunk/doap_ODE.rdf

2020-01-13 Thread Projects

WARN: project from a retired committee but PMC not changed to Attic in http://svn.apache.org/repos/asf/ode/trunk/doap_ODE.rdf

2020-01-13 Thread Projects

WARN: project in Attic but not in 'retired' category: https://raw.githubusercontent.com/apache/apex-site/master/doap_Apex.rdf

2020-01-13 Thread Projects

WARN: project in Attic but not in 'retired' category: https://svn.apache.org/repos/asf/falcon/trunk/falcon.rdf

2020-01-13 Thread Projects

WARN: project from a retired committee but PMC not changed to Attic in https://raw.githubusercontent.com/apache/apex-site/master/doap_Apex.rdf

2020-01-13 Thread Projects

WARN: project from a retired committee but PMC not changed to Attic in https://svn.apache.org/repos/asf/falcon/trunk/falcon.rdf

2020-01-13 Thread Projects

[arch-projects] [namcap] [PATCH] Add: rule to detect Python dependencies

2020-01-07 Thread Felix Yan via arch-projects

---
 Namcap/rules/__init__.py   |   1 +
 Namcap/rules/pydepends.py  | 122 +
 Namcap/tests/package/test_pydepends.py |  68 ++
 3 files changed, 191 insertions(+)
 create mode 100644 Namcap/rules/pydepends.py
 create mode 100644 Namcap/tests/package/test_pydepends.py

diff --git a/Namcap/rules/__init__.py b/Namcap/rules/__init__.py
index 525dbc6..01d1b96 100644
--- a/Namcap/rules/__init__.py
+++ b/Namcap/rules/__init__.py
@@ -43,6 +43,7 @@ from . import (
   perllocal,
   permissions,
   py_mtime,
+  pydepends,
   rpath,
   scrollkeeper,
   shebangdepends,
diff --git a/Namcap/rules/pydepends.py b/Namcap/rules/pydepends.py
new file mode 100644
index 000..efc6735
--- /dev/null
+++ b/Namcap/rules/pydepends.py
@@ -0,0 +1,122 @@
+# -*- coding: utf-8 -*-
+#
+# namcap rules - pydepends
+# Copyright (C) 2020 Felix Yan 
+#
+#   This program is free software; you can redistribute it and/or modify
+#   it under the terms of the GNU General Public License as published by
+#   the Free Software Foundation; either version 2 of the License, or
+#   (at your option) any later version.
+#
+#   This program is distributed in the hope that it will be useful,
+#   but WITHOUT ANY WARRANTY; without even the implied warranty of
+#   MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+#   GNU General Public License for more details.
+#
+#   You should have received a copy of the GNU General Public License
+#   along with this program; if not, write to the Free Software
+#   Foundation, Inc., 59 Temple Place, Suite 330, Boston, MA  02111-1307  USA
+#
+
+from collections import defaultdict
+import ast
+import sys
+import sysconfig
+import Namcap.package
+from Namcap.ruleclass import *
+
+
+def finddepends(liblist):
+   """
+   Find packages owning a list of libraries
+
+   Returns:
+ dependlist -- a dictionary { package => set(libraries) }
+ orphans -- the list of libraries without owners
+   """
+   dependlist = defaultdict(set)
+
+   pymatches = {}
+
+   knownlibs = set(liblist)
+   foundlibs = set()
+
+   workarounds = {
+   "python": sys.builtin_module_names
+   }
+
+   for pkg in Namcap.package.get_installed_packages():
+   for j, fsize, fmode in pkg.files:
+   if not j.startswith("usr/lib/python3"):
+   continue
+
+   for k in knownlibs:
+   if j.endswith("site-packages/" + k + "/") or 
j.endswith("site-packages/" + k + ".py") or \
+   j.endswith("site-packages/" + k 
+ ".so") or \
+   j.endswith("site-packages/" + k 
+ sysconfig.get_config_var('EXT_SUFFIX')) or \
+   j.endswith("lib-dynload/" + k + 
sysconfig.get_config_var('EXT_SUFFIX')) or \
+   j.count("/") == 3 and 
j.endswith("/" + k + ".py") or \
+   j.count("/") == 4 and 
j.endswith("/" + k + "/") or \
+   pkg.name in workarounds and k 
in workarounds[pkg.name]:
+   dependlist[pkg.name].add(k)
+   foundlibs.add(k)
+
+   orphans = list(knownlibs - foundlibs)
+   return dependlist, orphans
+
+
+def get_imports(file):
+   root = ast.parse(file.read())
+
+   for node in ast.walk(root):
+   if isinstance(node, ast.Import):
+   for module in node.names:
+   yield module.name.split('.')[0]
+   elif isinstance(node, ast.ImportFrom):
+   if node.module and node.level == 0:
+   yield node.module.split('.')[0]
+
+
+class PythonDependencyRule(TarballRule):
+   name = "pydepends"
+   description = "Checks python dependencies"
+   def analyze(self, pkginfo, tar):
+   liblist = defaultdict(set)
+   own_liblist = set()
+
+   for entry in tar:
+   if not entry.isfile() or not entry.name.endswith('.py'):
+   continue
+   own_liblist.add(entry.name[:-3])
+   f = tar.extractfile(entry)
+   for module in get_imports(f):
+   liblist[module].add(entry.name)
+   f.close()
+
+   for lib in own_liblist:
+   liblist.pop(lib, None)
+
+   dependlist, orphans = finddepends(liblist)
+
+   # Handle "no package associated" errors
+   self.warnings.extend([("library-no-package-associated %s", i)
+   for i in orphans])
+
+   # Print link-level deps
+   for pkg, libraries in

Broken text rendering in macOS Catalina

2020-01-06 Thread projects

Hi,

I've tried to report this JavaFX problem to the OpenJDK project ( 
https://bugreport.java.com/bugreport/ ), unfortunately I don’t have an account 
there. And the report of me as a guest wasn’t accepted. That’s why I’m trying 
to use this mailing list.

Bug description: 

Since updating to macOS Catalina the text rendering is broken in all JavaFX 
contrals which render text (labels, text areas, buttons, menu items etc.). This 
behavior is new since macOS 10.15 Catalina, it worked perfectly in macOS 
10.14.x and before.
The rendered text is still readable, but looks very blurred. And it looks like 
vertical pixel lines are completely missing in the displayed text.

This error occurs when using a non-Retina (HiDPI) display, e.g. a MacBook Air 
with the 1440x900 resolution or an external typical FullHD display (e.g. 24" 
1920x1080). Only when using a HiDPI / Retina display, then the rendered text 
looks fine. Unfortunately many / most people are still using non-Retina 
external displays.

Test environment:

* OS: macOS 10.15.2
* Java: OpenJDK 11.0.5 (AdaptOpenJDK), OpenJDK 13.0.1 (AdoptOpenJDK), OpenJDK 
14 EA Build 28 (2019/12/18)
* JavaFX: OpenJFX 11.0.2, OpenJFX 13.0.1, OpenJFX 14-ea+6
* Display: Dell 24" 1920x1200, MacBook Air (2013) 1440x900

The same problem exists in all combinations.

How to reproduce (example):

* Install and launch SceneBuilder (tested with 11.0.0 from 
https://gluonhq.com/products/scene-builder/ )
* Open an FXML file or create a new one
* Display Info dialog (Help > About Scene Builder)

Screenshots of the About Dialog:

* NonRetina (broken): 
https://www.saring.de/openjfx-bugreport/SceneBuilder_About-NonRetina.png 

  (e.g. in line „The default configuration") 
* Retina (OK): 
https://www.saring.de/openjfx-bugreport/SceneBuilder_About-Retina.png 
 

Best regards,
Stefan

[arch-projects] [devtools] [PATCH 2/2] makechrootpkg: use the chroot database to find checkpkg packages

2020-01-02 Thread Eli Schwartz via arch-projects

We don't want to check against the current version known to the host
system, because that will be incorrect in a wide variety of situations,
including:
- the build host hasn't done a full system upgrade yet
- we're building against staging, and want to see the delta between
  different staging versions
- we're building against extra, but the host runs testing which carries
  changes we don't want to visualize right now
- the chroot has a configured database not available to the host, and
  the package is only available there

Essentially, it's rarely 100% correct to run checkpkg on the host, but
we already have a database we *know* is correct, and that is the one we
just built the package against. So let's use that.

This also fixes a bug in the current logic, where in order to try
downloading fresh databases, we work in a non-cached temporary working
database to download the package files, but then let checkpkg default to
comparing packages in the system database. Since we are explicitly
trying to compare against packages that differ from the host's pacman
database, we need to pass the package files as options to checkpkg,
using the additional modes added in commit 
c14338c0fe71a74f5e56b4f3af7c548fe0928e15

Signed-off-by: Eli Schwartz 
---
 makechrootpkg.in | 32 ++--
 1 file changed, 14 insertions(+), 18 deletions(-)

diff --git a/makechrootpkg.in b/makechrootpkg.in
index dfea18c..bfa69be 100644
--- a/makechrootpkg.in
+++ b/makechrootpkg.in
@@ -366,11 +366,7 @@ if arch-nspawn "$copydir" \
"${bindmounts_ro[@]}" "${bindmounts_rw[@]}" \
/chrootbuild "${makepkg_args[@]}"
 then
-   pkgnames=()
-   for pkgfile in "$copydir"/pkgdest/*; do
-   pkgfile=${pkgfile##*/};
-   pkgnames+=("${pkgfile%-*-*-*}");
-   done
+   mapfile -t pkgnames < <(sudo -u "$makepkg_user" bash -c 'source 
PKGBUILD; printf "%s\n" "${pkgname[@]}"')
move_products
 else
(( ret += 1 ))
@@ -388,29 +384,29 @@ else
if (( run_checkpkg )); then
msg "Running checkpkg"
 
-   # sync off-site databases for up-to-date queries
-   trap 'rm -rf $dbpath; cleanup' EXIT INT TERM QUIT
-   dbpath=$(mktemp -d --tmpdir makechrootpkg-database.XX)
-   mkdir -p "$dbpath"
-   pacman -Sy --dbpath "$dbpath" --logfile /dev/null
+   mapfile -t remotepkgs < <(pacman --config 
"$copydir"/etc/pacman.conf \
+   --dbpath "$copydir"/var/lib/pacman \
+   -Sddp "${pkgnames[@]}")
 
-   # query current package locations
-   remotepkgs=($(pacman -Sddp --dbpath "$dbpath" --logfile 
/dev/null "${pkgnames[@]}"))
-   if (( $? )); then
+   if ! wait $!; then
warning "Skipped checkpkg due to missing repo packages"
exit 0
fi
 
# download package files if any non-local location exists
for remotepkg in "${remotepkgs[@]}"; do
-   [[ $remotepkg == file://* ]] && continue
-   msg2 "Downloading current versions"
-   pacman --noconfirm -Swdd --dbpath "$dbpath" --logfile 
/dev/null "${pkgnames[@]}"
-   break
+   if [[ $remotepkg != file://* ]]; then
+   msg2 "Downloading current versions"
+   arch-nspawn "$copydir" pacman --noconfirm -Swdd 
"${pkgnames[@]}"
+   mapfile -t remotepkgs < <(pacman --config 
"$copydir"/etc/pacman.conf \
+   --dbpath "$copydir"/var/lib/pacman \
+   -Sddp "${pkgnames[@]}")
+   break
+   fi
done
 
msg2 "Checking packages"
-   sudo -u "$makepkg_user" checkpkg --rmdir --warn
+   sudo -u "$makepkg_user" checkpkg --rmdir --warn 
"${remotepkgs[@]/#file:\/\//}"
fi
true
 fi
-- 
2.24.1

[arch-projects] [devtools] [PATCH 1/2] checkpkg: fix support for http:// url comparisons

2020-01-02 Thread Eli Schwartz via arch-projects

Broken in commit c14338c0fe71a74f5e56b4f3af7c548fe0928e15.

Signed-off-by: Eli Schwartz 
---
 checkpkg.in | 4 +++-
 1 file changed, 3 insertions(+), 1 deletion(-)

diff --git a/checkpkg.in b/checkpkg.in
index 374c004..d7c0948 100644
--- a/checkpkg.in
+++ b/checkpkg.in
@@ -95,8 +95,10 @@ for _pkgname in "${pkgname[@]}"; do
 
if (( $# )); then
case $1 in
+   *://*)
+   pkgurl=$1 ;;
/*|*/*)
-   pkgurl=file://$(readlink -m "$1") ;;
+   pkgurl=$(readlink -m "$1") ;;
*.pkg.tar*)
pkgurl=$1 ;;
'')
-- 
2.24.1

[arch-projects] [devtools] [PATCH 4/4] zsh-completion: update for new makerepropkg options

2020-01-02 Thread Eli Schwartz via arch-projects

Thanks to anthraxx for the guidance.

Original-patch-by: Levente Polyak 
Signed-off-by: Eli Schwartz 
---
 zsh_completion.in | 3 ++-
 1 file changed, 2 insertions(+), 1 deletion(-)

diff --git a/zsh_completion.in b/zsh_completion.in
index a1225aa..e59bc3a 100644
--- a/zsh_completion.in
+++ b/zsh_completion.in
@@ -94,10 +94,11 @@ _offload_build_args=(
 )
 
 _makerepropkg_args=(
+   '-d[Run diffoscope if the package is unreproducible]'
'-c[Set pacman cache]:pacman_cache:_files -/'
'-M[Location of a makepkg config file]:makepkg_config:_files -g 
"*.conf(.)"'
'-h[Display usage]'
-   '1:working_dir:_files -g "*.pkg.tar.*(.)"'
+   '*:working_dir:_files -g "*.pkg.tar.*(.)"'
 )
 
 _devtools_completions_all_packages() {
-- 
2.24.1

[arch-projects] [devtools] [GIT] The official devtools repository branch master updated. 20191227-1-g4c08847

2019-12-27 Thread Levente Polyak via arch-projects

This is an automated email from the git hooks/post-receive script. It was
generated because a ref change was pushed to the repository containing
the project "The official devtools repository".

The branch, master has been updated
   via  4c08847bfa7776abb884fef289a25c1cef9883fb (commit)
  from  74d7a70915d7143938f560e6f7051e0147855d3f (commit)

Those revisions listed above that are new to this repository have
not appeared on any other notification email; so we list those
revisions in full, below.

- Log -
commit 4c08847bfa7776abb884fef289a25c1cef9883fb
Author: Eli Schwartz 
Date:   Fri Dec 27 11:59:48 2019 -0500

makerepropkg: correctly reproduce a pkgfile with any compression type

We don't want the default PKGEXT in the current version of devtools, we
want the PKGEXT we *know* the input file used.

Signed-off-by: Levente Polyak 

---

Summary of changes:
 makerepropkg.in | 3 ++-
 1 file changed, 2 insertions(+), 1 deletion(-)


hooks/post-receive
-- 
The official devtools repository

[arch-projects] [devtools] [PATCH v2] makerepropkg: correctly reproduce a pkgfile with any compression type

2019-12-27 Thread Eli Schwartz via arch-projects

We don't want the default PKGEXT in the current version of devtools, we
want the PKGEXT we *know* the input file used.

Signed-off-by: Eli Schwartz 
---

v2: use one less line when defining PKGEXT, as per anthraxx review

 makerepropkg.in | 3 ++-
 1 file changed, 2 insertions(+), 1 deletion(-)

diff --git a/makerepropkg.in b/makerepropkg.in
index 40806cb..121456c 100755
--- a/makerepropkg.in
+++ b/makerepropkg.in
@@ -137,6 +137,7 @@ parse_buildinfo < <(bsdtar -xOqf "${pkgfile}" .BUILDINFO)
 export SOURCE_DATE_EPOCH="${buildinfo[builddate]}"
 PACKAGER="${buildinfo[packager]}"
 BUILDDIR="${buildinfo[builddir]}"
+PKGEXT=${pkgfile#${pkgfile%.pkg.tar*}}
 
 # nuke and restore reproducible testenv
 for copy in "${buildroot}"/*/; do
@@ -160,7 +161,7 @@ makechrootpkg -r "${buildroot}" -l "${chroot}" -- 
--packagelist || exit 1
 
 # set detected makepkg.conf options
 {
-for var in PACKAGER BUILDDIR; do
+for var in PACKAGER BUILDDIR PKGEXT; do
 printf '%s=%s\n' "${var}" "${!var@Q}"
 done
 printf 'OPTIONS=(%s)\n' "${buildopts[*]@Q}"
-- 
2.24.1

[arch-projects] [devtools] [PATCH] makerepropkg: correctly reproduce a pkgfile with any compression type

2019-12-27 Thread Eli Schwartz via arch-projects

We don't want the default PKGEXT in the current version of devtools, we
want the PKGEXT we *know* the input file used.

Signed-off-by: Eli Schwartz 
---
 makerepropkg.in | 5 -
 1 file changed, 4 insertions(+), 1 deletion(-)

diff --git a/makerepropkg.in b/makerepropkg.in
index 51c2dd2..0721f65 100755
--- a/makerepropkg.in
+++ b/makerepropkg.in
@@ -144,6 +144,9 @@ export SOURCE_DATE_EPOCH="${buildinfo[builddate]}"
 PACKAGER="${buildinfo[packager]}"
 BUILDDIR="${buildinfo[builddir]}"
 
+trimprefix=${pkgfile%.pkg.tar*}
+PKGEXT=${pkgfile#$trimprefix}
+
 # nuke and restore reproducible testenv
 for copy in "${buildroot}"/*/; do
 [[ -d ${copy} ]] || continue
@@ -166,7 +169,7 @@ makechrootpkg -r "${buildroot}" -l "${chroot}" -- 
--packagelist || exit 1
 
 # set detected makepkg.conf options
 {
-for var in PACKAGER BUILDDIR; do
+for var in PACKAGER BUILDDIR PKGEXT; do
 printf '%s=%s\n' "${var}" "${!var@Q}"
 done
 printf 'OPTIONS=(%s)\n' "${buildopts[*]@Q}"
-- 
2.24.1

[arch-projects] [devtools] [GIT] The official devtools repository branch master updated. 20191212-3-g74d7a70

2019-12-27 Thread Levente Polyak via arch-projects

This is an automated email from the git hooks/post-receive script. It was
generated because a ref change was pushed to the repository containing
the project "The official devtools repository".

The branch, master has been updated
   via  74d7a70915d7143938f560e6f7051e0147855d3f (commit)
   via  5eacb475cd1a92dc4fdaf25f86984da74a23f5ab (commit)
   via  bcda211dd86b3bf54a9bc40d2e19f1aad4bbfbb8 (commit)
  from  d4546c59ce2731a96d336f9953108816ff4b954b (commit)

Those revisions listed above that are new to this repository have
not appeared on any other notification email; so we list those
revisions in full, below.

- Log -
commit 74d7a70915d7143938f560e6f7051e0147855d3f
Author: Levente Polyak 
Date:   Fri Dec 27 16:06:30 2019 +0100

Version 20191227

commit 5eacb475cd1a92dc4fdaf25f86984da74a23f5ab
Author: Robin Broda 
Date:   Sat Dec 14 19:25:00 2019 +0100

makerepopkg: fix zstd extension (.zstd -> .zst)

commit bcda211dd86b3bf54a9bc40d2e19f1aad4bbfbb8
Author: Robin Broda 
Date:   Sat Dec 14 19:25:46 2019 +0100

makepkg.conf: change default compression method to zstd

---

Summary of changes:
 Makefile| 2 +-
 makepkg-x86_64.conf | 4 ++--
 makerepropkg.in | 2 +-
 3 files changed, 4 insertions(+), 4 deletions(-)


hooks/post-receive
-- 
The official devtools repository

[arch-projects] [devtools] [GIT] The official devtools repository annotated tag 20191227 created. 20191227

2019-12-27 Thread Levente Polyak via arch-projects

This is an automated email from the git hooks/post-receive script. It was
generated because a ref change was pushed to the repository containing
the project "The official devtools repository".

The annotated tag, 20191227 has been created
at  2304c51f99fd4b06a43de97ccb61b03532d8265b (tag)
   tagging  74d7a70915d7143938f560e6f7051e0147855d3f (commit)
  replaces  20191212
 tagged by  Levente Polyak
on  Fri Dec 27 16:06:30 2019 +0100

- Log -
Version 20191227
-BEGIN PGP SIGNATURE-

iQIzBAABCgAdFiEE4kC1fixGMLp2ji8m/BtUfI2BcsgFAl4GHfYACgkQ/BtUfI2B
csjulg//aRqDfwA5/FihptiY3aPH9GlOeWai/ikV1djfMjdie0kkjsWviHACr1bK
TggToyVKO1xq2oMO3oauO+/5dLMdE/TTsMHhrFkt6aFXD2Xm2LNKN2BsolAktmAU
vFF6F2mZJzKrRVglA5q/QjfDaWGMgKMu03no2Ei3yTjjCZwLucxl2xfb9PuCldYo
HD06ZEI5TsM/gkXRgobVTXvIdHFtXUgrcFKwlJ3RnfKfoPHxNbfKHJII+ZupTgbE
k9B1xVoErIItrDS8ZGaU6tqysYlOkfrtYlvdyu23eBIrkPJ1yrkYQsYXcWp8yA54
iZsD2SbUwW9xzEUjHfq3+VqGsn8MIpz9sDbwR06GZ849S2JKLTuikjDYzQY62m7j
498F+VCazWizn7koQaYcKGdAwB+HCrd5FR7Hgmf3yDTfzWC+lpiQMq1/P0lz7azT
DXxM0SH8/ei7ptsIOrSzri+R5+UH/ryKLBIQyN9xfB/FkDmZ3oPCumu82KRI3Q38
MwCmcWFsUOImSIWVcnh/akyqC86NoLsIR67f5r8Tu6A++LvbYQ4ifiS5QizKE4b3
4vtuGGdqxoTobWPsNsnjZbJNxcE+idlD64UZhu3MoiRqjkAB+5MWgBwdB95TD0Qm
j3q4lKBVBt3mmsYOl4FaPdEvJx3LkT9Mi1yhrmGA2NCYFgS8kuY=
=k9jN
-END PGP SIGNATURE-

Levente Polyak (1):
  Version 20191227

Robin Broda (2):
  makepkg.conf: change default compression method to zstd
  makerepopkg: fix zstd extension (.zstd -> .zst)

---


hooks/post-receive
-- 
The official devtools repository

[arch-projects] [netctl] [GIT] Network control utility based on systemd branch master updated. 1.20-2-gc019679

2019-12-25 Thread Jouke Witteveen via arch-projects

This is an automated email from the git hooks/post-receive script. It was
generated because a ref change was pushed to the repository containing
the project "Network control utility based on systemd".

The branch, master has been updated
   via  c0196798dde620566146867e59d52d3120e9b4f1 (commit)
   via  89cba954bef7c370ea38f9c0ca087f816620d62b (commit)
  from  7cb0a5ab146f3c26bc05706bda7e3e662af5408a (commit)

Those revisions listed above that are new to this repository have
not appeared on any other notification email; so we list those
revisions in full, below.

- Log -
commit c0196798dde620566146867e59d52d3120e9b4f1
Author: Christian Hesse 
Date:   Wed Nov 13 12:15:35 2019 +

base group removal

commit 89cba954bef7c370ea38f9c0ca087f816620d62b
Author: Antonio Rojas 
Date:   Wed Jun 26 16:22:35 2019 +0200

PKGBUILD: use https for the url

---

Summary of changes:
 contrib/PKGBUILD.in | 3 +--
 1 file changed, 1 insertion(+), 2 deletions(-)


hooks/post-receive
-- 
Network control utility based on systemd

Re: [arch-projects] [devtools] [PATCH 3/3] makerepropkg: support checking multiple split packages

2019-12-19 Thread Levente Polyak via arch-projects

On December 20, 2019 1:25:57 AM GMT+01:00, Eli Schwartz via arch-projects 
 wrote:
>On 12/19/19 6:49 PM, Levente Polyak via arch-projects wrote:
>> You are u justified ranting here for a whole wall of text
>
>And you are unjustified in ranting here for a single sentence about how
>you're "not into fixing up the precious integrity of my precious that
>you're ruining by submitting PRs". It's seriously demotivating.
>
>I'll consider only doing my rants via pithy one-liners in the future.
>
>> instead of editing a simple text file that anyone can understand
>> with zero knowledge of the specifics.
>
>Untrue, or are you suggesting I either understood or now currently
>understand where and why to use a "1" or a "*" in your previous
>recommendation "with zero knowledge of the specifics"?
>

Yes and that's why I helped you out with a simple answer to the question how to 
do it. 

>How do you propose I test the changes, what makes you think I have zsh
>installed at all, much less configured to initialize completions
>(however that is done)?
>

Seriously, look at that completion. I'm confident you have the technical 
competence to add a new option that simply works and it's a review here after 
all. 

>> Its a part of the toolkit to the same degree as man pages are. We are
>> also not wanting to soften up the integrity of man pages just because
>> a contributor never touched man pages.
>
>Man pages are prose, not code, so I expect that to be a lot easier. And
>if someone submits a man page update with incorrect asciidoc
>formatting,
>then 99% of the patch would still be correct and I'd be happy as a
>project maintainer to fix the rest.
>
>This is assuming that the formatting issues aren't of the variety that
>causes "make all" to fail. It's not hard to update *prose* when there's
>a Makefile target to prove it works, and when every user is expected to
>know how to run "man".
>
>This is quite aside for the fact that most devtools programs don't have
>manpages at all, so it's a non-issue.
>

Yep very happy you did the patches but it would be awesome of a frequent
contributor to also do the simple completion thingies. If it's something
unjustified complex that would be fine by me, but it's literally someone
so simple anyone can easily comprehend. I would prefer helping
contributors to get to a point where doing man pages and completions
is just part of a PR. 

Please for the sake of the project let's just get over this debate and get
a copy paste line for the new option into the completion file. I'm confident
you will do it properly in under 10 seconds, I know you well enough
to be able to judge that it's a zero brainer for you. 

Cheers and happy to include your series, 
anthraxx

Re: [arch-projects] [devtools] [PATCH 3/3] makerepropkg: support checking multiple split packages

2019-12-19 Thread Eli Schwartz via arch-projects

On 12/19/19 6:49 PM, Levente Polyak via arch-projects wrote:
> You are u justified ranting here for a whole wall of text

And you are unjustified in ranting here for a single sentence about how
you're "not into fixing up the precious integrity of my precious that
you're ruining by submitting PRs". It's seriously demotivating.

I'll consider only doing my rants via pithy one-liners in the future.

> instead of editing a simple text file that anyone can understand
> with zero knowledge of the specifics.

Untrue, or are you suggesting I either understood or now currently
understand where and why to use a "1" or a "*" in your previous
recommendation "with zero knowledge of the specifics"?

How do you propose I test the changes, what makes you think I have zsh
installed at all, much less configured to initialize completions
(however that is done)?

> Its a part of the toolkit to the same degree as man pages are. We are
> also not wanting to soften up the integrity of man pages just because
> a contributor never touched man pages.

Man pages are prose, not code, so I expect that to be a lot easier. And
if someone submits a man page update with incorrect asciidoc formatting,
then 99% of the patch would still be correct and I'd be happy as a
project maintainer to fix the rest.

This is assuming that the formatting issues aren't of the variety that
causes "make all" to fail. It's not hard to update *prose* when there's
a Makefile target to prove it works, and when every user is expected to
know how to run "man".

This is quite aside for the fact that most devtools programs don't have
manpages at all, so it's a non-issue.

> Its not the responsibility of the maintainers to fix up man pages
> and completions for all eternity

It's not the job of the maintainers. It's the job of the zsh users. You
happen to be both.

I didn't say it's your responsibility to fix up bash completions for all
eternity either -- that would be my job as a concerned bash user, and
I'll take my lumps for not being on the ball for it.

> whe also offering help and hints how to adjust them when people don't
> know a out them. I restored the zsh integrity and I'm happy to point
> people to how to keep them in tact with their changes but I'm not a
> cleanup boy because someone is too lazy to change a text file.

Sure, and by the same definition of a zsh script as "just a text file"
the linux kernel is just a bunch of text files, I guess anyone who
doesn't contribute changes there is too lazy?

-- 
Eli Schwartz
Bug Wrangler and Trusted User

signature.asc
Description: OpenPGP digital signature

Re: [arch-projects] [devtools] [PATCH 3/3] makerepropkg: support checking multiple split packages

2019-12-19 Thread Levente Polyak via arch-projects

On December 20, 2019 12:37:10 AM GMT+01:00, Eli Schwartz via arch-projects 
 wrote:
>It's nice that you're personally motivated to update zsh completions,
>but it would mean more to me if you had the same care and concern for
>the rotting bash completions, which is what *I* care about, since bash
>is the shell I know and use. (That, however, is not a current priority
>for me, so it goes onto the endless TODO list.)
>
>This shows me that you're asking for zsh completions because you're
>enthusiastic about zsh on a personal level, not because there's a
>fundamental goal that the project needs to have up to date completions.
>:(
>

And to respond to this explicitly, no, this is false. I care a out the integrity
of the specific parts and not to purely suite the variant I by accident use
as well. Fixing bash completions is still on my list as well and once it's
up to date it should also be aimed to fix up on changes. The truth is as
simple as bash completions being a total mess (at least the one we have
in the repo) compared to the zsh completion we have there so within the
time frame I prioritized bringing the zsh variant back to shape was way
easier even through I have way less zsh specific knowledge compared to
having bash related knowledge.
Once bash is in tact as well I have the very exact same feelings about its
integrity as I do right now for zsh, purely to sustain integrity in the
projects components itself from a maintainer view rather than *any*
personal choice or preference, because my personal preference doesn't
matter when having the maintainer hat on.

Re: [arch-projects] [devtools] [PATCH 3/3] makerepropkg: support checking multiple split packages

2019-12-19 Thread Levente Polyak via arch-projects

You are u justified ranting here for a whole wall of text instead of editing a 
simple text file that anyone can understand with zero knowledge of the 
specifics.
Its a part of the toolkit to the same degree as man pages are. We are also not 
wanting to soften up the integrity of man pages just because a contributor 
never touched man pages. You are more then capable of editing a single line in 
a text file you not fully know every detail about just by purely observing to 
the same degree I was able to restore its integrity without ever having done 
zsh completions before.
Its not the responsibility of the maintainers to fix up man pages and 
completions for all eternity whe also offering help and hints how to adjust 
them when people don't know a out them.
I restored the zsh integrity and I'm happy to point people to how to keep them 
in tact with their changes but I'm not a cleanup boy because someone is too 
lazy to change a text file.

Re: [arch-projects] [devtools] [PATCH 3/3] makerepropkg: support checking multiple split packages

2019-12-19 Thread Eli Schwartz via arch-projects

On 12/19/19 5:02 PM, Levente Polyak via arch-projects wrote:
> Just replace the 1 with a asterisk * where I mentioned it.
> 
> I'm not really into fixing up all commits people contribute to keep
> the integrity of completion that I once cleaned and synced to the
> current state.

I'm not really into having contributions blocked contingent on me
learning zsh.

...

It's nice that you're personally motivated to update zsh completions,
but it would mean more to me if you had the same care and concern for
the rotting bash completions, which is what *I* care about, since bash
is the shell I know and use. (That, however, is not a current priority
for me, so it goes onto the endless TODO list.)

This shows me that you're asking for zsh completions because you're
enthusiastic about zsh on a personal level, not because there's a
fundamental goal that the project needs to have up to date completions. :(

In the meantime, spoonfeeding me the actual diff you want for this file
and asking me to submit it with my name slapped on as the author feels
sort of silly to me. Nevertheless, if you tell me what the range diff
should be for "Please add the new option to zsh_completions.in", I will
be happy to combine that with replacing the "1" character with a "*" as
advised above, and submit a third patch that updates the completions for
your shell of choice (but no others).

Tell me exactly what to do and I'll do it. :)

...

All I can imagine now is submitting a feature to a project and being
told "sorry, we won't accept this unless you also submit updated gettext
translations for this list of 30 languages".

This is why projects usually have dedicated stakeholders to maintain
select integration features that aren't the core project and ensure they
are kept up to date with the rest of the codebase.

And those stakeholders do their work after features are merged, and if
they don't show up to do the work, the project can still be updated and
released.

-- 
Eli Schwartz
Bug Wrangler and Trusted User

signature.asc
Description: OpenPGP digital signature

Re: [arch-projects] [devtools] [PATCH 3/3] makerepropkg: support checking multiple split packages

2019-12-19 Thread Levente Polyak via arch-projects

On December 19, 2019 10:19:43 PM GMT+01:00, Eli Schwartz via arch-projects 
 wrote:
>On 12/16/19 3:55 PM, Levente Polyak via arch-projects wrote:
>> Please adjust zsh_completions.in to take multiple packages in
>_makerepropkg_args
>
>I'm not a zsh user, and I don't know what this means and therefore
>cannot implement it. Maybe you could do it instead, since you're the
>one
>who has been recently authoring changes to that file?

Just replace the 1 with a asterisk * where I mentioned it. 
I'm not really into fixing up all commits people contribute to keep the 
integrity of completion that I once cleaned and synced to the current state.

Re: [arch-projects] [devtools] [PATCH 3/3] makerepropkg: support checking multiple split packages

2019-12-19 Thread Eli Schwartz via arch-projects

On 12/16/19 3:55 PM, Levente Polyak via arch-projects wrote:
> Please adjust zsh_completions.in to take multiple packages in 
> _makerepropkg_args

I'm not a zsh user, and I don't know what this means and therefore
cannot implement it. Maybe you could do it instead, since you're the one
who has been recently authoring changes to that file?

-- 
Eli Schwartz
Bug Wrangler and Trusted User

signature.asc
Description: OpenPGP digital signature

Re: [arch-projects] [devtools] [PATCH 3/3] makerepropkg: support checking multiple split packages

2019-12-16 Thread Levente Polyak via arch-projects

Please adjust zsh_completions.in to take multiple packages in _makerepropkg_args

Re: [arch-projects] [devtools] [PATCH 2/3] makerepropkg: add support to check unreproducible packages using diffoscope

2019-12-16 Thread Levente Polyak via arch-projects

Please add the new option to zsh_completions.in

[arch-projects] [devtools] [PATCH 0/3] makerepropkg improvements

2019-12-16 Thread Eli Schwartz via arch-projects

Available at 
https://github.com/eli-schwartz/devtools/commits/makerepropkg-diffoscope



Eli Schwartz (3):
  makerepropkg: fix wonky indent
  makerepropkg: add support to check unreproducible packages using
diffoscope
  makerepropkg: support checking multiple split packages

 doc/makerepropkg.1.asciidoc | 11 ++--
 makerepropkg.in | 56 +++--
 2 files changed, 44 insertions(+), 23 deletions(-)

-- 
2.24.1

[arch-projects] [devtools] [PATCH 3/3] makerepropkg: support checking multiple split packages

2019-12-16 Thread Eli Schwartz via arch-projects

By specifying multiple package files, we assume they are all from the
same PKGBUILD, and try to check them all against the produced artifacts.
Since the buildinfo should be comparable for all of them, we simply use
the first one passed on the command line.

Signed-off-by: Eli Schwartz 
---
 doc/makerepropkg.1.asciidoc |  8 ++--
 makerepropkg.in | 40 +
 2 files changed, 29 insertions(+), 19 deletions(-)

diff --git a/doc/makerepropkg.1.asciidoc b/doc/makerepropkg.1.asciidoc
index 301b73e..0d7ddcb 100644
--- a/doc/makerepropkg.1.asciidoc
+++ b/doc/makerepropkg.1.asciidoc
@@ -7,12 +7,12 @@ makerepropkg - Rebuild a package to see if it is reproducible
 
 Synopsis
 
-makerepropkg [OPTIONS] 
+makerepropkg [OPTIONS] ...
 
 Description
 ---
 
-Given the path to a built pacman package, attempt to rebuild it using the
+Given the path to a built pacman package(s), attempt to rebuild it using the
 PKGBUILD in the current directory. The package will be built in an environment
 as closely matching the environment of the initial package as possible, by
 building up a chroot to match the information exposed in the package's
@@ -20,6 +20,10 @@ linkman:BUILDINFO[5] manifest. On success, the resulting 
package will be
 compared to the input package, and makerepropkg will report whether the
 artifacts are identical.
 
+When given multiple packages, additional package files are assumed to be split
+packages and will be treated as additional artifacts to compare during the
+verification step.
+
 This implements a verifier for pacman/libalpm packages in accordance with the
 link:https://reproducible-builds.org/[Reproducible Builds] project.
 
diff --git a/makerepropkg.in b/makerepropkg.in
index 60fee95..51c2dd2 100755
--- a/makerepropkg.in
+++ b/makerepropkg.in
@@ -117,10 +117,13 @@ check_root
 
 if [[ -n $1 ]]; then
 pkgfile="$1"
-if ! bsdtar -tqf "${pkgfile}" .BUILDINFO >/dev/null 2>&1; then
-error "file is not a valid pacman package: '%s'" "${pkgfile}"
-exit 1
-fi
+splitpkgs=("$@")
+for f in "${splitpkgs[@]}"; do
+if ! bsdtar -tqf "${f}" .BUILDINFO >/dev/null 2>&1; then
+error "file is not a valid pacman package: '%s'" "${f}"
+exit 1
+fi
+done
 else
 error "no package file specified. Try '${BASH_SOURCE[0]##*/} -h' for more 
information. "
 exit 1
@@ -176,23 +179,26 @@ arch-nspawn "${buildroot}/${chroot}" \
 --bind="${PWD}:/startdir" \
 --bind="${SRCDEST}:/srcdest" \
 /chrootbuild -C --noconfirm --log --holdver --skipinteg
+ret=$?
 
-if (( $? == 0 )); then
+if (( ${ret} == 0 )); then
 msg2 "built succeeded! built packages can be found in 
${buildroot}/${chroot}/pkgdest"
 msg "comparing artifacts..."
 
-comparefiles=("${pkgfile}" "${buildroot}/${chroot}/pkgdest/${pkgfile##*/}")
-if cmp -s "${comparefiles[@]}"; then
-msg2 "Package successfully reproduced!"
-exit 0
-else
-warning "Package is not reproducible. :("
-sha256sum "${comparefiles[@]}"
-if (( diffoscope )); then
-diffoscope "${comparefiles[@]}"
+for pkgfile in "${splitpkgs[@]}"; do
+comparefiles=("${pkgfile}" 
"${buildroot}/${chroot}/pkgdest/${pkgfile##*/}")
+if cmp -s "${comparefiles[@]}"; then
+msg2 "Package '%s' successfully reproduced!" "${pkgfile}"
+else
+ret=1
+warning "Package '%s' is not reproducible. :(" "${pkgfile}"
+sha256sum "${comparefiles[@]}"
+if (( diffoscope )); then
+diffoscope "${comparefiles[@]}"
+fi
 fi
-fi
+done
 fi
 
-# the package either failed to build, or was unreproducible
-exit 1
+# return failure from chrootbuild, or the reproducibility status
+exit ${ret}
-- 
2.24.1

[arch-projects] [devtools] [PATCH 2/3] makerepropkg: add support to check unreproducible packages using diffoscope

2019-12-16 Thread Eli Schwartz via arch-projects

Signed-off-by: Eli Schwartz 
---
 doc/makerepropkg.1.asciidoc |  3 +++
 makerepropkg.in | 14 +++---
 2 files changed, 14 insertions(+), 3 deletions(-)

diff --git a/doc/makerepropkg.1.asciidoc b/doc/makerepropkg.1.asciidoc
index 7d68e5e..301b73e 100644
--- a/doc/makerepropkg.1.asciidoc
+++ b/doc/makerepropkg.1.asciidoc
@@ -26,6 +26,9 @@ link:https://reproducible-builds.org/[Reproducible Builds] 
project.
 Options
 ---
 
+*-d*::
+   If packages are not reproducible, compare them using diffoscope.
+
 *-c*::
Set the pacman cache directory.
 
diff --git a/makerepropkg.in b/makerepropkg.in
index 2b0945e..60fee95 100755
--- a/makerepropkg.in
+++ b/makerepropkg.in
@@ -29,6 +29,7 @@ declare -a buildenv buildopts installed installpkgs
 archiveurl='https://archive.archlinux.org/packages'
 buildroot=/var/lib/archbuild/reproducible
 chroot=testenv
+diffoscope=0
 
 parse_buildinfo() {
 local line var val
@@ -94,14 +95,16 @@ package, including the .PKGINFO as well as the buildinfo.
 For more details see https://reproducible-builds.org/
 
 OPTIONS
+-dRun diffoscope if the package is unreproducible
 -c   Set pacman cache
 -M  Location of a makepkg config file
 -hShow this usage message
 __EOF__
 }
 
-while getopts 'M:c:h' arg; do
+while getopts 'dM:c:h' arg; do
 case "$arg" in
+d) diffoscope=1 ;;
 M) archroot_args+=(-M "$OPTARG") ;;
 c) cache_dirs+=("$OPTARG") ;;
 h) usage; exit 0 ;;
@@ -177,12 +180,17 @@ arch-nspawn "${buildroot}/${chroot}" \
 if (( $? == 0 )); then
 msg2 "built succeeded! built packages can be found in 
${buildroot}/${chroot}/pkgdest"
 msg "comparing artifacts..."
-if cmp -s "${pkgfile}" "${buildroot}/${chroot}/pkgdest/${pkgfile##*/}"; 
then
+
+comparefiles=("${pkgfile}" "${buildroot}/${chroot}/pkgdest/${pkgfile##*/}")
+if cmp -s "${comparefiles[@]}"; then
 msg2 "Package successfully reproduced!"
 exit 0
 else
 warning "Package is not reproducible. :("
-sha256sum "${pkgfile}" "${buildroot}/${chroot}/pkgdest/${pkgfile##*/}"
+sha256sum "${comparefiles[@]}"
+if (( diffoscope )); then
+diffoscope "${comparefiles[@]}"
+fi
 fi
 fi
 
-- 
2.24.1

[arch-projects] [devtools] [PATCH 1/3] makerepropkg: fix wonky indent

2019-12-16 Thread Eli Schwartz via arch-projects

Signed-off-by: Eli Schwartz 
---
 makerepropkg.in | 12 ++--
 1 file changed, 6 insertions(+), 6 deletions(-)

diff --git a/makerepropkg.in b/makerepropkg.in
index 710f3ca..2b0945e 100755
--- a/makerepropkg.in
+++ b/makerepropkg.in
@@ -101,12 +101,12 @@ __EOF__
 }
 
 while getopts 'M:c:h' arg; do
-case "$arg" in
-M) archroot_args+=(-M "$OPTARG") ;;
-c) cache_dirs+=("$OPTARG") ;;
-h) usage; exit 0 ;;
-*|?) usage; exit 1 ;;
-esac
+case "$arg" in
+M) archroot_args+=(-M "$OPTARG") ;;
+c) cache_dirs+=("$OPTARG") ;;
+h) usage; exit 0 ;;
+*|?) usage; exit 1 ;;
+esac
 done
 shift $((OPTIND - 1))
 
-- 
2.24.1

WARN: project from a retired committee but PMC not changed to Attic in https://raw.githubusercontent.com/apache/apex-site/master/doap_Apex.rdf

2019-12-13 Thread Projects

WARN: project from a retired committee but PMC not changed to Attic in http://svn.apache.org/repos/asf/ode/trunk/doap_ODE.rdf

2019-12-13 Thread Projects

WARN: project in Attic but not in 'retired' category: https://raw.githubusercontent.com/apache/apex-site/master/doap_Apex.rdf

2019-12-13 Thread Projects

WARN: project in Attic but not in 'retired' category: https://svn.apache.org/repos/asf/falcon/trunk/falcon.rdf

2019-12-13 Thread Projects

WARN: project from a retired committee but PMC not changed to Attic in https://svn.apache.org/repos/asf/falcon/trunk/falcon.rdf

2019-12-13 Thread Projects

WARN: project in Attic but not in 'retired' category: http://svn.apache.org/repos/asf/ode/trunk/doap_ODE.rdf

2019-12-13 Thread Projects

[arch-projects] [devtools] [GIT] The official devtools repository annotated tag 20191212 created. 20191212

2019-12-11 Thread Levente Polyak via arch-projects

This is an automated email from the git hooks/post-receive script. It was
generated because a ref change was pushed to the repository containing
the project "The official devtools repository".

The annotated tag, 20191212 has been created
at  7a55fc0fb9bfbd1341de76405b26de70cc54ec64 (tag)
   tagging  d4546c59ce2731a96d336f9953108816ff4b954b (commit)
  replaces  20191130
 tagged by  Levente Polyak
on  Thu Dec 12 01:01:45 2019 +0100

- Log -
Version 20191212
-BEGIN PGP SIGNATURE-

iQIzBAABCgAdFiEE4kC1fixGMLp2ji8m/BtUfI2BcsgFAl3xg2kACgkQ/BtUfI2B
cshpsg/+Ll13/q+GHDx7w7HvM+zDajv26XqeVR2snu2mZkwRhCa8sV603HixXTwY
D5DHDOQidylIpaYLmcVyc15Ed37y7IK58yiGt4uhViVHwh2pevIN+XhhKvbcez9L
IhjsPb/ZLg9a/gFKsvsHVaWWD98WYUCSTyORVuJgpbYT7nHUb0pAz1+wRZBEXnlQ
ogR/nXzVOaSa/eSO0YBzTgn4AYJP75ylijFzlXKrRRPxC5QRGU3nyajsoAt2UlS+
kteMiGJpH3qzi7NLyf+hBhjYQrxPUZrMcjoLXdRrtPCB/wX8VMdaOdtDLbFdLBwC
5ZBCqkNw6X5A9XkKOh4HxScsBWcBMQaFcilensvV5mVyy/iz0jadu5VpUhxp9Y9r
lM1UZsvC1IP6jmmtkMyoWTemZTX4KYQe6Nh5WxV1QXYvirFBNf/zkH9pUf8eidDq
3aS8zQF8NSnZ2HQspK2edQf6Zaurb2jHa3MvOhR4TazkIVIVuGiidOgtW3fKIPZO
eA4QUrt9HnVXIK96XZV8Ybde185xceok9KQgGA+UIkKWjOrGtD5XFVIbTGSez4ip
M02Kbdmw7l7K2TMiLLqnnq1qb98j/z/lPGdc9yD7VZ/dDJVitvOKajVaudNwyEIp
PfxU8rpArfYHyCVIhTxX7yWmecMyNBW5nxLIuL0oC09RB2u/c3A=
=ge4p
-END PGP SIGNATURE-

Eli Schwartz (1):
  offload-build: return failure if no package files were found

Levente Polyak (4):
  makechrootpkg: double quote array expansions for checkpkg locations
  makechrootpkg: sync databases for checkpkg off-site
  lib: support arbitrary compressed package files
  Version 20191212

---


hooks/post-receive
-- 
The official devtools repository

[arch-projects] [devtools] [GIT] The official devtools repository branch master updated. 20191130-5-gd4546c5

2019-12-11 Thread Levente Polyak via arch-projects

This is an automated email from the git hooks/post-receive script. It was
generated because a ref change was pushed to the repository containing
the project "The official devtools repository".

The branch, master has been updated
   via  d4546c59ce2731a96d336f9953108816ff4b954b (commit)
  from  d6866e0544581840cc021e4be68c1c450fcb7963 (commit)

Those revisions listed above that are new to this repository have
not appeared on any other notification email; so we list those
revisions in full, below.

- Log -
commit d4546c59ce2731a96d336f9953108816ff4b954b
Author: Levente Polyak 
Date:   Thu Dec 12 01:01:44 2019 +0100

Version 20191212

---

Summary of changes:
 Makefile | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)


hooks/post-receive
-- 
The official devtools repository

[arch-projects] [devtools] [GIT] The official devtools repository branch sogrep_redirect deleted. 20190912-11-g7f849ea

2019-12-10 Thread Levente Polyak via arch-projects

This is an automated email from the git hooks/post-receive script. It was
generated because a ref change was pushed to the repository containing
the project "The official devtools repository".

The branch, sogrep_redirect has been deleted
   was  7f849ea58d6a46631017b928285ebf3ff4ce6c69

- Log -
7f849ea58d6a46631017b928285ebf3ff4ce6c69 sogrep: redirect to destination mirror
---


hooks/post-receive
-- 
The official devtools repository

[arch-projects] [devtools] [GIT] The official devtools repository branch master updated. 20191130-4-gd6866e0

2019-12-10 Thread Levente Polyak via arch-projects

This is an automated email from the git hooks/post-receive script. It was
generated because a ref change was pushed to the repository containing
the project "The official devtools repository".

The branch, master has been updated
   via  d6866e0544581840cc021e4be68c1c450fcb7963 (commit)
   via  8edad226166eb6f2888b87cf8e0a9952822c887a (commit)
   via  f20435643f55c37e3f8274a03e7fe5e052dc8dd9 (commit)
  from  8d99df602d6e5fc377a37f67d0e5ce74c8facecd (commit)

Those revisions listed above that are new to this repository have
not appeared on any other notification email; so we list those
revisions in full, below.

- Log -
commit d6866e0544581840cc021e4be68c1c450fcb7963
Author: Levente Polyak 
Date:   Wed Dec 4 12:39:34 2019 +0100

lib: support arbitrary compressed package files

We need to modify the matching of valid package files to support formats
like zstd. Let's try to use an eager approach instead of a simple
whitelist in order to be functional for arbitrary formats that may be
introduced in the future without the need to adjust any code.

Allow any single fragment word as compression type but filter out known
non-package content like signature files.

Signed-off-by: Levente Polyak 

commit 8edad226166eb6f2888b87cf8e0a9952822c887a
Author: Eli Schwartz 
Date:   Mon Dec 2 15:51:21 2019 -0500

offload-build: return failure if no package files were found

This means that the remote command died at some stage earlier than the
printing of created files.

Signed-off-by: Eli Schwartz 

commit f20435643f55c37e3f8274a03e7fe5e052dc8dd9
Author: Levente Polyak 
Date:   Tue Dec 3 01:14:35 2019 +0100

makechrootpkg: sync databases for checkpkg off-site

Use pacman's --dbpath feature to sync fresh databases inside an isolated
location and split up the database sync and package location calls to
remove the need of weird grep calls.

It isn't nice of makechrootpkg to modify the host database state just by
building packages. No foreign program shall automatically modify
the host database other than by the explicit will of a system
maintainer, which is the major reason this changes get incorporated.

However, there is certain indoctrinated believe that using -Sy is
the prime evil. In fact it has been declared as a social rule to a
technical problem of not getting into potential partial upgrade states.
This is not a proper loophole less solution as there are multiple ways
and use cases that lead to such a state, like aborting a -Syu on the
prompt for whatever reason, what really matters is that it is not a
technically bullet proof solution to solve the problem.

Databases shall have the freedom to be as up to date as databases or
their owner wishes, allowing querying on latest database state without
fear. The only loophole-less contract that _really_ is from importance
is always using -Su instead of plain -S to install packages. Installing
packages is what actually brings one into a potential partial upgrade
state and by using -Su an outstanding upgrade is forced when installing
a new package. This properly solves all edge cases in a technical
manner instead of declaring people who abort the prompt of -Syu to be
the problem. In fact, using this simple contract allows whatever system
maintenance workflow a host owner wants to follow, which may still be to
always use -Syu and deal with system upgrades explicitly instead of the
time when installing new packages, but the -Su contract is the real safe
guard to guarantee no edge case can ever slip in. This magically also
opens up the freedom to people who wish to use -Sy to simply query on up
to date data as the currently indoctrinated "never do -Sy" stone plates
not only are not rock solid in technical terms but also make certain use
cases simply impossible and hence cripple the functionality without at
the very least being fully loophole free.

Signed-off-by: Levente Polyak 

---

Summary of changes:
 lib/common.sh|  4 ++--
 makechrootpkg.in | 15 +--
 offload-build|  2 ++
 3 files changed, 17 insertions(+), 4 deletions(-)


hooks/post-receive
-- 
The official devtools repository

[arch-projects] [devtools] [PATCH] offload-build: return failure if no package files were found

2019-12-02 Thread Eli Schwartz via arch-projects

This means that the remote command died at some stage earlier than the
printing of created files.

Signed-off-by: Eli Schwartz 
---
 offload-build | 2 ++
 1 file changed, 2 insertions(+)

diff --git a/offload-build b/offload-build
index dab036d..e607a16 100755
--- a/offload-build
+++ b/offload-build
@@ -116,4 +116,6 @@ if (( ${#files[@]} )); then
 printf '%s\n' '' '-> copying files...'
 load_makepkg_config
 scp "${files[@]/#/$server:}" "${PKGDEST:-${PWD}}/"
+else
+exit 1
 fi
-- 
2.24.0

Re: [arch-projects] [devtools] [GIT] The official devtools repository branch master updated. 20191016-20-g4c803b9

2019-12-01 Thread Eli Schwartz via arch-projects

On 11/30/19 7:31 AM, Levente Polyak via arch-projects wrote:

Generally some nice improvements, but what is the deal with this???

> commit 104c5bc90e259028f5c9352a32f8976aa0f95a8d
> Author: Levente Polyak 
> Date:   Sat Nov 30 13:13:49 2019 +0100
> 
> makechrootpkg: sync database for checkpkg to avoid nonexistent targets
> 
> For build servers or similar infrastructure its relatively common to not
> sync/update the database regularly. This leads to problems properly
> running checkpkg duo to nonexistent target files that we try to
> download. As building on build servers is a very common use case, lets
> ensure we sync the local database before trying to resolve the package
> locations.

This commit means that devtools is not suitable for installation on any
archlinux system (including the systems owned and maintained by
Developers and Trusted Users) other than the single build server which
you've declared to be a common, yet not exclusive, use case of devtools.

One can solve the problem with outdated databases by regularly updating,
or by having dragon.archlinux.org do a periodic pacman -Sy and relying
on devops to not break the box by using pacman -S without -u.

Devtools is now a direct cause of noncompliance with
https://wiki.archlinux.org/index.php/System_maintenance#Partial_upgrades_are_unsupported,
and this will affect both users who follow the recommended best
practices to build/test AUR packages using extra-x86_64-build, as well
as Developers and Trusted Users who prefer to build on their own
hardware, but do not expect running extra-x86_64-build to sneakily
modify their pacman database out from under them.

Please revert.

-- 
Eli Schwartz
Bug Wrangler and Trusted User

signature.asc
Description: OpenPGP digital signature

[arch-projects] [devtools] [GIT] The official devtools repository branch master updated. 20191130-1-g8d99df6

2019-11-30 Thread Levente Polyak via arch-projects

This is an automated email from the git hooks/post-receive script. It was
generated because a ref change was pushed to the repository containing
the project "The official devtools repository".

The branch, master has been updated
   via  8d99df602d6e5fc377a37f67d0e5ce74c8facecd (commit)
  from  4c803b9db8f6395c610c96bd090d1ba2ced82a9c (commit)

Those revisions listed above that are new to this repository have
not appeared on any other notification email; so we list those
revisions in full, below.

- Log -
commit 8d99df602d6e5fc377a37f67d0e5ce74c8facecd
Author: Levente Polyak 
Date:   Sat Nov 30 13:44:02 2019 +0100

makechrootpkg: double quote array expansions for checkpkg locations

Avoid re-splitting remotepkg elements used for checkpkg conditions.

---

Summary of changes:
 makechrootpkg.in | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)


hooks/post-receive
-- 
The official devtools repository

[arch-projects] [devtools] [GIT] The official devtools repository annotated tag 20191130 created. 20191130

2019-11-30 Thread Levente Polyak via arch-projects

This is an automated email from the git hooks/post-receive script. It was
generated because a ref change was pushed to the repository containing
the project "The official devtools repository".

The annotated tag, 20191130 has been created
at  fca044cc8898ae7f901274bab2da62338f6fcdc1 (tag)
   tagging  4c803b9db8f6395c610c96bd090d1ba2ced82a9c (commit)
  replaces  20191016
 tagged by  Levente Polyak
on  Sat Nov 30 13:30:39 2019 +0100

- Log -
Version 20191130
-BEGIN PGP SIGNATURE-

iQIzBAABCgAdFiEE4kC1fixGMLp2ji8m/BtUfI2BcsgFAl3iYO8ACgkQ/BtUfI2B
csg/ww/9Gt6xBhcvMgLduBbiriw+E2lpkR8Mrhv9VT/LnzMrUArvv8sTEE2aeO9P
8WqyrCzGgwTcgryinOy3KuVBxWjllh2tT6GsHp2Mn70Te7rkO2TybigPogTlyVRJ
bLvGDuSdjdHUYIL680x6oOMH1vHajZfFo27KoFF1Qu09MnF/Qx6tsNxZ63MQc4oN
ZxkmarQTK4/HggfmJdmWCpOyno4tUT56PVeTrS2FKSlthu1iv1+reTgh0y3Ocf7o
Yl0eQED3c7bnI3+nqcJmawWTWEVn0aLX5rbWhBBGoA2ih3QZ6fEN5dsY7EjMKca4
C5lipD9ByYSHqDuWiwieHFA6eY9+E9fixCK+hsjGHTU0dhD+WOyusFj6dBhwQSyL
3pbuh84ZfLp2QISiV6VpmIQ9AgX75fIA9FxkEI8RGPGCPF70weTg2u5EJS8W7jbE
YJvFmrIaC/0j5+UaYGMx4flPYuvwai6sLDpXjv0xZr5eSXq6OlXlxkZuVUQCsw0R
gk1JjvT36j8KKsE0FqLuaVIvg0V8OHu0+EBwJY7DWWcnci7KuyVd9RJRlMbchPvo
E5izF+u3ALTWHp/lPP1/C/7bJhYH/iOQFYnF6y2cxw503bcExinUymchIA6cCRFY
gt+so+lOUTQKr3k5DJ4LoTummtlSXTJIRCDoeoyEBxGPcboYZmU=
=lHvd
-END PGP SIGNATURE-

Daniel M. Capella (2):
  conf: Sync with pacman 5.2.0-2
  commitpkg: Include commit msg arg in first line

Eli Schwartz (10):
  arch-nspawn: restore cachedir handling for host_mirrors
  arch-nspawn: simplify cachedir/host_mirror parsing
  use libmakepkg to find and use variables in makepkg.conf
  Makefile: sort program names
  arch-nspawn: rely on deduplication to avoid making multiple host_mirror 
mounts
  commitpkg: clearly delineate the commit message template and the rationale
  archbuild: use better umask
  mkarchroot: support wrapping pacstrap -U
  makerepropkg: add new program to try to reproducibly build a package
  doc: add manpage for the new makerepropkg tool

Ivy Foster (1):
  lib/common.sh: do not use colors when running on a dumb terminal

Levente Polyak (7):
  offload-build: catch more signals to be sure SRCPKGDEST gets cleaned
  offload-build: remove empty src dir when SRCDEST is set
  completion: reflect new -U mkarchchroot option
  completion: add makerepropkg zsh completion
  makechrootpkg: check local pkg versions before downloading for checkpkg
  makechrootpkg: sync database for checkpkg to avoid nonexistent targets
  Version 20191130

---


hooks/post-receive
-- 
The official devtools repository

[arch-projects] [devtools] [GIT] The official devtools repository branch master updated. 20191016-20-g4c803b9

2019-11-30 Thread Levente Polyak via arch-projects

This is an automated email from the git hooks/post-receive script. It was
generated because a ref change was pushed to the repository containing
the project "The official devtools repository".

The branch, master has been updated
   via  4c803b9db8f6395c610c96bd090d1ba2ced82a9c (commit)
   via  104c5bc90e259028f5c9352a32f8976aa0f95a8d (commit)
   via  cee28a1b13ddd0f60b2466b20a43f04a4bf5df54 (commit)
   via  e0f82d394717efb28537f0a366b4a5b3515354b6 (commit)
   via  74313db9ee243b30b48d355f88b3c8971b90161f (commit)
   via  2c611d20bdd04feae6ab32a7ef8947aeb4118604 (commit)
   via  ca4d348c86de0a466d48e6d99ac390729707c317 (commit)
   via  2fb1cc2dd2c2171bd2c078a37f871de45b0fe118 (commit)
   via  bcba56640536406b860fa7364357659b51d0aea5 (commit)
   via  f8f2f0202804a7c6001a98295ec35d43ec5f809c (commit)
   via  68f0bff172f77390dfad798f12e4a56e0c1f35d4 (commit)
   via  f85a58a0a630d44285532693b61d4b8a58dee495 (commit)
   via  20eec484fadd7212367749ee7cd37d3aa18e8c4e (commit)
   via  6fffbfbc8af6b1194b977582fe3cb308b550f864 (commit)
  from  001726337972f35e1907f6460831c3c3c9d656e4 (commit)

Those revisions listed above that are new to this repository have
not appeared on any other notification email; so we list those
revisions in full, below.

- Log -
commit 4c803b9db8f6395c610c96bd090d1ba2ced82a9c
Author: Levente Polyak 
Date:   Sat Nov 30 13:30:34 2019 +0100

Version 20191130

commit 104c5bc90e259028f5c9352a32f8976aa0f95a8d
Author: Levente Polyak 
Date:   Sat Nov 30 13:13:49 2019 +0100

makechrootpkg: sync database for checkpkg to avoid nonexistent targets

For build servers or similar infrastructure its relatively common to not
sync/update the database regularly. This leads to problems properly
running checkpkg duo to nonexistent target files that we try to
download. As building on build servers is a very common use case, lets
ensure we sync the local database before trying to resolve the package
locations.

commit cee28a1b13ddd0f60b2466b20a43f04a4bf5df54
Author: Levente Polyak 
Date:   Sat Nov 30 13:09:14 2019 +0100

makechrootpkg: check local pkg versions before downloading for checkpkg

Avoid always trying to download and output the according message.
Add checks for packages either not being available in the repo or
all variants have up to date versions stored in the local cache.

commit e0f82d394717efb28537f0a366b4a5b3515354b6
Author: Levente Polyak 
Date:   Thu Nov 28 21:50:15 2019 +0100

completion: add makerepropkg zsh completion

commit 74313db9ee243b30b48d355f88b3c8971b90161f
Author: Levente Polyak 
Date:   Thu Nov 28 21:49:43 2019 +0100

completion: reflect new -U mkarchchroot option

commit 2c611d20bdd04feae6ab32a7ef8947aeb4118604
Author: Ivy Foster 
Date:   Thu Nov 21 18:08:25 2019 -0600

lib/common.sh: do not use colors when running on a dumb terminal

commit ca4d348c86de0a466d48e6d99ac390729707c317
Author: Eli Schwartz 
Date:   Sun Nov 17 21:24:02 2019 -0500

doc: add manpage for the new makerepropkg tool

Signed-off-by: Eli Schwartz 

commit 2fb1cc2dd2c2171bd2c078a37f871de45b0fe118
Author: Eli Schwartz 
Date:   Wed Feb 13 17:14:00 2019 -0500

makerepropkg: add new program to try to reproducibly build a package

This attempts to recreate a package that was probably created using
makechrootpkg, and see if it conforms to the
https://reproducible-builds.org/ specification.

Signed-off-by: Eli Schwartz 

commit bcba56640536406b860fa7364357659b51d0aea5
Author: Eli Schwartz 
Date:   Tue Sep 3 18:40:00 2019 -0400

mkarchroot: support wrapping pacstrap -U

Needed to support reproducible builds.

Signed-off-by: Eli Schwartz 

commit f8f2f0202804a7c6001a98295ec35d43ec5f809c
Author: Eli Schwartz 
Date:   Sat Nov 9 22:13:00 2019 -0500

archbuild: use better umask

In commit 40a90e2cab479cc64903a62b42eb617a8a7e5842 we tried to protect
against system umasks resulting in unreadable chroots. However, we tried
to do this in a targeted manner due to not wanting to fiddle with
permissions for user-owned files. Unfortuantely, mkdir -p -m755 does not
actually work that way -- the parent directory is created with broken
permissions. We need umask.

Run umask and mkdir in a subshell to prevent leakage.

Signed-off-by: Eli Schwartz 

commit 68f0bff172f77390dfad798f12e4a56e0c1f35d4
Author: Eli Schwartz 
Date:   Fri Nov 8 09:40:09 2019 -0500

commitpkg: clearly delineate the commit message template and the rationale

In commit 75d23eec942e7160108ee194894b6b83ed3045d5 we moved to include
commitpkg arguments as the first line of the svn commit message, but we
simply dumped the result after the version number without separating the
two, increasing the cognitive burden of parsing the rationale. Since the

[arch-projects] [devtools] [PATCH v3 2/3] makerepropkg: add new program to try to reproducibly build a package

2019-11-20 Thread Eli Schwartz via arch-projects

This attempts to recreate a package that was probably created using
makechrootpkg, and see if it conforms to the
https://reproducible-builds.org/ specification.

Signed-off-by: Eli Schwartz 
---

v3: make sure the pkgfile is actually a valid pkgfile

 .gitignore  |   1 +
 Makefile|   1 +
 makerepropkg.in | 190 
 3 files changed, 192 insertions(+)
 create mode 100755 makerepropkg.in

diff --git a/.gitignore b/.gitignore
index 6a1d1e4..7844219 100644
--- a/.gitignore
+++ b/.gitignore
@@ -9,6 +9,7 @@ commitpkg
 finddeps
 lddd
 makechrootpkg
+makerepropkg
 mkarchroot
 rebuildpkgs
 zsh_completion
diff --git a/Makefile b/Makefile
index 0eb7a88..090063d 100644
--- a/Makefile
+++ b/Makefile
@@ -14,6 +14,7 @@ IN_PROGS = \
finddeps \
find-libdeps \
lddd \
+   makerepropkg \
mkarchroot \
makechrootpkg \
rebuildpkgs \
diff --git a/makerepropkg.in b/makerepropkg.in
new file mode 100755
index 000..710f3ca
--- /dev/null
+++ b/makerepropkg.in
@@ -0,0 +1,190 @@
+#!/bin/bash
+#   makerepropkg - rebuild a package to see if it is reproducible
+#
+#   Copyright (c) 2019 by Eli Schwartz 
+#
+#   This program is free software; you can redistribute it and/or modify
+#   it under the terms of the GNU General Public License as published by
+#   the Free Software Foundation; either version 2 of the License, or
+#   (at your option) any later version.
+#
+#   This program is distributed in the hope that it will be useful,
+#   but WITHOUT ANY WARRANTY; without even the implied warranty of
+#   MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+#   GNU General Public License for more details.
+#
+#   You should have received a copy of the GNU General Public License
+#   along with this program.  If not, see .
+#
+
+m4_include(lib/common.sh)
+m4_include(lib/archroot.sh)
+
+source /usr/share/makepkg/util/config.sh
+source /usr/share/makepkg/util/message.sh
+
+declare -A buildinfo
+declare -a buildenv buildopts installed installpkgs
+
+archiveurl='https://archive.archlinux.org/packages'
+buildroot=/var/lib/archbuild/reproducible
+chroot=testenv
+
+parse_buildinfo() {
+local line var val
+
+while read -r line; do
+var="${line%% = *}"
+val="${line#* = }"
+case ${var} in
+buildenv)
+buildenv+=("${val}")
+;;
+options)
+buildopts+=("${val}")
+;;
+installed)
+installed+=("${val}")
+;;
+*)
+buildinfo["${var}"]="${val}"
+;;
+esac
+done
+}
+
+get_pkgfile() {
+local cdir=${cache_dirs[0]}
+local pkgfilebase=${1}
+local pkgname=${pkgfilebase%-*-*-*}
+local pkgfile ext
+
+for ext in .xz .zstd ''; do
+pkgfile=${pkgfilebase}.pkg.tar${ext}
+
+for c in "${cache_dirs[@]}"; do
+if [[ -f ${c}/${pkgfile} ]]; then
+cdir=${c}
+break
+fi
+done
+
+for f in "${pkgfile}" "${pkgfile}.sig"; do
+if [[ ! -f "${cdir}/${f}" ]]; then
+msg2 "retrieving '%s'..." "${f}" >&2
+curl -Llf -# -o "${cdir}/${f}" 
"${archiveurl}/${pkgname:0:1}/${pkgname}/${f}" || continue 2
+fi
+done
+printf '%s\n' "file://${cdir}/${pkgfile}"
+return 0
+done
+
+return 1
+}
+
+usage() {
+cat << __EOF__
+usage: ${BASH_SOURCE[0]##*/} [options] 
+
+Run this script in a PKGBUILD dir to build a package inside a
+clean chroot while attempting to reproduce it. The package file
+will be used to derive metadata needed for reproducing the
+package, including the .PKGINFO as well as the buildinfo.
+
+For more details see https://reproducible-builds.org/
+
+OPTIONS
+-c   Set pacman cache
+-M  Location of a makepkg config file
+-hShow this usage message
+__EOF__
+}
+
+while getopts 'M:c:h' arg; do
+case "$arg" in
+M) archroot_args+=(-M "$OPTARG") ;;
+c) cache_dirs+=("$OPTARG") ;;
+h) usage; exit 0 ;;
+*|?) usage; exit 1 ;;
+esac
+done
+shift $((OPTIND - 1))
+
+check_root
+
+if [[ -n $1 ]]; then
+pkgfile="$1"
+if ! bsdtar -tqf "${pkgfile}" .BUILDINFO >/dev/null 2>&1; then
+error "file is not a valid pacman package: '%s'" "${pkgfile}"
+exit 1
+fi
+else
+error "no package file specified. Try '${BASH_SOURCE[0]##*/} -h' for more 
information. "
+exit 1
+fi
+
+if (( ${#cache_dirs[@]} == 0 )); then
+   mapfile -t cache_dirs < <(pacman-conf CacheDir)
+fi
+
+ORIG_HOME=${HOME}
+IFS=: read -r _ _ _ _ _ HOME _ < <(getent passwd "${SUDO_USER:-$USER}")
+load_makepkg_config
+HOME=${ORIG_HOME}
+[[ -d ${SRCDEST} ]] || SRCDEST=${PWD}
+
+parse_buildinfo < <(bsdtar -xOqf "${pkgfile}" .BUILDINFO)
+export

[arch-projects] [devtools] [PATCH v2 2/3] makerepropkg: add new program to try to reproducibly build a package

2019-11-20 Thread Eli Schwartz via arch-projects

This attempts to recreate a package that was probably created using
makechrootpkg, and see if it conforms to the
https://reproducible-builds.org/ specification.

Signed-off-by: Eli Schwartz 
---

v2: add .gitignore bits

 .gitignore  |   1 +
 Makefile|   1 +
 makerepropkg.in | 186 
 3 files changed, 188 insertions(+)
 create mode 100755 makerepropkg.in

diff --git a/.gitignore b/.gitignore
index 6a1d1e4..7844219 100644
--- a/.gitignore
+++ b/.gitignore
@@ -9,6 +9,7 @@ commitpkg
 finddeps
 lddd
 makechrootpkg
+makerepropkg
 mkarchroot
 rebuildpkgs
 zsh_completion
diff --git a/Makefile b/Makefile
index 0eb7a88..090063d 100644
--- a/Makefile
+++ b/Makefile
@@ -14,6 +14,7 @@ IN_PROGS = \
finddeps \
find-libdeps \
lddd \
+   makerepropkg \
mkarchroot \
makechrootpkg \
rebuildpkgs \
diff --git a/makerepropkg.in b/makerepropkg.in
new file mode 100755
index 000..d1414d8
--- /dev/null
+++ b/makerepropkg.in
@@ -0,0 +1,186 @@
+#!/bin/bash
+#   makerepropkg - rebuild a package to see if it is reproducible
+#
+#   Copyright (c) 2019 by Eli Schwartz 
+#
+#   This program is free software; you can redistribute it and/or modify
+#   it under the terms of the GNU General Public License as published by
+#   the Free Software Foundation; either version 2 of the License, or
+#   (at your option) any later version.
+#
+#   This program is distributed in the hope that it will be useful,
+#   but WITHOUT ANY WARRANTY; without even the implied warranty of
+#   MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+#   GNU General Public License for more details.
+#
+#   You should have received a copy of the GNU General Public License
+#   along with this program.  If not, see .
+#
+
+m4_include(lib/common.sh)
+m4_include(lib/archroot.sh)
+
+source /usr/share/makepkg/util/config.sh
+source /usr/share/makepkg/util/message.sh
+
+declare -A buildinfo
+declare -a buildenv buildopts installed installpkgs
+
+archiveurl='https://archive.archlinux.org/packages'
+buildroot=/var/lib/archbuild/reproducible
+chroot=testenv
+
+parse_buildinfo() {
+local line var val
+
+while read -r line; do
+var="${line%% = *}"
+val="${line#* = }"
+case ${var} in
+buildenv)
+buildenv+=("${val}")
+;;
+options)
+buildopts+=("${val}")
+;;
+installed)
+installed+=("${val}")
+;;
+*)
+buildinfo["${var}"]="${val}"
+;;
+esac
+done
+}
+
+get_pkgfile() {
+local cdir=${cache_dirs[0]}
+local pkgfilebase=${1}
+local pkgname=${pkgfilebase%-*-*-*}
+local pkgfile ext
+
+for ext in .xz .zstd ''; do
+pkgfile=${pkgfilebase}.pkg.tar${ext}
+
+for c in "${cache_dirs[@]}"; do
+if [[ -f ${c}/${pkgfile} ]]; then
+cdir=${c}
+break
+fi
+done
+
+for f in "${pkgfile}" "${pkgfile}.sig"; do
+if [[ ! -f "${cdir}/${f}" ]]; then
+msg2 "retrieving '%s'..." "${f}" >&2
+curl -Llf -# -o "${cdir}/${f}" 
"${archiveurl}/${pkgname:0:1}/${pkgname}/${f}" || continue 2
+fi
+done
+printf '%s\n' "file://${cdir}/${pkgfile}"
+return 0
+done
+
+return 1
+}
+
+usage() {
+cat << __EOF__
+usage: ${BASH_SOURCE[0]##*/} [options] 
+
+Run this script in a PKGBUILD dir to build a package inside a
+clean chroot while attempting to reproduce it. The package file
+will be used to derive metadata needed for reproducing the
+package, including the .PKGINFO as well as the buildinfo.
+
+For more details see https://reproducible-builds.org/
+
+OPTIONS
+-c   Set pacman cache
+-M  Location of a makepkg config file
+-hShow this usage message
+__EOF__
+}
+
+while getopts 'M:c:h' arg; do
+case "$arg" in
+M) archroot_args+=(-M "$OPTARG") ;;
+c) cache_dirs+=("$OPTARG") ;;
+h) usage; exit 0 ;;
+*|?) usage; exit 1 ;;
+esac
+done
+shift $((OPTIND - 1))
+
+check_root
+
+if [[ -n $1 ]]; then
+pkgfile="$1"
+else
+error "no package file specified. Try '${BASH_SOURCE[0]##*/} -h' for more 
information. "
+exit 1
+fi
+
+if (( ${#cache_dirs[@]} == 0 )); then
+   mapfile -t cache_dirs < <(pacman-conf CacheDir)
+fi
+
+ORIG_HOME=${HOME}
+IFS=: read -r _ _ _ _ _ HOME _ < <(getent passwd "${SUDO_USER:-$USER}")
+load_makepkg_config
+HOME=${ORIG_HOME}
+[[ -d ${SRCDEST} ]] || SRCDEST=${PWD}
+
+parse_buildinfo < <(bsdtar -xOqf "${pkgfile}" .BUILDINFO)
+export SOURCE_DATE_EPOCH="${buildinfo[builddate]}"
+PACKAGER="${buildinfo[packager]}"
+BUILDDIR="${buildinfo[builddir]}"
+
+# nuke and restore reproducible testenv
+for copy in "${buildroot}"/*/; do
+[[ -d

[arch-projects] [devtools] [PATCH 2/3] makerepropkg: add new program to try to reproducibly build a package

2019-11-17 Thread Eli Schwartz via arch-projects

This attempts to recreate a package that was probably created using
makechrootpkg, and see if it conforms to the
https://reproducible-builds.org/ specification.

Signed-off-by: Eli Schwartz 
---
 Makefile|   1 +
 makerepropkg.in | 186 
 2 files changed, 187 insertions(+)
 create mode 100755 makerepropkg.in

diff --git a/Makefile b/Makefile
index 0eb7a88..090063d 100644
--- a/Makefile
+++ b/Makefile
@@ -14,6 +14,7 @@ IN_PROGS = \
finddeps \
find-libdeps \
lddd \
+   makerepropkg \
mkarchroot \
makechrootpkg \
rebuildpkgs \
diff --git a/makerepropkg.in b/makerepropkg.in
new file mode 100755
index 000..d1414d8
--- /dev/null
+++ b/makerepropkg.in
@@ -0,0 +1,186 @@
+#!/bin/bash
+#   makerepropkg - rebuild a package to see if it is reproducible
+#
+#   Copyright (c) 2019 by Eli Schwartz 
+#
+#   This program is free software; you can redistribute it and/or modify
+#   it under the terms of the GNU General Public License as published by
+#   the Free Software Foundation; either version 2 of the License, or
+#   (at your option) any later version.
+#
+#   This program is distributed in the hope that it will be useful,
+#   but WITHOUT ANY WARRANTY; without even the implied warranty of
+#   MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+#   GNU General Public License for more details.
+#
+#   You should have received a copy of the GNU General Public License
+#   along with this program.  If not, see .
+#
+
+m4_include(lib/common.sh)
+m4_include(lib/archroot.sh)
+
+source /usr/share/makepkg/util/config.sh
+source /usr/share/makepkg/util/message.sh
+
+declare -A buildinfo
+declare -a buildenv buildopts installed installpkgs
+
+archiveurl='https://archive.archlinux.org/packages'
+buildroot=/var/lib/archbuild/reproducible
+chroot=testenv
+
+parse_buildinfo() {
+local line var val
+
+while read -r line; do
+var="${line%% = *}"
+val="${line#* = }"
+case ${var} in
+buildenv)
+buildenv+=("${val}")
+;;
+options)
+buildopts+=("${val}")
+;;
+installed)
+installed+=("${val}")
+;;
+*)
+buildinfo["${var}"]="${val}"
+;;
+esac
+done
+}
+
+get_pkgfile() {
+local cdir=${cache_dirs[0]}
+local pkgfilebase=${1}
+local pkgname=${pkgfilebase%-*-*-*}
+local pkgfile ext
+
+for ext in .xz .zstd ''; do
+pkgfile=${pkgfilebase}.pkg.tar${ext}
+
+for c in "${cache_dirs[@]}"; do
+if [[ -f ${c}/${pkgfile} ]]; then
+cdir=${c}
+break
+fi
+done
+
+for f in "${pkgfile}" "${pkgfile}.sig"; do
+if [[ ! -f "${cdir}/${f}" ]]; then
+msg2 "retrieving '%s'..." "${f}" >&2
+curl -Llf -# -o "${cdir}/${f}" 
"${archiveurl}/${pkgname:0:1}/${pkgname}/${f}" || continue 2
+fi
+done
+printf '%s\n' "file://${cdir}/${pkgfile}"
+return 0
+done
+
+return 1
+}
+
+usage() {
+cat << __EOF__
+usage: ${BASH_SOURCE[0]##*/} [options] 
+
+Run this script in a PKGBUILD dir to build a package inside a
+clean chroot while attempting to reproduce it. The package file
+will be used to derive metadata needed for reproducing the
+package, including the .PKGINFO as well as the buildinfo.
+
+For more details see https://reproducible-builds.org/
+
+OPTIONS
+-c   Set pacman cache
+-M  Location of a makepkg config file
+-hShow this usage message
+__EOF__
+}
+
+while getopts 'M:c:h' arg; do
+case "$arg" in
+M) archroot_args+=(-M "$OPTARG") ;;
+c) cache_dirs+=("$OPTARG") ;;
+h) usage; exit 0 ;;
+*|?) usage; exit 1 ;;
+esac
+done
+shift $((OPTIND - 1))
+
+check_root
+
+if [[ -n $1 ]]; then
+pkgfile="$1"
+else
+error "no package file specified. Try '${BASH_SOURCE[0]##*/} -h' for more 
information. "
+exit 1
+fi
+
+if (( ${#cache_dirs[@]} == 0 )); then
+   mapfile -t cache_dirs < <(pacman-conf CacheDir)
+fi
+
+ORIG_HOME=${HOME}
+IFS=: read -r _ _ _ _ _ HOME _ < <(getent passwd "${SUDO_USER:-$USER}")
+load_makepkg_config
+HOME=${ORIG_HOME}
+[[ -d ${SRCDEST} ]] || SRCDEST=${PWD}
+
+parse_buildinfo < <(bsdtar -xOqf "${pkgfile}" .BUILDINFO)
+export SOURCE_DATE_EPOCH="${buildinfo[builddate]}"
+PACKAGER="${buildinfo[packager]}"
+BUILDDIR="${buildinfo[builddir]}"
+
+# nuke and restore reproducible testenv
+for copy in "${buildroot}"/*/; do
+[[ -d ${copy} ]] || continue
+subvolume_delete_recursive "${copy}"
+done
+rm -rf --one-file-system "${buildroot}"
+(umask 0022; mkdir -p "${buildroot}")
+
+for fname in "${installed[@]}"; do
+if ! allpkgfiles+=("$(get_pkgfile "${fname}")"); then
+error

[arch-projects] [devtools] [PATCH 0/3] New tool,

2019-11-17 Thread Eli Schwartz via arch-projects

I've finally finished up this thing for testing if a package can be
rebuilt reproducibly. It uses makechrootpkg/mkarchroot under the hood,
and requires arch-install-scripts >= 23.

This, and other commits recently submitted to the list, can be pulled
directly from my repository at 
https://github.com/eli-schwartz/devtools/commits/arch-projects-review

Eli Schwartz (3):
  mkarchroot: support wrapping pacstrap -U
  makerepropkg: add new program to try to reproducibly build a package
  doc: add manpage for the new makerepropkg tool

 Makefile|   2 +
 doc/makerepropkg.1.asciidoc |  38 
 doc/mkarchroot.1.asciidoc   |   3 +
 makerepropkg.in | 186 
 mkarchroot.in   |  13 ++-
 5 files changed, 238 insertions(+), 4 deletions(-)
 create mode 100644 doc/makerepropkg.1.asciidoc
 create mode 100755 makerepropkg.in

-- 
2.24.0

[arch-projects] [devtools] [PATCH 3/3] doc: add manpage for the new makerepropkg tool

2019-11-17 Thread Eli Schwartz via arch-projects

Signed-off-by: Eli Schwartz 
---
 Makefile|  1 +
 doc/makerepropkg.1.asciidoc | 38 +
 2 files changed, 39 insertions(+)
 create mode 100644 doc/makerepropkg.1.asciidoc

diff --git a/Makefile b/Makefile
index 090063d..4ca7155 100644
--- a/Makefile
+++ b/Makefile
@@ -72,6 +72,7 @@ MANS = \
doc/checkpkg.1 \
doc/offload-build.1 \
doc/sogrep.1 \
+   doc/makerepropkg.1 \
doc/mkarchroot.1 \
doc/find-libdeps.1 \
doc/find-libprovides.1
diff --git a/doc/makerepropkg.1.asciidoc b/doc/makerepropkg.1.asciidoc
new file mode 100644
index 000..7d68e5e
--- /dev/null
+++ b/doc/makerepropkg.1.asciidoc
@@ -0,0 +1,38 @@
+makerepropkg(1)
+
+
+Name
+
+makerepropkg - Rebuild a package to see if it is reproducible
+
+Synopsis
+
+makerepropkg [OPTIONS] 
+
+Description
+---
+
+Given the path to a built pacman package, attempt to rebuild it using the
+PKGBUILD in the current directory. The package will be built in an environment
+as closely matching the environment of the initial package as possible, by
+building up a chroot to match the information exposed in the package's
+linkman:BUILDINFO[5] manifest. On success, the resulting package will be
+compared to the input package, and makerepropkg will report whether the
+artifacts are identical.
+
+This implements a verifier for pacman/libalpm packages in accordance with the
+link:https://reproducible-builds.org/[Reproducible Builds] project.
+
+Options
+---
+
+*-c*::
+   Set the pacman cache directory.
+
+*-M* ::
+   Location of a makepkg config file.
+
+*-h*::
+   Show this usage message
+
+include::footer.asciidoc[]
-- 
2.24.0

[arch-projects] [devtools] [PATCH 1/3] mkarchroot: support wrapping pacstrap -U

2019-11-17 Thread Eli Schwartz via arch-projects

Needed to support reproducible builds.

Signed-off-by: Eli Schwartz 
---
 doc/mkarchroot.1.asciidoc |  3 +++
 mkarchroot.in | 13 +
 2 files changed, 12 insertions(+), 4 deletions(-)

diff --git a/doc/mkarchroot.1.asciidoc b/doc/mkarchroot.1.asciidoc
index 03d032c..eb0670a 100644
--- a/doc/mkarchroot.1.asciidoc
+++ b/doc/mkarchroot.1.asciidoc
@@ -20,6 +20,9 @@ en_US.UTF-8 and de_DE.UTF-8 locale and a generated machine-id.
 Options
 ---
 
+*-U*::
+   Use 'pacman -U' to install packages.
+
 *-C* ::
Location of a pacman config file.
 
diff --git a/mkarchroot.in b/mkarchroot.in
index 6c42d3b..37f6802 100644
--- a/mkarchroot.in
+++ b/mkarchroot.in
@@ -18,6 +18,7 @@ m4_include(lib/archroot.sh)
 umask 0022
 
 working_dir=''
+umode=''
 
 files=()
 nspawn_args=()
@@ -25,6 +26,7 @@ nspawn_args=()
 usage() {
echo "Usage: ${0##*/} [options] working-dir package-list..."
echo ' options:'
+   echo '-UUse pacman -U to install packages'
echo '-C  Location of a pacman config file'
echo '-M  Location of a makepkg config file'
echo '-c   Set pacman cache'
@@ -34,8 +36,9 @@ usage() {
exit 1
 }
 
-while getopts 'hC:M:c:f:s' arg; do
+while getopts 'hUC:M:c:f:s' arg; do
case "$arg" in
+   U) umode=U ;;
C) pac_conf="$OPTARG" ;;
M) makepkg_conf="$OPTARG" ;;
c) cache_dirs+=("$OPTARG") ;;
@@ -44,8 +47,10 @@ while getopts 'hC:M:c:f:s' arg; do
h|?) usage ;;
*) error "invalid argument '%s'" "$arg"; usage ;;
esac
-nspawn_args+=("-$arg")
-[[ -v OPTARG ]] && nspawn_args+=("$OPTARG")
+   if [[ $arg != U ]]; then
+   nspawn_args+=("-$arg")
+   [[ -v OPTARG ]] && nspawn_args+=("$OPTARG")
+   fi
 done
 shift $((OPTIND - 1))
 
@@ -85,7 +90,7 @@ for file in "${files[@]}"; do
cp "$file" "$working_dir$file"
 done
 
-pacstrap -Mcd ${pac_conf:+-C "$pac_conf"} "$working_dir" \
+pacstrap -${umode}Mcd ${pac_conf:+-C "$pac_conf"} "$working_dir" \
"${cache_dirs[@]/#/--cachedir=}" "$@" || die 'Failed to install all 
packages'
 
 printf '%s.UTF-8 UTF-8\n' en_US de_DE > "$working_dir/etc/locale.gen"
-- 
2.24.0

WARN: project in Attic but not in 'retired' category: https://raw.githubusercontent.com/apache/apex-site/master/doap_Apex.rdf

2019-11-13 Thread Projects

WARN: project in Attic but not in 'retired' category: http://svn.apache.org/repos/asf/ode/trunk/doap_ODE.rdf

2019-11-13 Thread Projects

WARN: project from a retired committee but PMC not changed to Attic in http://svn.apache.org/repos/asf/ode/trunk/doap_ODE.rdf

2019-11-13 Thread Projects

WARN: project from a retired committee but PMC not changed to Attic in https://svn.apache.org/repos/asf/falcon/trunk/falcon.rdf

2019-11-13 Thread Projects

WARN: project in Attic but not in 'retired' category: https://svn.apache.org/repos/asf/falcon/trunk/falcon.rdf

2019-11-13 Thread Projects

WARN: project from a retired committee but PMC not changed to Attic in https://raw.githubusercontent.com/apache/apex-site/master/doap_Apex.rdf

2019-11-13 Thread Projects

[arch-projects] [devtools] [GIT] The official devtools repository branch master updated. 20191016-6-g0017263

2019-11-07 Thread Levente Polyak via arch-projects

This is an automated email from the git hooks/post-receive script. It was
generated because a ref change was pushed to the repository containing
the project "The official devtools repository".

The branch, master has been updated
   via  001726337972f35e1907f6460831c3c3c9d656e4 (commit)
   via  751093eff2cbd0df422b69810787b4fcf3d33208 (commit)
   via  f43a86ee8a3a3bfbdc32c2d70516d945afcd8515 (commit)
   via  00671765296ad598f392df7a542dbfca48a6e7b7 (commit)
   via  75d23eec942e7160108ee194894b6b83ed3045d5 (commit)
  from  6679c28625b1e48bc115290b7c41941366d44a05 (commit)

Those revisions listed above that are new to this repository have
not appeared on any other notification email; so we list those
revisions in full, below.

- Log -
commit 001726337972f35e1907f6460831c3c3c9d656e4
Author: Eli Schwartz 
Date:   Fri Aug 9 14:26:57 2019 -0400

Makefile: sort program names

Signed-off-by: Eli Schwartz 
Signed-off-by: Levente Polyak 

commit 751093eff2cbd0df422b69810787b4fcf3d33208
Author: Eli Schwartz 
Date:   Fri Aug 9 14:31:53 2019 -0400

use libmakepkg to find and use variables in makepkg.conf

- drop homebrew function in makechrootpkg
- use better mock to find invoking user's $HOME
- make offload-build respect makepkg.conf to determine where to sync
  files, matching the behavior of makechrootpkg

Signed-off-by: Eli Schwartz 
Signed-off-by: Levente Polyak 

commit f43a86ee8a3a3bfbdc32c2d70516d945afcd8515
Author: Eli Schwartz 
Date:   Wed Oct 2 10:49:32 2019 -0400

arch-nspawn: simplify cachedir/host_mirror parsing

consolidate logic flows in the same area for parsing and building
arrays. Don't bother having a special function just to build the
mount_args array, since we now use the same handling for adding any
cachedir (including host mirrors) to the mount arguments, this becomes a
trivial for loop -- and it really did not need to be delayed until after
the sanity check, anyway.

Signed-off-by: Eli Schwartz 
Signed-off-by: Levente Polyak 

commit 00671765296ad598f392df7a542dbfca48a6e7b7
Author: Eli Schwartz 
Date:   Wed Oct 2 10:36:53 2019 -0400

arch-nspawn: restore cachedir handling for host_mirrors

In commit 27ff286ee78eb2faac803e3ef67f3171ddfa0098, we moved from
sourcing the primary cachedir via /etc/pacman.conf, to using the
pacman.conf in the workdir. One unanticipated side effect of this was
breaking the special host mirrors magic we used to turn a host mirror
into a cachedir. It was still processed as a server, but we relied on it
being in the host's cachedirs in order to be persisted, and this no
longer occurred.

Solve this by explicitly adding each host mirror root as a cachedir.

Signed-off-by: Eli Schwartz 
Signed-off-by: Levente Polyak 

commit 75d23eec942e7160108ee194894b6b83ed3045d5
Author: Daniel M. Capella 
Date:   Fri Sep 27 18:55:45 2019 -0400

commitpkg: Include commit msg arg in first line

Commit messages belong on the first line, with optional "explanatory
text" starting after a blank line:
https://tbaggery.com/2008/04/19/a-note-about-git-commit-messages.html

Referencing commit ee970f0bde3c90a0dff909c366d4ab1a1bff9b9d

Signed-off-by: Daniel M. Capella 
Signed-off-by: Levente Polyak 

---

Summary of changes:
 Makefile | 12 ++--
 arch-nspawn.in   | 31 ++-
 commitpkg.in |  4 ++--
 makechrootpkg.in | 34 ++
 offload-build|  9 -
 5 files changed, 36 insertions(+), 54 deletions(-)


hooks/post-receive
-- 
The official devtools repository

[arch-projects] [devtools] [PATCH] arch-nspawn: rely on deduplication to avoid making multiple host_mirror mounts

2019-11-05 Thread Eli Schwartz via arch-projects

Instead of comparing exact mirror urls to see if they are in
host_mirrors in order to "skip" the official mirrors, simply trim the
expected .../os/... pattern match. We already filter duplicate
cachedirs.

Signed-off-by: Eli Schwartz 
---

I wasn't sure of the precise utility of this, but in addition to being a
bit simpler, it seems to work around the case of
https://github.com/archlinux/devtools/issues/14

(Even though I don't really understand why anyone is using
'$repo/os/$arch' for their own Server urls.)

 arch-nspawn.in | 16 +++-
 1 file changed, 7 insertions(+), 9 deletions(-)

diff --git a/arch-nspawn.in b/arch-nspawn.in
index 7aa6fd6..198d227 100644
--- a/arch-nspawn.in
+++ b/arch-nspawn.in
@@ -75,15 +75,13 @@ done
 
 while read -r line; do
mapfile -t lines < <($pacconf_cmd --config 
"${pac_conf:-$working_dir/etc/pacman.conf}" \
-   --repo $line Server | sed -r 
's#(.*/)[^/]+/os/.+#\1$repo/os/$arch#')
-   if [[ ${lines[0]} != ${host_mirrors[0]} ]]; then
-   for line in "${lines[@]}"; do
-   if [[ $line = file://* ]]; then
-   line=${line#file://}
-   in_array "$line" "${cache_dirs[@]}" || 
cache_dirs+=("$line")
-   fi
-   done
-   fi
+   --repo $line Server | sed -r 's#(.*/)[^/]+/os/.+#\1#')
+   for line in "${lines[@]}"; do
+   if [[ $line = file://* ]]; then
+   line=${line#file://}
+   in_array "$line" "${cache_dirs[@]}" || 
cache_dirs+=("$line")
+   fi
+   done
 done < <($pacconf_cmd --config "${pac_conf:-$working_dir/etc/pacman.conf}" 
--repo-list)
 
 mount_args+=("--bind=${cache_dirs[0]//:/\\:}")
-- 
2.24.0

[arch-projects] [devtools] [GIT] The official devtools repository branch master updated. 20191016-1-g6679c28

2019-11-05 Thread Levente Polyak via arch-projects

This is an automated email from the git hooks/post-receive script. It was
generated because a ref change was pushed to the repository containing
the project "The official devtools repository".

The branch, master has been updated
   via  6679c28625b1e48bc115290b7c41941366d44a05 (commit)
  from  2edee89b629f73c8437368b37efbcafd90429728 (commit)

Those revisions listed above that are new to this repository have
not appeared on any other notification email; so we list those
revisions in full, below.

- Log -
commit 6679c28625b1e48bc115290b7c41941366d44a05
Author: Daniel M. Capella 
Date:   Sat Oct 26 18:02:33 2019 -0400

conf: Sync with pacman 5.2.0-2

Signed-off-by: Daniel M. Capella 

---

Summary of changes:
 makepkg-x86_64.conf  | 6 +++---
 pacman-extra.conf| 4 +---
 pacman-gnome-unstable.conf   | 4 +---
 pacman-kde-unstable.conf | 4 +---
 pacman-multilib-staging.conf | 4 +---
 pacman-multilib-testing.conf | 4 +---
 pacman-multilib.conf | 4 +---
 pacman-staging.conf  | 4 +---
 pacman-testing.conf  | 4 +---
 9 files changed, 11 insertions(+), 27 deletions(-)


hooks/post-receive
-- 
The official devtools repository

[arch-projects] [devtools] [PATCH 4/4] Makefile: sort program names

2019-11-05 Thread Eli Schwartz via arch-projects

Signed-off-by: Eli Schwartz 
---
 Makefile | 12 ++--
 1 file changed, 6 insertions(+), 6 deletions(-)

diff --git a/Makefile b/Makefile
index a8e44ee..0eb7a88 100644
--- a/Makefile
+++ b/Makefile
@@ -4,19 +4,19 @@ PREFIX = /usr/local
 MANDIR = $(PREFIX)/share/man
 
 IN_PROGS = \
-   checkpkg \
-   commitpkg \
archco \
+   arch-nspawn \
archrelease \
archbuild \
-   lddd \
+   checkpkg \
+   commitpkg \
+   crossrepomove\
finddeps \
-   rebuildpkgs \
find-libdeps \
-   crossrepomove\
-   arch-nspawn \
+   lddd \
mkarchroot \
makechrootpkg \
+   rebuildpkgs \
sogrep
 
 BINPROGS = \
-- 
2.24.0

[arch-projects] [devtools] [PATCH 1/4] arch-nspawn: restore cachedir handling for host_mirrors

2019-11-05 Thread Eli Schwartz via arch-projects

In commit 27ff286ee78eb2faac803e3ef67f3171ddfa0098, we moved from
sourcing the primary cachedir via /etc/pacman.conf, to using the
pacman.conf in the workdir. One unanticipated side effect of this was
breaking the special host mirrors magic we used to turn a host mirror
into a cachedir. It was still processed as a server, but we relied on it
being in the host's cachedirs in order to be persisted, and this no
longer occurred.

Solve this by explicitly adding each host mirror root as a cachedir.

Signed-off-by: Eli Schwartz 
---
 arch-nspawn.in | 7 +++
 1 file changed, 7 insertions(+)

diff --git a/arch-nspawn.in b/arch-nspawn.in
index 5817143..90fe967 100644
--- a/arch-nspawn.in
+++ b/arch-nspawn.in
@@ -99,7 +99,14 @@ build_mount_args() {
 copy_hostconf () {
unshare --fork --pid gpg --homedir "$working_dir"/etc/pacman.d/gnupg/ 
--no-permission-warning --quiet --batch --import --import-options 
import-local-sigs "$(pacman-conf GpgDir)"/pubring.gpg >/dev/null 2>&1
pacman-key --gpgdir "$working_dir"/etc/pacman.d/gnupg/ --import-trustdb 
"$(pacman-conf GpgDir)" >/dev/null 2>&1
+
printf 'Server = %s\n' "${host_mirrors[@]}" 
>"$working_dir/etc/pacman.d/mirrorlist"
+   for host_mirror in "${host_mirrors[@]}"; do
+   if [[ $host_mirror == *file://* ]]; then
+   host_mirror=$(echo "$host_mirror" | sed -r 
's#file://(/.*)/\$repo/os/\$arch#\1#g')
+   in_array "$host_mirror" "${cache_dirs[@]}" || 
cache_dirs+=("$host_mirror")
+   fi
+   done
 
[[ -n $pac_conf ]] && cp "$pac_conf" "$working_dir/etc/pacman.conf"
[[ -n $makepkg_conf ]] && cp "$makepkg_conf" 
"$working_dir/etc/makepkg.conf"
-- 
2.24.0

[arch-projects] [devtools] [PATCH 3/4] use libmakepkg to find and use variables in makepkg.conf

2019-11-05 Thread Eli Schwartz via arch-projects

- drop homebrew function in makechrootpkg
- use better mock to find invoking user's $HOME
- make offload-build respect makepkg.conf to determine where to sync
  files, matching the behavior of makechrootpkg

Signed-off-by: Eli Schwartz 
---
 makechrootpkg.in | 34 ++
 offload-build|  9 -
 2 files changed, 14 insertions(+), 29 deletions(-)

diff --git a/makechrootpkg.in b/makechrootpkg.in
index f5a0e51..b3a1854 100644
--- a/makechrootpkg.in
+++ b/makechrootpkg.in
@@ -13,6 +13,8 @@
 m4_include(lib/common.sh)
 m4_include(lib/archroot.sh)
 
+source /usr/share/makepkg/util/config.sh
+
 shopt -s nullglob
 
 default_makepkg_args=(--syncdeps --noconfirm --log --holdver --skipinteg)
@@ -80,26 +82,6 @@ usage() {
 }
 
 # {{{ functions
-# Usage: load_vars $makepkg_conf
-# Globals:
-#  - SRCDEST
-#  - SRCPKGDEST
-#  - PKGDEST
-#  - LOGDEST
-#  - MAKEFLAGS
-#  - PACKAGER
-load_vars() {
-   local makepkg_conf="$1" var
-
-   [[ -f $makepkg_conf ]] || return 1
-
-   for var in {SRC,SRCPKG,PKG,LOG}DEST MAKEFLAGS PACKAGER; do
-   [[ -z ${!var:-} ]] && eval "$(source "$makepkg_conf"; printf 
"%s='%s'" "$var" "${!var}")"
-   done
-
-   return 0
-}
-
 # Usage: sync_chroot $chrootdir $copydir [$copy]
 sync_chroot() {
local chrootdir=$1
@@ -338,16 +320,12 @@ for arg in "${@:$OPTIND}"; do
esac
 done
 
-if [[ -n $SUDO_USER ]]; then
-   eval "USER_HOME=~$SUDO_USER"
-else
-   USER_HOME=$HOME
-fi
-
 umask 0022
 
-load_vars "${XDG_CONFIG_HOME:-$USER_HOME/.config}/pacman/makepkg.conf" || 
load_vars "$USER_HOME/.makepkg.conf"
-load_vars /etc/makepkg.conf
+ORIG_HOME=$HOME
+IFS=: read -r _ _ _ _ _ HOME _ < <(getent passwd "${SUDO_USER:-$USER}")
+load_makepkg_config
+HOME=$ORIG_HOME
 
 # Use PKGBUILD directory if these don't exist
 [[ -d $PKGDEST ]]|| PKGDEST=$PWD
diff --git a/offload-build b/offload-build
index 7a07b15..078796a 100755
--- a/offload-build
+++ b/offload-build
@@ -18,6 +18,8 @@
 #   along with this program.  If not, see .
 #
 
+source /usr/share/makepkg/util/config.sh
+
 
 # global defaults suitable for use by Arch staff
 repo=extra
@@ -105,4 +107,9 @@ mapfile -t files < <(
 makepkg --packagelist
 ')
 
-(( ${#files[@]} )) && printf '%s\n' '' '-> copying files...' && scp 
"${files[@]/#/$server:}" .
+
+if (( ${#files[@]} )); then
+printf '%s\n' '' '-> copying files...'
+load_makepkg_config
+scp "${files[@]/#/$server:}" "${PKGDEST:-${PWD}}/"
+fi
-- 
2.24.0

Re: [arch-projects] [devtools] [PATCH 4/4] Use colored diagnostics by default.

2019-11-05 Thread Eli Schwartz via arch-projects

On 11/5/19 6:38 PM, Eli Schwartz wrote:
> I like color and feel comfortable using `less -R` to view logs.
> 
> Signed-off-by: Eli Schwartz 
> ---
>  makepkg-x86_64.conf | 4 ++--
>  1 file changed, 2 insertions(+), 2 deletions(-)
> 
> diff --git a/makepkg-x86_64.conf b/makepkg-x86_64.conf
> index 137d412..7fc3611 100644
> --- a/makepkg-x86_64.conf
> +++ b/makepkg-x86_64.conf
> @@ -39,8 +39,8 @@ CHOST="x86_64-pc-linux-gnu"
>  
>  #-- Compiler and Linker Flags
>  CPPFLAGS="-D_FORTIFY_SOURCE=2"
> -CFLAGS="-march=x86-64 -mtune=generic -O2 -pipe -fno-plt"
> -CXXFLAGS="-march=x86-64 -mtune=generic -O2 -pipe -fno-plt"
> +CFLAGS="-march=x86-64 -mtune=generic -O2 -pipe -fno-plt 
> -fdiagnostics-color=always"
> +CXXFLAGS="-march=x86-64 -mtune=generic -O2 -pipe -fno-plt 
> -fdiagnostics-color=always"
>  LDFLAGS="-Wl,-O1,--sort-common,--as-needed,-z,relro,-z,now"
>  #-- Make Flags: change this for DistCC/SMP systems
>  #MAKEFLAGS="-j2"

Hmm, sent in the wrong four patches. :p

-- 
Eli Schwartz
Bug Wrangler and Trusted User



signature.asc
Description: OpenPGP digital signature

[arch-projects] [devtools] [PATCH 2/4] arch-nspawn: simplify cachedir/host_mirror parsing

2019-11-05 Thread Eli Schwartz via arch-projects

consolidate logic flows in the same area for parsing and building
arrays. Don't bother having a special function just to build the
mount_args array, since we now use the same handling for adding any
cachedir (including host mirrors) to the mount arguments, this becomes a
trivial for loop -- and it really did not need to be delayed until after
the sanity check, anyway.

Signed-off-by: Eli Schwartz 
---
 arch-nspawn.in | 36 +---
 1 file changed, 13 insertions(+), 23 deletions(-)

diff --git a/arch-nspawn.in b/arch-nspawn.in
index 90fe967..7aa6fd6 100644
--- a/arch-nspawn.in
+++ b/arch-nspawn.in
@@ -20,6 +20,7 @@ umask 0022
 working_dir=''
 
 files=()
+mount_args=()
 
 usage() {
echo "Usage: ${0##*/} [options] working-dir [systemd-nspawn arguments]"
@@ -65,6 +66,13 @@ fi
 # shellcheck disable=2016
 host_mirrors=($($pacconf_cmd --repo extra Server 2> /dev/null | sed -r 
's#(.*/)extra/os/.*#\1$repo/os/$arch#'))
 
+for host_mirror in "${host_mirrors[@]}"; do
+   if [[ $host_mirror == *file://* ]]; then
+   host_mirror=$(echo "$host_mirror" | sed -r 
's#file://(/.*)/\$repo/os/\$arch#\1#g')
+   in_array "$host_mirror" "${cache_dirs[@]}" || 
cache_dirs+=("$host_mirror")
+   fi
+done
+
 while read -r line; do
mapfile -t lines < <($pacconf_cmd --config 
"${pac_conf:-$working_dir/etc/pacman.conf}" \
--repo $line Server | sed -r 
's#(.*/)[^/]+/os/.+#\1$repo/os/$arch#')
@@ -78,35 +86,18 @@ while read -r line; do
fi
 done < <($pacconf_cmd --config "${pac_conf:-$working_dir/etc/pacman.conf}" 
--repo-list)
 
-# {{{ functions
-build_mount_args() {
-   declare -g mount_args=()
-
-   for host_mirror in "${host_mirrors[@]}"; do
-   if [[ $host_mirror == *file://* ]]; then
-   host_mirror_path=$(echo "$host_mirror" | sed -r 
's#file://(/.*)/\$repo/os/\$arch#\1#g')
-   mount_args+=("--bind-ro=${host_mirror_path//:/\\:}")
-   fi
-   done
-
-   mount_args+=("--bind=${cache_dirs[0]//:/\\:}")
+mount_args+=("--bind=${cache_dirs[0]//:/\\:}")
 
-   for cache_dir in "${cache_dirs[@]:1}"; do
-   mount_args+=("--bind-ro=${cache_dir//:/\\:}")
-   done
-}
+for cache_dir in "${cache_dirs[@]:1}"; do
+   mount_args+=("--bind-ro=${cache_dir//:/\\:}")
+done
 
+# {{{ functions
 copy_hostconf () {
unshare --fork --pid gpg --homedir "$working_dir"/etc/pacman.d/gnupg/ 
--no-permission-warning --quiet --batch --import --import-options 
import-local-sigs "$(pacman-conf GpgDir)"/pubring.gpg >/dev/null 2>&1
pacman-key --gpgdir "$working_dir"/etc/pacman.d/gnupg/ --import-trustdb 
"$(pacman-conf GpgDir)" >/dev/null 2>&1
 
printf 'Server = %s\n' "${host_mirrors[@]}" 
>"$working_dir/etc/pacman.d/mirrorlist"
-   for host_mirror in "${host_mirrors[@]}"; do
-   if [[ $host_mirror == *file://* ]]; then
-   host_mirror=$(echo "$host_mirror" | sed -r 
's#file://(/.*)/\$repo/os/\$arch#\1#g')
-   in_array "$host_mirror" "${cache_dirs[@]}" || 
cache_dirs+=("$host_mirror")
-   fi
-   done
 
[[ -n $pac_conf ]] && cp "$pac_conf" "$working_dir/etc/pacman.conf"
[[ -n $makepkg_conf ]] && cp "$makepkg_conf" 
"$working_dir/etc/makepkg.conf"
@@ -130,7 +121,6 @@ elif [[ $(cat "$working_dir/.arch-chroot") != 
"$CHROOT_VERSION" ]]; then
die "chroot '%s' is not at version %s. Please rebuild." "$working_dir" 
"$CHROOT_VERSION"
 fi
 
-build_mount_args
 copy_hostconf
 
 eval "$(grep -a '^CARCH=' "$working_dir/etc/makepkg.conf")"
-- 
2.24.0

[arch-projects] [devtools] [PATCH 1/4] arch-nspawn: simplify cachedir/host_mirror parsing

2019-11-05 Thread Eli Schwartz via arch-projects

consolidate logic flows in the same area for parsing and building
arrays. Don't bother having a special function just to build the
mount_args array, since we now use the same handling for adding any
cachedir (including host mirrors) to the mount arguments, this becomes a
trivial for loop -- and it really did not need to be delayed until after
the sanity check, anyway.

Signed-off-by: Eli Schwartz 
---
 arch-nspawn.in | 36 +---
 1 file changed, 13 insertions(+), 23 deletions(-)

diff --git a/arch-nspawn.in b/arch-nspawn.in
index 90fe967..7aa6fd6 100644
--- a/arch-nspawn.in
+++ b/arch-nspawn.in
@@ -20,6 +20,7 @@ umask 0022
 working_dir=''
 
 files=()
+mount_args=()
 
 usage() {
echo "Usage: ${0##*/} [options] working-dir [systemd-nspawn arguments]"
@@ -65,6 +66,13 @@ fi
 # shellcheck disable=2016
 host_mirrors=($($pacconf_cmd --repo extra Server 2> /dev/null | sed -r 
's#(.*/)extra/os/.*#\1$repo/os/$arch#'))
 
+for host_mirror in "${host_mirrors[@]}"; do
+   if [[ $host_mirror == *file://* ]]; then
+   host_mirror=$(echo "$host_mirror" | sed -r 
's#file://(/.*)/\$repo/os/\$arch#\1#g')
+   in_array "$host_mirror" "${cache_dirs[@]}" || 
cache_dirs+=("$host_mirror")
+   fi
+done
+
 while read -r line; do
mapfile -t lines < <($pacconf_cmd --config 
"${pac_conf:-$working_dir/etc/pacman.conf}" \
--repo $line Server | sed -r 
's#(.*/)[^/]+/os/.+#\1$repo/os/$arch#')
@@ -78,35 +86,18 @@ while read -r line; do
fi
 done < <($pacconf_cmd --config "${pac_conf:-$working_dir/etc/pacman.conf}" 
--repo-list)
 
-# {{{ functions
-build_mount_args() {
-   declare -g mount_args=()
-
-   for host_mirror in "${host_mirrors[@]}"; do
-   if [[ $host_mirror == *file://* ]]; then
-   host_mirror_path=$(echo "$host_mirror" | sed -r 
's#file://(/.*)/\$repo/os/\$arch#\1#g')
-   mount_args+=("--bind-ro=${host_mirror_path//:/\\:}")
-   fi
-   done
-
-   mount_args+=("--bind=${cache_dirs[0]//:/\\:}")
+mount_args+=("--bind=${cache_dirs[0]//:/\\:}")
 
-   for cache_dir in "${cache_dirs[@]:1}"; do
-   mount_args+=("--bind-ro=${cache_dir//:/\\:}")
-   done
-}
+for cache_dir in "${cache_dirs[@]:1}"; do
+   mount_args+=("--bind-ro=${cache_dir//:/\\:}")
+done
 
+# {{{ functions
 copy_hostconf () {
unshare --fork --pid gpg --homedir "$working_dir"/etc/pacman.d/gnupg/ 
--no-permission-warning --quiet --batch --import --import-options 
import-local-sigs "$(pacman-conf GpgDir)"/pubring.gpg >/dev/null 2>&1
pacman-key --gpgdir "$working_dir"/etc/pacman.d/gnupg/ --import-trustdb 
"$(pacman-conf GpgDir)" >/dev/null 2>&1
 
printf 'Server = %s\n' "${host_mirrors[@]}" 
>"$working_dir/etc/pacman.d/mirrorlist"
-   for host_mirror in "${host_mirrors[@]}"; do
-   if [[ $host_mirror == *file://* ]]; then
-   host_mirror=$(echo "$host_mirror" | sed -r 
's#file://(/.*)/\$repo/os/\$arch#\1#g')
-   in_array "$host_mirror" "${cache_dirs[@]}" || 
cache_dirs+=("$host_mirror")
-   fi
-   done
 
[[ -n $pac_conf ]] && cp "$pac_conf" "$working_dir/etc/pacman.conf"
[[ -n $makepkg_conf ]] && cp "$makepkg_conf" 
"$working_dir/etc/makepkg.conf"
@@ -130,7 +121,6 @@ elif [[ $(cat "$working_dir/.arch-chroot") != 
"$CHROOT_VERSION" ]]; then
die "chroot '%s' is not at version %s. Please rebuild." "$working_dir" 
"$CHROOT_VERSION"
 fi
 
-build_mount_args
 copy_hostconf
 
 eval "$(grep -a '^CARCH=' "$working_dir/etc/makepkg.conf")"
-- 
2.24.0

[arch-projects] [devtools] [PATCH 3/4] Makefile: sort program names

2019-11-05 Thread Eli Schwartz via arch-projects

Signed-off-by: Eli Schwartz 
---
 Makefile | 12 ++--
 1 file changed, 6 insertions(+), 6 deletions(-)

diff --git a/Makefile b/Makefile
index a8e44ee..0eb7a88 100644
--- a/Makefile
+++ b/Makefile
@@ -4,19 +4,19 @@ PREFIX = /usr/local
 MANDIR = $(PREFIX)/share/man
 
 IN_PROGS = \
-   checkpkg \
-   commitpkg \
archco \
+   arch-nspawn \
archrelease \
archbuild \
-   lddd \
+   checkpkg \
+   commitpkg \
+   crossrepomove\
finddeps \
-   rebuildpkgs \
find-libdeps \
-   crossrepomove\
-   arch-nspawn \
+   lddd \
mkarchroot \
makechrootpkg \
+   rebuildpkgs \
sogrep
 
 BINPROGS = \
-- 
2.24.0

[arch-projects] [devtools] [PATCH 4/4] Use colored diagnostics by default.

2019-11-05 Thread Eli Schwartz via arch-projects

I like color and feel comfortable using `less -R` to view logs.

Signed-off-by: Eli Schwartz 
---
 makepkg-x86_64.conf | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

diff --git a/makepkg-x86_64.conf b/makepkg-x86_64.conf
index 137d412..7fc3611 100644
--- a/makepkg-x86_64.conf
+++ b/makepkg-x86_64.conf
@@ -39,8 +39,8 @@ CHOST="x86_64-pc-linux-gnu"
 
 #-- Compiler and Linker Flags
 CPPFLAGS="-D_FORTIFY_SOURCE=2"
-CFLAGS="-march=x86-64 -mtune=generic -O2 -pipe -fno-plt"
-CXXFLAGS="-march=x86-64 -mtune=generic -O2 -pipe -fno-plt"
+CFLAGS="-march=x86-64 -mtune=generic -O2 -pipe -fno-plt 
-fdiagnostics-color=always"
+CXXFLAGS="-march=x86-64 -mtune=generic -O2 -pipe -fno-plt 
-fdiagnostics-color=always"
 LDFLAGS="-Wl,-O1,--sort-common,--as-needed,-z,relro,-z,now"
 #-- Make Flags: change this for DistCC/SMP systems
 #MAKEFLAGS="-j2"
-- 
2.24.0

[arch-projects] [devtools] [PATCH 2/4] use libmakepkg to find and use variables in makepkg.conf

2019-11-05 Thread Eli Schwartz via arch-projects

- drop homebrew function in makechrootpkg
- use better mock to find invoking user's $HOME
- make offload-build respect makepkg.conf to determine where to sync
  files, matching the behavior of makechrootpkg

Signed-off-by: Eli Schwartz 
---
 makechrootpkg.in | 34 ++
 offload-build|  9 -
 2 files changed, 14 insertions(+), 29 deletions(-)

diff --git a/makechrootpkg.in b/makechrootpkg.in
index f5a0e51..b3a1854 100644
--- a/makechrootpkg.in
+++ b/makechrootpkg.in
@@ -13,6 +13,8 @@
 m4_include(lib/common.sh)
 m4_include(lib/archroot.sh)
 
+source /usr/share/makepkg/util/config.sh
+
 shopt -s nullglob
 
 default_makepkg_args=(--syncdeps --noconfirm --log --holdver --skipinteg)
@@ -80,26 +82,6 @@ usage() {
 }
 
 # {{{ functions
-# Usage: load_vars $makepkg_conf
-# Globals:
-#  - SRCDEST
-#  - SRCPKGDEST
-#  - PKGDEST
-#  - LOGDEST
-#  - MAKEFLAGS
-#  - PACKAGER
-load_vars() {
-   local makepkg_conf="$1" var
-
-   [[ -f $makepkg_conf ]] || return 1
-
-   for var in {SRC,SRCPKG,PKG,LOG}DEST MAKEFLAGS PACKAGER; do
-   [[ -z ${!var:-} ]] && eval "$(source "$makepkg_conf"; printf 
"%s='%s'" "$var" "${!var}")"
-   done
-
-   return 0
-}
-
 # Usage: sync_chroot $chrootdir $copydir [$copy]
 sync_chroot() {
local chrootdir=$1
@@ -338,16 +320,12 @@ for arg in "${@:$OPTIND}"; do
esac
 done
 
-if [[ -n $SUDO_USER ]]; then
-   eval "USER_HOME=~$SUDO_USER"
-else
-   USER_HOME=$HOME
-fi
-
 umask 0022
 
-load_vars "${XDG_CONFIG_HOME:-$USER_HOME/.config}/pacman/makepkg.conf" || 
load_vars "$USER_HOME/.makepkg.conf"
-load_vars /etc/makepkg.conf
+ORIG_HOME=$HOME
+IFS=: read -r _ _ _ _ _ HOME _ < <(getent passwd "${SUDO_USER:-$USER}")
+load_makepkg_config
+HOME=$ORIG_HOME
 
 # Use PKGBUILD directory if these don't exist
 [[ -d $PKGDEST ]]|| PKGDEST=$PWD
diff --git a/offload-build b/offload-build
index 7a07b15..078796a 100755
--- a/offload-build
+++ b/offload-build
@@ -18,6 +18,8 @@
 #   along with this program.  If not, see .
 #
 
+source /usr/share/makepkg/util/config.sh
+
 
 # global defaults suitable for use by Arch staff
 repo=extra
@@ -105,4 +107,9 @@ mapfile -t files < <(
 makepkg --packagelist
 ')
 
-(( ${#files[@]} )) && printf '%s\n' '' '-> copying files...' && scp 
"${files[@]/#/$server:}" .
+
+if (( ${#files[@]} )); then
+printf '%s\n' '' '-> copying files...'
+load_makepkg_config
+scp "${files[@]/#/$server:}" "${PKGDEST:-${PWD}}/"
+fi
-- 
2.24.0

[arch-projects] [mkinitcpio] [GIT] The official mkinitcpio repository annotated tag v27 created. v27

2019-10-29 Thread Giancarlo Razzolini via arch-projects

This is an automated email from the git hooks/post-receive script. It was
generated because a ref change was pushed to the repository containing
the project "The official mkinitcpio repository".

The annotated tag, v27 has been created
at  b66c7ed4b655b9a4bf5d6d4ab1219cfe40562d95 (tag)
   tagging  7f81f51a5b813343fe55253f60a865e75f42be52 (commit)
  replaces  v26
 tagged by  Giancarlo Razzolini
on  Tue Oct 29 10:53:20 2019 -0300

- Log -
tag as v27
-BEGIN PGP SIGNATURE-

iQIzBAABCAAdFiEE7MrITBugimzI5j+78i+x14p3rqsFAl24RGYACgkQ8i+x14p3
rqtLKRAA1/4lyiJqOmCabbQ1RjiAmoKpn2jystcvcOuwA8oLBYCn9ClisnMJ/8hG
Y+cth2XXG6Af51BZ24aUMHKPoVG9h0bj/qJ8GP6OxIaLVQC46wYq8HqXeIIaeDkV
lntVWOY8qoT+2UAVrdgmnFrwAh1WfvHp8lkilrKb85whFozcUymzHLzXG6DdlFsJ
zZGfkpOJRha0O/HNthSpdCsCyBy1Cp9iccLU0fOz9UfhUxElAvI9DBmucxGm9bTL
cwAksbTW2VBFdD7VQJJIQ84IJUY54M3uqASKiFwICzr0j9k7wURcyLYc6zKmFORZ
IT7xB0jqO3nzhsYj/Syy3AcwXLIaKSpLnVpdpoVBoENTAUbnqPbtMi4JyghvB7Ia
4YqxKGlT+FqXbWoJkEaHeIYNOJtQtafcrBkGfuV5KsVc/cryB+YcV0O/GMfaYXWe
z7u+DhazMgbPXYok0CfmgHu+/1sPCLtTFz5ip5ZB4seOu7zlgJpOv4/c0fHLwITV
WYz8yGVT5GbV2NxltQC2Z4BNbu780BdSljRo01VTQvoXZanBzJkBrKarXNrp/ESo
vyjbEoCAP3Fj2F8C6HaJaPCNCIgQv37buxbh0sv7Ji9Scj1Nr/zueuz1L6XLCjDC
4mZfSv0zoXvddkaox6vTZwMGOxx9Nk9tv+Y/LgLvR1pJ4cX5sFU=
=Dn2J
-END PGP SIGNATURE-

Giancarlo Razzolini (19):
  Add a new mkinitcpio pacman hook
  Add a mkinitcpio pacman script
  Add the pacman hook and script files to the installation
  Add a preset to be used by the pacman hook to create presets on the fly
  Change the hook name and change the name of the script called by it
  Rework the script to create the preset and install the actual kernel to 
/boot
  Change the Makefile to reflect the change in the names of the hook and 
script
  Rename of the hook and script
  Changed the trigger to vmlinuz
  Rework of the script to cover all cases
  Change the script to abort on errors and quote the glob on compgen
  Change the install hook to trigger on usr/lib/initcpio/* instead of 
mkinitcpio* package
  Rework the install script a bit more
  Add a remove hook
  libalpm/hooks: Change the remove hook to PreTransaction and also match on 
mkinitcpio-git.
  Makefile: Add the remove hook and script to install
  libalpm/scripts: Add a remove script
  mkinitcpio-remove: Fix the script to use -e
  Merge branch 'alpm-hook'

---


hooks/post-receive
-- 
The official mkinitcpio repository

[arch-projects] [mkinitcpio] [GIT] The official mkinitcpio repository branch master updated. v26-19-g7f81f51

2019-10-29 Thread Giancarlo Razzolini via arch-projects

This is an automated email from the git hooks/post-receive script. It was
generated because a ref change was pushed to the repository containing
the project "The official mkinitcpio repository".

The branch, master has been updated
   via  7f81f51a5b813343fe55253f60a865e75f42be52 (commit)
   via  c0ae6a74f30a586c91fb4a4f2ad773f1c018d8b6 (commit)
   via  9b0dfc9fbed73c9a70fa9ad7aea58c3b4f47ad0c (commit)
   via  d5e3f26dcdf623099c4f0fe5cceb72f34cebdc49 (commit)
   via  b22d1f578396cae9adec0389bc470cf321ae139f (commit)
   via  f949879ce6de354e02e06daa81e9257fdab07699 (commit)
   via  9c1e0f3dd01151b79e9b557ea8510605616c1369 (commit)
   via  0791321ed88bc480b193889c26cf4c356f1c78f7 (commit)
   via  59bdecbf138936f1eb61c9616d7270d92a5deac5 (commit)
   via  dfa609a6ee5f75af1aa5f94d331aea60b6d076ca (commit)
   via  e631c842069efcd661a066e16a6b1aca3ed62817 (commit)
   via  6a68249f84ff72e7f38bc0b7edae55c861fdfb3c (commit)
   via  bccd41015aaa55d1e661c503e74a414c86290b61 (commit)
   via  dfcdcf483c1b27dbb9fb91bc53f745cedba709cb (commit)
   via  2adc98944dfe0c40da44b6a2d8877af68b1f2bbe (commit)
   via  ace8c6de2b01d7d7b23c5d6db88daeac80df9448 (commit)
   via  9347ed6bee0fdbb03847238ca60a21ce7a27c40e (commit)
   via  e8106a8e24588c1ba65f4c563d55a4275b0e4b70 (commit)
   via  b85056e0096172d01ff6ce5f7c14c3ca5664a939 (commit)
  from  9ae6b1f928ef11e277437740908871ab535b655d (commit)

Those revisions listed above that are new to this repository have
not appeared on any other notification email; so we list those
revisions in full, below.

- Log -
commit 7f81f51a5b813343fe55253f60a865e75f42be52
Merge: 9ae6b1f c0ae6a7
Author: Giancarlo Razzolini 
Date:   Tue Oct 29 10:40:58 2019 -0300

Merge branch 'alpm-hook'

commit c0ae6a74f30a586c91fb4a4f2ad773f1c018d8b6
Author: Giancarlo Razzolini 
Date:   Tue Oct 29 10:04:27 2019 -0300

mkinitcpio-remove: Fix the script to use -e

Changed the script to use -e for exiting in case of uncaught errors.

commit 9b0dfc9fbed73c9a70fa9ad7aea58c3b4f47ad0c
Author: Giancarlo Razzolini 
Date:   Tue Oct 29 09:52:45 2019 -0300

libalpm/scripts: Add a remove script

Add a remove script that cleans up kernels, images and presets upon kernel
removals. It also handles mkinitcpio removal, by cleaning up presets.

commit d5e3f26dcdf623099c4f0fe5cceb72f34cebdc49
Author: Giancarlo Razzolini 
Date:   Mon Oct 28 22:31:59 2019 -0300

Makefile: Add the remove hook and script to install

Add the remove hook and remove script as part of the installation.

commit b22d1f578396cae9adec0389bc470cf321ae139f
Author: Giancarlo Razzolini 
Date:   Mon Oct 28 22:30:10 2019 -0300

libalpm/hooks: Change the remove hook to PreTransaction and also match on 
mkinitcpio-git.

Since the hook actually needs to be able to match on a kernel pkgbase, it 
needs to be ran
PreTransaction and not Post. Also add an additional target on 
mkinitcpio-git, to aid development.

commit f949879ce6de354e02e06daa81e9257fdab07699
Author: Giancarlo Razzolini 
Date:   Mon Oct 14 23:28:04 2019 -0300

Add a remove hook

This hook triggers when a kernel is removed or when the mkinitcpio package 
itself is being
removed.

commit 9c1e0f3dd01151b79e9b557ea8510605616c1369
Author: Giancarlo Razzolini 
Date:   Thu Oct 10 18:40:23 2019 -0300

Rework the install script a bit more

Added comments to make the flow more understandable. We now actively bail 
when
we encounter a kernel with no pkgbase. Also, if the preset does not exist 
yet,
and there is a .pacsave, we move that instead of copying from the template. 
Move
the preset check alongside the check if all was passed and finally, check 
if the
args array is not empty, before trying to run mkinitcpio.

commit 0791321ed88bc480b193889c26cf4c356f1c78f7
Author: Giancarlo Razzolini 
Date:   Thu Oct 10 18:21:51 2019 -0300

Change the install hook to trigger on usr/lib/initcpio/* instead of 
mkinitcpio* package

Since not only mkinitcpio* packages touch /usr/lib/initcpio, switch the 
hook to triggering
on that.

commit 59bdecbf138936f1eb61c9616d7270d92a5deac5
Author: Giancarlo Razzolini 
Date:   Wed Oct 9 18:34:33 2019 -0300

Change the script to abort on errors and quote the glob on compgen

commit dfa609a6ee5f75af1aa5f94d331aea60b6d076ca
Author: Giancarlo Razzolini 
Date:   Wed Oct 9 17:08:59 2019 -0300

Rework of the script to cover all cases

The script did not work properly for the cases where more than one kernel 
was being
installed, or only when mkinitcpio without a kernel is installed. Now the 
script runs
properly on all cases.

commit e631c842069efcd661a066e16a6b1aca3ed62817
Author: Giancarlo Razzolini 
Date:   Wed Oct 9 17:07:01 2019 -0300

Changed the trigger to vmlinuz

All the kernels install the kernel

[arch-projects] [namcap][PATCH] Support additional compression methods

2019-10-23 Thread George Rawlinson via arch-projects

Adds support for the following compression methods introduced in pacman
5.2:

- zstd
- lz4
- lzip

Signed-off-by: George Rawlinson 
---
 namcap | 6 ++
 1 file changed, 6 insertions(+)

diff --git a/namcap b/namcap
index 5f9ae19..ea0bc94 100755
--- a/namcap
+++ b/namcap
@@ -18,6 +18,12 @@ for arg in "${@}"; do
lzo)cmd='lzop' ;;
lrz)cmd='lrzip'
extra_opts="-q -o -" ;;
+   lz4)cmd='lz4'
+   extra_opts="-q" ;;
+   lz) cmd='lzip'
+   extra_opts="-q" ;;
+   zst)cmd='zstd'
+   extra_opts="-q" ;;
*)  echo 'Unsupported compression'; exit 1;;
esac
 
-- 
2.23.0

Re: [arch-projects] [namcap][PATCH] add support for zstd compression

2019-10-23 Thread George Rawlinson via arch-projects

Looks like I used git format-patch, rather than git send-email. The
patch is incomplete, as 2 other compression methods were added in pacman
5.2 (lzip & lz4). I'll discard this patch, and send another with support
for all 3 compression methods.

Regards,
George Rawlinson

On 19-10-22 22:33, George Rawlinson via arch-projects wrote:
> This patch adds support to namcap for zstd compression, introduced in
> pacman 5.2.0.
> ---
>  namcap | 2 ++
>  1 file changed, 2 insertions(+)
> 
> diff --git a/namcap b/namcap
> index 5f9ae19..1c07280 100755
> --- a/namcap
> +++ b/namcap
> @@ -18,6 +18,8 @@ for arg in "${@}"; do
> lzo)cmd='lzop' ;;
> lrz)cmd='lrzip'
> extra_opts="-q -o -" ;;
> +   zst)cmd='zstd'
> +   extra_opts="-q" ;;
> *)  echo 'Unsupported compression'; exit 1;;
> esac
> 
> --
> 2.23.0




signature.asc
Description: PGP signature

[arch-projects] [dbscripts] [GIT] Official repo DB scripts annotated tag 20191022 created. 20191022

2019-10-22 Thread Eli Schwartz via arch-projects

This is an automated email from the git hooks/post-receive script. It was
generated because a ref change was pushed to the repository containing
the project "Official repo DB scripts".

The annotated tag, 20191022 has been created
at  ffca694fae377c6806ed2b194b38a78fcb071cc3 (tag)
   tagging  ffae053006b2ecd53b028e26252b5b58e1f85d43 (commit)
  replaces  20190713
 tagged by  Eli Schwartz
on  Tue Oct 22 21:04:19 2019 -0400

- Log -
The release which finally lets us meme about zstd.
-BEGIN PGP SIGNATURE-

iQJMBAABCgA2FiEEYEETBMCdNmKDQO7/zrFn77VyK9YFAl2vp2cYHGVzY2h3YXJ0
ekBhcmNobGludXgub3JnAAoJEM6xZ++1civW4ZYP/2caPMlNRI7l3fLa00jQUhBr
8ButYn5PTau0gzLTWN0m4JIRNKRk/u2sEoPDC6U0ScqgsrEbk0Z14WEgBnOWQtZY
lU1jvEqX1zpEMtItrQ5bru2pSYDPM9RfldJ38NbKvlBWDrhMUmYUNffPc0pmotbQ
WEOmSkc814IfjDN3b/NLhQGUIgrxyW7g4nh/afB+NLWR8J+vKmCXnVTXk7xtyC/h
2svQKEwR66ar6MB2UoxBJ2VgiGbGiGrPAaqmoRG3GrECyvlKtai4tIBbwZMQue+G
rXh4fGwXo/sgI51NKixxJ7lnoJEZnfPohI9LyIi7Q4QIeiwyt/Eb7phoGP2be9PI
kYuf/5YeOQYJdFvLNpOrI4N0QnKhcQ8baNTu7EKh7blVkSG3ZDhwYcUo8XbLslfJ
sQqds49rU6N0BjLNA5x3wpvJhCMXeIFJKyYlpnsfjCTvt/li3EJSo/THZoGtHXzS
dZfXoS0D+wbV3oSPyh2UVONxfZwQw15RaP5njXZhJQoUcp5zvv/AXeVnQ1c+2H7K
+HIyLC7tTpqJQYJgon00Wkv1zYb890nNwPOgNyvNyJobB6qmGnot8qR/Uw7t4OyU
XObzg90uz69lCIrqGfmdxmN8/gTzqjROu3HYL+d1o6NZmjI/yvS647CXhswMJDPl
Cpyl9aGO6Ng6Wa8un0B2
=9igQ
-END PGP SIGNATURE-

Eli Schwartz (2):
  db-update: performance optimization when checking if a buildinfo exists
  config: sync list of valid compression types from pacman 5.2

---


hooks/post-receive
-- 
Official repo DB scripts

[arch-projects] [dbscripts] [GIT] Official repo DB scripts branch master updated. 20191022

2019-10-22 Thread Eli Schwartz via arch-projects

This is an automated email from the git hooks/post-receive script. It was
generated because a ref change was pushed to the repository containing
the project "Official repo DB scripts".

The branch, master has been updated
   via  ffae053006b2ecd53b028e26252b5b58e1f85d43 (commit)
  from  60d036ead2565ea19e1c09f8b263cfe34918e2cf (commit)

Those revisions listed above that are new to this repository have
not appeared on any other notification email; so we list those
revisions in full, below.

- Log -
commit ffae053006b2ecd53b028e26252b5b58e1f85d43
Author: Eli Schwartz 
Date:   Tue Jan 29 13:21:34 2019 -0400

config: sync list of valid compression types from pacman 5.2

This adds support for zst, lz4, and lzip compressed packages.

---

Summary of changes:
 config | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)


hooks/post-receive
-- 
Official repo DB scripts

[arch-projects] [namcap][PATCH] add support for zstd compression

2019-10-22 Thread George Rawlinson via arch-projects

This patch adds support to namcap for zstd compression, introduced in
pacman 5.2.0.
---
 namcap | 2 ++
 1 file changed, 2 insertions(+)

diff --git a/namcap b/namcap
index 5f9ae19..1c07280 100755
--- a/namcap
+++ b/namcap
@@ -18,6 +18,8 @@ for arg in "${@}"; do
lzo)cmd='lzop' ;;
lrz)cmd='lrzip'
extra_opts="-q -o -" ;;
+   zst)cmd='zstd'
+   extra_opts="-q" ;;
*)  echo 'Unsupported compression'; exit 1;;
esac

--
2.23.0


signature.asc
Description: PGP signature

[arch-projects] [dbscripts] [GIT] Official repo DB scripts branch master updated. 20190713-1-g60d036e

2019-10-17 Thread Eli Schwartz via arch-projects

This is an automated email from the git hooks/post-receive script. It was
generated because a ref change was pushed to the repository containing
the project "Official repo DB scripts".

The branch, master has been updated
   via  60d036ead2565ea19e1c09f8b263cfe34918e2cf (commit)
  from  0706db69d48e8fa9423587f0d11727075b0d3d5f (commit)

Those revisions listed above that are new to this repository have
not appeared on any other notification email; so we list those
revisions in full, below.

- Log -
commit 60d036ead2565ea19e1c09f8b263cfe34918e2cf
Author: Eli Schwartz 
Date:   Thu Oct 17 18:34:24 2019 -0400

db-update: performance optimization when checking if a buildinfo exists

Use the --fast-read option to quit as soon as the file is first found. A
package file should never contain two of these anyway, but even if it
did, we simply want to know that one exists!

makepkg guarantees its internal .METADATA files are tar'ed up first, so
this should usually be quite rapidly found. For very large packages,
crawling the entire package file to check for a later entry overriding
the first one, is... pointless... and worst of all, slow.

This reflects the identical mode used for extracting the pkginfo file,
which was inconsistently implemented from the initial feature addition.

---

Summary of changes:
 db-functions | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)


hooks/post-receive
-- 
Official repo DB scripts

[arch-projects] [devtools] [GIT] The official devtools repository branch master updated. 20190912-13-g2edee89

2019-10-15 Thread Levente Polyak via arch-projects

This is an automated email from the git hooks/post-receive script. It was
generated because a ref change was pushed to the repository containing
the project "The official devtools repository".

The branch, master has been updated
   via  2edee89b629f73c8437368b37efbcafd90429728 (commit)
  from  901581936a9b2cb60bb0ab00944fb14d65bf3732 (commit)

Those revisions listed above that are new to this repository have
not appeared on any other notification email; so we list those
revisions in full, below.

- Log -
commit 2edee89b629f73c8437368b37efbcafd90429728
Author: Levente Polyak 
Date:   Wed Oct 16 00:52:33 2019 +0200

Version 20191016

---

Summary of changes:
 Makefile | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)


hooks/post-receive
-- 
The official devtools repository

[arch-projects] [devtools] [GIT] The official devtools repository annotated tag 20191016 created. 20191016

2019-10-15 Thread Levente Polyak via arch-projects

This is an automated email from the git hooks/post-receive script. It was
generated because a ref change was pushed to the repository containing
the project "The official devtools repository".

The annotated tag, 20191016 has been created
at  f83beacc5ff30a0d207686acb23c98e80271b1cf (tag)
   tagging  2edee89b629f73c8437368b37efbcafd90429728 (commit)
  replaces  20190912
 tagged by  Levente Polyak
on  Wed Oct 16 00:52:37 2019 +0200

- Log -
Version 20191016
-BEGIN PGP SIGNATURE-

iQIzBAABCgAdFiEE4kC1fixGMLp2ji8m/BtUfI2BcsgFAl2mTbUACgkQ/BtUfI2B
csibFQ/+Owk6yToU/ORDhuaWS3CQxtO1EV0LoT3oGuzo2BBR8HuagL9+sMbjr37Y
cflnQxgR7AoXmLE8AbJcs6t2CivwXlMGWsjwDbiMq3ngvkEXj0iy35JipH/zTM+7
m+mMwnDGm2i7yrFRBmEQeGWu3fl784MGyksKCOq2CF9gOrL9bDmnVAOK+RmLhO0O
ZpnCPX8jKlgl4ZIbBAosE1HfOK7ES6EBexKpMJDm7tZm1AQojSg4vcxyDigHb+7A
gYpbbYaeFtwX48GgNctyWSOIgYyjQiWct5O3g8GqTo9S/9oEDqAjEASF1bl9nmyr
/fPkMQ9GhIZ8SOwt2OS1fHZdjqst6SEVRwIBjfkuwv3d8GKUxkRu9/qxPrzd/M63
t4kM3ivHXeqn3NbLGOT84CdIlI9b8T4Wj1swsomQLNFzwCdsLAt3A91zCEaaqqpn
TM4e5WbExhZeAY0xvSo+cOfyEHRf2C1Wchi/Xoy+S804I1w91gyllevSl5mSARV2
VVU0DxMe5LKt6TqOCPtr+zMfpAHTEUoekHKvibT3f7LUok2VBvp10KLUgk3IkNIv
zBj8fwbL3eWhz6B7L7czK+8POfvI98D98QAmNBew3sxFNhzNgE2+lnggA+mgEXT4
c28ovVK9tPTg7FEHabFeogaLAqr2YI97tSlEq7v4CmBVIuc3CYs=
=XOV3
-END PGP SIGNATURE-

Levente Polyak (12):
  makechrootpkg: run checkpkg automatically after build
  checkpkg: add option to avoid keeping the tmp dir
  checkpkg: add option to print a warning in case of differences
  zsh_completion: overhaul all completions to match actual options
  make: add target to tag a new version
  commitpkg: fix wrongly ordered find_cached_package call
  commitpkg: disallow if PKGBUILD hash mismatches package's enclosed hash
  commitpkg: prefer explicit signature+data parameters for gpg --verify
  zsh_completion: add sogrep completions
  zsh_completion: add offload-build completion
  ci: fix travis build using undocumented but reserved keyword
  Version 20191016

jelle van der Waa (1):
  sogrep: redirect to destination mirror (#25)

---


hooks/post-receive
-- 
The official devtools repository

[arch-projects] [devtools] [GIT] The official devtools repository branch master updated. 20190912-12-g9015819

2019-10-15 Thread Levente Polyak via arch-projects

This is an automated email from the git hooks/post-receive script. It was
generated because a ref change was pushed to the repository containing
the project "The official devtools repository".

The branch, master has been updated
   via  901581936a9b2cb60bb0ab00944fb14d65bf3732 (commit)
  from  29c6fa85373324c027c4ca3965707422187881d6 (commit)

Those revisions listed above that are new to this repository have
not appeared on any other notification email; so we list those
revisions in full, below.

- Log -
commit 901581936a9b2cb60bb0ab00944fb14d65bf3732
Author: Levente Polyak 
Date:   Tue Oct 15 23:43:05 2019 +0200

ci: fix travis build using undocumented but reserved keyword

https://github.com/mikkeloscar/arch-travis/issues/65

---

Summary of changes:
 .travis.yml | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)


hooks/post-receive
-- 
The official devtools repository

[arch-projects] [devtools] [GIT] The official devtools repository branch master updated. 20190912-11-g29c6fa8

2019-10-15 Thread Levente Polyak via arch-projects

This is an automated email from the git hooks/post-receive script. It was
generated because a ref change was pushed to the repository containing
the project "The official devtools repository".

The branch, master has been updated
   via  29c6fa85373324c027c4ca3965707422187881d6 (commit)
  from  74f65db396038caafcba20e4302fba080d8cc100 (commit)

Those revisions listed above that are new to this repository have
not appeared on any other notification email; so we list those
revisions in full, below.

- Log -
commit 29c6fa85373324c027c4ca3965707422187881d6
Author: jelle van der Waa 
Date:   Tue Oct 15 23:17:00 2019 +0200

sogrep: redirect to destination mirror (#25)

Some mirrors redirect consumers to a near by mirror which isn't handled
by sogrep.

---

Summary of changes:
 sogrep.in | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)


hooks/post-receive
-- 
The official devtools repository

[arch-projects] [devtools] [GIT] The official devtools repository branch sogrep_redirect created. 20190912-11-g7f849ea

2019-10-15 Thread Jelle van der Waa via arch-projects

This is an automated email from the git hooks/post-receive script. It was
generated because a ref change was pushed to the repository containing
the project "The official devtools repository".

The branch, sogrep_redirect has been created
at  7f849ea58d6a46631017b928285ebf3ff4ce6c69 (commit)

- Log -
commit 7f849ea58d6a46631017b928285ebf3ff4ce6c69
Author: Jelle van der Waa 
Date:   Tue Oct 15 21:43:20 2019 +0200

sogrep: redirect to destination mirror

Some mirrors redirect consumers to a near by mirror which isn't handled
by sogrep.

---


hooks/post-receive
-- 
The official devtools repository

WARN: project from a retired committee but PMC not changed to Attic in https://svn.apache.org/repos/asf/falcon/trunk/falcon.rdf

2019-10-13 Thread Projects

WARN: project from a retired committee but PMC not changed to Attic in https://raw.githubusercontent.com/apache/apex-site/master/doap_Apex.rdf

2019-10-13 Thread Projects

WARN: project in Attic but not in 'retired' category: https://raw.githubusercontent.com/apache/apex-site/master/doap_Apex.rdf

2019-10-13 Thread Projects

< 1 2 3 4 5 6 7 8 9 10 >

301 - 400 of 1376 matches

Mail list logo