Efficent batch fetching with verification?

2017-11-02 Thread Robin H. Johnson
What's a reasonably efficient way to fetch a lot of keys, by fingerprint, from keyserver pools with HKPS? Presently, the code is effectively this: ...cat-list-of-fingerprints... | xargs gpg --recv This has the downside of causing many execs. As an alternate, it was suggested that I could do manu

Re: Efficent batch fetching with verification?

2017-11-03 Thread Peter Lebbing
On 03/11/17 06:20, Robin H. Johnson wrote: > Presently, the code is effectively this: > ...cat-list-of-fingerprints... | xargs gpg --recv > > This has the downside of causing many exec I just tried this and a list of 1319 fingerprints caused one single call to "gpg --recv FPR1 FPR2 FPR3 ... FPR131

Re: Efficent batch fetching with verification?

2017-11-03 Thread Werner Koch
On Fri, 3 Nov 2017 06:20, robb...@gentoo.org said: > Presently, the code is effectively this: > ...cat-list-of-fingerprints... | xargs gpg --recv > > This has the downside of causing many execs. Right after a clean startup of your user session you will see these execs: 1. xargs execs gpg 2.

Re: Efficent batch fetching with verification?

2017-11-03 Thread Robin H. Johnson
On Fri, Nov 03, 2017 at 12:50:06PM +0100, Peter Lebbing wrote: > On 03/11/17 06:20, Robin H. Johnson wrote: > > Presently, the code is effectively this: > > ...cat-list-of-fingerprints... | xargs gpg --recv > > > > This has the downside of causing many exec ... > Anyway, I didn't look any further,

Re: Efficent batch fetching with verification?

2017-11-03 Thread Robin H. Johnson
On Fri, Nov 03, 2017 at 08:17:38PM +0100, Werner Koch wrote: > On Fri, 3 Nov 2017 06:20, robb...@gentoo.org said: > > > Presently, the code is effectively this: > > ...cat-list-of-fingerprints... | xargs gpg --recv > > > > This has the downside of causing many execs. > > Right after a clean star

Re: Efficent batch fetching with verification?

2017-11-04 Thread Peter Lebbing
On 03/11/17 21:06, Robin H. Johnson wrote: > You missed xargs itself, Actually, I did not :-). > this mostly centers around the command-line > length limit. I can get in about ~3200 fingerprints per GPG call. I asked "what is exec'ing much". I don't see one exec every 3200 fingerprints as overhe

Re: Efficent batch fetching with verification?

2017-11-04 Thread Werner Koch
On Sat, 4 Nov 2017 06:06, robb...@gentoo.org said: > Yes, the older versions do perform much worse, but even with gnupg2.2, > each exec of gpg is still at least 100ms, which adds up over time. I doubt that, let's see: $ time sh -c 'seq 1 1 | xargs -n 1 gpg --version >/dev/null' real0