Re: Disarchive update

Hey, On Thu, 21 Oct 2021 at 21:41, Ludovic Courtès wrote: > Really cool of the SWH folks to give you a higher rate limit. It is not to me particularly. :-) Anyone can create an account via Software Heritage Authentication service. Then anyone

Re: Disarchive update

Hi! Ludovic Courtès skribis: > Then there’s the mcron job that runs it once a day on berlin: > > > https://git.savannah.gnu.org/cgit/guix/maintenance.git/commit/?id=27dc74fbe33a9d929b37994e825dc202385f87c0 > > We could run it as well on bayfront so we have a backup. I did that without thinki

Re: Disarchive update

Hi, zimoun skribis: > Using, the Authentication mode from SWH [1] and this trivial patch, the > rate limit is at 1200 which allows to check and archive some packages. > For instance, now, > > for p in $(guix package -A | cut -f1 | grep "julia-"); > do >./pre-inst-env guix lint -c archival $p

Re: Disarchive update

Hi, On Thu, 14 Oct 2021 at 16:31, Ludovic Courtès wrote: >> 4. Add disarchive.guix.gnu.org to (guix download). > > Done: [...] > I think we’re making progress! :-) I added the SWH authentication token in patch#51216 [1]. Using a valid TOKEN from an account of the Software Heritage Authent

Re: Disarchive update

Hi, On Thu, 14 Oct 2021 at 16:02, Ludovic Courtès wrote: >> Going this road (use Cuirass), why not generating the sources.json >> similarly? Instead of the hack using the website builder. > > I guess that would also work, indeed. Then we could make /source.json > redirect to ci.guix.gnu.org/w

Re: Disarchive update

Hello Guix! Ludovic Courtès skribis: > This job is disassembling all the .tar.gz files packages refer to, using > the recently-added ‘etc/disarchive-manifest.scm’ file: > > https://ci.guix.gnu.org/jobset/disarchive [...] > A plan we can already deploy would be: > > 1. Add the disarchive.gu

Re: Disarchive update

Hi, Mathieu Othacehe skribis: > I think the easier way to proceed would be to create the "disarchive" > specification in the (maintenance sysadmin services) module, this way: > > (specification > (name "disarchive") > (build '(manifests "etc/disarchive-manifest.scm")) > (build-outputs > (li

Re: Disarchive update

Hey Timothy! Timothy Sample skribis: > Fantastic! I feel bad that I left you holding the bag on this one, > though. Sorry. I’ve been a little adrift this summer. Thanks for > picking it up! No problem, I’m glad to see you chime in now! :-) > One simple but satisfying thing that I do is se

Re: Disarchive update

Hey! zimoun skribis: > Timothy made this table months ago: > > tar+gz9090 52.0% > git 5294 30.3% > tar+xz1184 06.8% > tar+bz2775 04.4% > tar393 02.2% > zip273 01.6% > svn-multi

Re: Disarchive update

Hi Ludovic, Ludovic Courtès writes: > This job is disassembling all the .tar.gz files packages refer to, using > the recently-added ‘etc/disarchive-manifest.scm’ file: > > https://ci.guix.gnu.org/jobset/disarchive > > It has just succeeded for the first time. :-) Fantastic! I feel bad that

Re: Disarchive update

Hi Ludo, On Sat, 09 Oct 2021 at 12:05, Ludovic Courtès wrote: > If you run: > > guix build > /gnu/store/nnl67m8c2x9rwqbnych1agc6p7g5473g-disarchive-collection.drv Oh, cool! > and if you’re patient :-), you eventually get a 579 MB directory > containing Disarchive metadata for 8,413 tarballs

Re: Disarchive update

Hey, > That’d be nice! How do we do that again? The build-outputs field of the record must be used as explained here: https://guix.gnu.org/cuirass/manual/html_node/Specifications.html#Specifications. This field cannot be manipulated via the web interface yet. I think the easier way to proce

Re: Disarchive update

Hi! Mathieu Othacehe skribis: >> https://ci.guix.gnu.org/eval/29213?status=succeeded > > Nice! It looks like an expensive operation, maybe we should increase its > period to 24 hours or so? Yes, I’ve made it 12 hours now. :-) It shouldn’t be too expensive: there’s one derivation per tarball

Re: Disarchive update

Hey Ludo, > https://ci.guix.gnu.org/eval/29213?status=succeeded Nice! It looks like an expensive operation, maybe we should increase its period to 24 hours or so? > 2. On berlin, add an mcron job that periodically copies the output of > the latest “disarchive-collection” build to a di

Disarchive update

Hello Guix! This job is disassembling all the .tar.gz files packages refer to, using the recently-added ‘etc/disarchive-manifest.scm’ file: https://ci.guix.gnu.org/jobset/disarchive It has just succeeded for the first time. :-) https://ci.guix.gnu.org/eval/29213?status=succeeded If you ru