Hi Raphaël, please use the API v3 (described at https://forgeapi.puppetlabs.com/) to programmatically access the forge. Using the pagination parameters (offset and limit) allows much faster and safer traversing of the results. With the increasing number of modules on the forge, I'm not sure we'll be able to keep the generated all-in-one JSON around for much longer.
Cheers, David On Wed, Oct 11, 2017 at 2:11 PM Raphaël Hoareau <rap.hoar...@gmail.com> wrote: > Hi all, > > I'm trying to synchronize the Forge repository (https://forge.puppet.com) > into my Katello install but it fail with connection errors (it was working > a few weeks ago). > When trying to download https://forge.puppet.com/modules.json, a simple > curl/wget tries multiple times before getting the file (and Katello simply > fails). > > [rhoareau@glados ~]$ wget -S https://forge.puppet.com/modules.json > --2017-10-11 10:45:00-- https://forge.puppet.com/modules.json > Résolution de forge.puppet.com (forge.puppet.com)… 52.10.130.237 > Connexion à forge.puppet.com (forge.puppet.com)|52.10.130.237|:443… > connecté. > requête HTTP transmise, en attente de la réponse… > HTTP/1.0 504 Gateway Time-out > Cache-Control: no-cache > Connection: close > Content-Type: text/html > Nouvel essai. > > --2017-10-11 10:46:32-- (essai : 2) https://forge.puppet.com/modules.json > Connexion à forge.puppet.com (forge.puppet.com)|52.10.130.237|:443… > connecté. > requête HTTP transmise, en attente de la réponse… > HTTP/1.0 504 Gateway Time-out > Cache-Control: no-cache > Connection: close > Content-Type: text/html > Nouvel essai. > > --2017-10-11 10:48:05-- (essai : 3) https://forge.puppet.com/modules.json > Connexion à forge.puppet.com (forge.puppet.com)|52.10.130.237|:443… > connecté. > requête HTTP transmise, en attente de la réponse… > HTTP/1.1 504 Gateway Time-out > Server: nginx > Date: Wed, 11 Oct 2017 08:49:36 GMT > Content-Type: text/html > Content-Length: 176 > X-App-Server: forge/ > forge-i-437e8aec_forgenext-app04-prod.ops.puppetlabs.net > X-Lb-Server: forgenext-lb02-prod.ops.puppetl > X-UUID: 25AB0F9B:F43F_0AE00633:01BB_59DDDAC6_EF89F2B:01F1 > Nouvel essai. > > --2017-10-11 10:49:39-- (essai : 4) https://forge.puppet.com/modules.json > Réutilisation de la connexion existante à forge.puppet.com:443. > requête HTTP transmise, en attente de la réponse… > Taille : non indiqué > Sauvegarde en : « modules.json.1 » > > modules.json.1 [ <=> ] 1,67M --.-KB/s ds 68s > > 2017-10-11 10:50:48 (25,0 KB/s) - « modules.json.1 » sauvegardé [1749112] > > Any information on that ? > > Raphaël. > > -- > You received this message because you are subscribed to the Google Groups > "Puppet Users" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to puppet-users+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/puppet-users/8b5540ef-5110-40d5-80d7-639006084e2c%40googlegroups.com > <https://groups.google.com/d/msgid/puppet-users/8b5540ef-5110-40d5-80d7-639006084e2c%40googlegroups.com?utm_medium=email&utm_source=footer> > . > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-users/CALF7fHYknEN8b_EYaTpYiFSPp5AsH7vk4sQCfBEVUe%3D35Q5Eag%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
