Hi, I would caution against using -j auto too, on my machine with 16 cores and 32GB I had a couple of cases where Sphinx used all the memory and caused a swap storm while building the GeoServer docs... guess sphinx uses a ton of memory, and I already had a large chunk used by other apps.
Pretty much like with maven itself, we should limit it to 2 on the build server, and allow configuration on the dev machine... Cheers Andrea On Wed, Dec 11, 2019 at 4:53 PM Daniele Romagnoli < daniele.romagn...@geo-solutions.it> wrote: > Hi Jody, > my latest PR is still failing on travis. I had similar issue this summer > when updating the GeoServer doc build instructions. > > I see your doc fix contains add for "-j auto" parameter > The travis build is failing due to this: > [exec] Error: -j option argument must be an integer. > > Looking on the sphinx doc, I see this: > https://www.sphinx-doc.org/en/master/man/sphinx-build.html > > -j N > Distribute the build over N processes in parallel ..... > New in version 1.2: This option should be considered experimental. > Changed in version 1.7: Support *auto* argument. > > Checking travis build I see this: > Get:44 http://archive.ubuntu.com/ubuntu trusty-updates/main amd64 > sphinx-common all 1.2.2+dfsg-1ubuntu1.1 [392 kB] > Get:45 http://archive.ubuntu.com/ubuntu trusty-updates/main amd64 > python-sphinx all 1.2.2+dfsg-1ubuntu1.1 [271 kB] > > So I think that travis is using Sphinx 1.2.2 which doesn't support auto, > but an integer value instead. > Not sure if we can update Sphinx on travis or just use an integer value > for the -j option. I didn't spend other time on that for additional > investigation, yet > > Cheers, > Daniele > > > > On Wed, Dec 11, 2019 at 11:05 AM Jody Garnett <jody.garn...@gmail.com> > wrote: > >> It is fixed >> -- >> Jody Garnett >> >> >> On Wed, 11 Dec 2019 at 10:32, Jody Garnett <jody.garn...@gmail.com> >> wrote: >> >>> I am fixing now >>> -- >>> Jody Garnett >>> >>> >>> On Wed, 11 Dec 2019 at 10:30, Ian Turton <ijtur...@gmail.com> wrote: >>> >>>> Passed all the tests on Travis! Which was why I thought the docs used a >>>> different set of code. >>>> >>>> Ian >>>> >>>> On Wed, 11 Dec 2019, 09:04 Andrea Aime, <andrea.a...@geo-solutions.it> >>>> wrote: >>>> >>>>> Hi, >>>>> did the change go through a PR? The travis build should fail when docs >>>>> fail to build >>>>> >>>>> Cheers >>>>> Andrea >>>>> >>>>> >>>>> On Wed, Dec 11, 2019 at 10:01 AM Ian Turton <ijtur...@gmail.com> >>>>> wrote: >>>>> >>>>>> Sorry, I thought the docs were running off a separate copy of the >>>>>> code. >>>>>> >>>>>> Ian >>>>>> >>>>>> On Wed, 11 Dec 2019 at 08:23, Jody Garnett <jody.garn...@gmail.com> >>>>>> wrote: >>>>>> >>>>>>> Looks to be: >>>>>>> >>>>>>> [exec] Warning, treated as error: >>>>>>> [exec] >>>>>>> /tmp/jenkins-e86d80c8/workspace/geotools-master-docs/docs/user/tutorial/datastore/strategy.rst:142:start-after >>>>>>> pattern not found: import com.csvreader.CsvWriter; >>>>>>> >>>>>>> >>>>>>> I think Ian made some changes to CSV datastore (to use a supported >>>>>>> library) and misplaced some comments used by the docs to inline code). >>>>>>> >>>>>>> -- >>>>>>> Jody Garnett >>>>>>> >>>>>>> >>>>>>> On Wed, 11 Dec 2019 at 09:21, Jody Garnett <jody.garn...@gmail.com> >>>>>>> wrote: >>>>>>> >>>>>>>> Having a look, we should version control this script. >>>>>>>> -- >>>>>>>> Jody Garnett >>>>>>>> >>>>>>>> >>>>>>>> On Tue, 10 Dec 2019 at 15:27, Andrea Aime < >>>>>>>> andrea.a...@geo-solutions.it> wrote: >>>>>>>> >>>>>>>>> See: >>>>>>>>> >>>>>>>>> https://build.geoserver.org/job/geotools-master-docs/2622/consoleFull >>>>>>>>> >>>>>>>>> Looks like the build has been failing for a while, and it's likely >>>>>>>>> related to the build script >>>>>>>>> itself, as building the docs locally seems to work just fine. >>>>>>>>> Looking at the Jenkins configuration (has a bash script) the build >>>>>>>>> seems to be trying to >>>>>>>>> get into "target/web/html", which I have locally, but don't see in >>>>>>>>> the online working area: >>>>>>>>> >>>>>>>>> https://build.geoserver.org/job/geotools-master-docs/ws/docs/target/ >>>>>>>>> >>>>>>>>> Maybe this instruction chaining prevents it from seeing it's not >>>>>>>>> here? >>>>>>>>> cd docs && >>>>>>>>> mvn install && >>>>>>>>> cd target/web/html && >>>>>>>>> if [ -e web.zip ]; then >>>>>>>>> rm -rf web.zip >>>>>>>>> fi >>>>>>>>> >>>>>>>>> And then it fails trying to cd ../../target/use/html because it >>>>>>>>> did not get into target/web/html to start with? Unsure. Anyone has a >>>>>>>>> clue? >>>>>>>>> >>>>>>>>> Cheers >>>>>>>>> Andrea >>>>>>>>> >>>>>>>>> -- >>>>>>>>> >>>>>>>>> Regards, Andrea Aime == GeoServer Professional Services from the >>>>>>>>> experts! Visit http://goo.gl/it488V for more information. == Ing. >>>>>>>>> Andrea Aime @geowolf Technical Lead GeoSolutions S.A.S. Via di >>>>>>>>> Montramito >>>>>>>>> 3/A 55054 Massarosa (LU) phone: +39 0584 962313 fax: +39 0584 1660272 >>>>>>>>> mob: >>>>>>>>> +39 339 8844549 http://www.geo-solutions.it >>>>>>>>> http://twitter.com/geosolutions_it >>>>>>>>> ------------------------------------------------------- *Con >>>>>>>>> riferimento alla normativa sul trattamento dei dati personali (Reg. UE >>>>>>>>> 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si >>>>>>>>> precisa che ogni circostanza inerente alla presente email (il suo >>>>>>>>> contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è >>>>>>>>> riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il >>>>>>>>> messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra >>>>>>>>> operazione è illecita. Le sarei comunque grato se potesse darmene >>>>>>>>> notizia. >>>>>>>>> This email is intended only for the person or entity to which it is >>>>>>>>> addressed and may contain information that is privileged, >>>>>>>>> confidential or >>>>>>>>> otherwise protected from disclosure. We remind that - as provided by >>>>>>>>> European Regulation 2016/679 “GDPR” - copying, dissemination or use >>>>>>>>> of this >>>>>>>>> e-mail or the information herein by anyone other than the intended >>>>>>>>> recipient is prohibited. If you have received this email by mistake, >>>>>>>>> please >>>>>>>>> notify us immediately by telephone or e-mail.* >>>>>>>>> _______________________________________________ >>>>>>>>> GeoTools-Devel mailing list >>>>>>>>> GeoTools-Devel@lists.sourceforge.net >>>>>>>>> https://lists.sourceforge.net/lists/listinfo/geotools-devel >>>>>>>>> >>>>>>>> >>>>>> >>>>>> -- >>>>>> Ian Turton >>>>>> >>>>> >>>>> >>>>> -- >>>>> >>>>> Regards, Andrea Aime == GeoServer Professional Services from the >>>>> experts! Visit http://goo.gl/it488V for more information. == Ing. >>>>> Andrea Aime @geowolf Technical Lead GeoSolutions S.A.S. Via di Montramito >>>>> 3/A 55054 Massarosa (LU) phone: +39 0584 962313 fax: +39 0584 1660272 mob: >>>>> +39 339 8844549 http://www.geo-solutions.it >>>>> http://twitter.com/geosolutions_it >>>>> ------------------------------------------------------- *Con >>>>> riferimento alla normativa sul trattamento dei dati personali (Reg. UE >>>>> 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si >>>>> precisa che ogni circostanza inerente alla presente email (il suo >>>>> contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è >>>>> riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il >>>>> messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra >>>>> operazione è illecita. Le sarei comunque grato se potesse darmene notizia. >>>>> This email is intended only for the person or entity to which it is >>>>> addressed and may contain information that is privileged, confidential or >>>>> otherwise protected from disclosure. We remind that - as provided by >>>>> European Regulation 2016/679 “GDPR” - copying, dissemination or use of >>>>> this >>>>> e-mail or the information herein by anyone other than the intended >>>>> recipient is prohibited. If you have received this email by mistake, >>>>> please >>>>> notify us immediately by telephone or e-mail.* >>>>> >>>> _______________________________________________ >> GeoTools-Devel mailing list >> GeoTools-Devel@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/geotools-devel >> > > > -- > Regards, > Daniele Romagnoli > == > GeoServer Professional Services from the experts! Visit > http://goo.gl/it488V for more information. > == > > Ing. Daniele Romagnoli > Senior Software Engineer > > GeoSolutions S.A.S. > Via di Montramito 3/A > 55054 Massarosa (LU) > Italy > phone: +39 0584 962313 > fax: +39 0584 1660272 > > http://www.geo-solutions.it > http://twitter.com/geosolutions_it > > ------------------------------------------------------- > > Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE > 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si > precisa che ogni circostanza inerente alla presente email (il suo > contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è > riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il > messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra > operazione è illecita. Le sarei comunque grato se potesse darmene notizia. > > This email is intended only for the person or entity to which it is > addressed and may contain information that is privileged, confidential or > otherwise protected from disclosure. We remind that - as provided by > European Regulation 2016/679 “GDPR” - copying, dissemination or use of this > e-mail or the information herein by anyone other than the intended > recipient is prohibited. If you have received this email by mistake, please > notify us immediately by telephone or e-mail. > _______________________________________________ > GeoTools-Devel mailing list > GeoTools-Devel@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/geotools-devel > -- Regards, Andrea Aime == GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information. == Ing. Andrea Aime @geowolf Technical Lead GeoSolutions S.A.S. Via di Montramito 3/A 55054 Massarosa (LU) phone: +39 0584 962313 fax: +39 0584 1660272 mob: +39 339 8844549 http://www.geo-solutions.it http://twitter.com/geosolutions_it ------------------------------------------------------- *Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia. This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.*
_______________________________________________ GeoTools-Devel mailing list GeoTools-Devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/geotools-devel
