Re: [mkgmap-dev] max-jobs patch

2018-02-10 Thread Bernd Weigelt
Hi tested on my linux box, looks good Heap is 4.4 GB with 8 threads. With the unpatched version i'm using -Xmx8G for the heap Bernd Am Donnerstag, 8. Februar 2018, 15:34:23 CET schrieb Gerd Petermann: > binary is here: > http://files.mkgmap.org.uk/download/415/mkgmap.jar > > For those users

Re: [mkgmap-dev] max-jobs patch

2018-02-10 Thread Gerd Petermann
Hi Bernd, okay, I think that confirms my estimate of ~500M per thread. See also my previous answer to Henning. Gerd Von: mkgmap-dev im Auftrag von Bernd Weigelt Gesendet: Samstag, 10. Februar 2018 09:43 An: Development list for mkgmap Betreff: Re: [mkg

[mkgmap-dev] WG: AW: max-jobs patch

2018-02-10 Thread Gerd Petermann
Sorry, answered to Henning instead of the list, see below... Gerd Von: Gerd Petermann Gesendet: Samstag, 10. Februar 2018 09:52 An: Henning Scholland Betreff: AW: AW: [mkgmap-dev] max-jobs patch Hi Henning, splitter uses multiple threads by default, but

Re: [mkgmap-dev] max-jobs patch

2018-02-10 Thread Bernd Weigelt
Hi Gerd the unpatched version uses up to 8.7 GB with the options for mkgmap I'm using maxnodes=512000 to create an area.list and use this file for every build. At the moment i see no problem with the patched version Bernd Am Samstag, 10. Februar 2018, 09:56:41 CET schrieb Gerd Petermann:

Re: [mkgmap-dev] max-jobs patch

2018-02-10 Thread Gerd Petermann
Hi Bernd, not sure what you want to express here. When you use --max-jobs or max-jobs=8 with the unpatched version you should see exactly the same numbers on an 8 core machine, the patch only changes the default for max-jobs. Gerd Von: mkgmap-dev im Auf

Re: [mkgmap-dev] max-jobs patch

2018-02-10 Thread Mike Baggaley
Hi Gerd, I have put together the attached patch that should result in a reasonable value for max-jobs if it is defaulted. This version attempts to calculate a suitable value by processing one task, seeing how much memory it used, then dividing the available memory by the memory used to determine th

Re: [mkgmap-dev] max-jobs patch

2018-02-10 Thread Henning Scholland
Hi Gerd, these are my runtimes of several compilations of my Turkey map, splitted with 1.500.000 nodes, compiled witout index, gmapi and gmappsupp, but including DEM and routing etc. RAM in GB    Threads     Time1 in ms    Time2 in ms 12                    8                328106            3236

Re: [mkgmap-dev] max-jobs patch

2018-02-10 Thread Gerd Petermann
Hi Mike, I've compiled r4107 with your patch: http://files.mkgmap.org.uk/download/418/mkgmap.jar I did not yet try it because I am still fighting with the crash in MapSource. I am not sure if the usage of classes like com.sun.management.OperatingSystemMXBean are supported with openjdk? Will this