Re: [mkgmap-dev] Memory Consumption on Index Creation

2011-09-24 Thread Steve Ratcliffe
Hi Felix However could you change mkgmap to delete broken mdr files if it crashes on low memory?? That would be a real troublesaver I've implemented this idea on the index-memory branch. The mdr file is not written unless the process completes successfully, so you should never see a

Re: [mkgmap-dev] Memory Consumption on Index Creation

2011-09-07 Thread Felix Hartmann
Hi steve, Okay strange, tonight it went through without problems (255M reserved when starting). Maybe something else was wrong then... However could you change mkgmap to delete broken mdr files if it crashes on low memory?? That would be a real troublesaver I don't know how to find out

Re: [mkgmap-dev] Memory Consumption on Index Creation

2011-09-07 Thread Steve Ratcliffe
OK. 255 sounds a bit high but shouldn't be a problem all the same. You may have noticed that I've started a index-memory branch. Currently this does little more than print out memory use at various point during the process. It would be useful to run it, particularly if it fails again. ..Steve

Re: [mkgmap-dev] Memory Consumption on Index Creation

2011-09-06 Thread Steve Ratcliffe
On 06/09/11 00:17, Felix Hartmann wrote: could it be that the index starts to be worked one, when the first of the 4 worker threads (to compile the maps) is finished, with 3 still working and hence overshooting the memory limit?? I really cannot see why it would have failed me 4 times in a row

Re: [mkgmap-dev] Memory Consumption on Index Creation

2011-09-05 Thread Felix Hartmann
On 30.08.2011 17:23, Steve Ratcliffe wrote: On 29/08/11 08:31, Felix Hartmann wrote: 1. I noticed that (at least for my style-file) 7500MB of RAM available does not suffice to compile a map of Europe including index! However if I recreate the index in another go, then it is no problem. How

Re: [mkgmap-dev] Memory Consumption on Index Creation

2011-08-30 Thread Steve Ratcliffe
On 29/08/11 08:31, Felix Hartmann wrote: 1. I noticed that (at least for my style-file) 7500MB of RAM available does not suffice to compile a map of Europe including index! However if I recreate the index in another go, then it is no problem. How comes? The index creation seems to be

Re: [mkgmap-dev] Memory Consumption on Index Creation

2011-08-30 Thread Steve Ratcliffe
Hi One tip to reduce the memory use when using 64-bit java with a heap size less than 32G is to use the -XX:+UseCompressedOops option. This is a java option so put it along with the -Xmx option. I've still had no luck reproducing the problem you are seeing. ..Steve

[mkgmap-dev] Memory Consumption on Index Creation

2011-08-29 Thread Felix Hartmann
1. I noticed that (at least for my style-file) 7500MB of RAM available does not suffice to compile a map of Europe including index! However if I recreate the index in another go, then it is no problem. How comes? The index creation seems to be completly independent of the maptiles creation. Is

Re: [mkgmap-dev] Memory Consumption on Index Creation

2011-08-29 Thread WanMil
1. I noticed that (at least for my style-file) 7500MB of RAM available does not suffice to compile a map of Europe including index! However if I recreate the index in another go, then it is no problem. How comes? The index creation seems to be completly independent of the maptiles creation.

Re: [mkgmap-dev] Memory Consumption on Index Creation

2011-08-29 Thread Felix Hartmann
On 29.08.2011 20:52, WanMil wrote: 1. I noticed that (at least for my style-file) 7500MB of RAM available does not suffice to compile a map of Europe including index! However if I recreate the index in another go, then it is no problem. How comes? The index creation seems to be completly