Re: [mkgmap-dev] MDR building out-of-memory

2021-05-12 Thread Gerd Petermann
: [mkgmap-dev] MDR building out-of-memory Hi Gerd I did a bit more experimenting with LargeListSorter and Mdr7/11 and have some changes - patch attached. 1/ explicit param to LargeListSorted to useCache 2/ do nothing if 0 or 1 records to sort 3/ reduce chunkSize to reduce memory usage, increase

Re: [mkgmap-dev] MDR building out-of-memory

2021-05-12 Thread Ticker Berkin
t; Ticker Berkin > Gesendet: Mittwoch, 12. Mai 2021 10:48 > An: Development list for mkgmap > Betreff: Re: [mkgmap-dev] MDR building out-of-memory > > Hi Gerd > > Certainly no cache. Maybe reduce the chunk size, but this might > increase copying. > > It could be impr

Re: [mkgmap-dev] MDR building out-of-memory

2021-05-12 Thread Gerd Petermann
pment list for mkgmap Betreff: Re: [mkgmap-dev] MDR building out-of-memory Hi Gerd Certainly no cache. Maybe reduce the chunk size, but this might increase copying. It could be improved by doing a linear chunk split/sort then a multi -way merge. This would avoid lots of copying assuming the

Re: [mkgmap-dev] MDR building out-of-memory

2021-05-12 Thread Ticker Berkin
n: mkgmap-dev im Auftrag > von Ticker Berkin > Gesendet: Dienstag, 11. Mai 2021 19:19 > An: Development list for mkgmap > Betreff: Re: [mkgmap-dev] MDR building out-of-memory > > Hi Gerd > > I've looked at this, and if Mdr5 space becomes a problem again, I'll >

Re: [mkgmap-dev] MDR building out-of-memory

2021-05-11 Thread Gerd Petermann
Von: mkgmap-dev im Auftrag von Ticker Berkin Gesendet: Dienstag, 11. Mai 2021 19:19 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] MDR building out-of-memory Hi Gerd I've looked at this, and if Mdr5 space becomes a problem again, I'll consider converting to it. A couple

Re: [mkgmap-dev] MDR building out-of-memory

2021-05-11 Thread Ticker Berkin
cker Berkin > Gesendet: Dienstag, 11. Mai 2021 13:27 > An: Development list for mkgmap > Betreff: Re: [mkgmap-dev] MDR building out-of-memory > > Hi Gerd > > Here is updated version of patch. > > Changes from last: > > Uses your cache code for region and country (i

Re: [mkgmap-dev] MDR building out-of-memory

2021-05-11 Thread Gerd Petermann
code which uses LargeListSorter. Gerd Von: mkgmap-dev im Auftrag von Ticker Berkin Gesendet: Dienstag, 11. Mai 2021 13:27 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] MDR building out-of-memory Hi Gerd Here is updated version of patch. Ch

Re: [mkgmap-dev] MDR building out-of-memory

2021-05-11 Thread Ticker Berkin
Hi Gerd Here is updated version of patch. Changes from last: Uses your cache code for region and country (in 2 places). For British Isles, there are 190 regions and 7 countries, so I don't think the extra memory will be a problem and there should be some performance benefit. Delays allocating c

Re: [mkgmap-dev] MDR building out-of-memory

2021-05-11 Thread Gerd Petermann
Hi Ticker, sorry, here's the patch. Gerd Von: mkgmap-dev im Auftrag von Ticker Berkin Gesendet: Dienstag, 11. Mai 2021 10:07 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] MDR building out-of-memory Hi Gerd allCities.trimToSize()

Re: [mkgmap-dev] MDR building out-of-memory

2021-05-11 Thread Ticker Berkin
> Gerd > > > Von: mkgmap-dev im Auftrag > von Ticker Berkin > Gesendet: Montag, 10. Mai 2021 23:05 > An: mkgmap development > Betreff: [mkgmap-dev] MDR building out-of-memory > > Hi Gerd > > Since downloading loadi

Re: [mkgmap-dev] MDR building out-of-memory

2021-05-11 Thread Gerd Petermann
ns of region+country, sort them, and use the position in that list to sort other objects? Gerd Von: mkgmap-dev im Auftrag von Ticker Berkin Gesendet: Montag, 10. Mai 2021 23:05 An: mkgmap development Betreff: [mkgmap-dev] MDR building out-of-memory Hi

[mkgmap-dev] MDR building out-of-memory

2021-05-10 Thread Ticker Berkin
Hi Gerd Since downloading loading britain-and-ireland-latest.osm.pbf I had been unable to build a gmapsupp because of running out of heap (my hardware is 32 bit, -Xmx1540M is largest value allowed) My problem is mainly because I have 1731146 cities (along with 1046096 streets) Looking at Mdr5 pr