Re: [mkgmap-dev] Infinite loop splitter

2014-03-10 Thread Gerd Petermann
16:08:19 +0100 > Subject: Re: [mkgmap-dev] Infinite loop splitter > > Am Samstag, 8. März 2014, 23:49:18 schrieb GerdP: > > So, if you use osmconvert/osmfilter to update your files > > it is probably better to use a 64 bit Linux installation. > > BTW > Hmmh, i saw this er

Re: [mkgmap-dev] Infinite loop splitter

2014-03-10 Thread Bernd Weigelt
Am Samstag, 8. März 2014, 23:49:18 schrieb GerdP: > So, if you use osmconvert/osmfilter to update your files > it is probably better to use a 64 bit Linux installation. BTW Hmmh, i saw this error on a 64 bit linux system with 16 GiB RAM and i use osmupdate to update an extract from a local planet

Re: [mkgmap-dev] Infinite loop splitter

2014-03-09 Thread Gerd Petermann
Date: Sun, 9 Mar 2014 16:17:58 +0100 From: colin.sm...@xs4all.nl To: mkgmap-dev@lists.mkgmap.org.uk Subject: Re: [mkgmap-dev] Infinite loop splitter R320 certainly seems to have fixed it for me. If there is still a problem with osmconvert etc then the new splitter appears to cope with it so

Re: [mkgmap-dev] Infinite loop splitter

2014-03-09 Thread Colin Smale
R320 certainly seems to have fixed it for me. If there is still a problem with osmconvert etc then the new splitter appears to cope with it somehow. I will keep an eye on the maps coming out of mkgmap in case there any anomalies, but so far it's looking good. Thanks for the fix! Colin On 2

Re: [mkgmap-dev] Infinite loop splitter

2014-03-08 Thread GerdP
Hi all, I've contacted Markus Weber, the author of osmconvert and osmfilter. It seems that the problem with complex-ways occurs only in the Windows version, maybe because something goes wrong with files > 4GB. Markus doesn't have access to a Win64 system. I use a mingw-64 installation to compile m

Re: [mkgmap-dev] Infinite loop splitter

2014-03-08 Thread GerdP
Hi Minko, fine:-) I think the only good reason to use splitter with an input file like europe.o5m or planet.o5m in combination with a poly file that extracts a small part is that it is able to keep ferry lines complete. osmconvert --complete-ways --complex-ways -B=bnl_01.poly europe.o5m -o=benel

Re: [mkgmap-dev] Infinite loop splitter

2014-03-08 Thread Minko
Gerd wrote: > the order of input files would be > java ... splitter.jar [options] europe.o5m adres.o5m > vlaanderen-adres.o5m Yes I did that too. Anyway, with r320 it seems to work, mkgmap is running now thanks! ___ mkgmap-dev mailing list mkgmap-dev@li

Re: [mkgmap-dev] Infinite loop splitter

2014-03-08 Thread GerdP
Hi Minko, the order of input files would be java ... splitter.jar [options] europe.o5m adres.o5m vlaanderen-adres.o5m Your approach with osmconvert is probably faster because you have to use osmconvert anyway to convert to o5m. Gerd ligfietser wrote > Hi Gerd, > Thanks for the fix, I will t

Re: [mkgmap-dev] Infinite loop splitter

2014-03-08 Thread Minko
Gerd wrote: > > The reason for the loop was a way in a mp-relation > > for which no nodes were found. > > I guess this is caused by using osmconvert without the parameters > > --complete-ways --complex-ways If I use --complete-ways or --complex-ways with osmconvert, I didnt get any output at al

Re: [mkgmap-dev] Infinite loop splitter

2014-03-08 Thread Minko
Hi Gerd, Thanks for the fix, I will test it out. I tried Hennings approach but splitting seemed to last much longer because it analyses the whole EU extract and I only need the Benelux plus a small area of France and Germany. Splitting wasn't completed and threw out this error: warning: --keep-

Re: [mkgmap-dev] Infinite loop splitter

2014-03-08 Thread GerdP
Hi Minko, I've committed r320 to fix the loop problem. You can specify multiplie input files, but you have to make sure that each file contains ids which are higher than all previous ones. I think this is the case with your address files. The reason for the loop was a way in a mp-relation for w

Re: [mkgmap-dev] Infinite loop splitter

2014-03-08 Thread GerdP
Hi Minko, thanks, I can reproduce the problem with this file. Looking for a fix now. Gerd ligfietser wrote > Gerd, > If I skip merging the Vlaanderen address data then splitting goes well. > I have uploaded my 'corrupt' Benelux data which goes wrong (incl the > Vlaanderen addresses) here: > htt

Re: [mkgmap-dev] Infinite loop splitter

2014-03-08 Thread Minko
Hi Henning, I didnt know that you could feed multiple files to the splitter? How do you do this? > Hi Minko, > is there a reason for merging the files before splitting? Did you try > to > just pass all the files to splitter? I'm doing so with osm and > srtm-data. Don't know, if this helps in this

Re: [mkgmap-dev] Infinite loop splitter

2014-03-08 Thread Henning Scholland
Hi Minko, is there a reason for merging the files before splitting? Did you try to just pass all the files to splitter? I'm doing so with osm and srtm-data. Don't know, if this helps in this case, but in general I think it should be much faster. Henning __

Re: [mkgmap-dev] Infinite loop splitter

2014-03-08 Thread Minko
Gerd, If I skip merging the Vlaanderen address data then splitting goes well. I have uploaded my 'corrupt' Benelux data which goes wrong (incl the Vlaanderen addresses) here: http://mijndev.openstreetmap.nl/~ligfietser/test/benelux.o5m ___ mkgmap-dev m

Re: [mkgmap-dev] Infinite loop splitter

2014-03-08 Thread GerdP
Colin, thanks for the hint. No matter what other tools do: infinite loop in splitter is the worst case as a reaction on errors ;-) Gerd Colin Smale wrote > I see this very often as well, when I use osmupdate on an earlier > download. The only solution I have found is to download a new pbf, then

Re: [mkgmap-dev] Infinite loop splitter

2014-03-08 Thread Colin Smale
I see this very often as well, when I use osmupdate on an earlier download. The only solution I have found is to download a new pbf, then it works again. I suspect therefore that osmupdate or one of the underlying tools is corrupting the data. Colin On 8 March 2014 10:44:16 CET, Minko wrote:

Re: [mkgmap-dev] Infinite loop splitter

2014-03-08 Thread GerdP
Hi Minko, ligfietser wrote > Now if I skip the first step and split it without merging the address > nodes it goes well without problems. Could it be that the splitter creates > fake ID's that overlap my address data nodes? > Or is there an overlap in osm id's with the fake address nodes? I have

Re: [mkgmap-dev] Infinite loop splitter

2014-03-08 Thread Minko
BTW Here are the links to the files in case you need them: https://www.dropbox.com/sh/d3ssenipw2vx6qs/ucrj2cNiFM/adres.o5m https://www.dropbox.com/sh/d3ssenipw2vx6qs/bgWpOCpfwK/vlaanderen-adres.o5m https://www.dropbox.com/sh/d3ssenipw2vx6qs/zqzksFWZcp/bnl_01.poly https://www.dropbox.com/sh/d3ssenip

Re: [mkgmap-dev] Infinite loop splitter

2014-03-08 Thread Minko
Hi Gerd, I always mix the osm data with address nodes for Vlaanderen and the Netherlands with osmconvert. This part of my batch file looks like this: :osmconvert %DIR%\Tools\osmconvert --drop-version %DIR%\%date%\Splitter\%extract% %DIR%\resources\adres.o5m %DIR%\resources\vlaanderen-adres.o5m

Re: [mkgmap-dev] Infinite loop splitter

2014-03-08 Thread Gerd Petermann
Hi Minko, please keep the files that produce this problem. I'd like to have them to be able to reproduce it. Gerd > Date: Sat, 8 Mar 2014 11:09:03 +0100 > From: ligfiet...@online.nl > To: mkgmap-dev@lists.mkgmap.org.uk > Subject: Re: [mkgmap-dev] Infinite loop splitter >

Re: [mkgmap-dev] Infinite loop splitter

2014-03-08 Thread Minko
What have you done to solve this Bernd, should I just wait for another extract tomorrow? > I have seen this error last week, too. > > I had to recreate my dach extract. > > Bernd ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mk

Re: [mkgmap-dev] Infinite loop splitter

2014-03-08 Thread Bernd Weigelt
Am Samstag, 8. März 2014, 10:44:16 schrieb Minko: > I was trying to update my Benelux map but the splitter refused to finish the > process. Normally, splitter is finished in 2 minutes, now it gets in an > infinite loop with Full GC. What can be the cause for this, a corrupt > download of the europe