Re: [mkgmap-dev] Problem with splitter r393
Am Montag, 26. Mai 2014, 10:31:46 schrieb Gerd Petermann: Hi Gerd > okay, so it is probably a special case > Please post a link to the complete o5m file. Sorry, my mistake Didn't check the o5m file, only ask for that, what i should do ;-) I have to test osmconvert 0.7T against the old and a new extract, then i can give you the informations, but it will take some hours. I think, osmupdate 0.3F has a problem with this large extract, ~6.3 GB, because i have to create a new extract very often. Bernd -- amarok2 now playing: ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Re: [mkgmap-dev] Problem with splitter r393
Hi Bernd, no problem. I'll try to improve the error handling for this case. Gerd > From: weigelt.be...@web.de > To: mkgmap-dev@lists.mkgmap.org.uk > Date: Mon, 26 May 2014 11:03:36 +0200 > Subject: Re: [mkgmap-dev] Problem with splitter r393 > > Am Montag, 26. Mai 2014, 10:31:46 schrieb Gerd Petermann: > > Hi Gerd > > > okay, so it is probably a special case > > Please post a link to the complete o5m file. > > Sorry, my mistake > > Didn't check the o5m file, only ask for that, what i should do ;-) > > I have to test osmconvert 0.7T against the old and a new extract, then i can > give you the informations, but it will take some hours. > > I think, osmupdate 0.3F has a problem with this large extract, ~6.3 GB, > because i have to create a new extract very often. > > > > Bernd > > -- > amarok2 now playing: > > > > > ___ > mkgmap-dev mailing list > mkgmap-dev@lists.mkgmap.org.uk > http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Re: [mkgmap-dev] Problem with splitter r393
Hi Bernd, I've added a check in r395. reg. osmupdate I suggest to contact Markus Weber: markus.we...@gmx.com Gerd From: gpetermann_muenc...@hotmail.com To: mkgmap-dev@lists.mkgmap.org.uk Date: Mon, 26 May 2014 11:06:18 +0200 Subject: Re: [mkgmap-dev] Problem with splitter r393 Hi Bernd, no problem. I'll try to improve the error handling for this case. Gerd > From: weigelt.be...@web.de > To: mkgmap-dev@lists.mkgmap.org.uk > Date: Mon, 26 May 2014 11:03:36 +0200 > Subject: Re: [mkgmap-dev] Problem with splitter r393 > > Am Montag, 26. Mai 2014, 10:31:46 schrieb Gerd Petermann: > > Hi Gerd > > > okay, so it is probably a special case > > Please post a link to the complete o5m file. > > Sorry, my mistake > > Didn't check the o5m file, only ask for that, what i should do ;-) > > I have to test osmconvert 0.7T against the old and a new extract, then i can > give you the informations, but it will take some hours. > > I think, osmupdate 0.3F has a problem with this large extract, ~6.3 GB, > because i have to create a new extract very often. > > > > Bernd > > -- > amarok2 now playing: > > > > > ___ > mkgmap-dev mailing list > mkgmap-dev@lists.mkgmap.org.uk > http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Re: [mkgmap-dev] Problem with splitter r393
Am Montag, 26. Mai 2014, 11:23:51 schrieb Gerd Petermann: Hi Gerd > I've added a check in r395. > > reg. osmupdate I suggest to contact Markus Weber: > markus.we...@gmx.com I don't understand, what you have done, but the error has gone with r395 ;-) I made two tests, one with a new extract, created with osmconvert and osmupdate, and then one with the old data without update from this morning. Works fine now. have to thank you one more time Bernd -- amarok2 now playing: ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Re: [mkgmap-dev] Problem with splitter r393
Hi Bernd, that sounds not good to me. The only wanted effect of the change is that splitter reports an I/O error instead of failing with an ArrayIndexOutOfBoundsException. Maybe you have a hardware problem? Gerd Bernd Weigelt wrote > Am Montag, 26. Mai 2014, 11:23:51 schrieb Gerd Petermann: > > Hi Gerd > >> I've added a check in r395. >> >> reg. osmupdate I suggest to contact Markus Weber: >> > markus.weber@ > > I don't understand, what you have done, but the error has gone with r395 > ;-) > > I made two tests, one with a new extract, created with osmconvert and > osmupdate, and then one with the old data without update from this > morning. > Works fine now. > > have to thank you one more time > > Bernd > > -- > amarok2 now playing: > > > > > ___ > mkgmap-dev mailing list > mkgmap-dev@.org > http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev -- View this message in context: http://gis.19327.n5.nabble.com/Problem-with-splitter-r393-tp5807282p5807309.html Sent from the Mkgmap Development mailing list archive at Nabble.com. ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Re: [mkgmap-dev] Problem with splitter r393
Am Montag, 26. Mai 2014, 04:27:13 schrieb GerdP: Hi Gerd > Maybe you have a hardware problem? RAM? HDD? Don't think so, because then it should be more often, not only by this extract. If my HDD has a problem, the error should be the same as this morning, because i've renamed the file and didn't copy it to another place. S.M.A.R.T monitoring is enabled. But i'll test both, RAM and HDD, this night to be sure BTW: there only a few changes in the three splitter.log, the areas.list are more or less identical. Bernd -- amarok2 now playing: ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Re: [mkgmap-dev] Problem with splitter r393
Hi Bernd, if you test r393 again with same input file and it doesn't fail, you can be pretty sure that the problem is in the hardware, presuming you give enough heap so that GC is not too stressed. The areas are similar because the problem occured in a later phase. Gerd > From: weigelt.be...@web.de > To: mkgmap-dev@lists.mkgmap.org.uk > Date: Mon, 26 May 2014 14:44:26 +0200 > Subject: Re: [mkgmap-dev] Problem with splitter r393 > > Am Montag, 26. Mai 2014, 04:27:13 schrieb GerdP: > > Hi Gerd > > > Maybe you have a hardware problem? > > RAM? HDD? > > Don't think so, because then it should be more often, not only by this > extract. If my HDD has a problem, the error should be the same as this > morning, because i've renamed the file and didn't copy it to another place. > S.M.A.R.T monitoring is enabled. > > But i'll test both, RAM and HDD, this night to be sure > > BTW: there only a few changes in the three splitter.log, the areas.list are > more or less identical. > > Bernd > > > -- > amarok2 now playing: > > > > > ___ > mkgmap-dev mailing list > mkgmap-dev@lists.mkgmap.org.uk > http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Re: [mkgmap-dev] new bicycle access rules
A few days later the tag is used 2 140x already I guess it could be implemented in the default style now? > Minko wrote: > > Maybe none in the UK, but according to this site, 882 values (mainly > > in Germany) > > https://taginfo.openstreetmap.org/tags/?key=bicycle&value=use_sidepath > > http://overpass-turbo.eu/?key=bicycle&value=use_sidepath&template=key-value > > > > > Doh! User error on my part - I thought that I was pointing at the > golbal site. > > Cheers, > > Andy ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
[mkgmap-dev] Unicode index and searching
Hi I've been working on implementing unicode sorting so that we can have a global index that supports address search with full unicode support. I've tested with a map mixing Germany and Poland and it seems to work at first sight, but I'm sure someone will find a bug quickly enough :) Get the latest from the unicode branch at the bottom of the download page: http://www.mkgmap.org.uk/download/mkgmap-unicode-r3284.zip try with --code-page=65001 to enable unicode. It should be OK with Greek, Arabic and Cyrillic characters too. But not with Chinese characters at the moment. ..Steve ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Re: [mkgmap-dev] House numbers and styles
Hi Gerd,
maybe I find some time on the weekend to have a look on it.
WanMil
Hi Colin,
I think you found a bug in the housenumber processing.
The current implementation uses the streetnames which exist before style
processing
to produce a map of existing streets and nodes with addr info. After
style processing, It tries to find the
nodes and ways with the same name as that of a road. With your changes,
this will probably
fail.
If I got that right, we have to create another map that maps old and new
streetnames.
@WanMil: Do you have time to look at this?
Gerd
Date: Sun, 25 May 2014 22:18:35 +0200
From: colin.sm...@xs4all.nl
To: mkgmap-dev@lists.mkgmap.org.uk
Subject: [mkgmap-dev] House numbers and styles
I have some rules which modify name, addr:street and mkgmap:street in
"lines" and "points" which apply some transformations to the street
names. The idea is to normalise the names by removing punctuation and
standardising abbreviations. The resulting map is missing the house
numbers for streets whose name I have modified. In the style rules, I
apply identical transformations to the way (looking for highway=* &
name=*) and points (looking for addr:street and mkgmap:street,
separately of course). I expect that mkgmap can match up the address
nodes with the street because the street names are still identical, but
something is not working right. The modified street name is working fine
- that is displayed and is in the index (i.e. I can search for it as a
destination). However for these streets only, there don't seem to be any
house numbers present. A search for a specific (existing) number on the
road finds the road with no numbers, at the centroid of the street.
Other streets whose names don't get changed, will allow me to find a
specific house number and get the location right as well.
Does anyone have any ideas what might be going wrong here? Am I trying
to do something that can never work?
Is it possible that something in the address handling in mkgmap is using
the original street name, before the style has been applied?
Is it possible that the styles don't get applied to address-only nodes?
I have the following in "lines":
# CS: normalise by getting rid of . in abbreviations
highway=* & name ~ '.*[.].*' {set name='${name|subst:.-=>-|subst:\.~>
|subst: +~> }'}
... and the following in "points":
# CS: normalise by getting rid of . in abbreviations
#mkgmap:street ~ '.*[.].*' {set
mkgmap:street='${mkgmap:street|subst:.-=>-|subst:\.~> |subst: +~> }';
echo "fixed mkgmap:street ${mkgmap:street}"}
mkgmap:street ~ '.*[.].*' {set
mkgmap:street='${mkgmap:street|subst:.-=>-|subst:\.~> |subst: +~> }'}
#addr:street ~ '.*[.].*' {set
addr:street='${addr:street|subst:.-=>-|subst:\.~> |subst: +~> }'; echo
"fixed addr:street ${addr:street}"}
addr:street ~ '.*[.].*' {set
addr:street='${addr:street|subst:.-=>-|subst:\.~> |subst: +~> }'}
Thanks in advance for any pointers!
Colin
___ mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Re: [mkgmap-dev] House numbers and styles
Hi Wanmil, Gerd,
That would be wonderful. If you need any more information from me, feel
free to get in touch!
Colin
On 2014-05-26 20:10, WanMil wrote:
> Hi Gerd,
>
> maybe I find some time on the weekend to have a look on it.
>
> WanMil
>
>> Hi Colin, I think you found a bug in the housenumber processing. The current
>> implementation uses the streetnames which exist before style processing to
>> produce a map of existing streets and nodes with addr info. After style
>> processing, It tries to find the nodes and ways with the same name as that
>> of a road. With your changes, this will probably fail. If I got that right,
>> we have to create another map that maps old and new streetnames. @WanMil: Do
>> you have time to look at this? Gerd
>>
>> Date: Sun, 25 May 2014 22:18:35 +0200 From: colin.sm...@xs4all.nl To:
>> mkgmap-dev@lists.mkgmap.org.uk Subject: [mkgmap-dev] House numbers and
>> styles I have some rules which modify name, addr:street and mkgmap:street in
>> "lines" and "points" which apply some transformations to the street names.
>> The idea is to normalise the names by removing punctuation and standardising
>> abbreviations. The resulting map is missing the house n!
umbers
for streets whose name I have modified. In the style rules, I apply identical
transformations to the way (looking for highway=* & name=*) and points (looking
for addr:street and mkgmap:street, separately of course). I expect that mkgmap
can match up the address nodes with the street because the street names are
still identical, but something is not working right. The modified street name
is working fine - that is displayed and is in the index (i.e. I can search for
it as a destination). However for these streets only, there don't seem to be
any house numbers present. A search for a specific (existing) number on the
road finds the road with no numbers, at the centroid of the street. Other
streets whose names don't get changed, will allow me to find a specific house
number and get the location right as well. Does anyone have any ideas what
might be going wrong here? Am I trying to do something that can never work? Is
it possible that something in the address handling in mkgmap!
is using
the original street name, before the style has been applied? Is it possible
that the styles don't get applied to address-only nodes? I have the following
in "lines": # CS: normalise by getting rid of . in abbreviations highway=* &
name ~ '.*[.].*' {set name='${name|subst:.-=>-|subst:.~> |subst: +~> }'} ...
and the following in "points": # CS: normalise by getting rid of . in
abbreviations #mkgmap:street ~ '.*[.].*' {set
mkgmap:street='${mkgmap:street|subst:.-=>-|subst:.~> |subst: +~> }'; echo
"fixed mkgmap:street ${mkgmap:street}"} mkgmap:street ~ '.*[.].*' {set
mkgmap:street='${mkgmap:street|subst:.-=>-|subst:.~> |subst: +~> }'}
#addr:street ~ '.*[.].*' {set addr:street='${addr:street|subst:.-=>-|subst:.~>
|subst: +~> }'; echo "fixed addr:street ${addr:street}"} addr:street ~
'.*[.].*' {set addr:street='${addr:street|subst:.-=>-|subst:.~> |subst: +~> }'}
Thanks in advance for any pointers! Colin
___ mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev [1]
___ mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev [1]
>
> ___
> mkgmap-dev mailing list
> mkgmap-dev@lists.mkgmap.org.uk
> http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev [1]
Links:
--
[1] http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Re: [mkgmap-dev] Unicode index and searching
Hi Steve, this is a great news! I have compiled map of Europe. It looks good and search works correctly in Mapsource. I haven't tested thoroughly but I have tried address search and city search in several languages. Search index for Europe is about 420MB. When compiling I got some messages, like: missing page ? (4e00) missing page ? (5546) missing page ? (57ce) missing page ? (7c73) missing page ? (5170) missing page ? (7b2c) missing page ? (4e00) missing page ? (5546) missing page ? (57ce) no page ? (671d) no page ? (9633) no page ? (516c) no page ? (56ed) no page ? (6d77) no page ? (738b) no page ? (6d77) no page ? (738b) no page ? (767e) -- Best regards, Andrzej ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
[mkgmap-dev] Problem with splitter r393
Hi FYI: splitter r393 dies with following error, if i try to split my DACH-extract, all other extracts are not affected java.lang.ArrayIndexOutOfBoundsException: -184650 at uk.me.parabola.splitter.O5mMapParser.setStringRefPair(O5mMapParser.java:355) at uk.me.parabola.splitter.O5mMapParser.readAuthor(O5mMapParser.java:408) at uk.me.parabola.splitter.O5mMapParser.readVersionTsAuthor(O5mMapParser.java:372) at uk.me.parabola.splitter.O5mMapParser.readNode(O5mMapParser.java:251) at uk.me.parabola.splitter.O5mMapParser.readFile(O5mMapParser.java:187) at uk.me.parabola.splitter.O5mMapParser.parse(O5mMapParser.java:133) at uk.me.parabola.splitter.Main.processOSMFiles(Main.java:1362) at uk.me.parabola.splitter.Main.processMap(Main.java:874) at uk.me.parabola.splitter.Main.genProblemLists(Main.java:697) at uk.me.parabola.splitter.Main.partitionAreasForProblemListGenerator(Main.java:729) at uk.me.parabola.splitter.Main.split(Main.java:307) at uk.me.parabola.splitter.Main.start(Main.java:181) at uk.me.parabola.splitter.Main.main(Main.java:151) here are the log files http://files.mkgmap.org.uk/download/210/20140526_0900.zip Bernd -- amarok2 now playing: ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Re: [mkgmap-dev] Problem with splitter r393
Hi Bernd, this looks like an error in the o5m file. Is osmconvert able to read it? Gerd > From: weigelt.be...@web.de > To: mkgmap-dev@lists.mkgmap.org.uk > Date: Mon, 26 May 2014 10:20:11 +0200 > Subject: [mkgmap-dev] Problem with splitter r393 > > Hi > > FYI: > > splitter r393 dies with following error, if i try to split my DACH-extract, > all other extracts are not affected > > java.lang.ArrayIndexOutOfBoundsException: -184650 > at > uk.me.parabola.splitter.O5mMapParser.setStringRefPair(O5mMapParser.java:355) > at > uk.me.parabola.splitter.O5mMapParser.readAuthor(O5mMapParser.java:408) > at > uk.me.parabola.splitter.O5mMapParser.readVersionTsAuthor(O5mMapParser.java:372) > at > uk.me.parabola.splitter.O5mMapParser.readNode(O5mMapParser.java:251) > at > uk.me.parabola.splitter.O5mMapParser.readFile(O5mMapParser.java:187) > at uk.me.parabola.splitter.O5mMapParser.parse(O5mMapParser.java:133) > at uk.me.parabola.splitter.Main.processOSMFiles(Main.java:1362) > at uk.me.parabola.splitter.Main.processMap(Main.java:874) > at uk.me.parabola.splitter.Main.genProblemLists(Main.java:697) > at > uk.me.parabola.splitter.Main.partitionAreasForProblemListGenerator(Main.java:729) > at uk.me.parabola.splitter.Main.split(Main.java:307) > at uk.me.parabola.splitter.Main.start(Main.java:181) > at uk.me.parabola.splitter.Main.main(Main.java:151) > > > > here are the log files > http://files.mkgmap.org.uk/download/210/20140526_0900.zip > > Bernd > > > -- > amarok2 now playing: > > > > > ___ > mkgmap-dev mailing list > mkgmap-dev@lists.mkgmap.org.uk > http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Re: [mkgmap-dev] Problem with splitter r393
Am Montag, 26. Mai 2014, 10:21:31 schrieb Gerd Petermann: Wow, 80 seconds to get a hint ;-) > this looks like an error in the o5m file. Is osmconvert able to read it? What shall i do? convert from o5m to osm and back? No problem Bernd -- amarok2 now playing: ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Re: [mkgmap-dev] Problem with splitter r393
Hi Bernd, okay, so it is probably a special case :-( Please post a link to the complete o5m file. Gerd > From: weigelt.be...@web.de > To: mkgmap-dev@lists.mkgmap.org.uk > Date: Mon, 26 May 2014 10:28:33 +0200 > Subject: Re: [mkgmap-dev] Problem with splitter r393 > > Am Montag, 26. Mai 2014, 10:21:31 schrieb Gerd Petermann: > > Wow, 80 seconds to get a hint ;-) > > > this looks like an error in the o5m file. Is osmconvert able to read it? > > What shall i do? > > convert from o5m to osm and back? > > No problem > > Bernd > > > -- > amarok2 now playing: > > > > > ___ > mkgmap-dev mailing list > mkgmap-dev@lists.mkgmap.org.uk > http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Re: [mkgmap-dev] Problem with splitter r393
Hi Bernd, and you may use 7zip to compress the o5m file first. Gerd > From: weigelt.be...@web.de > To: mkgmap-dev@lists.mkgmap.org.uk > Date: Mon, 26 May 2014 10:28:33 +0200 > Subject: Re: [mkgmap-dev] Problem with splitter r393 > > Am Montag, 26. Mai 2014, 10:21:31 schrieb Gerd Petermann: > > Wow, 80 seconds to get a hint ;-) > > > this looks like an error in the o5m file. Is osmconvert able to read it? > > What shall i do? > > convert from o5m to osm and back? > > No problem > > Bernd > > > -- > amarok2 now playing: > > > > > ___ > mkgmap-dev mailing list > mkgmap-dev@lists.mkgmap.org.uk > http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
