geoff the map size i feel is far to big i have increased the nodes for it , and the memory was set to 800 mb but still no joy at all stephen
On Sat, Sep 29, 2012 at 5:27 AM, Geoff Sherlock <geoffrey_sherl...@btinternet.com> wrote: > Are you getting the problem in the splitter? > > I tried to recreate with a small set of data. > I downloaded latest pbf for Iceland, splitter did fine, but mkgmap hung in > some loop, then (eventually died). > > Could be a problem with the splitter and mkgmap!! > > I guessed increasing the nodes would be a fix for the splitter (if the > memory is there), but I don't know a fix for mkgmap. > > Output follows: > C:\Geoff\Walks\OSM\splitter>java -Xmx5000M -jar splitter.jar > iceland.osm.pbf -- > ax-nodes=300000 --mapid=56750001 > cache= > description= > geonames-file= > legacy-mode=false > mapid=56750001 > max-areas=255 > max-nodes=300000 > max-threads=4 (auto) > mixed=false > no-trim=false > output=pbf > output-dir= > overlap=2000 > resolution=13 > split-file= > status-freq=120 > write-kml= > Elapsed time: 0s Memory: Current 121MB (2MB used, 119MB free) Max 4444MB > Time started: Fri Sep 28 20:09:05 BST 2012 > Map is being split for resolution 13: > - area boundaries are aligned to 0x800 map units > - areas are multiples of 0x1000 map units wide and high > Processing iceland.osm.pbf > Bounding box -25.740850000000002 62.845530000000004 -12.41708 67.50085 > in 1 file > Time: Fri Sep 28 20:09:06 BST 2012 > Exact map coverage is (62.84553050994873,-25.740838050842285) to > (67.5008368492 > 265,-12.41706132888794) > Trimmed and rounded map coverage is (62.8857421875,-25.048828125) to > (67.368164 > 625,-12.392578125) > Splitting nodes into areas containing a maximum of 300,000 nodes each... > Area (63.5009765625,-23.73046875) to (64.2919921875,-21.884765625) contains > 234 > 963 nodes. DONE! > Area (63.0615234375,-21.884765625) to (64.0283203125,-20.654296875) contains > 20 > 679 nodes. DONE! > Area (64.0283203125,-21.884765625) to (64.2919921875,-20.654296875) contains > 29 > ,530 nodes. DONE! > Area (64.2919921875,-25.048828125) to (66.7529296875,-20.654296875) contains > 16 > ,219 nodes. DONE! > Area (62.8857421875,-20.654296875) to (64.8193359375,-12.744140625) contains > 14 > ,736 nodes. DONE! > Area (64.8193359375,-20.654296875) to (67.3681640625,-12.392578125) contains > 17 > ,626 nodes. DONE! > 6 areas: > Area 56750001 covers (0x2cd800,0xfff07000) to (0x2d8800,0xfff15000) > Area 56750002 covers (0x2db800,0xffee3000) to (0x2f7800,0xfff15000) > Area 56750003 covers (0x2cb800,0xfff15000) to (0x2e1800,0xfff6f000) > Area 56750004 covers (0x2d8800,0xfff07000) to (0x2db800,0xfff15000) > Area 56750005 covers (0x2e1800,0xfff15000) to (0x2fe800,0xfff73000) > Area 56750006 covers (0x2d2800,0xffef2000) to (0x2db800,0xfff07000) > Writing out split osm files Fri Sep 28 20:09:06 BST 2012 > Processing 6 areas in a single pass > (63.0615234375,-21.884765625) to (64.0283203125,-20.654296875) > (64.2919921875,-25.048828125) to (66.7529296875,-20.654296875) > (62.8857421875,-20.654296875) to (64.8193359375,-12.744140625) > (64.0283203125,-21.884765625) to (64.2919921875,-20.654296875) > (64.8193359375,-20.654296875) to (67.3681640625,-12.392578125) > (63.5009765625,-23.73046875) to (64.2919921875,-21.884765625) > Starting pass 1 of 1, processing 6 areas (56750001 to 56750006) > Grid [512][512] for grid area (62.84282684326172,-25.09174346923828) to > (67.411 > 7940673828,-12.349662780761719) requires max. 3 checks for each node. > Grid was created in 59 ms > Allocating three-tier structure to save area info > (HashMap->vector->chunkvector > > Allocating three-tier structure to save area info > (HashMap->vector->chunkvector > > Processing iceland.osm.pbf > Bounding box -25.740850000000002 62.845530000000004 -12.41708 67.50085 > MAP occupancy: 1,000,000, number of area dictionary entries: 21 of 65535 > Map details: HashMap -> 7 vectors for 65,307 chunks(vector usage < 1%) > Writing ways Fri Sep 28 20:09:08 BST 2012 > Writing relations Fri Sep 28 20:09:10 BST 2012 > *********************************************************** > Final statistics > *********************************************************** > Needed dictionary entries: 23 of 65535 > coords occupancy > MAP occupancy: 1,024,755 > Length-6 chunks: 58,084 (Bytes: 1,394,016) > Length-10 chunks: 4,059 (Bytes: 129,888) > Length-14 chunks: 1,871 (Bytes: 74,840) > Length-18 chunks: 672 (Bytes: 32,256) > Length-22 chunks: 528 (Bytes: 29,568) > Length-26 chunks: 371 (Bytes: 23,744) > Length-30 chunks: 247 (Bytes: 17,784) > Length-34 chunks: 224 (Bytes: 17,920) > Length-38 chunks: 156 (Bytes: 13,728) > Length-42 chunks: 90 (Bytes: 8,640) > Length-46 chunks: 52 (Bytes: 5,408) > Length-50 chunks: 28 (Bytes: 3,136) > Length-54 chunks: 19 (Bytes: 2,280) > Length-58 chunks: 14 (Bytes: 1,792) > Length-62 chunks: 13 (Bytes: 1,768) > Length-66 chunks: 12 (Bytes: 1,728) > Length-68 chunks: 28 (Bytes: 4,256) > RLE compresion info: compressed / uncompressed size / ratio: 482,512 / > 1,381,47 > / 66% > Map details: HashMap -> 8 vectors for 66,468 chunks(vector usage < 1%) > ways occupancy > MAP occupancy: 88,187 > Length-6 chunks: 9,798 (Bytes: 235,152) > Length-10 chunks: 300 (Bytes: 9,600) > Length-14 chunks: 275 (Bytes: 11,000) > Length-18 chunks: 145 (Bytes: 6,960) > Length-22 chunks: 84 (Bytes: 4,704) > Length-26 chunks: 42 (Bytes: 2,688) > Length-30 chunks: 25 (Bytes: 1,800) > Length-34 chunks: 18 (Bytes: 1,440) > Length-38 chunks: 20 (Bytes: 1,760) > Length-42 chunks: 11 (Bytes: 1,056) > Length-46 chunks: 8 (Bytes: 832) > Length-50 chunks: 16 (Bytes: 1,792) > Length-54 chunks: 9 (Bytes: 1,080) > Length-58 chunks: 13 (Bytes: 1,664) > Length-62 chunks: 17 (Bytes: 2,312) > Length-66 chunks: 32 (Bytes: 4,608) > Length-68 chunks: 11 (Bytes: 1,672) > RLE compresion info: compressed / uncompressed size / ratio: 80,094 / > 144,704 / > 45% > Map details: HashMap -> 1 vectors for 10,824 chunks(vector usage < 1%) > > Thread worker-2 has finished > Thread worker-0 has finished > Thread worker-1 has finished > Time finished: Fri Sep 28 20:09:10 BST 2012 > Total time taken: 5s > > C:\Geoff\Walks\OSM\splitter>move /-Y iceland.osm.pbf iceland > 1 file(s) moved. > > C:\Geoff\Walks\OSM\splitter>move /-Y *.osm.pbf ..\mkgmap > C:\Geoff\Walks\OSM\splitter\56750001.osm.pbf > C:\Geoff\Walks\OSM\splitter\56750002.osm.pbf > C:\Geoff\Walks\OSM\splitter\56750003.osm.pbf > C:\Geoff\Walks\OSM\splitter\56750004.osm.pbf > C:\Geoff\Walks\OSM\splitter\56750005.osm.pbf > C:\Geoff\Walks\OSM\splitter\56750006.osm.pbf > 6 file(s) moved. > > C:\Geoff\Walks\OSM\splitter>cd ..\mkgmap > > C:\Geoff\Walks\OSM\mkgmap>echo Iceland split completed. . . > 1>>compilemaps.txt > > > C:\Geoff\Walks\OSM\mkgmap>time /T 1>>compilemaps.txt > > C:\Geoff\Walks\OSM\mkgmap>rem > > C:\Geoff\Walks\OSM\mkgmap>rem Mapnik style > > C:\Geoff\Walks\OSM\mkgmap>rem > > C:\Geoff\Walks\OSM\mkgmap>pause > Press any key to continue . . . > > C:\Geoff\Walks\OSM\mkgmap>java -Xmx5000M -jar > mkgmap.jar --index --tdbfile --ro > te --generate-sea=multipolygon,close-gaps=1000 --mapname=56730001 > --family-id=4 > --family-name="icemapnik" --series-name="icemapnik"--description="OsmICEMapnik > --remove-short-arcs --add-pois-to-areas --nsis --drive-on-left --overview-mapn > me="OsmICEMapnik" --style-file=mapnik_styles/mapnik *.pbf icenik.typ > Time started: Fri Sep 28 20:09:33 BST 2012 > > > On Friday, September 28, 2012 12:23 PM, steve sgalowski wrote: > > -----Original Message----- > From: steve sgalowski > Sent: Friday, September 28, 2012 12:23 PM > To: Development list for mkgmap > Subject: Re: [mkgmap-dev] geofabrik > > true , but now when you use the splitter , it will not work on t he > new odbl license files > as it spits the dummy , when you have a map size of 0 x 200 > 0 x 400 is ok for ausralia > > Stephen > > > On Fri, Sep 28, 2012 at 9:19 PM, Geoff Sherlock > <geoffrey_sherl...@btinternet.com> wrote: >> Francois, you mention .osm.bz2 files. If you are only putting them through >> splitter and mkgmap, it is much quicker to both download and process the >> binary .pbf extracts. >> >> Regards, Geoff. >> >> -----Original Message----- >> From: Francois >> Sent: Friday, September 28, 2012 11:23 AM >> Cc: 'Development list for mkgmap' >> Subject: Re: [mkgmap-dev] geofabrik >> >> On 28/09/2012 12:18, RheinSkipper wrote: >>> They changed the folder name after the license change: >>> http://download.geofabrik.de/openstreetmap/ >> >> Great. Thank you. Francois >> >> _______________________________________________ >> mkgmap-dev mailing list >> mkgmap-dev@lists.mkgmap.org.uk >> http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev >> >> _______________________________________________ >> mkgmap-dev mailing list >> mkgmap-dev@lists.mkgmap.org.uk >> http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev > _______________________________________________ > mkgmap-dev mailing list > mkgmap-dev@lists.mkgmap.org.uk > http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev > > _______________________________________________ > mkgmap-dev mailing list > mkgmap-dev@lists.mkgmap.org.uk > http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev