Re: [OSM-dev] Splitting the planet into thousands of pieces in one pass.

2010-12-02 Thread Scott Crosby
On Thu, Dec 2, 2010 at 2:06 PM, Frederik Ramm wrote: >> > > I wanted to try this but it seems I have difficulties collecting the various > dependencies. I got hold of the fastutils.jar but: > >    [javac] > /home/fred/splitter/src/uk/me/parabola/splitter/DenseInt2ShortMap.java:5: > package it.unim

Re: [OSM-dev] Splitting the planet into thousands of pieces in one pass.

2010-12-02 Thread Frederik Ramm
Scott, Scott Crosby wrote: However, I've committed several improvements to crosby_integration branch in mkgmap SVN that massively increase its scalability and may make it more useful to a general audience: I wanted to try this but it seems I have difficulties collecting the various dependenci

Re: [OSM-dev] Splitting the planet into thousands of pieces in one pass.

2010-12-02 Thread Scott Crosby
On Thu, Dec 2, 2010 at 2:51 AM, Sarah Hoffmann wrote: > Hi Andrzej, > > On Wed, Dec 01, 2010 at 03:19:18PM +0100, andrzej zaborowski wrote: >> A further comment on splitting a big dataset into areas is that if the >> areas are disjoint (like in the case of countries, provinces and other >> adminis

Re: [OSM-dev] Splitting the planet into thousands of pieces in one pass.

2010-12-02 Thread Sarah Hoffmann
Hi Andrzej, On Wed, Dec 01, 2010 at 03:19:18PM +0100, andrzej zaborowski wrote: > A further comment on splitting a big dataset into areas is that if the > areas are disjoint (like in the case of countries, provinces and other > administrative areas) or nearly disjoint (like in the case of their >

Re: [OSM-dev] Splitting the planet into thousands of pieces in one pass.

2010-12-01 Thread Scott Crosby
On Wed, Dec 1, 2010 at 12:33 PM, Nic Roets wrote: > > > On Wed, Dec 1, 2010 at 8:18 PM, Scott Crosby wrote: >> >> On Wed, Dec 1, 2010 at 7:27 AM, Nic Roets wrote: >> > Hello Scott, >> > >> > How do you keep track of what bboxs each entity belongs to ? >> >> An Int2ShortMultiMap implemented by co

Re: [OSM-dev] Splitting the planet into thousands of pieces in one pass.

2010-12-01 Thread Nic Roets
On Wed, Dec 1, 2010 at 8:18 PM, Scott Crosby wrote: > On Wed, Dec 1, 2010 at 7:27 AM, Nic Roets wrote: > > Hello Scott, > > > > How do you keep track of what bboxs each entity belongs to ? > > An Int2ShortMultiMap implemented by composing two underlying > Int2ShortMap implementations with differ

Re: [OSM-dev] Splitting the planet into thousands of pieces in one pass.

2010-12-01 Thread Scott Crosby
On Wed, Dec 1, 2010 at 7:27 AM, Nic Roets wrote: > Hello Scott, > > How do you keep track of what bboxs each entity belongs to ? An Int2ShortMultiMap implemented by composing two underlying Int2ShortMap implementations with different space efficiency tradeoffs, a custom sparsearray implementation

Re: [OSM-dev] Splitting the planet into thousands of pieces in one pass.

2010-12-01 Thread andrzej zaborowski
Hi Nic and Scott, On 1 December 2010 14:27, Nic Roets wrote: > http://trac.openstreetmap.org/browser/applications/rendering/gosmore/bboxSplit.cpp?rev=24484 A further comment on splitting a big dataset into areas is that if the areas are disjoint (like in the case of countries, provinces and othe

Re: [OSM-dev] Splitting the planet into thousands of pieces in one pass.

2010-12-01 Thread Nic Roets
Hello Scott, How do you keep track of what bboxs each entity belongs to ? I'm not really asking a question, I'm just saying that I found a way to reduce the memory requirement for that considerably. Instead of a bit per bbox per entry, I store only 16 bits or 32 bits per entry. Here is the source

[OSM-dev] Splitting the planet into thousands of pieces in one pass.

2010-12-01 Thread Scott Crosby
I've been working on making various improvements to the mkgmap splitter. It was originally intended to split a map into smaller pieces which could then be converted into Garmin format and artifacts of that original purpose continue to exist. (Eg, its coordinate system for representing the areas.)