Re: [OSM-dev] List of Questions

2009-04-28 Thread Sam Mor

 
Mapnik get :
-the images from Symbols file 
- data from osm files 
then mapnik draws (renders) tha images
is it true?


and about mod_tile, we need to read it first.. sorry not yet finished

thanks, 
and it was a funny joke, hahaha

Cheers



From: Stephan Plepelits 
To: Sam Mor 
Cc: OpenstreetMap DevList 
Sent: Wednesday, 29 April, 2009 2:29:04 PM
Subject: Re: [OSM-dev] List of Questions

On Tue, Apr 28, 2009 at 08:35:35PM -0700, Sam Mor wrote:
> Sorry We are at beginning, but it's good to understand the basics,
>  
>  how do mapnik create the image from osm file?
>  
Check out this howto:
http://wiki.openstreetmap.org/wiki/Mapnik

> where are the images are located?
It depends where you put them ;) Sorry  I'm kidding.

You can either render them before you serve them to the Web, which doesn't
sound bad first, but unfortunately it takes a long time. As alternative you
can use mod_tile, an extension for the apache webserver, which renders on
demand, and as an advantage serves cached tiles much faster than apache
alone.
http://wiki.openstreetmap.org/wiki/Mod_tile

Hope I could help you.

greetings,
        Stephan
-- 
Seid unbequem, seid Sand, nicht Öl im Getriebe der Welt! - Günther Eich
,-.
| Stephan Plepelits,                                                  |
| Technische Universität Wien  -    Studium Informatik & Raumplanung |
| > openstreetbrowser.org > couchsurfing.com > tubasis.at > bl.mud.at |
| sk...@xover..htu.tuwien.ac.at      -      My Blog: http://plepe.at |
`-'



  The new Internet Explorer 8 optimised for Yahoo!7: Faster, Safer, Easier.___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] List of Questions

2009-04-28 Thread Stephan Plepelits
On Tue, Apr 28, 2009 at 08:35:35PM -0700, Sam Mor wrote:
> Sorry We are at beginning, but it's good to understand the basics,
>  
>  how do mapnik create the image from osm file?
>  
Check out this howto:
http://wiki.openstreetmap.org/wiki/Mapnik

> where are the images are located?
It depends where you put them ;) Sorry ... I'm kidding.

You can either render them before you serve them to the Web, which doesn't
sound bad first, but unfortunately it takes a long time. As alternative you
can use mod_tile, an extension for the apache webserver, which renders on
demand, and as an advantage serves cached tiles much faster than apache
alone.
http://wiki.openstreetmap.org/wiki/Mod_tile

Hope I could help you.

greetings,
Stephan
-- 
Seid unbequem, seid Sand, nicht Öl im Getriebe der Welt! - Günther Eich
,-.
| Stephan Plepelits,  |
| Technische Universität Wien   -Studium Informatik & Raumplanung |
| > openstreetbrowser.org > couchsurfing.com > tubasis.at > bl.mud.at |
| sk...@xover.htu.tuwien.ac.at   -   My Blog: http://plepe.at |
`-'

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] building A openstreetmap server

2009-04-28 Thread Sam Mor
I would to comment about I read:
is it correct that everyone can build his openstreet map server?
if yes , what are the needs of hardwares and softwares?


I tried long time to look for a free mapping system, but I didnt and I think 
OpenStreetMap is a Wonderful one if it's open source and can be used 
everywhere...

Cheers Guys



  Enjoy a safer web experience. Upgrade to the new Internet Explorer 8 
optimised for Yahoo!7. Get it now.___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] List of Questions

2009-04-28 Thread Sam Mor
Sorry We are at beginning, but it's good to understand the basics,

 how do mapnik create the image from osm file?


where are the images are located?


  Enjoy a better web experience. Upgrade to the new Internet Explorer 8 
optimised for Yahoo!7. Get it now.___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] Hi OpenStreetMap

2009-04-28 Thread Sam Mor
Hi Guys
We are very happy to join your Project,
Wonderful Project
We will take a breath and go deeper..

Have  a Nice Day 
Sam


  The new Internet Explorer 8 optimised for Yahoo!7: Faster, Safer, Easier.___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Slippy Map Elevation Overlay

2009-04-28 Thread MilesTogoe
Graham Jones (Physics) wrote:
> I sometimes think that the main slippy map has a bit too much plain 
> white, especially in undeveloped places where there are not many roads 
> such as the Pennines or North Yorkshire Moors in Northern England - I 
> keep wondering if this is an un-mapped area, or if there is nothing 
> there
>
> The cycle map is very good with shaded elevation contours, but the 
> main osmarender and mapnik maps do not include this.
> I would like this sort of shading to be available for the main map 
> too, but I am not convinced that rendering it into the tiles is good, 
> because sometimes those extra colours or contour lines are a 
> distraction, so it would be nice for the user to be able to switch 
> them off.
>
> I wondered if there is any reason why we could not create an overlay 
> of elevation information (contours and or shading) that could sit on 
> top of the main map as a user selectable leayer?
>
> I have had a quick go at http://maps.webhop.net/srtm.html.  It sort of 
> works - the high ground stands out, and you can see the shape of the 
> ground, and you can switch the overlay off and on.  It does not work 
> that well as an overlay though because it is not really transparent 
> enough.  I find that sometimes the transparency works quite well and 
> you can see the map underneath, and others it is practically opaque.
pretty nice, though when zoomed in, it gets blocky - maybe this is 
actually how the parcel boundaries are, maybe you where just trying to 
get stuff prototyped.I keep thinking it would be nice to integrate 
OSM data with free satellite data like java based WorldWind NASA data as 
the background - haven't really researched this yet. 



___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Problems with rendering tiles with mapnik

2009-04-28 Thread Mohamad Ali
I have 
Applications -> Accesories -> Terminal ...





-Original Message-
From: Dirk-Lüder Kreie [mailto:osm-l...@deelkar.net] 
Sent: Wednesday, April 29, 2009 10:05 AM
To: Iván Sánchez Ortega
Cc: dev@openstreetmap.org; Mohamad Ali
Subject: Re: [OSM-dev] Problems with rendering tiles with mapnik

Iván Sánchez Ortega schrieb:
> El Miércoles, 29 de Abril de 2009, Mohamad Ali escribió:
>> Actually guys, I have Ubuntu OS, and I am a newbie to Linux,
>>
>> I think You are right, Ubuntu is missing the shell,
> 
> Missing??

he has /bin/bash apparently, but not /bin/sh

-- 

Dirk-Lüder "Deelkar" Kreie
Bremen - 53.0952°N 8.8652°E



___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Problems with rendering tiles with mapnik

2009-04-28 Thread Iván Sánchez Ortega
El Miércoles, 29 de Abril de 2009, Dirk-Lüder Kreie escribió:
> >> I think You are right, Ubuntu is missing the shell,
> >
> > Missing??
>
> he has /bin/bash apparently, but not /bin/sh

Debian and Debian-like systems (i.e. Ubuntu) use bash as a replacement of sh.

So, if /bin/sh is *really* missing, just running "ln -s /bin/bash /bin/sh" 
should solve the problem.

-- 
--
Iván Sánchez Ortega 

A todos nos gustan las citas sin sentido sacadas de películas mediocres que 
nos hacen parecer intelectuales.
 -- The Ninja Bunny


signature.asc
Description: This is a digitally signed message part.
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Problems with rendering tiles with mapnik

2009-04-28 Thread Dirk-Lüder Kreie
Iván Sánchez Ortega schrieb:
> El Miércoles, 29 de Abril de 2009, Mohamad Ali escribió:
>> Actually guys, I have Ubuntu OS, and I am a newbie to Linux,
>>
>> I think You are right, Ubuntu is missing the shell,
> 
> Missing??

he has /bin/bash apparently, but not /bin/sh

-- 

Dirk-Lüder "Deelkar" Kreie
Bremen - 53.0952°N 8.8652°E



signature.asc
Description: OpenPGP digital signature
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] More Immediate Changeset Feedback

2009-04-28 Thread Iván Sánchez Ortega
El Miércoles, 29 de Abril de 2009, Ian Dees escribió:
> Would it be possible (I know, patches welcome -- I'm just asking about
> feasibility right now) to stream the node IDs back as the API creates them
> instead of waiting until the /changeset/upload operation is finished? This
> would potentially kill two birds with one stone:
>
> 1. Give the clients the ability to show progress

The clients are free to split into several changesets, or split a changeset 
into several uploads.

> 2. Save some memory on the API server (don't have to store the node IDs in
> memory, can just stream them out)

Premature optimization. 

-- 
--
Iván Sánchez Ortega 

Entonces, como no estudiaba nada, aprendía mucho.- Anatole France.


signature.asc
Description: This is a digitally signed message part.
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] More Immediate Changeset Feedback

2009-04-28 Thread Ian Dees
Would it be possible (I know, patches welcome -- I'm just asking about
feasibility right now) to stream the node IDs back as the API creates them
instead of waiting until the /changeset/upload operation is finished? This
would potentially kill two birds with one stone:

1. Give the clients the ability to show progress
2. Save some memory on the API server (don't have to store the node IDs in
memory, can just stream them out)
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Problems with rendering tiles with mapnik

2009-04-28 Thread Iván Sánchez Ortega
El Miércoles, 29 de Abril de 2009, Mohamad Ali escribió:
> Actually guys, I have Ubuntu OS, and I am a newbie to Linux,
>
> I think You are right, Ubuntu is missing the shell,

Missing??

Applications -> Accesories -> Terminal ...

-- 
--
Iván Sánchez Ortega 

http://ivan.sanchezortega.es
MSN:i_eat_s_p_a_m_for_breakf...@hotmail.com
Jabber:ivansanc...@jabber.org ; ivansanc...@kdetalk.net
IRC: ivansanchez @ OFTC & freenode


signature.asc
Description: This is a digitally signed message part.
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] Problems with rendering tiles with mapnik

2009-04-28 Thread Mohamad Ali
Actually guys, I have Ubuntu OS, and I am a newbie to Linux,

I think You are right, Ubuntu is missing the shell,

I googled about "Install sh" but I didn't find information that can help me
to fix the problem?

Please can u give me more details?

 

Thanks guys,

 

Mohamad

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] Slippy Map Elevation Overlay

2009-04-28 Thread Graham Jones (Physics)
I sometimes think that the main slippy map has a bit too much plain white,
especially in undeveloped places where there are not many roads such as the
Pennines or North Yorkshire Moors in Northern England - I keep wondering if
this is an un-mapped area, or if there is nothing there

The cycle map is very good with shaded elevation contours, but the main
osmarender and mapnik maps do not include this.
I would like this sort of shading to be available for the main map too, but
I am not convinced that rendering it into the tiles is good, because
sometimes those extra colours or contour lines are a distraction, so it
would be nice for the user to be able to switch them off.

I wondered if there is any reason why we could not create an overlay of
elevation information (contours and or shading) that could sit on top of the
main map as a user selectable leayer?

I have had a quick go at http://maps.webhop.net/srtm.html.  It sort of works
- the high ground stands out, and you can see the shape of the ground, and
you can switch the overlay off and on.  It does not work that well as an
overlay though because it is not really transparent enough.  I find that
sometimes the transparency works quite well and you can see the map
underneath, and others it is practically opaque.

I struggle a bit with javascript and openlayers and wondered if anyone could
suggest how I could sort out the opacity problem a bit better?
Maybe the main map should use a transparent background, and use the
elevation data as the base layer with the map as the overlay?

Regards


Graham.

-- 
Dr. Graham Jones
Hartlepool, UK
email: grahamjones...@gmail.com
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Can SQLite3 handle OSM 150G data file?

2009-04-28 Thread Robert Joop
On 09-04-28 09:14:31 CEST, marcus.wolsc...@googlemail.com wrote:
> Is there ANY embedded database out there that can handle the planet?
> Anything that does not require the (unskilled) user of a program to
> install a local database-server first?

has anybody tried "embedded innodb"?
i saw mention of it in the news a few days ago.

rj

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] [bug] direction of GPS traces

2009-04-28 Thread Graham Jones (Physics)
This thread seemed to fizzle out without coming to a conclusion.  I would
suggest the following:

   - Many developers (never mind users) did not appreciate that the opposite
   of 'public' in this context is 'anonymous'.
   - Although the wiki does explain this, the GPX upload page does not, it
   just has a 'public' checkbox.
   - It is not unreasonable for users to think that the opposite of 'public'
   is 'private' - ie, only visible to the user who uploaded the trace.
   - We should include some text next to the 'public' checkbox to explain -
   something like "Note that all GPX traces uploaded to OSM are visible to all
   users.  Selecting 'public' will associate the trace the user who uploaded
   it, otherwise it will be anonymous".

Does this sound reasonable?  I would offer to add the text myself, but I
can't find the HTML in the SVN repository.  Please will someone either make
this change (or something similar), or tell me how to do it?

Regards


Graham.

2009/4/16 Johnny Rose Carlsen 

> Frederik Ramm  wrote:
> > Karl Newman wrote:
> > > I've been around OSM for a few years now and I was not aware
> > > "private" GPS trackpoints were available for download.
> >
> > Firstly, the API does not talk of "private" GPS tracks. It only gives
> > you a checkbox saying "public".
>
> If you go to "My GPS traces", then it says PRIVATE with red letters.
>
> Maybe indicating that the traces are anonymous would be better.
>
> Best Regards,
>  - Johnny Carlsen
>
> ___
> dev mailing list
> dev@openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev
>



-- 
Dr. Graham Jones
Hartlepool, UK
email: grahamjones...@gmail.com
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Can SQLite3 handle OSM 150G data file?

2009-04-28 Thread Christoph Eckert
Hi,

> There is no reason to be sqlite slow. How much are you are using
> transactions on your local db? What are you using for import? I'm
> importing Czech republic (50Mb bziped) in one or two minutes. So for
> 5.4GB it takes 108 minutes (two hours). But I'm importig to modified osm
> schema (something like mapnik schema in postgress). It is because of
> query speed.

sounds cool. Is the Script that does the conversion from osm.xml into sqlite 
available somewhere?

Thanks & best regards,

ce

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Embedded databases

2009-04-28 Thread Tomas Kolda
As I wrote in another thread I tried sqlite to do rendering along with 
mapnik. There is no problem to do it even with builtin rtree spatial 
index. I can try to create some SVN repos to share code, but it was just 
for playing (not for production). I tweaked postgress datasource in 
mapnik and make my own implementation of storing GIS geometries, because 
of no dependecy needs. Also look to existing GIS extension for sqlite.

http://www.gaia-gis.it/spatialite/

Importing into sqlite is very fast. I'm using simple C++ importer with 
expat parser and insert all data in one transaction. Sqlite has also 
very little size overhead (about 5x size than bzipped OSM).

For my another project I use my own datastore, because it is much more 
faster than universal databases. It uses leveled Z-index. For searching 
I'm using litmax bigmin method. Its performance is great.

So you must choose between speed and simple approach. For routing you 
will need some special data store to do it fast.


Nolan Darilek napsal(a):
> I'm slowly hacking on a project that could benefit from an embedded
> database, and I'm not smart enough to create my own binary format.
> Furthermore, since we aren't usually under as severe constraints with
> embedded resources these days, an actual embedded DB makes more sense. I
> had a few questions regarding people's experiences, however.
>
> At the moment, I'm hacking on a prototype that uses Tokyo Cabinet's
> table store, and geohashes to implement geospatial searches. I'm still
> working on refining the import process so haven't experimented with how
> well searches work, and of course geohashes fail near the
> equator/meridians, so it feels a bit kludgy. Even so, my Ruby code
> imports a 13.4 meg OSM file into a 7.9M database in about a minute, so
> performance doesn't seem terrible. I'll still have to implement routing,
> though, and my geohash hack is about as far as I'll be able to take TC
> without implementing a custom geospatial datastore, which should be
> possible for someone smarter than I, but then TC's development process
> is less than ideal and I don't think it's a good fit.
>
> Has anyone used SQLite for more than rendering? There's one report of it
> working well with Mapnik and another suggestion that it might not. Does
> anyone have any other experiences to share? How about a working schema
> and some example import code?
>
> I've been reading references to MonetDB. I've googled, but its website
> seems somewhat disorganized. There appears to be a kernel atop which
> several interfaces are built? I've encountered references to geospatial
> support, and routing/embedded use was mentioned here recently. Is the
> geospatial support confined to a single implementation--only the SQL
> support, for instance--or does it work across the board? Is there any
> intro documentation anywhere? I mean, of course there are manuals and
> tutorials for each component, but what about a tying-it-all-together
> "this is what our architecture gives you that others don't" introduction
> that helps me understand, say, how the different versions can interact?
> How well does it work with Ruby? Again, either my GoogleFu is weak or
> it's just not getting used much, because while it reveals the presence
> of a Ruby library, I can't seem to find any "here's what's cool about
> this and how to start using it" blog posts or articles. Feel free to
> toss out URLs to anything I might have missed, as it certainly isn't my
> intent to use this list for discussion if there are better resources
> more readily available, but I'm just not seeing them. :) I've also
> looked through some of the server/SQL/Xquery docs, but am not clear on
> how they apply to OSM. Can an XML document be added in its XML form and
> queried via SQL somehow? Or is there some intermediate import step that
> makes the data available for routing? Or have I just mis-interpreted
> what is currently possible? :)
>
> Finally, are there any other embedded solutions I may have missed?
> Ideally, whatever format I use should be accessible via Ruby, whether
> via existing wrappers or by C libraries I can interface using FFI.
>
>
>
> ___
> dev mailing list
> dev@openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev
>   


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Can SQLite3 handle OSM 150G data file?

2009-04-28 Thread Ævar Arnfjörð Bjarmason
On Tue, Apr 28, 2009 at 12:29 PM,   wrote:
> On Tue, 28 Apr 2009 09:26:21 +0200, Stefan de Konink 
> wrote:
>> marcus.wolsc...@googlemail.com wrote:
>>> On Tue, 28 Apr 2009 08:02:30 +0100, Shaun McDonald
 SQLite isn't designed for huge databases like OpenStreetMap. You could
>
 get away with a city or small region, but more than that, you will get
>
 the slowness that you are seeing.
 http://www.sqlite.org/faq.html#q19 and some other FAQs on that page.
 You are much better using Postgres, or even MySQL.
>>>
>>> Is there ANY embedded database out there that can handle the planet?
>>> Anything that does not require the (unskilled) user of a program to
>>> install a local database-server first?
>>
>> MonetDB can be running in embedded mode ;)
>
> From what I can see at
> http://monetdb.cwi.nl/projects/monetdb/SQL/Documentation/Embedded-Server.html#Embedded-Server
> the "embedded"-mode is still a server, just for
> embedded systems.
> I was talking about having the database as a library
> be a part of the program.
> Nothing to install or to start separately.

You could always make your program embed/start the database server
regardless of whether it's a library or a server. It would just mean
e.g. shipping the postgresql binaries with your program and doing some
magic in your program that ensures that the server is started when the
program is.

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Embedded databases

2009-04-28 Thread marcus.wolschon
On Tue, 28 Apr 2009 13:34:16 -, "Nolan Darilek"

wrote:
> I'm slowly hacking on a project that could benefit from an embedded
> database, and I'm not smart enough to create my own binary format.

Have you looked at OsmBin in the wiki?
There is a complete, custom binary format on the wiki and a well
documented reference-implementation to test against. ;)

> Furthermore, since we aren't usually under as severe constraints with
> embedded resources these days, an actual embedded DB makes more sense. I
> had a few questions regarding people's experiences, however.

I tried a few and the performance it terrible for anything above 200-500MB.
(a single state, not even a single country.)
With OsmBin importing takes ages but then it's fast enough for
interactive rendering of large areas.

I'll try H2 again once they release a new version (The current one has
a known bug that makes it unusable. For small maps it has shown quite
some promise).

> At the moment, I'm hacking on a prototype that uses Tokyo Cabinet's
> table store, and geohashes to implement geospatial searches.

Do you have any reference on "geohashes"? I did not encounter the
term before. Do you mean one-way functions that turn a 2d-location into
a 1d-index similar to a Z-curve or hilbert-curve?

 I'm still
> working on refining the import process so haven't experimented with how
> well searches work, and of course geohashes fail near the
> equator/meridians,

So? Add 180° and go above the north-pole. ;) No negative numbers anymore.

> I've been reading references to MonetDB. I've googled, but its website
> seems somewhat disorganized.

I agree completely. It looks nice but you have a hard time finding
a given piece of information (if it is present at all.). I needed to
go to the small Sourceforge-link at the bottom just to see what language
monetDB was implemented in.

> How well does it work with Ruby? Again, either my GoogleFu is weak or
> it's just not getting used much, because while it reveals the presence
> of a Ruby library, I can't seem to find any "here's what's cool about
> this and how to start using it" blog posts or articles.

Same here for the Java-support in MonedDB.

Marcus

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Cloudmade routing for OSM rails_port site .

2009-04-28 Thread marcus.wolschon
On Tue, 28 Apr 2009 16:15:47 +0300, Eddy Petrișor

wrote:
> I meant "shouldn't be passed through". An exception should be made if
> one of the ends is within the private area. So in other words, the
> cost of going through an access=private node or way should be way
> higher than a regular road so that the passing should occur only if
> absolutely necessary (e.g. must leave a private area or must reach a
> private area).

Hint: 

Note that a very high cost also means that a huge number of roads
that would never lead anywhere near the destination get evaluated in
most routing-algorithms.
The proper way would probably be to threat ways with access=destination
as non-existent unless they >contain< the destination/start. However
that crossing multiple such ways to get to the nearest or the optimal
street that is generally available can be a small challenge in coding.
That is, if the internal data-format supports such rules at all.

So, access=destination is not as easy to implement as you may think.

(Same way no one has yet implemented no_uturn turn-restrictions or
turn-restrictions
 with more then 1 node or more then 0 ways in the "via" role.)

Marcus

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] Embedded databases

2009-04-28 Thread Nolan Darilek
I'm slowly hacking on a project that could benefit from an embedded
database, and I'm not smart enough to create my own binary format.
Furthermore, since we aren't usually under as severe constraints with
embedded resources these days, an actual embedded DB makes more sense. I
had a few questions regarding people's experiences, however.

At the moment, I'm hacking on a prototype that uses Tokyo Cabinet's
table store, and geohashes to implement geospatial searches. I'm still
working on refining the import process so haven't experimented with how
well searches work, and of course geohashes fail near the
equator/meridians, so it feels a bit kludgy. Even so, my Ruby code
imports a 13.4 meg OSM file into a 7.9M database in about a minute, so
performance doesn't seem terrible. I'll still have to implement routing,
though, and my geohash hack is about as far as I'll be able to take TC
without implementing a custom geospatial datastore, which should be
possible for someone smarter than I, but then TC's development process
is less than ideal and I don't think it's a good fit.

Has anyone used SQLite for more than rendering? There's one report of it
working well with Mapnik and another suggestion that it might not. Does
anyone have any other experiences to share? How about a working schema
and some example import code?

I've been reading references to MonetDB. I've googled, but its website
seems somewhat disorganized. There appears to be a kernel atop which
several interfaces are built? I've encountered references to geospatial
support, and routing/embedded use was mentioned here recently. Is the
geospatial support confined to a single implementation--only the SQL
support, for instance--or does it work across the board? Is there any
intro documentation anywhere? I mean, of course there are manuals and
tutorials for each component, but what about a tying-it-all-together
"this is what our architecture gives you that others don't" introduction
that helps me understand, say, how the different versions can interact?
How well does it work with Ruby? Again, either my GoogleFu is weak or
it's just not getting used much, because while it reveals the presence
of a Ruby library, I can't seem to find any "here's what's cool about
this and how to start using it" blog posts or articles. Feel free to
toss out URLs to anything I might have missed, as it certainly isn't my
intent to use this list for discussion if there are better resources
more readily available, but I'm just not seeing them. :) I've also
looked through some of the server/SQL/Xquery docs, but am not clear on
how they apply to OSM. Can an XML document be added in its XML form and
queried via SQL somehow? Or is there some intermediate import step that
makes the data available for routing? Or have I just mis-interpreted
what is currently possible? :)

Finally, are there any other embedded solutions I may have missed?
Ideally, whatever format I use should be accessible via Ruby, whether
via existing wrappers or by C libraries I can interface using FFI.



___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Cloudmade routing for OSM rails_port site.

2009-04-28 Thread Eddy Petrișor
On Tue, Apr 28, 2009 at 4:11 PM, Eddy Petrișor  wrote:
> On Mon, Apr 27, 2009 at 11:04 AM, Марат Хасанов  wrote:
>> Hi all!
>>
>> Let me introduce Routing for OSM!
>>
>> My name is Marat Khasanov and I’m working for CloudMade as Front-End
>> developer. Few days ago I’ve already finished routing tool for OSM project.
>> With this tool you can aOSdd your own routes between points on the map or
>> search for shortest or fastest way by car, bicycle or walking. Current
>> version is based on CM Routing API and interacts with the server over
>> cross-domain JSON requests(similarly to data and search window).
>>
>> You can find possibility to try it here:
>> http://mkhasanov.sandbox.cloudmade.com/directions (only view and routing
>> tabs works)
>
> The current algorithm doesn't take into account that roads with
> access=private or which have barriers on them with access private
> should be passed through, by default:

I meant "shouldn't be passed through". An exception should be made if
one of the ends is within the private area. So in other words, the
cost of going through an access=private node or way should be way
higher than a regular road so that the passing should occur only if
absolutely necessary (e.g. must leave a private area or must reach a
private area).

> http://mkhasanov.sandbox.cloudmade.com/directions?lat=44.42775&lon=25.99423&zoom=15&layers=B000FTFTT&travel_mode=car&waypoints=25.98,44.43,26.01013,44.43377


-- 
Regards,
EddyP
=
"Imagination is more important than knowledge" A.Einstein

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Cloudmade routing for OSM rails_port site.

2009-04-28 Thread Eddy Petrișor
On Mon, Apr 27, 2009 at 11:04 AM, Марат Хасанов  wrote:
> Hi all!
>
> Let me introduce Routing for OSM!
>
> My name is Marat Khasanov and I’m working for CloudMade as Front-End
> developer. Few days ago I’ve already finished routing tool for OSM project.
> With this tool you can aOSdd your own routes between points on the map or
> search for shortest or fastest way by car, bicycle or walking. Current
> version is based on CM Routing API and interacts with the server over
> cross-domain JSON requests(similarly to data and search window).
>
> You can find possibility to try it here:
> http://mkhasanov.sandbox.cloudmade.com/directions (only view and routing
> tabs works)

The current algorithm doesn't take into account that roads with
access=private or which have barriers on them with access private
should be passed through, by default:

http://mkhasanov.sandbox.cloudmade.com/directions?lat=44.42775&lon=25.99423&zoom=15&layers=B000FTFTT&travel_mode=car&waypoints=25.98,44.43,26.01013,44.43377

And, as Maarten said, the Permalink is not precise enough, it should
provide 5 decimals to be effective in locating a point.


Another problem is that the default shortest route for cars should
probably avoid tracks, or a "shortest on paved roads" algorithm should
be provided.

Problem visible here:
http://mkhasanov.sandbox.cloudmade.com/directions?lat=44.3905&lon=26.0228&zoom=13&layers=B000FTFTT&travel_mode=car/shortest&waypoints=25.99,44.41,25.99,44.38

Also, the fast and short route could be the same if the difference
isn't noticiable like above, where both the fast and the short route
are allegedly 4.7km long.


> Now it is easy to make your maps better and your mapping more effective
> finding not crossing roads or other lacks of existing maps. I appreciate
> community feedback and waiting till you review this functionality and
> attached patch.
>
> Marat.
>
>
> ___
> dev mailing list
> dev@openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev
>
>



-- 
Regards,
EddyP
=
"Imagination is more important than knowledge" A.Einstein

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Problems with rendering tiles with mapnik

2009-04-28 Thread Dirk-Lüder Kreie
Mohamad Ali schrieb:
> Hi,
> 
> I am trying to follow step by step this tutorial:  
>  
> www.weait.com/content/make-your-first-map
> 
>  
> 
> But when I try this command I get this error
> 
> u...@pc1:~/mapnik$ source set-mapnik-env
> bash: #!/bin/sh: No such file or directory,

Your Linux(?) Distro seems to be missing the shell. On most distros this
is just a symlink to /bin/bash.
You have 3 options at this point.

a) Install sh
b) symlink /bin/bash to /bin/sh (quite safe, because bash can do
everything sh can, and will even behave more like sh when called as /bin/sh)
c) edit all the shellscripts in mapnik to use #!/bin/bash in the first
line instead of #!/bin/sh


-- 

Dirk-Lüder "Deelkar" Kreie
Bremen - 53.0952°N 8.8652°E



signature.asc
Description: OpenPGP digital signature
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Can SQLite3 handle OSM 150G data file?

2009-04-28 Thread marcus.wolschon
On Tue, 28 Apr 2009 09:26:21 +0200, Stefan de Konink 
wrote:
> marcus.wolsc...@googlemail.com wrote:
>> On Tue, 28 Apr 2009 08:02:30 +0100, Shaun McDonald
>>> SQLite isn't designed for huge databases like OpenStreetMap. You could 

>>> get away with a city or small region, but more than that, you will get 

>>> the slowness that you are seeing.
>>> http://www.sqlite.org/faq.html#q19 and some other FAQs on that page.
>>> You are much better using Postgres, or even MySQL.
>> 
>> Is there ANY embedded database out there that can handle the planet?
>> Anything that does not require the (unskilled) user of a program to
>> install a local database-server first?
> 
> MonetDB can be running in embedded mode ;)

>From what I can see at
http://monetdb.cwi.nl/projects/monetdb/SQL/Documentation/Embedded-Server.html#Embedded-Server
the "embedded"-mode is still a server, just for
embedded systems.
I was talking about having the database as a library
be a part of the program.
Nothing to install or to start separately.

Marcus

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Problems with rendering tiles with mapnik

2009-04-28 Thread Barnett, Phillip
DISCLAIMER - I have not set up a mapnik server or followed these instructions.

Your error message is probably because it doesn’t understand ‘source’ – do you 
have this program/script installed? Might be from TCL if I read it correctly. 
Or it can’t find the file set-mapnik-env – try changing to the directory it’s 
in (mapnik?)

Do not omit the leading periods just means write the line exactly as shown, 
without skipping the dots at the start. This is again so that your OS knows 
where to find the scripts referred to.

Good luck



[http://www.itn.co.uk/images/ITN_Master_blue.gif]
PHILLIP BARNETT
SERVER MANAGER

200 GRAY'S INN ROAD
LONDON
WC1X 8XZ
UNITED KINGDOM
T +44 (0)20 7430 4474
F
E phillip.barn...@itn.co.uk
WWW.ITN.CO.UK
P  Please consider the environment. Do you really need to print this email?


From: dev-boun...@openstreetmap.org [mailto:dev-boun...@openstreetmap.org] On 
Behalf Of Mohamad Ali
Sent: 28 April 2009 04:08
To: dev@openstreetmap.org
Subject: [OSM-dev] Problems with rendering tiles with mapnik

Hi,
I am trying to follow step by step this tutorial: 
www.weait.com/content/make-your-first-map

But when I try this command I get this error
u...@pc1:~/mapnik$ source set-mapnik-env
bash: #!/bin/sh: No such file or directory,


also in tutorial, what that mean:
Do not omit the leading periods on lines two and three.
source set-mapnik-env
./customize-mapnik-map >$MAPNIK_MAP_FILE
./z0_generate_tiles.py

Thanks Guys
Please Note:

 

Any views or opinions are solely those of the author and do not necessarily 
represent 
those of Independent Television News Limited unless specifically stated. 
This email and any files attached are confidential and intended solely for the 
use of the individual
or entity to which they are addressed. 
If you have received this email in error, please notify postmas...@itn.co.uk 

Please note that to ensure regulatory compliance and for the protection of our 
clients and business,
we may monitor and read messages sent to and from our systems.

Thank You.

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Can SQLite3 handle OSM 150G data file?

2009-04-28 Thread Stefan de Konink
On Tue, 28 Apr 2009, Matt Amos wrote:

> > MonetDB can be running in embedded mode ;)
>
> seriously, you should get paid for the amount you promote MonetDB ;-)

Yes, the CWI is short for ClouWdmaIde ;) We also do routing-APIs ;)


Stefan


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Can SQLite3 handle OSM 150G data file?

2009-04-28 Thread Matt Amos
On Tue, Apr 28, 2009 at 8:26 AM, Stefan de Konink  wrote:
> marcus.wolsc...@googlemail.com wrote:
>> On Tue, 28 Apr 2009 08:02:30 +0100, Shaun McDonald
>>> SQLite isn't designed for huge databases like OpenStreetMap. You could
>>> get away with a city or small region, but more than that, you will get
>>> the slowness that you are seeing.
>>> http://www.sqlite.org/faq.html#q19 and some other FAQs on that page.
>>> You are much better using Postgres, or even MySQL.
>>
>> Is there ANY embedded database out there that can handle the planet?
>> Anything that does not require the (unskilled) user of a program to
>> install a local database-server first?
>
> MonetDB can be running in embedded mode ;)

seriously, you should get paid for the amount you promote MonetDB ;-)

cheers,

matt

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [josm-dev] Deletion conflicts

2009-04-28 Thread Shaun McDonald

On 28 Apr 2009, at 09:23, Frederik Ramm wrote:

> Hi,
>
> Shaun McDonald wrote:
>> It is already possible to do a multiget,
>
> ... which will return 404 as soon as any one of its targets has been  
> deleted ;-)
>

Nope, you will only get a 404 if the elements have never existed  
before. If it has been deleted you will get a visible=false. Take this  
example:
http://openstreetmap.org/api/0.6/nodes?nodes=15,18

The maximum number you can request at one time is limited by the  
length of the GET request, there are no limits set our code, so you  
may need to bulk it into groups like the gps points call.

We could change the call to silently drop the 404, and always return  
all elements that it could find, with only the elements that could not  
be found being missing from the list. If no requested ids could be  
found, then and osm document with no nodes, ways and relations would  
be returned.

Shaun


___
josm-dev mailing list
josm-...@openstreetmap.org
http://lists.openstreetmap.org/listinfo/josm-dev


Re: [OSM-dev] API: version number of newly created objects.

2009-04-28 Thread Chris Browet
Thanks

- Chris -

2009/4/28 Frederik Ramm 

> Hi,
>
> Chris Browet wrote:
>
>> As a creation PUT do not return the version number (AFAIK), does that mean
>> that we are suppose to do a "GET" on the newly created object to get the
>> version number?
>>
>
> No, that would be the stupidest API. I have fixed the Wiki page. Assume new
> versions to always be "1". If this ever gets changed in the API then the
> creation call will have to be changed to return the version number as well.
>
> Bye
> Frederik
>
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] API: version number of newly created objects.

2009-04-28 Thread Frederik Ramm
Hi,

Chris Browet wrote:
> As a creation PUT do not return the version number (AFAIK), does that mean
> that we are suppose to do a "GET" on the newly created object to get the
> version number?

No, that would be the stupidest API. I have fixed the Wiki page. Assume 
new versions to always be "1". If this ever gets changed in the API then 
the creation call will have to be changed to return the version number 
as well.

Bye
Frederik

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] API: version number of newly created objects.

2009-04-28 Thread D Tucny
2009/4/28 Chris Browet 

> Hi,
>
> I see in the api doc:
> "Version numbers will most of the time begin at *1* and increase by *1*every 
> time an element is changed but this behaviour is not guaranteed and
> should not be relied upon"
> I understand that phrase as "I cannot assume that a newly created object
> will be at version 1".
>
> As a creation PUT do not return the version number (AFAIK), does that mean
> that we are suppose to do a "GET" on the newly created object to get the
> version number?
>

If you do a diff upload (
http://wiki.openstreetmap.org/wiki/OSM_Protocol_Version_0.6#Diff_upload:_POST_.2Fapi.2F0.6.2Fchangeset.2F.23id.2Fupload)
you will get the version number back in the response and if you update an
existing individual object you will get the version number in the response,
but, as you say, as documented, creating an individual object won't return
the version... I don't know for sure, but, I'd hope that the version number
starting at 1 bit is guaranteed even if the increase by 1 isn't...

d
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Can SQLite3 handle OSM 150G data file?

2009-04-28 Thread Tomas Kolda
There is no reason to be sqlite slow. How much are you are using 
transactions on your local db? What are you using for import? I'm 
importing Czech republic (50Mb bziped) in one or two minutes. So for 
5.4GB it takes 108 minutes (two hours). But I'm importig to modified osm 
schema (something like mapnik schema in postgress). It is because of 
query speed.


I'm playing with sqlite and Mapnik. Sqlite knows RTree spatial index and 
with small modification to mapnik (sqlite datasource) it runs ok. If you 
use 8x8 tile per render, it is quite fast.


RTree in sqlite is fast, but there is overhead, when you use one bound 
rect per entity and also with mapnik (it queries many times per one 
render for same area). But if you do not need speed it works.


Tomas

Shaun McDonald napsal(a):

On 28 Apr 2009, at 00:16, Kelly Jones wrote:

  

I've seen many posts saying that SQLite2 can't handle OpenStreetMap's
large planet.osm data file:

http://planet.openstreetmap.org/planet-090421.osm.bz2

which is 5.4G bzip2 compressed, about 150G uncompressed.

Can SQLite3 handle this? Has anyone tried?

I tried to do this myself, but I'm on a slow machine and it's taking
too long (several days so far). If someone's done this, can I get a  
copy?





SQLite isn't designed for huge databases like OpenStreetMap. You could  
get away with a city or small region, but more than that, you will get  
the slowness that you are seeing.

http://www.sqlite.org/faq.html#q19 and some other FAQs on that page.
You are much better using Postgres, or even MySQL.

Shaun


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev
  


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Can SQLite3 handle OSM 150G data file?

2009-04-28 Thread Stefan de Konink
marcus.wolsc...@googlemail.com wrote:
> On Tue, 28 Apr 2009 08:02:30 +0100, Shaun McDonald
>> SQLite isn't designed for huge databases like OpenStreetMap. You could  
>> get away with a city or small region, but more than that, you will get  
>> the slowness that you are seeing.
>> http://www.sqlite.org/faq.html#q19 and some other FAQs on that page.
>> You are much better using Postgres, or even MySQL.
> 
> Is there ANY embedded database out there that can handle the planet?
> Anything that does not require the (unskilled) user of a program to
> install a local database-server first?

MonetDB can be running in embedded mode ;)


Stefan

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Can SQLite3 handle OSM 150G data file?

2009-04-28 Thread marcus.wolschon
On Tue, 28 Apr 2009 08:02:30 +0100, Shaun McDonald
> SQLite isn't designed for huge databases like OpenStreetMap. You could  
> get away with a city or small region, but more than that, you will get  
> the slowness that you are seeing.
> http://www.sqlite.org/faq.html#q19 and some other FAQs on that page.
> You are much better using Postgres, or even MySQL.

Is there ANY embedded database out there that can handle the planet?
Anything that does not require the (unskilled) user of a program to
install a local database-server first?

Marcus

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Can SQLite3 handle OSM 150G data file?

2009-04-28 Thread Shaun McDonald

On 28 Apr 2009, at 00:16, Kelly Jones wrote:

> I've seen many posts saying that SQLite2 can't handle OpenStreetMap's
> large planet.osm data file:
>
> http://planet.openstreetmap.org/planet-090421.osm.bz2
>
> which is 5.4G bzip2 compressed, about 150G uncompressed.
>
> Can SQLite3 handle this? Has anyone tried?
>
> I tried to do this myself, but I'm on a slow machine and it's taking
> too long (several days so far). If someone's done this, can I get a  
> copy?
>

SQLite isn't designed for huge databases like OpenStreetMap. You could  
get away with a city or small region, but more than that, you will get  
the slowness that you are seeing.
http://www.sqlite.org/faq.html#q19 and some other FAQs on that page.
You are much better using Postgres, or even MySQL.

Shaun


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev