Re: [OSM-dev] Question running osmosis (node-key-value and way-key-value at the same time)

2009-06-23 Thread Karl Newman
On Tue, Jun 23, 2009 at 6:11 PM, Brett Henderson  wrote:

> Karl Newman wrote:
>
>>
>> What's happening there is that the node-key-value and way-key-value are
>> ANDed together (which would leave you with only ways which match your tags
>> and are composed of nodes tagged place=city), and you want an OR instead.
>> You were sort of on the right track with the pipes, but what you need to do
>> is use the "tee" function and apply the node-key-value filter to one leg of
>> the tee, and apply the way-key-value filter to the other leg of the tee,
>> then use the "merge" function to join the results. It would look something
>> like this:
>>
>> ./osmosis-0.31/bin/osmosis --read-xml file="planet.bz2" --tee
>> outputCount=2 outPipe.0="nodes" outPipe.1="ways" --node-key-value
>> keyValueList="place.city" inPipe.0="nodes" --way-key-value
>> keyValueList="highway.motorway,highway.motorway_link,highway.motorway_junction,highway.trunk,highway.trunk_link"
>> inPipe.0="ways" --merge --write-xml file="basemap.osm"
>>
>> I'm not sure if that will work exactly as written. You may need to add
>> outPipe arguments to the node-key-value and way-key-value filters and then
>> reference them as inPipe.0 and inPipe.1 arguments to the merge task.
>>
> You may trigger a deadlock in this situation ... I've been waiting for
> somebody to try this out for a long time :-)
>
> While it's possible to construct a pipeline that tees a single dataset into
> multiple streams before merging them back together again, it is problematic
> from thread synchronisation point of view because the same input thread is
> feeding two inputs of another thread.  Using a --buffer task within both
> paths of the branch may help because it de-couples the threads somewhat with
> a buffer.
>
> The --read-xml task creates a thread which passes data into the --tee task.
>  The --tee task doesn't create a thread, it just uses the existing thread to
> pass incoming data to all consumers.  The --node-key-value and
> --way-key-value also use the existing thread to write to their destination
> which in both cases is the --merge task.  The --merge task creates a new
> thread which reads the incoming data from both of its inputs, but both
> inputs are coming from a single thread (ie. the original --read-xml thread).
>  The --merge thread may read from one input, then start waiting for a
> specific value on the the other input and never receive it.
>
> But if it works let me know.  I'm curious :-)
>
> Brett
>

Hmm... I didn't look at the code too closely. I thought the tee created
separate threads. I'm trying to see what might cause a deadlock--it looks
like it would happen in DataPostBox if anywhere--but it's not obvious what
might trigger it. I guess what could happen is if the merge task is trying
to get entities from both pipelines to compare them, and there isn't
anything available in one of the pipelines, that might deadlock it. I guess
someone will have to try it and see!

Karl
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Question running osmosis (node-key-value and way-key-value at the same time)

2009-06-23 Thread Brett Henderson
Karl Newman wrote:
>
> What's happening there is that the node-key-value and way-key-value 
> are ANDed together (which would leave you with only ways which match 
> your tags and are composed of nodes tagged place=city), and you want 
> an OR instead. You were sort of on the right track with the pipes, but 
> what you need to do is use the "tee" function and apply the 
> node-key-value filter to one leg of the tee, and apply the 
> way-key-value filter to the other leg of the tee, then use the "merge" 
> function to join the results. It would look something like this:
>
> ./osmosis-0.31/bin/osmosis --read-xml file="planet.bz2" --tee 
> outputCount=2 outPipe.0="nodes" outPipe.1="ways" --node-key-value 
> keyValueList="place.city" inPipe.0="nodes" --way-key-value 
> keyValueList="highway.motorway,highway.motorway_link,highway.motorway_junction,highway.trunk,highway.trunk_link"
>  
> inPipe.0="ways" --merge --write-xml file="basemap.osm"
>
> I'm not sure if that will work exactly as written. You may need to add 
> outPipe arguments to the node-key-value and way-key-value filters and 
> then reference them as inPipe.0 and inPipe.1 arguments to the merge task.
You may trigger a deadlock in this situation ... I've been waiting for 
somebody to try this out for a long time :-)

While it's possible to construct a pipeline that tees a single dataset 
into multiple streams before merging them back together again, it is 
problematic from thread synchronisation point of view because the same 
input thread is feeding two inputs of another thread.  Using a --buffer 
task within both paths of the branch may help because it de-couples the 
threads somewhat with a buffer.

The --read-xml task creates a thread which passes data into the --tee 
task.  The --tee task doesn't create a thread, it just uses the existing 
thread to pass incoming data to all consumers.  The --node-key-value and 
--way-key-value also use the existing thread to write to their 
destination which in both cases is the --merge task.  The --merge task 
creates a new thread which reads the incoming data from both of its 
inputs, but both inputs are coming from a single thread (ie. the 
original --read-xml thread).  The --merge thread may read from one 
input, then start waiting for a specific value on the the other input 
and never receive it.

But if it works let me know.  I'm curious :-)

Brett


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Question running osmosis (node-key-value and way-key-value at the same time)

2009-06-23 Thread Karl Newman
On Tue, Jun 23, 2009 at 3:56 PM, Christoph Eckert  wrote:

> Hi Brett,
>
> > That type of error is usually because you're running java 1.5 or older.
> > From your previous emails you seem to be running java 1.6 which should
> > be okay.  Can you double check to make sure you're still using 1.6?  If
> > you are then I'm not sure what's going on ...
>
> there's a global Java 1.5 installation, and a local 1.6 installation in
> ~/bin/
> I adjusted the osmosis shell script to use the latter one and yeah, it's up
> and running! Thanks a bunch for the help.
>
> Of course it immediately triggers the next question :) . I try to extract
> some
> data from an osm file which shall only contain the base net of roads,
> railways and cities. E.g. I do:
> ./osmosis-0.31/bin/osmosis
> --read-xml file="planet.bz2"
> --node-key-value keyValueList="place.city"
> --way-key-value
>
> keyValueList="highway.motorway,highway.motorway_link,highway.motorway_junction,highway.trunk,highway.trunk_link"
> --write-xml file="basemap.osm"
>
> This only writes nodes, no ways at all. Removing the nodes, it will write
> ways:
>
> ./osmosis-0.31/bin/osmosis
> --read-xml file="planet.bz2"
> --way-key-value
>
> keyValueList="highway.motorway,highway.motorway_link,highway.motorway_junction,highway.trunk,highway.trunk_link"
> --write-xml file="basemap.osm"
>
> So I thought I need to use the pipes as found in the documentation. So I
> tried:
>
> ./osmosis-0.31/bin/osmosis
> --read-xml file="planet.bz2"
> outPipe.0="readpipe"
> --node-key-value keyValueList="place.city"
> inPipe.0="readpipe" outPipe.0="outpipe"
> --way-key-value
>
> keyValueList="highway.motorway,highway.motorway_link,highway.motorway_junction"
> inPipe.0="readpipe" outPipe.0="outpipe"
> --write-xml file="basemap.osm"
> inPipe.0="outpipe"
>
> However, osmosis does not like my syntax. I'm obviously using the pipes in
> a
> wrong or at least unsupported :) manner. Any hint is much appreciated. Do I
> need the pipes in this case? If so, what should I change? Or an alternative
> syntax?
>
> Thanks & best regards,
>
> ce
>

What's happening there is that the node-key-value and way-key-value are
ANDed together (which would leave you with only ways which match your tags
and are composed of nodes tagged place=city), and you want an OR instead.
You were sort of on the right track with the pipes, but what you need to do
is use the "tee" function and apply the node-key-value filter to one leg of
the tee, and apply the way-key-value filter to the other leg of the tee,
then use the "merge" function to join the results. It would look something
like this:

./osmosis-0.31/bin/osmosis --read-xml file="planet.bz2" --tee outputCount=2
outPipe.0="nodes" outPipe.1="ways" --node-key-value
keyValueList="place.city" inPipe.0="nodes" --way-key-value
keyValueList="highway.motorway,highway.motorway_link,highway.motorway_junction,highway.trunk,highway.trunk_link"
inPipe.0="ways" --merge --write-xml file="basemap.osm"

I'm not sure if that will work exactly as written. You may need to add
outPipe arguments to the node-key-value and way-key-value filters and then
reference them as inPipe.0 and inPipe.1 arguments to the merge task.

Karl
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] The map key isn't static anymore

2009-06-23 Thread Ævar Arnfjörð Bjarmason
On Tue, Jun 23, 2009 at 10:45 PM, Tom Hughes wrote:
> Actually it probably won't be live for a while as the solution looks like it
> is a complete mess that won't scale to handling the other map layers. I need
> to review it fully but right now I'm not hopeful from a quick glance.

It's a hack, but the original implementation that has been there for
two years doesn't support anything but the default mapnik rendering
either and osmarender/cyclemap haven't submitted a map key for their
rendering in that time.

It's easy enough to add the support if there's a need, but thus far
there hasn't been so I didn't see the point of spending time on
something that might not be used for the foreseeable future.

Not being able to translate this aspect of the interface however is a
current problem.

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Question running osmosis (node-key-value and way-key-value at the same time)

2009-06-23 Thread Christoph Eckert
Hi Brett,

> That type of error is usually because you're running java 1.5 or older.  
> From your previous emails you seem to be running java 1.6 which should
> be okay.  Can you double check to make sure you're still using 1.6?  If
> you are then I'm not sure what's going on ...

there's a global Java 1.5 installation, and a local 1.6 installation in ~/bin/
I adjusted the osmosis shell script to use the latter one and yeah, it's up 
and running! Thanks a bunch for the help.

Of course it immediately triggers the next question :) . I try to extract some 
data from an osm file which shall only contain the base net of roads, 
railways and cities. E.g. I do:
./osmosis-0.31/bin/osmosis
--read-xml file="planet.bz2"
--node-key-value keyValueList="place.city"
--way-key-value 
keyValueList="highway.motorway,highway.motorway_link,highway.motorway_junction,highway.trunk,highway.trunk_link"
--write-xml file="basemap.osm"

This only writes nodes, no ways at all. Removing the nodes, it will write 
ways:

./osmosis-0.31/bin/osmosis
--read-xml file="planet.bz2"
--way-key-value 
keyValueList="highway.motorway,highway.motorway_link,highway.motorway_junction,highway.trunk,highway.trunk_link"
--write-xml file="basemap.osm"

So I thought I need to use the pipes as found in the documentation. So I 
tried:

./osmosis-0.31/bin/osmosis
--read-xml file="planet.bz2"
outPipe.0="readpipe"
--node-key-value keyValueList="place.city"
inPipe.0="readpipe" outPipe.0="outpipe"
--way-key-value 
keyValueList="highway.motorway,highway.motorway_link,highway.motorway_junction" 
inPipe.0="readpipe" outPipe.0="outpipe"
--write-xml file="basemap.osm"
inPipe.0="outpipe"

However, osmosis does not like my syntax. I'm obviously using the pipes in a 
wrong or at least unsupported :) manner. Any hint is much appreciated. Do I 
need the pipes in this case? If so, what should I change? Or an alternative 
syntax?

Thanks & best regards,

ce



___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] The map key isn't static anymore

2009-06-23 Thread Tom Hughes
2009/6/23 Ævar Arnfjörð Bjarmason 

The map key is now a HTML table instead of a static PNG image as can
> be seen on the dev server (click "Map key"):
>
> http://api06.dev.openstreetmap.org/
>
> (Should be on the main site soon)
>

Actually it probably won't be live for a while as the solution looks like it
is a complete mess that won't scale to handling the other map layers. I need
to review it fully but right now I'm not hopeful from a quick glance.

Jon Burgess/Steve Chilton - if you're reading this do you have any issues
with the way it's been done in terms of of how it interacts with the way you
create the original key images?

Tom

-- 
Tom Hughes (t...@compton.nu)
http://www.compton.nu/
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Osmosis and Postgresql

2009-06-23 Thread Brett Henderson
Jeffrey Warren wrote:
> I dropped it as well; there are many instances of data in the planet 
> dump which do not meet the constraint; do you know what part of the 
> codebase does in fact rely upon the constraints?
I'm not familiar with the internals of the rails API.  However I suspect 
that nothing relies directly on that constraint and that everything will 
work without it.  Hopefully those with rails knowledge will contradict 
me if I'm wrong :-)

Brett


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Osmosis and Postgresql

2009-06-23 Thread Graham Jones
Jeffrey,
I can't help with your error, I'm afraid, but if you have an up to date
description of the database schema I would be happy to add it ot the summary
page I am writing.
I think that http://wiki.openstreetmap.org/wiki/Database/Model is supposed
to be a description of the main API DB schema, but it is labelled as out of
date, so maybe this would be a good place for your description to be stored?

Regards


Graham.

2009/6/22 Jeffrey Warren 

> Hi, I'm compiling a very long description of a Postgres/Rails port schema
> import, though I'm writing directly to the db. I'd be happy to share/post my
> notes on the process as I managed to get around a number of undocumented
> problems.
> I'm still not done right now (i've been pinging the list here occasionally)
> and my latest problem is that I'm getting several errors like the following:
>
>
> ERROR:  insert or update on table "current_way_nodes" violates foreign key
> constraint "current_way_nodes_node_id_fkey"
>
> DETAIL:  Key (node_id)=(17704640) is not present in table "current_nodes".
>
>
> ** Error **
>
>
> ERROR: insert or update on table "current_way_nodes" violates foreign key
> constraint "current_way_nodes_node_id_fkey"
>
> SQL state: 23503
>
> Detail: Key (node_id)=(17704640) is not present in table "current_nodes".
>
>
> These are current_way_nodes which were not deleted from the current_ table
> when their matching current_nodes were deleted. I'm now trying to delete
> them manually since this only occurs where nodes are visible=false, but it's
> confusing when this causes the foreign key constraint creation to fail:
>
>
> ALTER TABLE ONLY current_way_nodes
>
> ADD CONSTRAINT current_way_nodes_node_id_fkey FOREIGN KEY (node_id)
> REFERENCES current_nodes(id);
>
>
> Has anyone else encountered this? Is there a better way to resolve it?
>
> I tried following how the rails port actually deletes from current_nodes,
> but was unable to find it; is this done outside rails code? Can someone
> point to a line number where this is done so I can try to find out why the
> dependent current_way_node record wasn't deleted also? Hopefully this will
> eliminate this problem for future submitted changesets.
>
> Jeff
>
>  history of a node with leftover current_way_node ==
>
> 
> 
>user="southglos" uid="3937" visible="true" timestamp="2006-10-06T11:08:17Z"
> version="1">
> 
>   
>user="Strange but untrue" uid="57932" visible="true"
> timestamp="2009-04-16T22:28:59Z" version="2"/>
>user="Strange but untrue" uid="57932" visible="true"
> timestamp="2009-04-16T22:31:23Z" version="3"/>
>user="Strange but untrue" uid="57932" visible="true"
> timestamp="2009-04-16T22:32:07Z" version="4"/>
>user="Strange but untrue" uid="57932" visible="true"
> timestamp="2009-04-16T22:32:19Z" version="5"/>
>user="Strange but untrue" uid="57932" visible="false"
> timestamp="2009-04-16T22:32:21Z" version="6"/>
> 
>
>
>
> On Mon, Jun 22, 2009 at 4:09 PM, 80n <80n...@gmail.com> wrote:
>
>> On Mon, Jun 22, 2009 at 2:29 AM, Brett Henderson wrote:
>>
>>> Graham Jones wrote:
>>> > Brett,
>>> >
>>> > I'll have a look at --write-pgsql-dump and add some words about that
>>> > too.  Then I'll have a go at MySQL...
>>> >
>>> > The other thing I would like to add is a write-up on choosing a
>>> > database to use, because it is not obvious to me which would be the
>>> > best, but I suspect this has been looked at a lot before now.  I think
>>> > the choices are:
>>> I'm not aware of a page summarising this, so it sounds very useful.
>>> Lots of people ask about it.
>>> >
>>> > * PostgreSQL/PostGIS - Can handle big datasets, and has geographic
>>> >   extensions.  What I do not know is whether these extensions are
>>> >   fast or not, or if for simple things like selecting for a
>>> >   bounding box it would be quicker to just select on lat/lon
>>> >   directly.   Mapnik uses this database, but the schema is
>>> >   optimised for rendering.
>>> >
>>> There's actually 3 PostgreSQL schemas which causes much confusion:
>>> 1. The API database.  This is the database behind the main OSM
>>> ruby-based API.  This is supported by the osmosis "apidb" tasks.  The
>>> only db capable of holding full history.
>>> 2. The Mapnik database.  Used by the mapnik renderer.  Loaded using
>>> osm2pgsql.  Not supported by osmosis.  Uses PostGIS extensions.  Holds a
>>> filtered subset of data appropriate for rendering.
>>> 3. The pgsql "simple" schema.  Badly named, but this is a schema I
>>> created for holding OSM snapshots (ie. doesn't maintain history).  It
>>> does support replication for keeping it up to date.  Uses PostGIS
>>> extensions.  Used by ROMA servers.
>>>
>>> All three schemas above can support minutely updates, 1 and 3 by
>>> osmosis, 2 by osm2pgsql.
>>> >
>>> >*
>>> >
>>> >
>>> > * MySQL - Can handle big datasets, but does not have geographic
>>> >   estensions.
>>> >
>>> This is the same schema as th

[OSM-dev] The map key isn't static anymore

2009-06-23 Thread Ævar Arnfjörð Bjarmason
The map key is now a HTML table instead of a static PNG image as can
be seen on the dev server (click "Map key"):

http://api06.dev.openstreetmap.org/

(Should be on the main site soon)

There's lots of room for improvement here, and much easier to make
those improvements now that it's not static:

* It doesn't correspond very well to the map.

E.g. zoom level 2 still shows motorway/trunk roads in the map key even
though they're nowhere to be found, if someone would collate a list of
what's visible on each zoom level (the possible values are under
"mapkey_values" here:
http://trac.openstreetmap.org/browser/sites/rails_port/app/views/site/_key.html.erb
) then that could be used to improve the map.

Maybe such a list could be maintained on the wiki, as long as it's in
a format that's reasonably easy to parse I could write a script that
generated _key.html.erb periodically from it.

* Stuff is missing

There are no icons for tertiary roads to name one obvious example, and
lots of other stuff is missing.

The icons are really easy to make now, here's an example:
http://api06.dev.openstreetmap.org/images/mapkey/motorway.png

* It's easier to support other renderers now

Maybe projects like osmarender would like to have their own map key?
If they generate the appropriate icons it should be easy to add them.

* Do we want to link to the wiki?

If we had a list of how wiki pages relate to the tag names (which
should be easy enough to generate) we could link from each row in the
map key to the appropriate wiki page, is this a good idea?

* Your pet-peeve here

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] OAuth

2009-06-23 Thread Stefan Baebler
> please DO NOT revert my work without talking to me first. OSM doesn't
> stop just because you're on holiday.
+1
Do not get me wrong. Tom undoubtedly puts in a lot of effort and does
great work. However, if the huge community relies on a single person
to do all code checks before deploying it, and this cannot be (even
temporarily, during planned vacations) delegated to anyone else
(skilled and trustworthy enough), we have a continuity problem that
needs to be addressed. Tom deserves better holidays.

Stefan
/disclaimer: I did a similar thingy a week ago, having a slight clash
with Tom, so my view probably isn't perfectly unbiased. But that gave
me some time to think about it.

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Duplicate county - Huntingdon, PA

2009-06-23 Thread Ian Dees
On Tue, Jun 23, 2009 at 1:08 PM, Andy Allan  wrote:

> On Tue, Jun 23, 2009 at 6:45 PM, Frederik Ramm wrote:
> > Hi,
> >
> > Andy Allan wrote:
> >>
> >> Anyone fancy a challenge? It looks to me like an entire county has
> >> been duplicated in Pennsylvania - Huntingdon, PA. Looks like Milenko
> >> and DaveHansen both uploaded copies a day apart from one another.
> >
> > How could this have gone unnoticed for so long?
>
> How many contributors do we have in that county? How many OSM-checking
> websites are "Europe-only"?


It'd be interesting to write an app that searches for ways with similar*
tags within a certain** distance across the planet.

* It would be very tricky to figure out what "similar" means. Same highway
tags? A certain number of characters that match up in the name?

** Distance might be tricky to fine-tune. I imagine most of the duplicates
are either exactly the same (distance = 0) or very very close.

This would also take a long time to run.

Sounds like fun! Let's do it. Any similar ideas?
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Duplicate county - Huntingdon, PA

2009-06-23 Thread Andy Allan
On Tue, Jun 23, 2009 at 6:45 PM, Frederik Ramm wrote:
> Hi,
>
> Andy Allan wrote:
>>
>> Anyone fancy a challenge? It looks to me like an entire county has
>> been duplicated in Pennsylvania - Huntingdon, PA. Looks like Milenko
>> and DaveHansen both uploaded copies a day apart from one another.
>
> How could this have gone unnoticed for so long?

How many contributors do we have in that county? How many OSM-checking
websites are "Europe-only"?

Seriously, I've been working on a secret project* for the last couple
of months, and most interstates are duplicated with pre-TIGER
osm-volunteer data, and both are a complete mess. If the interstates
aren't being looked after by anyone, then I'd guess a lot of counties
have had only trivial changes in the last two years.

It would be interesting if anyone wants to try spotting other counties
in the same situation. Newbies will be put off immediately if they
find things like these.

Cheers,
Andy

* It sounds so much more cool if I call it secret. It's not really.

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Duplicate county - Huntingdon, PA

2009-06-23 Thread Frederik Ramm
Hi,

Andy Allan wrote:
> Anyone fancy a challenge? It looks to me like an entire county has
> been duplicated in Pennsylvania - Huntingdon, PA. Looks like Milenko
> and DaveHansen both uploaded copies a day apart from one another.

How could this have gone unnoticed for so long?

Bye
Frederik

-- 
Frederik Ramm  ##  eMail frede...@remote.org  ##  N49°00'09" E008°23'33"

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] Duplicate county - Huntingdon, PA

2009-06-23 Thread Andy Allan
Hi all,

Anyone fancy a challenge? It looks to me like an entire county has
been duplicated in Pennsylvania - Huntingdon, PA. Looks like Milenko
and DaveHansen both uploaded copies a day apart from one another.

http://www.openstreetmap.org/browse/way/11820101
http://www.openstreetmap.org/browse/way/11911506

and so on. And does anyone fancy doing some digging in counties that
are neighbouring either in space or time to see if there's a more
widespread problem?

Cheers,
Andy

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Osmosis and Postgresql

2009-06-23 Thread Jeffrey Warren
I dropped it as well; there are many instances of data in the planet dump
which do not meet the constraint; do you know what part of the codebase does
in fact rely upon the constraints?
Jeff

On Tue, Jun 23, 2009 at 9:09 AM, Brett Henderson  wrote:

>  Jeffrey Warren wrote:
>
> Hi, I'm compiling a very long description of a Postgres/Rails port schema
> import, though I'm writing directly to the db. I'd be happy to share/post my
> notes on the process as I managed to get around a number of undocumented
> problems.
>  I'm still not done right now (i've been pinging the list here
> occasionally) and my latest problem is that I'm getting several errors like
> the following:
>
>
>  ERROR:  insert or update on table "current_way_nodes" violates foreign
> key constraint "current_way_nodes_node_id_fkey"
>
> DETAIL:  Key (node_id)=(17704640) is not present in table "current_nodes".
>
>
>  ** Error **
>
>
>  ERROR: insert or update on table "current_way_nodes" violates foreign key
> constraint "current_way_nodes_node_id_fkey"
>
> SQL state: 23503
>
> Detail: Key (node_id)=(17704640) is not present in table "current_nodes".
>
>
>  These are current_way_nodes which were not deleted from the current_
> table when their matching current_nodes were deleted. I'm now trying to
> delete them manually since this only occurs where nodes are visible=false,
> but it's confusing when this causes the foreign key constraint creation to
> fail:
>
>
>  ALTER TABLE ONLY current_way_nodes
>
> ADD CONSTRAINT current_way_nodes_node_id_fkey FOREIGN KEY (node_id)
> REFERENCES current_nodes(id);
>
>
>  Has anyone else encountered this? Is there a better way to resolve it?
>
> When testing local imports I drop that constraint from the database.  I'm
> not aware of any better ways of solving the problem.
>
> Brett
>
>
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Improved i18n diff script for railsport translators

2009-06-23 Thread Vitor George
On Tue, Jun 23, 2009 at 10:34 AM, Ævar Arnfjörð Bjarmason
wrote:

> On Tue, Jun 23, 2009 at 1:05 PM, Vitor George
> wrote:
> > I know that JOSM uses launchpad to localization.
> >
> > Is that the best tool? Can we use for the main site and Potlach?
>
> Aside from license reasons (we use GPL and launchpad requires BSD)
> launchpad is a complete PITA to deal with. For instance it looks like
> you can only get .po files back out of it by requesting that they be
> e-mailed to you one at a time.
>
> We should be using something like this instead, at least for rails:
>
>
> http://developer.newsdesk.se/2009/01/21/translate-new-rails-i18n-plugin-with-a-nice-web-ui/
>
> And what's so bad about editing .yml files directly anyway? Of all the
> apps I've translated. Some with launchpad, some with .po, and some
> with home-made systems translating the railsport has been the least
> pain of all of them. I can use my editor directly without any
> translation app or web UI getting in my way.
>

I've no problem in editing directly the file. The problem is that if the key
structure changes, it's difficult to keep track of them in the already
translated files. We had this problem when we were translating the main site
to Portuguese. The en.yml changed a lot so we had to spent some time just to
fix the correct places of the strings.
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Improved i18n diff script for railsport translators

2009-06-23 Thread Jonas Krückel
Andy Allan schrieb:
> On Tue, Jun 23, 2009 at 12:53 PM, Vitor George wrote:
>   
>> I'm just arriving in this list but I strongly agree about having a specific
>> list for i18n issues. there is a lot of work to be done in several fronts
>> and the information about it is mostly sparse.
>>
>> For a country where the adoption of English is very low, like Brazil,
>> translating is a essential thing to grow the number of volunteers.
>> 
>
> I'm not disputing that! I just don't really understand what emails or
> discussions aren't appropriate for either a) a native-language list or
> b) d...@osm.org
>   
+1 I also don't see why we should create a new list. Form my POV it 
would only has disadvantages.


Jonas

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Improved i18n diff script for railsport translators

2009-06-23 Thread Ævar Arnfjörð Bjarmason
On Tue, Jun 23, 2009 at 1:05 PM, Vitor George wrote:
> I know that JOSM uses launchpad to localization.
>
> Is that the best tool? Can we use for the main site and Potlach?

Aside from license reasons (we use GPL and launchpad requires BSD)
launchpad is a complete PITA to deal with. For instance it looks like
you can only get .po files back out of it by requesting that they be
e-mailed to you one at a time.

We should be using something like this instead, at least for rails:

http://developer.newsdesk.se/2009/01/21/translate-new-rails-i18n-plugin-with-a-nice-web-ui/

And what's so bad about editing .yml files directly anyway? Of all the
apps I've translated. Some with launchpad, some with .po, and some
with home-made systems translating the railsport has been the least
pain of all of them. I can use my editor directly without any
translation app or web UI getting in my way.

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Improved i18n diff script for railsport translators

2009-06-23 Thread Richard Fairhurst

Vitor George wrote:
> Is that the best tool? Can we use for the main site and Potlach?

Potlatch uses the OSM wiki for localisation. I have no plans to change this
in favour of a third-party solution.

cheers
Richard
-- 
View this message in context: 
http://www.nabble.com/Improved-i18n-diff-script-for-railsport-translators-tp24151358p24165866.html
Sent from the OpenStreetMap - Dev mailing list archive at Nabble.com.


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Osmosis and Postgresql

2009-06-23 Thread Brett Henderson

Jeffrey Warren wrote:
Hi, I'm compiling a very long description of a Postgres/Rails port 
schema import, though I'm writing directly to the db. I'd be happy to 
share/post my notes on the process as I managed to get around a number 
of undocumented problems. 

I'm still not done right now (i've been pinging the list here 
occasionally) and my latest problem is that I'm getting several errors 
like the following:



ERROR:  insert or update on table "current_way_nodes" violates foreign 
key constraint "current_way_nodes_node_id_fkey"


DETAIL:  Key (node_id)=(17704640) is not present in table "current_nodes".


** Error **


ERROR: insert or update on table "current_way_nodes" violates foreign 
key constraint "current_way_nodes_node_id_fkey"


SQL state: 23503

Detail: Key (node_id)=(17704640) is not present in table "current_nodes".


These are current_way_nodes which were not deleted from the current_ 
table when their matching current_nodes were deleted. I'm now trying 
to delete them manually since this only occurs where nodes are 
visible=false, but it's confusing when this causes the foreign key 
constraint creation to fail:



ALTER TABLE ONLY current_way_nodes

ADD CONSTRAINT current_way_nodes_node_id_fkey FOREIGN KEY 
(node_id) REFERENCES current_nodes(id);



Has anyone else encountered this? Is there a better way to resolve it?
When testing local imports I drop that constraint from the database.  
I'm not aware of any better ways of solving the problem.


Brett

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Improved i18n diff script for railsport translators

2009-06-23 Thread Vitor George
I know that JOSM uses launchpad to localization.

Is that the best tool? Can we use for the main site and Potlach?

On Tue, Jun 23, 2009 at 9:45 AM, Subhodip Biswas
wrote:

> On Tue, Jun 23, 2009 at 5:23 PM, Vitor George
> wrote:
> > I'm just arriving in this list but I strongly agree about having a
> specific
> > list for i18n issues. there is a lot of work to be done in several fronts
> > and the information about it is mostly sparse.
> >
> > For a country where the adoption of English is very low, like Brazil,
> > translating is a essential thing to grow the number of volunteers.
> >
> +1 to this from me too, In my country where there are more than 5
> languages being used in computers and each one having a great
> translation team,I guess a person interested only in i18n/l10n will
> have some help
>
> Btw, Is it possible somehow to make use of translation software like
> kbabel for translating osm.org,Josm,etc?
>
>
>
> --
> Regards
> Subhodip Biswas
>
>
> GPG key : FAEA34AB
> Server : pgp.mit.edu
> http://subhodipbiswas.wordpress.com
> http:/www.fedoraproject.org/wiki/SubhodipBiswas
>
> ___
> dev mailing list
> dev@openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev
>
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Improved i18n diff script for railsport translators

2009-06-23 Thread Andy Allan
On Tue, Jun 23, 2009 at 12:53 PM, Vitor George wrote:
> I'm just arriving in this list but I strongly agree about having a specific
> list for i18n issues. there is a lot of work to be done in several fronts
> and the information about it is mostly sparse.
>
> For a country where the adoption of English is very low, like Brazil,
> translating is a essential thing to grow the number of volunteers.

I'm not disputing that! I just don't really understand what emails or
discussions aren't appropriate for either a) a native-language list or
b) d...@osm.org

Cheers,
Andy

> Vitor
> On Tue, Jun 23, 2009 at 7:10 AM, Andy Allan  wrote:
>>
>> On Mon, Jun 22, 2009 at 5:57 PM, Ævar Arnfjörð
>> Bjarmason wrote:
>>
>> > And finally, is this the preferred mailing list to talk about i18n
>> > issues? Maybe we should have some forum especially for this as
>> > interest in matters that concern i18n in rails are probably pretty
>> > orthogonal to the general concerns of -dev. And people who are just
>> > interested in translating the website to their language are thus
>> > unlikely to sign up.
>>
>> I'd say it's fine for now. It's unclear how big a deal translations
>> are going to be in the medium term - the interface of
>> openstreetmap.org has been pretty stable over the last few years and
>> most translation work so far has been catching up with what we have
>> already rather than aiming for a moving target. And anything other
>> than "what's this in my language" *is* a topic for the dev list.
>>
>> If there's still lots of translation stuff needing discussed in a few
>> months time, then maybe we would be better off with a separate list.
>> But I'd say it's fine here for now.
>>
>> Cheers,
>> Andy
>>
>> ___
>> dev mailing list
>> dev@openstreetmap.org
>> http://lists.openstreetmap.org/listinfo/dev
>
>

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Improved i18n diff script for railsport translators

2009-06-23 Thread Subhodip Biswas
On Tue, Jun 23, 2009 at 5:23 PM, Vitor George wrote:
> I'm just arriving in this list but I strongly agree about having a specific
> list for i18n issues. there is a lot of work to be done in several fronts
> and the information about it is mostly sparse.
>
> For a country where the adoption of English is very low, like Brazil,
> translating is a essential thing to grow the number of volunteers.
>
+1 to this from me too, In my country where there are more than 5
languages being used in computers and each one having a great
translation team,I guess a person interested only in i18n/l10n will
have some help

Btw, Is it possible somehow to make use of translation software like
kbabel for translating osm.org,Josm,etc?



-- 
Regards
Subhodip Biswas


GPG key : FAEA34AB
Server : pgp.mit.edu
http://subhodipbiswas.wordpress.com
http:/www.fedoraproject.org/wiki/SubhodipBiswas

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Improved i18n diff script for railsport translators

2009-06-23 Thread Vitor George
I'm just arriving in this list but I strongly agree about having a specific
list for i18n issues. there is a lot of work to be done in several fronts
and the information about it is mostly sparse.

For a country where the adoption of English is very low, like Brazil,
translating is a essential thing to grow the number of volunteers.

Vitor
On Tue, Jun 23, 2009 at 7:10 AM, Andy Allan  wrote:

> On Mon, Jun 22, 2009 at 5:57 PM, Ævar Arnfjörð
> Bjarmason wrote:
>
> > And finally, is this the preferred mailing list to talk about i18n
> > issues? Maybe we should have some forum especially for this as
> > interest in matters that concern i18n in rails are probably pretty
> > orthogonal to the general concerns of -dev. And people who are just
> > interested in translating the website to their language are thus
> > unlikely to sign up.
>
> I'd say it's fine for now. It's unclear how big a deal translations
> are going to be in the medium term - the interface of
> openstreetmap.org has been pretty stable over the last few years and
> most translation work so far has been catching up with what we have
> already rather than aiming for a moving target. And anything other
> than "what's this in my language" *is* a topic for the dev list.
>
> If there's still lots of translation stuff needing discussed in a few
> months time, then maybe we would be better off with a separate list.
> But I'd say it's fine here for now.
>
> Cheers,
> Andy
>
> ___
> dev mailing list
> dev@openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev
>
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] [OSM-talk] Error in OSM site when Exporting to Embedded HTML

2009-06-23 Thread Jonas Krückel
Ævar Arnfjörð Bjarmason schrieb:
> On Mon, Jun 22, 2009 at 8:59 AM, Ivan Garcia wrote:
>   
>> Hi, I realized that when I click in the EXPORT tab of OSM.org and I choose
>> the Embedded HTML radiobox, it appears a link that says: "Click here to
>> select a marker", but when I click later on in the map, no marker is placed,
>> I'm using Firefox 3 in my Kubuntu.
>> 
>
> Can someone who can debug JS look at this? Firefox error
> console/Firebug complain about undefined variables but I can't track
> down what's wrong.
>   
I recognized this bug a few weeks ago as I was translating osm.org. It 
seemed to me that the bug appeared that time, so maybe it has something 
to do with the translation?
I checked de.yml at this time, but there was no bug, so it must be 
somewhere else.
Maybe this is a hint.

Jonas

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Improved i18n diff script for railsport translators

2009-06-23 Thread Andy Allan
On Mon, Jun 22, 2009 at 5:57 PM, Ævar Arnfjörð
Bjarmason wrote:

> And finally, is this the preferred mailing list to talk about i18n
> issues? Maybe we should have some forum especially for this as
> interest in matters that concern i18n in rails are probably pretty
> orthogonal to the general concerns of -dev. And people who are just
> interested in translating the website to their language are thus
> unlikely to sign up.

I'd say it's fine for now. It's unclear how big a deal translations
are going to be in the medium term - the interface of
openstreetmap.org has been pretty stable over the last few years and
most translation work so far has been catching up with what we have
already rather than aiming for a moving target. And anything other
than "what's this in my language" *is* a topic for the dev list.

If there's still lots of translation stuff needing discussed in a few
months time, then maybe we would be better off with a separate list.
But I'd say it's fine here for now.

Cheers,
Andy

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] OAuth

2009-06-23 Thread Matt Amos
On Tue, Jun 23, 2009 at 3:53 AM, Tom Hughes wrote:
> 2009/6/23 Matt Amos 
>> i've committed a working version of OAuth token support for OSM. it
>> turns out that ajturner and i were working on it independently, so it
>> makes sense to share code.
>
> I have uncommitted it (from a fricking airport).
>
> Please DO NOT commit major changes to trunk without talking to me first. Use
> a branch.

please DO NOT revert my work without talking to me first. OSM doesn't
stop just because you're on holiday.

using a branch would be retarded. the OAuth stuff is a simple
enhancement, which doesn't break anything existing. if you want a
stable code version to do minor bugfix releases from, *that's* what
branches are for.

cheers,

matt

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev