Re: [Talk-in] How to get all missing street names for chennai?

2017-04-03 Thread Srikanth Lakshmanan
Hi Shrini,


On 2 April 2017 at 21:41, Shrinivasan T  wrote:

> How can get them all?
>

Mapzen provides metro extracts[0] and I used xpath here to get list of
nodes without name:ta. Parsing extracted Chennai osm file (400 MB) consumes
lot of memory. Python experts, please feel free to optimize this code[1] in
better ways.  The list of nodes (I will come to ways, relations soon) is
available here[2].

Offlate, I am facing strange unicode issues with my script which used to
work, but will soon get it fixed. I am thinking of trying TensorFlow or
equivalent ML models to provide translation suggestions, aside from google
translate. Wikidata doesnt help when it comes to street level sadly.

[0] https://mapzen.com/data/metro-extracts/
[1] https://github.com/srikanthlogic/osm-ta/blob/master/MetroExtract2.py
[2]
https://docs.google.com/spreadsheets/d/1PJdMVuSHDQ9-11ewj2pT_CNqKMLUiqUurcfyHGgSfoE/edit?usp=sharing


-- 
Regards
Srikanth.L
___
Talk-in mailing list
Talk-in@openstreetmap.org
https://lists.openstreetmap.org/listinfo/talk-in


Re: [Talk-in] How to get all missing street names for chennai?

2017-04-03 Thread Srihari Thalla
I can use your script to extract the same for Telangana and AP and
hopefully improve Telugu translations here too, thanks! (BTW, I don't know
Python. Wish I could help.)

On Mon, 3 Apr 2017 at 12:57 Srikanth Lakshmanan  wrote:

> Hi Shrini,
>
>
> On 2 April 2017 at 21:41, Shrinivasan T  wrote:
>
> How can get them all?
>
>
> Mapzen provides metro extracts[0] and I used xpath here to get list of
> nodes without name:ta. Parsing extracted Chennai osm file (400 MB) consumes
> lot of memory. Python experts, please feel free to optimize this code[1] in
> better ways.  The list of nodes (I will come to ways, relations soon) is
> available here[2].
>
> Offlate, I am facing strange unicode issues with my script which used to
> work, but will soon get it fixed. I am thinking of trying TensorFlow or
> equivalent ML models to provide translation suggestions, aside from google
> translate. Wikidata doesnt help when it comes to street level sadly.
>
> [0] https://mapzen.com/data/metro-extracts/
> [1] https://github.com/srikanthlogic/osm-ta/blob/master/MetroExtract2.py
> [2]
> https://docs.google.com/spreadsheets/d/1PJdMVuSHDQ9-11ewj2pT_CNqKMLUiqUurcfyHGgSfoE/edit?usp=sharing
>
>
>
> --
> Regards
> Srikanth.L
> ___
> Talk-in mailing list
> Talk-in@openstreetmap.org
> https://lists.openstreetmap.org/listinfo/talk-in
>
___
Talk-in mailing list
Talk-in@openstreetmap.org
https://lists.openstreetmap.org/listinfo/talk-in


Re: [Talk-in] Use MapRoulette to improve OSM - India data

2017-04-03 Thread Srihari Thalla
Very happy to know that :)

I see that he has also updated NH wiki tags (but with errors, he is
correcting too). @Naveen Can you check if all the NHs are properly tagged
and complete with Wiki-pedia/data? Thanks.

He is also adding Wiki info for cities and towns now.

On Sat, 1 Apr 2017 at 06:53 Naveen Francis  wrote:

> Challenge "Wiki for districts" is completed.
> User Vonter  has added tags for
> most of the  Indian districts :)
>
> Thanks,
> naveenpf
>
> On 16 March 2017 at 21:25, Srihari Thalla  wrote:
>
> I have set up these challenges as of today:
>
> [1] - Railway Station codes
> [2] - Wiki tags for railway stations
> [3] - Wiki tags for cities and towns
> [4] - Wiki tags for districts
>
> -
>
> @Naveen I hope all the NHs are already traced and mapped [and updated to
> the new numbering]? I'll check if Overpass QL supports regex tomorrow and
> set up the challenges. I might need your help.
>
> -
>
> Regarding tracing roads and building in small towns and villages, I
> noticed that more 50% of the villages were not even mapped (at least in
> Andhra/Telangana, I didn't look at other states). I think this procedure
> might be good:
>
> [a] - Place `node`s with place=village tags for untagged villages. We
> don't know all the names, so we might want to leave the name for now.
> [b] - Setup challenges to trace roads; and buildings
> [c] - Work to get data about the villages (starting with their names
> themselves)
>
> I can start [a] with Andhra Pradesh and Telangana
> district-wise-alphabetically. If you are open to this idea, let me know and
> your thoughts.
>
> -
>
> Here are the links for the Challenges [1,2,3,4]:
>
> [1] - Railway Station codes - http://maproulette.org/map/2403
> [2] - Wiki for Railway Stations - http://maproulette.org/map/2404
> [3] - Wiki for cities and towns - http://maproulette.org/map/2405
> [4] - Wiki for districts - http://maproulette.org/map/2406
>
> cc Arun. Need your help spreading the word :)
> -
>
> I am in touch with Martijn of MapRoulette. He said he would feature our
> challenges in the upcoming newsletter. I think the challenges above are
> pretty easy and useful for getting people from other communities interested
> in OSM, as Arun said.
>
> But tracing untraced villages would be good for featuring in his
> newsletter. That might bring attention. What do you think?
>
> On Wed, 15 Mar 2017 at 19:23 Naveen Francis  wrote:
>
> One more task
>   - Add wikidata tags for Indian Highways, it has been add for about 100
> primary highways.
>
> https://en.wikipedia.org/wiki/List_of_National_Highways_in_India_by_highway_number#/maplink/0
> About 200 may be remaining, finding QID is easier since it is in one
> place :)
>
> https://www.wikidata.org/wiki/Wikidata:WikiProject_Roads/India/National_Highways
>
>
>
>
>
> On 15 March 2017 at 17:16, Arun Ganesh  wrote:
>
> Challenge 3 and 4 could be quite interesting to get other communities
> interested in OSM.
>
> For Wikidata matching, we can share the challenge with the Wikimedia India
> chapter. Adding these tags also help make maps on Wikipedia. See Naveens'
> diary http://www.openstreetmap.org/user/naveenpf/diary/40515
>
> For any railway mapping we can spread the word on IRFCA, which would get
> the railfans really excited.
>
> Srihari, if you can make the challenges, I could help spread the word. We
> could also do mapping sprints to map them together with others to knock it
> off.
>
> ___
> Talk-in mailing list
> Talk-in@openstreetmap.org
> https://lists.openstreetmap.org/listinfo/talk-in
>
>
> ___
> Talk-in mailing list
> Talk-in@openstreetmap.org
> https://lists.openstreetmap.org/listinfo/talk-in
>
>
> ___
> Talk-in mailing list
> Talk-in@openstreetmap.org
> https://lists.openstreetmap.org/listinfo/talk-in
>
>
> ___
> Talk-in mailing list
> Talk-in@openstreetmap.org
> https://lists.openstreetmap.org/listinfo/talk-in
>
___
Talk-in mailing list
Talk-in@openstreetmap.org
https://lists.openstreetmap.org/listinfo/talk-in


Re: [Talk-in] Use MapRoulette to improve OSM - India data

2017-04-03 Thread Naveen Francis
Looks like we dont have somewhere 228 highways without wikiarticle.

http://overpass-turbo.eu/s/nz2 [20 mb]


On 3 April 2017 at 13:28, Srihari Thalla  wrote:

> Very happy to know that :)
>
> I see that he has also updated NH wiki tags (but with errors, he is
> correcting too). @Naveen Can you check if all the NHs are properly tagged
> and complete with Wiki-pedia/data? Thanks.
>
> He is also adding Wiki info for cities and towns now.
>
> On Sat, 1 Apr 2017 at 06:53 Naveen Francis  wrote:
>
>> Challenge "Wiki for districts" is completed.
>> User Vonter  has added tags
>> for most of the  Indian districts :)
>>
>> Thanks,
>> naveenpf
>>
>> On 16 March 2017 at 21:25, Srihari Thalla 
>> wrote:
>>
>> I have set up these challenges as of today:
>>
>> [1] - Railway Station codes
>> [2] - Wiki tags for railway stations
>> [3] - Wiki tags for cities and towns
>> [4] - Wiki tags for districts
>>
>> -
>>
>> @Naveen I hope all the NHs are already traced and mapped [and updated to
>> the new numbering]? I'll check if Overpass QL supports regex tomorrow and
>> set up the challenges. I might need your help.
>>
>> -
>>
>> Regarding tracing roads and building in small towns and villages, I
>> noticed that more 50% of the villages were not even mapped (at least in
>> Andhra/Telangana, I didn't look at other states). I think this procedure
>> might be good:
>>
>> [a] - Place `node`s with place=village tags for untagged villages. We
>> don't know all the names, so we might want to leave the name for now.
>> [b] - Setup challenges to trace roads; and buildings
>> [c] - Work to get data about the villages (starting with their names
>> themselves)
>>
>> I can start [a] with Andhra Pradesh and Telangana
>> district-wise-alphabetically. If you are open to this idea, let me know and
>> your thoughts.
>>
>> -
>>
>> Here are the links for the Challenges [1,2,3,4]:
>>
>> [1] - Railway Station codes - http://maproulette.org/map/2403
>> [2] - Wiki for Railway Stations - http://maproulette.org/map/2404
>> [3] - Wiki for cities and towns - http://maproulette.org/map/2405
>> [4] - Wiki for districts - http://maproulette.org/map/2406
>>
>> cc Arun. Need your help spreading the word :)
>> -
>>
>> I am in touch with Martijn of MapRoulette. He said he would feature our
>> challenges in the upcoming newsletter. I think the challenges above are
>> pretty easy and useful for getting people from other communities interested
>> in OSM, as Arun said.
>>
>> But tracing untraced villages would be good for featuring in his
>> newsletter. That might bring attention. What do you think?
>>
>> On Wed, 15 Mar 2017 at 19:23 Naveen Francis  wrote:
>>
>> One more task
>>   - Add wikidata tags for Indian Highways, it has been add for about 100
>> primary highways.
>> https://en.wikipedia.org/wiki/List_of_National_Highways_in_
>> India_by_highway_number#/maplink/0
>> About 200 may be remaining, finding QID is easier since it is in one
>> place :)
>> https://www.wikidata.org/wiki/Wikidata:WikiProject_
>> Roads/India/National_Highways
>>
>>
>>
>>
>> On 15 March 2017 at 17:16, Arun Ganesh  wrote:
>>
>> Challenge 3 and 4 could be quite interesting to get other communities
>> interested in OSM.
>>
>> For Wikidata matching, we can share the challenge with the Wikimedia
>> India chapter. Adding these tags also help make maps on Wikipedia. See
>> Naveens' diary http://www.openstreetmap.org/user/naveenpf/diary/40515
>>
>> For any railway mapping we can spread the word on IRFCA, which would get
>> the railfans really excited.
>>
>> Srihari, if you can make the challenges, I could help spread the word. We
>> could also do mapping sprints to map them together with others to knock it
>> off.
>>
>> ___
>> Talk-in mailing list
>> Talk-in@openstreetmap.org
>> https://lists.openstreetmap.org/listinfo/talk-in
>>
>>
>> ___
>> Talk-in mailing list
>> Talk-in@openstreetmap.org
>> https://lists.openstreetmap.org/listinfo/talk-in
>>
>>
>> ___
>> Talk-in mailing list
>> Talk-in@openstreetmap.org
>> https://lists.openstreetmap.org/listinfo/talk-in
>>
>>
>> ___
>> Talk-in mailing list
>> Talk-in@openstreetmap.org
>> https://lists.openstreetmap.org/listinfo/talk-in
>>
>
> ___
> Talk-in mailing list
> Talk-in@openstreetmap.org
> https://lists.openstreetmap.org/listinfo/talk-in
>
>
___
Talk-in mailing list
Talk-in@openstreetmap.org
https://lists.openstreetmap.org/listinfo/talk-in


Re: [Talk-in] Use MapRoulette to improve OSM - India data

2017-04-03 Thread Srihari Thalla
I think not all of the NH are listed in the Wikipedia page. I don't see
NH340C, NH544D, etc,. Are these listed some where else?

[1] -
https://en.m.wikipedia.org/wiki/List_of_National_Highways_in_India_by_highway_number

On Mon, Apr 3, 2017, 16:08 Naveen Francis  wrote:

> Looks like we dont have somewhere 228 highways without wikiarticle.
>
> http://overpass-turbo.eu/s/nz2 [20 mb]
> 
>
> On 3 April 2017 at 13:28, Srihari Thalla  wrote:
>
> Very happy to know that :)
>
> I see that he has also updated NH wiki tags (but with errors, he is
> correcting too). @Naveen Can you check if all the NHs are properly tagged
> and complete with Wiki-pedia/data? Thanks.
>
> He is also adding Wiki info for cities and towns now.
>
> On Sat, 1 Apr 2017 at 06:53 Naveen Francis  wrote:
>
> Challenge "Wiki for districts" is completed.
> User Vonter  has added tags for
> most of the  Indian districts :)
>
> Thanks,
> naveenpf
>
> On 16 March 2017 at 21:25, Srihari Thalla  wrote:
>
> I have set up these challenges as of today:
>
> [1] - Railway Station codes
> [2] - Wiki tags for railway stations
> [3] - Wiki tags for cities and towns
> [4] - Wiki tags for districts
>
> -
>
> @Naveen I hope all the NHs are already traced and mapped [and updated to
> the new numbering]? I'll check if Overpass QL supports regex tomorrow and
> set up the challenges. I might need your help.
>
> -
>
> Regarding tracing roads and building in small towns and villages, I
> noticed that more 50% of the villages were not even mapped (at least in
> Andhra/Telangana, I didn't look at other states). I think this procedure
> might be good:
>
> [a] - Place `node`s with place=village tags for untagged villages. We
> don't know all the names, so we might want to leave the name for now.
> [b] - Setup challenges to trace roads; and buildings
> [c] - Work to get data about the villages (starting with their names
> themselves)
>
> I can start [a] with Andhra Pradesh and Telangana
> district-wise-alphabetically. If you are open to this idea, let me know and
> your thoughts.
>
> -
>
> Here are the links for the Challenges [1,2,3,4]:
>
> [1] - Railway Station codes - http://maproulette.org/map/2403
> [2] - Wiki for Railway Stations - http://maproulette.org/map/2404
> [3] - Wiki for cities and towns - http://maproulette.org/map/2405
> [4] - Wiki for districts - http://maproulette.org/map/2406
>
> cc Arun. Need your help spreading the word :)
> -
>
> I am in touch with Martijn of MapRoulette. He said he would feature our
> challenges in the upcoming newsletter. I think the challenges above are
> pretty easy and useful for getting people from other communities interested
> in OSM, as Arun said.
>
> But tracing untraced villages would be good for featuring in his
> newsletter. That might bring attention. What do you think?
>
> On Wed, 15 Mar 2017 at 19:23 Naveen Francis  wrote:
>
> One more task
>   - Add wikidata tags for Indian Highways, it has been add for about 100
> primary highways.
>
> https://en.wikipedia.org/wiki/List_of_National_Highways_in_India_by_highway_number#/maplink/0
> About 200 may be remaining, finding QID is easier since it is in one
> place :)
>
> https://www.wikidata.org/wiki/Wikidata:WikiProject_Roads/India/National_Highways
>
>
>
>
>
> On 15 March 2017 at 17:16, Arun Ganesh  wrote:
>
> Challenge 3 and 4 could be quite interesting to get other communities
> interested in OSM.
>
> For Wikidata matching, we can share the challenge with the Wikimedia India
> chapter. Adding these tags also help make maps on Wikipedia. See Naveens'
> diary http://www.openstreetmap.org/user/naveenpf/diary/40515
>
> For any railway mapping we can spread the word on IRFCA, which would get
> the railfans really excited.
>
> Srihari, if you can make the challenges, I could help spread the word. We
> could also do mapping sprints to map them together with others to knock it
> off.
>
> ___
> Talk-in mailing list
> Talk-in@openstreetmap.org
> https://lists.openstreetmap.org/listinfo/talk-in
>
>
> ___
> Talk-in mailing list
> Talk-in@openstreetmap.org
> https://lists.openstreetmap.org/listinfo/talk-in
>
>
> ___
> Talk-in mailing list
> Talk-in@openstreetmap.org
> https://lists.openstreetmap.org/listinfo/talk-in
>
>
> ___
> Talk-in mailing list
> Talk-in@openstreetmap.org
> https://lists.openstreetmap.org/listinfo/talk-in
>
>
> ___
> Talk-in mailing list
> Talk-in@openstreetmap.org
> https://lists.openstreetmap.org/listinfo/talk-in
>
>
> ___
> Talk-in mailing list
> Talk-in@openstreetmap.org
> https://lists.openstreetmap.org/listinfo/talk-in
>
___
Talk-in mailing list
Talk-in@openstreetmap.org
https:

Re: [Talk-in] How to get all missing street names for chennai?

2017-04-03 Thread Aruna S
On Mon, Apr 3, 2017 at 3:25 AM, Srikanth Lakshmanan 
wrote:

> Hi Shrini,
>
>
> On 2 April 2017 at 21:41, Shrinivasan T  wrote:
>
>> How can get them all?
>>
>
> Mapzen provides metro extracts[0] and I used xpath here to get list of
> nodes without name:ta. Parsing extracted Chennai osm file (400 MB) consumes
> lot of memory. Python experts, please feel free to optimize this code[1] in
> better ways.  The list of nodes (I will come to ways, relations soon) is
> available here[2].
>

Firstly, sorry I think I misunderstood your question - you want to make
Tamil maps! That's awesome - my music teacher will be very happy. : )

You can use https://github.com/mapbox/osm-tag-stats with the country
mb-tiles from http://osmlab.github.io/osm-qa-tiles/country.html, with a
filter like `["==", "name:ta", ""]`.

You can then convert the geojson to csv using a converter available online.

Shrini, and Srikanth, if you require a CSV similar to what Srikanth has
generated, I am happy to generate it for you with a link to the node on
OpenStreetMap. But, first I am curious if Arun, or other Mapboxers on the
list, can explain how to make a To-Fix task if we have a CSV - not sure
what attributes the CSV should have. This will make the process of using
the csv to edit the map really easy, instead of adding edits one by one
from a CSV.

Let's make the map better!
Aruna
___
Talk-in mailing list
Talk-in@openstreetmap.org
https://lists.openstreetmap.org/listinfo/talk-in


Re: [Talk-in] How to get all missing street names for chennai?

2017-04-03 Thread Aruna S
Also, the right overpass links for the same would be:
1. Roads having names (`name`), but no Tamil(`name:ta`) names:
http://overpass-turbo.eu/s/o2q
2. Roads having no `name` tag: http://overpass-turbo.eu/s/nZs
___
Talk-in mailing list
Talk-in@openstreetmap.org
https://lists.openstreetmap.org/listinfo/talk-in