Re: [datameet] Fwd: Fwd: [New post] Happy Independence Day and Open Indian Village Boundaries
@arun: i will rename the attributes so the length of attribute name is 8.
Can you put an issue. Easy to track.
@question: in census, they use subdistrict. Is it same as Taluk?
Also anyone has 2001 to 2011 village code mappings?
On Aug 15, 2016 9:32 PM, "Thejesh GN" wrote:
On 15 August 2016 at 18:12, "Sharad Lele [शरच्चंद्र लेले]" <
sharad.l...@gmail.com> wrote:
> For some reason, this email by Thejesh did not show up datameet (or maybe
> I just missed it?). So forwarding it to the group.
>
> Thejesh, thanks for this. I have two queries:
>
> 1. Is this effort different from the effort by Nisha? My impression was
> that we had (with the group) access to boundaries of many more states, but
> the issue was copyright etc, and that Nisha, you and some others were
> taking legal opinion on the same. Is what you have put out a result of
> that? What is the legal opinion?
>
>
Its the same effort, This is going to be our single effort. In this phase-1
we are going to publish boundaries of the villages for states which are
derived from the government websites. We are applying our license - ODBL to
the additional skilled and creative work our volunteers do, designing,
organizing, extracting, georeferencing, drawing missing areas, adding more
attributes, cleaning etc and attribute/credit the source (Govt Website) for
each state.
I know there are more boundaries with complicated licenses. The talks are
still on, as of now we are not publishing them. we will look at them in
phase-2. We will keep the list updated.
So as of now its govt public data + DataMeet volunteer's creative work.
> 2. I think I have asked this silly question on the group before, but have
> to ask it again: what is the 'json' format, and why is it better to put the
> data out in that format than in .shp? And how does one convert from json to
> .shp?
>
>
Our boundaries are incomplete in some cases or might have errors. Hence we
are maintaining them in git similar to source code, where any changes to
the file can be seen tracked and seen.
geojson or json is a simple text format. Which can be opened by a simple
text editor and hence gives advantage to compare the versions, do a diff
just like source code.
Shape files are a format by ESRI is more like a binary format. Its
difficult to compare them on GitHub.
I would suggest http://mapshaper.org/ (Its open source so you can run
internally if required) . You can convert between
Shapefiles/geojson/topojson. Work on them and export. I have attached
screenshots.
I have been using it a lot and it has really great support for all formats.
I would suggest you to use http://mapshaper.org/ and let the group know if
you face any issues.
Let me know if you have any more questions.
> Thanks.
> Sharad
>
> -
>
>
> -- Forwarded message --
> From: "Data{Meet}"
> Date: 15 Aug 2016 10:27
> Subject: [New post] Happy Independence Day and Open Indian Village
> Boundaries
> To:
> Cc:
>
> Thejesh GN posted: "One of the longest and most passionately discussed
> subject on the Data{Meet} list is the availability of Indian Village
> Boundaries in Digital format. Search for Indian Village shape files and you
> can spend hours on reading interesting conversations. Over"
>
>
> New post on *Data{Meet}*
> Happy Independence Day and Open Indian
> Village Boundaries
>
>
> One of the longest and most passionately discussed subject on the
> Data{Meet} list is the availability of Indian Village Boundaries in Digital
> format. Search for Indian Village shape files
>
> and you can spend hours on reading interesting conversations.
>
> Over last two years different members of community have tried to digitize
>
> the maps available through various government platforms or shared the
> maps through their organizations
> .
>
> A look at the list discussion tells you that boundaries of at the least
> 75% of the states are available in various formats and quality. What we
> need at this point is a consolidate effort to bring them all on par in
> format, attributes and to some level quality. So some volunteers at
> Data{Meet} agreed to come together, clean up the available maps, add
> attributes, make them geojson and publish them on our GitHub repository
> called Indian Village Boundaries
> .
>
> Of course this will be an on going effort but we would love to reach a
> baseline (all states) by year end. As of now I have cleaned up and uploaded
> Gujarat. I have at the least 4 more states to go liv
Re: [datameet] School Safety in India
On Mon, Aug 15, 2016 at 8:39 PM, Pradeep Bhatt wrote: > We can also use RTI to know from Department of Education what data they > collect from schools. Check out what DISE collects: http://schoolreportcards.in The KLP team uses some of this data and they have an interface for Karnataka for a subset here: http://dise.klp.org.in Drop them a line at t...@klp.org.in -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] BBMP Maps for Bangalore
There was lot of uproar due to recent demolitions in Bangalore. Under fire from public and political parties BBMP is releasing whatever maps they got with them and is promising to upload GIS data as well. *About the development in the newspapers* http://indiatoday.intoday.in/story/bengaluru-demolition-drive-storm-water-drains-revenue-maps/1/740490.html http://www.thehindu.com/news/cities/bangalore/following-rights-panel-fiat-bbmp-releases-revenue-maps/article8986672.ece This is the website with new maps http://164.100.133.91/rajkalve/ There is a hyperlink to the new GIS based Property Identification Details link here http://bbmp.gov.in/wardwise-detailed-information But as usual it is down. BBMP was publishing lake maps since long, but they are almost un readable for a normal individual. Some survey maps of certified lakes http://bbmp.gov.in/certified-lakes by third parties seem good enough http://bbmp.gov.in/documents/10180/0/agraharakere%2033.pdf but there are others like these http://bbmp.gov.in/documents/10180/0/kalkere%20maps.pdf which are represented in a bad way with no metadata of the survey. BBMP does has digital maps of the city and you can look into the property ids over layed on the maps beside lakes. But they sharing screenshots of Google Earth. http://landrecords.karnataka.gov.in/service3/Lakeencroachment.aspx Can we track these developments and also the license under which BBMP is releasing the GIS data. I am not sure if it is even worth crawling this data, it is in consumable with all the scans and irregularities. Regards, Srinivas Kodali www.lostprogrammer.com -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: [datameet] Govt. of Tamilnadu order of Content Publishing under Creative Commons
Thanks, looks like it can promote open access in research. Regards, Srinivas Kodali www.lostprogrammer.com *"Not everyone who wanders is lost, I am probably a bit"* On Mon, Aug 15, 2016 at 9:41 AM, Suren wrote: > Hi, > > So the order is issued by the Secretary, Tamilnadu Government. The primary > purpose of this initiative is to ensure that the - if works in tamil are > published under CC by SA, aided by technology, it has the potential to > reach people globally. > > In essence the order says that: > > *1) Books & other literary works that shall be published under CC by SA* > >- That have been nationalized >- Produced by the Tamil Development Department & other Government >departments, >- Rare books collected by the Tamil Development Department & Tamil >University >- Digital Copies of - Old Scrolls, Pictures & Stone carvings > > > 2) *Research papers and books (subject to copyright rules) of the > students & teachers of the Tamil University should be published on their > website* > > *3) If any of the above have been procured by other Government > departments, from Individuals or private enterprises - they too can be > published after obtaining due permission from the owner.* > > The letter doesn't explicitly mentioned CC by SA for (2) & (3) but I think > that's what was intended. > > Cheers, > > Surendran > > On Sun, Aug 14, 2016 at 4:39 PM, srinivas kodali > wrote: > >> There is an order by Govt. of Tamilnadu, approved last month to publish >> govt. content under creative commons, this is a big deal for govt. data >> too. Can someone who knows tamil translate the order and its scope? >> >> https://commons.wikimedia.org/wiki/File:GoTN_Tamil_Developme >> nt_Departments_order_on_creative_commons_cc_by_sa.pdf >> >> Regards, >> Srinivas Kodali >> www.lostprogrammer.com >> >> -- >> Datameet is a community of Data Science enthusiasts in India. Know more >> about us by visiting http://datameet.org >> --- >> You received this message because you are subscribed to the Google Groups >> "datameet" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to datameet+unsubscr...@googlegroups.com. >> For more options, visit https://groups.google.com/d/optout. >> > > -- > Datameet is a community of Data Science enthusiasts in India. Know more > about us by visiting http://datameet.org > --- > You received this message because you are subscribed to the Google Groups > "datameet" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to datameet+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. > -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: [datameet] School Safety in India
Hi Hutch, I have a friend working with Schools in Bangalore I will check with him to know if there is already such data online. We can also use RTI to know from Department of Education what data they collect from schools. Anyone else here working in this area? Regards, Pradeep On Sun, Aug 14, 2016 at 12:21 AM, Huich Goh wrote: > Hello everyone, > > Please allow me to give a somewhat lengthy background. > > I'm a Singaporean-Australian who worked in an Indian NGO for about 2 > years. I was a policy consultant and worked on the National School Safety > Programme. On my field trips to schools, and while collating the safety > data sheets and reports for my colleagues, I realised that there were a lot > of impracticalities, like no centralised system for holding the data from > schools, the manual process of entering data, the inability to properly > analyse the data, erroneous data collection, and so on. > > I then had this idea of developing a school safety database but never > acted on it - let's just say being a non-techie I was only starting to > discover the potential of IT and data management. But now I know what can > be done and and would really like to make this happen. The kind of things > we look at for school safety are structural hazards, the number of toilets, > evacuation procedures and areas, kitchen safety and fire extinguishers. Of > course school safety can extend beyond the confines of the school to its > surrounding areas and can also have intangible aspects. > > Not only would having a database greatly streamline the data collection > process, it would also help decision makers, NGOs etc visualise which areas > have the most school safety problems, the number of critical schools, > levels of compliance with safety standards, all of which leads to better > allocation of resources. > > I would to discuss this more with any interested datameeters. I've left > the NGO sector but still remain very deeply interested in its social > issues. I'm currently based in Bangalore. For all I know, by now there > already is a centralised database for school safety used internally by the > NDMA, UNICEF or other government organisations - my research shows there > isn't though but it would be good to affirm this. > > Please message me if you're interested, and thank you. > Hutch > > -- > Datameet is a community of Data Science enthusiasts in India. Know more > about us by visiting http://datameet.org > --- > You received this message because you are subscribed to the Google Groups > "datameet" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to datameet+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. > -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: [datameet] Fwd: Fwd: [New post] Happy Independence Day and Open Indian Village Boundaries
> 2. I think I have asked this silly question on the group before, but have > to ask it again: what is the 'json' format, and why is it better to put the > data out in that format than in .shp? And how does one convert from json to > .shp? > > For starters, the property names in shapefiles is limited to 8 characters :o You can convert from geojson to shapefiles using QGIS or ogr2ogr or a bunch of online websites https://ogre.adc4gis.com . All modern web maps work natively with the geojson format. -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] Fwd: Fwd: [New post] Happy Independence Day and Open Indian Village Boundaries
For some reason, this email by Thejesh did not show up datameet (or
maybe I just missed it?). So forwarding it to the group.
Thejesh, thanks for this. I have two queries:
1. Is this effort different from the effort by Nisha? My impression was
that we had (with the group) access to boundaries of many more states,
but the issue was copyright etc, and that Nisha, you and some others
were taking legal opinion on the same. Is what you have put out a result
of that? What is the legal opinion?
2. I think I have asked this silly question on the group before, but
have to ask it again: what is the 'json' format, and why is it better to
put the data out in that format than in .shp? And how does one convert
from json to .shp?
Thanks.
Sharad
-
-- Forwarded message --
From: "Data{Meet}" >
Date: 15 Aug 2016 10:27
Subject: [New post] Happy Independence Day and Open Indian Village
Boundaries
To: mailto:sbadi...@atree.org>>
Cc:
Thejesh GN posted: "One of the longest and most passionately discussed
subject on the Data{Meet} list is the availability of Indian Village
Boundaries in Digital format. Search for Indian Village shape files and
you can spend hours on reading interesting conversations. Over"
New post on *Data{Meet}*
Happy Independence Day and Open Indian Village Boundaries
One of the longest and most passionately discussed subject on the
Data{Meet} list is the availability of Indian Village Boundaries in
Digital format. Search for Indian Village shape files
and you can spend hours on reading interesting conversations.
Over last two years different members of community have tried to
digitize
the maps available through various government platforms or shared the
maps through their organizations
.
A look at the list discussion tells you that boundaries of at the least
75% of the states are available in various formats and quality. What we
need at this point is a consolidate effort to bring them all on par in
format, attributes and to some level quality. So some volunteers at
Data{Meet} agreed to come together, clean up the available maps, add
attributes, make them geojson and publish them on our GitHub repository
called Indian Village Boundaries
.
Of course this will be an on going effort but we would love to reach a
baseline (all states) by year end. As of now I have cleaned up and
uploaded Gujarat. I have at the least 4 more states to go live by month
end. Karnataka, Kerala, Tamil Nadu and Goa. I will announce them on the
list as they go live.
The boundaries are organized by state using state ISO code. All the
village boundaries are available in geojson (WGS84, EPSG4326) format.
The project page
gives you the status of the data as we clean and upload. Data is not
perfect yet, there could many errors both in data and boundaries. You
can contribute by sending the pull requests. Please use the census names
when correcting the attributes and geojson for shapes and but please
source them to an official source.
Like everything else community creates. All map data will be available
under Open Data Commons Open Database License (ODbL)
*
Picture: Kedarnath range behind the Kedarnath temple early morning. By
Kaustabh, Available under CCBYSA
.
*Thejesh GN * | August 15, 2016 at 10:26
am | Tags: featured
, Indian Village
Maps ,
Maps , open access
[datameet] Re: Data Visualization
Thanks for the reply Ajit. I'll refer to the links you mentioned. Actually I'm planning to use web technologies(mostly Javascript D3, JSON, angularJS) to create visualizations so i'm looking for those kind of approaches. Certainly I won't be using R language. On Monday, August 15, 2016 at 11:51:12 AM UTC+5:30, mili jain wrote: > > I have a final year project on "Data Visualization of Social Networks". > > Can someone please tell me where to fetch data from any social network, > and what possibly could be a good way to carry out the visualizations? > -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: [datameet] Data Visualization
Hey Mili, There are APIs available to extract data. For extracting twitter data, you can refer to this: https://dev.twitter.com/overview/api Similarly for Facebook graph API you can refer here: https://developers.facebook.com/docs/graph-api/overview Note that there are limitations on the amount of data you can obtain from these APIs. I had earlier written a post on sentiment analysis of twitter data in *R* ( http://discerndata.blogspot.in/2014/11/sentiment-analysis-of-twitter-data.html). You can refer this to see how Twitter API can be used to obtain data. For creating visualizations, there is a library in R called *igraph *using which you can create visuals depicting the node connections representing a social network. Regards, Ajit On Mon, Aug 15, 2016 at 11:32 AM, mili jain wrote: > I have a final year project on "Data Visualization of Social Networks". > > Can someone please tell me where to fetch data from any social network, > and what possibly could be a good way to carry out the visualizations? > > -- > Datameet is a community of Data Science enthusiasts in India. Know more > about us by visiting http://datameet.org > --- > You received this message because you are subscribed to the Google Groups > "datameet" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to datameet+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. > -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
