[datameet] Gujarat Assembly Constituency Shapefiles

2022-11-23 Thread Chandrashekhar Raman
Hi all, does anyone have  shapefiles for gujarat Assembly constituencies or
can point to a source.

my usual source - from the datameet website seems to be incomplete.

regards
Chandrashekhar

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CACSGm8eZ1_FSd-awz%3DA466b55%3D9BBKYtzJh75P2SjGzRXZQrTQ%40mail.gmail.com.


Re: [datameet] pre-delimitation (<2008) assembly constituency shapefiles for UP

2021-12-29 Thread Chandrashekhar Raman
thanks Devdatta, i am using the one shared by Dileep last time around, the
shape is perfect just that the latitude and longitude seems to be scaled
down , so in my case UP shows up small and almost next to the equator.
i was told  this is something to do with choosing the right projection and
can be done with QGIS, but i do not know how. much appreciate any ideas or
links

chandrashekhar

On Thu, Dec 30, 2021 at 9:27 AM Devdatta Tengshe 
wrote:

> It is available in this thread:
> https://groups.google.com/g/datameet/c/tYMSW1sbjwg/m/alfUTFpSDwAJ
>
>
> Regards,
> Devdatta
>
>
> On Wed, 29 Dec 2021 at 19:28, Chandrashekhar Raman <
> chandrashekhar.ra...@gmail.com> wrote:
>
>> Hello All, can anyone point to  pre-delimitation AC shapefiles for Uttar
>> Pradesh.
>>
>> thanks
>> Chandrashekhar
>>
>> --
>> Datameet is a community of Data Science enthusiasts in India. Know more
>> about us by visiting http://datameet.org
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to datameet+unsubscr...@googlegroups.com.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/datameet/CACSGm8ez0JwwM%3DxXxSLmyjoSpLux5y6J1_m3qYirNc3EZY5X5A%40mail.gmail.com
>> <https://groups.google.com/d/msgid/datameet/CACSGm8ez0JwwM%3DxXxSLmyjoSpLux5y6J1_m3qYirNc3EZY5X5A%40mail.gmail.com?utm_medium=email_source=footer>
>> .
>>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/CAOQOUMuEbXcGRRjpR6dtEA_j%3DE9kw6M%2ByFTd%3DWTvd4rpeUBbVw%40mail.gmail.com
> <https://groups.google.com/d/msgid/datameet/CAOQOUMuEbXcGRRjpR6dtEA_j%3DE9kw6M%2ByFTd%3DWTvd4rpeUBbVw%40mail.gmail.com?utm_medium=email_source=footer>
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CACSGm8fDjSSSwruChTchPBYbM0NhgCy%2BDayHvUJ-M4ArMd9YxA%40mail.gmail.com.


[datameet] pre-delimitation (<2008) assembly constituency shapefiles for UP

2021-12-29 Thread Chandrashekhar Raman
Hello All, can anyone point to  pre-delimitation AC shapefiles for Uttar
Pradesh.

thanks
Chandrashekhar

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CACSGm8ez0JwwM%3DxXxSLmyjoSpLux5y6J1_m3qYirNc3EZY5X5A%40mail.gmail.com.


Re: [datameet] Re: bihar pre delimitation AC shapefiles

2015-10-30 Thread Chandrashekhar Raman
Thank you dileep.. Will check this out as well. 

Btw tried the one that Dev shared and that seems to be pretty good as well. 
Just one AC missing - i think govindpur

Regards
Cs

Sent from my iPhone

> On 30-Oct-2015, at 12:17 PM, Dilip Damle <cadvis...@gmail.com> wrote:
> 
> The predetermination data was available fro download from the Election 
> commission website itself.
> I had kept it safely.
> 
> Here it is. There is a known problem about the placement of Uttarakhand in 
> one of the sets.
> 
> 
>> On Wednesday, October 28, 2015 at 11:43:58 AM UTC+5:30, Chandrashekhar Raman 
>> wrote:
>>  does anyone have access to pre-delimitation assembly constituency 
>> shapefiles of Bihar.. i.e 2005 backwards. much appreciate if can be shared.
>> 
>> thanks
>> cs
> 
> -- 
> Datameet is a community of Data Science enthusiasts in India. Know more about 
> us by visiting http://datameet.org
> --- 
> You received this message because you are subscribed to the Google Groups 
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to datameet+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
> 

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [datameet] bihar pre delimitation AC shapefiles

2015-10-28 Thread Chandrashekhar Raman
thank you Dev, this is looking good!!

regards
cs

On Wed, Oct 28, 2015 at 7:36 PM, Devdatta Tengshe <devda...@tengshe.in>
wrote:

> Hi Chandrashekar,
>
> There is some data available at:
> http://www.dartmouth.edu/~sandip/data.html#maps. This link was shred
> several years ago on this group.
>
> I've extracted the ACs belonging to Bihar, and am sharing them in
> Shapefile format.
>
> Regards,
> Dev
>
>
> On Wed, Oct 28, 2015 at 11:43 AM, Chandrashekhar Raman <
> chandrashekhar.ra...@gmail.com> wrote:
>
>>  does anyone have access to pre-delimitation assembly constituency
>> shapefiles of Bihar.. i.e 2005 backwards. much appreciate if can be shared.
>>
>> thanks
>> cs
>>
>> --
>> Datameet is a community of Data Science enthusiasts in India. Know more
>> about us by visiting http://datameet.org
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to datameet+unsubscr...@googlegroups.com.
>> For more options, visit https://groups.google.com/d/optout.
>>
>
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [datameet] 3rd and final? draft to the ECI letter

2014-08-12 Thread Chandrashekhar Raman
Want to echo the points made by a few folks on the 'tyranny of pdfs'

I have spent countless hours with free trial versions of pdf to excel
conversion software to wrangle election data from pdfs available online
into a usable excel format (or csv). and in the process infected my
computer with countless malware.Extracting and cleaning data is a learning
exercise in itself, but making it available in a machine readable format
will take this to a whole new level.

Tim Barnes Lees framework on the 'degree of open-ness' of open data is
perhaps relevant to this discussion.

  1 Star Data available on the Web, with an open license, but non machine
readable - E.g. Zip files and PDFs  2 Star Data available in
Machine-readable proprietary formats e.g. Excel  3 Star Data available in
machine-readable, non-proprietary formats e.g. XML, RDF, JSON or even CSV  4
Star Data Available using an open linked data format (URI so people can
point to your data)  5 Star Data available and linked to other data ( to
provide context and relationships)

I am not a tech expert - but seems that there is a lot of activity around
moving much of data from '1star' to the '5star' level - and that could be
one guiding thought for us as a group.

cs



On Tue, Aug 12, 2014 at 1:16 PM, Ma-roof M mahroo...@gmail.com wrote:

 I agree fully. I am as enraged by the pdfs as many others are :-)
 What can be more enraging than staring at a scanned pdf, with tables of
 numbers, which one is absolutely sure came out of a spreadsheet..??

 I was hinting that if we say open standards, they could take recourse to
 the fact that pdf is an open standard.
 And at the least, ensure that whatever pdfs get shared are not image-pdfs.

 Kind Regards
 Mahroof
 
 Knowledge, that is *discovered*, lasts a lifetime..



 On 12 August 2014 12:40, Vaishnavi Jayakumar (Inclusive India) 
 vaishnavi.jayaku...@inclusiveindia.info wrote:

 Pdf became an open standard, yes. But the software required to ensure
 easy PDF/UA
 http://www.pdfa.org/wp-content/uploads/2013/08/PDFUA-in-a-Nutshell-PDFUA.pdfcreation
 (PDF accessibility for screen readers) is invariably paid i.e. Adobe
 Acrobat Pro. Else, training on the following will have to take place
 http://www.w3.org/TR/WCAG20-TECHS/pdf.html which will be a mammoth
 exercise.  The spectrum of PDF types (hybrid, /A, /UA etc) is also prone to
 lead to confusion. The following article on document accessibility is a
 good place to start thinking on Universal Design principles.
 http://www.accessiq.org/news/news/2014/03/why-document-accessibility-and-pdfua-matters
  *(Accessibility btw is used in disability lingo to refer to stuff
 accessible to disabled people as well as non-disabled on an equal basis -
 not just run of the mill accessibility)  *

 Ethically I am against government using paid proprietary software where
 FOSS alternatives exist.
 Which is why I was pleased to see UK's official adoption of the open
 document format  recently.
 http://www.theregister.co.uk/2014/07/23/uk_government_officially_adopts_open_document_format/

 Can PDFs be made accessible? Yes.
 But I'd go with the sentiment expressed below via
 http://datadenkers.wordpress.com/2014/06/06/the-united-nations-and-its-pdf-ghettos-supposedly-open-data-and-the-lack-of-transparency/
 :

 What is clear though is that frankly, there is no reason whatsoever, why
 ‘open data’ would ever be ‘released’ in PDF format, instead of .csv or
 .xcl. As Nathanial Manning
 http://www.theguardian.com/global-development-professionals-network/2013/oct/21/development-open-data-action
  puts
 it: “This is like funding James Cameron to make Avatar, and then releasing
 it in a black and white flipbook. We are missing all the good stuff.”


 ---
 *VAISHNAVI JAYAKUMAR*
 http://about.me/vjayakumar


 On Tue, Aug 12, 2014 at 10:33 AM, Ma-roof M mahroo...@gmail.com wrote:

 for that matter, pdf is an open standard. So are office formats since
 v2007 (office open xml).

 We might want to specifically address the issue of the image-pdf
 menace.

 Kind Regards
 Mahroof

 
 Knowledge, that is *discovered*, lasts a lifetime..



 On 12 August 2014 10:18, Vaishnavi Jayakumar (Inclusive India) 
 vaishnavi.jayaku...@inclusiveindia.info wrote:

 Are there no guidelines in existence for what formats need to be used
 for data / information sharing? If data is open, isn't it necessarily in
 open formats?

 Echo that the letter needs to be sent. But Datameet should next
 prioritise advocating for standard open formats for information sharing at
 the policy level.

 In my work on disability advocacy, most of the time the bills put up
 asking for public comments are pdfs created by crooked scans of printouts.
 It needs to be transcribed before people with near vision / blindness can
 read it. Such a waste.

 Nirmita at CIS should be able to advise on 

Re: [datameet] Data portals for cities through data.gov.in?

2014-06-09 Thread Chandrashekhar Raman
Nisha, Srini, Open Data for Cities is a topic that I happen to have
invested some time on as part of my day job. I should have a bunch of
presentations PDF on the benefits of the same from my old days which i
would be happy to share. If you want to do this in India, I suspect this is
something a few corporates would also be interested in.

Also there are a couple of companies which are very good at doing this for
cities - Socrata comes to mind immediately - I have talked to these folks a
couple of times - they have a good hosted solution and a very impressive
list of references (almost all major US cities in that list).

net net.. If there is a team that is getting organically formed to look
deeper into it, i would love to be a part of it

regards
cs


On Fri, Jun 6, 2014 at 11:45 PM, Nisha Thompson nisha.thomp...@gmail.com
wrote:

 Data.gov.in mentioned a meeting with Tamil Nadu a while ago.  I will try
 to follow up with them and see if there is a follow meeting, maybe
 DataMeeters in Chennai can attend.

 Nisha


 On Fri, Jun 6, 2014 at 1:39 PM, srinivas kodali iota.kod...@gmail.com
 wrote:

 Nisha,

 You mentioned something about chennai is moving towards a portal, can u
 elaborate on that?

 Srinivas


 On Fri, Jun 6, 2014 at 9:35 PM, Nisha Thompson ni...@datameet.org
 wrote:

 Srinivas,

 I agree we should have one!  Can we get a few other people in teh
 Bangalore group together and start lobbying the NIC and bangalore to create
 one?

 STarting with meetings and letters with Bangalore stakeholders? THen see
 about who is interested in starting the conversation in other cities.

 Chennai might be movign toward a portal but I'm nto sure, I don't see
 why Bangalore can't have one or Delhi or Mumbai or PUne.

 Nisha


 On Fri, Jun 6, 2014 at 8:52 AM, srinivas kodali iota.kod...@gmail.com
 wrote:

 Hi,

 Our Open data policy makes it mandatory for ministries to categorize
 their department datasets into open-data or restricted and release them
 publicly.
 But the same is not true with city/municipal agencies. Most important
 datasets like public transport, financial spendings, pollution levels,
 water  usage fall under state/municipal agencies.

 These are important datasets which need to be made public. Making local
 agencies release datasets through data.gov.in would bring data
 standards locally and also improve community participation. Think of it,
 bangalore.data.gov.in would be an interesting page to have.

 Pointing out the equivalent open-access pages across the world.

 Beijing - http://www.bjdata.gov.cn/
 Seattle - https://data.seattle.gov/browse
 Chicago - https://data.cityofchicago.org/
 Baltimore - data.baltimorecity.gov
 Honolulu - data.honolulu.gov
 Colorado - data.opencolorado.org
 Lexington - data.lexingtonky.gov
 Somerville - data.somervillema.gov
 Palo Alto - paloalto.opendata.junar.com
 Louisville - portal.louisvilleky.gov

 why not have similar ones for india, there is enough data around. Delhi
 has real-time pollution level monitored, real-time locations of buses,
 water usage data is available from water boards.

 What do we need for this to happen?

 Regards,
 Srinivas Kodali

 --
 Datameet is a community of Data Science enthusiasts in India. Know more
 about us by visiting http://datameet.org
 ---
 You received this message because you are subscribed to the Google
 Groups datameet group.
 To unsubscribe from this group and stop receiving emails from it, send
 an email to datameet+unsubscr...@googlegroups.com.
 For more options, visit https://groups.google.com/d/optout.




 --
 Nisha Thompson
 DataMeet.org
 ni...@datameet.org
 skype: nishaqt
 mobile: 962-061-2245

 --
 Datameet is a community of Data Science enthusiasts in India. Know more
 about us by visiting http://datameet.org
 ---
 You received this message because you are subscribed to the Google
 Groups datameet group.
 To unsubscribe from this group and stop receiving emails from it, send
 an email to datameet+unsubscr...@googlegroups.com.
 For more options, visit https://groups.google.com/d/optout.


  --
 Datameet is a community of Data Science enthusiasts in India. Know more
 about us by visiting http://datameet.org
 ---
 You received this message because you are subscribed to the Google Groups
 datameet group.
 To unsubscribe from this group and stop receiving emails from it, send an
 email to datameet+unsubscr...@googlegroups.com.
 For more options, visit https://groups.google.com/d/optout.




 --
 Nisha Thompson
 Mobile: 962-061-2245

  --
 Datameet is a community of Data Science enthusiasts in India. Know more
 about us by visiting http://datameet.org
 ---
 You received this message because you are subscribed to the Google Groups
 datameet group.
 To unsubscribe from this group and stop receiving emails from it, send an
 email to datameet+unsubscr...@googlegroups.com.
 For more options, visit https://groups.google.com/d/optout.


-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 

[datameet] Take on Elections 2014

2014-06-01 Thread Chandrashekhar Raman
Finally got around to taking a crack at the results of Elections 2014. Old
news now.. but still wanted to share with the group. If someone is
interested the data is downloadable right there.

democracydatablog.blogspot.in

Also attaching a quick and dirty shell script i wrote to scrape the data
from ECI as well. unfortunately will work on a mac (or linux box, maybe).
 it generates a file called consolidated.htm - and you can copy paste all
to excel. probably too late this time but maybe useful next time..

cheers,
Cs

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
datameet group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


script2.sh
Description: Bourne shell script


Re: [datameet] Re: Indian Elections 2014 - ECI Datasets

2014-05-18 Thread Chandrashekhar Raman
This will be a tough nut to crack with just the name.. especially because
fielding 'dummy candidates' with same or very similar names is a fairly
common practice.. Used to split votes.. As employed by the veteran ajit
jogi in mahasamund.. Maybe eci will make some kind of identification number
mandatory in future, or they have already.
On May 19, 2014 9:32 AM, Dilip Damle cadvis...@gmail.com wrote:

 Hello to all,

 Thanks for this data.

 I was wondering if there is a way to Uniquely identify the Contestant
 If someone wants to create a track record of the contestants over period
 then this is important
 Just name is not sufficient.

 I tried to look for Duplicate NameParty combinations

 Including independents there are 97 duplicate combinations
 Excluding independents there are 16
  7 candidates named as Chandu Lal Sahu contested  from Chhattisgarh,
 Mahasamund
 Since they are from same constituency there are obviously different
 individuals.

 However there is no way to differentiate multiple persons with same name
 and Same person contesting in two constituencies.
 Any way out?

 Rgds
 Dilip Damle

 On Saturday, May 17, 2014 8:40:52 PM UTC+5:30, Pratap Vardhan wrote:

 Ravi,

 I did change the code a bit this afternoon. You would find the mentioned
 places in the repo files

 Regards,
 Pratap

  --
 Datameet is a community of Data Science enthusiasts in India. Know more
 about us by visiting http://datameet.org
 ---
 You received this message because you are subscribed to the Google Groups
 datameet group.
 To unsubscribe from this group and stop receiving emails from it, send an
 email to datameet+unsubscr...@googlegroups.com.
 For more options, visit https://groups.google.com/d/optout.


-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
datameet group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [datameet] List of LS-2014 Electoral Candidates

2014-04-21 Thread Chandrashekhar Raman
I think the nomination process is not complete yet for the last phases..
Once that is done the eci should have the full list

Cs
On Apr 17, 2014 4:07 PM, Ritvvij Parrikh ritvvij.parr...@pykih.com
wrote:

 Hello,

 Has any one compiled a complete list?

 We checked myneta and the list is not complete. Plus called them and they
 said they do not provide the data in XLS and hence must be scrapped. Now we
 are checking each Chief Election Commissioner's site.

 Regards,
 Ritvvij

 --
 For more details about this list
 http://datameet.org/discussions/
 ---
 You received this message because you are subscribed to the Google Groups
 datameet group.
 To unsubscribe from this group and stop receiving emails from it, send an
 email to datameet+unsubscr...@googlegroups.com.
 For more options, visit https://groups.google.com/d/optout.


-- 
For more details about this list
http://datameet.org/discussions/
--- 
You received this message because you are subscribed to the Google Groups 
datameet group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [datameet] Security Issues with the Voter List

2014-04-11 Thread Chandrashekhar Raman
Raphael, you raise very pertinent issues.

We as a community love open data and in this country there is a lot that
can be done to free all kinds of data so that it can be made use of in a
good way (election data in an aggregated form is one example). But at the
same time there are certain kinds of data which are not open ( i mean not
open in a machine readable format) for a good reason. I believe voter rolls
data is one such type. In the past voter lists have been used to pinpoint
members of specific communities which were then targeted with gruesome
effect. Shudder to think what happens if it is automated, a 'riot app'?

As Raphael points out this is not just about privacy, but could be much
worse.

This group is a fantastic initiative and as it evolves, it would be great
for us to involve more social scientists and policy experts - so as we
advocate vociferously to free more data and make it open - we can also
bring in the technical expertise here to recommend where data needs to be
better protected and how.

cs


On Fri, Apr 11, 2014 at 11:44 AM, Raphael Susewind 
li...@raphael-susewind.de wrote:

 Hi Devdatta and Avinash,

 yes, I, too, am frankly surprised at the ease with which one can access
 sensitive data in bulk. Not only PDF rolls and voter details, but also
 things such as land records, BPL lists, and much more - I think we are
 in an exciting as well as dangerous phase of fairly uncontrolled,
 nascent e-Governance practices. But I think the ethical issues here are
 a little more complex than mere privacy concern.

 Upfront, I must admit that I use all the above sources for academic
 research (in UP and across India). What Avinash described in principle
 and at the example of Delhi can indeed be done on an all-India scale,
 and I am sure there are more people than just me who do it.

 But then the social sciences have long dealt with sensitive data and
 developed protocols to protect it. Even though the data is publicly
 available, I for instance have my own copy on a secure workstation with
 full disk encryption and two factor authentication. Whenever possible, I
 also work on anonymized subsets of data. Yet there are other potential
 uses - some of the more worrisome you pointed out - which are not bound
 by such data protection standards.

 To me, this once more highlights the nascent stage of ethical standards
 around Big Data and eGovernance. On the plus side, I am happy to have
 that kind of access to conduct research which will ultimately be
 ethically beneficial, leading to better understanding of social issues
 and potentially to better policy advice. Also, there is a point to be
 made that transparency is an important asset in elections in particular,
 not only in terms of individual electoral search functions, but also in
 terms of publicly accessible (and cross-checkable, publicly verifiable)
 PDF rolls. Finally, a lot of this data had been available in the past as
 well, only in distributed and/or commercial form, which means there had
 been a hierarchy of access: small-time crooks could not use it, but
 large-time crooks were always able to use it. Likewise, scholars at
 large (often foreign) universities were able to use it, but not smaller
 ones (this is still true for some data, geodata in particular, which I
 can only access because of Ivy-League contacts and only process because
 of an association with Oxford University).

 The ethical challenge as I see it thus comes not from data availability
 per se, but from the bulk accessibility and processability of data, as
 well as the potential to link otherwise disconnected datasets with each
 other (for instance a voter ID from the rolls to the online electoral
 search mechanism to that voter's polling booth locality to the ration
 card of a person with the same name registered at a ration shop in close
 spatial proximity to the amount of rice that person obtained last week,
 all coupled - in case of my own research - to that person's religious
 identity through a namematching algorithm). And this IS an ethical
 challenge indeed, particularly if one leaves the ivory tower of
 academia, where ethical standards for such data are more ingrained, and
 more adhered to. One need not go all the way to the various criminal
 uses of such data - are we all happy with commercial use, to start with?

 I have no easy answers here, because I think the ethical issue is fairly
 complex, balancing privacy and personal security against transparency in
 the political process and legitimate academic use of data (also because
 I think the answer must be found in India through political
 deliberation, and not in German academia). Still, in the end, I have to
 admit that I often leave my desk in the evening with quite some unease
 over the sheer wealth of private data that I work with...

 What do others think?
 Raphael

 On 11.04.2014 06:57, Avinash Celestine wrote:
  Hi Devdatta
 
  Yes, though (and in the current context, i suppose thats a good 

Re: [datameet] Security Issues with the Voter List

2014-04-11 Thread Chandrashekhar Raman
Raphael, To clarify, i am not trying to make a case against availability of
fine grained data, far from it i'm with you on this argument among others
that are made spuriously to restrict access. I might have stretched the
point but then again - killing is just one extreme form of discrimination -
there are others that are less visible

you summed it up very well, its good to have a healthy caution and unease
when dealing with some of this data,there are probably no simple answers
here.

will read the paper at leisure.

cs.


On Fri, Apr 11, 2014 at 12:37 PM, Raphael Susewind 
li...@raphael-susewind.de wrote:

 Chandrashekhar,

 just on the specific issues of targeting communities, which I have
 thought about a great deal (my first book was on post-2002 Gujarat), my
 tentative conclusion is this:

 The fact that electoral rolls had been used in the past in riots before
 they were available online shows that rioters, if they want to, can
 access this data already. As Gautam pointed out, it IS public by law.
 What changes is merely the scale of data availability. Large-scale data
 would only be 'more useful' for large-scale targeting, however
 (small-scale targeting is possible already), which I don't see happening
 at this time (with the troublesome exception of Gujarat, particularly
 troublesome now that Mr Modi runs for PM - but here, too, the targeting
 happened in small units on the ground, even though coordination took
 place higher up). On the other hand, fine-grained large-scale data is
 absolutely necessary to understand a range of issues about (religious,
 caste) economic position. So that in this specific case, we have
 additional benefits but no additional risk (beyond the worrisome risk
 already out there)...

 More detailed arguments about this in a forthcoming paper of mine at
 http://pub.uni-bielefeld.de/publication/2631138

 Best,
 Raphael

 On 11.04.2014 08:49, Chandrashekhar Raman wrote:
  Raphael, you raise very pertinent issues.
 
  We as a community love open data and in this country there is a lot that
  can be done to free all kinds of data so that it can be made use of in a
  good way (election data in an aggregated form is one example). But at
  the same time there are certain kinds of data which are not open ( i
  mean not open in a machine readable format) for a good reason. I believe
  voter rolls data is one such type. In the past voter lists have been
  used to pinpoint members of specific communities which were then
  targeted with gruesome effect. Shudder to think what happens if it is
  automated, a 'riot app'?
 
  As Raphael points out this is not just about privacy, but could be much
  worse.
 
  This group is a fantastic initiative and as it evolves, it would be
  great for us to involve more social scientists and policy experts - so
  as we advocate vociferously to free more data and make it open - we can
  also bring in the technical expertise here to recommend where data needs
  to be better protected and how.
 
  cs
 
 
  On Fri, Apr 11, 2014 at 11:44 AM, Raphael Susewind
  li...@raphael-susewind.de mailto:li...@raphael-susewind.de wrote:
 
  Hi Devdatta and Avinash,
 
  yes, I, too, am frankly surprised at the ease with which one can
 access
  sensitive data in bulk. Not only PDF rolls and voter details, but
 also
  things such as land records, BPL lists, and much more - I think we
 are
  in an exciting as well as dangerous phase of fairly uncontrolled,
  nascent e-Governance practices. But I think the ethical issues here
 are
  a little more complex than mere privacy concern.
 
  Upfront, I must admit that I use all the above sources for academic
  research (in UP and across India). What Avinash described in
 principle
  and at the example of Delhi can indeed be done on an all-India scale,
  and I am sure there are more people than just me who do it.
 
  But then the social sciences have long dealt with sensitive data and
  developed protocols to protect it. Even though the data is publicly
  available, I for instance have my own copy on a secure workstation
 with
  full disk encryption and two factor authentication. Whenever
 possible, I
  also work on anonymized subsets of data. Yet there are other
 potential
  uses - some of the more worrisome you pointed out - which are not
 bound
  by such data protection standards.
 
  To me, this once more highlights the nascent stage of ethical
 standards
  around Big Data and eGovernance. On the plus side, I am happy to have
  that kind of access to conduct research which will ultimately be
  ethically beneficial, leading to better understanding of social
 issues
  and potentially to better policy advice. Also, there is a point to be
  made that transparency is an important asset in elections in
 particular,
  not only in terms of individual electoral search functions, but also
 in
  terms of publicly accessible

[datameet] Open Data 'Platform' startups

2013-04-01 Thread Chandrashekhar Raman
Hi, is anyone here aware of any start-ups in India working in the open data
platform space .. ideally someone who is trying to create something like a
socrata/ junar/ datamarket  (or even better!)..
thanks
cs

-- 
For more details about this list
http://datameet.org/discussions/
--- 
You received this message because you are subscribed to the Google Groups 
datameet group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.