I imported the CSV into SQLite. I can see 1450490 rows. Here is the quick screen-cast on how to do it -> https://www.youtube.com/watch?v=rodMh6wGnoA The tool I used for SQlite is called https://sqlitebrowser.org/ Its free and open source. It's available for all three platforms.
Thej -- Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್ http://thejeshgn.com GPG ID : 0xBFFC8DD3C06DD6B0 On Wed, 30 Jun 2021 at 08:04, Apurva Dalwadi <apurvasoi...@gmail.com> wrote: > It has 10 lakh records > > On Thu, Jun 24, 2021 at 10:35 AM Thejesh GN <i...@thejeshgn.com> wrote: > >> I have converted it into a CSV >> https://github.com/datameet/udise_schools/tree/master/data >> >> It has about 14 Lakh + schools. >> >> I will do some initial analysis over the weekend. But I am happy to >> listen. I am guessing this data is at the least 2 years old. >> >> Thej >> -- >> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್ >> http://thejeshgn.com >> GPG ID : 0xBFFC8DD3C06DD6B0 >> >> >> On Wed, 23 Jun 2021 at 04:03, Abhilash Chowdhary < >> abhilash.ch...@gmail.com> wrote: >> >>> Thanks Thejesh. Super helpful! >>> >>> Abhilash >>> >>> On Wed, Jun 16, 2021 at 2:21 AM Thejesh GN <i...@thejeshgn.com> wrote: >>> >>>> Sorry, its public now. >>>> >>>> I will add readme and other information. >>>> >>>> Thej >>>> -- >>>> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್ >>>> http://thejeshgn.com >>>> GPG ID : 0xBFFC8DD3C06DD6B0 >>>> >>>> >>>> On Wed, 16 Jun 2021 at 14:48, Abhilash Chowdhary < >>>> abhilash.ch...@gmail.com> wrote: >>>> >>>>> Hi Thejesh, >>>>> >>>>> Thanks for the efforts in collating all this in a GeoJSON file. >>>>> However, looks like the repository is private. The page returns a 404 for >>>>> me. >>>>> >>>>> Abhilash >>>>> >>>>> On Sun, Jun 13, 2021 at 10:03 PM Thejesh GN <i...@thejeshgn.com> wrote: >>>>> >>>>>> 1. Thanks Dev. I was able to get the school list of all of India. >>>>>> Currently raw GeoJSON is at https://github.com/datameet/udise_schools >>>>>> 2. I will try and flatten the data and do some initial analysis >>>>>> 3. Rahul Gupta - the excel looks good. The udise school code in excel >>>>>> is can be matched map files. Can you add this to a repo? Also for which >>>>>> year is this? I see that they publish 2013 to 2018 data online. >>>>>> >>>>>> >>>>>> Thej >>>>>> -- >>>>>> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್ >>>>>> http://thejeshgn.com >>>>>> GPG ID : 0xBFFC8DD3C06DD6B0 >>>>>> >>>>>> >>>>>> On Sat, 29 May 2021 at 06:53, Rahul Gupta <rahulgupta.w...@gmail.com> >>>>>> wrote: >>>>>> >>>>>>> Hi Thej, >>>>>>> >>>>>>> Attaching a few sample files for districts in Andhra Pradesh. This >>>>>>> is the data I was able to scrape. Let me know if this helps. >>>>>>> >>>>>>> Thanks & Regards >>>>>>> >>>>>>> On Thu, May 27, 2021 at 7:40 PM Thejesh GN <i...@thejeshgn.com> wrote: >>>>>>> >>>>>>>> Devdatta, >>>>>>>> Do you have for more than one state. So we can see the extent of >>>>>>>> error? Even if the error rate is 10% it's not a bad idea to have that >>>>>>>> data. >>>>>>>> Also do school info have meta data like district or taluk? Because >>>>>>>> they do collect that kind of data from schools in their form >>>>>>>> <https://thejeshgn.com/wp-content/uploads/2021/05/udise_form.png>. >>>>>>>> or may be its part of school reports. >>>>>>>> >>>>>>>> Rahul, >>>>>>>> Thank you. >>>>>>>> >>>>>>>> Thej >>>>>>>> -- >>>>>>>> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್ >>>>>>>> http://thejeshgn.com >>>>>>>> GPG ID : 0xBFFC8DD3C06DD6B0 >>>>>>>> >>>>>>>> >>>>>>>> On Thu, 27 May 2021 at 19:33, Rahul Gupta < >>>>>>>> rahulgupta.w...@gmail.com> wrote: >>>>>>>> >>>>>>>>> Hi Tej, >>>>>>>>> >>>>>>>>> I had scraped district level information earlier. Will share a >>>>>>>>> sample for everyone to have a look at. >>>>>>>>> >>>>>>>>> On Thu, 27 May, 2021, 5:10 pm Thejesh GN, <i...@thejeshgn.com> wrote: >>>>>>>>> >>>>>>>>>> I was planning to scrape the location and school codes. >>>>>>>>>> >>>>>>>>>> Reports, may be later. >>>>>>>>>> >>>>>>>>>> On Thu, 27 May 2021, 03:33 Devdatta Tengshe, <devda...@tengshe.in> >>>>>>>>>> wrote: >>>>>>>>>> >>>>>>>>>>> Hi Thej, >>>>>>>>>>> >>>>>>>>>>> What do you want to scrape from this site? >>>>>>>>>>> >>>>>>>>>>> I have scraped some of the school locations from this site, but >>>>>>>>>>> have not tried scraping the school reports. >>>>>>>>>>> >>>>>>>>>>> I also found that the location of many schools is incorrect. ( >>>>>>>>>>> Schools tagged with Punjab appear in MP and so on) >>>>>>>>>>> >>>>>>>>>>> Regards, >>>>>>>>>>> Devdatta >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> On Wed, 26 May 2021 at 15:53, Thejesh GN <i...@thejeshgn.com> >>>>>>>>>>> wrote: >>>>>>>>>>> >>>>>>>>>>>> Thanks Gautam and Emmerich. >>>>>>>>>>>> >>>>>>>>>>>> Here[1] is the summary of everything I know until now, >>>>>>>>>>>> including the list of current UDISE Districts and Blocks along >>>>>>>>>>>> with codes. >>>>>>>>>>>> >>>>>>>>>>>> I am planning to scrape https://schoolgis.nic.in/. But it >>>>>>>>>>>> seems to be down most of the time. Has anyone here tried scraping >>>>>>>>>>>> it before? >>>>>>>>>>>> >>>>>>>>>>>> I have not looked at data.gov.in for school list. May be I >>>>>>>>>>>> should check that too. >>>>>>>>>>>> >>>>>>>>>>>> - [1] >>>>>>>>>>>> https://thejeshgn.com/2021/05/26/india-udise-educational-districts-and-blocks/ >>>>>>>>>>>> >>>>>>>>>>>> On Saturday, 10 April 2021 at 20:38:03 UTC+5:30 >>>>>>>>>>>> emmeric...@gmail.com wrote: >>>>>>>>>>>> >>>>>>>>>>>>> Hi Thej and Gautam, >>>>>>>>>>>>> >>>>>>>>>>>>> From what I know, Gautam is exactly right. For example, in >>>>>>>>>>>>> Delhi, the Directorate of Education maintains 13 education >>>>>>>>>>>>> districts that >>>>>>>>>>>>> do not correspond to the 10 administrative districts for Delhi. >>>>>>>>>>>>> They are >>>>>>>>>>>>> for management and administrative purposes within the Directorate >>>>>>>>>>>>> of >>>>>>>>>>>>> Education (see here: >>>>>>>>>>>>> http://www.edudel.nic.in/mis/schoolplant/school_information.htm >>>>>>>>>>>>> and look at by district). I'm not sure if they maintain maps of >>>>>>>>>>>>> these >>>>>>>>>>>>> boundaries. >>>>>>>>>>>>> >>>>>>>>>>>>> I can't speak for any other states. >>>>>>>>>>>>> >>>>>>>>>>>>> Adding to Gautam and others approach beyond KA, you can also >>>>>>>>>>>>> get lat/long for a lot of schools from here: >>>>>>>>>>>>> https://schoolgis.nic.in/. I believe many on here have also >>>>>>>>>>>>> pointed to that site. Scraping that data and matching to DISE >>>>>>>>>>>>> data gets you >>>>>>>>>>>>> ~85% of the schools. DISE school codes minus the last two digits >>>>>>>>>>>>> gets you >>>>>>>>>>>>> villages, so you can then get another couple of percent by >>>>>>>>>>>>> matching any >>>>>>>>>>>>> schools with missing lat/longs that are in the same village as >>>>>>>>>>>>> schools with >>>>>>>>>>>>> lat/longs. >>>>>>>>>>>>> >>>>>>>>>>>>> From there you could aggregate up to the administrative >>>>>>>>>>>>> district. >>>>>>>>>>>>> >>>>>>>>>>>>> hth, >>>>>>>>>>>>> Emmerich >>>>>>>>>>>>> >>>>>>>>>>>>> On Sunday, March 28, 2021 at 11:10:50 PM UTC-7 Gautam John >>>>>>>>>>>>> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>>> Hi Thej: >>>>>>>>>>>>>> >>>>>>>>>>>>>> > I am trying to make sense of UDISE wrt administrative >>>>>>>>>>>>>> boundaries. >>>>>>>>>>>>>> >>>>>>>>>>>>>> There isn't any linkage - they are completely independent at >>>>>>>>>>>>>> least >>>>>>>>>>>>>> when I last checked in 2016. What we did was to collect the >>>>>>>>>>>>>> lat/long >>>>>>>>>>>>>> for schools so we could plot them to administrative and >>>>>>>>>>>>>> electoral >>>>>>>>>>>>>> boundaries. And infer educational boundaries from the school >>>>>>>>>>>>>> points we >>>>>>>>>>>>>> had and since we knew ed boundary each school belonged to. >>>>>>>>>>>>>> >>>>>>>>>>>>>> See: https://dise.klp.org.in/about/ >>>>>>>>>>>>>> >>>>>>>>>>>>>> I wonder if Sajjad might have any of those scripts handy. >>>>>>>>>>>>>> >>>>>>>>>>>>> -- >>>>>>>>>>>> Datameet is a community of Data Science enthusiasts in India. >>>>>>>>>>>> Know more about us by visiting http://datameet.org >>>>>>>>>>>> --- >>>>>>>>>>>> You received this message because you are subscribed to the >>>>>>>>>>>> Google Groups "datameet" group. >>>>>>>>>>>> To unsubscribe from this group and stop receiving emails from >>>>>>>>>>>> it, send an email to datameet+unsubscr...@googlegroups.com. >>>>>>>>>>>> To view this discussion on the web visit >>>>>>>>>>>> https://groups.google.com/d/msgid/datameet/f658144f-9ea1-4c89-9a6a-06feb0e71b4cn%40googlegroups.com >>>>>>>>>>>> <https://groups.google.com/d/msgid/datameet/f658144f-9ea1-4c89-9a6a-06feb0e71b4cn%40googlegroups.com?utm_medium=email&utm_source=footer> >>>>>>>>>>>> . >>>>>>>>>>>> >>>>>>>>>>> -- >>>>>>>>>>> Datameet is a community of Data Science enthusiasts in India. >>>>>>>>>>> Know more about us by visiting http://datameet.org >>>>>>>>>>> --- >>>>>>>>>>> You received this message because you are subscribed to the >>>>>>>>>>> Google Groups "datameet" group. >>>>>>>>>>> To unsubscribe from this group and stop receiving emails from >>>>>>>>>>> it, send an email to datameet+unsubscr...@googlegroups.com. >>>>>>>>>>> To view this discussion on the web visit >>>>>>>>>>> https://groups.google.com/d/msgid/datameet/CAOQOUMs8rVRWvZg%3D-GoxF9q1%2BNRpN-W8yC-kxCQayGbeQxveUg%40mail.gmail.com >>>>>>>>>>> <https://groups.google.com/d/msgid/datameet/CAOQOUMs8rVRWvZg%3D-GoxF9q1%2BNRpN-W8yC-kxCQayGbeQxveUg%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>>>>>>>> . >>>>>>>>>>> >>>>>>>>>> -- >>>>>>>>>> Datameet is a community of Data Science enthusiasts in India. >>>>>>>>>> Know more about us by visiting http://datameet.org >>>>>>>>>> --- >>>>>>>>>> You received this message because you are subscribed to the >>>>>>>>>> Google Groups "datameet" group. >>>>>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>>>>> send an email to datameet+unsubscr...@googlegroups.com. >>>>>>>>>> To view this discussion on the web visit >>>>>>>>>> https://groups.google.com/d/msgid/datameet/CAABnYsVdHx83dk77%2BgubycV_ZHEfcuki8GZ7M2m2A4EJt9kiew%40mail.gmail.com >>>>>>>>>> <https://groups.google.com/d/msgid/datameet/CAABnYsVdHx83dk77%2BgubycV_ZHEfcuki8GZ7M2m2A4EJt9kiew%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>>>>>>> . >>>>>>>>>> >>>>>>>>> -- >>>>>>>>> Datameet is a community of Data Science enthusiasts in India. Know >>>>>>>>> more about us by visiting http://datameet.org >>>>>>>>> --- >>>>>>>>> You received this message because you are subscribed to the Google >>>>>>>>> Groups "datameet" group. >>>>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>>>> send an email to datameet+unsubscr...@googlegroups.com. >>>>>>>>> To view this discussion on the web visit >>>>>>>>> https://groups.google.com/d/msgid/datameet/CAKxLuZf4MQJEk4BYvX-0qbQmTbTQaMM5GsowzCt5kpKcqrShQA%40mail.gmail.com >>>>>>>>> <https://groups.google.com/d/msgid/datameet/CAKxLuZf4MQJEk4BYvX-0qbQmTbTQaMM5GsowzCt5kpKcqrShQA%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>>>>>> . >>>>>>>>> >>>>>>>> -- >>>>>>>> Datameet is a community of Data Science enthusiasts in India. Know >>>>>>>> more about us by visiting http://datameet.org >>>>>>>> --- >>>>>>>> You received this message because you are subscribed to the Google >>>>>>>> Groups "datameet" group. >>>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>>> send an email to datameet+unsubscr...@googlegroups.com. >>>>>>>> To view this discussion on the web visit >>>>>>>> https://groups.google.com/d/msgid/datameet/CAABnYsUTTeKP8LSN-QUq9Y1AkoPZYZbTwZdY2AaTP%3DO%3Dw0e7zw%40mail.gmail.com >>>>>>>> <https://groups.google.com/d/msgid/datameet/CAABnYsUTTeKP8LSN-QUq9Y1AkoPZYZbTwZdY2AaTP%3DO%3Dw0e7zw%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>>>>> . >>>>>>>> >>>>>>> -- >>>>>>> Datameet is a community of Data Science enthusiasts in India. Know >>>>>>> more about us by visiting http://datameet.org >>>>>>> --- >>>>>>> You received this message because you are subscribed to the Google >>>>>>> Groups "datameet" group. >>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>> send an email to datameet+unsubscr...@googlegroups.com. >>>>>>> To view this discussion on the web visit >>>>>>> https://groups.google.com/d/msgid/datameet/CAKxLuZe%3DHBBwx7oNf7TnZajf0ytp3J%2B15cyD5Fd%3DQkW9_gmZ6A%40mail.gmail.com >>>>>>> <https://groups.google.com/d/msgid/datameet/CAKxLuZe%3DHBBwx7oNf7TnZajf0ytp3J%2B15cyD5Fd%3DQkW9_gmZ6A%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>>>> . >>>>>>> >>>>>> -- >>>>>> Datameet is a community of Data Science enthusiasts in India. Know >>>>>> more about us by visiting http://datameet.org >>>>>> --- >>>>>> You received this message because you are subscribed to the Google >>>>>> Groups "datameet" group. >>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>> send an email to datameet+unsubscr...@googlegroups.com. >>>>>> To view this discussion on the web visit >>>>>> https://groups.google.com/d/msgid/datameet/CAABnYsWeAOCKPzkyJzj6RVEoK2oev9PSeHv_9_6D4OuPcXxb4A%40mail.gmail.com >>>>>> <https://groups.google.com/d/msgid/datameet/CAABnYsWeAOCKPzkyJzj6RVEoK2oev9PSeHv_9_6D4OuPcXxb4A%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>>> . >>>>>> >>>>> -- >>>>> Datameet is a community of Data Science enthusiasts in India. Know >>>>> more about us by visiting http://datameet.org >>>>> --- >>>>> You received this message because you are subscribed to the Google >>>>> Groups "datameet" group. >>>>> To unsubscribe from this group and stop receiving emails from it, send >>>>> an email to datameet+unsubscr...@googlegroups.com. >>>>> To view this discussion on the web visit >>>>> https://groups.google.com/d/msgid/datameet/CAA%2BkmBAGWe2ct3EOq55sHYc5DczXBUb7vrn0rP%2B9go_NZZjz2Q%40mail.gmail.com >>>>> <https://groups.google.com/d/msgid/datameet/CAA%2BkmBAGWe2ct3EOq55sHYc5DczXBUb7vrn0rP%2B9go_NZZjz2Q%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>> . >>>>> >>>> -- >>>> Datameet is a community of Data Science enthusiasts in India. Know more >>>> about us by visiting http://datameet.org >>>> --- >>>> You received this message because you are subscribed to the Google >>>> Groups "datameet" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to datameet+unsubscr...@googlegroups.com. >>>> To view this discussion on the web visit >>>> https://groups.google.com/d/msgid/datameet/CAABnYsVhf%2BHza8h1gtK9KrDik8S5O%2BrurS2q998UyLDkFjCJpw%40mail.gmail.com >>>> <https://groups.google.com/d/msgid/datameet/CAABnYsVhf%2BHza8h1gtK9KrDik8S5O%2BrurS2q998UyLDkFjCJpw%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>> . >>>> >>> -- >>> Datameet is a community of Data Science enthusiasts in India. Know more >>> about us by visiting http://datameet.org >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "datameet" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to datameet+unsubscr...@googlegroups.com. >>> To view this discussion on the web visit >>> https://groups.google.com/d/msgid/datameet/CAA%2BkmBBzhEeO4ikFfrM45N5Vr-MF2ws%2B0p2GXc_w9VPjHMZYeQ%40mail.gmail.com >>> <https://groups.google.com/d/msgid/datameet/CAA%2BkmBBzhEeO4ikFfrM45N5Vr-MF2ws%2B0p2GXc_w9VPjHMZYeQ%40mail.gmail.com?utm_medium=email&utm_source=footer> >>> . >>> >> -- >> Datameet is a community of Data Science enthusiasts in India. Know more >> about us by visiting http://datameet.org >> --- >> You received this message because you are subscribed to the Google Groups >> "datameet" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to datameet+unsubscr...@googlegroups.com. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/datameet/CAABnYsWGHb-3UVh0yeayfs5HVR%3DYfLmq6_OR9J-57ggu2V8gjQ%40mail.gmail.com >> <https://groups.google.com/d/msgid/datameet/CAABnYsWGHb-3UVh0yeayfs5HVR%3DYfLmq6_OR9J-57ggu2V8gjQ%40mail.gmail.com?utm_medium=email&utm_source=footer> >> . >> > -- > Datameet is a community of Data Science enthusiasts in India. Know more > about us by visiting http://datameet.org > --- > You received this message because you are subscribed to the Google Groups > "datameet" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to datameet+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/datameet/CAD2K3bA0-qwKBZ8BnRPJ87%2BDqsEcC_GcK_HryspruTwZN3GnVg%40mail.gmail.com > <https://groups.google.com/d/msgid/datameet/CAD2K3bA0-qwKBZ8BnRPJ87%2BDqsEcC_GcK_HryspruTwZN3GnVg%40mail.gmail.com?utm_medium=email&utm_source=footer> > . > -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAABnYsWiQoP3b_4DM8g3bBFvatmnNyPZay16zkixuUo91uTwgg%40mail.gmail.com.
