It has 10 lakh records On Thu, Jun 24, 2021 at 10:35 AM Thejesh GN <i...@thejeshgn.com> wrote:
> I have converted it into a CSV > https://github.com/datameet/udise_schools/tree/master/data > > It has about 14 Lakh + schools. > > I will do some initial analysis over the weekend. But I am happy to > listen. I am guessing this data is at the least 2 years old. > > Thej > -- > Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್ > http://thejeshgn.com > GPG ID : 0xBFFC8DD3C06DD6B0 > > > On Wed, 23 Jun 2021 at 04:03, Abhilash Chowdhary <abhilash.ch...@gmail.com> > wrote: > >> Thanks Thejesh. Super helpful! >> >> Abhilash >> >> On Wed, Jun 16, 2021 at 2:21 AM Thejesh GN <i...@thejeshgn.com> wrote: >> >>> Sorry, its public now. >>> >>> I will add readme and other information. >>> >>> Thej >>> -- >>> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್ >>> http://thejeshgn.com >>> GPG ID : 0xBFFC8DD3C06DD6B0 >>> >>> >>> On Wed, 16 Jun 2021 at 14:48, Abhilash Chowdhary < >>> abhilash.ch...@gmail.com> wrote: >>> >>>> Hi Thejesh, >>>> >>>> Thanks for the efforts in collating all this in a GeoJSON file. >>>> However, looks like the repository is private. The page returns a 404 for >>>> me. >>>> >>>> Abhilash >>>> >>>> On Sun, Jun 13, 2021 at 10:03 PM Thejesh GN <i...@thejeshgn.com> wrote: >>>> >>>>> 1. Thanks Dev. I was able to get the school list of all of India. >>>>> Currently raw GeoJSON is at https://github.com/datameet/udise_schools >>>>> 2. I will try and flatten the data and do some initial analysis >>>>> 3. Rahul Gupta - the excel looks good. The udise school code in excel >>>>> is can be matched map files. Can you add this to a repo? Also for which >>>>> year is this? I see that they publish 2013 to 2018 data online. >>>>> >>>>> >>>>> Thej >>>>> -- >>>>> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್ >>>>> http://thejeshgn.com >>>>> GPG ID : 0xBFFC8DD3C06DD6B0 >>>>> >>>>> >>>>> On Sat, 29 May 2021 at 06:53, Rahul Gupta <rahulgupta.w...@gmail.com> >>>>> wrote: >>>>> >>>>>> Hi Thej, >>>>>> >>>>>> Attaching a few sample files for districts in Andhra Pradesh. This is >>>>>> the data I was able to scrape. Let me know if this helps. >>>>>> >>>>>> Thanks & Regards >>>>>> >>>>>> On Thu, May 27, 2021 at 7:40 PM Thejesh GN <i...@thejeshgn.com> wrote: >>>>>> >>>>>>> Devdatta, >>>>>>> Do you have for more than one state. So we can see the extent of >>>>>>> error? Even if the error rate is 10% it's not a bad idea to have that >>>>>>> data. >>>>>>> Also do school info have meta data like district or taluk? Because >>>>>>> they do collect that kind of data from schools in their form >>>>>>> <https://thejeshgn.com/wp-content/uploads/2021/05/udise_form.png>. >>>>>>> or may be its part of school reports. >>>>>>> >>>>>>> Rahul, >>>>>>> Thank you. >>>>>>> >>>>>>> Thej >>>>>>> -- >>>>>>> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್ >>>>>>> http://thejeshgn.com >>>>>>> GPG ID : 0xBFFC8DD3C06DD6B0 >>>>>>> >>>>>>> >>>>>>> On Thu, 27 May 2021 at 19:33, Rahul Gupta <rahulgupta.w...@gmail.com> >>>>>>> wrote: >>>>>>> >>>>>>>> Hi Tej, >>>>>>>> >>>>>>>> I had scraped district level information earlier. Will share a >>>>>>>> sample for everyone to have a look at. >>>>>>>> >>>>>>>> On Thu, 27 May, 2021, 5:10 pm Thejesh GN, <i...@thejeshgn.com> wrote: >>>>>>>> >>>>>>>>> I was planning to scrape the location and school codes. >>>>>>>>> >>>>>>>>> Reports, may be later. >>>>>>>>> >>>>>>>>> On Thu, 27 May 2021, 03:33 Devdatta Tengshe, <devda...@tengshe.in> >>>>>>>>> wrote: >>>>>>>>> >>>>>>>>>> Hi Thej, >>>>>>>>>> >>>>>>>>>> What do you want to scrape from this site? >>>>>>>>>> >>>>>>>>>> I have scraped some of the school locations from this site, but >>>>>>>>>> have not tried scraping the school reports. >>>>>>>>>> >>>>>>>>>> I also found that the location of many schools is incorrect. ( >>>>>>>>>> Schools tagged with Punjab appear in MP and so on) >>>>>>>>>> >>>>>>>>>> Regards, >>>>>>>>>> Devdatta >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Wed, 26 May 2021 at 15:53, Thejesh GN <i...@thejeshgn.com> wrote: >>>>>>>>>> >>>>>>>>>>> Thanks Gautam and Emmerich. >>>>>>>>>>> >>>>>>>>>>> Here[1] is the summary of everything I know until now, including >>>>>>>>>>> the list of current UDISE Districts and Blocks along with codes. >>>>>>>>>>> >>>>>>>>>>> I am planning to scrape https://schoolgis.nic.in/. But it seems >>>>>>>>>>> to be down most of the time. Has anyone here tried scraping it >>>>>>>>>>> before? >>>>>>>>>>> >>>>>>>>>>> I have not looked at data.gov.in for school list. May be I >>>>>>>>>>> should check that too. >>>>>>>>>>> >>>>>>>>>>> - [1] >>>>>>>>>>> https://thejeshgn.com/2021/05/26/india-udise-educational-districts-and-blocks/ >>>>>>>>>>> >>>>>>>>>>> On Saturday, 10 April 2021 at 20:38:03 UTC+5:30 >>>>>>>>>>> emmeric...@gmail.com wrote: >>>>>>>>>>> >>>>>>>>>>>> Hi Thej and Gautam, >>>>>>>>>>>> >>>>>>>>>>>> From what I know, Gautam is exactly right. For example, in >>>>>>>>>>>> Delhi, the Directorate of Education maintains 13 education >>>>>>>>>>>> districts that >>>>>>>>>>>> do not correspond to the 10 administrative districts for Delhi. >>>>>>>>>>>> They are >>>>>>>>>>>> for management and administrative purposes within the Directorate >>>>>>>>>>>> of >>>>>>>>>>>> Education (see here: >>>>>>>>>>>> http://www.edudel.nic.in/mis/schoolplant/school_information.htm >>>>>>>>>>>> and look at by district). I'm not sure if they maintain maps of >>>>>>>>>>>> these >>>>>>>>>>>> boundaries. >>>>>>>>>>>> >>>>>>>>>>>> I can't speak for any other states. >>>>>>>>>>>> >>>>>>>>>>>> Adding to Gautam and others approach beyond KA, you can also >>>>>>>>>>>> get lat/long for a lot of schools from here: >>>>>>>>>>>> https://schoolgis.nic.in/. I believe many on here have also >>>>>>>>>>>> pointed to that site. Scraping that data and matching to DISE data >>>>>>>>>>>> gets you >>>>>>>>>>>> ~85% of the schools. DISE school codes minus the last two digits >>>>>>>>>>>> gets you >>>>>>>>>>>> villages, so you can then get another couple of percent by >>>>>>>>>>>> matching any >>>>>>>>>>>> schools with missing lat/longs that are in the same village as >>>>>>>>>>>> schools with >>>>>>>>>>>> lat/longs. >>>>>>>>>>>> >>>>>>>>>>>> From there you could aggregate up to the administrative >>>>>>>>>>>> district. >>>>>>>>>>>> >>>>>>>>>>>> hth, >>>>>>>>>>>> Emmerich >>>>>>>>>>>> >>>>>>>>>>>> On Sunday, March 28, 2021 at 11:10:50 PM UTC-7 Gautam John >>>>>>>>>>>> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> Hi Thej: >>>>>>>>>>>>> >>>>>>>>>>>>> > I am trying to make sense of UDISE wrt administrative >>>>>>>>>>>>> boundaries. >>>>>>>>>>>>> >>>>>>>>>>>>> There isn't any linkage - they are completely independent at >>>>>>>>>>>>> least >>>>>>>>>>>>> when I last checked in 2016. What we did was to collect the >>>>>>>>>>>>> lat/long >>>>>>>>>>>>> for schools so we could plot them to administrative and >>>>>>>>>>>>> electoral >>>>>>>>>>>>> boundaries. And infer educational boundaries from the school >>>>>>>>>>>>> points we >>>>>>>>>>>>> had and since we knew ed boundary each school belonged to. >>>>>>>>>>>>> >>>>>>>>>>>>> See: https://dise.klp.org.in/about/ >>>>>>>>>>>>> >>>>>>>>>>>>> I wonder if Sajjad might have any of those scripts handy. >>>>>>>>>>>>> >>>>>>>>>>>> -- >>>>>>>>>>> Datameet is a community of Data Science enthusiasts in India. >>>>>>>>>>> Know more about us by visiting http://datameet.org >>>>>>>>>>> --- >>>>>>>>>>> You received this message because you are subscribed to the >>>>>>>>>>> Google Groups "datameet" group. >>>>>>>>>>> To unsubscribe from this group and stop receiving emails from >>>>>>>>>>> it, send an email to datameet+unsubscr...@googlegroups.com. >>>>>>>>>>> To view this discussion on the web visit >>>>>>>>>>> https://groups.google.com/d/msgid/datameet/f658144f-9ea1-4c89-9a6a-06feb0e71b4cn%40googlegroups.com >>>>>>>>>>> <https://groups.google.com/d/msgid/datameet/f658144f-9ea1-4c89-9a6a-06feb0e71b4cn%40googlegroups.com?utm_medium=email&utm_source=footer> >>>>>>>>>>> . >>>>>>>>>>> >>>>>>>>>> -- >>>>>>>>>> Datameet is a community of Data Science enthusiasts in India. >>>>>>>>>> Know more about us by visiting http://datameet.org >>>>>>>>>> --- >>>>>>>>>> You received this message because you are subscribed to the >>>>>>>>>> Google Groups "datameet" group. >>>>>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>>>>> send an email to datameet+unsubscr...@googlegroups.com. >>>>>>>>>> To view this discussion on the web visit >>>>>>>>>> https://groups.google.com/d/msgid/datameet/CAOQOUMs8rVRWvZg%3D-GoxF9q1%2BNRpN-W8yC-kxCQayGbeQxveUg%40mail.gmail.com >>>>>>>>>> <https://groups.google.com/d/msgid/datameet/CAOQOUMs8rVRWvZg%3D-GoxF9q1%2BNRpN-W8yC-kxCQayGbeQxveUg%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>>>>>>> . >>>>>>>>>> >>>>>>>>> -- >>>>>>>>> Datameet is a community of Data Science enthusiasts in India. Know >>>>>>>>> more about us by visiting http://datameet.org >>>>>>>>> --- >>>>>>>>> You received this message because you are subscribed to the Google >>>>>>>>> Groups "datameet" group. >>>>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>>>> send an email to datameet+unsubscr...@googlegroups.com. >>>>>>>>> To view this discussion on the web visit >>>>>>>>> https://groups.google.com/d/msgid/datameet/CAABnYsVdHx83dk77%2BgubycV_ZHEfcuki8GZ7M2m2A4EJt9kiew%40mail.gmail.com >>>>>>>>> <https://groups.google.com/d/msgid/datameet/CAABnYsVdHx83dk77%2BgubycV_ZHEfcuki8GZ7M2m2A4EJt9kiew%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>>>>>> . >>>>>>>>> >>>>>>>> -- >>>>>>>> Datameet is a community of Data Science enthusiasts in India. Know >>>>>>>> more about us by visiting http://datameet.org >>>>>>>> --- >>>>>>>> You received this message because you are subscribed to the Google >>>>>>>> Groups "datameet" group. >>>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>>> send an email to datameet+unsubscr...@googlegroups.com. >>>>>>>> To view this discussion on the web visit >>>>>>>> https://groups.google.com/d/msgid/datameet/CAKxLuZf4MQJEk4BYvX-0qbQmTbTQaMM5GsowzCt5kpKcqrShQA%40mail.gmail.com >>>>>>>> <https://groups.google.com/d/msgid/datameet/CAKxLuZf4MQJEk4BYvX-0qbQmTbTQaMM5GsowzCt5kpKcqrShQA%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>>>>> . >>>>>>>> >>>>>>> -- >>>>>>> Datameet is a community of Data Science enthusiasts in India. Know >>>>>>> more about us by visiting http://datameet.org >>>>>>> --- >>>>>>> You received this message because you are subscribed to the Google >>>>>>> Groups "datameet" group. >>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>> send an email to datameet+unsubscr...@googlegroups.com. >>>>>>> To view this discussion on the web visit >>>>>>> https://groups.google.com/d/msgid/datameet/CAABnYsUTTeKP8LSN-QUq9Y1AkoPZYZbTwZdY2AaTP%3DO%3Dw0e7zw%40mail.gmail.com >>>>>>> <https://groups.google.com/d/msgid/datameet/CAABnYsUTTeKP8LSN-QUq9Y1AkoPZYZbTwZdY2AaTP%3DO%3Dw0e7zw%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>>>> . >>>>>>> >>>>>> -- >>>>>> Datameet is a community of Data Science enthusiasts in India. Know >>>>>> more about us by visiting http://datameet.org >>>>>> --- >>>>>> You received this message because you are subscribed to the Google >>>>>> Groups "datameet" group. >>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>> send an email to datameet+unsubscr...@googlegroups.com. >>>>>> To view this discussion on the web visit >>>>>> https://groups.google.com/d/msgid/datameet/CAKxLuZe%3DHBBwx7oNf7TnZajf0ytp3J%2B15cyD5Fd%3DQkW9_gmZ6A%40mail.gmail.com >>>>>> <https://groups.google.com/d/msgid/datameet/CAKxLuZe%3DHBBwx7oNf7TnZajf0ytp3J%2B15cyD5Fd%3DQkW9_gmZ6A%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>>> . >>>>>> >>>>> -- >>>>> Datameet is a community of Data Science enthusiasts in India. Know >>>>> more about us by visiting http://datameet.org >>>>> --- >>>>> You received this message because you are subscribed to the Google >>>>> Groups "datameet" group. >>>>> To unsubscribe from this group and stop receiving emails from it, send >>>>> an email to datameet+unsubscr...@googlegroups.com. >>>>> To view this discussion on the web visit >>>>> https://groups.google.com/d/msgid/datameet/CAABnYsWeAOCKPzkyJzj6RVEoK2oev9PSeHv_9_6D4OuPcXxb4A%40mail.gmail.com >>>>> <https://groups.google.com/d/msgid/datameet/CAABnYsWeAOCKPzkyJzj6RVEoK2oev9PSeHv_9_6D4OuPcXxb4A%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>> . >>>>> >>>> -- >>>> Datameet is a community of Data Science enthusiasts in India. Know more >>>> about us by visiting http://datameet.org >>>> --- >>>> You received this message because you are subscribed to the Google >>>> Groups "datameet" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to datameet+unsubscr...@googlegroups.com. >>>> To view this discussion on the web visit >>>> https://groups.google.com/d/msgid/datameet/CAA%2BkmBAGWe2ct3EOq55sHYc5DczXBUb7vrn0rP%2B9go_NZZjz2Q%40mail.gmail.com >>>> <https://groups.google.com/d/msgid/datameet/CAA%2BkmBAGWe2ct3EOq55sHYc5DczXBUb7vrn0rP%2B9go_NZZjz2Q%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>> . >>>> >>> -- >>> Datameet is a community of Data Science enthusiasts in India. Know more >>> about us by visiting http://datameet.org >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "datameet" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to datameet+unsubscr...@googlegroups.com. >>> To view this discussion on the web visit >>> https://groups.google.com/d/msgid/datameet/CAABnYsVhf%2BHza8h1gtK9KrDik8S5O%2BrurS2q998UyLDkFjCJpw%40mail.gmail.com >>> <https://groups.google.com/d/msgid/datameet/CAABnYsVhf%2BHza8h1gtK9KrDik8S5O%2BrurS2q998UyLDkFjCJpw%40mail.gmail.com?utm_medium=email&utm_source=footer> >>> . >>> >> -- >> Datameet is a community of Data Science enthusiasts in India. Know more >> about us by visiting http://datameet.org >> --- >> You received this message because you are subscribed to the Google Groups >> "datameet" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to datameet+unsubscr...@googlegroups.com. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/datameet/CAA%2BkmBBzhEeO4ikFfrM45N5Vr-MF2ws%2B0p2GXc_w9VPjHMZYeQ%40mail.gmail.com >> <https://groups.google.com/d/msgid/datameet/CAA%2BkmBBzhEeO4ikFfrM45N5Vr-MF2ws%2B0p2GXc_w9VPjHMZYeQ%40mail.gmail.com?utm_medium=email&utm_source=footer> >> . >> > -- > Datameet is a community of Data Science enthusiasts in India. Know more > about us by visiting http://datameet.org > --- > You received this message because you are subscribed to the Google Groups > "datameet" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to datameet+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/datameet/CAABnYsWGHb-3UVh0yeayfs5HVR%3DYfLmq6_OR9J-57ggu2V8gjQ%40mail.gmail.com > <https://groups.google.com/d/msgid/datameet/CAABnYsWGHb-3UVh0yeayfs5HVR%3DYfLmq6_OR9J-57ggu2V8gjQ%40mail.gmail.com?utm_medium=email&utm_source=footer> > . > -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAD2K3bA0-qwKBZ8BnRPJ87%2BDqsEcC_GcK_HryspruTwZN3GnVg%40mail.gmail.com.
