Thanks Thejesh. Super helpful! Abhilash
On Wed, Jun 16, 2021 at 2:21 AM Thejesh GN <i...@thejeshgn.com> wrote: > Sorry, its public now. > > I will add readme and other information. > > Thej > -- > Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್ > http://thejeshgn.com > GPG ID : 0xBFFC8DD3C06DD6B0 > > > On Wed, 16 Jun 2021 at 14:48, Abhilash Chowdhary <abhilash.ch...@gmail.com> > wrote: > >> Hi Thejesh, >> >> Thanks for the efforts in collating all this in a GeoJSON file. However, >> looks like the repository is private. The page returns a 404 for me. >> >> Abhilash >> >> On Sun, Jun 13, 2021 at 10:03 PM Thejesh GN <i...@thejeshgn.com> wrote: >> >>> 1. Thanks Dev. I was able to get the school list of all of India. >>> Currently raw GeoJSON is at https://github.com/datameet/udise_schools >>> 2. I will try and flatten the data and do some initial analysis >>> 3. Rahul Gupta - the excel looks good. The udise school code in excel is >>> can be matched map files. Can you add this to a repo? Also for which year >>> is this? I see that they publish 2013 to 2018 data online. >>> >>> >>> Thej >>> -- >>> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್ >>> http://thejeshgn.com >>> GPG ID : 0xBFFC8DD3C06DD6B0 >>> >>> >>> On Sat, 29 May 2021 at 06:53, Rahul Gupta <rahulgupta.w...@gmail.com> >>> wrote: >>> >>>> Hi Thej, >>>> >>>> Attaching a few sample files for districts in Andhra Pradesh. This is >>>> the data I was able to scrape. Let me know if this helps. >>>> >>>> Thanks & Regards >>>> >>>> On Thu, May 27, 2021 at 7:40 PM Thejesh GN <i...@thejeshgn.com> wrote: >>>> >>>>> Devdatta, >>>>> Do you have for more than one state. So we can see the extent of >>>>> error? Even if the error rate is 10% it's not a bad idea to have that >>>>> data. >>>>> Also do school info have meta data like district or taluk? Because >>>>> they do collect that kind of data from schools in their form >>>>> <https://thejeshgn.com/wp-content/uploads/2021/05/udise_form.png>. or >>>>> may be its part of school reports. >>>>> >>>>> Rahul, >>>>> Thank you. >>>>> >>>>> Thej >>>>> -- >>>>> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್ >>>>> http://thejeshgn.com >>>>> GPG ID : 0xBFFC8DD3C06DD6B0 >>>>> >>>>> >>>>> On Thu, 27 May 2021 at 19:33, Rahul Gupta <rahulgupta.w...@gmail.com> >>>>> wrote: >>>>> >>>>>> Hi Tej, >>>>>> >>>>>> I had scraped district level information earlier. Will share a sample >>>>>> for everyone to have a look at. >>>>>> >>>>>> On Thu, 27 May, 2021, 5:10 pm Thejesh GN, <i...@thejeshgn.com> wrote: >>>>>> >>>>>>> I was planning to scrape the location and school codes. >>>>>>> >>>>>>> Reports, may be later. >>>>>>> >>>>>>> On Thu, 27 May 2021, 03:33 Devdatta Tengshe, <devda...@tengshe.in> >>>>>>> wrote: >>>>>>> >>>>>>>> Hi Thej, >>>>>>>> >>>>>>>> What do you want to scrape from this site? >>>>>>>> >>>>>>>> I have scraped some of the school locations from this site, but >>>>>>>> have not tried scraping the school reports. >>>>>>>> >>>>>>>> I also found that the location of many schools is incorrect. ( >>>>>>>> Schools tagged with Punjab appear in MP and so on) >>>>>>>> >>>>>>>> Regards, >>>>>>>> Devdatta >>>>>>>> >>>>>>>> >>>>>>>> On Wed, 26 May 2021 at 15:53, Thejesh GN <i...@thejeshgn.com> wrote: >>>>>>>> >>>>>>>>> Thanks Gautam and Emmerich. >>>>>>>>> >>>>>>>>> Here[1] is the summary of everything I know until now, including >>>>>>>>> the list of current UDISE Districts and Blocks along with codes. >>>>>>>>> >>>>>>>>> I am planning to scrape https://schoolgis.nic.in/. But it seems >>>>>>>>> to be down most of the time. Has anyone here tried scraping it before? >>>>>>>>> >>>>>>>>> I have not looked at data.gov.in for school list. May be I should >>>>>>>>> check that too. >>>>>>>>> >>>>>>>>> - [1] >>>>>>>>> https://thejeshgn.com/2021/05/26/india-udise-educational-districts-and-blocks/ >>>>>>>>> >>>>>>>>> On Saturday, 10 April 2021 at 20:38:03 UTC+5:30 >>>>>>>>> emmeric...@gmail.com wrote: >>>>>>>>> >>>>>>>>>> Hi Thej and Gautam, >>>>>>>>>> >>>>>>>>>> From what I know, Gautam is exactly right. For example, in >>>>>>>>>> Delhi, the Directorate of Education maintains 13 education districts >>>>>>>>>> that >>>>>>>>>> do not correspond to the 10 administrative districts for Delhi. They >>>>>>>>>> are >>>>>>>>>> for management and administrative purposes within the Directorate of >>>>>>>>>> Education (see here: >>>>>>>>>> http://www.edudel.nic.in/mis/schoolplant/school_information.htm >>>>>>>>>> and look at by district). I'm not sure if they maintain maps of >>>>>>>>>> these >>>>>>>>>> boundaries. >>>>>>>>>> >>>>>>>>>> I can't speak for any other states. >>>>>>>>>> >>>>>>>>>> Adding to Gautam and others approach beyond KA, you can also get >>>>>>>>>> lat/long for a lot of schools from here: >>>>>>>>>> https://schoolgis.nic.in/. I believe many on here have also >>>>>>>>>> pointed to that site. Scraping that data and matching to DISE data >>>>>>>>>> gets you >>>>>>>>>> ~85% of the schools. DISE school codes minus the last two digits >>>>>>>>>> gets you >>>>>>>>>> villages, so you can then get another couple of percent by matching >>>>>>>>>> any >>>>>>>>>> schools with missing lat/longs that are in the same village as >>>>>>>>>> schools with >>>>>>>>>> lat/longs. >>>>>>>>>> >>>>>>>>>> From there you could aggregate up to the administrative district. >>>>>>>>>> >>>>>>>>>> hth, >>>>>>>>>> Emmerich >>>>>>>>>> >>>>>>>>>> On Sunday, March 28, 2021 at 11:10:50 PM UTC-7 Gautam John wrote: >>>>>>>>>> >>>>>>>>>>> Hi Thej: >>>>>>>>>>> >>>>>>>>>>> > I am trying to make sense of UDISE wrt administrative >>>>>>>>>>> boundaries. >>>>>>>>>>> >>>>>>>>>>> There isn't any linkage - they are completely independent at >>>>>>>>>>> least >>>>>>>>>>> when I last checked in 2016. What we did was to collect the >>>>>>>>>>> lat/long >>>>>>>>>>> for schools so we could plot them to administrative and >>>>>>>>>>> electoral >>>>>>>>>>> boundaries. And infer educational boundaries from the school >>>>>>>>>>> points we >>>>>>>>>>> had and since we knew ed boundary each school belonged to. >>>>>>>>>>> >>>>>>>>>>> See: https://dise.klp.org.in/about/ >>>>>>>>>>> >>>>>>>>>>> I wonder if Sajjad might have any of those scripts handy. >>>>>>>>>>> >>>>>>>>>> -- >>>>>>>>> Datameet is a community of Data Science enthusiasts in India. Know >>>>>>>>> more about us by visiting http://datameet.org >>>>>>>>> --- >>>>>>>>> You received this message because you are subscribed to the Google >>>>>>>>> Groups "datameet" group. >>>>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>>>> send an email to datameet+unsubscr...@googlegroups.com. >>>>>>>>> To view this discussion on the web visit >>>>>>>>> https://groups.google.com/d/msgid/datameet/f658144f-9ea1-4c89-9a6a-06feb0e71b4cn%40googlegroups.com >>>>>>>>> <https://groups.google.com/d/msgid/datameet/f658144f-9ea1-4c89-9a6a-06feb0e71b4cn%40googlegroups.com?utm_medium=email&utm_source=footer> >>>>>>>>> . >>>>>>>>> >>>>>>>> -- >>>>>>>> Datameet is a community of Data Science enthusiasts in India. Know >>>>>>>> more about us by visiting http://datameet.org >>>>>>>> --- >>>>>>>> You received this message because you are subscribed to the Google >>>>>>>> Groups "datameet" group. >>>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>>> send an email to datameet+unsubscr...@googlegroups.com. >>>>>>>> To view this discussion on the web visit >>>>>>>> https://groups.google.com/d/msgid/datameet/CAOQOUMs8rVRWvZg%3D-GoxF9q1%2BNRpN-W8yC-kxCQayGbeQxveUg%40mail.gmail.com >>>>>>>> <https://groups.google.com/d/msgid/datameet/CAOQOUMs8rVRWvZg%3D-GoxF9q1%2BNRpN-W8yC-kxCQayGbeQxveUg%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>>>>> . >>>>>>>> >>>>>>> -- >>>>>>> Datameet is a community of Data Science enthusiasts in India. Know >>>>>>> more about us by visiting http://datameet.org >>>>>>> --- >>>>>>> You received this message because you are subscribed to the Google >>>>>>> Groups "datameet" group. >>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>> send an email to datameet+unsubscr...@googlegroups.com. >>>>>>> To view this discussion on the web visit >>>>>>> https://groups.google.com/d/msgid/datameet/CAABnYsVdHx83dk77%2BgubycV_ZHEfcuki8GZ7M2m2A4EJt9kiew%40mail.gmail.com >>>>>>> <https://groups.google.com/d/msgid/datameet/CAABnYsVdHx83dk77%2BgubycV_ZHEfcuki8GZ7M2m2A4EJt9kiew%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>>>> . >>>>>>> >>>>>> -- >>>>>> Datameet is a community of Data Science enthusiasts in India. Know >>>>>> more about us by visiting http://datameet.org >>>>>> --- >>>>>> You received this message because you are subscribed to the Google >>>>>> Groups "datameet" group. >>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>> send an email to datameet+unsubscr...@googlegroups.com. >>>>>> To view this discussion on the web visit >>>>>> https://groups.google.com/d/msgid/datameet/CAKxLuZf4MQJEk4BYvX-0qbQmTbTQaMM5GsowzCt5kpKcqrShQA%40mail.gmail.com >>>>>> <https://groups.google.com/d/msgid/datameet/CAKxLuZf4MQJEk4BYvX-0qbQmTbTQaMM5GsowzCt5kpKcqrShQA%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>>> . >>>>>> >>>>> -- >>>>> Datameet is a community of Data Science enthusiasts in India. Know >>>>> more about us by visiting http://datameet.org >>>>> --- >>>>> You received this message because you are subscribed to the Google >>>>> Groups "datameet" group. >>>>> To unsubscribe from this group and stop receiving emails from it, send >>>>> an email to datameet+unsubscr...@googlegroups.com. >>>>> To view this discussion on the web visit >>>>> https://groups.google.com/d/msgid/datameet/CAABnYsUTTeKP8LSN-QUq9Y1AkoPZYZbTwZdY2AaTP%3DO%3Dw0e7zw%40mail.gmail.com >>>>> <https://groups.google.com/d/msgid/datameet/CAABnYsUTTeKP8LSN-QUq9Y1AkoPZYZbTwZdY2AaTP%3DO%3Dw0e7zw%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>> . >>>>> >>>> -- >>>> Datameet is a community of Data Science enthusiasts in India. Know more >>>> about us by visiting http://datameet.org >>>> --- >>>> You received this message because you are subscribed to the Google >>>> Groups "datameet" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to datameet+unsubscr...@googlegroups.com. >>>> To view this discussion on the web visit >>>> https://groups.google.com/d/msgid/datameet/CAKxLuZe%3DHBBwx7oNf7TnZajf0ytp3J%2B15cyD5Fd%3DQkW9_gmZ6A%40mail.gmail.com >>>> <https://groups.google.com/d/msgid/datameet/CAKxLuZe%3DHBBwx7oNf7TnZajf0ytp3J%2B15cyD5Fd%3DQkW9_gmZ6A%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>> . >>>> >>> -- >>> Datameet is a community of Data Science enthusiasts in India. Know more >>> about us by visiting http://datameet.org >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "datameet" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to datameet+unsubscr...@googlegroups.com. >>> To view this discussion on the web visit >>> https://groups.google.com/d/msgid/datameet/CAABnYsWeAOCKPzkyJzj6RVEoK2oev9PSeHv_9_6D4OuPcXxb4A%40mail.gmail.com >>> <https://groups.google.com/d/msgid/datameet/CAABnYsWeAOCKPzkyJzj6RVEoK2oev9PSeHv_9_6D4OuPcXxb4A%40mail.gmail.com?utm_medium=email&utm_source=footer> >>> . >>> >> -- >> Datameet is a community of Data Science enthusiasts in India. Know more >> about us by visiting http://datameet.org >> --- >> You received this message because you are subscribed to the Google Groups >> "datameet" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to datameet+unsubscr...@googlegroups.com. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/datameet/CAA%2BkmBAGWe2ct3EOq55sHYc5DczXBUb7vrn0rP%2B9go_NZZjz2Q%40mail.gmail.com >> <https://groups.google.com/d/msgid/datameet/CAA%2BkmBAGWe2ct3EOq55sHYc5DczXBUb7vrn0rP%2B9go_NZZjz2Q%40mail.gmail.com?utm_medium=email&utm_source=footer> >> . >> > -- > Datameet is a community of Data Science enthusiasts in India. Know more > about us by visiting http://datameet.org > --- > You received this message because you are subscribed to the Google Groups > "datameet" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to datameet+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/datameet/CAABnYsVhf%2BHza8h1gtK9KrDik8S5O%2BrurS2q998UyLDkFjCJpw%40mail.gmail.com > <https://groups.google.com/d/msgid/datameet/CAABnYsVhf%2BHza8h1gtK9KrDik8S5O%2BrurS2q998UyLDkFjCJpw%40mail.gmail.com?utm_medium=email&utm_source=footer> > . > -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAA%2BkmBBzhEeO4ikFfrM45N5Vr-MF2ws%2B0p2GXc_w9VPjHMZYeQ%40mail.gmail.com.