Hi Rahul, Since you have already scraped data from < https://src.udiseplus.gov.in/locateSchool/schoolSearch;jsessionid=44DA6E7BC5EA403EAC38ECF43E93098F.app1Worker >, Can you provide the latest data available for AY 2019-20 to the group?
Also is it possible to get a few attributes from 'School Report Card'? (a pop-up button is made available on the page which opens a PDF) Kindly upload state wise csv files, so that it is consumable. Warm Regards, *Akshit Shah* On Wed, Jun 30, 2021 at 11:12 AM Thejesh GN <i...@thejeshgn.com> wrote: > I imported the CSV into SQLite. I can see 1450490 rows. > > Here is the quick screen-cast on how to do it -> > https://www.youtube.com/watch?v=rodMh6wGnoA > The tool I used for SQlite is called https://sqlitebrowser.org/ > Its free and open source. It's available for all three platforms. > > > Thej > -- > Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್ > http://thejeshgn.com > GPG ID : 0xBFFC8DD3C06DD6B0 > > > On Wed, 30 Jun 2021 at 08:04, Apurva Dalwadi <apurvasoi...@gmail.com> > wrote: > >> It has 10 lakh records >> >> On Thu, Jun 24, 2021 at 10:35 AM Thejesh GN <i...@thejeshgn.com> wrote: >> >>> I have converted it into a CSV >>> https://github.com/datameet/udise_schools/tree/master/data >>> >>> It has about 14 Lakh + schools. >>> >>> I will do some initial analysis over the weekend. But I am happy to >>> listen. I am guessing this data is at the least 2 years old. >>> >>> Thej >>> -- >>> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್ >>> http://thejeshgn.com >>> GPG ID : 0xBFFC8DD3C06DD6B0 >>> >>> >>> On Wed, 23 Jun 2021 at 04:03, Abhilash Chowdhary < >>> abhilash.ch...@gmail.com> wrote: >>> >>>> Thanks Thejesh. Super helpful! >>>> >>>> Abhilash >>>> >>>> On Wed, Jun 16, 2021 at 2:21 AM Thejesh GN <i...@thejeshgn.com> wrote: >>>> >>>>> Sorry, its public now. >>>>> >>>>> I will add readme and other information. >>>>> >>>>> Thej >>>>> -- >>>>> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್ >>>>> http://thejeshgn.com >>>>> GPG ID : 0xBFFC8DD3C06DD6B0 >>>>> >>>>> >>>>> On Wed, 16 Jun 2021 at 14:48, Abhilash Chowdhary < >>>>> abhilash.ch...@gmail.com> wrote: >>>>> >>>>>> Hi Thejesh, >>>>>> >>>>>> Thanks for the efforts in collating all this in a GeoJSON file. >>>>>> However, looks like the repository is private. The page returns a 404 for >>>>>> me. >>>>>> >>>>>> Abhilash >>>>>> >>>>>> On Sun, Jun 13, 2021 at 10:03 PM Thejesh GN <i...@thejeshgn.com> wrote: >>>>>> >>>>>>> 1. Thanks Dev. I was able to get the school list of all of India. >>>>>>> Currently raw GeoJSON is at >>>>>>> https://github.com/datameet/udise_schools >>>>>>> 2. I will try and flatten the data and do some initial analysis >>>>>>> 3. Rahul Gupta - the excel looks good. The udise school code in >>>>>>> excel is can be matched map files. Can you add this to a repo? Also for >>>>>>> which year is this? I see that they publish 2013 to 2018 data online. >>>>>>> >>>>>>> >>>>>>> Thej >>>>>>> -- >>>>>>> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್ >>>>>>> http://thejeshgn.com >>>>>>> GPG ID : 0xBFFC8DD3C06DD6B0 >>>>>>> >>>>>>> >>>>>>> On Sat, 29 May 2021 at 06:53, Rahul Gupta <rahulgupta.w...@gmail.com> >>>>>>> wrote: >>>>>>> >>>>>>>> Hi Thej, >>>>>>>> >>>>>>>> Attaching a few sample files for districts in Andhra Pradesh. This >>>>>>>> is the data I was able to scrape. Let me know if this helps. >>>>>>>> >>>>>>>> Thanks & Regards >>>>>>>> >>>>>>>> On Thu, May 27, 2021 at 7:40 PM Thejesh GN <i...@thejeshgn.com> wrote: >>>>>>>> >>>>>>>>> Devdatta, >>>>>>>>> Do you have for more than one state. So we can see the extent of >>>>>>>>> error? Even if the error rate is 10% it's not a bad idea to have that >>>>>>>>> data. >>>>>>>>> Also do school info have meta data like district or taluk? Because >>>>>>>>> they do collect that kind of data from schools in their form >>>>>>>>> <https://thejeshgn.com/wp-content/uploads/2021/05/udise_form.png>. >>>>>>>>> or may be its part of school reports. >>>>>>>>> >>>>>>>>> Rahul, >>>>>>>>> Thank you. >>>>>>>>> >>>>>>>>> Thej >>>>>>>>> -- >>>>>>>>> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್ >>>>>>>>> http://thejeshgn.com >>>>>>>>> GPG ID : 0xBFFC8DD3C06DD6B0 >>>>>>>>> >>>>>>>>> >>>>>>>>> On Thu, 27 May 2021 at 19:33, Rahul Gupta < >>>>>>>>> rahulgupta.w...@gmail.com> wrote: >>>>>>>>> >>>>>>>>>> Hi Tej, >>>>>>>>>> >>>>>>>>>> I had scraped district level information earlier. Will share a >>>>>>>>>> sample for everyone to have a look at. >>>>>>>>>> >>>>>>>>>> On Thu, 27 May, 2021, 5:10 pm Thejesh GN, <i...@thejeshgn.com> >>>>>>>>>> wrote: >>>>>>>>>> >>>>>>>>>>> I was planning to scrape the location and school codes. >>>>>>>>>>> >>>>>>>>>>> Reports, may be later. >>>>>>>>>>> >>>>>>>>>>> On Thu, 27 May 2021, 03:33 Devdatta Tengshe, < >>>>>>>>>>> devda...@tengshe.in> wrote: >>>>>>>>>>> >>>>>>>>>>>> Hi Thej, >>>>>>>>>>>> >>>>>>>>>>>> What do you want to scrape from this site? >>>>>>>>>>>> >>>>>>>>>>>> I have scraped some of the school locations from this site, but >>>>>>>>>>>> have not tried scraping the school reports. >>>>>>>>>>>> >>>>>>>>>>>> I also found that the location of many schools is incorrect. ( >>>>>>>>>>>> Schools tagged with Punjab appear in MP and so on) >>>>>>>>>>>> >>>>>>>>>>>> Regards, >>>>>>>>>>>> Devdatta >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> On Wed, 26 May 2021 at 15:53, Thejesh GN <i...@thejeshgn.com> >>>>>>>>>>>> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> Thanks Gautam and Emmerich. >>>>>>>>>>>>> >>>>>>>>>>>>> Here[1] is the summary of everything I know until now, >>>>>>>>>>>>> including the list of current UDISE Districts and Blocks along >>>>>>>>>>>>> with codes. >>>>>>>>>>>>> >>>>>>>>>>>>> I am planning to scrape https://schoolgis.nic.in/. But it >>>>>>>>>>>>> seems to be down most of the time. Has anyone here tried scraping >>>>>>>>>>>>> it before? >>>>>>>>>>>>> >>>>>>>>>>>>> I have not looked at data.gov.in for school list. May be I >>>>>>>>>>>>> should check that too. >>>>>>>>>>>>> >>>>>>>>>>>>> - [1] >>>>>>>>>>>>> https://thejeshgn.com/2021/05/26/india-udise-educational-districts-and-blocks/ >>>>>>>>>>>>> >>>>>>>>>>>>> On Saturday, 10 April 2021 at 20:38:03 UTC+5:30 >>>>>>>>>>>>> emmeric...@gmail.com wrote: >>>>>>>>>>>>> >>>>>>>>>>>>>> Hi Thej and Gautam, >>>>>>>>>>>>>> >>>>>>>>>>>>>> From what I know, Gautam is exactly right. For example, in >>>>>>>>>>>>>> Delhi, the Directorate of Education maintains 13 education >>>>>>>>>>>>>> districts that >>>>>>>>>>>>>> do not correspond to the 10 administrative districts for Delhi. >>>>>>>>>>>>>> They are >>>>>>>>>>>>>> for management and administrative purposes within the >>>>>>>>>>>>>> Directorate of >>>>>>>>>>>>>> Education (see here: >>>>>>>>>>>>>> http://www.edudel.nic.in/mis/schoolplant/school_information.htm >>>>>>>>>>>>>> and look at by district). I'm not sure if they maintain maps of >>>>>>>>>>>>>> these >>>>>>>>>>>>>> boundaries. >>>>>>>>>>>>>> >>>>>>>>>>>>>> I can't speak for any other states. >>>>>>>>>>>>>> >>>>>>>>>>>>>> Adding to Gautam and others approach beyond KA, you can also >>>>>>>>>>>>>> get lat/long for a lot of schools from here: >>>>>>>>>>>>>> https://schoolgis.nic.in/. I believe many on here have also >>>>>>>>>>>>>> pointed to that site. Scraping that data and matching to DISE >>>>>>>>>>>>>> data gets you >>>>>>>>>>>>>> ~85% of the schools. DISE school codes minus the last two >>>>>>>>>>>>>> digits gets you >>>>>>>>>>>>>> villages, so you can then get another couple of percent by >>>>>>>>>>>>>> matching any >>>>>>>>>>>>>> schools with missing lat/longs that are in the same village as >>>>>>>>>>>>>> schools with >>>>>>>>>>>>>> lat/longs. >>>>>>>>>>>>>> >>>>>>>>>>>>>> From there you could aggregate up to the administrative >>>>>>>>>>>>>> district. >>>>>>>>>>>>>> >>>>>>>>>>>>>> hth, >>>>>>>>>>>>>> Emmerich >>>>>>>>>>>>>> >>>>>>>>>>>>>> On Sunday, March 28, 2021 at 11:10:50 PM UTC-7 Gautam John >>>>>>>>>>>>>> wrote: >>>>>>>>>>>>>> >>>>>>>>>>>>>>> Hi Thej: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> > I am trying to make sense of UDISE wrt administrative >>>>>>>>>>>>>>> boundaries. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> There isn't any linkage - they are completely independent at >>>>>>>>>>>>>>> least >>>>>>>>>>>>>>> when I last checked in 2016. What we did was to collect the >>>>>>>>>>>>>>> lat/long >>>>>>>>>>>>>>> for schools so we could plot them to administrative and >>>>>>>>>>>>>>> electoral >>>>>>>>>>>>>>> boundaries. And infer educational boundaries from the school >>>>>>>>>>>>>>> points we >>>>>>>>>>>>>>> had and since we knew ed boundary each school belonged to. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> See: https://dise.klp.org.in/about/ >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> I wonder if Sajjad might have any of those scripts handy. >>>>>>>>>>>>>>> >>>>>>>>>>>>>> -- >>>>>>>>>>>>> Datameet is a community of Data Science enthusiasts in India. >>>>>>>>>>>>> Know more about us by visiting http://datameet.org >>>>>>>>>>>>> --- >>>>>>>>>>>>> You received this message because you are subscribed to the >>>>>>>>>>>>> Google Groups "datameet" group. >>>>>>>>>>>>> To unsubscribe from this group and stop receiving emails from >>>>>>>>>>>>> it, send an email to datameet+unsubscr...@googlegroups.com. >>>>>>>>>>>>> To view this discussion on the web visit >>>>>>>>>>>>> https://groups.google.com/d/msgid/datameet/f658144f-9ea1-4c89-9a6a-06feb0e71b4cn%40googlegroups.com >>>>>>>>>>>>> <https://groups.google.com/d/msgid/datameet/f658144f-9ea1-4c89-9a6a-06feb0e71b4cn%40googlegroups.com?utm_medium=email&utm_source=footer> >>>>>>>>>>>>> . >>>>>>>>>>>>> >>>>>>>>>>>> -- >>>>>>>>>>>> Datameet is a community of Data Science enthusiasts in India. >>>>>>>>>>>> Know more about us by visiting http://datameet.org >>>>>>>>>>>> --- >>>>>>>>>>>> You received this message because you are subscribed to the >>>>>>>>>>>> Google Groups "datameet" group. >>>>>>>>>>>> To unsubscribe from this group and stop receiving emails from >>>>>>>>>>>> it, send an email to datameet+unsubscr...@googlegroups.com. >>>>>>>>>>>> To view this discussion on the web visit >>>>>>>>>>>> https://groups.google.com/d/msgid/datameet/CAOQOUMs8rVRWvZg%3D-GoxF9q1%2BNRpN-W8yC-kxCQayGbeQxveUg%40mail.gmail.com >>>>>>>>>>>> <https://groups.google.com/d/msgid/datameet/CAOQOUMs8rVRWvZg%3D-GoxF9q1%2BNRpN-W8yC-kxCQayGbeQxveUg%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>>>>>>>>> . >>>>>>>>>>>> >>>>>>>>>>> -- >>>>>>>>>>> Datameet is a community of Data Science enthusiasts in India. >>>>>>>>>>> Know more about us by visiting http://datameet.org >>>>>>>>>>> --- >>>>>>>>>>> You received this message because you are subscribed to the >>>>>>>>>>> Google Groups "datameet" group. >>>>>>>>>>> To unsubscribe from this group and stop receiving emails from >>>>>>>>>>> it, send an email to datameet+unsubscr...@googlegroups.com. >>>>>>>>>>> To view this discussion on the web visit >>>>>>>>>>> https://groups.google.com/d/msgid/datameet/CAABnYsVdHx83dk77%2BgubycV_ZHEfcuki8GZ7M2m2A4EJt9kiew%40mail.gmail.com >>>>>>>>>>> <https://groups.google.com/d/msgid/datameet/CAABnYsVdHx83dk77%2BgubycV_ZHEfcuki8GZ7M2m2A4EJt9kiew%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>>>>>>>> . >>>>>>>>>>> >>>>>>>>>> -- >>>>>>>>>> Datameet is a community of Data Science enthusiasts in India. >>>>>>>>>> Know more about us by visiting http://datameet.org >>>>>>>>>> --- >>>>>>>>>> You received this message because you are subscribed to the >>>>>>>>>> Google Groups "datameet" group. >>>>>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>>>>> send an email to datameet+unsubscr...@googlegroups.com. >>>>>>>>>> To view this discussion on the web visit >>>>>>>>>> https://groups.google.com/d/msgid/datameet/CAKxLuZf4MQJEk4BYvX-0qbQmTbTQaMM5GsowzCt5kpKcqrShQA%40mail.gmail.com >>>>>>>>>> <https://groups.google.com/d/msgid/datameet/CAKxLuZf4MQJEk4BYvX-0qbQmTbTQaMM5GsowzCt5kpKcqrShQA%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>>>>>>> . >>>>>>>>>> >>>>>>>>> -- >>>>>>>>> Datameet is a community of Data Science enthusiasts in India. Know >>>>>>>>> more about us by visiting http://datameet.org >>>>>>>>> --- >>>>>>>>> You received this message because you are subscribed to the Google >>>>>>>>> Groups "datameet" group. >>>>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>>>> send an email to datameet+unsubscr...@googlegroups.com. >>>>>>>>> To view this discussion on the web visit >>>>>>>>> https://groups.google.com/d/msgid/datameet/CAABnYsUTTeKP8LSN-QUq9Y1AkoPZYZbTwZdY2AaTP%3DO%3Dw0e7zw%40mail.gmail.com >>>>>>>>> <https://groups.google.com/d/msgid/datameet/CAABnYsUTTeKP8LSN-QUq9Y1AkoPZYZbTwZdY2AaTP%3DO%3Dw0e7zw%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>>>>>> . >>>>>>>>> >>>>>>>> -- >>>>>>>> Datameet is a community of Data Science enthusiasts in India. Know >>>>>>>> more about us by visiting http://datameet.org >>>>>>>> --- >>>>>>>> You received this message because you are subscribed to the Google >>>>>>>> Groups "datameet" group. >>>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>>> send an email to datameet+unsubscr...@googlegroups.com. >>>>>>>> To view this discussion on the web visit >>>>>>>> https://groups.google.com/d/msgid/datameet/CAKxLuZe%3DHBBwx7oNf7TnZajf0ytp3J%2B15cyD5Fd%3DQkW9_gmZ6A%40mail.gmail.com >>>>>>>> <https://groups.google.com/d/msgid/datameet/CAKxLuZe%3DHBBwx7oNf7TnZajf0ytp3J%2B15cyD5Fd%3DQkW9_gmZ6A%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>>>>> . >>>>>>>> >>>>>>> -- >>>>>>> Datameet is a community of Data Science enthusiasts in India. Know >>>>>>> more about us by visiting http://datameet.org >>>>>>> --- >>>>>>> You received this message because you are subscribed to the Google >>>>>>> Groups "datameet" group. >>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>> send an email to datameet+unsubscr...@googlegroups.com. >>>>>>> To view this discussion on the web visit >>>>>>> https://groups.google.com/d/msgid/datameet/CAABnYsWeAOCKPzkyJzj6RVEoK2oev9PSeHv_9_6D4OuPcXxb4A%40mail.gmail.com >>>>>>> <https://groups.google.com/d/msgid/datameet/CAABnYsWeAOCKPzkyJzj6RVEoK2oev9PSeHv_9_6D4OuPcXxb4A%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>>>> . >>>>>>> >>>>>> -- >>>>>> Datameet is a community of Data Science enthusiasts in India. Know >>>>>> more about us by visiting http://datameet.org >>>>>> --- >>>>>> You received this message because you are subscribed to the Google >>>>>> Groups "datameet" group. >>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>> send an email to datameet+unsubscr...@googlegroups.com. >>>>>> To view this discussion on the web visit >>>>>> https://groups.google.com/d/msgid/datameet/CAA%2BkmBAGWe2ct3EOq55sHYc5DczXBUb7vrn0rP%2B9go_NZZjz2Q%40mail.gmail.com >>>>>> <https://groups.google.com/d/msgid/datameet/CAA%2BkmBAGWe2ct3EOq55sHYc5DczXBUb7vrn0rP%2B9go_NZZjz2Q%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>>> . >>>>>> >>>>> -- >>>>> Datameet is a community of Data Science enthusiasts in India. Know >>>>> more about us by visiting http://datameet.org >>>>> --- >>>>> You received this message because you are subscribed to the Google >>>>> Groups "datameet" group. >>>>> To unsubscribe from this group and stop receiving emails from it, send >>>>> an email to datameet+unsubscr...@googlegroups.com. >>>>> To view this discussion on the web visit >>>>> https://groups.google.com/d/msgid/datameet/CAABnYsVhf%2BHza8h1gtK9KrDik8S5O%2BrurS2q998UyLDkFjCJpw%40mail.gmail.com >>>>> <https://groups.google.com/d/msgid/datameet/CAABnYsVhf%2BHza8h1gtK9KrDik8S5O%2BrurS2q998UyLDkFjCJpw%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>> . >>>>> >>>> -- >>>> Datameet is a community of Data Science enthusiasts in India. Know more >>>> about us by visiting http://datameet.org >>>> --- >>>> You received this message because you are subscribed to the Google >>>> Groups "datameet" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to datameet+unsubscr...@googlegroups.com. >>>> To view this discussion on the web visit >>>> https://groups.google.com/d/msgid/datameet/CAA%2BkmBBzhEeO4ikFfrM45N5Vr-MF2ws%2B0p2GXc_w9VPjHMZYeQ%40mail.gmail.com >>>> <https://groups.google.com/d/msgid/datameet/CAA%2BkmBBzhEeO4ikFfrM45N5Vr-MF2ws%2B0p2GXc_w9VPjHMZYeQ%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>> . >>>> >>> -- >>> Datameet is a community of Data Science enthusiasts in India. Know more >>> about us by visiting http://datameet.org >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "datameet" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to datameet+unsubscr...@googlegroups.com. >>> To view this discussion on the web visit >>> https://groups.google.com/d/msgid/datameet/CAABnYsWGHb-3UVh0yeayfs5HVR%3DYfLmq6_OR9J-57ggu2V8gjQ%40mail.gmail.com >>> <https://groups.google.com/d/msgid/datameet/CAABnYsWGHb-3UVh0yeayfs5HVR%3DYfLmq6_OR9J-57ggu2V8gjQ%40mail.gmail.com?utm_medium=email&utm_source=footer> >>> . >>> >> -- >> Datameet is a community of Data Science enthusiasts in India. Know more >> about us by visiting http://datameet.org >> --- >> You received this message because you are subscribed to the Google Groups >> "datameet" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to datameet+unsubscr...@googlegroups.com. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/datameet/CAD2K3bA0-qwKBZ8BnRPJ87%2BDqsEcC_GcK_HryspruTwZN3GnVg%40mail.gmail.com >> <https://groups.google.com/d/msgid/datameet/CAD2K3bA0-qwKBZ8BnRPJ87%2BDqsEcC_GcK_HryspruTwZN3GnVg%40mail.gmail.com?utm_medium=email&utm_source=footer> >> . >> > -- > Datameet is a community of Data Science enthusiasts in India. Know more > about us by visiting http://datameet.org > --- > You received this message because you are subscribed to the Google Groups > "datameet" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to datameet+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/datameet/CAABnYsWiQoP3b_4DM8g3bBFvatmnNyPZay16zkixuUo91uTwgg%40mail.gmail.com > <https://groups.google.com/d/msgid/datameet/CAABnYsWiQoP3b_4DM8g3bBFvatmnNyPZay16zkixuUo91uTwgg%40mail.gmail.com?utm_medium=email&utm_source=footer> > . > -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAJHzfxUMA5iWJXVS9cxK%3D2Jw_Pr89MOgoSkE4WOZUHAWoOx3vg%40mail.gmail.com.
