Re: [datameet] Data of Indian Railways

2019-01-06 Thread Nikhil VJ
Heads-up for folks in Pune : Mark your calendars for Jan 12th, DMers are organizing a meetup to get together and work on this data. We'll post details here when finalized. --- Hi Arun, Good is great, and I tell this to my interns : Never chase perfection, target 80% and take a break;

Re: [datameet] Data of Indian Railways

2019-01-06 Thread Jasvinder Singh
Dear Nikhil, Saw the interface. Its quite simple and easy to use even by newbies. However is an android version of the same available? It would be easy to update the databank whenever one is traveling and comes across an unfamiliar station. Regards, Jasvinder Singh On Fri, Jan 4, 2019 at 3:51

Re: [datameet] Data of Indian Railways

2019-01-06 Thread Arun Ganesh
On Sun, Jan 6, 2019 at 11:19 AM Nikhil VJ wrote: > Hi, > > We might be able to get some data from Train On Map site of Indian > Railways? > > https://enquiry.indianrail.gov.in/ntes/trainOnMap.jsp > > (good to see the map is working again.. last few months it had been down > after google api

Re: [datameet] Data of Indian Railways

2019-01-05 Thread Nikhil VJ
Hi, We might be able to get some data from Train On Map site of Indian Railways? https://enquiry.indianrail.gov.in/ntes/trainOnMap.jsp (good to see the map is working again.. last few months it had been down after google api changes) The browser console is yielding quite some stuff. One

Re: [datameet] Data of Indian Railways

2019-01-04 Thread Srihari Thalla
Thanks for the mention Arun! I have now updated the crawler - removing tabs, unwanted newlines, leading and trailing spaces in the data columns. Here is the latest links to download: JSON: https://api.apify.com/v1/execs/7t9roKQ9yp6T8ZnpR/results?format=json=1=1 CSV:

Re: [datameet] Data of Indian Railways

2019-01-04 Thread Srihari Thalla
Hi Sajjad, I recently noticed that station codes from Datameet railways is used to update Wikidata pages for the stations. Would it be possible to update the repo in reverse as well, with the Arun's spreadsheet? -- Srihari On Fri, 4 Jan 2019 at 15:58, Sajjad Anwar wrote: > Hi! > > There are

Re: [datameet] Data of Indian Railways

2019-01-04 Thread Nikhil VJ
Hi, If there's interest I can set up a mapping interface to crowdsource lat-longs. Along the lines of this: https://fuzzymapper.herokuapp.com/ But I would take a week to set up so tell. Though it would be best to get existing lat-long sets with the official station code and import them in,

Re: [datameet] Data of Indian Railways

2019-01-04 Thread Sajjad Anwar
Hi! There are some ~8900 station coordinates that we scraped a while ago here https://github.com/datameet/railways Most of these have station codes so if we want to match with the list Arun generated we could do it. And then run another round of manual geocoding. Cheers, Sajjad On Fri, Jan 4,

Re: [datameet] Data of Indian Railways

2019-01-03 Thread Jasvinder Singh
Dear Arun, Exactly the type of simple data sheet that newbies can understand. However how location (Coordinates) is linked in this file? On Fri, Jan 4, 2019 at 12:11 PM Arun Ganesh wrote: > Spreadsheet if anyone wants to explore: >

Re: [datameet] Data of Indian Railways

2019-01-03 Thread Arun Ganesh
Spreadsheet if anyone wants to explore: https://docs.google.com/spreadsheets/d/1AFwl_5cB9qD39VWNox1LoeL3tGaGB22f7p4vc7IyMqY/edit#gid=0 There are 16,770 station entries of which 11,660 seem to be currently operational according to the expiry date of 2999. Filtering out goods stations, there are

Re: [datameet] Data of Indian Railways

2019-01-03 Thread Arun Ganesh
Beauty of the internet, crawler got done by Srihari: https://twitter.com/sriharithalla/status/1080801313707896837 JSON data: https://api.apify.com/v1/execs/TsBwnYutP5u9FCKp5/results?format=json=1 I'm in the process of doing a little bit of cleanup using openrefine and will share on a

Re: [datameet] Data of Indian Railways

2019-01-03 Thread Jasvinder Singh
Dear All, Not all the members are familiar with intricacies of the data collection for such projects. Since this seems to be a crowd sourcing endeavour, I suggest that the basic data collection protocol be enumerated for newbies so that they can also contribute data which can then be put in

Re: [datameet] Data of Indian Railways

2019-01-03 Thread Rajaram K
Hi I can help with scraping. Let me know. On Thu, 3 Jan 2019, 13:55 Arun Ganesh Thanks Nikhil for compiling all the links and improving the overpass query! > > Thinking whats the best way to scale this exercise so others can join. > Having a task list like the maproulette challenge is convenient

Re: [datameet] Data of Indian Railways

2019-01-03 Thread Arun Ganesh
Thanks Nikhil for compiling all the links and improving the overpass query! Thinking whats the best way to scale this exercise so others can join. Having a task list like the maproulette challenge is convenient tfor a newcomer to join. The only issue is that not every station has an entry on

Re: [datameet] Data of Indian Railways

2018-12-24 Thread Nikhil VJ
Hi folks, There's a project afoot in the OpenStreetMap and Wikidata communities to get together Indian Railways data. One major part of it: Properly mapping all the railway stations of India, and ensuring they have wikidata entries. Here's a wiki page set up for it:

Re: [datameet] Data of Indian Railways

2015-10-06 Thread srinivas kodali
So the new version of trains at a glance is out, this post is basically how to mine TAG to get train numbers. http://www.lostprogrammer.com/blog/trains-and-numbers/ Also OGD (data.gov.in) released a set of trains details a month or so ago, 2810 trains to be specific. Which can be found here

[datameet] Data of Indian Railways

2015-09-24 Thread srinivas kodali
Hi guys, I have writing a series of posts to highlight the data available with in Indian railways. I am not sharing any data as of now, But listing things on how and where you can find the datasets. www.lostprogrammer.com/blog/tag/railways/ Regards, Srinivas Kodali -- Datameet is a community

Re: [datameet] Data of Indian Railways

2015-09-24 Thread Anand Chitipothu
On Thu, Sep 24, 2015 at 6:03 PM, srinivas kodali wrote: > Hi guys, > > I have writing a series of posts to highlight the data available with in > Indian railways. I am not sharing any data as of now, But listing things on > how and where you can find the datasets. > >