Re: [datameet] DOS release Remote Sensing Policy 2020 draft for public comment

[Thejesh GN]

Thank you for sharing. We should send out comments as community.
Thej
--
Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0


On Fri, 27 Nov 2020 at 19:30, Sharad Lele (शरच्चंद्र लेले) <
sharad.l...@gmail.com> wrote:

> Please read and comment.
>
>
> https://www.isro.gov.in/sites/default/files/spacers_policy_ngp_2020_draft.pdf
>
> Sharad
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/e9221cdf-1e29-9f26-cd5a-1b031ba51761%40gmail.com
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CAABnYsWm7xuY33vkAP0nu8qDRBibSwFx-pEGKCESe5Nuu9Bn6g%40mail.gmail.com.

Re: [datameet] ANN: Opening of 7,00,000+ Rural Points of Interests Data

[Pratap Vardhan]

Thanks Nisar, that's useful to know. I'll update the repo with these 
pointers. 
What frequency for updates would you suggest (monthly or)? If you prefer, 
we can move the repo to datameet org or any other widely accessible one and 
collectively edit it.  
So, what I meant about coordinates data is, some rows are blank and some 
have coordinates but beyond India's extent bounds. I guess they will get 
fixed with updates too.
Here's the distribution for states.

Separately, minor issue perhaps - there are 22 rows which probably have 
sub-category mislabeled.
 
Thanks for the details!
On Friday, November 27, 2020 at 12:47:59 AM UTC-5 nisar...@gmail.com wrote:

> Really beautiful!  
>
> I'll answer some of the queries you raised on the tweet thread here for 
> everyone. 
>
> You've commented that the data in UK, HP & Nagaland appears erroneous. I 
> am assuming because the lat/long is missing. It is so because these states 
> are still doing the survey and haven't completed. They may complete it in 
> the next few months. Many of the other NE states are also in a similar 
> position. Goa and most UTs haven't been onboarded to the scheme yet. For 
> the same reason, I would point people towards to original dataset or put in 
> a system to update your GH repos regularly.
>
> Apart from that - I'll re-iterate that the data was collected by 
> government rural engineers at the block level. Intention, accuracy and even 
> understanding of definitions will vary across blocks/districts and 
> especially states. The data serves its primary purpose with these 
> assumptions but may lead to misleading statistics if treated as a census 
> for cross-geography comparisons. 
>
>
> On Friday, 27 November 2020 at 10:50:23 UTC+5:30 prat...@gmail.com wrote:
>
>> I've pulled states csvs to this repo 
>> https://github.com/pratapvardhan/rural-facilities-pmgsy. Consolidated 
>> India csv is at 
>> https://www.kaggle.com/pratapvardhan/770k-geotagged-rural-facilities-in-india-pmgsy
>> And, posted a thread of couple of visuals and minor data issues here 
>> https://twitter.com/PratapVardhan/status/1332174593877020673
>> Would love to hear if you use this data to create something.
>>
>> On Monday, November 23, 2020 at 2:05:47 AM UTC-5 Arun Ganesh wrote:
>>
>>> Wonderful Harsh, its amazing to see such rural spatial datasets opened 
>>> by the government. The OpenStreetMap India community is looking into the 
>>> data to better get a sense of the quality to see how it could be integrated 
>>> with the existing OSM basemap.
>>>
>>> As a sample have made an interactive map of just the Kerala data if 
>>> anyone wants to explore: 
>>> https://api.mapbox.com/styles/v1/planemad/ckhrbz1o6038o19piti441hd7.html?fresh=true&title=copy&access_token=pk.eyJ1IjoicGxhbmVtYWQiLCJhIjoiemdYSVVLRSJ9.g3lbg_eN0kztmsfIPxa9MQ#10.53/9.6726/76.524
>>>
>>> The dataset points are in yellow, the rest are from OSM. Some initial 
>>> evaluations in Kerala and Karnataka suggest that the data is pretty good 
>>> and spatially accurate within 100m.
>>>
>>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/7286d673-1804-436d-8f6c-5805383db591n%40googlegroups.com.

Re: [datameet] ANN: Opening of 7,00,000+ Rural Points of Interests Data

[Pratap Vardhan]

Images seem to have been lost. Attaching them.
Distribution for states.  

[image: pm1.PNG]I
22 rows which probably have sub-category mislabeled? 
[image: pm2.PNG]

On Friday, November 27, 2020 at 9:27:56 AM UTC-5 Pratap Vardhan wrote:

> Thanks Nisar, that's useful to know. I'll update the repo with these 
> pointers. 
> What frequency for updates would you suggest (monthly or)? If you prefer, 
> we can move the repo to datameet org or any other widely accessible one and 
> collectively edit it.  
> So, what I meant about coordinates data is, some rows are blank and some 
> have coordinates but beyond India's extent bounds. I guess they will get 
> fixed with updates too.
> Here's the distribution for states.
>
> Separately, minor issue perhaps - there are 22 rows which probably have 
> sub-category mislabeled.
>  
> Thanks for the details!
> On Friday, November 27, 2020 at 12:47:59 AM UTC-5 nisar...@gmail.com 
> wrote:
>
>> Really beautiful!  
>>
>> I'll answer some of the queries you raised on the tweet thread here for 
>> everyone. 
>>
>> You've commented that the data in UK, HP & Nagaland appears erroneous. I 
>> am assuming because the lat/long is missing. It is so because these states 
>> are still doing the survey and haven't completed. They may complete it in 
>> the next few months. Many of the other NE states are also in a similar 
>> position. Goa and most UTs haven't been onboarded to the scheme yet. For 
>> the same reason, I would point people towards to original dataset or put in 
>> a system to update your GH repos regularly.
>>
>> Apart from that - I'll re-iterate that the data was collected by 
>> government rural engineers at the block level. Intention, accuracy and even 
>> understanding of definitions will vary across blocks/districts and 
>> especially states. The data serves its primary purpose with these 
>> assumptions but may lead to misleading statistics if treated as a census 
>> for cross-geography comparisons. 
>>
>>
>> On Friday, 27 November 2020 at 10:50:23 UTC+5:30 prat...@gmail.com wrote:
>>
>>> I've pulled states csvs to this repo 
>>> https://github.com/pratapvardhan/rural-facilities-pmgsy. Consolidated 
>>> India csv is at 
>>> https://www.kaggle.com/pratapvardhan/770k-geotagged-rural-facilities-in-india-pmgsy
>>> And, posted a thread of couple of visuals and minor data issues here 
>>> https://twitter.com/PratapVardhan/status/1332174593877020673
>>> Would love to hear if you use this data to create something.
>>>
>>> On Monday, November 23, 2020 at 2:05:47 AM UTC-5 Arun Ganesh wrote:
>>>
 Wonderful Harsh, its amazing to see such rural spatial datasets opened 
 by the government. The OpenStreetMap India community is looking into the 
 data to better get a sense of the quality to see how it could be 
 integrated 
 with the existing OSM basemap.

 As a sample have made an interactive map of just the Kerala data if 
 anyone wants to explore: 
 https://api.mapbox.com/styles/v1/planemad/ckhrbz1o6038o19piti441hd7.html?fresh=true&title=copy&access_token=pk.eyJ1IjoicGxhbmVtYWQiLCJhIjoiemdYSVVLRSJ9.g3lbg_eN0kztmsfIPxa9MQ#10.53/9.6726/76.524

 The dataset points are in yellow, the rest are from OSM. Some initial 
 evaluations in Kerala and Karnataka suggest that the data is pretty good 
 and spatially accurate within 100m.

>>>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/c71a2201-b94d-4107-97c8-0ebd9baa76d0n%40googlegroups.com.

Re: [datameet] DOS release Remote Sensing Policy 2020 draft for public comment

[Ujaval Gandhi]

Hi Sharad,

Thanks for sharing. From the perspective of sharing ISRO's own data, the
policy says

" In the interest of promoting research, innovation, societal applications
and value addition, DOS shall make IRS satellite data having GSD of 5 meter
and coarser, easily accessible on ‘free and open’ basis. "

I think this is really good. As the best open remote sensing multispectral
data currently is Sentinel-2 (10m), ISRO sharing LISS4 (5.6m) data puts
them ahead of USGS and ESA. Of course, the concern would be the
implementation and how fast they can make that data available. My comment
here would that they adopt a true open data license for this data, like
Government Open Data License.

[image: Logo] 
Ujaval Gandhi
Spatial Thoughts
mobile: +91-8095684687
email: uja...@spatialthoughts.com
[image: LinkedIn icon]   [image:
Twitter icon] 



On Fri, Nov 27, 2020 at 7:33 PM Thejesh GN  wrote:

> Thank you for sharing. We should send out comments as community.
> Thej
> --
> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
> http://thejeshgn.com
> GPG ID :  0xBFFC8DD3C06DD6B0
>
>
> On Fri, 27 Nov 2020 at 19:30, Sharad Lele (शरच्चंद्र लेले) <
> sharad.l...@gmail.com> wrote:
>
>> Please read and comment.
>>
>>
>> https://www.isro.gov.in/sites/default/files/spacers_policy_ngp_2020_draft.pdf
>>
>> Sharad
>>
>> --
>> Datameet is a community of Data Science enthusiasts in India. Know more
>> about us by visiting http://datameet.org
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to datameet+unsubscr...@googlegroups.com.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/datameet/e9221cdf-1e29-9f26-cd5a-1b031ba51761%40gmail.com
>> .
>>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/CAABnYsWm7xuY33vkAP0nu8qDRBibSwFx-pEGKCESe5Nuu9Bn6g%40mail.gmail.com
> 
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CALymcQDu0jbCGmR%3DxBPFG52w5tU79Kg770i4Skc2iY9pt3L8GA%40mail.gmail.com.

Re: [datameet] DOS release Remote Sensing Policy 2020 draft for public comment

[Naveen Francis]

Hello Thej, 

Definitely, we should send comments to mention data to be in 'government 
open data license'
We should reach out to like-minded orgs ?

1. Space Federation of India https://www.spacefed.in/
2. Association of Geospatial Industries (AGI) - http://agiindia.com/
3. Indian National Cartographic Association - https://www.incaindia.org/
4. Open Source Geospatial Foundation – India - http://osgeo.in/

Thanks,
naveenpf

On Friday, 27 November, 2020 at 8:13:01 pm UTC+5:30 
uja...@spatialthoughts.com wrote:

> Hi Sharad,
>
> Thanks for sharing. From the perspective of sharing ISRO's own data, the 
> policy says 
>
> " In the interest of promoting research, innovation, societal applications 
> and value addition, DOS shall make IRS satellite data having GSD of 5 meter 
> and coarser, easily accessible on ‘free and open’ basis. "
>
> I think this is really good. As the best open remote sensing multispectral 
> data currently is Sentinel-2 (10m), ISRO sharing LISS4 (5.6m) data puts 
> them ahead of USGS and ESA. Of course, the concern would be the 
> implementation and how fast they can make that data available. My comment 
> here would that they adopt a true open data license for this data, like 
> Government Open Data License.
>
> [image: Logo]  
> Ujaval Gandhi
> Spatial Thoughts
> mobile: +91-8095684687 <+91%2080956%2084687>
> email: uja...@spatialthoughts.com
> [image: LinkedIn icon]   
> [image: 
> Twitter icon]   
>
>
>
> On Fri, Nov 27, 2020 at 7:33 PM Thejesh GN  wrote:
>
>> Thank you for sharing. We should send out comments as community.
>> Thej
>> --
>> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
>> http://thejeshgn.com
>> GPG ID :  0xBFFC8DD3C06DD6B0
>>
>>
>> On Fri, 27 Nov 2020 at 19:30, Sharad Lele (शरच्चंद्र लेले) <
>> shara...@gmail.com> wrote:
>>
>>> Please read and comment.
>>>
>>>
>>> https://www.isro.gov.in/sites/default/files/spacers_policy_ngp_2020_draft.pdf
>>>
>>> Sharad
>>>
>>> -- 
>>> Datameet is a community of Data Science enthusiasts in India. Know more 
>>> about us by visiting http://datameet.org
>>> --- 
>>> You received this message because you are subscribed to the Google 
>>> Groups "datameet" group.
>>> To unsubscribe from this group and stop receiving emails from it, send 
>>> an email to datameet+u...@googlegroups.com.
>>> To view this discussion on the web visit 
>>> https://groups.google.com/d/msgid/datameet/e9221cdf-1e29-9f26-cd5a-1b031ba51761%40gmail.com
>>> .
>>>
>> -- 
>> Datameet is a community of Data Science enthusiasts in India. Know more 
>> about us by visiting http://datameet.org
>> --- 
>> You received this message because you are subscribed to the Google Groups 
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to datameet+u...@googlegroups.com.
>>
> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/datameet/CAABnYsWm7xuY33vkAP0nu8qDRBibSwFx-pEGKCESe5Nuu9Bn6g%40mail.gmail.com
>>  
>> 
>> .
>>
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/0d727514-d239-46f5-b019-58302088dde1n%40googlegroups.com.

Re: [datameet] DOS release Remote Sensing Policy 2020 draft for public comment

[Sharad Lele]

I agree with you, Ujaval. Getting 5.6m data in the public domain will be a 
big boost. 

But I am curious to know from others what their experience has been with 
the quality of this 5.6m (IRS P6) data. For instance, I found the spectral 
quality to be rather poor: it boasts of being 10-bit but all the data are 
clustered in a 7-bit space. So we had to go back to coarser Landsat-8 
because it gave better spectral quality (not just more bands).

On the rest of the policy: I am wondering why they say nothing about 
drones, about UAV-based LIDAR, and so on, which are really the cutting-edge 
these days, are they not?

Sharad

On Friday, November 27, 2020 at 8:13:01 PM UTC+5:30 
uja...@spatialthoughts.com wrote:

> Hi Sharad,
>
> Thanks for sharing. From the perspective of sharing ISRO's own data, the 
> policy says 
>
> " In the interest of promoting research, innovation, societal applications 
> and value addition, DOS shall make IRS satellite data having GSD of 5 meter 
> and coarser, easily accessible on ‘free and open’ basis. "
>
> I think this is really good. As the best open remote sensing multispectral 
> data currently is Sentinel-2 (10m), ISRO sharing LISS4 (5.6m) data puts 
> them ahead of USGS and ESA. Of course, the concern would be the 
> implementation and how fast they can make that data available. My comment 
> here would that they adopt a true open data license for this data, like 
> Government Open Data License.
>
> [image: Logo]  
> Ujaval Gandhi
> Spatial Thoughts
> mobile: +91-8095684687 <+91%2080956%2084687>
> email: uja...@spatialthoughts.com
> [image: LinkedIn icon]   
> [image: 
> Twitter icon]   
>
>
>
> On Fri, Nov 27, 2020 at 7:33 PM Thejesh GN  wrote:
>
>> Thank you for sharing. We should send out comments as community.
>> Thej
>> --
>> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
>> http://thejeshgn.com
>> GPG ID :  0xBFFC8DD3C06DD6B0
>>
>>
>> On Fri, 27 Nov 2020 at 19:30, Sharad Lele (शरच्चंद्र लेले) <
>> shara...@gmail.com> wrote:
>>
>>> Please read and comment.
>>>
>>>
>>> https://www.isro.gov.in/sites/default/files/spacers_policy_ngp_2020_draft.pdf
>>>
>>> Sharad
>>>
>>> -- 
>>> Datameet is a community of Data Science enthusiasts in India. Know more 
>>> about us by visiting http://datameet.org
>>> --- 
>>> You received this message because you are subscribed to the Google 
>>> Groups "datameet" group.
>>> To unsubscribe from this group and stop receiving emails from it, send 
>>> an email to datameet+u...@googlegroups.com.
>>> To view this discussion on the web visit 
>>> https://groups.google.com/d/msgid/datameet/e9221cdf-1e29-9f26-cd5a-1b031ba51761%40gmail.com
>>> .
>>>
>> -- 
>> Datameet is a community of Data Science enthusiasts in India. Know more 
>> about us by visiting http://datameet.org
>> --- 
>> You received this message because you are subscribed to the Google Groups 
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to datameet+u...@googlegroups.com.
>>
> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/datameet/CAABnYsWm7xuY33vkAP0nu8qDRBibSwFx-pEGKCESe5Nuu9Bn6g%40mail.gmail.com
>>  
>> 
>> .
>>
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/e9c9178a-7317-4cf0-b734-ef881a11793fn%40googlegroups.com.

Re: [datameet] DOS release Remote Sensing Policy 2020 draft for public comment

[Sharad Lele]

Btw, I will be appearing on Rajya Sabha TV tomorrow at 1pm with MoES Secy 
for a panel discussion on this new policy. So do send in more comments 
tonight/tomorrow morning, AND listen in on that discussion. 

On Friday, November 27, 2020 at 10:14:16 PM UTC+5:30 Sharad Lele wrote:

> I agree with you, Ujaval. Getting 5.6m data in the public domain will be a 
> big boost. 
>
> But I am curious to know from others what their experience has been with 
> the quality of this 5.6m (IRS P6) data. For instance, I found the spectral 
> quality to be rather poor: it boasts of being 10-bit but all the data are 
> clustered in a 7-bit space. So we had to go back to coarser Landsat-8 
> because it gave better spectral quality (not just more bands).
>
> On the rest of the policy: I am wondering why they say nothing about 
> drones, about UAV-based LIDAR, and so on, which are really the cutting-edge 
> these days, are they not?
>
> Sharad
>
> On Friday, November 27, 2020 at 8:13:01 PM UTC+5:30 
> uja...@spatialthoughts.com wrote:
>
>> Hi Sharad,
>>
>> Thanks for sharing. From the perspective of sharing ISRO's own data, the 
>> policy says 
>>
>> " In the interest of promoting research, innovation, societal 
>> applications and value addition, DOS shall make IRS satellite data having 
>> GSD of 5 meter and coarser, easily accessible on ‘free and open’ basis. "
>>
>> I think this is really good. As the best open remote sensing 
>> multispectral data currently is Sentinel-2 (10m), ISRO sharing LISS4 (5.6m) 
>> data puts them ahead of USGS and ESA. Of course, the concern would be the 
>> implementation and how fast they can make that data available. My comment 
>> here would that they adopt a true open data license for this data, like 
>> Government Open Data License.
>>
>> [image: Logo]  
>> Ujaval Gandhi
>> Spatial Thoughts
>> mobile: +91-8095684687 <+91%2080956%2084687>
>> email: uja...@spatialthoughts.com
>> [image: LinkedIn icon]   
>> [image: 
>> Twitter icon]   
>>
>>
>>
>> On Fri, Nov 27, 2020 at 7:33 PM Thejesh GN  wrote:
>>
>>> Thank you for sharing. We should send out comments as community.
>>> Thej
>>> --
>>> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
>>> http://thejeshgn.com
>>> GPG ID :  0xBFFC8DD3C06DD6B0
>>>
>>>
>>> On Fri, 27 Nov 2020 at 19:30, Sharad Lele (शरच्चंद्र लेले) <
>>> shara...@gmail.com> wrote:
>>>
 Please read and comment.


 https://www.isro.gov.in/sites/default/files/spacers_policy_ngp_2020_draft.pdf

 Sharad

 -- 
 Datameet is a community of Data Science enthusiasts in India. Know more 
 about us by visiting http://datameet.org
 --- 
 You received this message because you are subscribed to the Google 
 Groups "datameet" group.
 To unsubscribe from this group and stop receiving emails from it, send 
 an email to datameet+u...@googlegroups.com.
 To view this discussion on the web visit 
 https://groups.google.com/d/msgid/datameet/e9221cdf-1e29-9f26-cd5a-1b031ba51761%40gmail.com
 .

>>> -- 
>>> Datameet is a community of Data Science enthusiasts in India. Know more 
>>> about us by visiting http://datameet.org
>>> --- 
>>> You received this message because you are subscribed to the Google 
>>> Groups "datameet" group.
>>> To unsubscribe from this group and stop receiving emails from it, send 
>>> an email to datameet+u...@googlegroups.com.
>>>
>> To view this discussion on the web visit 
>>> https://groups.google.com/d/msgid/datameet/CAABnYsWm7xuY33vkAP0nu8qDRBibSwFx-pEGKCESe5Nuu9Bn6g%40mail.gmail.com
>>>  
>>> 
>>> .
>>>
>>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/4a13ca14-cc3a-4b2f-8f7e-771ef543f4e7n%40googlegroups.com.

Re: [datameet] ANN: Opening of 7,00,000+ Rural Points of Interests Data

[nisar...@gmail.com]

Rows which don't have lat-long will get updated as the work progresses in 
the concerned states. The lat-long which are out of extent will not be 
corrected and remain as-is because of errors in the app or simply low GPS 
accuracy. They'll be very few. Once the survey work is complete and 
finalized in all states; it will be mostly usable as-is from omms.nic.in. 
It's snowing right now so survey work is on a hold.

As the department released the data already in a machine readable format, 
doesn't require scraping etc and under Open Data License, please try to 
attribute the original source, link and license in your work and repo (4a/5 
of the GODL).

I have two concerns; primary is to ensure the data collection mechanism and 
assumptions are documented officially and available readily (not just for 
people subscribed to this google group) so that inferences made by people 
on the data are grounded and more useful. The second is to find a mechanism 
for people to cite the original source so that a case can be made in the 
future for releasing other such datasets within the government. 

On my side, it seems the best way to do this is to dedicate a static page 
with FAQs on ommas & further release this data on the data.gov.in. Though 
in true spirit, anyone can host it anywhere subject to Section 4 and 7 of 
GODL.


On Friday, 27 November 2020 at 20:01:35 UTC+5:30 prat...@gmail.com wrote:

> Images seem to have been lost. Attaching them.
> Distribution for states.  
>
> [image: pm1.PNG]I
> 22 rows which probably have sub-category mislabeled? 
> [image: pm2.PNG]
>
> On Friday, November 27, 2020 at 9:27:56 AM UTC-5 Pratap Vardhan wrote:
>
>> Thanks Nisar, that's useful to know. I'll update the repo with these 
>> pointers. 
>> What frequency for updates would you suggest (monthly or)? If you prefer, 
>> we can move the repo to datameet org or any other widely accessible one and 
>> collectively edit it.  
>> So, what I meant about coordinates data is, some rows are blank and some 
>> have coordinates but beyond India's extent bounds. I guess they will get 
>> fixed with updates too.
>> Here's the distribution for states.
>>
>> Separately, minor issue perhaps - there are 22 rows which probably have 
>> sub-category mislabeled.
>>  
>> Thanks for the details!
>> On Friday, November 27, 2020 at 12:47:59 AM UTC-5 nisar...@gmail.com 
>> wrote:
>>
>>> Really beautiful!  
>>>
>>> I'll answer some of the queries you raised on the tweet thread here for 
>>> everyone. 
>>>
>>> You've commented that the data in UK, HP & Nagaland appears erroneous. I 
>>> am assuming because the lat/long is missing. It is so because these states 
>>> are still doing the survey and haven't completed. They may complete it in 
>>> the next few months. Many of the other NE states are also in a similar 
>>> position. Goa and most UTs haven't been onboarded to the scheme yet. For 
>>> the same reason, I would point people towards to original dataset or put in 
>>> a system to update your GH repos regularly.
>>>
>>> Apart from that - I'll re-iterate that the data was collected by 
>>> government rural engineers at the block level. Intention, accuracy and even 
>>> understanding of definitions will vary across blocks/districts and 
>>> especially states. The data serves its primary purpose with these 
>>> assumptions but may lead to misleading statistics if treated as a census 
>>> for cross-geography comparisons. 
>>>
>>>
>>> On Friday, 27 November 2020 at 10:50:23 UTC+5:30 prat...@gmail.com 
>>> wrote:
>>>
 I've pulled states csvs to this repo 
 https://github.com/pratapvardhan/rural-facilities-pmgsy. Consolidated 
 India csv is at 
 https://www.kaggle.com/pratapvardhan/770k-geotagged-rural-facilities-in-india-pmgsy
 And, posted a thread of couple of visuals and minor data issues here 
 https://twitter.com/PratapVardhan/status/1332174593877020673
 Would love to hear if you use this data to create something.

 On Monday, November 23, 2020 at 2:05:47 AM UTC-5 Arun Ganesh wrote:

> Wonderful Harsh, its amazing to see such rural spatial datasets opened 
> by the government. The OpenStreetMap India community is looking into the 
> data to better get a sense of the quality to see how it could be 
> integrated 
> with the existing OSM basemap.
>
> As a sample have made an interactive map of just the Kerala data if 
> anyone wants to explore: 
> https://api.mapbox.com/styles/v1/planemad/ckhrbz1o6038o19piti441hd7.html?fresh=true&title=copy&access_token=pk.eyJ1IjoicGxhbmVtYWQiLCJhIjoiemdYSVVLRSJ9.g3lbg_eN0kztmsfIPxa9MQ#10.53/9.6726/76.524
>
> The dataset points are in yellow, the rest are from OSM. Some initial 
> evaluations in Kerala and Karnataka suggest that the data is pretty good 
> and spatially accurate within 100m.
>


-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You rec

Re: [datameet] ANN: Opening of 7,00,000+ Rural Points of Interests Data

[Pratap Vardhan]

I've added a note on top with source, license and last updated. Is there an 
recommended citation you'd like me to place? (also, feel free to submit a 
PR of what you think might keep the reading more informed.)
https://github.com/pratapvardhan/rural-facilities-pmgsy#rural-facilities-geo-tagged-dataset-pmgsy

On Friday, November 27, 2020 at 4:01:15 PM UTC-5 nisar...@gmail.com wrote:

> Rows which don't have lat-long will get updated as the work progresses in 
> the concerned states. The lat-long which are out of extent will not be 
> corrected and remain as-is because of errors in the app or simply low GPS 
> accuracy. They'll be very few. Once the survey work is complete and 
> finalized in all states; it will be mostly usable as-is from omms.nic.in. 
> It's snowing right now so survey work is on a hold.
>
> As the department released the data already in a machine readable format, 
> doesn't require scraping etc and under Open Data License, please try to 
> attribute the original source, link and license in your work and repo (4a/5 
> of the GODL).
>
> I have two concerns; primary is to ensure the data collection mechanism 
> and assumptions are documented officially and available readily (not just 
> for people subscribed to this google group) so that inferences made by 
> people on the data are grounded and more useful. The second is to find a 
> mechanism for people to cite the original source so that a case can be made 
> in the future for releasing other such datasets within the government. 
>
> On my side, it seems the best way to do this is to dedicate a static page 
> with FAQs on ommas & further release this data on the data.gov.in. Though 
> in true spirit, anyone can host it anywhere subject to Section 4 and 7 of 
> GODL.
>
>
> On Friday, 27 November 2020 at 20:01:35 UTC+5:30 prat...@gmail.com wrote:
>
>> Images seem to have been lost. Attaching them.
>> Distribution for states.  
>>
>> [image: pm1.PNG]I
>> 22 rows which probably have sub-category mislabeled? 
>> [image: pm2.PNG]
>>
>> On Friday, November 27, 2020 at 9:27:56 AM UTC-5 Pratap Vardhan wrote:
>>
>>> Thanks Nisar, that's useful to know. I'll update the repo with these 
>>> pointers. 
>>> What frequency for updates would you suggest (monthly or)? If you 
>>> prefer, we can move the repo to datameet org or any other widely accessible 
>>> one and collectively edit it.  
>>> So, what I meant about coordinates data is, some rows are blank and some 
>>> have coordinates but beyond India's extent bounds. I guess they will get 
>>> fixed with updates too.
>>> Here's the distribution for states.
>>>
>>> Separately, minor issue perhaps - there are 22 rows which probably have 
>>> sub-category mislabeled.
>>>  
>>> Thanks for the details!
>>> On Friday, November 27, 2020 at 12:47:59 AM UTC-5 nisar...@gmail.com 
>>> wrote:
>>>
 Really beautiful!  

 I'll answer some of the queries you raised on the tweet thread here for 
 everyone. 

 You've commented that the data in UK, HP & Nagaland appears erroneous. 
 I am assuming because the lat/long is missing. It is so because these 
 states are still doing the survey and haven't completed. They may complete 
 it in the next few months. Many of the other NE states are also in a 
 similar position. Goa and most UTs haven't been onboarded to the scheme 
 yet. For the same reason, I would point people towards to original dataset 
 or put in a system to update your GH repos regularly.

 Apart from that - I'll re-iterate that the data was collected by 
 government rural engineers at the block level. Intention, accuracy and 
 even 
 understanding of definitions will vary across blocks/districts and 
 especially states. The data serves its primary purpose with these 
 assumptions but may lead to misleading statistics if treated as a census 
 for cross-geography comparisons. 


 On Friday, 27 November 2020 at 10:50:23 UTC+5:30 prat...@gmail.com 
 wrote:

> I've pulled states csvs to this repo 
> https://github.com/pratapvardhan/rural-facilities-pmgsy. Consolidated 
> India csv is at 
> https://www.kaggle.com/pratapvardhan/770k-geotagged-rural-facilities-in-india-pmgsy
> And, posted a thread of couple of visuals and minor data issues here 
> https://twitter.com/PratapVardhan/status/1332174593877020673
> Would love to hear if you use this data to create something.
>
> On Monday, November 23, 2020 at 2:05:47 AM UTC-5 Arun Ganesh wrote:
>
>> Wonderful Harsh, its amazing to see such rural spatial datasets 
>> opened by the government. The OpenStreetMap India community is looking 
>> into 
>> the data to better get a sense of the quality to see how it could be 
>> integrated with the existing OSM basemap.
>>
>> As a sample have made an interactive map of just the Kerala data if 
>> anyone wants to explore: 
>> https://api.mapbox.com/styles/v1

Re: [datameet] ANN: Opening of 7,00,000+ Rural Points of Interests Data

[Arun Ganesh]

Btw, Bhanu and I have made some great progress matching the LGD codes in
the last hour. 100% of districts matched and it looks like the PMGSY
district names are definitely older (eg. Allahabad vs Prayagraj).

Down to 1539 unmatched blocks which can be finished with some help. Feel
free to request access to above sheet if you would like to help out.
Instructions on column I & H. You basically need to copy and paste the
matching lookup key from the lgd block sheet to the pmgsy sheet.

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CA%2BGKQr0mETr9WvEZUMDGfrh9JTg2VV4uvZpW20yYoMjDyLOdnA%40mail.gmail.com.

Re: [datameet] DOS release Remote Sensing Policy 2020 draft for public comment

[Sharad Lele]

Rajya Sabha TV just now called saying the programme got cancelled. Typical 
of them. 

On Friday, November 27, 2020 at 10:15:42 PM UTC+5:30 Sharad Lele wrote:

> Btw, I will be appearing on Rajya Sabha TV tomorrow at 1pm with MoES Secy 
> for a panel discussion on this new policy. So do send in more comments 
> tonight/tomorrow morning, AND listen in on that discussion. 
>
> On Friday, November 27, 2020 at 10:14:16 PM UTC+5:30 Sharad Lele wrote:
>
>> I agree with you, Ujaval. Getting 5.6m data in the public domain will be 
>> a big boost. 
>>
>> But I am curious to know from others what their experience has been with 
>> the quality of this 5.6m (IRS P6) data. For instance, I found the spectral 
>> quality to be rather poor: it boasts of being 10-bit but all the data are 
>> clustered in a 7-bit space. So we had to go back to coarser Landsat-8 
>> because it gave better spectral quality (not just more bands).
>>
>> On the rest of the policy: I am wondering why they say nothing about 
>> drones, about UAV-based LIDAR, and so on, which are really the cutting-edge 
>> these days, are they not?
>>
>> Sharad
>>
>> On Friday, November 27, 2020 at 8:13:01 PM UTC+5:30 
>> uja...@spatialthoughts.com wrote:
>>
>>> Hi Sharad,
>>>
>>> Thanks for sharing. From the perspective of sharing ISRO's own data, the 
>>> policy says 
>>>
>>> " In the interest of promoting research, innovation, societal 
>>> applications and value addition, DOS shall make IRS satellite data having 
>>> GSD of 5 meter and coarser, easily accessible on ‘free and open’ basis. "
>>>
>>> I think this is really good. As the best open remote sensing 
>>> multispectral data currently is Sentinel-2 (10m), ISRO sharing LISS4 (5.6m) 
>>> data puts them ahead of USGS and ESA. Of course, the concern would be the 
>>> implementation and how fast they can make that data available. My comment 
>>> here would that they adopt a true open data license for this data, like 
>>> Government Open Data License.
>>>
>>> [image: Logo]  
>>> Ujaval Gandhi
>>> Spatial Thoughts
>>> mobile: +91-8095684687 <+91%2080956%2084687>
>>> email: uja...@spatialthoughts.com
>>> [image: LinkedIn icon]   
>>> [image: 
>>> Twitter icon]   
>>>
>>>
>>>
>>> On Fri, Nov 27, 2020 at 7:33 PM Thejesh GN  wrote:
>>>
 Thank you for sharing. We should send out comments as community.
 Thej
 --
 Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
 http://thejeshgn.com
 GPG ID :  0xBFFC8DD3C06DD6B0


 On Fri, 27 Nov 2020 at 19:30, Sharad Lele (शरच्चंद्र लेले) <
 shara...@gmail.com> wrote:

> Please read and comment.
>
>
> https://www.isro.gov.in/sites/default/files/spacers_policy_ngp_2020_draft.pdf
>
> Sharad
>
> -- 
> Datameet is a community of Data Science enthusiasts in India. Know 
> more about us by visiting http://datameet.org
> --- 
> You received this message because you are subscribed to the Google 
> Groups "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send 
> an email to datameet+u...@googlegroups.com.
> To view this discussion on the web visit 
> https://groups.google.com/d/msgid/datameet/e9221cdf-1e29-9f26-cd5a-1b031ba51761%40gmail.com
> .
>
 -- 
 Datameet is a community of Data Science enthusiasts in India. Know more 
 about us by visiting http://datameet.org
 --- 
 You received this message because you are subscribed to the Google 
 Groups "datameet" group.
 To unsubscribe from this group and stop receiving emails from it, send 
 an email to datameet+u...@googlegroups.com.

>>> To view this discussion on the web visit 
 https://groups.google.com/d/msgid/datameet/CAABnYsWm7xuY33vkAP0nu8qDRBibSwFx-pEGKCESe5Nuu9Bn6g%40mail.gmail.com
  
 
 .

>>>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/5fc7108a-5250-4b8e-b992-69931243b981n%40googlegroups.com.

Re: [datameet] DOS release Remote Sensing Policy 2020 draft for public comment

[Sharad Lele]

I think Thejesh's idea of a joint response is excellent, and am happy to 
contribute.
My immediate observation is that 
a) the RS policy does not cover drones/UAVs, which according to me is the 
hot area, where a lot of application development is also required. The UAV 
related policy by DGCA is purely regulatory (what permissions are required 
etc), not developmental
b) the opening of 5.6m imagery is great. HOWEVER, there is lack of clarity 
of whether the govt will continue to support the IRS P6 (or equivalent) 
programmes well into the future. There is no clear commitment. There is 
talk about past images, and open sharing, but obviously if commercial 
players come in, their data will not be shared. So a bit more clarity on 
whether (like USA) the state agency will continue to do imaging till 5.6m 
resolution and leave the 5.6m to 1m field for commercial providers is 
required.
c) the shift from NRSC to a socalled PSU is noticeable and its implications 
unclear. What we do know as users is that NRSA is not particularly 
accountable to users in terms of quality of data, transparency in what they 
do (they will suddenly stop taking requests for imaging on particular 
dates, saying they are doing a full run for govt), technical transparency 
(quality), and promptness. And it is not clear in the policy how this 
accountability will be enforced vis-a-vis the PSU either.
d) The USA defines 'high-res' as 0.5m and below. That's why commercial 
providers stop at 0.6m. (please correct me if I am wrong--or if this is 
outdated). We should use the same threshold, not 1m. Because otherwise our 
data users are unnecessarily penalised, while 0.6m data on India are 
available to users located in the USA or elsewhere!
e) accountability of the high-res committee--they simply turn down requests 
without any reason. Who holds them accountable?
f) If commercial providers are to come in from India, how will they beat 
existing global suppliers of 1m data such as Ikonos and others who are well 
established? 

Some quick thoughts, to spark further debate in the group and help in the 
drafting of the joint comment.
Sharad

On Saturday, November 28, 2020 at 12:37:17 PM UTC+5:30 Sharad Lele wrote:

> Rajya Sabha TV just now called saying the programme got cancelled. Typical 
> of them. 
>
> On Friday, November 27, 2020 at 10:15:42 PM UTC+5:30 Sharad Lele wrote:
>
>> Btw, I will be appearing on Rajya Sabha TV tomorrow at 1pm with MoES Secy 
>> for a panel discussion on this new policy. So do send in more comments 
>> tonight/tomorrow morning, AND listen in on that discussion. 
>>
>> On Friday, November 27, 2020 at 10:14:16 PM UTC+5:30 Sharad Lele wrote:
>>
>>> I agree with you, Ujaval. Getting 5.6m data in the public domain will be 
>>> a big boost. 
>>>
>>> But I am curious to know from others what their experience has been with 
>>> the quality of this 5.6m (IRS P6) data. For instance, I found the spectral 
>>> quality to be rather poor: it boasts of being 10-bit but all the data are 
>>> clustered in a 7-bit space. So we had to go back to coarser Landsat-8 
>>> because it gave better spectral quality (not just more bands).
>>>
>>> On the rest of the policy: I am wondering why they say nothing about 
>>> drones, about UAV-based LIDAR, and so on, which are really the cutting-edge 
>>> these days, are they not?
>>>
>>> Sharad
>>>
>>> On Friday, November 27, 2020 at 8:13:01 PM UTC+5:30 
>>> uja...@spatialthoughts.com wrote:
>>>
 Hi Sharad,

 Thanks for sharing. From the perspective of sharing ISRO's own data, 
 the policy says 

 " In the interest of promoting research, innovation, societal 
 applications and value addition, DOS shall make IRS satellite data having 
 GSD of 5 meter and coarser, easily accessible on ‘free and open’ basis. "

 I think this is really good. As the best open remote sensing 
 multispectral data currently is Sentinel-2 (10m), ISRO sharing LISS4 
 (5.6m) 
 data puts them ahead of USGS and ESA. Of course, the concern would be the 
 implementation and how fast they can make that data available. My comment 
 here would that they adopt a true open data license for this data, like 
 Government Open Data License.

 [image: Logo]  
 Ujaval Gandhi
 Spatial Thoughts
 mobile: +91-8095684687 <+91%2080956%2084687>
 email: uja...@spatialthoughts.com
 [image: LinkedIn icon]   
 [image: 
 Twitter icon]   



 On Fri, Nov 27, 2020 at 7:33 PM Thejesh GN  wrote:

> Thank you for sharing. We should send out comments as community.
> Thej
> --
> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
> http://thejeshgn.com
> GPG ID :  0xBFFC8DD3C06DD6B0
>
>
> On Fri, 27 Nov 2020 at 19:30, Sharad Lele (शरच्चंद्र लेले) <
> shara...@gmail.com> wrote:
>
>> Please read and comment.