Re: [postgis-users] Geoprocessing & BigData

2016-01-28 Thread David Haynes
. > > > Lars > > > ____________ > Fra: postgis-users [postgis-users-boun...@lists.osgeo.org] på vegne av > Ravi Pavuluri [ravith...@ymail.com] > Sendt: 27. januar 2016 21:31 > Til: PostGIS Users Discussion > Emne: Re: [postgis-users] Geoprocessing &

Re: [postgis-users] Geoprocessing & BigData

2016-01-27 Thread Lars Aksel Opsahl
ssion Emne: Re: [postgis-users] Geoprocessing & BigData Hi David, I are dealing with census blocks/census block groups spanning a few million records. Thanks, Ravi. On Monday, January 25, 2016 10:18 AM, David Haynes <hayne...@gmail.com> wrote: We have done some work, implement

Re: [postgis-users] Geoprocessing & BigData

2016-01-27 Thread Ravi Pavuluri
Hi David, I are dealing with census blocks/census block groups spanning a few million records. Thanks,Ravi. On Monday, January 25, 2016 10:18 AM, David Haynes wrote: We have done some work, implementing parallel spatial queries using a spatial declustering

Re: [postgis-users] Geoprocessing & BigData

2016-01-25 Thread David Haynes
We have done some work, implementing parallel spatial queries using a spatial declustering algorithm. How large are your datasets? On Mon, Jan 18, 2016 at 1:51 PM, Rémi Cura wrote: > Hey, > if you have one beefy server you can parallelize throwing several queries > working

Re: [postgis-users] Geoprocessing & BigData

2016-01-20 Thread Ravi Pavuluri
Felix,Thanks for the tip and  I am kind of doing the same way. An intersect or union would help me test and compare my result with other GIS software. Also, thanks for the mapbutcher link on union. I will look into it. Steve, Thanks for the tiles approach, I am going to to give it a try.

Re: [postgis-users] Geoprocessing & BigData

2016-01-19 Thread Felix Kunde
Uhr Von: "Ravi Pavuluri" <ravith...@ymail.com> An: vincent...@oslandia.com, "PostGIS Users Discussion" <postgis-users@lists.osgeo.org>, "Rémi Cura" <remi.c...@gmail.com> Betreff: Re: [postgis-users] Geoprocessing & BigData Vincent and Remi,

Re: [postgis-users] Geoprocessing & BigData

2016-01-19 Thread Stephen Woodbridge
*Von:* "Ravi Pavuluri" <ravith...@ymail.com> *An:* vincent...@oslandia.com, "PostGIS Users Discussion" <postgis-users@lists.osgeo.org>, "Rémi Cura" <remi.c...@gmail.com> *Betreff:* Re: [postgis-users] Geoprocessing & BigData Vincent and Remi,

Re: [postgis-users] Geoprocessing & BigData

2016-01-19 Thread Pierre Racine
> @Vincent : For ArcGIS Union, please see here. > http://resources.esri.com/help/9.3/arcgisengine/java/gp_toolref/analysis_ > tools/union_analysis_.htm ArcGIS Union resume to removing overlaps from the union of two tables. Look at the ST_DifferenceAgg() example in the PostGIS Addons:

[postgis-users] Geoprocessing & BigData

2016-01-18 Thread Ravi Pavuluri
Hi All, I am checking if there is a way to process quickly large datasets such as census blocks in PostGIS and also by leveraging big data platform. I have few questions in this regard. 1) When I try intersect for sample census blocks with another polygon layer, PostGIS 2.2(on Postgres 9.4)

Re: [postgis-users] Geoprocessing & BigData

2016-01-18 Thread Vincent Picavet (ml)
Hi Ravi, On 18/01/2016 19:14, Ravi Pavuluri wrote: > Hi All, > > I am checking if there is a way to process quickly large datasets such > as census blocks in PostGIS and also by leveraging big data platform. I > have few questions in this regard. > > 1) When I try intersect for sample census

Re: [postgis-users] Geoprocessing & BigData

2016-01-18 Thread Rémi Cura
Hey, if you have one beefy server you can parallelize throwing several queries working on sub set of your data. (aka parallel processing trough data partition). One conceptual example : you want to process the world, you create 20 workers, a list of countries, and then make the worker process the

Re: [postgis-users] Geoprocessing & BigData

2016-01-18 Thread Ravi Pavuluri
ere. http://resources.esri.com/help/9.3/arcgisengine/java/gp_toolref/analysis_tools/union_analysis_.htm Any inputs are appreciated. Thanks again, Ravi. On Mon, 1/18/16, Rémi Cura <remi.c...@gmail.com> wrote: Subject: Re: [postgis-users] Geoproc