Re: [gdal-dev] Making use of SPOT imagery mask files

2021-07-29 Thread Matt.Wilkie
Aha! A small bit of progress: $ gdaltransform -rpc DS_SPOT6_201308032015087_LM1_FR1_FR1_FR1_W137N65_10315\PROD_SPOT6_001\VOL_SPOT6_001_A\IMG_SPOT6_MS_001_A\DIM_SPOT6_MS_201308032015087_SEN_1.XML Enter column line values separated by space, and press Return. 0.0 57083.0 -137.766376889524 63.1

Re: [gdal-dev] How to deal with security related bug reports?

2021-07-29 Thread David Strip
On 7/29/2021 3:29 PM, Even Rouault wrote: Fair point. I've added a commit with the following text "However please refrain from publicly posting exploits with harmful consequences (data destruction, etc.). Only people with the github handles f

Re: [gdal-dev] How to deal with security related bug reports?

2021-07-29 Thread Even Rouault
I've read the security.md file and maybe I'm running a little slow today, but I still don't understand how I would go about reporting a serious security bug and what will happen afterwards. Let's say I find a really serious vulnerability, something that might let me erase your file system, or

Re: [gdal-dev] How to deal with security related bug reports?

2021-07-29 Thread David Strip
On 7/29/2021 11:20 AM, Even Rouault wrote: I've created https://github.com/OSGeo/gdal/pull/4152 with a SECURITY.md that largely uses Kurt's proposal. Even I've read the security.md file and maybe I'm running a little slow t

Re: [gdal-dev] Large GeoJSONs and aborting file opening

2021-07-29 Thread Simon Eves
We could, but it does import if you're willing to leave it long enough. I guess we could throw an "are you sure?" if the file is large. However, being able to kill it without bringing down the whole server is still desirable! On Thu, Jul 29, 2021 at 11:09 AM Andrew Bell wrote: > Not exactly what

Re: [gdal-dev] [EXTERNAL] Re: Large GeoJSONs and aborting file opening

2021-07-29 Thread Newcomb, Doug via gdal-dev
I just converted them to geopackage layers and went from there. Doug From: gdal-dev on behalf of Mike Flannigan Sent: Thursday, July 29, 2021 1:28 PM To: Simon Eves Cc: gdal-dev@lists.osgeo.org Subject: [EXTERNAL] Re: [gdal-dev] Large GeoJSONs and aborting fi

Re: [gdal-dev] Large GeoJSONs and aborting file opening

2021-07-29 Thread Andrew Bell
Not exactly what you asked, but can you simply avoid opening the file at all if it's too large rather than start the process and then abort? On Wed, Jul 28, 2021 at 7:10 PM Simon Eves wrote: > Agreed. Unfortunately, we're looking for a quick solution to a customer > complaint. I'll ponder it som

Re: [gdal-dev] Large GeoJSONs and aborting file opening

2021-07-29 Thread Mike Flannigan
Yeah, there must be a way of breaking this up in Postgis or some other method.  Maybe by county or city region, if that meets your workflow needs.  I would break it up outside of QGIS, and then import the various geoj's into QGIS. I'm thinking these methods don't work on a geoj: https://www.redd

Re: [gdal-dev] How to deal with security related bug reports?

2021-07-29 Thread Even Rouault
I've created https://github.com/OSGeo/gdal/pull/4152 with a SECURITY.md that largely uses Kurt's proposal. Even Le 28/07/2021 à 19:37, Even Rouault a écrit : PSC, We just got https://github.com/OSGeo/gdal/issues/4146 from someone trying to get in touch with a security issue. How do we want t

Re: [gdal-dev] How to deal with security related bug reports?

2021-07-29 Thread Greg Troxel
From the semi-outside, and packaging perspective, I can completely understand not having a full-blown private security process. It's certainly a lot of work. Some upstream packages have private reporting paths, and develop and test patches in secret, even including packagers. I have several tim

Re: [gdal-dev] Large GeoJSONs and aborting file opening

2021-07-29 Thread Mike Flannigan
Thank you. These building outlines don't produce fields that are extremely wide (lots of characters on a single line).  But I tend to store my geoj's with each point on a single line, to prevent excessively wide lines. It makes a BIG difference for QGIS with the geoj's I work with. You might try

Re: [gdal-dev] Large GeoJSONs and aborting file opening

2021-07-29 Thread Simon Eves
The problematic one in this case is about 30GB, with ~5.9M features, of property parcels in Florida, each with polygons with 5-10 vertices and 57 (!) other columns. Below is the first feature as printed by ogrinfo. It appears to have originated as a Shapefile, which we have also converted to regula

Re: [gdal-dev] [EXTERNAL] Re: Large GeoJSONs and aborting file opening

2021-07-29 Thread Newcomb, Doug via gdal-dev
https://github.com/microsoft/USBuildingFootprints [https://opengraph.githubassets.com/225fd5de0d4b915c82edf14205ec82909692b31f97fa3453012808d51a8fd323/microsoft/USBuildingFootprints] GitHub - microsoft/USBuildingFootprints: Computer generated build

Re: [gdal-dev] Large GeoJSONs and aborting file opening

2021-07-29 Thread Mike Flannigan
I would like to hear more about large GeoJSON files. How large are they? My GeoJSON files contain linear features only.  My largest one is 50.2 MB with 1,230,000 newlines in it. Next biggest one is 12 MB with 280,000 newlines.  These and about 140 other geojsons are open in the same project and