Hi Devon,
Big +1 for this module.
The module for S3 will be useful right now. Generally, I'd note that
there's a logical extension to move this module to use the Hadoop
FileSystem abstraction. With that kind of move, you'd be able to pick
up support for whatever someone implements support for (1). Once this
happens, the module would support additional cloud vendors like Azure.
Also, code like (2) would become more general and less brittle. That
code is forcing the system to use s3:// urls rather than s3a or s3n.
(There are implementation differences between the protocols.)
Lastly, another +1 on the caching layer. As an extension, I'd love to
see the caching layer separated from the remote/distributed file system
so that the two can be configured separately.
Cheers,
Jim
1. https://en.wikipedia.org/wiki/Apache_Hadoop#Other_file_systems
https://wiki.apache.org/hadoop/HCFS
2.
https://github.com/dvntucker/geotools/blob/s3-geotiff-module/modules/unsupported/s3-geotiff/src/main/java/org/geotools/s3/geotiff/S3GeoTiffFormat.java#L105-L120
On 05/23/2017 12:56 PM, Devon Tucker wrote:
Hi all,
I mentioned this in a previous email either here or on gs-devel, but
we have a simple-ish module we'd like to make into
community/unsupported modules for GeoTools and GeoServer. They enable
GeoTiffs to be served via Amazon S3 directly.
The modules are fairly simple. In GeoTools there is a
GridFormatFactory interface that's largely derivative of the GeoTiff
module, as well as an ImageInputStream implementation that does most
of the heavy lifting. This is also tied into EhCache caching in order
to improve performance.
In GeoServer there is a very trivial store UI screen. This exists only
to get around some of the limitations currently in GeoServer when it
comes to URL validation in the default grid store screens.
I have branches created for each of these in my fork:
https://github.com/dvntucker/geotools/tree/s3-geotiff-module/modules/unsupported/s3-geotiff
https://github.com/dvntucker/geoserver/tree/s3-geotiff-gs/src/community/s3-geotiff
Take a look if you like and let me know what you think.
Cheers,
Devon
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
GeoTools-Devel mailing list
GeoTools-Devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geotools-devel
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
GeoTools-Devel mailing list
GeoTools-Devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geotools-devel
