On Wed, May 13, 2015 at 9:58 PM, Andrea Aime <[email protected]>
wrote:
> An issue to be solved another day I guess (it will require some refactor
> of both the core code, the REST module,
> and the REST api workflow itself).
>
Hum... maybe it does not have to be that way, maybe we can handle this
today.
Bear with me for a minute.
When creating the import context, we normally indicate the data to be
importer, and that results
in the creation of tasks (all of this, rest wise, is a synchronous http
request),
and then we can attach transformations on the tasks being created.
But say we need the importer to fetch the data, and that might take a lot
of time... we cannot rely
on a synch request, and we would like that to happen as the import runs
asynchronously.
So, what about a new type of ImportData, tentatively named FetchData (feel
free to suggest a better name),
which has a location attribute, where we should get the data from, and a
transformation attribute, the transformations
we would like to apply on the data to be imported (which will be either
raster or vector, but not both)
and that we assume are going to be uniform (not the 100% case, but pretty
common).
No tasks are created during the creation, when run happens, the importer
checks for FetchData,
if available, it will fetch it, create a File or Directory import data,
create the tasks, attach
the transformations, and then have everything run as normal.
This basically moves the expensive move operation down the line, in a place
that can be run
in async mode, and eventually retried. This would make it suitable for ftp
transfer, http fetching, and the like.
Does this work for you?
Cheers
Andrea
--
==
Meet us at the INSPIRE Conference in Lisbon 25-29 May 2015! Visit
http://goo.gl/WHKDXT for more information.
==
Ing. Andrea Aime
@geowolf
Technical Lead
GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549
http://www.geo-solutions.it
http://twitter.com/geosolutions_it
*AVVERTENZE AI SENSI DEL D.Lgs. 196/2003*
Le informazioni contenute in questo messaggio di posta elettronica e/o
nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il
loro utilizzo è consentito esclusivamente al destinatario del messaggio,
per le finalità indicate nel messaggio stesso. Qualora riceviate questo
messaggio senza esserne il destinatario, Vi preghiamo cortesemente di
darcene notizia via e-mail e di procedere alla distruzione del messaggio
stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso,
divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od
utilizzarlo per finalità diverse, costituisce comportamento contrario ai
principi dettati dal D.Lgs. 196/2003.
The information in this message and/or attachments, is intended solely for
the attention and use of the named addressee(s) and may be confidential or
proprietary in nature or covered by the provisions of privacy act
(Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection
Code).Any use not in accord with its purpose, any disclosure, reproduction,
copying, distribution, or either dissemination, either whole or partial, is
strictly forbidden except previous formal approval of the named
addressee(s). If you are not the intended recipient, please contact
immediately the sender by telephone, fax or e-mail and delete the
information in this message that has been received in error. The sender
does not give any warranty or accept liability as the content, accuracy or
completeness of sent messages and accepts no responsibility for changes
made after they were sent or for other risks which arise as a result of
e-mail transmission, viruses, etc.
-------------------------------------------------------
------------------------------------------------------------------------------
One dashboard for servers and applications across Physical-Virtual-Cloud
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
_______________________________________________
Geoserver-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/geoserver-devel
