Re: Batch Checkpoints with DUCC?
Hi Erik, There is a brief discussion of this in the duccbook in section 9.3 ... https://uima.apache.org/d/uima-ducc-2.2.2/duccbook.html#x1-1880009.3 In particular, the 3rd option, "Flushing cached data". This assumes that the batch of work to be flushed is represented by each workitem CAS. Regards, Eddie On Tue, May 15, 2018 at 9:21 AM, Erik Fäßlerwrote: > And another question concerning DUCC :-) > > With my CPEs I use a lot the batchProcessingComplete() and > collectionProcessingComplete() methods. I need them because I do a lot of > database interactions where I need to send data in batches due to the > overhead of network communication. > How is that handled in DUCC? The documentation does not talk about it, at > least it not find anything. > > Hints are appreciated. > > Thanks! > > Erik
Re: Deploy Async Service without XML
We have developed a framework to deal with UIMA AS programmatically. No dealing with XML ever. Feel free to check it out: http://department-of-veterans-affairs.github.io/Leo/ Olga -Original Message- From:on behalf of Jaroslaw Cwiklik Reply-To: "user@uima.apache.org" Date: Tuesday, May 15, 2018 at 2:58 AM To: "user@uima.apache.org" Subject: Re: Deploy Async Service without XML You can generate UIMA-AS deployment descriptor programmatically. You still need AE descriptor though. Please check UIMA-AS documentation: https://uima.apache.org/d/uima-as-2.10.3/uima_async_scaleout.html#ugr.ref.async.api.usage section 4.10 Generating Deployment Descriptor Programmatically Jerry On Mon, May 14, 2018 at 9:47 PM, Osborne, John D wrote: > Is it possible to deploy an UIMA-AS service without an XML descriptor > similar to how UIMA-FIT works? I currently deploy services using > deployAsyncService.sh > > I have multiple long running services that need to work in different > (production, testing, dev) environments and would prefer to avoid having an > XML file for each service. I realize that with some refactoring (like > removing environment specific parameters) this number of XML files could be > reduced, but I've become spoiled with UIMA-FIT. :) > > I'm looking at the toXML() function so I can potentially generate the > aggregate analysis engine with UIMA-FIT. > > -John > >
Batch Checkpoints with DUCC?
And another question concerning DUCC :-) With my CPEs I use a lot the batchProcessingComplete() and collectionProcessingComplete() methods. I need them because I do a lot of database interactions where I need to send data in batches due to the overhead of network communication. How is that handled in DUCC? The documentation does not talk about it, at least it not find anything. Hints are appreciated. Thanks! Erik
Re: Deploy Async Service without XML
You can generate UIMA-AS deployment descriptor programmatically. You still need AE descriptor though. Please check UIMA-AS documentation: https://uima.apache.org/d/uima-as-2.10.3/uima_async_scaleout.html#ugr.ref.async.api.usage section 4.10 Generating Deployment Descriptor Programmatically Jerry On Mon, May 14, 2018 at 9:47 PM, Osborne, John Dwrote: > Is it possible to deploy an UIMA-AS service without an XML descriptor > similar to how UIMA-FIT works? I currently deploy services using > deployAsyncService.sh > > I have multiple long running services that need to work in different > (production, testing, dev) environments and would prefer to avoid having an > XML file for each service. I realize that with some refactoring (like > removing environment specific parameters) this number of XML files could be > reduced, but I've become spoiled with UIMA-FIT. :) > > I'm looking at the toXML() function so I can potentially generate the > aggregate analysis engine with UIMA-FIT. > > -John > >