Re: Batch Checkpoints with DUCC?

2018-05-15 Thread Eddie Epstein
Hi Erik,

There is a brief discussion of this in the duccbook in section 9.3 ...
https://uima.apache.org/d/uima-ducc-2.2.2/duccbook.html#x1-1880009.3

In particular, the 3rd option, "Flushing cached data". This assumes that
the batch of work to be flushed is represented by each workitem CAS.

Regards,
Eddie

On Tue, May 15, 2018 at 9:21 AM, Erik Fäßler 
wrote:

> And another question concerning DUCC :-)
>
> With my CPEs I use a lot the batchProcessingComplete() and
> collectionProcessingComplete() methods. I need them because I do a lot of
> database interactions where I need to send data in batches due to the
> overhead of network communication.
> How is that handled in DUCC? The documentation does not talk about it, at
> least it not find anything.
>
> Hints are appreciated.
>
> Thanks!
>
> Erik


Re: Deploy Async Service without XML

2018-05-15 Thread Olga Patterson
We have developed a framework to deal with UIMA AS programmatically. No dealing 
with XML ever. 

Feel free to check it out:
http://department-of-veterans-affairs.github.io/Leo/

Olga


-Original Message-
From:  on behalf of Jaroslaw Cwiklik 
Reply-To: "user@uima.apache.org" 
Date: Tuesday, May 15, 2018 at 2:58 AM
To: "user@uima.apache.org" 
Subject: Re: Deploy Async Service without XML

You can generate UIMA-AS deployment descriptor programmatically. You still
need AE descriptor though.

Please check UIMA-AS documentation:

https://uima.apache.org/d/uima-as-2.10.3/uima_async_scaleout.html#ugr.ref.async.api.usage
section 4.10 Generating Deployment Descriptor Programmatically

Jerry

On Mon, May 14, 2018 at 9:47 PM, Osborne, John D  wrote:

> Is it possible to deploy an UIMA-AS service without an XML descriptor
> similar to how UIMA-FIT works? I currently deploy services using
> deployAsyncService.sh
>
> I have multiple long running services that need to work in different
> (production, testing, dev) environments and would prefer to avoid having 
an
> XML file for each service. I realize that with some refactoring (like
> removing environment specific parameters) this number of XML files could 
be
> reduced, but I've become spoiled with UIMA-FIT. :)
>
> I'm looking at the toXML()  function so I can potentially generate the
> aggregate analysis engine with UIMA-FIT.
>
> -John
>
>




Batch Checkpoints with DUCC?

2018-05-15 Thread Erik Fäßler
And another question concerning DUCC :-)

With my CPEs I use a lot the batchProcessingComplete() and 
collectionProcessingComplete() methods. I need them because I do a lot of 
database interactions where I need to send data in batches due to the overhead 
of network communication.
How is that handled in DUCC? The documentation does not talk about it, at least 
it not find anything.

Hints are appreciated.

Thanks!

Erik

Re: Deploy Async Service without XML

2018-05-15 Thread Jaroslaw Cwiklik
You can generate UIMA-AS deployment descriptor programmatically. You still
need AE descriptor though.

Please check UIMA-AS documentation:
https://uima.apache.org/d/uima-as-2.10.3/uima_async_scaleout.html#ugr.ref.async.api.usage
section 4.10 Generating Deployment Descriptor Programmatically

Jerry

On Mon, May 14, 2018 at 9:47 PM, Osborne, John D  wrote:

> Is it possible to deploy an UIMA-AS service without an XML descriptor
> similar to how UIMA-FIT works? I currently deploy services using
> deployAsyncService.sh
>
> I have multiple long running services that need to work in different
> (production, testing, dev) environments and would prefer to avoid having an
> XML file for each service. I realize that with some refactoring (like
> removing environment specific parameters) this number of XML files could be
> reduced, but I've become spoiled with UIMA-FIT. :)
>
> I'm looking at the toXML()  function so I can potentially generate the
> aggregate analysis engine with UIMA-FIT.
>
> -John
>
>