Re: problem in calling DUCC Service with ducc_submit
DUCC is just managing UIMA-AS jobs and services. It is up to the descriptor for the job to specify what annotators and services to use. The simplest way to use a service in a job is to reference it via a JMS service descriptor. The flow of execution in the job and the data it processes is up to you DUCC is only responsible for running the job (providing as many resources as available and necessary to complete the work rapidly) and also for starting and stopping any required services. On Thu, Jul 31, 2014 at 8:45 AM, reshu.agarwal wrote: > > Dear Burn, > > Thanks for the information. But problem is as Eddie Said before, we can > not use the DUCC Service using ducc_submit, we can just check availability > of service by using service_dependency in job. > > There is only a way that I have to create a Analysis Engine which is using > ducc service using UIMA AS client. > > If there is another way to use DUCC Service in Job so I can use DUCC > Service as my AE or DD, then please tell me. > > > > On 07/31/2014 06:05 PM, Burn Lewis wrote: > >> You can register a DUCC service with --autostart set to true and the >> service will start when it is registered and stay running. If your job >> has >> a dependency on that service DUCC will verify that it is running before >> starting your job. >> If instead you register the service without autostart then DUCC will start >> the service (if it is not already running) before starting your job. When >> the last job that references that service ends DUCC will stop the service >> after an idle delay defined by the service's --linger value. If you make >> linger very large the service can be made to stay running, even if it is >> idle, for many hours between jobs. >> >> ~Burn >> >> >> On Thu, Jul 31, 2014 at 2:41 AM, reshu.agarwal >> wrote: >> >> Hi, >>> >>> Today, I got understand the reason of why DUCC Job is not using DUCC >>> Service. But All I want that my initialization Part of a Process_DD >>> should >>> occur once. I don't need to wait every time for initialization. So, I >>> want >>> to use DUCC Service in my DUCC JOB. >>> >>> Is there any way to configure in DUCC that Process_DD initialized once >>> and >>> Job will start again and again? >>> >>> On 04/01/2014 05:21 PM, Eddie Epstein wrote: >>> >>> Declaring a service dependency does not affect application code paths. The job still needs to connect to the service in the normal way. DUCC uses services dependency for several reasons: to automatically start services when needed by a job; to not give resources to a job or service for which a dependent service is not running; and to post a warning on running jobs when a dependent service goes "bad". Eddie On Tue, Apr 1, 2014 at 1:27 AM, reshu.agarwal >>> > wrote: Hi, > I am again in a problem. I have successfully deployed DUCC UIMA AS > Service > using ducc_service. The service status is available with good health. > If > I > try to use my this service using parameter service_dependency to my Job > in > ducc_submit then it is not showing any error but executes only the DB > Collection Reader not this service. > > -- > Thanks, > Reshu Agarwal > > > > -- >>> Thanks, >>> Reshu Agarwal >>> >>> >>> > > -- > Thanks, > Reshu Agarwal > >
Re: problem in calling DUCC Service with ducc_submit
Dear Burn, Thanks for the information. But problem is as Eddie Said before, we can not use the DUCC Service using ducc_submit, we can just check availability of service by using service_dependency in job. There is only a way that I have to create a Analysis Engine which is using ducc service using UIMA AS client. If there is another way to use DUCC Service in Job so I can use DUCC Service as my AE or DD, then please tell me. On 07/31/2014 06:05 PM, Burn Lewis wrote: You can register a DUCC service with --autostart set to true and the service will start when it is registered and stay running. If your job has a dependency on that service DUCC will verify that it is running before starting your job. If instead you register the service without autostart then DUCC will start the service (if it is not already running) before starting your job. When the last job that references that service ends DUCC will stop the service after an idle delay defined by the service's --linger value. If you make linger very large the service can be made to stay running, even if it is idle, for many hours between jobs. ~Burn On Thu, Jul 31, 2014 at 2:41 AM, reshu.agarwal wrote: Hi, Today, I got understand the reason of why DUCC Job is not using DUCC Service. But All I want that my initialization Part of a Process_DD should occur once. I don't need to wait every time for initialization. So, I want to use DUCC Service in my DUCC JOB. Is there any way to configure in DUCC that Process_DD initialized once and Job will start again and again? On 04/01/2014 05:21 PM, Eddie Epstein wrote: Declaring a service dependency does not affect application code paths. The job still needs to connect to the service in the normal way. DUCC uses services dependency for several reasons: to automatically start services when needed by a job; to not give resources to a job or service for which a dependent service is not running; and to post a warning on running jobs when a dependent service goes "bad". Eddie On Tue, Apr 1, 2014 at 1:27 AM, reshu.agarwal wrote: Hi, I am again in a problem. I have successfully deployed DUCC UIMA AS Service using ducc_service. The service status is available with good health. If I try to use my this service using parameter service_dependency to my Job in ducc_submit then it is not showing any error but executes only the DB Collection Reader not this service. -- Thanks, Reshu Agarwal -- Thanks, Reshu Agarwal -- Thanks, Reshu Agarwal
Re: problem in calling DUCC Service with ducc_submit
You can register a DUCC service with --autostart set to true and the service will start when it is registered and stay running. If your job has a dependency on that service DUCC will verify that it is running before starting your job. If instead you register the service without autostart then DUCC will start the service (if it is not already running) before starting your job. When the last job that references that service ends DUCC will stop the service after an idle delay defined by the service's --linger value. If you make linger very large the service can be made to stay running, even if it is idle, for many hours between jobs. ~Burn On Thu, Jul 31, 2014 at 2:41 AM, reshu.agarwal wrote: > > Hi, > > Today, I got understand the reason of why DUCC Job is not using DUCC > Service. But All I want that my initialization Part of a Process_DD should > occur once. I don't need to wait every time for initialization. So, I want > to use DUCC Service in my DUCC JOB. > > Is there any way to configure in DUCC that Process_DD initialized once and > Job will start again and again? > > On 04/01/2014 05:21 PM, Eddie Epstein wrote: > >> Declaring a service dependency does not affect application code paths. The >> job still needs to connect to the service in the normal way. >> >> DUCC uses services dependency for several reasons: to automatically start >> services when needed by a job; to not give resources to a job or service >> for which a dependent service is not running; and to post a warning on >> running jobs when a dependent service goes "bad". >> >> Eddie >> >> >> On Tue, Apr 1, 2014 at 1:27 AM, reshu.agarwal >> wrote: >> >> Hi, >>> >>> I am again in a problem. I have successfully deployed DUCC UIMA AS >>> Service >>> using ducc_service. The service status is available with good health. If >>> I >>> try to use my this service using parameter service_dependency to my Job >>> in >>> ducc_submit then it is not showing any error but executes only the DB >>> Collection Reader not this service. >>> >>> -- >>> Thanks, >>> Reshu Agarwal >>> >>> >>> > > -- > Thanks, > Reshu Agarwal > >
Re: problem in calling DUCC Service with ducc_submit
Hi, Today, I got understand the reason of why DUCC Job is not using DUCC Service. But All I want that my initialization Part of a Process_DD should occur once. I don't need to wait every time for initialization. So, I want to use DUCC Service in my DUCC JOB. Is there any way to configure in DUCC that Process_DD initialized once and Job will start again and again? On 04/01/2014 05:21 PM, Eddie Epstein wrote: Declaring a service dependency does not affect application code paths. The job still needs to connect to the service in the normal way. DUCC uses services dependency for several reasons: to automatically start services when needed by a job; to not give resources to a job or service for which a dependent service is not running; and to post a warning on running jobs when a dependent service goes "bad". Eddie On Tue, Apr 1, 2014 at 1:27 AM, reshu.agarwal wrote: Hi, I am again in a problem. I have successfully deployed DUCC UIMA AS Service using ducc_service. The service status is available with good health. If I try to use my this service using parameter service_dependency to my Job in ducc_submit then it is not showing any error but executes only the DB Collection Reader not this service. -- Thanks, Reshu Agarwal -- Thanks, Reshu Agarwal
Re: problem in calling DUCC Service with ducc_submit
The service_dependency argument merely tells DUCC that your job uses that
service so that DUCC can ensure that the service is up and running before
starting your job. It does NOT make your job use that service.
You can try this using the 1.job example as follows.
First define the location of your DUCC and your application broker, e.g.
export DUCC_HOME=/home/ducc/ducc_runtime
export BrokerURL=tcp://broker1:61616
Then register a service similar to 1.job:
${DUCC_HOME/bin/ducc_services --register \
--process_DD
${DUCC_HOME}/examples/simple/resources/service/Deploy_RandomSleepAE.xml \
--classpath ${DUCC_HOME}/lib/uima-ducc/examples/* \
--process_jvm_args -DdefaultBrokerURL=${BrokerURL} \
--environment "AE_INIT_TIME=5 AE_INIT_RANGE=5 INIT_ERROR=0"
Then submit a job that connects to this service using a JMS service
descriptor, with the service as a
dependency so that DUCC will start it:
${DUCC_HOME}/bin/ducc_submit --specification
${DUCC_HOME}/examples/simple/1.job \
--process_descriptor_AE
${DUCC_HOME}/examples/simple/resources/service/UimaAsRemote.xml \
--service_dependency UIMA-AS:FixedSleepAE:${BrokerURL} \
--process_jvm_args "-Xmx100M -DdefaultBrokerURL=${BrokerURL}"
Note that these descriptors use a system properties placeholder for the
broker URL which is copied from the environment.
~Burn
On Mon, Apr 7, 2014 at 8:25 AM, reshu.agarwal wrote:
> On 04/04/2014 05:39 PM, Eddie Epstein wrote:
>
>> Given an aggregate AE, a UIMA-AS service is accessed by defining a
>> delegate
>> as a JMS service descriptor.
>> See
>> http://uima.apache.org/d/uima-as-2.4.2/uima_async_scaleout.
>> html#ugr.async.ov.concepts.jms_descriptor
>> and the example from the uima-as SDK in
>> apache-uima-as-2.4.2/examples/descriptors/as
>>
>> So the AE in a DUCC job would have such a delegate.
>>
>> Eddie
>>
>>
>> On Thu, Apr 3, 2014 at 1:00 AM, reshu.agarwal
>> wrote:
>>
>> On 04/01/2014 05:21 PM, Eddie Epstein wrote:
>>>
>>> The
job still needs to connect to the service in the normal way.
DUCC uses services dependency for several reasons: to automatically
start
services when needed by a job; to not give resources to a job or service
for which a dependent service is not running; and to post a warning on
running jobs when a dependent service goes "bad".
Hi Eddie,
>>>
>>> I have tried many times but my job could not be connected to DUCC
>>> Service.
>>> So, Can you please define a sample job with all parameters which you use
>>> to
>>> connect to service.
>>>
>>> --
>>> Thanks,
>>> Reshu Agarwal
>>>
>>>
>>> Dear Eddie,
>
> It is not helping me. As I deployed and use UIMA AS service without any
> problem. But I am facing problem in DUCC. So, I want a sample of DUCC Job
> which is using the DUCC Service. If you can provide me that it will be very
> helpful.
>
> --
> Thanks,
> Reshu Agarwal
>
>
Re: problem in calling DUCC Service with ducc_submit
On 04/04/2014 05:39 PM, Eddie Epstein wrote: Given an aggregate AE, a UIMA-AS service is accessed by defining a delegate as a JMS service descriptor. See http://uima.apache.org/d/uima-as-2.4.2/uima_async_scaleout.html#ugr.async.ov.concepts.jms_descriptor and the example from the uima-as SDK in apache-uima-as-2.4.2/examples/descriptors/as So the AE in a DUCC job would have such a delegate. Eddie On Thu, Apr 3, 2014 at 1:00 AM, reshu.agarwal wrote: On 04/01/2014 05:21 PM, Eddie Epstein wrote: The job still needs to connect to the service in the normal way. DUCC uses services dependency for several reasons: to automatically start services when needed by a job; to not give resources to a job or service for which a dependent service is not running; and to post a warning on running jobs when a dependent service goes "bad". Hi Eddie, I have tried many times but my job could not be connected to DUCC Service. So, Can you please define a sample job with all parameters which you use to connect to service. -- Thanks, Reshu Agarwal Dear Eddie, It is not helping me. As I deployed and use UIMA AS service without any problem. But I am facing problem in DUCC. So, I want a sample of DUCC Job which is using the DUCC Service. If you can provide me that it will be very helpful. -- Thanks, Reshu Agarwal
Re: problem in calling DUCC Service with ducc_submit
Given an aggregate AE, a UIMA-AS service is accessed by defining a delegate as a JMS service descriptor. See http://uima.apache.org/d/uima-as-2.4.2/uima_async_scaleout.html#ugr.async.ov.concepts.jms_descriptor and the example from the uima-as SDK in apache-uima-as-2.4.2/examples/descriptors/as So the AE in a DUCC job would have such a delegate. Eddie On Thu, Apr 3, 2014 at 1:00 AM, reshu.agarwal wrote: > On 04/01/2014 05:21 PM, Eddie Epstein wrote: > >> The >> job still needs to connect to the service in the normal way. >> >> DUCC uses services dependency for several reasons: to automatically start >> services when needed by a job; to not give resources to a job or service >> for which a dependent service is not running; and to post a warning on >> running jobs when a dependent service goes "bad". >> > Hi Eddie, > > I have tried many times but my job could not be connected to DUCC Service. > So, Can you please define a sample job with all parameters which you use to > connect to service. > > -- > Thanks, > Reshu Agarwal > >
Re: problem in calling DUCC Service with ducc_submit
On 04/01/2014 05:21 PM, Eddie Epstein wrote: The job still needs to connect to the service in the normal way. DUCC uses services dependency for several reasons: to automatically start services when needed by a job; to not give resources to a job or service for which a dependent service is not running; and to post a warning on running jobs when a dependent service goes "bad". Hi Eddie, I have tried many times but my job could not be connected to DUCC Service. So, Can you please define a sample job with all parameters which you use to connect to service. -- Thanks, Reshu Agarwal
Re: problem in calling DUCC Service with ducc_submit
Declaring a service dependency does not affect application code paths. The job still needs to connect to the service in the normal way. DUCC uses services dependency for several reasons: to automatically start services when needed by a job; to not give resources to a job or service for which a dependent service is not running; and to post a warning on running jobs when a dependent service goes "bad". Eddie On Tue, Apr 1, 2014 at 1:27 AM, reshu.agarwal wrote: > > Hi, > > I am again in a problem. I have successfully deployed DUCC UIMA AS Service > using ducc_service. The service status is available with good health. If I > try to use my this service using parameter service_dependency to my Job in > ducc_submit then it is not showing any error but executes only the DB > Collection Reader not this service. > > -- > Thanks, > Reshu Agarwal > >
problem in calling DUCC Service with ducc_submit
Hi, I am again in a problem. I have successfully deployed DUCC UIMA AS Service using ducc_service. The service status is available with good health. If I try to use my this service using parameter service_dependency to my Job in ducc_submit then it is not showing any error but executes only the DB Collection Reader not this service. -- Thanks, Reshu Agarwal
