Re: remoteAnalysisEngine services not scaling to effect

2011-09-30 Thread Burn Lewis
> I observed from the logs that cases are divided among the the 2 running > instances of cas consumers , but some of the cases seem to be missed out, which > didn't go to any of the 2 instances. I can't understand why so ? This is strange. UIMA-AS doesn't treat CasConsumers any differently, since

Re: remoteAnalysisEngine services not scaling to effect

2011-09-28 Thread Arun Tewatia
Thanks Greg Holmberg and Burn Lewis for the reply You have understood right, what i am trying to do. > What you're doing is taking each step in your analysis engine and running it > on > one or more machines. And yes this will create the 2 problems that you mentioned. Network overhead & lum

Re: remoteAnalysisEngine services not scaling to effect

2011-09-27 Thread Burn Lewis
Arun, If you have multiple instances of your CasConsumer then access to your database must be synchronized. I suggest you add logging to each instance to verify that all the CASes are being processed by your CasConsumers. You should also be able to see the CASes flow in and out of the services

Re: remoteAnalysisEngine services not scaling to effect

2011-09-27 Thread Thilo Götz
On 26/09/11 22:31, Greg Holmberg wrote: > Arun-- > > > I don't know what the cause of your specific technical issue is, but in my > opinion, there's a better way to slice the problem. > > What you're doing is taking each step in your analysis engine and running it > on > one or more machines.

Re: remoteAnalysisEngine services not scaling to effect

2011-09-26 Thread Greg Holmberg
Arun-- I don't know what the cause of your specific technical issue is, but in my opinion, there's a better way to slice the problem. What you're doing is taking each step in your analysis engine and running it on one or more machines. The creates two problems. One, it's a lot of networ

Re: remoteAnalysisEngine services not scaling to effect

2011-09-26 Thread Arun Tewatia
Thanks for replying I am trying to break my big pipeline of AE's having over 15 AE's for Cluster Environment I was initially testing with 2 of the beginning AE's of my pipeline. And when i checked the QueueSize using jconsole, I found that it was zero, next I checked the same with my whole

Re: remoteAnalysisEngine services not scaling to effect

2011-09-23 Thread Burn Lewis
You didn't say how big the casPool is in your aggregate ... I think it should be >= 15 to keep all your remote services busy. ~Burn

Re: remoteAnalysisEngine services not scaling to effect

2011-09-23 Thread Jaroslaw Cwiklik
Are you doing any real analysis in your AEs? If the analysis is fast, replicating AEs makes no sense. You can see that by observing queue depths in jConsole. Attach it to a broker and check the queue size while you are processing. You may need to enable broker JMX support in activemq.xml first:

remoteAnalysisEngine services not scaling to effect

2011-09-23 Thread Arun Tewatia
Hi all, I am using UIMA-AS for some time now. I have been trying to divide my UIMA pipeline and scale it out on a cluster environment. Here's my setup : UIMA-AS 2.3.1 Machine 1 : Broker , 1 instance of aggregate X on Queue-X (containing entries for 2 remoteAnalysisEngines and 1 remote CasCo