Re: Performance of CPE/CPM vs AS

2011-08-16 Thread Eddie Epstein
> I get it now. When I put the CR into the aggregate AE and ran > 'runRemoteAsyncAE.sh' without the '-c' flag, it was within a few seconds of > being as fast as the CPE. That's good :) The few seconds are because the CPE/CPM runs the CR in a separate thread than the AE, but the simple UIMA AS deplo

Re: Performance of CPE/CPM vs AS

2011-08-16 Thread Charles Bearden
On 08/16/2011 01:45 PM, Eddie Epstein wrote: Thanks again for your reply. I thought that I was deploying the pipeline in one AS process with the first option for running it: runRemoteAsyncAE.sh tcp://localhost:61616 CollectionReader \ -c sbmi-ctsa/desc/asynchronous_scaleout/SentencesFromDBRead

Performance of CPE/CPM vs AS

2011-08-16 Thread Eddie Epstein
Accidentally replied off list ... -- Forwarded message -- From: Eddie Epstein Date: Tue, Aug 16, 2011 at 2:45 PM Subject: Re: Performance of CPE/CPM vs AS To: Charles Bearden > Thanks again for your reply. I thought that I was deploying the pipeline in > one AS proces

Re: Performance of CPE/CPM vs AS

2011-08-16 Thread Charles Bearden
Hi Marshall, Thanks for your reply. I should have included details of our machine. It has four CPUs each with 8 cores; here's the /proc/cpuinfo stanza for one of the cores: The machine has 64G RAM; I was running dstat at the same time as the AS pipeline, and it

Re: Performance of CPE/CPM vs AS

2011-08-16 Thread Charles Bearden
On 08/16/2011 11:15 AM, Eddie Epstein wrote: The CPE runs everything in the same process. UIMA AS could deploy this pipeline in one process and get the same performance as the CPE. Thanks again for your reply. I thought that I was deploying the pipeline in one AS process with the first option

Re: Performance of CPE/CPM vs AS

2011-08-16 Thread Marshall Schor
When looking at performance, it's important to get more details around the possibilities. For instance, is the machine your running on a multi-core machine (meaning it can run multiple threads at the same time, for increased performance), and if so, how many cores? The Intel i7 I think supports 8

Re: Performance of CPE/CPM vs AS

2011-08-16 Thread Eddie Epstein
The CPE runs everything in the same process. UIMA AS could deploy this pipeline in one process and get the same performance as the CPE. Scaling out to multiple processes incurs overhead, which for UIMA AS essentially consists of CAS serialization and communication. Figure 5 on http://uima.apache.o

Performance of CPE/CPM vs AS

2011-08-16 Thread Charles Bearden
Thank you Jerry & Eddie for your responses to my previous questions. I appreciate the opportunity to learn. Based on a little testing, I'm starting to think that AS is not designed for performance-enhancing scale-out, but maybe rather for architectural clarity. I have a CPE that has a collecti