Thanks Peter, The architecture for our project (https://github.com/nlpie/nlp-adapt-kube, uima-as branch under current development), relies heavily on uima-as to work in conjunction with ActiveMQ and a home spun multiplexer/collection processing client to do all the heavy lifting for the nlp-engines we're using. Currently, CLAMP, and BioMedICUS both support UIMA-AS out-of-the-box (I'm looking into MetaMap, as I type this).
To the best of my knowledge, the MQ and broker work together (at least in ActiveMQ). Given the volume of documents we need to process and the constraint of being tied to UIMA, UIMA-AS is the easiest option for implementing at scale, for both speed and fault tolerance. If anyone has done any work trying to integrate UIMA-AS into cTAKES we would be very interested in this. Retrofitting a different solution into our architecture at this time is not feasible. Thanks very much! Best! Greg- On Thu, Jan 17, 2019 at 10:08 PM Peter Abramowitsch <[email protected]> wrote: > I used a completely different approach that allows parallel but not async > processing. Multiple [analysis engine+cas] pair objects pre-instantiated > into into a threadsafe pool running behind a web service interface. We can > fully saturate a single ctakes server process using multiple client > processes talking to that API each working synchronously and arriving at an > overall speed of 10-15 6K notes per second on a single server process. > > I haven't used AS but it looks as if that middleware could have too many > moving parts for our needs. They would generate many wakeups and context > switches adding undesired latency as a request makes its way to the > server. I'm assuming that in AS, the broker and the MQ are separate > processes and not just in-process subsystems to the ctakes server process. > Is that right? > > On Thu, Jan 17, 2019 at 4:09 PM Greg Silverman <[email protected]> wrote: > > > Anyone out there developed a pipeline using UIMA-AS, as opposed to the > > CPE/CPM file reader? > > > > Thanks in advance! > > > > Greg-- > > > > -- > > Greg M. Silverman > > Senior Systems Developer > > NLP/IE <https://healthinformatics.umn.edu/research/nlpie-group> > > Cardiovascular Informatics <http://www.med.umn.edu/cardiology/> > > University of Minnesota > > [email protected] > > > > › evaluate-it.org ‹ > > > -- Greg M. Silverman Senior Systems Developer NLP/IE <https://healthinformatics.umn.edu/research/nlpie-group> Cardiovascular Informatics <http://www.med.umn.edu/cardiology/> University of Minnesota [email protected] › evaluate-it.org ‹
