Martin Toepfer created UIMA-3347:
------------------------------------

             Summary: Ruta: Missing False Positives in "Annotation Test" view
                 Key: UIMA-3347
                 URL: https://issues.apache.org/jira/browse/UIMA-3347
             Project: UIMA
          Issue Type: Bug
          Components: ruta
    Affects Versions: 2.1.0ruta
            Reporter: Martin Toepfer


I recognized that there are no False Positive annotations in the evaluation 
when the type has no annotation in the gold cas, even when I specified a white 
list of types for evaluation.

For instance,

Gold standard Document:
<PER>Peter</PER> develops software.

Corresponding document under test:
Peter develops <ORG>software</ORG>.

produces a False Negative for the person annotation, but no False Positive 
annotation for the organization annotation.


Possible Solution:
Allow to specify a pattern that filters all types of the typesystem that should 
be used for evaluation (including creation of false positive annotations).



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Reply via email to