[
https://issues.apache.org/jira/browse/UIMA-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13795018#comment-13795018
]
Peter Klügl commented on UIMA-3347:
-----------------------------------
Not all evaluators are affected, but I wonder how this problem was able to
remain hidden for so long.
As a provisional hotifx, I added a preference for including all types
(deactivated by default). If activated, you need to specify the included and
excluded types manually.
> Ruta: Missing False Positives in "Annotation Test" view
> -------------------------------------------------------
>
> Key: UIMA-3347
> URL: https://issues.apache.org/jira/browse/UIMA-3347
> Project: UIMA
> Issue Type: Bug
> Components: ruta
> Affects Versions: 2.1.0ruta
> Reporter: Martin Toepfer
> Assignee: Peter Klügl
>
> I recognized that there are no False Positive annotations in the evaluation
> when the type has no annotation in the gold cas, even when I specified a
> white list of types for evaluation.
> For instance,
> Gold standard Document:
> <PER>Peter</PER> develops software.
> Corresponding document under test:
> Peter develops <ORG>software</ORG>.
> produces a False Negative for the person annotation, but no False Positive
> annotation for the organization annotation.
> Possible Solution:
> Allow to specify a pattern that filters all types of the typesystem that
> should be used for evaluation (including creation of false positive
> annotations).
--
This message was sent by Atlassian JIRA
(v6.1#6144)
