Hi Chen, Thanks for this helpful information!
Best, Erin ________________________________________ From: Lin, Chen <[email protected]> Sent: Tuesday, May 9, 2017 3:47 PM To: [email protected] Subject: Re: Temporal module tests Hi Erin, The warning is saying that Time-class feature of a temporal expression is not found. The time-class (e.g. ³date², ³time², ³duration², ³quantifier², ³prepostexp², and ³set²) of a temporal expression is a standard feature we can get from gold standard thyme annotation (https://urldefense.proofpoint.com/v2/url?u=http-3A__clear.colorado.edu_compsem_documents_older_THYME-2520Guidelines.pdf&d=DwIFAw&c=yHlS04HhBraes5BQ9ueu5zKhE7rtNXt_d012z2PA6ws&r=Dgs2SzWIrHv8-_z6aTQMb9T-HW5-XqFcYRtqzvjdZSU&m=nKPJKbhYOj4CyfDi9eKU50Tu6lt2Oj5w32cb4dw5M2U&s=pv6c5XjaZ9beRnfE6z0UcQgn2mIfmHA8o8ldahCt21Q&e= ). For the test pipeline, the timex annotator probably missed the time-class type for a temporal expression, so this feature is null. Good thing is that without this feature, our model can still make reasonable prediction, as you can successfully get contains prediction. Without temporal attributes, a performance drop (-0.012 F-score) is expected, as our system paper (Lin C, et al. J Am Med Inform Assoc 2015;0:19. doi:10.1093/jamia/ocv113) shows (Table 4). Best, Chen On 5/9/17, 4:21 PM, "Erin Gustafson" <[email protected]> wrote: >Hi all, > > >I am interested in using the temporal extraction pipeline, and am running >the included tests to get a sense for how the module works. When running >testPipeline within EventTimeRelationAnnotatorTest, a number of null >value warnings get logged to the console: > > >Null value found in Feature(<Time-Class->, <NULL>)?). > > >Despite the warning, it seems to successfully identify the time-event >relation CONTAINS(2004, diagnosed) from the text I'm feeding it (Example >2 from Lin et al 2016: In 2004 the patient was diagnosed with ascending >colon cancer). > > >Does anyone have insight into this warning? > > >Thanks, > >Erin >
