| abian created this task. abian added projects: Wikidata, WMDE-Analytics-Engineering. Restricted Application added a subscriber: Aklapper. |
The temporal falsifiability is a quantitative value between 0 and 1 that reflects the usefulness of the contemporary constraint on a certain entity set, although it's an indicator of data quality by itself. It's defined as 1-(c/(n^2)), where c is the number of potentially contemporary pairs of entities (including reflexive pairs) in a set of n entities. Wikidata data shouldn't reduce their temporal falsifiability, something that would mean its average data quality is declining. The temporal falsifiability can raise when any of these good things happen:
- More data are added to existing entities.
- We improve the precision of dates.
- We create entities that are more complete and accurate than average.
- Temporal biases are reduced (i.e., we get more data about the past and not so many about the present).
The value of temporal falsifiability of people in Wikidata, which should ideally be >0.35, and will never be able to reach 0.55, can be estimated by following these steps:
- Choose an n. For a very accurate estimation, this number can be the total number of instances of Q5; however, if using that n is too expensive, a lower n can be chosen.
- Initialize c := 0.
- Repeat n times:
- Pick two instances of Q5 randomly (see T194884), e1 and e2.
- If the date of birth (P569) of e1 can be lower than or equal to the date of death (P570) of e2 and the date of birth (P569) of e1 can be lower than or equal to the date of death (P570) of e1, then add 1 to c (c := c + 1); otherwise, do nothing. Here "can be" means that, in case there are several values, or values with low precision, it's enough to have a single possible combination that meets the rule. The rule is also met in case we don't have enough data; for instance, when checking if "the date of birth (P569) of e1 can be lower than or equal to the date of death (P570) of e2", this half of the rule is directly met if we don't have any date of death defined for e2.
- Calculate (n-1)*(n-c)/(n^2) to get the value of temporal falsifiability.
Please monitor on Grafana the value of temporal falsifiability of Q5 instances.
Cc: Aklapper, abian, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, D3r1ck01, Wikidata-bugs, aude, Mbch331
_______________________________________________ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
