Hi Jan, A few years ago, the Grants (now Community Engagement) dept. at WMF put together a set of metrics <https://meta.wikimedia.org/wiki/Grants:Learning_patterns/Calculating_global_metrics> designed to measure the impact of different kinds of grant-funded and/or "programmatic" events and activities within the movement. Many of these metrics were built into the Wikimetrics tool <https://meta.wikimedia.org/wiki/Grants:Evaluation/Wikimetrics>, developed by the Analytics team to help individuals and groups measure and report the impact of their activities themselves.
The metrics we developed aren't perfect, but they were based on research and intended to be accessible and provide coverage for a wide variety of activities related to the Wikimedia movement. So they represent a framework in that respect. To learn more about them, you might ask members of the Learning & Evaluation team <https://wikimediafoundation.org/wiki/Staff_and_contractors#Learning_.26_Evaluation> . - J On Sat, Feb 4, 2017 at 7:34 AM, Jan Dittrich <[email protected]> wrote: > Hello Analytics, > > It seems to easily happen that a well meant metrics is proposed, but that > this is actually not sure to be correlated with something value or (at > least with my skills) super hard to measure technically [1]. > > So I wanted to create some easy-to-graspmaterials, maybe to put them on a > poster or in a video… whatever. > > Sadly I found a lot of warnings about "vanity metrics" online > (recommending $ made instead) but no framework, research or case studies on > organizational impact and understanding of metrics and how colleagues can > be helped to be empowered to do a basic evaluation of metrics. > > > *So you have any framework, research or case studies that could help us to > teach and empower to evaluate** metrics and their use?* > > > Here is what I found useful so far: > > - https://en.wikipedia.org/wiki/DIKW_pyramid and similar frameworks like > https://randomblatherdotcom.files.wordpress.com/2014/04/ > bmust7rcuaa6ueo-jpg-large.jpeg > > - For the need of organizational sensemaking: Weick, Sensemaking in > Organizations > > - And, not directly related but providing some inspiration: Robust methods > and visualizations by Tuckey, decision making under uncertainty by > Gingerenzer. > Jan > > > [1] In which case I prefer no metric at all, and investing into > qualitative research instead, till the problem space is better understood, > but if metrics are already there it often stays… > -- > Jan Dittrich > UX Design/ User Research > > Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin > Phone: +49 (0)30 219 158 26-0 > http://wikimedia.de > > Imagine a world, in which every single human being can freely share in the > sum of all knowledge. That‘s our commitment. > > Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e. V. > Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter > der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für > Körperschaften I Berlin, Steuernummer 27/029/42207. > > _______________________________________________ > Analytics mailing list > [email protected] > https://lists.wikimedia.org/mailman/listinfo/analytics > > -- Jonathan T. Morgan Senior Design Researcher Wikimedia Foundation User:Jmorgan (WMF) <https://meta.wikimedia.org/wiki/User:Jmorgan_(WMF)>
_______________________________________________ Analytics mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/analytics
