Re: [Wiki-research-l] Preexsiting Researchers on Metrics for Users?

2014-02-06 Thread Federico Leva (Nemo)
Sort of related, an ongoing education@ discussion "student evaluation 
criteria". http://thread.gmane.org/gmane.org.wikimedia.education/854


Nemo

___
Wiki-research-l mailing list
Wiki-research-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l


[Wiki-research-l] Preexsiting Researchers on Metrics for Users?

2014-02-06 Thread Klein,Max
Hello All,


Can you point me to research, or have ideas about metrics of user performance? 
I know edit count, and total bytes have their limitations. Right now I am 
counting the occurrences of "thank" "appreciate" and "barnstar"  for a User in 
User talk namespace (and recursive subpages). What else is there?



Let me explain more about my current project

I am trying to develop some new techniques to measure user and article 
performance. I am repurposing the bi-partite economics trade model of 
countries-products, but instead using editors-articles. This means that I 
arrive at a new metric for users, and articles. Now I am calibrating some of 
the variables in this model, by comparing my results to exogenous variable. On 
pages, I use the metric that this listed pointed me to last time, like the 
actionable metrics from Group lens, and cleanup tags from Stein. (Thank list!). 
When I rank articles in a category using my economics method, versus the 
article-text methods I acheive .7 spearman correlation. Using my 
count-thanks-on-user-talk method for users in the user domain I acheive .50 
spearman ranking correlation, which is still quite good, but I want to make 
sure there aren't better baselines to which to compare.



Thanks,

Maximilian Klein
Wikipedian in Residence, OCLC
+17074787023
___
Wiki-research-l mailing list
Wiki-research-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l