It seems that the main issue is that different teams, if experiencing the same game, would give different scores for the same category depending on how they interpret the question, and some teams might be harsh or lenient scorers for all of the teams they play. Individual differences between teams is always going to be an issue, no matter how well you explain the criteria for judging spirit.
A method that may or may not be viable would be to consider the scores given by a single team in relation to the scores given by all the teams. My minor statistical knowledge thinks that this would be done by standardising the scores given by a team, and then comparing how far away this standard score is from the 'tournament average'. First we could calculate the mean of all the scores given by teams for a particular category. By then taking the mean of scores given by a single team in that category, we can work out a z-score (mean of score given – mean of all scores given) / Standard Deviation of all scores given. This will give a standardised score of how far away the scores a team gives are from the mean scores given by all teams, and should provide a statistic of how lenient or harshly teams have interpreted the category. This 'leniency rating' of all teams could then be used to create some form of weighting for scores given, for example anyone outside of 1 Std. Deviation of the mean will have the scores they've given for that category weighted accordingly. 'Harsh' raters will have their scores weighted higher, so a team rated highly by a harsh team will get a score even higher to accommodate the lower score from the 'harsh' team. Likewise, lenient teams will have scores weighted lower, and teams a lenient team have rated low will be scored even lower to account for the team's leniency. This wouldn't be expected to be done by hand, but a spreadsheet with the formulas in it should make it light work. Anybody with stats knowledge is welcome to point out the flaws and shoot down the idea. Andy. __________________________________________________ BritDisc mailing list [email protected] http://www.fysh.org/cgi-bin/mailman/listinfo/britdisc Staying informed - http://www.ukultimate.com/staying-informed
