Thanks for sending this out Daisy.
There are a few things I'd like to add from my observations with users.
2 users were pretty concerned that it was so easy it would lead to vandalism
at worst and edit wars at best.
The one user that interacted with the CTA unprompted had the least helpful
contribution, literally describing the contents of the lead image. "It's the
Golden Gate Bridge and the bay" which causes me some concern.
In general even the users who understood the point of the descriptions failed
to write descriptions that would hold up to the standards of the Wikidata
community.
If we intend on moving forward with this I think we should consider the
following:
- figure out a way to do a smaller rollout first
- tag edits done through this method
- consider allowing IP users only to contribute new descriptions (not edit
existing ones)
- show a brief "guided tour" with examples of good descriptions for first time
contributors
Thank you for the quick work on the prototype Dan, and thank you for
organizing the last minute testing Daisy.
From: Daisy Chen <dc...@wikimedia.org>
Date: Thu, Mar 26, 2015 at 9:13 AM
Subject: [WikimediaMobile] [Apps] Description editing prototype testing
To: mobile-l@lists.wikimedia.org
Cc: Abbey Ripstra <arips...@wikimedia.org>
Hi all,
Please find the goals for and top-level findings from guerrilla testing
description editing on Wikipedia Alpha below. More in-depth information
including tasks/questions posed and raw notes on the 5 participants can be
found here. There may be typos and small formatting errors (I'll be proofing
the page in the next hour).
Happy quarterly planning--
Daisy
---
Goal
The goal of this research was to observe people interact with the CTA ("Tap to
add a description!") line in the header under article titles in Wikipedia
Alpha. After tapping the CTA, users experience 3 editable scenarios: 1. an
meaningful description suggestion, 2. a blank form field, and 3. a
random/irrelevant description suggestion.
Do users notice the CTA prompt? How effective are they in triggering action?
How do users feel about the CTA?
How effective are descriptions that are auto-generated and meaningful? Do they
assist users with finalizing the description or confuse users as to why they
are prompted to edit a description that is already automated and correct?
How effective is not giving a user a pre-populated description field?
How effective are descriptions that are auto-generated and random?
How do users feel about the process of editing description lines overall?
Findings: Patterns Observed
3 of 5 users required some level of facilitator prompting to notice the CTA.
Interactivity breakdown:2 users would most likely overlook this field, 2 users
might notice/interact depending on the situation, and 1 user was not sure.
All users either specifically indicated field interaction was easy and
intuitive or had no specific complaint or struggle that was observed. Only 1
user was briefly confused about the blank SF description field, thinking he
couldn't type because he didn't see a blinking cursor.
3 scenarios feedback breakdownMeaningful description suggestionmost helpful: 2
users
most helpful, but pointless because I can't see it on page: 1 user
confusing: 1 user
Blankfine if you know about topic: 1 user
fine and having the CTA here made most sense: 1 user
most engaging: 1 user
easiest: 1 user
Random/irrelevant description suggestionif visible, could prompt action: 2 users
2 of 5 users expressed some level of confusion around why the CTA hides the
description. One user was confused about why he was prompted to action when the
description was correct on Picasso. Another user was confused about the same
thing, and also mentioned that he would be much more likely to take action on
the random article if he could see that the description was incorrect. The
latter also mentioned that the CTA really only makes sense on the SF blank
description page.
1 user was confused about whether these descriptions were for himself or for
all of Wikipedia.
No users indicated confusion about the CTA pop-up language.
_______________________________________________
Mobile-l mailing list
Mobile-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/mobile-l_______________________________________________
Mobile-l mailing list
Mobile-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/mobile-l
