Re: [WikimediaMobile] [Apps] How good is our search? Here's some data!
Thanks. This is not directly related, but some time I'd love to see data about interlanguage links tapping on all media - iOS, Android, MobileFrontend. -- Amir Elisha Aharoni · אָמִיר אֱלִישָׁע אַהֲרוֹנִי http://aharoni.wordpress.com “We're living in pieces, I want to live in peace.” – T. Moore 2014-12-04 4:15 GMT+02:00 Dan Garry : > We've now got some preliminary data in about how effective our search is > in mobile apps. Note that this is only half a day's data, and it's sampled > at 1%. > > High-level metrics: > >- *Number of searching sessions which end by tapping on a result:* 91% >- *Percentage of queries that give 0 results: *19% >- *Mean queries per searching session:* 3.8 >- *Median user-perceived time taken to retrieve search results: *486ms >- *90th percentile of user-perceived time taken:* 898ms > > My quick take-homes from this: > >- 91% clickthrough seems pretty good. >- 19% of queries giving "no results" seems really bad. >- The combination of the above two means users are generally finding >what they need, but that it's a struggle to do it. >- User-perceived performance seems pretty good; 90% of our users get >search results within a second! > > What I think our next steps are: > >- Push out our new search improvements and see how these baselines >change. >- Try to tackle the "0 results" problem, which seems to be more of a >problem than clickthrough. > > Spreadsheet containing my queries and processed data: > https://docs.google.com/a/wikimedia.org/spreadsheets/d/1syLgNygAS7Prxxg7RTIvK3vxwyVG-ZkjxtK0LSbU76w/edit > > Dan > > -- > Dan Garry > Associate Product Manager, Mobile Apps > Wikimedia Foundation > > ___ > Mobile-l mailing list > Mobile-l@lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/mobile-l > > ___ Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
Re: [WikimediaMobile] [Apps] How good is our search? Here's some data!
Nemo, Prefix search doesn't offer suggestions. So, 0 then. Bernd On Wed, Dec 3, 2014 at 11:28 PM, Federico Leva (Nemo) wrote: > Dan Garry, 04/12/2014 03:15: > >> # *Percentage of queries that give 0 results: *19% >> > > How many of these offered a "did you mean" alternative? > Can typos on mobile increase the error rate? > > Nemo > > P.s.: Someone add this number next to the low-hanging fruit hypothesis > claims. ;-) > > > ___ > Mobile-l mailing list > Mobile-l@lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/mobile-l > ___ Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
Re: [WikimediaMobile] [Apps] How good is our search? Here's some data!
Dan Garry, 04/12/2014 03:15: # *Percentage of queries that give 0 results: *19% How many of these offered a "did you mean" alternative? Can typos on mobile increase the error rate? Nemo P.s.: Someone add this number next to the low-hanging fruit hypothesis claims. ;-) ___ Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
Re: [WikimediaMobile] [Apps] How good is our search? Here's some data!
Since presently all app searches are prefix, I'm not too surprised by 19% - I seem to misspell at least that percentage typing on phone screens, and most misspellings result in zero prefix results. But yes, really excited about supplementing small/null prefix results sets with full text results as suggested by Jared. We'll see that 19% really drop. > On Dec 3, 2014, at 6:27 PM, Tomasz Finc wrote: > >> On Wed, Dec 3, 2014 at 6:15 PM, Dan Garry wrote: >> 19% of queries giving "no results" seems really bad. > > Fixing this needs to be our priority across all projects. It doesn't > matter what we fix later down the pipeline if this number is as high > as it is. Let's get this as a daily/hourly number so that we can see > live stats and then discuss changes/improvements. > > Great work getting these > --tomasz > > ___ > Mobile-l mailing list > Mobile-l@lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/mobile-l ___ Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
Re: [WikimediaMobile] [Apps] How good is our search? Here's some data!
On Wed, Dec 3, 2014 at 6:15 PM, Dan Garry wrote: > 19% of queries giving "no results" seems really bad. Fixing this needs to be our priority across all projects. It doesn't matter what we fix later down the pipeline if this number is as high as it is. Let's get this as a daily/hourly number so that we can see live stats and then discuss changes/improvements. Great work getting these --tomasz ___ Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
[WikimediaMobile] [Apps] How good is our search? Here's some data!
We've now got some preliminary data in about how effective our search is in mobile apps. Note that this is only half a day's data, and it's sampled at 1%. High-level metrics: - *Number of searching sessions which end by tapping on a result:* 91% - *Percentage of queries that give 0 results: *19% - *Mean queries per searching session:* 3.8 - *Median user-perceived time taken to retrieve search results: *486ms - *90th percentile of user-perceived time taken:* 898ms My quick take-homes from this: - 91% clickthrough seems pretty good. - 19% of queries giving "no results" seems really bad. - The combination of the above two means users are generally finding what they need, but that it's a struggle to do it. - User-perceived performance seems pretty good; 90% of our users get search results within a second! What I think our next steps are: - Push out our new search improvements and see how these baselines change. - Try to tackle the "0 results" problem, which seems to be more of a problem than clickthrough. Spreadsheet containing my queries and processed data: https://docs.google.com/a/wikimedia.org/spreadsheets/d/1syLgNygAS7Prxxg7RTIvK3vxwyVG-ZkjxtK0LSbU76w/edit Dan -- Dan Garry Associate Product Manager, Mobile Apps Wikimedia Foundation ___ Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
Re: [WikimediaMobile] WG response table
Every user's response will be a separate row for attribution/curation. On Wed, Dec 3, 2014 at 6:00 PM, Jon Robson wrote: > instead of using a boolean I would suggest using an integer. That way you > could require validation by 3 users if that proved to lead to more accurate > results. > > I think the table should be as flexible as and where possible. > On Dec 3, 2014 5:15 PM, "Ryan Kaldari" wrote: > >> Since we are still supporting WikiGrok version A for the time being, we >> will need to have a 'correct' column that is boolean. Although we will >> never push claims that have correct set to 'false', we may use such entries >> to evaluate whether 'true' entries should be pushed or not. For example, if >> there are 2 entries that say 'occupation:author:true', but 5 that say >> 'occupation:author:false', we will not want to push 'occupation:author' to >> Wikidata. >> >> Kaldari >> >> On Wed, Dec 3, 2014 at 4:55 PM, Max Semenik >> wrote: >> >>> https://gerrit.wikimedia.org/r/#/c/177448/ - please let me know if you >>> see something misssing:) >>> >>> -- >>> Best regards, >>> Max Semenik ([[User:MaxSem]]) >>> >>> ___ >>> Mobile-l mailing list >>> Mobile-l@lists.wikimedia.org >>> https://lists.wikimedia.org/mailman/listinfo/mobile-l >>> >>> >> >> ___ >> Mobile-l mailing list >> Mobile-l@lists.wikimedia.org >> https://lists.wikimedia.org/mailman/listinfo/mobile-l >> >> -- Best regards, Max Semenik ([[User:MaxSem]]) ___ Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
Re: [WikimediaMobile] WG response table
instead of using a boolean I would suggest using an integer. That way you could require validation by 3 users if that proved to lead to more accurate results. I think the table should be as flexible as and where possible. On Dec 3, 2014 5:15 PM, "Ryan Kaldari" wrote: > Since we are still supporting WikiGrok version A for the time being, we > will need to have a 'correct' column that is boolean. Although we will > never push claims that have correct set to 'false', we may use such entries > to evaluate whether 'true' entries should be pushed or not. For example, if > there are 2 entries that say 'occupation:author:true', but 5 that say > 'occupation:author:false', we will not want to push 'occupation:author' to > Wikidata. > > Kaldari > > On Wed, Dec 3, 2014 at 4:55 PM, Max Semenik wrote: > >> https://gerrit.wikimedia.org/r/#/c/177448/ - please let me know if you >> see something misssing:) >> >> -- >> Best regards, >> Max Semenik ([[User:MaxSem]]) >> >> ___ >> Mobile-l mailing list >> Mobile-l@lists.wikimedia.org >> https://lists.wikimedia.org/mailman/listinfo/mobile-l >> >> > > ___ > Mobile-l mailing list > Mobile-l@lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/mobile-l > > ___ Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
Re: [WikimediaMobile] WG response table
After a discussion, the office cabal decided to add an explicit column for claim removal. Done in PS4. On Wed, Dec 3, 2014 at 5:18 PM, Ryan Kaldari wrote: > Yes, but part of that is deciding whether or not to push stuff. We can > double-check with Maryana, but that's what I would recommend. > > On Wed, Dec 3, 2014 at 5:16 PM, Max Semenik wrote: > >> Didn't we decide that this table is only for actually pushing stuff? >> >> On Wed, Dec 3, 2014 at 5:15 PM, Ryan Kaldari >> wrote: >> >>> Since we are still supporting WikiGrok version A for the time being, we >>> will need to have a 'correct' column that is boolean. Although we will >>> never push claims that have correct set to 'false', we may use such entries >>> to evaluate whether 'true' entries should be pushed or not. For example, if >>> there are 2 entries that say 'occupation:author:true', but 5 that say >>> 'occupation:author:false', we will not want to push 'occupation:author' to >>> Wikidata. >>> >>> Kaldari >>> >>> On Wed, Dec 3, 2014 at 4:55 PM, Max Semenik >>> wrote: >>> https://gerrit.wikimedia.org/r/#/c/177448/ - please let me know if you see something misssing:) -- Best regards, Max Semenik ([[User:MaxSem]]) ___ Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l >>> >> >> >> -- >> Best regards, >> Max Semenik ([[User:MaxSem]]) >> > > -- Best regards, Max Semenik ([[User:MaxSem]]) ___ Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
Re: [WikimediaMobile] WG response table
Yes, but part of that is deciding whether or not to push stuff. We can double-check with Maryana, but that's what I would recommend. On Wed, Dec 3, 2014 at 5:16 PM, Max Semenik wrote: > Didn't we decide that this table is only for actually pushing stuff? > > On Wed, Dec 3, 2014 at 5:15 PM, Ryan Kaldari > wrote: > >> Since we are still supporting WikiGrok version A for the time being, we >> will need to have a 'correct' column that is boolean. Although we will >> never push claims that have correct set to 'false', we may use such entries >> to evaluate whether 'true' entries should be pushed or not. For example, if >> there are 2 entries that say 'occupation:author:true', but 5 that say >> 'occupation:author:false', we will not want to push 'occupation:author' to >> Wikidata. >> >> Kaldari >> >> On Wed, Dec 3, 2014 at 4:55 PM, Max Semenik >> wrote: >> >>> https://gerrit.wikimedia.org/r/#/c/177448/ - please let me know if you >>> see something misssing:) >>> >>> -- >>> Best regards, >>> Max Semenik ([[User:MaxSem]]) >>> >>> ___ >>> Mobile-l mailing list >>> Mobile-l@lists.wikimedia.org >>> https://lists.wikimedia.org/mailman/listinfo/mobile-l >>> >>> >> > > > -- > Best regards, > Max Semenik ([[User:MaxSem]]) > ___ Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
Re: [WikimediaMobile] WG response table
Yes, but part of that is deciding whether or not to push stuff. We can double-check with Maryana, but that's what I would recommend. On Wed, Dec 3, 2014 at 5:16 PM, Max Semenik wrote: > Didn't we decide that this table is only for actually pushing stuff? > > On Wed, Dec 3, 2014 at 5:15 PM, Ryan Kaldari > wrote: > >> Since we are still supporting WikiGrok version A for the time being, we >> will need to have a 'correct' column that is boolean. Although we will >> never push claims that have correct set to 'false', we may use such entries >> to evaluate whether 'true' entries should be pushed or not. For example, if >> there are 2 entries that say 'occupation:author:true', but 5 that say >> 'occupation:author:false', we will not want to push 'occupation:author' to >> Wikidata. >> >> Kaldari >> >> On Wed, Dec 3, 2014 at 4:55 PM, Max Semenik >> wrote: >> >>> https://gerrit.wikimedia.org/r/#/c/177448/ - please let me know if you >>> see something misssing:) >>> >>> -- >>> Best regards, >>> Max Semenik ([[User:MaxSem]]) >>> >>> ___ >>> Mobile-l mailing list >>> Mobile-l@lists.wikimedia.org >>> https://lists.wikimedia.org/mailman/listinfo/mobile-l >>> >>> >> > > > -- > Best regards, > Max Semenik ([[User:MaxSem]]) > ___ Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
Re: [WikimediaMobile] WG response table
Didn't we decide that this table is only for actually pushing stuff? On Wed, Dec 3, 2014 at 5:15 PM, Ryan Kaldari wrote: > Since we are still supporting WikiGrok version A for the time being, we > will need to have a 'correct' column that is boolean. Although we will > never push claims that have correct set to 'false', we may use such entries > to evaluate whether 'true' entries should be pushed or not. For example, if > there are 2 entries that say 'occupation:author:true', but 5 that say > 'occupation:author:false', we will not want to push 'occupation:author' to > Wikidata. > > Kaldari > > On Wed, Dec 3, 2014 at 4:55 PM, Max Semenik wrote: > >> https://gerrit.wikimedia.org/r/#/c/177448/ - please let me know if you >> see something misssing:) >> >> -- >> Best regards, >> Max Semenik ([[User:MaxSem]]) >> >> ___ >> Mobile-l mailing list >> Mobile-l@lists.wikimedia.org >> https://lists.wikimedia.org/mailman/listinfo/mobile-l >> >> > -- Best regards, Max Semenik ([[User:MaxSem]]) ___ Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
Re: [WikimediaMobile] WG response table
Since we are still supporting WikiGrok version A for the time being, we will need to have a 'correct' column that is boolean. Although we will never push claims that have correct set to 'false', we may use such entries to evaluate whether 'true' entries should be pushed or not. For example, if there are 2 entries that say 'occupation:author:true', but 5 that say 'occupation:author:false', we will not want to push 'occupation:author' to Wikidata. Kaldari On Wed, Dec 3, 2014 at 4:55 PM, Max Semenik wrote: > https://gerrit.wikimedia.org/r/#/c/177448/ - please let me know if you > see something misssing:) > > -- > Best regards, > Max Semenik ([[User:MaxSem]]) > > ___ > Mobile-l mailing list > Mobile-l@lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/mobile-l > > ___ Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
[WikimediaMobile] WG response table
https://gerrit.wikimedia.org/r/#/c/177448/ - please let me know if you see something misssing:) -- Best regards, Max Semenik ([[User:MaxSem]]) ___ Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
[WikimediaMobile] Fwd: [African Wikimedians] Afripédia Douala
fyi, a feedback from duala, cameroon, concerning uploading fotos to commons. -- Forwarded message -- From: Kasper Souren Date: Wed, Dec 3, 2014 at 12:01 AM Subject: Re: [African Wikimedians] Afripédia Douala To: Mailing list for African Wikimedians On Tuesday, December 2, 2014, Florence Devouard wrote: > > I wanted to outline that both Kumusha Takes Wiki and Wiki Loves Africa are > being conducted in English and French > Great! > > https://commons.wikimedia.org/wiki/Commons:Wiki_Loves_Africa I see the contest is over now, will there be another one coming up? > > > I was quite disappointed by the limited participation of Cameroom to the > photo contest. Given the effort already been done in that country to train > editors and to promote the project, I expected more input. > While trying to upload some pictures to https://commons.wikimedia.org/wiki/Category:Afripedia_Douala I'm starting to understand at least one part of the issue. Internet connections are really bad. Very high ping times, both at the French institute as well as in the hotel I'm staying in now, which I can't easily consider cheap (at least in terms of pricing). Is there a robust way to upload pictures to Commons over bad internet connections? Facebook and G+ Android apps have done a fairly good job at uploading pictures automatically, but now I still need to first download them to my laptop and then upload them through the Upload Wizard, which is failing me. Using the Commons Android app is not a good alternative from the hotel connection because it wants me to enter a user/pass combination too often on my phone. Cheers, Kasper ___ African-Wikimedians mailing list african-wikimedi...@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/african-wikimedians ___ Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
