Re: [WikimediaMobile] [Wikimedia-search] Fwd: "Morelike" suggestions - the results are in!

[Dmitry Brant]

Will surely take note for next time. Thanks!
Now that we've got the results from this test, we will soon update the app
to use *only* morelike suggestions, which means you'll be getting twice as
many morelike queries from the app as before. (We'll let you know when
that's released)

On Wed, Jul 29, 2015 at 4:17 PM, Oliver Keyes  wrote:

> This is fantastic work to see!
>
> For future work around this stuff, can I ask that you keep us in the
> loop? When you build a feature like this, users get more things - and
> search gets more queries, some that succeed and some but fail. But for
> this email at the tail-end of the test we wouldn't know this was
> happening, and it has the potential to mess with some of our core
> KPIs.
>
> On 29 July 2015 at 16:01, Dmitry Brant  wrote:
> > moving to mobile-l, and cc Search & Discovery.
> >
> > -- Forwarded message --
> > From: Dmitry Brant 
> > Date: Wed, Jul 29, 2015 at 3:38 PM
> > Subject: "Morelike" suggestions - the results are in!
> > To: Internal communication for WMF Reading team
> > 
> >
> >
> > Hi all,
> >
> > For the last few weeks, we've had an A/B test in the Android app where we
> > measure user engagement with the "read more" suggestions that we show at
> the
> > bottom of each article. We display three suggestions for further reading,
> > based on either (A) a plain full-text search query based on the title of
> the
> > current article, or (B) a query using the "morelike" feature in
> > CirrusSearch.
> >
> > And the winner is... (perhaps not entirely surprisingly) "morelike"!
> Users
> > who saw suggestions based on "morelike" were over 20% more likely to
> click
> > on one of the suggestions.
> >
> > Here's a quick analysis and chart of the data from the last 10 days:
> >
> >
> https://docs.google.com/spreadsheets/d/1BFsrAcPgexQyNVemmJ3k3IX5rtPvJ_5vdYOyGgS5R6Y/edit?usp=sharing
> >
> >
> > -Dmitry
> >
> >
> >
> > ___
> > Wikimedia-search mailing list
> > wikimedia-sea...@lists.wikimedia.org
> > https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
> >
>
>
>
> --
> Oliver Keyes
> Research Analyst
> Wikimedia Foundation
>
> ___
> Mobile-l mailing list
> Mobile-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/mobile-l
>
___
Mobile-l mailing list
Mobile-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/mobile-l

Re: [WikimediaMobile] [Wikimedia-search] Fwd: "Morelike" suggestions - the results are in!

[Oliver Keyes]

This is fantastic work to see!

For future work around this stuff, can I ask that you keep us in the
loop? When you build a feature like this, users get more things - and
search gets more queries, some that succeed and some but fail. But for
this email at the tail-end of the test we wouldn't know this was
happening, and it has the potential to mess with some of our core
KPIs.

On 29 July 2015 at 16:01, Dmitry Brant  wrote:
> moving to mobile-l, and cc Search & Discovery.
>
> -- Forwarded message --
> From: Dmitry Brant 
> Date: Wed, Jul 29, 2015 at 3:38 PM
> Subject: "Morelike" suggestions - the results are in!
> To: Internal communication for WMF Reading team
> 
>
>
> Hi all,
>
> For the last few weeks, we've had an A/B test in the Android app where we
> measure user engagement with the "read more" suggestions that we show at the
> bottom of each article. We display three suggestions for further reading,
> based on either (A) a plain full-text search query based on the title of the
> current article, or (B) a query using the "morelike" feature in
> CirrusSearch.
>
> And the winner is... (perhaps not entirely surprisingly) "morelike"!  Users
> who saw suggestions based on "morelike" were over 20% more likely to click
> on one of the suggestions.
>
> Here's a quick analysis and chart of the data from the last 10 days:
>
> https://docs.google.com/spreadsheets/d/1BFsrAcPgexQyNVemmJ3k3IX5rtPvJ_5vdYOyGgS5R6Y/edit?usp=sharing
>
>
> -Dmitry
>
>
>
> ___
> Wikimedia-search mailing list
> wikimedia-sea...@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
>



-- 
Oliver Keyes
Research Analyst
Wikimedia Foundation

___
Mobile-l mailing list
Mobile-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/mobile-l

[WikimediaMobile] Fwd: "Morelike" suggestions - the results are in!

[Dmitry Brant]

moving to mobile-l, and cc Search & Discovery.

-- Forwarded message --
From: Dmitry Brant 
Date: Wed, Jul 29, 2015 at 3:38 PM
Subject: "Morelike" suggestions - the results are in!
To: Internal communication for WMF Reading team <
reading-...@lists.wikimedia.org>


Hi all,

For the last few weeks, we've had an A/B test in the Android app where we
measure user engagement with the "read more" suggestions that we show at
the bottom of each article. We display three suggestions for further
reading, based on either (A) a plain full-text search query based on the
title of the current article, or (B) a query using the "morelike" feature
in CirrusSearch.

And the winner is... (perhaps not entirely surprisingly) "morelike"!  Users
who saw suggestions based on "morelike" were over 20% more likely to click
on one of the suggestions.

Here's a quick analysis and chart of the data from the last 10 days:

*https://docs.google.com/spreadsheets/d/1BFsrAcPgexQyNVemmJ3k3IX5rtPvJ_5vdYOyGgS5R6Y/edit?usp=sharing
*


-Dmitry
___
Mobile-l mailing list
Mobile-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/mobile-l

Re: [WikimediaMobile] [Apps] Android Wikipedia beta app release (2.0.104-beta-2015-06-25)

[Joaquin Oltra Hernandez]

Created https://phabricator.wikimedia.org/T107256 for tracking what's
happening with this. Please chime in and report your problems so that we
can properly triage it.

On Fri, Jun 26, 2015 at 5:02 PM, Adam Baso  wrote:

> Not sure if a ticket exists for the mobileview API. Anyone on the list
> know?
>
> As for a features matrix It's a work in progress, but
> https://www.mediawiki.org/wiki/Reading/Features is where we've been
> adding stuff. There are varying opinions about pursuit of feature parity,
> but I think there's agreement we need to at least analyze stuff on a
> feature by feature basis.
>
> On Thursday, June 25, 2015, Federico Leva (Nemo) 
> wrote:
>
>> Stephen Niedzielski, 26/06/2015 04:20:
>>
>>>* Fix certain ISBN number links
>>>
>>
>> I see it was more than that, all special pages!
>> https://phabricator.wikimedia.org/rAPAW647a53d3ea896c3c66805fd65726852d126f48f5
>>
>> Was this reported against the mobileview API as well? Having a complete
>> map of gaps and differences from the desktop version is important so that
>> everyone is on the same page.
>>
>> Nemo
>>
>> ___
>> Mobile-l mailing list
>> Mobile-l@lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/mobile-l
>>
>
> ___
> Mobile-l mailing list
> Mobile-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/mobile-l
>
>
___
Mobile-l mailing list
Mobile-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/mobile-l