Re: [Wikitech-l] [WikimediaMobile] [Analytics] Mobile stats

2013-09-19 Thread Adam Baso
A run on yesterday's valid Wikipedia Zero hits showed that user agents NOT supporting HTML (i.e., only supporting WAP) is only 0.098 - 0.108 *percent*. Assuming a bunch of complaints don't come in (e.g., "I'm getting tag soup!", as Max might say), I think we could make a reasonable case to stop su

Re: [Wikitech-l] [WikimediaMobile] [Analytics] Mobile stats

2013-09-19 Thread Adam Baso
+Analytics On Thu, Sep 19, 2013 at 1:57 PM, Adam Baso wrote: > A run on yesterday's valid Wikipedia Zero hits showed that user agents NOT > supporting HTML (i.e., only supporting WAP) is only 0.098 - 0.108 *percent*. > > Assuming a bunch of complaints don't come in (e.g., "I'm getting tag > sou

Re: [Wikitech-l] [WikimediaMobile] [Analytics] Mobile stats

2013-09-17 Thread Max Semenik
After looking at Varnish VCL with Adam, we discovered a bug in regex resulting in many phones being detected as WAP when they shouldn't be. Since the older change[1] simplifying detection had also fixed this bug, Brandon Black deployed it and since today the usage share of WAP should seriously drop

Re: [Wikitech-l] [WikimediaMobile] [Analytics] Mobile stats

2013-09-17 Thread Arthur Richards
That's awesome - thanks Max and Adam; it's great to see the last vestiges of X-Device finally disappear! On Tue, Sep 17, 2013 at 1:07 PM, Max Semenik wrote: > After looking at Varnish VCL with Adam, we discovered a bug in regex > resulting in many phones being detected as WAP when they shouldn'

Re: [Wikitech-l] [WikimediaMobile] [Analytics] Mobile stats

2013-09-10 Thread Adam Baso
Thanks. 7-9% of responses on Wikipedia Zero being WAP is pretty substantial. On Tue, Sep 10, 2013 at 2:01 PM, Andrew Otto wrote: > > These > > zero.tsv.log* > > files to which I refer seem to be, basically Varnish log lines that > > correspond to Wikipedia Zero-targeted traffic. > Yup! Correct

Re: [Wikitech-l] [WikimediaMobile] [Analytics] Mobile stats

2013-09-10 Thread Andrew Otto
> These > zero.tsv.log* > files to which I refer seem to be, basically Varnish log lines that > correspond to Wikipedia Zero-targeted traffic. Yup! Correct. zero.tsv.log* files are captured unsampled and based on the presence of a "zero=" tag in the X-Analytics header: http://git.wikimedia.or

Re: [Wikitech-l] [WikimediaMobile] [Analytics] Mobile stats

2013-09-10 Thread Adam Baso
Somewhere in between, I think. Wikipedia Zero's main extension, ZeroRatedMobileAccess, relies upon the mobile web's main extension, MobileFrontend. Wikipedia Zero access is served across [lang.].zero.wikipedia.org and [lang.].m.wikipedia.org. As I understand, the general Varnish logs capture both

Re: [Wikitech-l] [WikimediaMobile] [Analytics] Mobile stats

2013-09-10 Thread Gerard Meijssen
Hoi, Is the Wikipedia-Zero traffic information part of the mobile statistics or is it something completely separate thing? Thanks, GerardM On 10 September 2013 03:26, Adam Baso wrote: > Wikipedia Zero traffic (IP address and MCC/MNC matching as expected) shows > in one day of requests (zer

Re: [Wikitech-l] [WikimediaMobile] [Analytics] Mobile stats

2013-09-09 Thread Adam Baso
Wikipedia Zero traffic (IP address and MCC/MNC matching as expected) shows in one day of requests (zero.tsv.log-20130907) roughly 7-9% of page responses having a Content-Type response of "text/vnd.wap.wml", presuming field #11 (or index 10 if you're indexing from 0) in zero.tsv.log- is the Content-

Re: [Wikitech-l] [WikimediaMobile] [Analytics] Mobile stats

2013-09-05 Thread Arthur Richards
Would adding the accept header to the x-analytics header be worthwhile for this? On Sep 5, 2013 4:16 AM, "Erik Zachte" wrote: > For a breakdown per country, the higher the sampling rate the better, as > the data will become reliable even for smaller countries with a not so > great adoption rate o

Re: [Wikitech-l] [WikimediaMobile] [Analytics] Mobile stats

2013-09-04 Thread Dan Foy
I have some concerns about looking at this from a perspective of 'WAP browsers make up only X% of worldwide traffic'. This approach may bias towards the results of the US and Europe, where the majority of the internet users will overshadow what devices are in use in less developed areas like Afric

Re: [Wikitech-l] [WikimediaMobile] [Analytics] Mobile stats

2013-09-04 Thread Arthur Richards
Thanks Max for digging into this :) I'm no analytics guy, but I am a little concerned about the sample size and duration of the internal logging that we've done - sampling 1/1 for only a few days for data about something we generally know usage to already be low seems to me like it might be di