Re: [Analytics] [Ops] How best to accurately record page interactions in Page Previews

Thanks. On Fri, Jan 19, 2018 at 12:30 PM, Nuria Ruiz wrote: > >Thanks, good to know - is there a report around that? I'm wondering how > "missing requests" ought to be expressed with some margin of error. > I think the ones that can quantify this best is your team. If anything > from what I reme

Re: [Analytics] [Ops] How best to accurately record page interactions in Page Previews

>Thanks, good to know - is there a report around that? I'm wondering how "missing requests" ought to be expressed with some margin of error. I think the ones that can quantify this best is your team. If anything from what I remember from pop ups experiments the inflow of events was higher than expe

Re: [Analytics] [Ops] How best to accurately record page interactions in Page Previews

>So maybe it's worth considering which approach takes us closer to that? AIUI the beacon puts the record into the webrequest table and from there it would only take some >trivial preprocessing to replace the beacon URL with the virtual URL and and add the beacon type as a "virtual_type" field or so

Re: [Analytics] [Ops] How best to accurately record page interactions in Page Previews

> >Thanks, Sam. Nuria, that's what I was getting at - if using the EL JS > library would some sort of new method be needed so that these impressions > arena't undercounted? > If we had a lot of users with DNT, maybe, from our tests when we enabled > that on EL this is not the case. > Thanks, good

Re: [Analytics] [Ops] How best to accurately record page interactions in Page Previews

> You could join these together in a broader ‘content consumption’ dataset somehow, either in Hadoop with batch jobs, or more realtime with streaming jobs. Hm, idea…which I think has been mentioned before: Could we leave pageviews as is, but make a new dataset that counts both pageviews and page

Re: [Analytics] [Ops] How best to accurately record page interactions in Page Previews

>Thanks, Sam. Nuria, that's what I was getting at - if using the EL JS library would some sort of new method be needed so that these impressions arena't undercounted? If we had a lot of users with DNT, maybe, from our tests when we enabled that on EL this is not the case. Your team has already run

Re: [Analytics] is there an hourly pageviews API?

Hi James, We don't have hourly resolution for pageviews-per-article in API. I don't think of better options than getting the dumps :( Joseph On Fri, Jan 19, 2018 at 12:15 PM, James Salsman wrote: > Hourly pageviews are in > /public/dumps/pageviews/$year/$year-$month/pageviews-$year$ > month$day-

Re: [Analytics] is there an hourly pageviews API?

> > Thanks, Thomas, but that has only daily and monthly granularity for > articles. > True. Sorry, replied too quickly. Hourly granularity is available for / metrics/pageviews/aggregate/{project}/{access}/{agent}/{granularity}/{start}/{end}

Re: [Analytics] is there an hourly pageviews API?

>> Hourly pageviews are in >> /public/dumps/pageviews/$year/$year-$month/pageviews-$year$month$day-[012][0-9].gz >> >> Is there an API faster than zgreping those? > > https://wikimedia.org/api/rest_v1/#/ :-) Thanks, Thomas, but that has only daily and monthly granularity for articles. ___

Re: [Analytics] [Ops] How best to accurately record page interactions in Page Previews

> For virtual pageviews, people will probably be more interested in reports that belong to the first group (summing them up with normal pageviews, breaking them down along the dimensions that are relevant for web traffic, counting them for a given URL etc). Ah! Ok I get this use case now. I mig

Re: [Analytics] is there an hourly pageviews API?

https://wikimedia.org/api/rest_v1/#/ :-) ___ Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics

[Analytics] is there an hourly pageviews API?

Hourly pageviews are in /public/dumps/pageviews/$year/$year-$month/pageviews-$year$month$day-[012][0-9].gz Is there an API faster than zgreping those? ___ Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listi

Re: [Analytics] [Ops] How best to accurately record page interactions in Page Previews

Thanks, Sam. Nuria, that's what I was getting at - if using the EL JS library would some sort of new method be needed so that these impressions arena't undercounted? On Fri, Jan 19, 2018 at 4:49 AM, Sam Smith wrote: > On Thu, Jan 18, 2018 at 9:57 PM, Adam Baso wrote: > >> Adding to this, one th

Re: [Analytics] [Ops] How best to accurately record page interactions in Page Previews

On Thu, Jan 18, 2018 at 9:57 PM, Adam Baso wrote: > Adding to this, one thing to consider is DNT - is there a way to invoke EL > so that such traffic is appropriately imputed or something? > The EventLogging client respects DNT [0]. When the user enables DNT, mw.eventLog.logEvent is a NOP. I do

Re: [Analytics] [Ops] How best to accurately record page interactions in Page Previews

On Thu, Jan 18, 2018 at 3:56 PM, Nuria Ruiz wrote: > Event logging use cases are events, as we move to a thicker client -more > javascript heavy- you will be needing to measure events for -nearly- > everything, whether those are to be consider "content consumption" or "ui > interaction" is not t