Nuria added a comment.
Are there any docs we can look at with metrics?TASK DETAILhttps://phabricator.wikimedia.org/T177354EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: chelsyx, NuriaCc: Nuria, Aklapper, mpopov, chelsyx, Abit, SandraF_WMF, Ramsey-WMF
Nuria added a comment.
@chelsyx That makes sense, thank you.
I was also trying to make a meta point though: since prior work and statistics exist for commons it will be worth documenting ( on meta?) these numbers and why/how they differ with other numbers community might have access to. I know
Nuria added a comment.
Is the user versus bot percentage overall? I am not sure that is of value to quantify usage as of 2017, right? See timeseries of uploads by bots/users at https://stats.wikimedia.org/wikispecial/EN/TablesWikipediaCOMMONS.htm (scroll down)
Most recent monthly numbers
Nuria added a comment.
Please have in mind that metrics for commons exist is https://stats.wikimedia.org/wikispecial/EN/TablesWikipediaCOMMONS.htm , let's make sure those are looked at when this work is taking place.TASK DETAILhttps://phabricator.wikimedia.org/T174519EMAIL PREFERENCEShttps
Nuria edited projects, added Analytics; removed Analytics-Kanban.
TASK DETAILhttps://phabricator.wikimedia.org/T173850EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: NuriaCc: Ottomata, gerritbot, Mattflaschen-WMF, Liuxinyu970226, WMDE-leszek, Anomie, Aklapper
Nuria added a comment.
Moving to radar as it doesn't seem there are any actionables for analytics.TASK DETAILhttps://phabricator.wikimedia.org/T170400EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: NuriaCc: Nuria, Lydia_Pintscher, Jan_Dittrich, Aklapper
Nuria added a subscriber: Smallyen03.Nuria added a comment.
@Smallyen03 : the idea of the tags is to be able to split webrequest dataset into "partitions" that make subsequent querying more effective. So tags have to be coarse, so this one sounds good: "Tag for a request containi
Nuria added a comment.
To incentivize them to contribute, we have to give them even better metrics of community usage/impact that they can give to funders
Understood, as I said we are willing to help in any way we can, seems like a great objective. My main point is that if we come up
Nuria added a comment.
@Smalyshev @AndrewSu please take a look at other metric definitions we have. once you decide on a metric definition please be so kind as to document it in beta: https://meta.wikimedia.org/wiki/Research:Standard_metrics#Newly_registered_user
This helps a lot to quantify what
Nuria added a comment.
As far as I understand you need to publish not only queries to service but also query results (is this correct @Smalyshev?) analyzing those will produce the metric counts @AndrewSu and @leila are interested on. This requires a schema definition of what a query result
Nuria added a comment.
If @Smalyshev thinks this would be a good idea and can develop the instrumentation for the metrics and own the metric definition (together with "gene wiki") we can help on the project as needed, seems to me that things like these could be computed with the infrast
Nuria added a comment.
From meeting:
@Smalyshev can consume from either kafka or event stream once we add the ability to consume from a given point in time, this is what is mean by "seekable" (on new kafka cluster, next quarter, Q1) .
Keeping data for longer than 7 days is no
Nuria added a comment.
ping @Smalyshev is this still a need? Maybe we should set up a short 30 minute sync upTASK DETAILhttps://phabricator.wikimedia.org/T161731EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ottomata, NuriaCc: Nuria, Anomie, Aklapper
Nuria assigned this task to Ottomata.
TASK DETAILhttps://phabricator.wikimedia.org/T161731EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ottomata, NuriaCc: Anomie, Aklapper, Smalyshev, QZanden, EBjune, merbst, Salgo60, Avner, debt, Gehel, D3r1ck01, Jonas
Nuria added a comment.
ping @AddshoreTASK DETAILhttps://phabricator.wikimedia.org/T160825EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: NuriaCc: Nuria, Lydia_Pintscher, Addshore, matej_suchanek, Aklapper, QZanden, D3r1ck01, Izno, JAllemandou, Wikidata-bugs
Nuria closed this task as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T130102EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: NuriaCc: Nuria, Addshore, Aklapper, Lydia_Pintscher, QZanden, D3r1ck01, Izno, JAllemandou, Wikidata-bugs, aud
Nuria added a comment.
Also, have in mind that browser usage is really not that different per project and overall, the overall info should be sufficient to take triage decisions: https://analytics.wikimedia.org/dashboards/browsers/#desktop-site-by-osTASK DETAILhttps://phabricator.wikimedia.org
Nuria closed subtask T130102: [Task] dashboard showing browser usage distribution for Wikidata as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T108931EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: NuriaCc: Ricordisamoa, Abraham
Nuria added a comment.
Will be closing this task as http://pivot.wikimedia.org ( to which wikimedia de has access) provides this data.TASK DETAILhttps://phabricator.wikimedia.org/T130102EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: NuriaCc: Nuria, Addshore
Nuria added a comment.
F4079411: Screen Shot 2016-05-30 at 10.28.41 AM.pngTASK DETAILhttps://phabricator.wikimedia.org/T130102EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: NuriaCc: Nuria, Addshore, Aklapper, Lydia_Pintscher, QZanden, D3r1ck01, Izno
Nuria added a comment.
This is again another instance of bot traffic that slips by, this UA might not be causing trouble now but there will be others. Merging into parent taskTASK DETAILhttps://phabricator.wikimedia.org/T135164EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel
wikidata query service? Anything else?
Thanks,
Nuria
On Mon, Oct 3, 2016 at 10:05 PM, Yuri Astrakhan <yastrak...@wikimedia.org>
wrote:
> For consistency between all possible clients, we seem to have only two
> options: either part of the query, or the X-Analytics header. The
Yuri/Stas:
This thread is missing some background context info as to what the issues
are, if you could forward it it will be great.
>Thanks, though using distinct User-Agent may be easier for analysis,
>since those are stored as separate fields, and doing operations on
>separate field would be
Nuria added a comment.
Comments from the project standpoint:
@Addshore: we will not be adding new features to Pageview API until we have finished our scaling project and added counting of pageviews for wikis for which it is not happening (ex: outreachwiki)
Any feature additions will happen
Nuria moved this task from Q1 (July 2016) to Q2 (October 2016) on the Analytics board.
TASK DETAILhttps://phabricator.wikimedia.org/T135164WORKBOARDhttps://phabricator.wikimedia.org/project/board/11/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: NuriaCc
Nuria added a comment.
See attached a rough preview of 1 week of wikidata requests per browser per
country via Druid
TASK DETAIL
https://phabricator.wikimedia.org/T130102
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Nuria
Cc: Nuria, Addshore
Nuria added a comment.
FYI that when we have our pageview dataset working on druid you could look at
this data in an easier fashion, now, as i said (other than they many crawlers
for wikidata) browser stats per project are not that significantly different.
TASK DETAIL
https
Nuria added a comment.
I realize this task did not included the link to browser reports:
https://browser-reports.wmflabs.org/#all-sites-by-os
Please let us know if it can be closed, i assume @Addshore has provided the
data you needed. As I mentioned browser stats are not significantly
Nuria removed projects: Analytics, Pageviews-API.
TASK DETAIL
https://phabricator.wikimedia.org/T132223
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Nuria
Cc: Nuria, Lucie, Addshore, Lydia_Pintscher, Ricordisamoa, Quiddity, Aklapper,
D3r1ck01
Nuria added a comment.
I am not sure this requires any works from analytics team. Seems like the
data you need is already available on pageview API, correct?
TASK DETAIL
https://phabricator.wikimedia.org/T132223
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel
Nuria added a comment.
The policy doesn't have an specific owner, if that is what you are asking.
Here is is: https://meta.wikimedia.org/wiki/User-Agent_policy
TASK DETAIL
https://phabricator.wikimedia.org/T135164
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel
Nuria moved this task from Backlog to Q1 (July 2016) on the Analytics board.
TASK DETAIL
https://phabricator.wikimedia.org/T135164
WORKBOARD
https://phabricator.wikimedia.org/project/board/11/
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Nuria
Nuria moved this task from Incoming to Backlog on the Analytics board.
TASK DETAIL
https://phabricator.wikimedia.org/T135164
WORKBOARD
https://phabricator.wikimedia.org/project/board/11/
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Nuria
Cc
Nuria added a comment.
.Please try to notify owner of UA policy. If they add the word "bot" to UA
this would automatically be marked as spider.
TASK DETAIL
https://phabricator.wikimedia.org/T135164
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailp
Nuria moved this task to Radar on the Analytics workboard.
TASK DETAIL
https://phabricator.wikimedia.org/T120452
WORKBOARD
https://phabricator.wikimedia.org/project/board/11/
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Yurik, Nuria
Cc: TheDJ
Nuria moved this task to Tasked on the Analytics workboard.
TASK DETAIL
https://phabricator.wikimedia.org/T120452
WORKBOARD
https://phabricator.wikimedia.org/project/board/11/
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Yurik, Nuria
Cc: TheDJ
Nuria edited projects, added Analytics; removed Analytics-Kanban.
TASK DETAIL
https://phabricator.wikimedia.org/T120452
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Milimetric, Nuria
Cc: Pokefan95, gerritbot, -jem-, Bawolff, MZMcBride, Alkamid
Nuria added a comment.
@Lydia_Pintscher:
Ah! Sorry, I should have included this:
The data is all on wedrequest table of wmf db on hive for all projects.
https://wikitech.wikimedia.org/wiki/Analytics/Data/Webrequest
You can take a look for wikidata pageviews but from having looked
Nuria added a project: Analytics.
TASK DETAIL
https://phabricator.wikimedia.org/T130102
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Nuria
Cc: Nuria, Addshore, Aklapper, Lydia_Pintscher, D3r1ck01, Izno, JAllemandou,
Wikidata-bugs, aude, Mbch331
Nuria added a comment.
@Lydia_Pintscher: Have you evaluated (by looking at current data) that
wikidata browser stats are significantly different from other projects?
This question comes up often and our browser traffic -when we have looked at
it in the past- doesn't exhibit major
Nuria closed this task as "Resolved".
TASK DETAIL
https://phabricator.wikimedia.org/T119054
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: JAllemandou, Nuria
Cc: Tbayer, gerritbot, Lydia_Pintscher, Aklapper, Addshore, StudiesWorld,
Wik
Nuria added a comment.
@addshore: It is on our backlog but we have several things before it so we
cannot give an ETA. Now, I suggest that 1) you do some ad-hoc querying and get
the data you need to met your end of December deadline. And 2) we can work
together on oozification of this job later
Nuria added a subscriber: Nuria.
Nuria added a comment.
@addshore: Do you have access to cluster 1002 to run querys yourself? Timeline
wise if you need this before end of year it might be faster if you start
working on it while we help you get changes going.
TASK DETAIL
https
Nuria added a comment.
I second @ottomata
TASK DETAIL
https://phabricator.wikimedia.org/T117732
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Nuria
Cc: Lydia_Pintscher, fgiunchedi, Christopher, JanZerebecki, Nuria, Ottomata,
Aklapper, Addshore
Nuria added a comment.
> As mentioned, we might want to use a single node process exposing parsoid,
> restbase & eventbus for small (third party) installs, but might as well use
> the new EventLogging service in production.
To date we do not have a third party install s
Nuria added a comment.
> I don't see these two as being mutually-exclusive. In order to meet the end
> goal of a generalised event service we are starting with the Services' use
> case. The MVP is part of >one of our quarterly goals. We have almost
> finalised the events and
Nuria added a project: Analytics-Backlog.
TASK DETAIL
https://phabricator.wikimedia.org/T117402
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Addshore, Nuria
Cc: JanZerebecki, fgiunchedi, gerritbot, Addshore, Aklapper, Wikidata-bugs,
aude, Mbch331
Nuria added a comment.
> a way to expose a stream of events in a defined format that can be consumed
> easily by a range of clients.
This talks about consumption, not production but I do not want to get too deep
into that cause I really I do not think we are discussing w
Nuria added a comment.
> EventLogging: Decode, validate and enqueue JSON events for EL.
mmm..I am not sure who would be the users of this endpoint at this time, do
you have a case for EL that is not served by varnish endpoint?
> Provide edit related events (ex: edit, creation, de
Nuria added a comment.
> @Ottomata, main reason would be the ability to work with $simple_queue,
> $binary_kafka, $amazon_queue and so on without changes in MW code. This isn't
> so theoretical. We'll want a lighter-weight queue for testing, developers and
> third party users
Nuria added a subscriber: Nuria.
Nuria added a comment.
Wait, one thing is limn, other (i know, confusing) the limn-data repositories.
those are not tied to limn necessarily, they are just poorly named.
TASK DETAIL
https://phabricator.wikimedia.org/T112506
EMAIL PREFERENCES
https
101 - 151 of 151 matches
Mail list logo
