[Wikidata-bugs] [Maniphest] T336361: [Analytics] Identify access via mobile devices independent of tags

2023-08-14 Thread Manuel
Manuel updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T336361 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE, Manuel Cc: AndrewTavis_WMDE, Michael, Manuel, Aklapper, Danny_Benjafield_WMDE,

[Wikidata-bugs] [Maniphest] T336361: [Analytics] Identify access via mobile devices independent of tags

2023-08-11 Thread Manuel
Manuel added a comment. Ah, I see! This task was only about finding a way to reliably identify all uses (viewing and editing) from mobile devices, independent of their tags. Once we have a reliable way of detecting the user device type, the next goal will be along the lines of what you

[Wikidata-bugs] [Maniphest] T336361: [Analytics] Identify access via mobile devices independent of tags

2023-08-11 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. Or am I just jumping to the question in the description and we just want to figure out mobile edits and views over the period? TASK DETAIL https://phabricator.wikimedia.org/T336361 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T336361: [Analytics] Identify access via mobile devices independent of tags

2023-08-11 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. I guess I'm confused what the goal here is then 樂 As I understand it we're looking for users who are using the normal desktop UI on a mobile device. For the `wmf.webrequest` table we'd then use: - `user_agent` -> device used via `python-user-agent` and

[Wikidata-bugs] [Maniphest] T336361: [Analytics] Identify access via mobile devices independent of tags

2023-08-11 Thread Manuel
Manuel added a comment. Yes, I edited my comment, as I missed this important point: access_method just checks the URL for indications of a mobile UI, so it is about UI and not about device. So it is out of scope here, after all. TASK DETAIL https://phabricator.wikimedia.org/T336361 EMAIL

[Wikidata-bugs] [Maniphest] T336361: [Analytics] Identify access via mobile devices independent of tags

2023-08-11 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. My understanding of `access_method` is that it's only related to `user_agent` for mobile apps: > Mobile app requests are identified by the user agent including `WikipediaApp` or `Wikipedia/5.0`. For web requests it's based on the subdomains. TASK

[Wikidata-bugs] [Maniphest] T336361: [Analytics] Identify access via mobile devices independent of tags

2023-08-11 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. I've already checked and there are differences between a `python-user-agents` derived device via `user_agents.parse(ua_value).is_mobile` and the `access_method`. Specifically we are getting users where the device from `.is_mobile` is `mobile`, but the

[Wikidata-bugs] [Maniphest] T336361: [Analytics] Identify access via mobile devices independent of tags

2023-08-11 Thread Manuel
Manuel added a comment. > Are we trying then the combination of user_agent_var.is_mobile = True and access_method = "desktop" via the access_method column from wmf.webrequest? It is important to keep user devices and Wikidata UI separate here. For now we are only trying to get the

[Wikidata-bugs] [Maniphest] T336361: [Analytics] Identify access via mobile devices independent of tags

2023-08-11 Thread Manuel
Manuel updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T336361 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE, Manuel Cc: AndrewTavis_WMDE, Michael, Manuel, Aklapper, Danny_Benjafield_WMDE,

[Wikidata-bugs] [Maniphest] T336361: [Analytics] Identify access via mobile devices independent of tags

2023-08-11 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T336361 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: AndrewTavis_WMDE, Michael, Manuel, Aklapper, Danny_Benjafield_WMDE,

[Wikidata-bugs] [Maniphest] T336361: [Analytics] Identify access via mobile devices independent of tags

2023-08-11 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T336361 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: AndrewTavis_WMDE, Michael, Manuel, Aklapper, Danny_Benjafield_WMDE,

[Wikidata-bugs] [Maniphest] T336361: [Analytics] Identify access via mobile devices independent of tags

2023-08-10 Thread Manuel
Manuel updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T336361 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE, Manuel Cc: AndrewTavis_WMDE, Michael, Manuel, Aklapper, Danny_Benjafield_WMDE,

[Wikidata-bugs] [Maniphest] T336361: [Analytics] Identify access via mobile devices independent of tags

2023-08-10 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. @Manuel, I've been using python-user-agents and so far it's going ok in so far as the `.ismobile` method seems to be working well. Are we trying then the combination of `user_agent_var.ismobile = True` and

[Wikidata-bugs] [Maniphest] T336361: [Analytics] Identify access via mobile devices independent of tags

2023-08-10 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T336361 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: AndrewTavis_WMDE, Michael, Manuel, Aklapper, Danny_Benjafield_WMDE,

[Wikidata-bugs] [Maniphest] T336361: [Analytics] Identify access via mobile devices independent of tags

2023-08-10 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T336361 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: AndrewTavis_WMDE, Michael, Manuel, Aklapper, Danny_Benjafield_WMDE,

[Wikidata-bugs] [Maniphest] T336361: [Analytics] Identify access via mobile devices independent of tags

2023-08-10 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T336361 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: AndrewTavis_WMDE, Michael, Manuel, Aklapper, Danny_Benjafield_WMDE,

[Wikidata-bugs] [Maniphest] T336361: [Analytics] Identify access via mobile devices independent of tags

2023-08-10 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. @Manuel, just a note on using the `wmf.webrequest` table: now that I'm using Spark a bit more and can see the number of steps, it's definitely worth it to try to restrict the data based on the year and month as we're doing. Selecting 30 days over two months

[Wikidata-bugs] [Maniphest] T336361: [Analytics] Identify access via mobile devices independent of tags

2023-08-10 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T336361 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: AndrewTavis_WMDE, Michael, Manuel, Aklapper, Danny_Benjafield_WMDE,

[Wikidata-bugs] [Maniphest] T336361: [Analytics] Identify access via mobile devices independent of tags

2023-08-09 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T336361 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: AndrewTavis_WMDE, Michael, Manuel, Aklapper, Danny_Benjafield_WMDE,

[Wikidata-bugs] [Maniphest] T336361: [Analytics] Identify access via mobile devices independent of tags

2023-08-09 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T336361 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: AndrewTavis_WMDE, Michael, Manuel, Aklapper, Danny_Benjafield_WMDE,

[Wikidata-bugs] [Maniphest] T336361: [Analytics] Identify access via mobile devices independent of tags

2023-08-09 Thread Manuel
Manuel added a comment. That was very helpful, thank you, @Michael! TASK DETAIL https://phabricator.wikimedia.org/T336361 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE, Manuel Cc: AndrewTavis_WMDE, Michael, Manuel, Aklapper,

[Wikidata-bugs] [Maniphest] T336361: [Analytics] Identify access via mobile devices independent of tags

2023-08-09 Thread Michael
Michael added a comment. > How do we deal with API consumers that disguise themselves as browsers? I'm not fully sure if that is true across the board, but from a quick look, it seems that API requests from the browser seem to usually have a referrer header set. Also, they usually have

[Wikidata-bugs] [Maniphest] T336361: [Analytics] Identify access via mobile devices independent of tags

2023-08-09 Thread Manuel
Manuel updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T336361 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE, Manuel Cc: AndrewTavis_WMDE, Michael, Manuel, Aklapper, Danny_Benjafield_WMDE,

[Wikidata-bugs] [Maniphest] T336361: [Analytics] Identify access via mobile devices independent of tags

2023-08-09 Thread Manuel
Manuel updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T336361 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE, Manuel Cc: AndrewTavis_WMDE, Michael, Manuel, Aklapper, Danny_Benjafield_WMDE,

[Wikidata-bugs] [Maniphest] T336361: [Analytics] Identify access via mobile devices independent of tags

2023-08-09 Thread Manuel
Manuel updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T336361 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE, Manuel Cc: AndrewTavis_WMDE, Michael, Manuel, Aklapper, Danny_Benjafield_WMDE,

[Wikidata-bugs] [Maniphest] T336361: [Analytics] Identify access via mobile devices independent of tags

2023-08-09 Thread Manuel
Manuel updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T336361 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE, Manuel Cc: AndrewTavis_WMDE, Michael, Manuel, Aklapper, Danny_Benjafield_WMDE,

[Wikidata-bugs] [Maniphest] T336361: [Analytics] Identify access via mobile devices independent of tags

2023-08-09 Thread Manuel
Manuel renamed this task from "[Analytics] Identify access via mobile phones independent of tags " to "[Analytics] Identify access via mobile devices independent of tags ". Manuel updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T336361 EMAIL PREFERENCES