AndrewTavis_WMDE added a comment.
Here are the answers to the three questions we had from the daily, @Manuel:
`uri_host LIKE 'wikidata'` as mentioned above:
| uri_host |
| -------------------------- |
| test.m.wikidata.org |
| query-preview.wikidata.org |
| m.wikidata.org |
| www.m.wikidata.org |
| query.wikidata.org |
| test.wikidata.org |
| www.wikidata.org |
| wikidata.org |
|
Results for the following:
SELECT
DISTINCT agent_type AS agent_type
FROM
wmf.webrequest
WHERE
year = 2023
AND month = 7
AND '2023-07-25' <= dt
AND dt < '2023-08-01'
| agent_type |
| ---------- |
| spider |
| user |
|
And `os_family`/`device_family` results for `agent_type = 'spider'` via the
following query:
SELECT
user_agent_map.os_family AS os_family,
user_agent_map.device_family AS device_family,
COUNT(*) AS total_requests,
ROUND(COUNT(*) / CAST( SUM(COUNT(*)) OVER () AS float) * 100, 4) AS
percent_total
FROM
wmf.webrequest
WHERE
uri_host IN ('www.wikidata.org', 'm.wikidata.org')
AND agent_type = 'spider'
GROUP BY
os_family,
device_family
ORDER BY
total_requests DESC
| os_family | device_family | total_requests | percent_total |
| --------- | -------------------- | -------------- | ------------- |
| Other | Spider | 139680267 | 47.6981 |
| Other | Other | 132010385 | 45.079 |
| Android | Spider | 10371644 | 3.5417 |
| Android | Generic Smartphone | 7175211 | 2.4502 |
| Other | Generic Feature P... | 2658042 | 0.9077 |
| Mac OS X | Mac | 450696 | 0.1539 |
| iOS | Spider | 155612 | 0.0531 |
| Linux | Other | 101342 | 0.0346 |
| Android | Samsung SM-G930V | 84047 | 0.0287 |
| Windows | Spider | 72628 | 0.0248 |
| Linux | Spider | 45399 | 0.0155 |
| Windows | Other | 14062 | 0.0048 |
| Other | Mac | 8591 | 0.0029 |
| iOS | iPhone | 5062 | 0.0017 |
| Gentoo | Spider | 1234 | 4.0E-4 |
| Android | XIG02 | 737 | 3.0E-4 |
| iOS | iPad | 680 | 2.0E-4 |
| Android | Samsung SM-G570F | 533 | 2.0E-4 |
| - | - | 471 | 2.0E-4 |
| Android | SC-53C | 148 | 1.0E-4 |
|
All things considered, I think we're good to do `agent_type != 'spider'` :)
TASK DETAIL
https://phabricator.wikimedia.org/T336361
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: AndrewTavis_WMDE
Cc: AndrewTavis_WMDE, Michael, Manuel, Aklapper, Danny_Benjafield_WMDE,
Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz,
Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen,
rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331
_______________________________________________
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
