Marostegui added a comment.
That is fine by me - let's leave ruwiki aside for now while we finish purging up its recentchanges table (T12) on all the pending hosts.
Please keep giving us a heads up on the irc channel before you enable it on those new wikis.
Thanks!TASK
Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-10-19T05:46:43Z] Optimize recentchanges, pagelinks and templatelinks on db1102 for s6 - T174509 T12TASK DETAILhttps://phabricator.wikimedia.org/T12EMAIL
Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-10-19T05:45:12Z] Optimize recentchanges, pagelinks and templatelinks on db1064 - T174509 T12TASK DETAILhttps://phabricator.wikimedia.org/T12EMAIL
Shizhao added a project: Chinese-Sites.
TASK DETAILhttps://phabricator.wikimedia.org/T178515EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, ShizhaoCc: jcrespo, Marostegui, Cosine02, jeblad, Aklapper, hoo, GoranSMilovanovic, QZanden, Minhnv-2809,
Jdforrester-WMF added a subtask: T178538: Bump PHP requirement to 5.6 in 1.31.
TASK DETAILhttps://phabricator.wikimedia.org/T170281EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jdforrester-WMFCc: Ricordisamoa, PokestarFan, thiemowmde, Reedy,
abian added a comment.
In T138371#3689998, @Zeko wrote:
Quick but non trivial question here: I am considering using external libraries for some things, as I intend to release the plugin under a GPL, can somebody tell me what kind of problems can we have if I use libraries as bootstrap??
"MIT
Smalyshev created this task.Smalyshev added a project: Wikidata-Query-Service.Herald added a subscriber: Aklapper.Herald added projects: Wikidata, Discovery.
TASK DESCRIPTIONLooking at nginx log in logstash, I notice that it does not have any entries with status 429, while other error statuses
jmatazzoni edited projects, added Collaboration-Team-Triage; removed Collaboration-Team-Triage (Collab-Team-Q2-Oct-Dec-2017).
TASK DETAILhttps://phabricator.wikimedia.org/T176515EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: jmatazzoniCc: Petar.petkovic,
Smalyshev added a project: User-Smalyshev.
TASK DETAILhttps://phabricator.wikimedia.org/T178530EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: dcausse, Gehel, EBernhardson, Aklapper, Smalyshev, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden,
Smalyshev added a comment.
In this case, if I understand correctly, we need something like:
Yes, that sounds correct.TASK DETAILhttps://phabricator.wikimedia.org/T175948EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: gerritbot, Gehel, Aklapper,
EBernhardson added a project: Wikimedia-Logstash.
TASK DETAILhttps://phabricator.wikimedia.org/T178530EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: EBernhardsonCc: dcausse, Gehel, EBernhardson, Aklapper, Smalyshev, Lucas_Werkmeister_WMDE, GoranSMilovanovic,
Smalyshev claimed this task.Smalyshev added a project: User-Smalyshev.
TASK DETAILhttps://phabricator.wikimedia.org/T178211EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Caliuser, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic,
EBernhardson added a comment.
There might be other opinions, but i think hard coding specific fields to specific types in the logstash config is reasonable as long as it's documented. The primary problem we run into is that without coordination different types can be sent to fields by different
Smalyshev added a comment.
Hmm I think GUI should be Apache, as it does not rely directly on any GPL code AFAIK. And main docs in WDQS repo says so. I'm not sure why the code has GPL tags, maybe some confusion. My preference is to take it to Apache, but if it's for some reason is impossible, GPL I
Smalyshev closed this task as "Resolved".Smalyshev claimed this task.
TASK DETAILhttps://phabricator.wikimedia.org/T178315EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Gehel, gerritbot, Smalyshev, Framawiki, Donglixp, Aklapper, Gq86, Lordiis,
Smalyshev added a comment.
My checks show that request_time and upstream_time only used by nginx, but response_size is also used by webrequest. While it is used in the same meaning, I wonder if changing the type won't disrupt anything. response_size is less important for me than the rest, so if it
Smalyshev added a project: Wikidata-Query-Service.Smalyshev added subscribers: EBernhardson, Gehel, dcausse.Herald added projects: Wikidata, Discovery.
TASK DETAILhttps://phabricator.wikimedia.org/T178530EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To:
Smalyshev added a subscriber: mobrovac.Smalyshev added a comment.
I am not familiar with the details of dependent services (would be nice to document it somewhere? or point me to the place where it is already documented :) but in general unless you need an instant response, 429 should not be a
hoo removed a project: Patch-For-Review.hoo added a comment.
We're already at 6,213,948 statement usages on cawiki (this is a lot).
The number of usages is still growing strong there, but it seems to be within sane bounds.TASK DETAILhttps://phabricator.wikimedia.org/T151717EMAIL
hoo added subscribers: Marostegui, jcrespo.hoo added a project: DBA.
TASK DETAILhttps://phabricator.wikimedia.org/T178515EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: jcrespo, Marostegui, Cosine02, jeblad, Aklapper, hoo, GoranSMilovanovic, QZanden,
hoo updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...[x] Evaluate statistics from T177155data from T177155
[] Remove `'D'` from `$wgWBClientSettings['disabledUsageAspects']` on a few more wikis (T178515)
[] Remove `'D'` from `$wgWBClientSettings['disabledUsageAspects']`
hoo updated the task description. (Show Details)Herald added subscribers: jeblad, Cosine02.
CHANGES TO TASK DESCRIPTION...* `dewiki`
* `hewiki`
* `lvwiki`
* `mediawikiwiki`
* `metawiki`
* `nnwiki`
* `nowiki`
* `ruwikinews`
* ``* `zhwiki`
Also I suggest `ruwiki`: It has so many usages that there
hoo created this task.hoo added projects: Wikidata, MediaWiki-extensions-WikibaseClient.Herald added a subscriber: Aklapper.
TASK DESCRIPTIONI suggest to also enable description usage tracking on further wikis. Currently we don't have a single description usage, even though the usage type is
hoo created subtask T178515: Enable description usage tracking on further wikis.
TASK DETAILhttps://phabricator.wikimedia.org/T106287EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: thiemowmde, gerritbot, eranroz, PokestarFan, jmadler, hoo, daniel,
chelsyx claimed this task.chelsyx edited projects, added Discovery-Analysis (Current work); removed Discovery-Analysis.
TASK DETAILhttps://phabricator.wikimedia.org/T177353EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: chelsyxCc: Aklapper, mpopov, chelsyx,
hoo updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...[x] https://gerrit.wikimedia.org/r/384592TASK DETAILhttps://phabricator.wikimedia.org/T151717EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Marostegui, Bawolff, eranroz,
debt added a parent task: Restricted Task.
TASK DETAILhttps://phabricator.wikimedia.org/T178491EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Gehel, debtCc: gerritbot, Smalyshev, Gehel, Aklapper, Gq86, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic,
debt triaged this task as "High" priority.
TASK DETAILhttps://phabricator.wikimedia.org/T178491EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Gehel, debtCc: gerritbot, Smalyshev, Gehel, Aklapper, Gq86, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic,
gerritbot added a comment.
Change 384996 had a related patch set uploaded (by MarkTraceur; owner: MarkTraceur):
[mediawiki/extensions/WikibaseMediaInfo@master] [WIP] Add lookup services for title <--> ID
https://gerrit.wikimedia.org/r/384996TASK
Jonas added a comment.
My understanding is that the structured data on commons project will rely on WDQS for some of its functionalities. If we want that project to be stable, we need to address the WDQS stability issues.
In what form does it rely on it?
What I can say is that
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T178491EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Gehel, gerritbotCc: gerritbot, Smalyshev, Gehel, Aklapper, Gq86, Lordiis, Lucas_Werkmeister_WMDE,
gerritbot added a comment.
Change 384986 had a related patch set uploaded (by Gehel; owner: Gehel):
[wikidata/query/rdf@master] Make throttling more aggressive
https://gerrit.wikimedia.org/r/384986TASK DETAILhttps://phabricator.wikimedia.org/T178491EMAIL
Gehel created this task.Gehel added projects: Wikidata-Query-Service, Discovery-Wikidata-Query-Service-Sprint, Structured-Data-Commons.Herald added a subscriber: Aklapper.Herald added projects: Wikidata, Discovery.
TASK DESCRIPTIONWDQS is by design a fragile service. We allow arbitrary users to
matthiasmullie removed a project: Easy.
TASK DETAILhttps://phabricator.wikimedia.org/T178447EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matthiasmullieCc: Aklapper, MBinder_WMF, Cparle, MarkTraceur, Ramsey-WMF, TerraCodes, E1presidente, Jmmuguerza,
Gehel created this task.Gehel added projects: Wikidata-Query-Service, Discovery-Wikidata-Query-Service-Sprint, Operations, Wikimedia-Incident.Herald added a subscriber: Aklapper.Herald added projects: Wikidata, Discovery.
TASK DESCRIPTIONA recent incident on WDQS show that our throttling is not
Gehel added a comment.
I'm not sure why we have a retry in the first place. An exponential back-off would be good, or to honor the "Retry-After" HTTP header sent by WDQS on 429 errors.TASK DETAILhttps://phabricator.wikimedia.org/T178445EMAIL
Zeko added a comment.
F10293586: image.png
Created a setup page and added a list with a tag list (please ignore the tag names), in each one its possible to add a wiki id manually (won't be saved yet) or just press the "search" button that later on will call a _javascript_ function that will open
The idea with .tab is to treat it like a blob from wikibase perspective,
just like an image. There was some discussion on importing it into wdqs,
but that hasn't progressed much.
The headers use nonlocalizable ids, Latin chars only, digits, underscores.
But it supports titles--localized names for
SandraF_WMF raised the priority of this task from "Low" to "Normal".SandraF_WMF added a comment.
I'd say it's normal priority. Will probably not be solved in one quarter though.TASK DETAILhttps://phabricator.wikimedia.org/T178187EMAIL
I like the idea of storing tables in Commons, but for now I am still
using Wikidata to store the lists I upload, because:
* tabular data is not integrated with WDQS as far as I know
* the tabular data format is quite poor compared to things like
https://www.w3.org/TR/tabular-metadata/
* it is not
On Wed, Oct 18, 2017 at 12:50 PM, Yuri Astrakhan
wrote:
>
>> when you say "wikidata is not well suited for lists data", you refer
>> to wikibase or WDQS here?
>
>
> Wikibase, per Daniel K.
>>
>>
>> the data:Bea.gov/GDP by state.tab above is certainly a good
>>
> when you say "wikidata is not well suited for lists data", you refer
> to wikibase or WDQS here?
>
Wikibase, per Daniel K.
>
> the data:Bea.gov/GDP by state.tab above is certainly a good
> representation for efficient delivery (via json) and display of data.
> but inefficient for further
when you say "wikidata is not well suited for lists data", you refer
to wikibase or WDQS here?
the data:Bea.gov/GDP by state.tab above is certainly a good
representation for efficient delivery (via json) and display of data.
but inefficient for further data sharing without URIs.
On Tue, Oct
Hjfocs created this task.Hjfocs added projects: Wikidata-primary-sources, Wikidata.Herald added a subscriber: Aklapper.
TASK DESCRIPTIONTASK DETAILhttps://phabricator.wikimedia.org/T178476EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: HjfocsCc: Aklapper,
Hjfocs closed this task as "Resolved".Hjfocs moved this task from Doing to Done on the Wikidata-primary-sources board.Hjfocs added a comment.
Standalone module based on WDQS release 0.2.5: https://github.com/marfox/pst-backend ;
WDQS fork that integrates the above repo as a submodule:
mobrovac added subscribers: Volans, Joe.mobrovac added a comment.
The amount of requests from the Recommendation API service actually makes sense. On each service checker script run, 3 requests are sent to WDQS from the service. Accounting for the number of hosts and frequency of the checks, we
Qgil triaged this task as "Normal" priority.Qgil added a comment.
(Assuming Normal priority, please correct if this is wrong.)TASK DETAILhttps://phabricator.wikimedia.org/T178144EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Slaporte, QgilCc: Qgil,
Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-10-18T08:41:48Z] Synchronized wmf-config/InitialiseSettings.php: Re-enable Statement usage tracking on cawiki (T151717) (duration: 00m 50s)TASK DETAILhttps://phabricator.wikimedia.org/T151717EMAIL
gerritbot added a comment.
Change 384592 merged by jenkins-bot:
[operations/mediawiki-config@master] Re-enable Statement usage tracking on cawiki
https://gerrit.wikimedia.org/r/384592TASK DETAILhttps://phabricator.wikimedia.org/T151717EMAIL
hoo closed this task as "Resolved".hoo removed a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T177155EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Stashbot, gerritbot, Marostegui, Aklapper, jcrespo, revi, hoo,
hoo closed subtask T177155: Find test wiki(s) for new description usage and enable there as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T106287EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: thiemowmde, gerritbot, eranroz, PokestarFan,
hoo updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...[x] Remove `'D'` from `$wgWBClientSettings['disabledUsageAspects']` test-wise on a few wikis (all small wikis, `elwiki`, …) (T177155)
[] Evaluate statistics from T177155
[] Remove `'D'` from
Gehel added a comment.
Looking at logs in logstash, it seems we throttled Recommendation API only when WDQS was overwhelmed by another user. Throttling is done on overall request time and the service was most probably already not responding correctly, or in a reasonable time.
My understanding at
Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-10-18T08:09:34Z] Synchronized wmf-config/InitialiseSettings.php: Enable description usage tracking on a few test wikis (T177155) (duration: 00m 50s)TASK DETAILhttps://phabricator.wikimedia.org/T177155EMAIL
gerritbot added a comment.
Change 384003 merged by jenkins-bot:
[operations/mediawiki-config@master] Enable description usage tracking on a few test wikis
https://gerrit.wikimedia.org/r/384003TASK DETAILhttps://phabricator.wikimedia.org/T177155EMAIL
Zeko created this task.Zeko added projects: Wikimania-Hackathon-2016, Wikidata.
TASK DESCRIPTION
To add a list of the tags of the blog in the plugin setup page
Add a form to each tag in that setup page in which the user can add manually a wikidata ID
Develop a _javascript_ function to
Zeko created subtask T178455: Disambiguation for Wikidata search from tags terms in wordpress.
TASK DETAILhttps://phabricator.wikimedia.org/T138371EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ZekoCc: Philipjohn21, Liuxinyu970226, Samwilson, Mbch331,
mobrovac added a comment.
In T178445#3692895, @Smalyshev wrote:
@mobrovac what's the rate the requests are currently sent at? IIRC the limits we have are pretty generous, but depends on the use case of course.
This is the part that I don't understand - the rate of the public end point is 0,
Zeko claimed this task.
TASK DETAILhttps://phabricator.wikimedia.org/T138371EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ZekoCc: Philipjohn21, Liuxinyu970226, Samwilson, Mbch331, Framawiki, DanBri, Esh77, Lydia_Pintscher, abian, Tramullas, Zeko, Aklapper,
Zeko added a comment.
Include a field on the term edit screen (e.g. Posts > Tags > [Tag] > Edit). There is a term meta API for this in WordPress (see add_term_meta())
This is really nice to know and will save a lot of work =)
My feeling is that many site owners would find that to be undesirable
Gehel added a comment.
@mobrovac it is possible if we can identify internal traffic. The throttling we apply is bucketed by user agent / IP, so I suspect that all the recommendation API traffic end up in the same bucket.
We could add an exception for specific user agent. Or have Recommendation
Smalyshev added a comment.
@mborovac what's the rate the requests are currently sent at? IIRC the limits we have are pretty generous, but depends on the use case of course.TASK DETAILhttps://phabricator.wikimedia.org/T178445EMAIL
mobrovac added subscribers: Gehel, Smalyshev, mobrovac.mobrovac edited projects, added Services (watching), Recommendation-API, Wikidata-Query-Service; removed Services.mobrovac added a comment.Herald added projects: Wikidata, Discovery.
The 429 coming from WDQS. @Gehel, @Smalyshev would it be
hoo updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTIONWe should only track an all usage for an entity table loaded via [[ https://www.mediawiki.org/wiki/Extension:Wikibase_Client/Lua#mw.wikibase.getEntity | `mw.wikibase.getEntity` ]], if the data on it is actually used. This
ReleaseTaggerBot added a project: MW-1.31-release-notes (WMF-deploy-2017-10-24 (1.31.0-wmf.5)).
TASK DETAILhttps://phabricator.wikimedia.org/T178153EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, ReleaseTaggerBotCc: gerritbot, Lydia_Pintscher, hoo,
hoo closed this task as "Resolved".hoo removed a project: Patch-For-Review.hoo moved this task from Review to Done on the Wikidata-Sprint board.
TASK DETAILhttps://phabricator.wikimedia.org/T178153WORKBOARDhttps://phabricator.wikimedia.org/project/board/2351/EMAIL
hoo closed subtask T178153: make disabledUsageAspects coarse graining as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T49288EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: PokestarFan, DixonD, Aklapper, Bianjiang, aude, jeremyb, liangent,
Philipjohn21 removed Zeko as the assignee of this task.Philipjohn21 added a comment.
Ah yes I see what you mean :)
F10288642: Screenshot_20171018-071334.png
Scrap that idea then... I think the field on the term edit page with an ajax search is a good idea.
I'm not sure we can avoid the manual
68 matches
Mail list logo