[Wikidata-bugs] [Maniphest] [Triaged] T230051: wikidata.org handles GET MWAPI requests, but silently fails on POST

2019-08-08 Thread mobrovac
mobrovac edited projects, added Core Platform Team Workboards (Clinic Duty 
Team); removed Core Platform Team.
mobrovac triaged this task as "Normal" priority.

TASK DETAIL
  https://phabricator.wikimedia.org/T230051

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: mobrovac
Cc: Aklapper, Anomie, Yurik, darthmon_wmde, WDoranWMF, Legado_Shulgin, 
DannyS712, Nandana, thifranc, AndyTan, Davinaclare77, Qtn1293, Techguru.pc, 
Lahi, Gq86, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, LawExplorer, 
Sethakill, Zppix, dg711, _jensen, rosalieper, Jonas, Wong128hk, mobrovac, 
Wikidata-bugs, aude, jayvdb, Lydia_Pintscher, faidon, Mbch331, Jay8g, 
fgiunchedi, Legoktm, holger.knust, EvanProdromou, Agabi10, Pchelolo
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T220402: Introduce wikidata termbox SSR to kubernetes

2019-05-27 Thread mobrovac
mobrovac added a comment.


  In T220402#5199730 <https://phabricator.wikimedia.org/T220402#5199730>, 
@Tarrow wrote:
  
  > Should we be using http rather than https internally?
  
  
  Yes, indeed, sorry that was an omission on my part. Since setting up TLS 
connections takes time, though, you also want to keep these connections alive. 
You can do so by explicitly adding this agent option to the request template:
  
uri: https://appservers-ro.discovery.wmnet/{+path}
headers:
  Host: '{req.params.domain}'
agentOptions:
  keepAlive: true
  
  
  
  > I also wanted to check if we should be using `appservers.discovery.wmnet` 
as the host; I'm not sure if I read things right but I didn't think this host 
is defined? Or should we aiming for `appservers-ro.discovery.wmnet` (since we 
are not writing)? I then saw https://phabricator.wikimedia.org/T199219#4452041 
and was wondering if that is indeed the right place or if it is oddly slow/not 
cached.
  
  Yup, +1, use `appservers-ro` here, in that case. The end point itself is 
synonymous with `appservers-rw` for now, but once we start splitting MW traffic 
based on reads/writes, this will mean that your requests will always land in 
the local DC, both giving it a speed-up and decreasing the load from the master 
appservers, resulting in a net win for everybody :)
  
  > In general is there a place on wikitech (or similar) we should be looking 
to make sure we're getting things right?
  
  Not that I'm aware of :/

TASK DETAIL
  https://phabricator.wikimedia.org/T220402

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: mobrovac
Cc: Krenair, fsero, mobrovac, Matthias_Geisler_WMDE, Pablo-WMDE, Dzahn, 
Addshore, Tarrow, Lea_WMDE, WMDE-leszek, Jakob_WMDE, Aklapper, akosiaris, 
E.S.A-Sheild, darthmon_wmde, Premeditated, joker88john, Legado_Shulgin, 
CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, 
Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, 
Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, 
Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, LawExplorer, WSH1906, 
Lewizho99, Zppix, Maathavan, _jensen, rosalieper, Liudvikas, Wong128hk, Eevans, 
thcipriani, Hardikj, Wikidata-bugs, aude, Lydia_Pintscher, dduvall, faidon, 
Jdforrester-WMF, Mbch331, Jay8g, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T220402: Introduce wikidata termbox SSR to kubernetes

2019-05-16 Thread mobrovac
mobrovac added a comment.


  @Pablo-WMDE all you have to do is have the request be of this form:
  
URI: http://appservers.discovery.wmnet/{+your_path_here}
headers:
  Host: www.wikidata.org
  
  The curl you are trying does not work because you are executing it outside 
the production environment and then Varnish strips out the `Host` header. All 
of the services work this way in prod, cf. e.g. the MCS config for making 
requests to MediaWiki 
<https://github.com/wikimedia/mediawiki-services-mobileapps-deploy/blob/b8f04dae92dd819222dc429d9cc64b285915e1bc/scap/templates/config.yaml.j2#L80>.

TASK DETAIL
  https://phabricator.wikimedia.org/T220402

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: mobrovac
Cc: Krenair, fsero, mobrovac, Matthias_Geisler_WMDE, Pablo-WMDE, Dzahn, 
Addshore, Tarrow, Lea_WMDE, WMDE-leszek, Jakob_WMDE, Aklapper, akosiaris, 
E.S.A-Sheild, darthmon_wmde, alaa_wmde, joker88john, Legado_Shulgin, CucyNoiD, 
Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, 
Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, 
Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, 
Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, LawExplorer, WSH1906, 
Lewizho99, Zppix, Maathavan, _jensen, rosalieper, Liudvikas, Wong128hk, Eevans, 
thcipriani, Hardikj, Wikidata-bugs, aude, Lydia_Pintscher, dduvall, faidon, 
Jdforrester-WMF, Mbch331, Jay8g, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T220402: Introduce wikidata termbox SSR to kubernetes

2019-04-30 Thread mobrovac
mobrovac added a comment.


  In T220402#5146064 <https://phabricator.wikimedia.org/T220402#5146064>, 
@Pablo-WMDE wrote:
  
  > @mobrovac During T221755 <https://phabricator.wikimedia.org/T221755> & 
T221754 <https://phabricator.wikimedia.org/T221754> we tended to `/?spec` 
<https://ssr-termbox.wmflabs.org/?spec> and `/_info` 
<https://ssr-termbox.wmflabs.org/_info> - could you please take a look?
  
  
  Yup, lookin' good! Now service-checker can get the spec. The next step is to 
define (a) whether a specific end point should be tested; and (b) if so, what 
are the request/response pairs that it ought to send/expect.
  
  For the former, each end point + method combo should have an `x-monitor` 
stanza that is set to `true` or `false` (whether to test the end point + method 
combo or not). If this stanza is not present, service-checker assumes its value 
to be `true`. For the latter, if `x-monitor: true`, then you need an additional 
stanza - `x-amples`. It is an array of objects, consisting of `request` and 
`response` properties that define the request to be sent and the response that 
is expected back. Both properties are objects themselves that can have the 
`uri`, `headers` and `body` properties, depending on the request.
  
  Here are some examples of its usage to get you an idea of how this works in 
practice: RESTBase 
<https://github.com/wikimedia/restbase/blob/bd2f9de08cbe6d999ac6678282dd5d8f5fc99594/v1/mobileapps.yaml#L96-L109>,
 Mathoid 
<https://github.com/wikimedia/mathoid/blob/1107c4c5b42eafb0464e33b175e8097cf928e07c/spec.yaml#L119-L197>,
 MCS 
<https://github.com/wikimedia/mediawiki-services-mobileapps/blob/8bcdae5618e98b4d9d20497ecee3604e9a4bdddb/spec.yaml#L207-L220>,
 Citoid 
<https://github.com/wikimedia/citoid/blob/063afebb6304d7cc3125dbdc0b1fec1c0f49f029/spec.yaml#L99-L145>.

TASK DETAIL
  https://phabricator.wikimedia.org/T220402

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: mobrovac
Cc: fsero, mobrovac, Matthias_Geisler_WMDE, Pablo-WMDE, Dzahn, Addshore, 
Tarrow, Lea_WMDE, WMDE-leszek, Jakob_WMDE, Aklapper, akosiaris, alaa_wmde, 
joker88john, Legado_Shulgin, CucyNoiD, Nandana, NebulousIris, thifranc, 
AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, 
Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, 
Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, 
QZanden, LawExplorer, WSH1906, Lewizho99, Zppix, Maathavan, _jensen, 
rosalieper, Liudvikas, Wong128hk, Eevans, thcipriani, Hardikj, Wikidata-bugs, 
aude, Lydia_Pintscher, dduvall, faidon, Jdforrester-WMF, Mbch331, Jay8g, 
fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T220402: Introduce wikidata termbox SSR to kubernetes

2019-04-24 Thread mobrovac
mobrovac added a comment.


  In T220402#5136129 <https://phabricator.wikimedia.org/T220402#5136129>, 
@Tarrow wrote:
  
  > We are indeed using service-runner; I don't think this provides /_info or 
/?spec though? Or are we missing something?
  
  
  Ah, indeed, sorry, it does not :) I meant service template 
<https://github.com/wikimedia/service-template-node>. If you base the service 
on that, you get the standard testing end points.

TASK DETAIL
  https://phabricator.wikimedia.org/T220402

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: mobrovac
Cc: mobrovac, Matthias_Geisler_WMDE, Pablo-WMDE, Dzahn, Addshore, Tarrow, 
Lea_WMDE, WMDE-leszek, Jakob_WMDE, Aklapper, akosiaris, alaa_wmde, joker88john, 
Legado_Shulgin, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, 
Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, 
Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, 
GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, 
LawExplorer, WSH1906, Lewizho99, Zppix, Maathavan, _jensen, rosalieper, 
Liudvikas, Wong128hk, Eevans, thcipriani, Hardikj, Wikidata-bugs, aude, 
Lydia_Pintscher, dduvall, faidon, Jdforrester-WMF, Mbch331, Jay8g, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T220402: Introduce wikidata termbox SSR to kubernetes

2019-04-24 Thread mobrovac
mobrovac added a comment.


  In T220402#5133994 <https://phabricator.wikimedia.org/T220402#5133994>, 
@akosiaris wrote:
  
  > @Tarrow, @WMDE-leszek. I 've been working on the termbox helm chart and 
while the service seems to be up and running, I see no `/_info` endpoint nor a 
swagger/openapi[1] spec published under `/?spec`. Both are crucial for 
deploying, as the former is used as a kubernetes readiness probe (aka if an 
instance of the app can't serve that for any reason it will temporarily not see 
new traffic) and the latter is used by our monitoring, so we can't proceed 
without those. Could you please have a look at it and add them? Thanks!
  >
  > [1] https://swagger.io/docs/specification/about/
  
  
  Hmmm, is the service using service-runner 
<https://www.npmjs.com/package/service-runner>? We've kind of standardised on 
that and it would good to follow that practice here as well.

TASK DETAIL
  https://phabricator.wikimedia.org/T220402

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: mobrovac
Cc: mobrovac, Matthias_Geisler_WMDE, Pablo-WMDE, Dzahn, Addshore, Tarrow, 
Lea_WMDE, WMDE-leszek, Jakob_WMDE, Aklapper, akosiaris, alaa_wmde, joker88john, 
Legado_Shulgin, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, 
Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, 
Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, 
GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, 
LawExplorer, WSH1906, Lewizho99, Zppix, Maathavan, _jensen, rosalieper, 
Liudvikas, Wong128hk, Eevans, thcipriani, Hardikj, Wikidata-bugs, aude, 
Lydia_Pintscher, dduvall, faidon, Jdforrester-WMF, Mbch331, Jay8g, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T215339: No jobs running on beta cluster

2019-04-19 Thread mobrovac
mobrovac edited projects, added Services (done), serviceops; removed 
Patch-For-Review, Services (next).

TASK DETAIL
  https://phabricator.wikimedia.org/T215339

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Joe, mobrovac
Cc: mobrovac, DannyS712, kostajh, jijiki, Ramsey-WMF, Krenair, Cparle, Joe, 
Stashbot, Aklapper, MarcoAurelio, Samwilson, Pchelolo, EBernhardson, alaa_wmde, 
Nandana, JKSTNK, Jony, Lahi, PDrouin-WMF, Gq86, E1presidente, Anooprao, 
SandraF_WMF, Bsandipan, GoranSMilovanovic, QZanden, Tramullas, Acer, 
LawExplorer, Silverfish, _jensen, rosalieper, Susannaanas, Eevans, Jane023, 
Hardikj, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Wesalius, 
Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Rxy, Jay8g, 
Dzahn, joker88john, CucyNoiD, NebulousIris, Gaboe420, Versusxo, 
Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, 
Darkminds3113, Lordiis, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, WSH1906, 
Lewizho99, Maathavan
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T215339: No jobs running on beta cluster

2019-04-19 Thread mobrovac
mobrovac added a comment.


  In T215339#5125634 <https://phabricator.wikimedia.org/T215339#5125634>, 
@DannyS712 wrote:
  
  > @Joe I just tried to send a mass message on the beta cluster, and the 
message was "queued" but isn't actually being delivered. Is that part of this 
task?
  
  
  I see you submitted a job and it got executed successfully:
  
MassMessageSubmitJob User:DannyS712/mms 
class=MediaWiki\MassMessage\MassMessageJob 
data={"comment":["DannyS712","enwiki","https://en.wikipedia.beta.wmflabs.org/w/index.php?title=User:DannyS712/mms\u0026oldid=391772"],"message":"hello","originWiki":"enwiki","spamlist":"User:DannyS712/mms","subject":"Testing","userId":32948}
 namespace=2 pages=[{"site":"en.wikipedia.beta.wmflabs.org","title":"User 
talk:DannyS712 test2","wiki":"enwiki"}] requestId=XLn4qawQBHcAABRZT90AAABB 
title=DannyS712/mms
  
  So perhaps something else in Beta is not working if you don't see the 
delivery being done?

TASK DETAIL
  https://phabricator.wikimedia.org/T215339

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Joe, mobrovac
Cc: mobrovac, DannyS712, kostajh, jijiki, Ramsey-WMF, Krenair, Cparle, Joe, 
Stashbot, Aklapper, MarcoAurelio, Samwilson, Pchelolo, EBernhardson, alaa_wmde, 
joker88john, CucyNoiD, Nandana, NebulousIris, JKSTNK, Gaboe420, Versusxo, 
Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, PDrouin-WMF, Gq86, 
Baloch007, E1presidente, Darkminds3113, Anooprao, SandraF_WMF, Bsandipan, 
Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, 
Tramullas, Acer, LawExplorer, WSH1906, Lewizho99, Maathavan, Silverfish, 
_jensen, rosalieper, Susannaanas, Eevans, Jane023, Hardikj, Wikidata-bugs, 
Base, matthiasmullie, aude, Ricordisamoa, Wesalius, Lydia_Pintscher, 
Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Rxy, Jay8g
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T221295: Wikidata changes doesn't appear in recent changes

2019-04-19 Thread mobrovac
mobrovac added a comment.


  In T221295#5123775 <https://phabricator.wikimedia.org/T221295#5123775>, 
@eranroz wrote:
  
  > seems to happen again - no updates from Wikidata in the last 30 minutes in 
enwiki
  
  
  
  
  In T221295#5125065 <https://phabricator.wikimedia.org/T221295#5125065>, 
@Lydia_Pintscher wrote:
  
  > Any chance this is related to T221368 
<https://phabricator.wikimedia.org/T221368>?
  
  
  Yes, that was the reason why there were no jobs running during that period of 
time. We had a JobQueue outage 
<https://wikitech.wikimedia.org/wiki/Incident_documentation/20190417-Jobqueue> 
and had to stop job execution for approximately one hour while we were 
investigating/fixing the issue. Sorry about that.
  
  The core issues have since been fixed, so this should not happen again any 
time soon (fingers crossed!).

TASK DETAIL
  https://phabricator.wikimedia.org/T221295

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: mobrovac
Cc: mobrovac, Lydia_Pintscher, Nirmos, Aklapper, eranroz, alaa_wmde, Nandana, 
kostajh, Jony, Lahi, Gq86, GoranSMilovanovic, Jayprakash12345, QZanden, 
LawExplorer, _jensen, rosalieper, Taiwania_Justo, Jonas, Wong128hk, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T221315: Determine future of bare-metal hosting for services like WDQS, ElasticSearch, RESTBase Cassandra, etc.

2019-04-17 Thread mobrovac
mobrovac edited projects, added RESTBase, Services (designing), Core Platform 
Team Backlog (Designing); removed RESTBase-Cassandra.
mobrovac added a comment.


  What we originally discussed was basically to leave databases outside of the 
realm of k8s. So MariaDB, Postgres, Cassandra and friends would still stay on 
bare metal. We have also touched upon the question of whether the services that 
directly access these storage engines would stay there or not, and we opted for 
keeping them as-are for now. In the first phase of the move to k8s we would 
move only //stateless// services, but I can see us moving those directly using 
storage too in a while. Whether the storage engines themselves would ever be 
moved if up for discussion, but IMHO that's not what containers are for.

TASK DETAIL
  https://phabricator.wikimedia.org/T221315

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: mobrovac
Cc: mobrovac, Smalyshev, Jdforrester-WMF, Aklapper, alaa_wmde, Nandana, Lahi, 
Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Jonas, Xmlizer, Eevans, thcipriani, jkroll, 
Hardikj, Wikidata-bugs, Jdouglas, aude, Tobias1984, GWicke, Manybubbles, 
Gryllida, dduvall, Mbch331, Jay8g, Dzahn
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Unblock] T111231: Page previews for Wikidata

2019-04-12 Thread mobrovac
mobrovac closed subtask T190689: FY17/18 Q4 Program 7 Services Goal: Language 
variants support as Resolved.

TASK DETAIL
  https://phabricator.wikimedia.org/T111231

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: mobrovac
Cc: Niedzielski, RodrigoTavares, Salgo60, Jhernandez, WMDE-leszek, bearND, hoo, 
Vibhabamba, Jdforrester-WMF, Wikidata-bugs, JanZerebecki, Se4598, SamB, 
Raymond, Quiddity, pizzzacat, gerritbot, Bdjwiki, Trizek-WMF, Jakob_WMDE, 
Pablo-WMDE, Smalyshev, ovasileva, Lucas_Werkmeister_WMDE, Mholloway, 
Sjoerddebruin, Pchelolo, pmiazga, aude, Nirzar, Tbayer, CKoerner_WMF, Yurik, 
phuedx, Jdlrobson, Liuxinyu970226, Yair_rand, JKatzWMF, Ricordisamoa, Bene, 
Aklapper, Lydia_Pintscher, alaa_wmde, joker88john, CucyNoiD, Nandana, 
NebulousIris, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, 
Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, 
GoranSMilovanovic, Adik2382, Jayprakash12345, Th3d3v1ls, Ramalepe, Liugev6, 
QZanden, Zoranzoki21, LawExplorer, Winter, Lewizho99, Maathavan, DatGuy, 
Devwaker, Niklitov, _jensen, Urbanecm, rosalieper, Jdrewniak, JEumerus, 
Ananthsubray, Tulsi_Bhagat, Wong128hk, Luke081515, SimmeD, Snowolf, Dcljr, 
Shizhao, Matanya, Mbch331, Rxy, Jay8g, Krenair
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T220402: Introduce wikidata termbox SSR to kubernetes

2019-04-08 Thread mobrovac
mobrovac edited projects, added Services (watching), Core Platform Team Backlog 
(Watching / External); removed Core Platform Team, Services.

TASK DETAIL
  https://phabricator.wikimedia.org/T220402

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: mobrovac
Cc: Aklapper, akosiaris, alaa_wmde, Legado_Shulgin, Nandana, NebulousIris, 
thifranc, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, GoranSMilovanovic, 
Th3d3v1ls, Hfbn0, QZanden, LawExplorer, Zppix, _jensen, rosalieper, Liudvikas, 
Wong128hk, Eevans, thcipriani, mobrovac, Hardikj, Wikidata-bugs, aude, 
Lydia_Pintscher, dduvall, faidon, Jdforrester-WMF, Mbch331, Jay8g, fgiunchedi, 
Dzahn, EvanProdromou, Agabi10
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T214706: How to surface link changes as a stream?

2019-02-05 Thread mobrovac
mobrovac edited projects, added Core Platform Team Kanban (Blocked Externally); removed Core Platform Team Kanban (Doing).
TASK DETAILhttps://phabricator.wikimedia.org/T214706EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: EvanProdromou, Mvolz, Lydia_Pintscher, Addshore, gerritbot, Pchelolo, Nuria, mobrovac, Samwalton9, Ottomata, ssastry, Smalyshev, bearND, bmansurov, holger.knust, CucyNoiD, Nandana, NebulousIris, Akovalyov, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Avner, Lewizho99, Maathavan, _jensen, Agabi10, Eevans, JAllemandou, Jrf, Hardikj, Wikidata-bugs, aude, GWicke, Capt_Swing, Dinoguy1000, Arlolra, Jdforrester-WMF, Mbch331, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T214362: RFC: Store WikibaseQualityConstraint check data in persistent storage

2019-01-22 Thread mobrovac
mobrovac added projects: Services (designing), Core Platform Team Backlog (Designing).
TASK DETAILhttps://phabricator.wikimedia.org/T214362EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: Agabi10, Aklapper, Addshore, Nandana, kostajh, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, merbst, LawExplorer, _jensen, D3r1ck01, SBisson, Eevans, mobrovac, Hardikj, Wikidata-bugs, aude, GWicke, jayvdb, fbstj, santhosh, Jdforrester-WMF, Mbch331, Rxy, Jay8g, Ltrlg, bd808, Legoktm___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T214362: RFC: Store WikibaseQualityConstraint check data in persistent storage

2019-01-22 Thread mobrovac
mobrovac added a project: User-mobrovac.
TASK DETAILhttps://phabricator.wikimedia.org/T214362EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: Agabi10, Aklapper, Addshore, Nandana, kostajh, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, merbst, LawExplorer, _jensen, D3r1ck01, SBisson, mobrovac, Wikidata-bugs, aude, GWicke, jayvdb, fbstj, santhosh, Jdforrester-WMF, Mbch331, Rxy, Jay8g, Ltrlg, bd808, Legoktm___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T204024: Store WikibaseQualityConstraint check data in persistent storage instead of in the cache

2019-01-17 Thread mobrovac
mobrovac added a comment.

In T204024#4888623, @Addshore wrote:
will we store data only for the latest revision or not (implies different storage semantics and guarantees)

I agree with everything @Lucas_Werkmeister_WMDE said here, only store data for the latest revision.


Ok, that makes things much simpler.



how will we detect key/value pairs that need to be invalidated (possibly efficiently)

This invalidation logic is already contained within WikibaseQualityConstraints and currently used with memcached, checking if the stored value is still valid or rechecking and regenerating it.

That's a bit out of scope for the data placing strategy itself, but I think this point needs more discussion.



do we benefit from having a multi-DC storage solution for this

As in mirrored between the DCs and retrievable in both rather than either in the case of a DC switch over regenerating the data or for services operating in the passive DC retrieving from the active?

I'll just put some points here:


We don't want to have to regenerate this data if we switch DCs
WDQS will be calling the MW api to essentially retrieve this data after it is generated, and WDQS is in both DCs so shorter distance to the data would be better.


Ok, so that's a definitive yes.



There are probably more detailed questions that lurk there too. Given all of the above, yes, I think it would be good to have an RfC written up that explores these questions.

Should I write an #techcom-rfc for this in general to get the ball moving?

That would be a good starting point. Please put some background into the the task as well as the proposed data model and interactions of WD with the cache.TASK DETAILhttps://phabricator.wikimedia.org/T204024EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: Lydia_Pintscher, Pintoch, Tpt, Smalyshev, Eevans, daniel, mobrovac, Jonas, Lucas_Werkmeister_WMDE, Aklapper, Addshore, Legado_Shulgin, Nandana, thifranc, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, merbst, LawExplorer, Zppix, _jensen, Agabi10, Pchelolo, Wong128hk, Hardikj, Wikidata-bugs, aude, faidon, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T212189: New Service Request: Wikidata Termbox SSR

2018-12-20 Thread mobrovac
mobrovac added a comment.

In T212189#4837824, @daniel wrote:
That works, but defies the purpose. The idea is to present a default rendering to clients that don't have JS enabled (or no sufficiently current JS support). That rendering should be generated by the same vue.js code that does the rendering on the client.


But the same principle applies, regardless of whether the req is sent by the client or not. If index.php has all the data to render it, then that means that it can send it to the service directly without the need for the service to call MW back (now, whether the client will be used as a proxy is a different issue).

Clients that do have JS support will ask the API for different data (based on user language settings, for logged in users) and will re-render the term box based on that. No server side rendering required.

This confuses me. You first need to render the page on the server before you know whether the client supports JS/SW or not, so it will need to be rendered on the server irrespective of the client's capabilities in case where MW calls the service directly before handing out the page.TASK DETAILhttps://phabricator.wikimedia.org/T212189EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: akosiaris, Krinkle, Milimetric, daniel, mobrovac, Joe, Matthias_Geisler_WMDE, Jakob_WMDE, Pablo-WMDE, Aklapper, Lydia_Pintscher, Lea_WMDE, Addshore, WMDE-leszek, Legado_Shulgin, Nandana, thifranc, AndyTan, kostajh, Davinaclare77, Qtn1293, Lahi, Gq86, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, LawExplorer, Zppix, _jensen, D3r1ck01, SBisson, Wong128hk, Eevans, Hardikj, Wikidata-bugs, aude, GWicke, jayvdb, fbstj, faidon, santhosh, Jdforrester-WMF, Mbch331, Rxy, Jay8g, Ltrlg, bd808, fgiunchedi, Legoktm___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T212189: New Service Request: Wikidata Termbox SSR

2018-12-20 Thread mobrovac
mobrovac added a comment.

In T212189#4837768, @daniel wrote:
But for the case at hand, there might be a workaround: the PHP code that renders the (Wikibase Entity) page content already knows what data will be needed for the rendering. It can send it to the rendering service along with the request to render. The vue.js code would then need to have a "fake repo request" facility that would just use data that was passed in with the original request, and would fail (or at least warn) when trying to load any additional content by calling the actual MediaWiki API. I think that solution would still be fairly clean, and would perform better than calling back to the MediaWiki API all the time.


When rendering the page, index.php knows the exact data that needs to be rendered already, correct? If so, it can send that to the client, and then based on whether JS/SW is available or not, the client either renders it or sends a request to the service which sits behind Varnish. Or am I missing something.

Thinking further into the future, the dilemma could perhaps also be solved by separating MediaWiki's storage layout entirely from the application layer; this way PHP and JS code can use the same storage layer API for retrieving page content. But this is just a thought for the future - it woudl take a while, and I'm not even sure it's a good idea.

Somewhat OT for this task, but I would actually argue that the democratisation of the storage layer is a good thing, as it allows different entities to focus on wht they are supposed to achieve. Naturally, this implies the storage solution is scalable, secure, etc.TASK DETAILhttps://phabricator.wikimedia.org/T212189EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: akosiaris, Krinkle, Milimetric, daniel, mobrovac, Joe, Matthias_Geisler_WMDE, Jakob_WMDE, Pablo-WMDE, Aklapper, Lydia_Pintscher, Lea_WMDE, Addshore, WMDE-leszek, Legado_Shulgin, Nandana, thifranc, AndyTan, kostajh, Davinaclare77, Qtn1293, Lahi, Gq86, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, LawExplorer, Zppix, _jensen, D3r1ck01, SBisson, Wong128hk, Eevans, Hardikj, Wikidata-bugs, aude, GWicke, jayvdb, fbstj, faidon, santhosh, Jdforrester-WMF, Mbch331, Rxy, Jay8g, Ltrlg, bd808, fgiunchedi, Legoktm___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T166042: Put Wikibase Statements (and possibly other parts of entities) into restbase

2018-12-20 Thread mobrovac
mobrovac added a project: Core Platform Team Backlog (Designing).
TASK DETAILhttps://phabricator.wikimedia.org/T166042EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: thiemowmde, daniel, aude, Lydia_Pintscher, GWicke, Aklapper, hoo, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, D3r1ck01, Eevans, mobrovac, Hardikj, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T212189: New Service Request: Wikidata Termbox SSR

2018-12-20 Thread mobrovac
mobrovac edited projects, added Core Platform Team Backlog (Later); removed Core Platform Team Backlog (Next).
TASK DETAILhttps://phabricator.wikimedia.org/T212189EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: akosiaris, Krinkle, Milimetric, daniel, mobrovac, Joe, Matthias_Geisler_WMDE, Jakob_WMDE, Pablo-WMDE, Aklapper, Lydia_Pintscher, Lea_WMDE, Addshore, WMDE-leszek, Legado_Shulgin, Nandana, thifranc, AndyTan, kostajh, Davinaclare77, Qtn1293, Lahi, Gq86, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, LawExplorer, Zppix, _jensen, D3r1ck01, SBisson, Wong128hk, Eevans, Hardikj, Wikidata-bugs, aude, GWicke, jayvdb, fbstj, faidon, santhosh, Jdforrester-WMF, Mbch331, Rxy, Jay8g, Ltrlg, bd808, fgiunchedi, Legoktm___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T199096: Add support for wikidata summaries in the /page/summary/ endpoint

2018-12-20 Thread mobrovac
mobrovac added a project: Core Platform Team Backlog (Watching / External).
TASK DETAILhttps://phabricator.wikimedia.org/T199096EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: daniel, Mholloway, Pchelolo, Liuxinyu970226, Aklapper, ovasileva, bearND, Jdlrobson, Jhernandez, Lydia_Pintscher, Nirzar, Nandana, Kotchchanipa, Adrian1985, Abo00tamr, Lahi, Gq86, GoranSMilovanovic, Jayprakash12345, QZanden, LawExplorer, _jensen, D3r1ck01, Eevans, mobrovac, Hardikj, Wikidata-bugs, aude, Ricordisamoa, Jdforrester-WMF, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T149456: Wikidata description change doesn't trigger mobile-sections update

2018-12-20 Thread mobrovac
mobrovac added a project: Core Platform Team Backlog (Watching / External).
TASK DETAILhttps://phabricator.wikimedia.org/T149456EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Pchelolo, mobrovacCc: PokestarFan, GWicke, Niedzielski, mobrovac, daniel, aude, hoo, Pchelolo, Aklapper, Dbrant, Mholloway, gerritbot, bearND, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Sharvaniharan, Darkminds3113, Bsandipan, Lordiis, schoenbaechler, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, cmadeo, LawExplorer, Lewizho99, Maathavan, _jensen, D3r1ck01, Eevans, Hardikj, Wikidata-bugs, Jdforrester-WMF, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T178445: flapping monitoring for recommendation_api on scb

2018-12-20 Thread mobrovac
mobrovac added a project: Core Platform Team Backlog (Watching / External).
TASK DETAILhttps://phabricator.wikimedia.org/T178445EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: Joe, Volans, mobrovac, Smalyshev, Gehel, Stashbot, Aklapper, Dzahn, ET4Eva, Legado_Shulgin, Nandana, thifranc, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, Darkminds3113, GoranSMilovanovic, Chicocvenancio, Th3d3v1ls, Hfbn0, QZanden, EBjune, LawExplorer, Avner, Zppix, _jensen, D3r1ck01, FloNight, Wong128hk, Eevans, Hardikj, Wikidata-bugs, aude, Capt_Swing, faidon, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T200594: Add client identifier to requests sent from Kartotherian to WDQS

2018-12-20 Thread mobrovac
mobrovac added a project: Core Platform Team Backlog (Watching / External).
TASK DETAILhttps://phabricator.wikimedia.org/T200594EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Mholloway, mobrovacCc: Stashbot, mobrovac, MSantos, Gehel, Aklapper, MaxSem, Pnorman, Mholloway, Smalyshev, Nandana, Amatissart, Lahi, Gq86, Looniverse, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Orienteerix, merbst, LawExplorer, _jensen, JGirault, D3r1ck01, Jonas, phabyogi, Xmlizer, Susannaanas, lxbarth, Eevans, jkroll, Planemad, Hardikj, Wikidata-bugs, Jdouglas, bearND, aude, Tobias1984, Manybubbles, Yurik, Jdforrester-WMF, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T105845: RFC: Page components / content widgets

2018-12-20 Thread mobrovac
mobrovac added a project: Core Platform Team Backlog (Watching / External).
TASK DETAILhttps://phabricator.wikimedia.org/T105845EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: brion, leila, Reasno, SBisson, MZMcBride, Mholloway, RandomDSdevel, jmadler, Bianjiang, LikeLifer, MGChecker, -jem-, Daniel_Mietchen, StudiesWorld, Kelson, Jonas, daniel, Jhernandez, MrStradivarius, JanZerebecki, Quiddity, mobrovac, ssastry, Tgr, Ltrlg, Inez, cscott, TrevorParscal, Jdlrobson, GWicke, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, D3r1ck01, Eevans, Jrf, Hardikj, Wikidata-bugs, aude, Dinoguy1000, Gryllida, Nikerabbit, Arlolra, Jdforrester-WMF, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T192687: Better formatting in REST API results for wikidata

2018-12-20 Thread mobrovac
mobrovac added a project: Core Platform Team Backlog (Watching / External).
TASK DETAILhttps://phabricator.wikimedia.org/T192687EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: cscott, Aklapper, HYanWong, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, D3r1ck01, Eevans, Jrf, mobrovac, Hardikj, Wikidata-bugs, aude, GWicke, Dinoguy1000, ssastry, Arlolra, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T212189: New Service Request: Wikidata Termbox SSR

2018-12-18 Thread mobrovac
mobrovac added a comment.

In T212189#4831314, @daniel wrote:
@mobrovac Please note that the term box is shown based on user preferences (languages spoken), the initially served DOM however needs to be the same for all users, so it can be cached. Also note that the language specific data that goes into the term box has to be loaded from the wikibase entity. So the only way to make it work as you suggested would be to always send all the terms in all languages, which, for some items, would be quite a bit of data.


Oh right, the languages. for caching we can vary the accept-language header, so that at least the most requested languages can be served from cache. But you are correct, shipping all the data may become unwieldy. I would still prefer the client making the extra request, though, since it still keeps the architecture saner and faster than doing it prematurely internally.TASK DETAILhttps://phabricator.wikimedia.org/T212189EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: daniel, mobrovac, Joe, Matthias_Geisler_WMDE, Jakob_WMDE, Pablo-WMDE, Aklapper, Lydia_Pintscher, Lea_WMDE, Addshore, WMDE-leszek, Legado_Shulgin, Nandana, thifranc, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, LawExplorer, Zppix, _jensen, D3r1ck01, SBisson, Wong128hk, Eevans, Hardikj, Wikidata-bugs, aude, faidon, Nikerabbit, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T212189: New Service Request: Wikidata Termbox SSR

2018-12-18 Thread mobrovac
mobrovac added a comment.
As a further optimisation of both the architecture as well as parsing and load times, MW/Wikibase could populate a (hidden?) tag in the DOM with all the info needed to generate the termbox. Then, if JS is enabled (w/ possibly ServiceWorkers), the client simply generates it. If a no-JS client gets the page, this could be done using an iFrame by requesting the specific termbox from the server via a cacheable URI. As a result, the service would need to do less work, the client would load the page faster and the architecture would be simpler.

That said, I'm not a UI/front-end expert, so I defer to others whether using iframes is doable or desirable.TASK DETAILhttps://phabricator.wikimedia.org/T212189EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: mobrovac, Joe, Matthias_Geisler_WMDE, Jakob_WMDE, Pablo-WMDE, Aklapper, Lydia_Pintscher, Lea_WMDE, Addshore, WMDE-leszek, Legado_Shulgin, Nandana, thifranc, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, LawExplorer, Zppix, _jensen, D3r1ck01, SBisson, Wong128hk, Eevans, Hardikj, Wikidata-bugs, aude, daniel, faidon, Nikerabbit, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T212189: New Service Request: Wikidata Termbox SSR

2018-12-18 Thread mobrovac
mobrovac added a project: serviceops.
TASK DETAILhttps://phabricator.wikimedia.org/T212189EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: Matthias_Geisler_WMDE, Jakob_WMDE, Pablo-WMDE, Aklapper, Lydia_Pintscher, Lea_WMDE, Addshore, WMDE-leszek, Legado_Shulgin, Nandana, thifranc, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, LawExplorer, Zppix, _jensen, D3r1ck01, SBisson, Wong128hk, Eevans, mobrovac, Hardikj, Wikidata-bugs, aude, daniel, faidon, Nikerabbit, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T212189: New Service Request: Wikidata Termbox SSR

2018-12-18 Thread mobrovac
mobrovac edited projects, added TechCom, Services (next), Core Platform Team Backlog (Next); removed Services.
TASK DETAILhttps://phabricator.wikimedia.org/T212189EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: Matthias_Geisler_WMDE, Jakob_WMDE, Pablo-WMDE, Aklapper, Lydia_Pintscher, Lea_WMDE, Addshore, WMDE-leszek, Legado_Shulgin, Nandana, thifranc, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, LawExplorer, Zppix, _jensen, D3r1ck01, SBisson, Wong128hk, Eevans, mobrovac, Hardikj, Wikidata-bugs, aude, daniel, faidon, Nikerabbit, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Closed] T210451: Kafka eqiad.mediawiki.page-delete topic is empty

2018-11-27 Thread mobrovac
mobrovac closed this task as "Resolved".mobrovac claimed this task.
TASK DETAILhttps://phabricator.wikimedia.org/T210451EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: Stashbot, gerritbot, MisterSynergy, mobrovac, TerraCodes, Liuxinyu970226, Aklapper, Pchelolo, Ottomata, Gehel, Smalyshev, Legado_Shulgin, Nandana, thifranc, Akovalyov, jijiki, AndyTan, Davinaclare77, Qtn1293, Imarlier, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, _jensen, D3r1ck01, Jonas, Xmlizer, Wong128hk, Eevans, JAllemandou, jkroll, Hardikj, Wikidata-bugs, Jdouglas, aude, Tobias1984, GWicke, Manybubbles, ArielGlenn, faidon, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, akosiaris, fgiunchedi, jeremyb, greg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T210451: Kafka eqiad.mediawiki.page-delete topic is empty

2018-11-27 Thread mobrovac
mobrovac edited projects, added Services (done), Core Platform Team Kanban (Done with CPT); removed Patch-For-Review, Core Platform Team Kanban (Doing), Services (doing).mobrovac added a comment.
The fix has been deployed, delete events should start flowing again, so resolving. Let's reopen the ticket if that does not occur.TASK DETAILhttps://phabricator.wikimedia.org/T210451EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: Stashbot, gerritbot, MisterSynergy, mobrovac, TerraCodes, Liuxinyu970226, Aklapper, Pchelolo, Ottomata, Gehel, Smalyshev, Legado_Shulgin, Nandana, thifranc, Akovalyov, jijiki, AndyTan, Davinaclare77, Qtn1293, Imarlier, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, _jensen, D3r1ck01, Jonas, Xmlizer, Wong128hk, Eevans, JAllemandou, jkroll, Hardikj, Wikidata-bugs, Jdouglas, aude, Tobias1984, GWicke, Manybubbles, ArielGlenn, faidon, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, akosiaris, fgiunchedi, jeremyb, greg, CucyNoiD, NebulousIris, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Bsandipan, Lordiis, Adik2382, Ramalepe, Liugev6, Lewizho99, Maathavan___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Lowered Priority] T210451: Kafka eqiad.mediawiki.page-delete topic is empty

2018-11-26 Thread mobrovac
mobrovac lowered the priority of this task from "Unbreak Now!" to "High".mobrovac added projects: WMF-JobQueue, Services (doing), Core Platform Team Kanban (Doing).mobrovac added a comment.
Will be done in the EU SWAT window on 2018-11-27. Lowering the priority as it is a known issue and does not cause severe breakage.TASK DETAILhttps://phabricator.wikimedia.org/T210451EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: mobrovac, TerraCodes, Liuxinyu970226, Aklapper, Pchelolo, Ottomata, Gehel, Smalyshev, Legado_Shulgin, Nandana, thifranc, Akovalyov, jijiki, AndyTan, Davinaclare77, Qtn1293, Imarlier, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, _jensen, D3r1ck01, Jonas, Xmlizer, Wong128hk, Eevans, JAllemandou, jkroll, Hardikj, Wikidata-bugs, Jdouglas, aude, Tobias1984, GWicke, Manybubbles, ArielGlenn, faidon, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, akosiaris, fgiunchedi, jeremyb, greg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T204024: Store WikibaseQualityConstraint check data in persistent storage instead of in the cache

2018-11-01 Thread mobrovac
mobrovac added a project: Dependency-Tracking.mobrovac added a comment.
Essentially, we are talking here about dependency tracking for WikiBase/WikiData. We do need a larger solution to the dependency tracking problem all over our infrastructure, with WB/WD being the pathological case. At some point we will start seriously tackling that problem, but until we do, it makes perfect sense to me to have the constraints stored permanently.

I see certain questions that need to be resolved before any movement can be made on this front, such as:


will we store data only for the latest revision or not (implies different storage semantics and guarantees)
how will we detect key/value pairs that need to be invalidated (possibly efficiently)
do we benefit from having a multi-DC storage solution for this


There are probably more detailed questions that lurk there too. Given all of the above, yes, I think it would be good to have an RfC written up that explores these questions.TASK DETAILhttps://phabricator.wikimedia.org/T204024EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: Lydia_Pintscher, Pintoch, Tpt, Smalyshev, Eevans, daniel, mobrovac, Jonas, Lucas_Werkmeister_WMDE, Aklapper, Addshore, Legado_Shulgin, Nandana, thifranc, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, merbst, LawExplorer, Zppix, Agabi10, Pchelolo, Wong128hk, Hardikj, Wikidata-bugs, aude, faidon, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T208213: Add wikibase export format to citoid service

2018-10-29 Thread mobrovac
mobrovac edited projects, added Services (watching), Core Platform Team Backlog (Watching / External); removed Services.mobrovac added a comment.
+1 to the idea. We could then have ref import/export to/fro WB and WP and other utilities.

Dates in particular seem like something that could be a big source of pain because on the one hand we don't always have the full date available and on the other WikiBase has a rather intricate way of ingesting time-based data. But we can iterate on that.TASK DETAILhttps://phabricator.wikimedia.org/T208213EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Mvolz, mobrovacCc: mobrovac, Aklapper, Samwalton9, Susannaanas, Lydia_Pintscher, Ocaasi_WMF, marcella, aude, Phil_Boswell, He7d3r, MichaelSchoenitzer, Jsamwrites, Jklamo, The_RedBurn, PKM, Juandev, Glorian_Yapinus, DarTar, Izno, Whatamidoing-WMF, czar, Daniel_Mietchen, BrillLyle, Stryn, Tobias1984, Scott_WUaS, Elitre, Liuxinyu970226, VIGNERON, Jdforrester-WMF, Florian, Mvolz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Shangkuanlc, Eevans, Hardikj, Wikidata-bugs, Deskana, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T207817: WDQS Updater ran into issue and stopped working

2018-10-25 Thread mobrovac
mobrovac edited projects, added Services (next), Core Platform Team Backlog (Later), EventBus; removed Patch-For-Review.Restricted Application added a project: Analytics.
TASK DETAILhttps://phabricator.wikimedia.org/T207817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: Ottomata, Pchelolo, Tarrow, WMDE-leszek, Addshore, mmodell, Stashbot, 20after4, TerraCodes, Liuxinyu970226, gerritbot, Gehel, Smalyshev, Mathew.onipe, Aklapper, Dzahn, Nandana, thifranc, Akovalyov, AndyTan, Davinaclare77, Qtn1293, Imarlier, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, Jonas, Xmlizer, Wong128hk, Eevans, JAllemandou, mobrovac, jkroll, Hardikj, Wikidata-bugs, Jdouglas, aude, Tobias1984, GWicke, Manybubbles, ArielGlenn, faidon, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, fgiunchedi, jeremyb, greg, CucyNoiD, NebulousIris, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Bsandipan, Lordiis, Adik2382, Ramalepe, Liugev6, Lewizho99, Maathavan___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T124196: Notice: Unable to unserialize job_params in some CirrusSearch jobs (when using JobQueueDB)

2018-10-15 Thread mobrovac
mobrovac removed a project: WMF-JobQueue.mobrovac added a comment.
Removing #wmf-jobqueue as we don't use JobQueueDB in production.TASK DETAILhttps://phabricator.wikimedia.org/T124196EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: mobrovac, Krinkle, Rudloff, Physikerwelt, GFXDude2010, Zoglun, hoo, aude, Aklapper, Nandana, Lahi, Gq86, Darkminds3113, GoranSMilovanovic, QZanden, EBjune, LawExplorer, Avner, Gehel, FloNight, Wikidata-bugs, jayvdb, Mbch331, jeremyb, Pchelolo___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T204713: Provide a Wikibase instance where we can import Wikitionaries materials and that can be queried from Wiktionaries

2018-10-15 Thread mobrovac
mobrovac removed a project: Service-Architecture.
TASK DETAILhttps://phabricator.wikimedia.org/T204713EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: Framawiki, Darkdadaah, Noe, Lydia_Pintscher, Lea_Lacroix_WMDE, Aklapper, Psychoslave, Nandana, Lahi, Gq86, Cinemantique, GoranSMilovanovic, QZanden, LawExplorer, jberkel, Wikidata-bugs, aude, GPHemsley, Shizhao, Nemo_bis, Mbch331, Ltrlg, Krenair, GWicke, RobLa-WMF, bd808___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T204024: Store WikibaseQualityConstraint check data in an SQL table instead of in the cache

2018-10-15 Thread mobrovac
mobrovac added a project: Core Platform Team Backlog (Designing).
TASK DETAILhttps://phabricator.wikimedia.org/T204024EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: Lydia_Pintscher, Pintoch, Tpt, Smalyshev, Eevans, daniel, mobrovac, Jonas, Lucas_Werkmeister_WMDE, Aklapper, Addshore, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, merbst, LawExplorer, Agabi10, Hardikj, Wikidata-bugs, aude, Mbch331, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T204031: Deploy regular running of wikidata constraint checks using the job queue

2018-10-15 Thread mobrovac
mobrovac added a project: Core Platform Team Backlog (Watching / External).
TASK DETAILhttps://phabricator.wikimedia.org/T204031EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: Pchelolo, Addshore, Aklapper, Nandana, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, merbst, LawExplorer, Agabi10, Eevans, mobrovac, Hardikj, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Closed] T206303: Add sudo rules for wdqs-updater in puppet

2018-10-08 Thread mobrovac
mobrovac edited projects, added Services (done); removed Patch-For-Review, Services (doing).mobrovac closed this task as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T206303EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: gerritbot, Aklapper, Smalyshev, Gehel, Mathew.onipe, Nandana, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, Jonas, Xmlizer, Wong128hk, Eevans, mobrovac, jkroll, Hardikj, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi, CucyNoiD, NebulousIris, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Bsandipan, Lordiis, Adik2382, Ramalepe, Liugev6, Lewizho99, Maathavan___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Retitled] T206303: Add sudo rules for wdqs-updater in puppet

2018-10-05 Thread mobrovac
mobrovac renamed this task from "Add wdqs-updater to scap target in puppet" to "Add sudo rules for wdqs-updater in puppet".mobrovac claimed this task.mobrovac edited projects, added Services (doing); removed Services.
TASK DETAILhttps://phabricator.wikimedia.org/T206303EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: Aklapper, Smalyshev, Gehel, Mathew.onipe, Nandana, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, Jonas, Xmlizer, Wong128hk, Eevans, mobrovac, jkroll, Hardikj, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Triaged] T206303: Add sudo rules for wdqs-updater in puppet

2018-10-05 Thread mobrovac
mobrovac triaged this task as "Normal" priority.
TASK DETAILhttps://phabricator.wikimedia.org/T206303EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: Aklapper, Smalyshev, Gehel, Mathew.onipe, Nandana, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, Jonas, Xmlizer, Wong128hk, Eevans, mobrovac, jkroll, Hardikj, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T204024: Store WikibaseQualityConstraint check data in an SQL table instead of in the cache

2018-09-12 Thread mobrovac
mobrovac added projects: Services (designing), Cassandra.mobrovac added a comment.
Could you describe the exact data that would be stored and its data model? I looked at T179849, but I see two different things there: in T179849#3770891 a resulting JSON blob is mentioned, but T179849#3778358 outlines a full SQL schema (with various indices) and I cannot relate the two.

If we are talking about a key/value JSON/blob storage, the Cassandra-powered key/value storage component might be a good fit for it, but at this point we need more info:


the aforementioned data model
access pattern: is it write-once, read multiple times, do overwrites happen, etc



In T204024#4573953, @Jonas wrote:
+1 for Cassandra, but one disadvantage might be that normal installation don't have the service.


Ideally, once we have the storage component in place in our infrastructure, alternative MW interfaces ought to be developed that allow smaller-scale installation to use something else, which should resolve this concern.TASK DETAILhttps://phabricator.wikimedia.org/T204024EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: mobrovac, Jonas, Lucas_Werkmeister_WMDE, Aklapper, Addshore, Lahi, Gq86, GoranSMilovanovic, QZanden, merbst, LawExplorer, Agabi10, Eevans, Hardikj, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T200594: Add client identifier to requests sent from Kartotherian to WDQS

2018-08-01 Thread mobrovac
mobrovac added a comment.

In T200594#4469972, @Smalyshev wrote:
Aren't clients making requests to Kartotherian? If they are, then X-Client-IP will be set to the external (to our prod environment) client issuing the request.

Yes. But when Kartotherian calls to WDQS, it calls external Varnish endpoint (now), which might replace X-Client-IP - not 100% sure about it, needs checking, but I think judging from the logs that's what is happening since the IP I see in the logs is one of Kartotherian.


The flow is: client -> Nginx -> Varnish -> Kartotherian -> WDQS. Hence, when Kartotherian receives the request, that request will have the external client's IP in the X-Client-IP header and that's immutable regardless of what Kartotherian does next (i.e. whether the requests it issues pass through Varnish or not).

The ideal solution here would be for Kartotherian to call directly WDQS (via its discovery end point mentioned in the previous comments) and supply it the aforementioned header if the idea is to throttle requests on WDQS.



On the technical side, though, changing the UA for every client is IMHO a bad practice and should not even be considered a solution here.

I am not sure why. What's wrong with changing the UA? 
 But I am not hard-set on the UA, that'd just make it work automatically, but if it puts it in other place as long as Java can extract it it'd be fine I think.

By definition, the User-Agent header identifies the user agent making the request, not the client. Furthermore, putting semi-random information in that header (like IPs) makes analytics, metrics, logging and other use-cases harder, amongst other things.

The differentiator here is not who initiates the query, but who writes the query itself. As I understand, Kartotherian runs arbitrary user queries, which can be very heavy and unoptimized, and we have little visibility into who produces these queries.

Ah I see. In that case, perhaps it would worth investigating whether the set of queries could be restricted somehow?TASK DETAILhttps://phabricator.wikimedia.org/T200594EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: mobrovac, MSantos, Gehel, Aklapper, MaxSem, Pnorman, Mholloway, Smalyshev, Amatissart, Lahi, Gq86, Looniverse, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Orienteerix, merbst, LawExplorer, debt, JGirault, Jonas, phabyogi, Xmlizer, Susannaanas, lxbarth, Eevans, jkroll, Planemad, Hardikj, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Yurik, Jdforrester-WMF, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T200594: Add client identifier to requests sent from Kartotherian to WDQS

2018-08-01 Thread mobrovac
mobrovac added a comment.

In T200594#4469670, @Smalyshev wrote:
Yes, but we need it to be the IP of the client of Karthoterian, not the IP of the server running Karthoterian.


Aren't clients making requests to Kartotherian? If they are, then X-Client-IP will be set to the external (to our prod environment) client issuing the request.

Why do you think so? WDQS is an internal WMF service, and the webrequest logs track incoming IPs anyway. So no additional information is logged and no PII is sent out.

This may constitute data manipulation not allowed by current policies. But, I am not an expert in this field, I just raised it as a potential legal problem. On the technical side, though, changing the UA for every client is IMHO a bad practice and should not even be considered a solution here.

Not sure about that, since Kartotherian is acting as a proxy in this case - i.e. we have load generated by public requests driven by the clients everywhere, and queries written by the clients, not just internal WMF workloads with queries curated by us, as far as I can understand. I'd prefer using internal clusters only for curated queries for now, unless Kartotherian load is very small.

There is precedent for this: the recommendation api service uses the internal WDQS cluster and issues requests to it upon receiving client requests. However, the requests sent to WDQS are strictly bounded (i.e. external clients cannot make arbitrary queries to WDQS). If that is the case with Katotherian as well, then the same principle can be applied. The original idea of the internal WDQS cluster was that internal services requiring it should function regardless of the external client load faced by WDQS directly.

But we do not need to uniquely identify a single request. We need to identify a client, sending multiple requests. That's the whole point of throttling.

It wasn't clear enough to me from the task desc that throttling is the main purpose of this.TASK DETAILhttps://phabricator.wikimedia.org/T200594EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: mobrovac, MSantos, Gehel, Aklapper, MaxSem, Pnorman, Mholloway, Smalyshev, Amatissart, Lahi, Gq86, Looniverse, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Orienteerix, merbst, LawExplorer, debt, JGirault, Jonas, phabyogi, Xmlizer, Susannaanas, lxbarth, Eevans, jkroll, Planemad, Hardikj, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Yurik, Jdforrester-WMF, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T200594: Add client identifier to requests sent from Kartotherian to WDQS

2018-08-01 Thread mobrovac
mobrovac added a comment.
I would also suggest using X-Request-ID which uniquely identifies a single request.TASK DETAILhttps://phabricator.wikimedia.org/T200594EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: mobrovac, MSantos, Gehel, Aklapper, MaxSem, Pnorman, Mholloway, Smalyshev, Amatissart, Lahi, Gq86, Looniverse, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Orienteerix, merbst, LawExplorer, debt, JGirault, Jonas, phabyogi, Xmlizer, Susannaanas, lxbarth, Eevans, jkroll, Planemad, Hardikj, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Yurik, Jdforrester-WMF, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T200594: Add client identifier to requests sent from Kartotherian to WDQS

2018-08-01 Thread mobrovac
mobrovac added a comment.
Nginx and Varnish already attach the X-Client-IP header to incoming requests (cf. this sample request), so all you have to do is actually use the provided header.


In T200594#4467019, @Mholloway wrote:
It would be very easy to add the requesting IP to the user-agent string.


I believe this violates multiple privacy policies we have in place, but as stated above, work-arounds are not even needed.

Does WDQS have an internal URI (similar to restbase.svc.codfw.wmnet) that we could/should use in production?  Currently we're hard-coding the public endpoint.

Yes. there are two WDQS cluster: an external and an internal one. The former services external requests coming from query.wikidata.org, while the latter is to be used for requests originating from entities inside our production environment. Therefore, Kartotherian should use http://wdqs-internal.discovery.wmnet - the internal cluster.TASK DETAILhttps://phabricator.wikimedia.org/T200594EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: mobrovac, MSantos, Gehel, Aklapper, MaxSem, Pnorman, Mholloway, Smalyshev, Amatissart, Lahi, Gq86, Looniverse, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Orienteerix, merbst, LawExplorer, debt, JGirault, Jonas, phabyogi, Xmlizer, Susannaanas, lxbarth, Eevans, jkroll, Planemad, Hardikj, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Yurik, Jdforrester-WMF, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T187296: Increase kafka event retention to 31

2018-06-13 Thread mobrovac
mobrovac added a project: EventBus.
TASK DETAILhttps://phabricator.wikimedia.org/T187296EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ottomata, mobrovacCc: mforns, elukey, Ottomata, Aklapper, Nuria, Ladsgroup, Pchelolo, JAllemandou, Smalyshev, Lahi, Gq86, Vacio, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Gehel, Jonas, FloNight, Xmlizer, Eevans, Nirmos, mobrovac, jkroll, Hardikj, Wikidata-bugs, Jdouglas, aude, Tobias1984, GWicke, Manybubbles, Mbch331, Krenair, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T111231: Page previews for Wikidata

2018-05-22 Thread mobrovac
mobrovac removed a subtask: T159985: Implement language variant support in the REST API.
TASK DETAILhttps://phabricator.wikimedia.org/T111231EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: Smalyshev, ovasileva, Lucas_Werkmeister_WMDE, Mholloway, Sjoerddebruin, Pchelolo, pmiazga, aude, Nirzar, Tbayer, CKoerner_WMF, Yurik, phuedx, Jdlrobson, Liuxinyu970226, Yair_rand, JKatzWMF, Ricordisamoa, Bene, Aklapper, Lydia_Pintscher, Lahi, Gq86, GoranSMilovanovic, Jayprakash12345, QZanden, Zoranzoki21, LawExplorer, Winter, Salgo60, DatGuy, Devwaker, Niklitov, Urbanecm, JEumerus, Tulsi_Bhagat, Wong128hk, Luke081515, SimmeD, biplabanand, Wikidata-bugs, Snowolf, Dcljr, Shizhao, Se4598, Jdforrester-WMF, Matanya, Mbch331, Rxy, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T111231: Page previews for Wikidata

2018-05-22 Thread mobrovac
mobrovac added a subtask: T190689: FY17/18 Q4 Program 7 Services Goal: Language variants support.
TASK DETAILhttps://phabricator.wikimedia.org/T111231EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: Smalyshev, ovasileva, Lucas_Werkmeister_WMDE, Mholloway, Sjoerddebruin, Pchelolo, pmiazga, aude, Nirzar, Tbayer, CKoerner_WMF, Yurik, phuedx, Jdlrobson, Liuxinyu970226, Yair_rand, JKatzWMF, Ricordisamoa, Bene, Aklapper, Lydia_Pintscher, Lahi, Gq86, GoranSMilovanovic, Jayprakash12345, QZanden, Zoranzoki21, LawExplorer, Winter, Salgo60, DatGuy, Devwaker, Niklitov, Urbanecm, JEumerus, Tulsi_Bhagat, Wong128hk, Luke081515, SimmeD, biplabanand, Wikidata-bugs, Snowolf, Dcljr, Shizhao, Se4598, Jdforrester-WMF, Matanya, Mbch331, Rxy, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T105845: RFC: Page components / content widgets

2018-04-25 Thread mobrovac
mobrovac added a project: Services (watching).
TASK DETAILhttps://phabricator.wikimedia.org/T105845EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: brion, leila, Reasno, SBisson, MZMcBride, Mholloway, RandomDSdevel, jmadler, Bianjiang, LikeLifer, MGChecker, -jem-, Daniel_Mietchen, StudiesWorld, Kelson, Jonas, daniel, Jhernandez, MrStradivarius, JanZerebecki, Quiddity, mobrovac, ssastry, Tgr, Ltrlg, Inez, cscott, TrevorParscal, Jdlrobson, GWicke, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Eevans, Jrf, Hardikj, Wikidata-bugs, aude, Gryllida, Arlolra, Jdforrester-WMF, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T192085: PHP Fatal in AffectedPagesFinder::getChangedAspects

2018-04-25 Thread mobrovac
mobrovac added a parent task: T190327: FY17/18 Q4 Program 8 Services Goal: Complete the JobQueue transition to EventBus.
TASK DETAILhttps://phabricator.wikimedia.org/T192085EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, mobrovacCc: mobrovac, Stashbot, gerritbot, daniel, Aklapper, Pchelolo, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, lisong, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Eevans, Hardikj, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T192085: PHP Fatal in AffectedPagesFinder::getChangedAspects

2018-04-25 Thread mobrovac
mobrovac added a comment.
Thank you @Ladsgroup !TASK DETAILhttps://phabricator.wikimedia.org/T192085EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, mobrovacCc: mobrovac, Stashbot, gerritbot, daniel, Aklapper, Pchelolo, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, lisong, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Eevans, Hardikj, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T192687: Better formatting in REST API results for wikidata

2018-04-23 Thread mobrovac
mobrovac added a project: Parsoid.
TASK DETAILhttps://phabricator.wikimedia.org/T192687EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: Aklapper, HYanWong, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Eevans, Jrf, mobrovac, Hardikj, Wikidata-bugs, aude, GWicke, ssastry, Arlolra, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T192687: Better formatting in REST API results for wikidata

2018-04-23 Thread mobrovac
mobrovac added a project: Services (watching).
TASK DETAILhttps://phabricator.wikimedia.org/T192687EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: Aklapper, HYanWong, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Eevans, mobrovac, Hardikj, Wikidata-bugs, aude, GWicke, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T192198: Wikidata doesn't update recentchanges

2018-04-16 Thread mobrovac
mobrovac added a parent task: T190327: FY17/18 Q4 Program 8 Services Goal: Complete the JobQueue transition to EventBus.
TASK DETAILhttps://phabricator.wikimedia.org/T192198EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Pchelolo, mobrovacCc: Stashbot, gerritbot, abian, Marostegui, mobrovac, Pchelolo, TerraCodes, Liuxinyu970226, Lydia_Pintscher, Aklapper, Ladsgroup, eranroz, Lahi, Gq86, GoranSMilovanovic, lisong, QZanden, LawExplorer, Eevans, JAllemandou, Hardikj, Wikidata-bugs, aude, GWicke, Mbch331, Jay8g, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Closed] T192198: Wikidata doesn't update recentchanges

2018-04-16 Thread mobrovac
mobrovac assigned this task to Pchelolo.mobrovac closed this task as "Resolved".mobrovac edited projects, added Services (done); removed Services (doing), Patch-For-Review.mobrovac added a comment.
It took us a while to find the root cause of this. Essentially, the problem was that the ChangeNotification jobs were being created/dispatched via a cron script. In such a case, the EventBus-based JobQueue was assigning the originating wiki (which was Wikidata) instead of the intended recipient wiki. At the same time, whether this job injects RC records or not is configurable per-wiki, and that setting was set to false for WD.

We have fixed the bug in the EventBus-based JobQueue push service and now the correct wiki name is set in the event data. Consequently, injectRCRecord jobs are now being created and executed as intended.TASK DETAILhttps://phabricator.wikimedia.org/T192198EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Pchelolo, mobrovacCc: Stashbot, gerritbot, abian, Marostegui, mobrovac, Pchelolo, TerraCodes, Liuxinyu970226, Lydia_Pintscher, Aklapper, Ladsgroup, eranroz, Lahi, Gq86, GoranSMilovanovic, lisong, QZanden, LawExplorer, Eevans, JAllemandou, Hardikj, Wikidata-bugs, aude, GWicke, Mbch331, Jay8g, jeremyb, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Lordiis, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, Lewizho99, Maathavan___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T192198: Wikidata doesn't update recentchanges

2018-04-16 Thread mobrovac
mobrovac edited projects, added Services (doing), EventBus, MediaWiki-JobQueue; removed Services.Herald added a project: Analytics.
TASK DETAILhttps://phabricator.wikimedia.org/T192198EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: gerritbot, abian, Marostegui, mobrovac, Pchelolo, TerraCodes, Liuxinyu970226, Lydia_Pintscher, Aklapper, Ladsgroup, eranroz, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Lordiis, GoranSMilovanovic, lisong, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Eevans, JAllemandou, Hardikj, Wikidata-bugs, aude, GWicke, Mbch331, Jay8g, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Triaged] T192085: PHP Fatal in AffectedPagesFinder::getChangedAspects

2018-04-12 Thread mobrovac
mobrovac triaged this task as "High" priority.
TASK DETAILhttps://phabricator.wikimedia.org/T192085EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: daniel, Aklapper, Pchelolo, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Eevans, mobrovac, Hardikj, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T178492: Create a more controlled WDQS cluster

2018-03-29 Thread mobrovac
mobrovac added a parent task: T190266: Recommendation API fails with internal error if the optional seed_article param is missing.
TASK DETAILhttps://phabricator.wikimedia.org/T178492EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: Daniel_Mietchen, BBlack, Lydia_Pintscher, Volans, mobrovac, Jonas, Aklapper, debt, Smalyshev, Gehel, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, Darkminds3113, SandraF_WMF, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Tramullas, Acer, merbst, LawExplorer, Avner, FloNight, Xmlizer, Susannaanas, Eevans, Aschroet, Jane023, jkroll, Hardikj, Wikidata-bugs, Jdouglas, PKM, Base, matthiasmullie, aude, Tobias1984, Manybubbles, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T114454: [RFC] Visual Templates: Authoring templates with Visual Editor

2018-01-10 Thread mobrovac
mobrovac added a comment.
There has been no activity on this RfC since E146 . @cscott are you still interesting in pursuing this idea? Are the relevant actors aware of this proposal?TASK DETAILhttps://phabricator.wikimedia.org/T114454EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: cscott, mobrovacCc: mobrovac, srishakatux, Capt_Swing, Qgil, MZMcBride, jeblad, Physikerwelt, RobLa-WMF, StudiesWorld, Krenair, Jdforrester-WMF, daniel, Anomie, cscott, Aklapper, Lahi, Gq86, Necroarcano, Robinma, GoranSMilovanovic, QZanden, merbst, LawExplorer, Wess, SundanceRaphael, Srdjan_m, SBisson, Jrf, Husun1297, Wikidata-bugs, aude, GWicke, Deskana, Dinoguy1000, jayvdb, MrStradivarius, Swainr, fbstj, santhosh, Jackmcbarn, Mbch331, Rxy, Jay8g, Ltrlg, bd808, Legoktm___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T183472: tagline update on an HEWP article

2018-01-02 Thread mobrovac
mobrovac added a comment.
Is this a problem with the mobile version in the browser or the native Android app?TASK DETAILhttps://phabricator.wikimedia.org/T183472EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: mobrovac, Lydia_Pintscher, Itzike, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Dbrant, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T181216: Get rid of pointless EnqueueJob usage

2017-11-29 Thread mobrovac
mobrovac edited projects, added Services (done); removed Patch-For-Review, Services (watching).
TASK DETAILhttps://phabricator.wikimedia.org/T181216EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: gerritbot, Legoktm, mobrovac, Joe, Pchelolo, Aklapper, aaron, Lahi, Gq86, GoranSMilovanovic, QZanden, Eevans, Hardikj, Wikidata-bugs, aude, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T181216: Get rid of pointless EnqueueJob usage

2017-11-28 Thread mobrovac
mobrovac edited projects, added Wikidata; removed Patch-For-Review.mobrovac added a comment.
Grepping the current MW release code on tin, it looks like only FlaggedRevs and Wikibase use this job:

$ grep -iIREn enqueuejob .
./includes/DefaultSettings.php:7432:	'enqueue' => 'EnqueueJob', // local queue for multi-DC setups
./includes/jobqueue/jobs/EnqueueJob.php:36:final class EnqueueJob extends Job {
./includes/jobqueue/jobs/EnqueueJob.php:49:	 * @return EnqueueJob
./includes/jobqueue/jobs/EnqueueJob.php:59:	 * @return EnqueueJob
./autoload.php:434:	'EnqueueJob' => __DIR__ . '/includes/jobqueue/jobs/EnqueueJob.php',
./extensions/FlaggedRevs/backend/FRDependencyUpdate.php:69:JobQueueGroup::singleton()->push( EnqueueJob::newFromLocalJobs(
./extensions/FlaggedRevs/backend/FlaggableWikiPage.php:345:		JobQueueGroup::singleton()->push( EnqueueJob::newFromLocalJobs(
./extensions/Wikidata/extensions/Wikibase/client/includes/Hooks/DataUpdateHookHandlers.php:7:use EnqueueJob;
./extensions/Wikidata/extensions/Wikibase/client/includes/Hooks/DataUpdateHookHandlers.php:168:		$enqueueJob = EnqueueJob::newFromLocalJobs( $addUsagesForPageJob );
./extensions/Wikidata/extensions/Wikibase/client/includes/Hooks/DataUpdateHookHandlers.php:170:		$this->jobScheduler->lazyPush( $enqueueJob );
./extensions/Wikibase/client/includes/Hooks/DataUpdateHookHandlers.php:7:use EnqueueJob;
./extensions/Wikibase/client/includes/Hooks/DataUpdateHookHandlers.php:168:		$enqueueJob = EnqueueJob::newFromLocalJobs( $addUsagesForPageJob );
./extensions/Wikibase/client/includes/Hooks/DataUpdateHookHandlers.php:170:		$this->jobScheduler->lazyPush( $enqueueJob );

Since FlaggedRevs has been taken care of in Gerrit 393199, that leaves only the Wikibase extension.TASK DETAILhttps://phabricator.wikimedia.org/T181216EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: gerritbot, Legoktm, mobrovac, Joe, Pchelolo, Aklapper, aaron, Lahi, Gq86, GoranSMilovanovic, QZanden, Eevans, Hardikj, Wikidata-bugs, aude, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop

2017-11-03 Thread mobrovac
mobrovac added a comment.

In T173710#3730359, @elukey wrote:
https://gerrit.wikimedia.org/r/#/c/385248 should be already working for commons, but from mwlog1001's runJob.log I can only see stuff like causeAction=unknown causeAgent=unknown (that probably only confirms that no authenticated user/bot is triggering these jobs iteratively).


The unknown causes may also stem from the fact that the patch was not active when the initial job was executed, and so its descendants can't know the cause.TASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: zhuyifei1999, RP88, Jack_who_built_the_house, elukey, debt, mxn, Daimona, YOUR1, Tbayer, mobrovac, Nikerabbit, Mholloway, Legoktm, ema, Joe, GWicke, Nemo_bis, Andreasmperu, BBlack, Peachey88, Liuxinyu970226, daniel, Stashbot, Agabi10, Daniel_Mietchen, XXN, Pasleim, Bugreporter, Sjoerddebruin, Magnus, Mr.Ibrahem, gerritbot, EBernhardson, Esc3300, jcrespo, WMDE-leszek, Jdforrester-WMF, Krinkle, aaron, fgiunchedi, Aklapper, Ladsgroup, Lahi, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, Vali.matei, Avner, Lewizho99, Zppix, Maathavan, Gehel, FloNight, Eevans, Hardikj, Wikidata-bugs, aude, jayvdb, faidon, Mbch331, Jay8g, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T178492: Create a more controlled WDQS cluster

2017-11-01 Thread mobrovac
mobrovac added a comment.

In T178492#3725811, @Gehel wrote:

Since we have 2 active / active WDQS clusters (eqiad / codfw), we could use one of them to serve internal traffic and one as external endpoint. This defeats the purpose of having a backup datacenter, so that's not a long term solution.



Perhaps a viable solution for the short- to mid-term is to have two LVS end points in each DC: one that serves external traffic, and another one internal, much like we have api.svc.{site}.wmnet and api-async.svc.{site}.wmnet for the MW API, respectively,TASK DETAILhttps://phabricator.wikimedia.org/T178492EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: Volans, mobrovac, Jonas, Aklapper, debt, Smalyshev, Gehel, Lahi, Gq86, E1presidente, Ramsey-WMF, SandraF_WMF, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Acer, merbst, Avner, FloNight, Xmlizer, Susannaanas, Eevans, Jane023, jkroll, Hardikj, Wikidata-bugs, Jdouglas, PKM, Base, matthiasmullie, aude, Tobias1984, Manybubbles, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Edited] T178997: AddUsagesForPageJob doesn't really report execution status

2017-10-25 Thread mobrovac
mobrovac updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTIONEven though the documentation says the job returns a bool reporting execution success/failure, it actually returns [[ http://calendar.google.com/calendar/render | nothing ]]nothing](https://github.com/wikimedia/mediawiki-extensions-Wikidata/blob/6577cec77a28c088e269671b6b69c095463c30fa/extensions/Wikibase/client/includes/Store/AddUsagesForPageJob.php#L134)TASK DETAILhttps://phabricator.wikimedia.org/T178997EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: gerritbot, daniel, Pchelolo, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Eevans, mobrovac, Hardikj, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T178492: Create a more controlled WDQS cluster

2017-10-19 Thread mobrovac
mobrovac added a project: Services (watching).mobrovac added a comment.
The Recommendation API service depends entirely on WDQS (and partially on AQS). While in theory we could (and should) account for 429s sent by WDQS in the service, the problem described in the task description is genuine. I second the effort of splitting the service (or its access) into two logical entities - one for external, the other for internal clients.TASK DETAILhttps://phabricator.wikimedia.org/T178492EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: mobrovac, Jonas, Aklapper, debt, Smalyshev, Gehel, Gq86, E1presidente, Ramsey-WMF, Jmmuguerza, SandraF_WMF, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Acer, merbst, Avner, FloNight, Xmlizer, Susannaanas, Eevans, jkroll, Hardikj, Wikidata-bugs, Jdouglas, PKM, Base, matthiasmullie, aude, Tobias1984, Manybubbles, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Changed Subscribers] T178445: flapping monitoring for recommendation_api on scb

2017-10-18 Thread mobrovac
mobrovac added subscribers: Volans, Joe.mobrovac added a comment.
The amount of requests from the Recommendation API service actually makes sense. On each service checker script run, 3 requests are sent to WDQS from the service. Accounting for the number of hosts and frequency of the checks, we get to 0.5 requests per second. However, because the checker script does not receive the expected status, it retries multiple times, which brings us to the observed rate of approximately 1.5 reqs/s. @Joe, @Volans should perhaps some back-off policy be implemented in the checker script, especially when it receives 429s?TASK DETAILhttps://phabricator.wikimedia.org/T178445EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: Joe, Volans, mobrovac, Smalyshev, Gehel, Stashbot, Aklapper, Dzahn, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, Avner, Zppix, debt, Jonas, FloNight, Xmlizer, Eevans, jkroll, Hardikj, Wikidata-bugs, Jdouglas, aude, Tobias1984, Capt_Swing, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T178445: flapping monitoring for recommendation_api on scb

2017-10-18 Thread mobrovac
mobrovac added a comment.

In T178445#3692895, @Smalyshev wrote:
@mobrovac what's the rate the requests are currently sent at? IIRC the limits we have are pretty generous, but depends on the use case of course.


This is the part that I don't understand - the rate of the public end point is 0, which means that the Recommendation API service contacts WDQS on;y 4 times every 60 seconds due to the automatic monitoring script sending health-check requests to it, which doesn't seem like something that should trigger rate limiting.


In T178445#3692899, @Gehel wrote:
We could add an exception for specific user agent. Or have Recommendation API propagate some way to bucket by end user. This needs a little bit of thinking.


The latter would be ideal. We could forward the client's IP via the x-client-ip header.TASK DETAILhttps://phabricator.wikimedia.org/T178445EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: mobrovac, Smalyshev, Gehel, Stashbot, Aklapper, Dzahn, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, Avner, Zppix, Volans, debt, Jonas, FloNight, Xmlizer, Eevans, jkroll, Hardikj, Wikidata-bugs, Jdouglas, aude, Tobias1984, Capt_Swing, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T178445: flapping monitoring for recommendation_api on scb

2017-10-18 Thread mobrovac
mobrovac added subscribers: Gehel, Smalyshev, mobrovac.mobrovac edited projects, added Services (watching), Recommendation-API, Wikidata-Query-Service; removed Services.mobrovac added a comment.Herald added projects: Wikidata, Discovery.
The 429 coming from WDQS. @Gehel, @Smalyshev would it be possible to split WDQS' rate limiting for internal and external requests?TASK DETAILhttps://phabricator.wikimedia.org/T178445EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: mobrovac, Smalyshev, Gehel, Stashbot, Aklapper, Dzahn, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, Avner, Zppix, Volans, debt, Jonas, FloNight, Xmlizer, Eevans, jkroll, Hardikj, Wikidata-bugs, Jdouglas, aude, Tobias1984, Capt_Swing, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T175316: Very large jobs posted by Wikidata

2017-09-14 Thread mobrovac
mobrovac added a comment.

In T175316#3608388, @daniel wrote:
@mobrovac how about a very large number of very small jobs? e.g. a million jobs to purge a million pages from cdn?

Note that we introduced batching only a few weeks ago, at the explicit request of the performance folks. We had one job per purge before. It caused problems.


This is where the improvement part of the discussion comes in :) For example, in the concrete case of CDN purges, the EventBus/ChangeProp system supports that out of the box, so instead of having the flow MW -> EB -> CP -> JR -> V we could have MW -> EB -> CP -> V. This is the way we are doing it for async updates, doing around 500-1000 purges per second.

I think we should sit down together (Wikidata/Services) and go over the operational side of WD jobs and see (a) how can the new JQ system best support it; and (b) what changes/improvements can be made on both sides to make the system more performant and robust. (Disclaimer: I am not claiming that there is something wrong, and confess my ignorance when it comes to WD, but as this ticket illustrates, there is definitely room for improvement)

But, this is getting a bit out of scope of this concrete ticket. For now, let's just try to get the size of the jobs below the 4MB mark? :)TASK DETAILhttps://phabricator.wikimedia.org/T175316EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Pchelolo, mobrovacCc: mobrovac, Stashbot, Legoktm, hoo, Addshore, aude, gerritbot, Ladsgroup, daniel, GWicke, Aklapper, Pchelolo, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Eevans, JAllemandou, Hardikj, Wikidata-bugs, Mbch331, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T175316: Very large jobs posted by Wikidata

2017-09-14 Thread mobrovac
mobrovac added a comment.

In T175316#3608364, @daniel wrote:
We can tweak the chunk size - more jobs, or larger jobs, your pick.


Since in the new JQ system all jobrunners will run all jobs, a higher number of smaller jobs are preferred over a smaller number of big jobs.TASK DETAILhttps://phabricator.wikimedia.org/T175316EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Pchelolo, mobrovacCc: mobrovac, Stashbot, Legoktm, hoo, Addshore, aude, gerritbot, Ladsgroup, daniel, GWicke, Aklapper, Pchelolo, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Eevans, JAllemandou, Hardikj, Wikidata-bugs, Mbch331, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T175316: Very large jobs posted by Wikidata

2017-09-08 Thread mobrovac
mobrovac edited projects, added Services (designing), EventBus; removed Services (doing).Herald added a project: Analytics.
TASK DETAILhttps://phabricator.wikimedia.org/T175316EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Pchelolo, mobrovacCc: daniel, GWicke, Aklapper, Pchelolo, GoranSMilovanovic, QZanden, Izno, Eevans, JAllemandou, mobrovac, Hardikj, Wikidata-bugs, aude, Mbch331, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop

2017-09-07 Thread mobrovac
mobrovac added a comment.

In T173710#3588015, @Joe wrote:
Wikibase refreshlinks jobs might benefit from being in smaller batches


+1 on this. As we have now all jobs being emitted to EventBus as well, we have had Kafka reject a portion of the jobs because they were larger than 4MB each. Upon inspection, we saw that these were endless lists of titles sent as one refreshLinks job by Wikibase.TASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: mobrovac, Nikerabbit, Mholloway, Legoktm, ema, Joe, GWicke, Nemo_bis, Andreasmperu, BBlack, Peachey88, Liuxinyu970226, daniel, Stashbot, Agabi10, Daniel_Mietchen, Harej, XXN, Pasleim, Bugreporter, Sjoerddebruin, Magnus, Mr.Ibrahem, gerritbot, EBernhardson, Esc3300, jcrespo, WMDE-leszek, Jdforrester-WMF, Krinkle, aaron, fgiunchedi, Aklapper, Ladsgroup, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, Vali.matei, Avner, Lewizho99, Zppix, Maathavan, debt, Gehel, FloNight, Izno, Eevans, Hardikj, Wikidata-bugs, aude, jayvdb, faidon, Mbch331, Jay8g, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T172832: Investigate use-cases for delayed job executions

2017-08-09 Thread mobrovac
mobrovac added a comment.
@hoo, @daniel let's talk about it tomorrow during the hackathon day 2?TASK DETAILhttps://phabricator.wikimedia.org/T172832EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Pchelolo, mobrovacCc: daniel, PokestarFan, hoo, Aklapper, Joe, elukey, Ottomata, Nuria, mobrovac, GWicke, Pchelolo, GoranSMilovanovic, QZanden, Izno, Eevans, JAllemandou, Hardikj, Wikidata-bugs, aude, Mbch331, Jay8g, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T167787: [Spike 2hr] Investigate ability for page previews in wikidata to appear in user's preferred language

2017-06-20 Thread mobrovac
mobrovac added projects: Services (blocked), RESTBase-API.mobrovac added a comment.

In T167787#3364809, @GWicke wrote:
The caveat is that we discussed Accept-Language in the context of supporting language variants in the REST API.


Correct, but we discussed language selection in general for that RfC, and consequently I think that this should be the way to go, as intuitively language selection is to a language-independent project what language-variant selection is to a language-scoped one.TASK DETAILhttps://phabricator.wikimedia.org/T167787EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: Jdlrobson, GWicke, mobrovac, Pchelolo, bmansurov, Jhernandez, Nirzar, Tbayer, Aklapper, Lydia_Pintscher, phuedx, ovasileva, GoranSMilovanovic, QZanden, Winter, Izno, Eevans, Hardikj, Wikidata-bugs, aude, Ricordisamoa, Se4598, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T166042: Put Wikibase Statements (and possibly other parts of entities) into restbase

2017-05-29 Thread mobrovac
mobrovac added projects: Services (designing), RESTBase-API.
TASK DETAILhttps://phabricator.wikimedia.org/T166042EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: aude, Lydia_Pintscher, GWicke, Aklapper, hoo, GoranSMilovanovic, QZanden, Izno, Eevans, mobrovac, Hardikj, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Closed] T150737: Error for the property math formula in some languages

2016-11-22 Thread mobrovac
mobrovac closed this task as "Resolved".mobrovac edited projects, added Services (done); removed Services (doing).mobrovac added a comment.
The PR has been deployed and the error isn't appearing any more. Resolving.TASK DETAILhttps://phabricator.wikimedia.org/T150737EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: Pchelolo, Nikki, hoo, GWicke, mobrovac, Physikerwelt, Lea_Lacroix_WMDE, Aklapper, Debenben, D3r1ck01, Izno, Eevans, Hardikj, Wikidata-bugs, Prod, aude, fredw, Pkra, scfc, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Claimed] T150737: Error for the property math formula in some languages

2016-11-22 Thread mobrovac
mobrovac added projects: Services (doing), User-mobrovac, RESTBase, RESTBase-API.mobrovac triaged this task as "High" priority.mobrovac claimed this task.mobrovac added a comment.
Ups. PR #719 fixes it.TASK DETAILhttps://phabricator.wikimedia.org/T150737EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: Pchelolo, Nikki, hoo, GWicke, mobrovac, Physikerwelt, Lea_Lacroix_WMDE, Aklapper, Debenben, D3r1ck01, Izno, Eevans, Hardikj, Wikidata-bugs, Prod, aude, fredw, Pkra, scfc, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Changed Status] T149456: Wikidata description change doesn't trigger mobile-sections update

2016-11-09 Thread mobrovac
mobrovac changed the task status from "Open" to "Stalled".mobrovac added a comment.

In T149456#2783473, @bearND wrote:
I want to keep this one open for a bit to give the Wikidata folks a chance to provide info if our solution could be improved. We might have to add more to the regex. There could be also a whole different way to restrict WD events to description changes.


Setting as stalled until that happens :)TASK DETAILhttps://phabricator.wikimedia.org/T149456EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Pchelolo, mobrovacCc: Niedzielski, mobrovac, daniel, aude, hoo, Pchelolo, Aklapper, Dbrant, Mholloway, gerritbot, bearND, Designsbydavesconcepts, NHarateh_WMF, Serumulapiet, Lewizho99, Maathavan, D3r1ck01, donaldepig, Izno, Eevans, Hardikj, Wikidata-bugs, AuFCL, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Closed] T149114: Reconsider wikidata support in the REST API

2016-11-03 Thread mobrovac
mobrovac closed this task as "Resolved".mobrovac claimed this task.mobrovac added a comment.
The REST API is back on www.wikidata.org. I don' think there is more work to be done here, so closing.TASK DETAILhttps://phabricator.wikimedia.org/T149114EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: Stashbot, gerritbot, Lydia_Pintscher, mobrovac, bearND, Mholloway, Pchelolo, Eevans, daniel, Aklapper, GWicke, Lewizho99, Maathavan, D3r1ck01, Izno, Hardikj, Wikidata-bugs, aude, AuFCL, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T149114: Reconsider wikidata support in the REST API

2016-11-03 Thread mobrovac
mobrovac added a comment.

In T149114#2768351, @Lydia_Pintscher wrote:
Does this also affect wikitext pages on Wikidata?


It affects the whole domain.

Because that seems like not what we want.

Mind elaborating on that?

FYI, test.wd.org and www.wd.org have been removed and don't have the REST API any more.TASK DETAILhttps://phabricator.wikimedia.org/T149114EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: Stashbot, gerritbot, Lydia_Pintscher, mobrovac, bearND, Mholloway, Pchelolo, Eevans, daniel, Aklapper, GWicke, Lewizho99, Maathavan, D3r1ck01, Izno, Hardikj, Wikidata-bugs, aude, AuFCL, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T149114: Reconsider wikidata support in the REST API

2016-11-03 Thread mobrovac
mobrovac added a comment.
Change-prop is not receiving WD updates any more. The only piece left is to remove the domain from RESTBase.TASK DETAILhttps://phabricator.wikimedia.org/T149114EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: gerritbot, Lydia_Pintscher, mobrovac, bearND, Mholloway, Pchelolo, Eevans, daniel, Aklapper, GWicke, Lewizho99, Maathavan, D3r1ck01, Izno, Hardikj, Wikidata-bugs, aude, AuFCL, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Triaged] T149456: Wikidata description change doesn't trigger mobile-sections update

2016-11-02 Thread mobrovac
mobrovac edited projects, added Services (watching), User-mobrovac; removed Services (doing).mobrovac triaged this task as "Normal" priority.mobrovac added a comment.
The work-around has been deployed, so the imminent problem should be resolved, but let's continue the discussion about finding the proper way of dealing with this.TASK DETAILhttps://phabricator.wikimedia.org/T149456EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Pchelolo, mobrovacCc: mobrovac, daniel, aude, hoo, Pchelolo, Aklapper, Dbrant, Mholloway, gerritbot, bearND, Designsbydavesconcepts, NHarateh_WMF, Kaartic, Serumulapiet, Lewizho99, Maathavan, D3r1ck01, donaldepig, Izno, Eevans, Hardikj, Wikidata-bugs, AuFCL, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T149114: Reconsider wikidata support in the REST API

2016-11-01 Thread mobrovac
mobrovac added a comment.
I'm ok with it too, but would love some input from #wikidata folks before we proceed.TASK DETAILhttps://phabricator.wikimedia.org/T149114EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: mobrovac, bearND, Mholloway, Pchelolo, Eevans, daniel, Aklapper, GWicke, D3r1ck01, Izno, Hardikj, Wikidata-bugs, aude, AuFCL, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T102476: RFC: Requirements for change propagation

2016-05-18 Thread mobrovac
mobrovac added a project: EventBus.

TASK DETAIL
  https://phabricator.wikimedia.org/T102476

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RobLa-WMF, mobrovac
Cc: Ottomata, Smalyshev, ArielGlenn, hoo, Addshore, RobLa-WMF, StudiesWorld, 
intracer, JanZerebecki, brion, Ltrlg, Anomie, Milimetric, mark, BBlack, aaron, 
daniel, Eevans, mobrovac, GWicke, D3r1ck01, Izno, Luke081515, Hardikj, 
Wikidata-bugs, aude, jayvdb, fbstj, Mbch331, Jay8g, bd808, Legoktm



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Unblock] T84923: Reliable publish / subscribe event bus

2016-04-27 Thread mobrovac
mobrovac closed blocking task T114443: EventBus MVP as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T84923

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: GWicke, mobrovac
Cc: Aklapper, Matanya, Ottomata, mmodell, Eevans, chasemp, brion, Krenair, 
Halfak, JanZerebecki, bd808, MZMcBride, mobrovac, GWicke, aaron, daniel, 
Hardikj, yuvipanda, Avner, debt, Gehel, D3r1ck01, FloNight, Izno, JAllemandou, 
jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, 
RobLa-WMF, Mbch331, Jay8g, jeremyb



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Closed] T114443: EventBus MVP

2016-04-27 Thread mobrovac
mobrovac closed this task as "Resolved".
mobrovac added a comment.


  And we're done here!

TASK DETAIL
  https://phabricator.wikimedia.org/T114443

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ottomata, mobrovac
Cc: yuvipanda, JanZerebecki, Glaisher, Milimetric, RobLa-WMF, brion, intracer, 
Smalyshev, mark, MZMcBride, Krinkle, EBernhardson, bd808, Joe, dr0ptp4kt, 
madhuvishy, Nuria, ori, faidon, aaron, GWicke, mobrovac, Eevans, Ottomata, 
Matanya, Aklapper, Avner, debt, Gehel, D3r1ck01, FloNight, Izno, JAllemandou, 
jkroll, Hardikj, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, jayvdb, 
fbstj, Mbch331, Jay8g, Ltrlg, jeremyb, Legoktm



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Unblock] T114443: EventBus MVP

2016-04-27 Thread mobrovac
mobrovac closed blocking task T116786: Integrate eventbus-based event 
production into MediaWiki as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T114443

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ottomata, mobrovac
Cc: yuvipanda, JanZerebecki, Glaisher, Milimetric, RobLa-WMF, brion, intracer, 
Smalyshev, mark, MZMcBride, Krinkle, EBernhardson, bd808, Joe, dr0ptp4kt, 
madhuvishy, Nuria, ori, faidon, aaron, GWicke, mobrovac, Eevans, Ottomata, 
Matanya, Aklapper, Avner, debt, Gehel, D3r1ck01, FloNight, Izno, JAllemandou, 
jkroll, Hardikj, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, jayvdb, 
fbstj, Mbch331, Jay8g, Ltrlg, jeremyb, Legoktm



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Unblock] T114443: EventBus MVP

2016-04-01 Thread mobrovac
mobrovac closed blocking task T128463: New Service Request - Change Propagation 
as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T114443

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ottomata, mobrovac
Cc: yuvipanda, JanZerebecki, Glaisher, Milimetric, RobLa-WMF, brion, intracer, 
Smalyshev, mark, MZMcBride, Krinkle, EBernhardson, bd808, Joe, dr0ptp4kt, 
madhuvishy, Nuria, ori, faidon, aaron, GWicke, mobrovac, Eevans, Ottomata, 
Matanya, Aklapper, Avner, debt, TerraCodes, Gehel, D3r1ck01, FloNight, Izno, 
JAllemandou, jkroll, Hardikj, Wikidata-bugs, Jdouglas, aude, Deskana, 
Manybubbles, jayvdb, fbstj, Mbch331, Jay8g, Ltrlg, jeremyb, Legoktm



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T114443: EventBus MVP

2016-03-01 Thread mobrovac
mobrovac added a comment.


  In https://phabricator.wikimedia.org/T114443#2077418, @RobLa-WMF wrote:
  
  > I realize that the blocking relationship is transitive, but given Otto's 
comment (https://phabricator.wikimedia.org/T114443#2072426), it would seem that 
it would be clearer to make the blocking relationship specific, rather than 
obscuring it in a hierarchy.  Would you mind if I put 
https://phabricator.wikimedia.org/T120212 as a direct blocker for this task?
  
  
  Nope. {{done}}

TASK DETAIL
  https://phabricator.wikimedia.org/T114443

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ottomata, mobrovac
Cc: yuvipanda, JanZerebecki, Glaisher, Milimetric, RobLa-WMF, brion, intracer, 
Smalyshev, mark, MZMcBride, Krinkle, EBernhardson, bd808, Joe, dr0ptp4kt, 
madhuvishy, Nuria, ori, faidon, aaron, GWicke, mobrovac, Eevans, Ottomata, 
Matanya, Aklapper, debt, Gehel, D3r1ck01, FloNight, Izno, JAllemandou, jkroll, 
Hardikj, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, jayvdb, daniel, 
Mbch331, Jay8g, Ltrlg, jeremyb, Legoktm



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T114443: EventBus MVP

2016-03-01 Thread mobrovac
mobrovac added a blocking task: T120212: Security review of EventBus extension.

TASK DETAIL
  https://phabricator.wikimedia.org/T114443

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ottomata, mobrovac
Cc: yuvipanda, JanZerebecki, Glaisher, Milimetric, RobLa-WMF, brion, intracer, 
Smalyshev, mark, MZMcBride, Krinkle, EBernhardson, bd808, Joe, dr0ptp4kt, 
madhuvishy, Nuria, ori, faidon, aaron, GWicke, mobrovac, Eevans, Ottomata, 
Matanya, Aklapper, debt, Gehel, D3r1ck01, FloNight, Izno, JAllemandou, jkroll, 
Hardikj, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, jayvdb, daniel, 
Mbch331, Jay8g, Ltrlg, jeremyb, Legoktm



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T114443: EventBus MVP

2016-03-01 Thread mobrovac
mobrovac added a comment.


  In https://phabricator.wikimedia.org/T114443#2076614, @RobLa-WMF wrote:
  
  > @mobrovac - I'm confused, why don't you think 
https://phabricator.wikimedia.org/T120212 is a blocker for this?
  
  
  It is, but it's an indirect one: it is blocking T116786: Integrate 
eventbus-based event production into MediaWiki 
<https://phabricator.wikimedia.org/T116786> which is a blocker for this task 
and whose resolution depends solely on 
https://phabricator.wikimedia.org/T120212 .

TASK DETAIL
  https://phabricator.wikimedia.org/T114443

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ottomata, mobrovac
Cc: yuvipanda, JanZerebecki, Glaisher, Milimetric, RobLa-WMF, brion, intracer, 
Smalyshev, mark, MZMcBride, Krinkle, EBernhardson, bd808, Joe, dr0ptp4kt, 
madhuvishy, Nuria, ori, faidon, aaron, GWicke, mobrovac, Eevans, Ottomata, 
Matanya, Aklapper, debt, Gehel, D3r1ck01, FloNight, Izno, JAllemandou, jkroll, 
Hardikj, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, jayvdb, daniel, 
Mbch331, Jay8g, Ltrlg, jeremyb, Legoktm



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T114443: EventBus MVP

2016-03-01 Thread mobrovac
mobrovac edited blocking tasks, added: T128463: New Service Request - Change 
Propagation; removed: T120212: Security review of EventBus extension.

TASK DETAIL
  https://phabricator.wikimedia.org/T114443

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ottomata, mobrovac
Cc: yuvipanda, JanZerebecki, Glaisher, Milimetric, RobLa-WMF, brion, intracer, 
Smalyshev, mark, MZMcBride, Krinkle, EBernhardson, bd808, Joe, dr0ptp4kt, 
madhuvishy, Nuria, ori, faidon, aaron, GWicke, mobrovac, Eevans, Ottomata, 
Matanya, Aklapper, debt, Gehel, D3r1ck01, FloNight, Izno, JAllemandou, jkroll, 
Hardikj, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, jayvdb, daniel, 
Mbch331, Jay8g, Ltrlg, jeremyb, Legoktm



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Changed Subscribers] T114019: Dumps 2.0 for realz (planning/architecture session)

2016-02-02 Thread mobrovac
mobrovac added a subscriber: mobrovac.

TASK DETAIL
  https://phabricator.wikimedia.org/T114019

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: ArielGlenn, mobrovac
Cc: mobrovac, jberkel, NealMcB, jcrespo, Bianjiang, madhuvishy, Milimetric, 
RobLa-WMF, GWicke, TTO, zhuyifei1999, StudiesWorld, gnosygnu, LA2, Ladsgroup, 
intracer, Lokal_Profil, Halfak, Legoktm, JanZerebecki, brion, daniel, Hydriz, 
MZMcBride, hoo, ezachte, wpmirrordev, Nemo_bis, Aklapper, ArielGlenn, Izno, 
Wikidata-bugs, aude, Mbch331, Jay8g, Krenair



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Unblock] T102476: RFC: Requirements for change propagation

2016-01-12 Thread mobrovac
mobrovac closed blocking task T116247: Define edit related events for change 
propagation as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T102476

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: GWicke, mobrovac
Cc: Addshore, RobLa-WMF, StudiesWorld, intracer, Qgil, JanZerebecki, brion, 
Ltrlg, Anomie, Milimetric, mark, BBlack, aaron, daniel, Eevans, mobrovac, 
GWicke, Hardikj, Wikidata-bugs, aude, jayvdb, Mbch331, Jay8g, bd808, Krenair, 
Legoktm



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Unblock] T84923: Reliable publish / subscribe event bus

2016-01-12 Thread mobrovac
mobrovac closed blocking task T116247: Define edit related events for change 
propagation as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T84923

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: mobrovac
Cc: Aklapper, Matanya, Ottomata, mmodell, Eevans, chasemp, brion, Krenair, 
Halfak, JanZerebecki, bd808, MZMcBride, mobrovac, GWicke, aaron, daniel, 
Hardikj, yuvipanda, JAllemandou, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, 
aude, Deskana, Manybubbles, RobLa-WMF, Mbch331, jeremyb



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Closed] T116247: Define edit related events for change propagation

2016-01-12 Thread mobrovac
mobrovac closed this task as "Resolved".
mobrovac added a comment.

Indeed. We are done here.


TASK DETAIL
  https://phabricator.wikimedia.org/T116247

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: mobrovac
Cc: RobLa-WMF, Nuria, gerritbot, intracer, EBernhardson, Smalyshev, yuvipanda, 
Hardikj, daniel, aaron, GWicke, mobrovac, MZMcBride, bd808, JanZerebecki, 
Halfak, Krenair, brion, chasemp, Eevans, mmodell, Ottomata, Matanya, Aklapper, 
JAllemandou, jkroll, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, 
Mbch331, jeremyb



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


  1   2   >