date:20170406

[Wikidata-bugs] [Maniphest] [Changed Status] T148928: Wikidata integration for proveit gadget

2017-04-06 Thread Sophivorus

Sophivorus changed the task status from "Stalled" to "Open".Sophivorus added a comment.
The new REST API offers a simple way to get citation data out of a URL, DOI, PMID, etc.
https://en.wikipedia.org/api/rest_v1/#!/Citation/getCitation
This, coupled with the Citoid parameter map already available for all the main templates, could greatly simplify the task of adding a Citoid service to ProveIt!TASK DETAILhttps://phabricator.wikimedia.org/T148928EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SophivorusCc: Mvolz, Daniel_Mietchen, Iniquity, Sophivorus, QZanden, merbst, Salgo60, Wess, D3r1ck01, Phil_Boswell, Shangkuanlc, Izno, Cumbril, Jrf, Husun1297, mobrovac, Wikidata-bugs, Etonkovidova, aude, Swainr, Jdforrester-WMF, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T162250: Query Service: "order by" doesn't work on graph views

2017-04-06 Thread Smalyshev

Smalyshev added a comment.
Ordering by coordinate is a bit weird, I'm not even sure what exactly happens there, as coordinate is a compound data type. Need to check that...

Incidentally, it probably would be good to have functions to extract single coordinate, that way it could be sorted by one of them.TASK DETAILhttps://phabricator.wikimedia.org/T162250EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, VIGNERON, LucasWerkmeister, Jonas, Lea_Lacroix_WMDE, Aklapper, QZanden, EBjune, merbst, Salgo60, Avner, debt, Gehel, D3r1ck01, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T153729: CI tests throw warning "Cannot find site mywiki in sites table"

2017-04-06 Thread gerritbot

gerritbot added a comment.
Change 346916 had a related patch set uploaded (by Paladox; owner: Daniel Kinzler):
[mediawiki/extensions/Wikibase@REL1_27] Use default wiki id in example settings.

https://gerrit.wikimedia.org/r/346916TASK DETAILhttps://phabricator.wikimedia.org/T153729EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Tgr, gerritbotCc: Tobi_WMDE_SW, KartikMistry, Amire80, santhosh, StudiesWorld, JanZerebecki, hoo, aude, Bene, demon, hashar, daniel, Lydia_Pintscher, thiemowmde, Nikerabbit, TerraCodes, Jay8g, gerritbot, Paladox, Aklapper, Tgr, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Salgo60, Lewizho99, Maathavan, D3r1ck01, Izno, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T161731: Create reliable change stream for specific wiki

2017-04-06 Thread Smalyshev

Smalyshev added a comment.
FYI, neither base Kafka Consumer clients nor EventStreams does this.

Yes, I know :) It's one of the decisions I still haven't figured out - how much I can/should do on the backend so I don't have to do it on the client, vs sending the client the raw firehose output and let it do all the work. Minimal req is reliability (which I don't have now) but I am also interested in better performance such as making clients download and process less irrelevant data.TASK DETAILhttps://phabricator.wikimedia.org/T161731EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ottomata, SmalyshevCc: Anomie, Aklapper, Smalyshev, QZanden, EBjune, merbst, Salgo60, Avner, debt, Gehel, D3r1ck01, Jonas, FloNight, Xmlizer, Izno, JAllemandou, mobrovac, jkroll, Wikidata-bugs, Jdouglas, aude, GWicke, Deskana, Manybubbles, Mbch331, Krenair, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T161731: Create reliable change stream for specific wiki

2017-04-06 Thread Ottomata

Ottomata added a comment.
I'd rather have some intermediary that cleans up, deduplicates, etc. the changes.

FYI, neither base Kafka Consumer clients nor EventStreams does this.TASK DETAILhttps://phabricator.wikimedia.org/T161731EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: OttomataCc: Anomie, Aklapper, Smalyshev, QZanden, EBjune, merbst, Salgo60, Avner, debt, Gehel, D3r1ck01, Jonas, FloNight, Xmlizer, Izno, JAllemandou, mobrovac, jkroll, Wikidata-bugs, Jdouglas, aude, GWicke, Deskana, Manybubbles, Mbch331, Krenair, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T161731: Create reliable change stream for specific wiki

2017-04-06 Thread Smalyshev

Smalyshev added a comment.
It will be more, a lot more. What language are you working in?

The end consumer will be Java, but I don't want to consume the raw Kafka stream from Java, I'd rather have some intermediary that cleans up, deduplicates, etc. the changes.

Load balanced parallel consumers, or all distinct consumers doing different stuff?

All distinct. They will be pretty close to each other, but nothing forces them to consume exactly the same things, they are completely independent.

If any of those processes goes down, a different consumer process will be auto-assigned its work.

That's kind of the opposite of what I need :) Each client is independent and should get all the updates.TASK DETAILhttps://phabricator.wikimedia.org/T161731EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ottomata, SmalyshevCc: Anomie, Aklapper, Smalyshev, QZanden, EBjune, merbst, Salgo60, Avner, debt, Gehel, D3r1ck01, Jonas, FloNight, Xmlizer, Izno, JAllemandou, mobrovac, jkroll, Wikidata-bugs, Jdouglas, aude, GWicke, Deskana, Manybubbles, Mbch331, Krenair, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T161731: Create reliable change stream for specific wiki

2017-04-06 Thread Ottomata

Ottomata added a comment.
If so, you may want to consider consuming from Kafka rather than EventStreams.

I am considering this too, but I assume it's more code for me to write (maybe wrongly, I didn't look at it closely).

It will be more, a lot more.  What language are you working in?

But what in fact I need is something like 10-20 parallel consumers

Load balanced parallel consumers, or all distinct consumers doing different stuff?

Nice thing about using a Kafka client directly, is you can subscribe to multiple topics/partitions in a single consumer group, and have the load automatically balanced between them (up to the total number of topic-partitions).  If any of those processes goes down, a different consumer process will be auto-assigned its work.TASK DETAILhttps://phabricator.wikimedia.org/T161731EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: OttomataCc: Anomie, Aklapper, Smalyshev, QZanden, EBjune, merbst, Salgo60, Avner, debt, Gehel, D3r1ck01, Jonas, FloNight, Xmlizer, Izno, JAllemandou, mobrovac, jkroll, Wikidata-bugs, Jdouglas, aude, GWicke, Deskana, Manybubbles, Mbch331, Krenair, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T161731: Create reliable change stream for specific wiki

2017-04-06 Thread Smalyshev

Smalyshev added a comment.
let's jump in a hangout sometime to discuss this more.

Would be glad to. I'll try to set up something next week.

If there is a desire, we can expose these in EventStreams. Do you have desire? :)

Yes, see T145712 - recentchanges ignores pageprops updates, and it would be nice to have those too.

Does WDQS run in production?

Yes.

If so, you may want to consider consuming from Kafka rather than EventStreams.

I am considering this too, but I assume it's more code for me to write (maybe wrongly, I didn't look at it closely).

Kafka consumers support parallelization and scale much better than the EventStreams HTTP Kafka consumer proxy.

I may have written requirements to ask for more than I need, it gives an impression it has to serve Wikipedia-scale consumer load maybe. But what in fact I need is something like 10-20 parallel consumers, that order of magnitude. So I don't really foresee too much problem here as long as it doesn't require doing unindexed DB queries. I expect both Kafka and ES be fine with it.TASK DETAILhttps://phabricator.wikimedia.org/T161731EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ottomata, SmalyshevCc: Anomie, Aklapper, Smalyshev, QZanden, EBjune, merbst, Salgo60, Avner, debt, Gehel, D3r1ck01, Jonas, FloNight, Xmlizer, Izno, JAllemandou, mobrovac, jkroll, Wikidata-bugs, Jdouglas, aude, GWicke, Deskana, Manybubbles, Mbch331, Krenair, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T162230: Updater gets stuck if batchSize is short

2017-04-06 Thread gerritbot

gerritbot added a comment.
Change 346676 merged by jenkins-bot:
[wikidata/query/rdf@master] Set backoff to only work for recent changes

https://gerrit.wikimedia.org/r/346676TASK DETAILhttps://phabricator.wikimedia.org/T162230EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Smalyshev, gerritbotCc: gerritbot, Aklapper, Smalyshev, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, Salgo60, Avner, Lewizho99, Maathavan, debt, Gehel, D3r1ck01, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Triaged] T161251: Themes from GLAM workshop workflow exercise

2017-04-06 Thread Capt_Swing

Capt_Swing triaged this task as "Normal" priority.
TASK DETAILhttps://phabricator.wikimedia.org/T161251EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Capt_SwingCc: Aklapper, Capt_Swing, Sadads, QZanden, Acer, Salgo60, D3r1ck01, SBecker, Izno, Wikidata-bugs, Base, matthiasmullie, aude, aripstra, Deskana, Ricordisamoa, Fabrice_Florin, Mbch331, Jay8g, Tgr___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T161251: Themes from GLAM workshop workflow exercise

2017-04-06 Thread Capt_Swing

Capt_Swing edited projects, added Design-Research; removed Design-Research-Backlog.
TASK DETAILhttps://phabricator.wikimedia.org/T161251EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Capt_SwingCc: Aklapper, Capt_Swing, Sadads, QZanden, Acer, Salgo60, D3r1ck01, SBecker, Izno, Wikidata-bugs, Base, matthiasmullie, aude, aripstra, Deskana, Ricordisamoa, Fabrice_Florin, Mbch331, Jay8g, Tgr___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T162331: Provide tools for processing obfuscated Chinese geodata (GCJ-02, BD-09)

2017-04-06 Thread Arthur2e5

Arthur2e5 added a comment.
Good question. With my AGF hat on, I would say that maps served in mainland China, Google or Baidu, also provide distorted/shift aerial imagery to mask the deviation applied, so "good guys" who look for places on the wrong aerial map are still screwed. With that map off by a bit, I should mention thatTASK DETAILhttps://phabricator.wikimedia.org/T162331EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Arthur2e5Cc: Pnorman, C933103, Aklapper, Arthur2e5, Cosine02, Liuxinyu970226, QZanden, Salgo60, D3r1ck01, Izno, Cwek, Wikidata-bugs, aude, zhuyifei1999, Shizhao, MaxSem, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T162331: Provide tools for processing obfuscated Chinese geodata (GCJ-02, BD-09)

2017-04-06 Thread Pnorman

Pnorman added a comment.
Is systematic copying of coordinates from other sources not problematic anyways because it means the data infringes copyright and/or DB rights in many jurisdictions?TASK DETAILhttps://phabricator.wikimedia.org/T162331EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PnormanCc: Pnorman, C933103, Aklapper, Arthur2e5, Cosine02, Liuxinyu970226, QZanden, Salgo60, D3r1ck01, Izno, Cwek, Wikidata-bugs, aude, zhuyifei1999, Shizhao, MaxSem, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T162331: Provide tools for processing obfuscated Chinese geodata (GCJ-02, BD-09)

2017-04-06 Thread Arthur2e5

Arthur2e5 added a comment.
For people looking for a solution for now, I have set up a simple user gadget for conversion (web version). I have added links to the web version to the CN section for GeoTemplate on zhwiki and enwiki. I am planning on adding the said map previews to the web demo, but that might take a few weeks of procrastination.TASK DETAILhttps://phabricator.wikimedia.org/T162331EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Arthur2e5Cc: C933103, Aklapper, Arthur2e5, Cosine02, Liuxinyu970226, QZanden, Salgo60, D3r1ck01, Izno, Cwek, Wikidata-bugs, aude, zhuyifei1999, Shizhao, MaxSem, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T162238: Watchlist in Wikipedia to also report changes to related Wikidata item

2017-04-06 Thread matej_suchanek

matej_suchanek added projects: Wikidata, MediaWiki-extensions-WikibaseClient.
TASK DETAILhttps://phabricator.wikimedia.org/T162238EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanekCc: matej_suchanek, Headbomb, Magioladitis, Aklapper, QZanden, Salgo60, D3r1ck01, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T125500: Index Wikidata labels and descriptions as separate fields in ElasticSearch

2017-04-06 Thread gerritbot

gerritbot added a comment.
Change 334194 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@master] Create mappings for Wikibase labels

https://gerrit.wikimedia.org/r/334194TASK DETAILhttps://phabricator.wikimedia.org/T125500EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Smalyshev, gerritbotCc: Jonas, gerritbot, JanZerebecki, daniel, thiemowmde, Tobi_WMDE_SW, Smalyshev, Aklapper, StudiesWorld, Deskana, aude, Ricordisamoa, hoo, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, Salgo60, Avner, Lewizho99, Maathavan, debt, Gehel, Jdrewniak, D3r1ck01, FloNight, Izno, Wikidata-bugs, jayvdb, Mbch331, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T161731: Create reliable change stream for specific wiki

2017-04-06 Thread Ottomata

Ottomata added a comment.
@Smalyshev let's jump in a hangout sometime to discuss this more.

Just a few quick points:

Does not have data back more than 7 days

We could probably bump this up to 14 days for specific topics like recentchange.

Scalable - there's no hard limit on the number of clients connecting

EventStreams does not have a 'hard limit', but it definitely isn't intended to be used for wiki-reader scale. Scalable service updates should be fine though.

Not consumable per-wiki due to the lack of filtering (T152731)

We haven't done this because we are waiting for a strong use case. Implementing it will be a lot of bike shedding, and we've put that off due to a lack of solid use case. If you really need this, say so, and we will start the bike shedding!

Qs:

We have a more than recentchange in other schemas, and we can add more. If there is a desire, we can expose these in EventStreams. Do you have desire? :)

Does WDQS run in production? I think it does, right? If so, you may want to consider consuming from Kafka rather than EventStreams. Kafka consumers support parallelization and scale much better than the EventStreams HTTP Kafka consumer proxy.

TASK DETAILhttps://phabricator.wikimedia.org/T161731EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: OttomataCc: Anomie, Aklapper, Smalyshev, QZanden, EBjune, merbst, Salgo60, Avner, debt, Gehel, D3r1ck01, Jonas, FloNight, Xmlizer, Izno, JAllemandou, mobrovac, jkroll, Wikidata-bugs, Jdouglas, aude, GWicke, Deskana, Manybubbles, Mbch331, Krenair, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Assigned] T161731: Create reliable change stream for specific wiki

2017-04-06 Thread Nuria

Nuria assigned this task to Ottomata.
TASK DETAILhttps://phabricator.wikimedia.org/T161731EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ottomata, NuriaCc: Anomie, Aklapper, Smalyshev, QZanden, EBjune, merbst, Salgo60, Avner, debt, Gehel, D3r1ck01, Jonas, FloNight, Xmlizer, Izno, JAllemandou, mobrovac, jkroll, Wikidata-bugs, Jdouglas, aude, GWicke, Deskana, Manybubbles, Mbch331, Krenair, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T159828: Use redis-based lock manager for dispatchChanges on test.wikidata.org

2017-04-06 Thread Stashbot

Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-04-06T16:17:19Z]  Synchronized wmf-config/Wikibase-production.php: Try using redisLockManager for test.wikidata.org (T159828) (duration: 00m 39s)TASK DETAILhttps://phabricator.wikimedia.org/T159828EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, StashbotCc: Stashbot, aude, gerritbot, aaron, Marostegui, jcrespo, Aklapper, Jonas, Lydia_Pintscher, hoo, daniel, Ladsgroup, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Salgo60, Lewizho99, Minhnv-2809, Maathavan, D3r1ck01, Izno, Luke081515, Wikidata-bugs, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T159828: Use redis-based lock manager for dispatchChanges on test.wikidata.org

2017-04-06 Thread gerritbot

gerritbot added a comment.
Change 345387 merged by jenkins-bot:
[operations/mediawiki-config@master] Try using redisLockManager for test.wikidata.org

https://gerrit.wikimedia.org/r/345387TASK DETAILhttps://phabricator.wikimedia.org/T159828EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, gerritbotCc: aude, gerritbot, aaron, Marostegui, jcrespo, Aklapper, Jonas, Lydia_Pintscher, hoo, daniel, Ladsgroup, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Salgo60, Lewizho99, Minhnv-2809, Maathavan, D3r1ck01, Izno, Luke081515, Wikidata-bugs, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T162371: Benchmark RDF dump with foreign ID mapping

2017-04-06 Thread daniel

daniel added a parent task: T161592: Account for foreign repositories in RDF mapping.
TASK DETAILhttps://phabricator.wikimedia.org/T162371EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, danielCc: Smalyshev, daniel, WMDE-leszek, Aklapper, QZanden, Salgo60, D3r1ck01, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T161592: Account for foreign repositories in RDF mapping

2017-04-06 Thread daniel

daniel added a subtask: T162371: Benchmark RDF dump with foreign ID mapping.
TASK DETAILhttps://phabricator.wikimedia.org/T161592EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszek, danielCc: gerritbot, daniel, Lydia_Pintscher, Aklapper, WMDE-leszek, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Salgo60, Lewizho99, Maathavan, D3r1ck01, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T162371: Benchmark RDF dump with foreign ID mapping

2017-04-06 Thread daniel

daniel created this task.daniel added projects: Wikidata, MediaWiki-extensions-WikibaseRepository.Herald added a subscriber: Aklapper.
TASK DESCRIPTION@WMDE-leszek wrote https://gerrit.wikimedia.org/r/#/c/345332 for T161592: Account for foreign repositories in RDF mapping. Since RDF generation is a performance hotspot, we should compare profiling data before and after applying the patch, to see what impact it has on performance.

Profiling should be done against a sample of live data, e.g. the first 50k items and properties. The benchmark should be repeated, to make sure it's not skewed by external factors.TASK DETAILhttps://phabricator.wikimedia.org/T162371EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, danielCc: Smalyshev, daniel, WMDE-leszek, Aklapper, QZanden, Salgo60, D3r1ck01, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T159828: Use redis-based lock manager for dispatchChanges on test.wikidata.org

2017-04-06 Thread gerritbot

gerritbot added a comment.
Change 346540 merged by jenkins-bot:
[operations/mediawiki-config@master] Temporarily enable change dispatch logging on testwikidata

https://gerrit.wikimedia.org/r/346540TASK DETAILhttps://phabricator.wikimedia.org/T159828EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, gerritbotCc: aude, gerritbot, aaron, Marostegui, jcrespo, Aklapper, Jonas, Lydia_Pintscher, hoo, daniel, Ladsgroup, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Salgo60, Lewizho99, Minhnv-2809, Maathavan, D3r1ck01, Izno, Luke081515, Wikidata-bugs, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T159828: Use redis-based lock manager for dispatchChanges on test.wikidata.org

2017-04-06 Thread gerritbot

gerritbot added a comment.
Change 346545 merged by Jcrespo:
[operations/puppet@production] Temporarily disable the change dispatch cron for testwikidata

https://gerrit.wikimedia.org/r/346545TASK DETAILhttps://phabricator.wikimedia.org/T159828EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, gerritbotCc: aude, gerritbot, aaron, Marostegui, jcrespo, Aklapper, Jonas, Lydia_Pintscher, hoo, daniel, Ladsgroup, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Salgo60, Lewizho99, Minhnv-2809, Maathavan, D3r1ck01, Izno, Luke081515, Wikidata-bugs, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

87 matches

Mail list logo