[Wikidata-bugs] [Maniphest] [Commented On] T221917: Create RDF dump of structured data on Commons

2019-06-10 Thread Smalyshev
Smalyshev added a comment. > Can we get away with a 'dumpwikibaserdf.sh' and some well-chosen variables for both wikidata and commons (or at worst two much much shorter scripts) instead of a whole new dumpcommonsrdf.sh? I thought about it, and it might be possible, but it would make the

[Wikidata-bugs] [Maniphest] [Commented On] T221917: Create RDF dump of structured data on Commons

2019-06-10 Thread ArielGlenn
ArielGlenn added a comment. A couple thoughts on the above patchset: Can we get away with a 'dumpwikibaserdf.sh' and some well-chosen variables for both wikidata and commons (or at worst two much much shorter scripts) instead of a whole new dumpcommonsrdf.sh? Additionally, we

[Wikidata-bugs] [Maniphest] [Commented On] T221917: Create RDF dump of structured data on Commons

2019-06-10 Thread gerritbot
gerritbot added a comment. Change 516444 had a related patch set uploaded (by Smalyshev; owner: Smalyshev): [operations/puppet@production] Set up dumps for mediainfo RDF generation https://gerrit.wikimedia.org/r/516444 TASK DETAIL https://phabricator.wikimedia.org/T221917 EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T221917: Create RDF dump of structured data on Commons

2019-06-10 Thread gerritbot
gerritbot added a comment. Change 516441 had a related patch set uploaded (by Smalyshev; owner: Smalyshev): [mediawiki/extensions/Wikibase@master] Add option --ignore-missing to dumper https://gerrit.wikimedia.org/r/516441 TASK DETAIL https://phabricator.wikimedia.org/T221917 EMAIL

[Wikidata-bugs] [Maniphest] [Updated] T221917: Create RDF dump of structured data on Commons

2019-06-10 Thread gerritbot
gerritbot added a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T221917 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: gerritbot Cc: WMDE-leszek, Poyekhali, Steinsplitter, Aklapper, Lydia_Pintscher, Bugreporter, Tgr,

[Wikidata-bugs] [Maniphest] [Unblock] T221916: Create RDF export for structured data stored for files

2019-06-10 Thread Smalyshev
Smalyshev closed subtask T222995: Decide which prefixes to use for MediaInfo RDF as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T221916 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: WMDE-leszek, Poyekhali, Steinsplitter,

[Wikidata-bugs] [Maniphest] [Closed] T222995: Decide which prefixes to use for MediaInfo RDF

2019-06-10 Thread Smalyshev
Smalyshev closed this task as "Resolved". Smalyshev claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T222995 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Denny, mkroetzsch, Mholloway, Cparle, daniel,

[Wikidata-bugs] [Maniphest] [Merged] T225364: Class undefined: Wikibase\DataModel\Entity\ItemId in WikibaseLib.entitytypes.php on line 35

2019-06-10 Thread matmarex
matmarex closed this task as a duplicate of T189560: mediawiki/vendor REL1_* no longer ship dependencies for wmf extensions that are not in the mediawiki tarball. TASK DETAIL https://phabricator.wikimedia.org/T225364 EMAIL PREFERENCES

[Wikidata] [OM-2019] Final CFP: 14th workshop on Ontology Matching collocated with ISWC

2019-06-10 Thread Pavel Shvaiko
... Most often we need to integrate together data sources that were not aiming at their integration while being designed, thus, increasing the difficulty of the matching operation. Even if a good progress has been made in the matching field as such, ontology matching may appear to be virtually

[Wikidata-bugs] [Maniphest] [Updated] T194101: Add more metrics to WDQS

2019-06-10 Thread Maintenance_bot
Maintenance_bot removed a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T194101 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Maintenance_bot Cc: Aklapper, Gehel, Smalyshev, darthmon_wmde, ET4Eva, Nandana, Lahi, Gq86,

[Wikidata-bugs] [Maniphest] [Commented On] T194101: Add more metrics to WDQS

2019-06-10 Thread gerritbot
gerritbot added a comment. Change 514645 **merged** by jenkins-bot: [wikidata/query/rdf@master] Add metering of federation requests https://gerrit.wikimedia.org/r/514645 TASK DETAIL https://phabricator.wikimedia.org/T194101 EMAIL PREFERENCES

Re: [Wikidata] Scaling Wikidata Query Service

2019-06-10 Thread Sebastian Hellmann
Yes, I can ask. I am talking a lot with them as we are redeploying DBpedia live and also pushing the new DBpedia to them soon. I think, they also had a specific issue with how Wikidata does linked data, but I didn't get it, as it was mentioned too briefly. All the best, Sebastian On

Re: [Wikidata] Scaling Wikidata Query Service

2019-06-10 Thread Stas Malyshev
Hi! > thanks for the elaboration. I can understand the background much better. > I have to admit, that I am also not a real expert, but very close to the > real experts like Vidal and Rahm who are co-authors of the SWJ paper or > the OpenLink devs. If you know anybody at OpenLink that would be

Re: [Wikidata] Scaling Wikidata Query Service

2019-06-10 Thread Sebastian Hellmann
Hi Stas, thanks for the elaboration. I can understand the background much better. I have to admit, that I am also not a real expert, but very close to the real experts like Vidal and Rahm who are co-authors of the SWJ paper or the OpenLink devs. I am also spoiled, because OpenLink solves

Re: [Wikidata] Scaling Wikidata Query Service

2019-06-10 Thread Stas Malyshev
Hi! > Yes, sharding is what you need, I think, instead of replication. This is > the technique where data is repartitioned into more manageable chunks > across servers. Agreed, if we are to get any solution that is not constrained by hardware limits of a single server, we can not avoid looking

Re: [Wikidata] Scaling Wikidata Query Service

2019-06-10 Thread Stas Malyshev
Hi! > I am not sure how to evaluate this correctly. Scaling databases in > general is a "known hard problem" and graph databases a sub-field of it, > which are optimized for graph-like queries as opposed to column stores > or relational databases. If you say that "throwing hardware at the >

Re: [Wikidata] Scaling Wikidata Query Service

2019-06-10 Thread Guillaume Lederrey
On Mon, Jun 10, 2019 at 9:03 PM Sebastian Hellmann wrote: > > Hi Guillaume, > > On 10.06.19 16:54, Guillaume Lederrey wrote: > > Hello! > > On Mon, Jun 10, 2019 at 4:28 PM Sebastian Hellmann > wrote: > > Hi Guillaume, > > On 06.06.19 21:32, Guillaume Lederrey wrote: > > Hello all! > > There has

Re: [Wikidata] Scaling Wikidata Query Service

2019-06-10 Thread Sebastian Hellmann
Hi Guillaume, On 10.06.19 16:54, Guillaume Lederrey wrote: Hello! On Mon, Jun 10, 2019 at 4:28 PM Sebastian Hellmann wrote: Hi Guillaume, On 06.06.19 21:32, Guillaume Lederrey wrote: Hello all! There has been a number of concerns raised about the performance and scaling of Wikdata Query

[Wikidata-bugs] [Maniphest] [Updated] T217018: Upgrade Wikibase extension to use newer phan

2019-06-10 Thread Jdforrester-WMF
Jdforrester-WMF added a parent task: T225456: Run phan on PHP 7.2, not PHP 7.0. TASK DETAIL https://phabricator.wikimedia.org/T217018 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Jdforrester-WMF Cc: Jdforrester-WMF, matej_suchanek, gerritbot,

[Wikidata-bugs] [Maniphest] [Updated] T217018: Upgrade Wikibase extension to use newer phan

2019-06-10 Thread Jdforrester-WMF
Jdforrester-WMF added a comment. This is blocking T225456 because the version of phan Wikibase master is using is so old. :-( TASK DETAIL https://phabricator.wikimedia.org/T217018 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] [Commented On] T170281: Raise PHP version requirement of Wikibase (and its related extensions) to 5.6

2019-06-10 Thread Jdforrester-WMF
Jdforrester-WMF added a comment. Can we declare this done? :-) TASK DETAIL https://phabricator.wikimedia.org/T170281 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Jdforrester-WMF Cc: Jdforrester-WMF, Paladox, Ricordisamoa, PokestarFan,

[Wikidata-bugs] [Maniphest] [Updated] T198557: Remove support for legacy pre-MCR schema

2019-06-10 Thread CCicalese_WMF
CCicalese_WMF edited projects, added MW-1.34-release; removed MW-1.33-release. CCicalese_WMF added a comment. Agree, this should be moved to 1.34. TASK DETAIL https://phabricator.wikimedia.org/T198557 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/

[Wikidata-bugs] [Maniphest] [Updated] T198492: Drop rev_text_id and ar_text_id when running update.php

2019-06-10 Thread CCicalese_WMF
CCicalese_WMF edited projects, added MW-1.34-release; removed MW-1.33-release. TASK DETAIL https://phabricator.wikimedia.org/T198492 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: CCicalese_WMF Cc: Aklapper, Anomie, Jdforrester-WMF, Tgr, daniel,

[Wikidata-bugs] [Maniphest] [Commented On] T138332: interwiki links to/from Multilingual Wikisource

2019-06-10 Thread Jarekt
Jarekt added a comment. I run into this problem, when dealing with unusual sitelinks, which are not displayed. For example Q62081484 seems to be an empty item with nothing in it other than label in italian, but closer look

[Wikidata-bugs] [Maniphest] [Updated] T214308: Force usage of MCR aware database schema

2019-06-10 Thread CCicalese_WMF
CCicalese_WMF set the point value for this task to "1". TASK DETAIL https://phabricator.wikimedia.org/T214308 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: CCicalese_WMF Cc: Aklapper, CCicalese_WMF, Fjalapeno, daniel, darthmon_wmde, WDoranWMF,

[Wikidata-bugs] [Maniphest] [Updated] T214308: Force usage of MCR aware database schema

2019-06-10 Thread CCicalese_WMF
CCicalese_WMF moved this task from Inbox to Team 3 on the Core Platform Team Kanban board. CCicalese_WMF edited projects, added Core Platform Team Kanban (Team 3); removed Core Platform Team Kanban. TASK DETAIL https://phabricator.wikimedia.org/T214308 WORKBOARD

[Wikidata-bugs] [Maniphest] [Updated] T214308: Force usage of MCR aware database schema

2019-06-10 Thread CCicalese_WMF
CCicalese_WMF edited projects, added Core Platform Team Kanban; removed Core Platform Team Backlog (Later). TASK DETAIL https://phabricator.wikimedia.org/T214308 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: CCicalese_WMF Cc: Aklapper,

Re: [Wikidata] Scaling Wikidata Query Service

2019-06-10 Thread Guillaume Lederrey
Hello! On Mon, Jun 10, 2019 at 4:28 PM Sebastian Hellmann wrote: > > Hi Guillaume, > > On 06.06.19 21:32, Guillaume Lederrey wrote: > > Hello all! > > There has been a number of concerns raised about the performance and > scaling of Wikdata Query Service. We share those concerns and we are >

[Wikidata-bugs] [Maniphest] [Closed] T78134: Adapt red links on the translation - part 2

2019-06-10 Thread Pginer-WMF
Pginer-WMF closed this task as "Resolved". Pginer-WMF claimed this task. Pginer-WMF added a comment. Content translation supports red links, and specific improvements are captured in specific tickets (T197787 ) TASK DETAIL

Re: [Wikidata] Scaling Wikidata Query Service

2019-06-10 Thread Sebastian Hellmann
Hi Guillaume, On 06.06.19 21:32, Guillaume Lederrey wrote: Hello all! There has been a number of concerns raised about the performance and scaling of Wikdata Query Service. We share those concerns and we are doing our best to address them. Here is some info about what is going on: In an ideal

[Wikidata-bugs] [Maniphest] [Updated] T222624: Unable to remove last alias from entity

2019-06-10 Thread Aklapper
Aklapper added a project: Wikidata. Aklapper added a comment. Assuming this is about #Wikidata . TASK DETAIL https://phabricator.wikimedia.org/T222624 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/

[Wikidata-bugs] [Maniphest] [Commented On] T203696: Drastically reduce the number of ResourceLoader modules that WikibaseClient registers

2019-06-10 Thread gerritbot
gerritbot added a comment. Change 516240 had a related patch set uploaded (by Krinkle; owner: Krinkle): [mediawiki/extensions/Wikibase@master] Consolidate more view/ modules resources (16) https://gerrit.wikimedia.org/r/516240 TASK DETAIL https://phabricator.wikimedia.org/T203696

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T212843: [EPIC] Access to Wikidata's lexicographical data from Wiktionaries and other WMF sites

2019-06-10 Thread deryckchan
deryckchan added a subscriber: Fnielsen. deryckchan added a comment. There's a Wikimania 2019 submission about Lexemes, by @Fnielsen : https://wikimania.wikimedia.org/wiki/2019:Languages/Wikidata_lexemes TASK DETAIL https://phabricator.wikimedia.org/T212843 EMAIL PREFERENCES