[Wikidata-bugs] [Maniphest] [Triaged] T228640: WDQS missing some particular data (property P6885)

2019-07-22 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T228640 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Smalyshev, Mormegil, Aklapper, Vojtech.dostal, Cyberpower678, mate

[Wikidata-bugs] [Maniphest] [Commented On] T228640: WDQS missing some particular data (property P6885)

2019-07-22 Thread Smalyshev
Smalyshev added a comment. Hmm looking at the date, it's close to where the dump is generated, so I wonder if there's not some race condition between dumping and updating and loading, etc. where some updates may fall through. TASK DETAIL https://phabricator.wikimedia.org/T228640 EMAIL

[Wikidata-bugs] [Maniphest] [Triaged] T228297: Re-evaluate supporting dcatap namespace

2019-07-22 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T228297 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: nichtich, Gehel, Lydia_Pintscher, Lea_Lacroix_WMDE, Aklapper,

[Wikidata-bugs] [Maniphest] [Triaged] T228645: Create normalization between Q11229 (percentage) and Q181011 (per mille)

2019-07-22 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T228645 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, matej_suchanek, darthmon_wmde, Nandana, Sario528,

[Wikidata-bugs] [Maniphest] [Closed] T213210: WDQS is hitting allocator limit on Blazegraph

2019-07-21 Thread Smalyshev
Smalyshev closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T213210 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Stashbot, Gehel, Aklapper, Smalyshev, darthmon_wmde, Nandana, Sario528,

[Wikidata-bugs] [Maniphest] [Closed] T228569: Suspicious data loss on the Query Service

2019-07-21 Thread Smalyshev
Smalyshev closed this task as "Resolved". Smalyshev added a comment. Should be fine now, please verify. TASK DETAIL https://phabricator.wikimedia.org/T228569 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc:

[Wikidata-bugs] [Maniphest] [Commented On] T228569: Suspicious data loss on the Query Service

2019-07-21 Thread Smalyshev
Smalyshev added a comment. Thanks @ArielGlenn the dump is now up, I'll load it shortly. TASK DETAIL https://phabricator.wikimedia.org/T228569 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: ArielGlenn, Alicia_Fagerving_WMSE

[Wikidata-bugs] [Maniphest] [Closed] T218522: SPARQL incorrectly changes URI's from http to https

2019-07-21 Thread Smalyshev
Smalyshev closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T218522 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Esc3300, Base, Aklapper, Lydia_Pintscher, Smalyshev, Multichill, darthmon_wmd

[Wikidata-bugs] [Maniphest] [Unblock] T222404: Tasks requiring Blazegraph reload

2019-07-21 Thread Smalyshev
Smalyshev closed subtask T228122: DB reload for WDQS as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T222404 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Smalyshev, darthmon_wmde, Nickleh, Nandana, Sario528, Lahi

[Wikidata-bugs] [Maniphest] [Closed] T228122: DB reload for WDQS

2019-07-21 Thread Smalyshev
Smalyshev closed this task as "Resolved". Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T228122 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel, Smalyshev Cc: Dzahn, Aklapper, Smalyshev, dar

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T228569: Suspicious data loss on the Query Service

2019-07-21 Thread Smalyshev
Smalyshev added a subscriber: ArielGlenn. Smalyshev added a comment. We also seem to be missing lexemes dumps for last 2 weeks - the latest one is Jul 5h. @ArielGlenn is this something related to the dumps problems we had with JSON or a different issue? TASK DETAIL https

[Wikidata-bugs] [Maniphest] [Triaged] T228569: Suspicious data loss on the Query Service

2019-07-20 Thread Smalyshev
Smalyshev triaged this task as "High" priority. TASK DETAIL https://phabricator.wikimedia.org/T228569 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Alicia_Fagerving_WMSE, Aklapper, Tagishsimon, Fnielsen, ArthurPSmith,

[Wikidata-bugs] [Maniphest] [Commented On] T228569: Suspicious data loss on the Query Service

2019-07-20 Thread Smalyshev
Smalyshev added a comment. My fault, I've not loaded the full Lexeme dump. So missing Lexemes are because of that. I'll fix it on Monday. TASK DETAIL https://phabricator.wikimedia.org/T228569 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] [Claimed] T228569: Suspicious data loss on the Query Service

2019-07-20 Thread Smalyshev
Smalyshev added a project: Wikidata-Query-Service. Smalyshev claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T228569 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Alicia_Fagerving_WMSE, Aklapper, Tagishsimon, Fnielsen

[Wikidata-bugs] [Maniphest] [Commented On] T223792: Extend mw.wikibase.getEntity lua function to allow accessing Structured Data on Commons items

2019-07-18 Thread Smalyshev
Smalyshev added a comment. > So as a LUA user I want to do mw.wikibase.getEntity( 'M62798946' ) and get in LUA like But for this you don't need any index at all, 62798946 is literally the page id. Am I missing something here? Why there's talk about indexes? TASK DETAIL ht

[Wikidata-bugs] [Maniphest] [Commented On] T227847: Backfill terms index

2019-07-18 Thread Smalyshev
Smalyshev added a comment. > you'll see it's just labels Yes and no. They are stored in labels slot, but that doesn't mean they are the same in all aspects. E.g. labels are used to look up items all the time, but would captions be used to look up files? I don't think they'd be u

[Wikidata-bugs] [Maniphest] [Updated] T227847: Backfill terms index

2019-07-18 Thread Smalyshev
Smalyshev added a comment. > If elastic already has captions indexed then yes this could probably just use elastic. Yes, we do index captions. The question is of course how you want them indexed - which depends on the type of the lookup that is required. Right now we were indexing t

[Wikidata-bugs] [Maniphest] [Commented On] T223792: Extend mw.wikibase.getEntity lua function to allow accessing Structured Data on Commons items

2019-07-18 Thread Smalyshev
Smalyshev added a comment. > It looks like the Wikibase Lua support can mostly deal with MediaInfo already, except that it can't look up the MediaInfo entities. What kind of look up is this - matching the exact caption? Or partial matching the caption? `mw.wikibase.getEntity` does

[Wikidata-bugs] [Maniphest] [Commented On] T227847: Backfill terms index

2019-07-18 Thread Smalyshev
Smalyshev added a comment. What kind of lookups there should be for MediaInfo - can ElasticSearch index that we already have be used for it? TASK DETAIL https://phabricator.wikimedia.org/T227847 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] [Closed] T209034: Incomplete continuation in MWAPI

2019-07-17 Thread Smalyshev
Smalyshev closed this task as "Resolved". Smalyshev claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T209034 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: gerritbot, Aklapper, Smalyshev, Lucas_Werkmeister_W

[Wikidata-bugs] [Maniphest] [Closed] T186037: Need mvn build mode that does not build gui

2019-07-17 Thread Smalyshev
Smalyshev closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T186037 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse, Smalyshev Cc: Gehel, Aklapper, Smalyshev, Hook696, Daryl-TTMG, RomaAmorRoma, 00103184

[Wikidata-bugs] [Maniphest] [Created] T228343: Huge delay for RecentChanges in test.wikidata

2019-07-17 Thread Smalyshev
Smalyshev created this task. Smalyshev added a project: Wikidata. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION I am observing a delay of tens of seconds to a full minute between an edit being made on test.wikidata.org and the time it appears in RecentChanges (page

[Wikidata-bugs] [Maniphest] [Commented On] T227818: WDQS GUI deploy build fails

2019-07-17 Thread Smalyshev
Smalyshev added a comment. The build seems to be fine now, thanks! TASK DETAIL https://phabricator.wikimedia.org/T227818 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: hashar, Smalyshev Cc: greg, hashar, Liuxinyu970226, Aklapper, Smalyshev

[Wikidata-bugs] [Maniphest] [Created] T228297: Re-evaluate supporting dcatap namespace

2019-07-17 Thread Smalyshev
Smalyshev created this task. Smalyshev added projects: Wikidata-Query-Service, Wikidata. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION We are currently supporting DCAT-AP namespace on our servers, introduced in T178978 <https://phabricator.wikimedia.org/T178

[Wikidata-bugs] [Maniphest] [Commented On] T228122: DB reload for WDQS

2019-07-16 Thread Smalyshev
Smalyshev added a comment. 2001 seems to be doing fine, so we can do the next set I think. TASK DETAIL https://phabricator.wikimedia.org/T228122 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel, Smalyshev Cc: Aklapper, Smalyshev

[Wikidata-bugs] [Maniphest] [Edited] T228122: DB reload for WDQS

2019-07-16 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T228122 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel, Smalyshev Cc: Aklapper, Smalyshev, darthmon_wmde, Nandana, Lahi, Gq86, Lucas_Werkmeister_WMDE

[Wikidata-bugs] [Maniphest] [Edited] T228122: DB reload for WDQS

2019-07-16 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T228122 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel, Smalyshev Cc: Aklapper, Smalyshev, darthmon_wmde, Nandana, Lahi, Gq86, Lucas_Werkmeister_WMDE

[Wikidata-bugs] [Maniphest] [Updated] T209034: Incomplete continuation in MWAPI

2019-07-16 Thread Smalyshev
Smalyshev removed a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T209034 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: gerritbot, Aklapper, Smalyshev, Lucas_Werkmeister_WMDE, Nikki, darthmon_wmde, Nandana

[Wikidata-bugs] [Maniphest] [Commented On] T175840: Using label service twice in one query results in obscure error message

2019-07-16 Thread Smalyshev
Smalyshev added a comment. This query also doesn't seem to work: SELECT ?pLabel ?prop ?val ?valLabel WHERE { wd:Q8486 ?prop ?val . ?ps wikibase:directClaim ?prop . ?ps rdfs:label ?pLabel . SERVICE wikibase:label { bd:serviceParam

[Wikidata-bugs] [Maniphest] [Commented On] T228122: DB reload for WDQS

2019-07-16 Thread Smalyshev
Smalyshev added a comment. @Gehel Never mind, this was me misconfiguring the query to use wrong namespace :\ The data is fine, so we can proceed. TASK DETAIL https://phabricator.wikimedia.org/T228122 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] [Commented On] T228122: DB reload for WDQS

2019-07-15 Thread Smalyshev
Smalyshev added a comment. @gehel wdqs2004 looks normal, I think we can proceed with the next one. TASK DETAIL https://phabricator.wikimedia.org/T228122 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel, Smalyshev Cc: Aklapper, Smalyshev

[Wikidata-bugs] [Maniphest] [Raised Priority] T227818: WDQS GUI deploy build fails

2019-07-15 Thread Smalyshev
Smalyshev raised the priority of this task from "High" to "Unbreak Now!". Smalyshev added a comment. Restricted Application added a subscriber: Liuxinyu970226. Still failing: https://integration.wikimedia.org/ci/job/wikidata-query-gui-build/238/console This is blocki

[Wikidata-bugs] [Maniphest] [Closed] T222302: Too many RDF label forms for MediaInfo

2019-07-15 Thread Smalyshev
Smalyshev closed this task as "Resolved". Smalyshev claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T222302 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: WMDE-leszek, Lucas_Werkmeister_WMDE, Tpt, Addshore,

[Wikidata-bugs] [Maniphest] [Unblock] T221916: Create RDF export for structured data stored for files

2019-07-15 Thread Smalyshev
Smalyshev closed subtask T222302: Too many RDF label forms for MediaInfo as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T221916 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: WMDE-leszek, Poyekhali, Steinsplitter, Aklapper

[Wikidata-bugs] [Maniphest] [Updated] T222404: Tasks requiring Blazegraph reload

2019-07-15 Thread Smalyshev
Smalyshev added a subtask: T228122: DB reload for WDQS. TASK DETAIL https://phabricator.wikimedia.org/T222404 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Smalyshev, darthmon_wmde, Nickleh, Nandana, Lahi, Gq86

[Wikidata-bugs] [Maniphest] [Updated] T228122: DB reload for WDQS

2019-07-15 Thread Smalyshev
Smalyshev added a parent task: T222404: Tasks requiring Blazegraph reload. TASK DETAIL https://phabricator.wikimedia.org/T228122 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel, Smalyshev Cc: Aklapper, Smalyshev, Daryl-TTMG, RomaAmorRoma

[Wikidata-bugs] [Maniphest] [Created] T228122: DB reload for WDQS

2019-07-15 Thread Smalyshev
Smalyshev created this task. Smalyshev added projects: Wikidata-Query-Service, Discovery-Wikidata-Query-Service-Sprint. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION This task is for reloading WDQS database from scratch

[Wikidata-bugs] [Maniphest] [Triaged] T228122: DB reload for WDQS

2019-07-15 Thread Smalyshev
Smalyshev triaged this task as "High" priority. TASK DETAIL https://phabricator.wikimedia.org/T228122 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel, Smalyshev Cc: Aklapper, Smalyshev, darthmon_wmde, Nandana,

[Wikidata-bugs] [Maniphest] [Closed] T226153: Remove BETA from Wikidata entities dump

2019-07-14 Thread Smalyshev
Smalyshev closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T226153 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: GoranSMilovanovic, nichtich, hoo, Hydriz, Maxlath, Envlh, Lea_Lacroix_WMDE,

[Wikidata-bugs] [Maniphest] [Commented On] T227943: "Server error" for a specific query

2019-07-14 Thread Smalyshev
Smalyshev added a comment. Where did you get such message? GUI? Could you do a screenshot? It may be that the GUI does not recognize the exact message or timeout happens after sending partial data, in this case GUI may get confused. TASK DETAIL https://phabricator.wikimedia.org/T227943

[Wikidata-bugs] [Maniphest] [Closed] T227943: "Server error" for a specific query

2019-07-13 Thread Smalyshev
Smalyshev closed this task as "Invalid". Smalyshev added a comment. Timeouts on big queries are normal, not an error. Your query seems to be very non-selective - there are millions of items with `P50` and millions `P2093` statements. TASK DETAIL https://phabricator.wikimedia.o

[Wikidata-bugs] [Maniphest] [Updated] T227365: WDQS/Blazegraph data loading has timeout

2019-07-13 Thread Smalyshev
Smalyshev added a project: Upstream. TASK DETAIL https://phabricator.wikimedia.org/T227365 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Igorkim78, Smalyshev, darthmon_wmde, Nandana, Lahi, Gq86, Lucas_Werkmeister_WMDE

[Wikidata-bugs] [Maniphest] [Commented On] T227365: WDQS/Blazegraph data loading has timeout

2019-07-13 Thread Smalyshev
Smalyshev added a comment. Trying via dataloader API gets this: Jul 13 22:25:54 wdqs1009 wdqs-blazegraph[7722]: 22:25:54.928 [qtp226170135-55] ERROR c.b.r.sail.webapp.BigdataRDFServlet - cause=java.util.concurrent. TimeoutException, query=DATALOADER-SERVLET: wdq req.requestURI

[Wikidata-bugs] [Maniphest] [Commented On] T222497: dumpRDF for MediaInfo entities loads each page individually

2019-07-12 Thread Smalyshev
Smalyshev added a comment. Biggest issue here is that we need generic solution for both Item and MediaInfo, when: - Item has EntityId derived from title, but we do not know page id (though could get it from LinkCache). So having EntityId, we know title, but not page id. - MediaInfo

[Wikidata-bugs] [Maniphest] [Triaged] T205777: Unknown prefix wdtn: on Wikidata SPARQL

2019-07-11 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T205777 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Lydia_Pintscher, Smalyshev, Aklapper, Multichill, darthmon_wmde, Nand

[Wikidata-bugs] [Maniphest] [Created] T227818: WDQS GUI deploy build fails

2019-07-11 Thread Smalyshev
Smalyshev created this task. Smalyshev added projects: Release-Engineering-Team, Wikimedia-production-error (Shared Build Failure), Wikidata Query UI. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION WDQS GUI deploy build

[Wikidata-bugs] [Maniphest] [Triaged] T227818: WDQS GUI deploy build fails

2019-07-11 Thread Smalyshev
Smalyshev triaged this task as "High" priority. TASK DETAIL https://phabricator.wikimedia.org/T227818 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Smalyshev, darthmon_wmde, Nandana, NebulousIris,

[Wikidata-bugs] [Maniphest] [Edited] T205777: Unknown prefix wdtn: on Wikidata SPARQL

2019-07-10 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T205777 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Lydia_Pintscher, Smalyshev, Aklapper, Multichill, Daryl-TTMG, RomaAmorRoma, 0010318400, E.S.A

[Wikidata-bugs] [Maniphest] [Claimed] T205777: Unknown prefix wdtn: on Wikidata SPARQL

2019-07-10 Thread Smalyshev
Smalyshev claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T205777 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Lydia_Pintscher, Smalyshev, Aklapper, Multichill, darthmon_wmde, Nandana, Lahi, Gq86

[Wikidata-bugs] [Maniphest] [Updated] T161991: Whether a data type should be treated as a reference type in RDF should be defined in WikibaseRepo.datatypes.php

2019-07-10 Thread Smalyshev
Smalyshev added a project: User-Smalyshev. TASK DETAIL https://phabricator.wikimedia.org/T161991 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Smalyshev, Aklapper, daniel, Daryl-TTMG, RomaAmorRoma, 0010318400, E.S.A-Sheild

[Wikidata-bugs] [Maniphest] [Updated] T174504: Coordinates are exported into RDF with excessive precision

2019-07-10 Thread Smalyshev
Smalyshev added a project: User-Smalyshev. TASK DETAIL https://phabricator.wikimedia.org/T174504 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: thiemowmde, daniel, Aklapper, Smalyshev, darthmon_wmde, ET4Eva, Nandana, Lahi, Gq86

[Wikidata-bugs] [Maniphest] [Updated] T222497: dumpRDF for MediaInfo entities loads each page individually

2019-07-10 Thread Smalyshev
Smalyshev added a project: User-Smalyshev. TASK DETAIL https://phabricator.wikimedia.org/T222497 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: ArielGlenn, Lucas_Werkmeister_WMDE, Addshore, Ramsey-WMF, Aklapper, WMDE-leszek, Smalyshev

[Wikidata-bugs] [Maniphest] [Closed] T171092: WDQS sync (?) issue for certain recently created items

2019-07-10 Thread Smalyshev
Smalyshev closed this task as "Invalid". Smalyshev added a comment. Assuming it has been resolved, please reopen if I'm wrong. TASK DETAIL https://phabricator.wikimedia.org/T171092 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Sm

[Wikidata-bugs] [Maniphest] [Updated] T206613: Search of wikidata string property values using haswbstatement is case sensitive

2019-07-10 Thread Smalyshev
Smalyshev added a comment. Reindexing on eqiad currently blocked by T227136: Reindexing search index wikidatawiki for eqiad fails <https://phabricator.wikimedia.org/T227136>. TASK DETAIL https://phabricator.wikimedia.org/T206613 EMAIL PREFERENCES https://phabricator.wikimed

[Wikidata-bugs] [Maniphest] [Commented On] T226709: Add user agent to Wikidata Query UI code examples

2019-07-10 Thread Smalyshev
Smalyshev added a comment. @Legoktm `wikidata/query/gui` repo. IIRC code examples are here: https://phabricator.wikimedia.org/diffusion/WDQG/browse/master/examples/code/ TASK DETAIL https://phabricator.wikimedia.org/T226709 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings

[Wikidata-bugs] [Maniphest] [Commented On] T224125: Wikibase and WikibaseLexeme Selenium tests fail when UseCirrus is true in WikibaseCirrusSearch

2019-07-09 Thread Smalyshev
Smalyshev added a comment. @zeljkofilipin Do we have or plan to have any way to solve this in the near term, like ability to load special config settings for CI? TASK DETAIL https://phabricator.wikimedia.org/T224125 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel

[Wikidata-bugs] [Maniphest] [Commented On] T221632: Storage capacity upgrade for WDQS

2019-07-09 Thread Smalyshev
Smalyshev added a comment. > wdqs could lose a single node, but could it lose two? Depends. Losing two hosts in the same cluster in the same datacenter would be a huge issue. But we could temporarily borrow a node between clusters (e.g. internal -> public) if such thing happens

[Wikidata-bugs] [Maniphest] [Closed] T226329: QueryService UI test build fails on CI

2019-07-08 Thread Smalyshev
Smalyshev closed this task as "Resolved". Smalyshev claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T226329 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Lucas_Werkmeister_WMDE, Jdforrester-WMF, Aklapper,

[Wikidata-bugs] [Maniphest] [Commented On] T226329: QueryService UI test build fails on CI

2019-07-08 Thread Smalyshev
Smalyshev added a comment. Yep, the output has `` instead. TASK DETAIL https://phabricator.wikimedia.org/T226329 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Lucas_Werkmeister_WMDE, Jdforrester-WMF, Aklapper, Smalyshev, Daryl

[Wikidata-bugs] [Maniphest] [Commented On] T226329: QueryService UI test build fails on CI

2019-07-08 Thread Smalyshev
Smalyshev added a comment. It looks like only `TableResultBrowser` one fails, the rest of the browsers are fine. Maybe it's some mismatch in HTML... TASK DETAIL https://phabricator.wikimedia.org/T226329 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] [Commented On] T225245: Beta endpoint for Wikidata SPARQL

2019-07-08 Thread Smalyshev
Smalyshev added a comment. @maskaravivek Does it matter for you if it's connected to https://test.wikidata.org or https://wikidata.beta.wmflabs.org/? If yes, which one of those would work better for your purposes? TASK DETAIL https://phabricator.wikimedia.org/T225245 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] [Closed] T213375: Inline value and reference URIs

2019-07-08 Thread Smalyshev
Smalyshev closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T213375 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Igorkim78, Smalyshev Cc: Igorkim78, Aklapper, Gehel, Smalyshev, Daryl-TTMG, RomaAmorRoma,

[Wikidata-bugs] [Maniphest] [Unblock] T213210: WDQS is hitting allocator limit on Blazegraph

2019-07-08 Thread Smalyshev
Smalyshev closed subtask T213375: Inline value and reference URIs as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T213210 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Stashbot, Gehel, Aklapper, Smalyshev, darthmon_wmde

[Wikidata-bugs] [Maniphest] [Commented On] T206613: Search of wikidata string property values using haswbstatement is case sensitive

2019-07-06 Thread Smalyshev
Smalyshev added a comment. I've reindexed testwikidata last week, the patch should already be there. TASK DETAIL https://phabricator.wikimedia.org/T206613 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: EBernhardson, WMDE-leszek

[Wikidata-bugs] [Maniphest] [Created] T227365: Data loading has timeout

2019-07-05 Thread Smalyshev
Smalyshev created this task. Smalyshev added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION Loading data inside Blazegraph can take quite a lot of time. Right now one of the ways to do

[Wikidata-bugs] [Maniphest] [Retitled] T227365: WDQS/Blazegraph data loading has timeout

2019-07-05 Thread Smalyshev
Smalyshev renamed this task from "Data loading has timeout" to "WDQS/Blazegraph data loading has timeout". Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T227365 EMAIL PREFERENCES https://phabricato

[Wikidata-bugs] [Maniphest] [Edited] T223789: Add selenium tests to WikibaseCirrusSearch

2019-07-05 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T223789 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Smalyshev, darthmon_wmde, Dinadineke, Nandana, tabish.shaikh91, Lahi, Gq86

[Wikidata-bugs] [Maniphest] [Updated] T223789: Add selenium tests to WikibaseCirrusSearch

2019-07-05 Thread Smalyshev
Smalyshev added a subtask: T223774: The first Selenium test for WikibaseCirrusSearch. TASK DETAIL https://phabricator.wikimedia.org/T223789 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Smalyshev, darthmon_wmde, Dinadineke

[Wikidata-bugs] [Maniphest] [Triaged] T227170: Usage of article titles in Wikidata search suggestions

2019-07-05 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. Smalyshev added a comment. The problem is right now sitelink texts are not indexed anywhere except in text. We could add match against text, but that would probably involve huge number of false positives, or add another fiel

[Wikidata-bugs] [Maniphest] [Commented On] T175840: Using label service twice in one query results in obscure error message

2019-07-05 Thread Smalyshev
Smalyshev added a comment. Here's an interesting one: SELECT ?pLabel ?prop ?val ?valLabel WHERE { wd:Q8486 ?prop ?val . ?ps wikibase:directClaim ?prop . ?ps rdfs:label ?pLabel . SERVICE wikibase:label { bd:serviceParam

[Wikidata-bugs] [Maniphest] [Commented On] T171092: WDQS sync (?) issue for certain recently created items

2019-07-03 Thread Smalyshev
Smalyshev added a comment. SELECT ?item WHERE { ?item wdt:P856 http://www.sikjm.ch/ .} is not a valid query. But this is: SELECT ?item WHERE { ?item wdt:P856 <http://www.sikjm.ch/> .} And seems to be consistent on all servers. Same with other query. So maybe it's

[Wikidata-bugs] [Maniphest] [Closed] T227145: All WDQS logs have MDC: string appended to them

2019-07-03 Thread Smalyshev
Smalyshev closed this task as "Resolved". Smalyshev claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T227145 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Smalyshev, Gehel, Aklapper, darthmon_wmde, Nandana,

[Wikidata-bugs] [Maniphest] [Commented On] T175840: Using label service twice in one query results in obscure error message

2019-07-03 Thread Smalyshev
Smalyshev added a comment. Anther one: SELECT ?item ?name ?coord WHERE { wd:Q12988 wdt:P625 ?Firstloc . wd:Q184287 wdt:P625 ?Secondloc . SERVICE wikibase:box { ?item wdt:P625 ?coord . bd:serviceParam wikibase:cornerNorthEast

[Wikidata-bugs] [Maniphest] [Updated] T189744: Add hints parameter to wbsearchentities

2019-07-03 Thread Smalyshev
Smalyshev removed a project: User-Smalyshev. TASK DETAIL https://phabricator.wikimedia.org/T189744 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Nuria, Jonas, EBernhardson, gerritbot, Lydia_Pintscher, daniel, Aklapper, Smalyshev

[Wikidata-bugs] [Maniphest] [Commented On] T222985: Provide wikidata JSON dumps compressed with zstd

2019-07-03 Thread Smalyshev
Smalyshev added a comment. I tried zstd some time ago and found that with default settings it's bigger than bz2 and with max settings it's rather slow, so I did not proceed. But I agree that decompression speed might matter too, I did not consider that. So if there's no problem storing

[Wikidata-bugs] [Maniphest] [Closed] T226603: Blazegraph federation call does not properly work with URLs containing parameters

2019-07-02 Thread Smalyshev
Smalyshev closed this task as "Resolved". Smalyshev claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T226603 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Smalyshev, darthmon_wmde, Nandana,

[Wikidata-bugs] [Maniphest] [Created] T227145: All WDQS logs have MDC: string appended to them

2019-07-02 Thread Smalyshev
Smalyshev created this task. Smalyshev added projects: Wikidata-Query-Service, Discovery-Wikidata-Query-Service-Sprint. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION All WDQS logs look like: 20:14:38.021 [main

[Wikidata-bugs] [Maniphest] [Commented On] T174504: Coordinates are exported into RDF with excessive precision

2019-07-02 Thread Smalyshev
Smalyshev added a comment. Now this bug has its own xkcd: https://xkcd.com/2170/ TASK DETAIL https://phabricator.wikimedia.org/T174504 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: thiemowmde, daniel, Aklapper, Smalyshev

[Wikidata-bugs] [Maniphest] [Commented On] T226153: Remove BETA from Wikidata entities dump

2019-07-01 Thread Smalyshev
Smalyshev added a comment. Sounds good! TASK DETAIL https://phabricator.wikimedia.org/T226153 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: nichtich, hoo, Hydriz, Maxlath, Envlh, Lea_Lacroix_WMDE, ArielGlenn, Smalyshev, Daryl

[Wikidata-bugs] [Maniphest] [Commented On] T226153: Remove BETA from Wikidata entities dump

2019-07-01 Thread Smalyshev
Smalyshev added a comment. Oh, July... Somehow I've read that as "June". Maybe a bit earlier? Couple of weeks should be enough for preparing the software... TASK DETAIL https://phabricator.wikimedia.org/T226153 EMAIL PREFERENCES https://phabricator.wikimedia.org/sett

[Wikidata-bugs] [Maniphest] [Commented On] T226153: Remove BETA from Wikidata entities dump

2019-07-01 Thread Smalyshev
Smalyshev added a comment. @ArielGlenn I think we can merge it now? TASK DETAIL https://phabricator.wikimedia.org/T226153 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: nichtich, hoo, Hydriz, Maxlath, Envlh, Lea_Lacroix_WMDE

[Wikidata-bugs] [Maniphest] [Commented On] T175840: Using label service twice in one query results in obscure error message

2019-07-01 Thread Smalyshev
Smalyshev added a comment. Another broken one (likely same reason): SELECT ?count ?gender ?genderLabel WITH { SELECT (COUNT(DISTINCT ?researcher) AS ?count) ?gender WHERE { ?researcher ( wdt:P108 | wdt:P463 | wdt:P1416 ) / wdt:P361* wd:Q1269766 . ?researcher wdt:P21

[Wikidata-bugs] [Maniphest] [Commented On] T175840: Using label service twice in one query results in obscure error message

2019-07-01 Thread Smalyshev
Smalyshev added a comment. Another broken one: SELECT ?parent ?parentLabel WHERE { wd:Q174097 wdt:P31/wdt:P279* ?parent . SERVICE wikibase:label { bd:serviceParam wikibase:language "en" } } Again, service comes out in front. Looks like path nodes are

[Wikidata-bugs] [Maniphest] [Commented On] T175840: Using label service twice in one query results in obscure error message

2019-07-01 Thread Smalyshev
Smalyshev added a comment. Another broken one: SELECT ?item ?itemLabel WHERE { { SELECT (MIN(?item) AS ?item) WHERE {?item wdt:P373 "A Topographical and Historical Description of London and Middlesex (1820) by Bayley, Brewer and Nightingale" FILTER

[Wikidata-bugs] [Maniphest] [Commented On] T226453: Concept URI in sidebar uses HTTP instead of HTTPS

2019-07-01 Thread Smalyshev
Smalyshev added a comment. `wdata:` is not the concept uri though. `wd:` is the thing, `wdata:` is Wikidata page talking about the thing. We consciously separated them in the data. TASK DETAIL https://phabricator.wikimedia.org/T226453 EMAIL PREFERENCES https://phabricator.wikimedia.org

[Wikidata-bugs] [Maniphest] [Commented On] T217897: Reduce / remove the aggessive cache busting behaviour of wdqs-updater

2019-06-30 Thread Smalyshev
Smalyshev added a comment. Eventually, yes. TASK DETAIL https://phabricator.wikimedia.org/T217897 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Lucas_Werkmeister_WMDE, Addshore, Smalyshev, BBlack, Aklapper, Gehel, darthmon_wmde

[Wikidata-bugs] [Maniphest] [Commented On] T226794: 403: Forbidden query.wikidata

2019-06-27 Thread Smalyshev
Smalyshev added a comment. Have you followed instructions at https://meta.wikimedia.org/wiki/User-Agent_policy ? TASK DETAIL https://phabricator.wikimedia.org/T226794 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Smalyshev

[Wikidata-bugs] [Maniphest] [Updated] T199787: WikibaseQualityConstraints gets Too Many Requests errors from query service

2019-06-27 Thread Smalyshev
Smalyshev removed a subtask: T226794: 403: Forbidden query.wikidata. TASK DETAIL https://phabricator.wikimedia.org/T199787 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Jc86035, Bugreporter, Liuxinyu970226, Nikki, MisterSynergy

[Wikidata-bugs] [Maniphest] [Updated] T226794: 403: Forbidden query.wikidata

2019-06-27 Thread Smalyshev
Smalyshev removed a parent task: T199787: WikibaseQualityConstraints gets Too Many Requests errors from query service. TASK DETAIL https://phabricator.wikimedia.org/T226794 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Smalyshev

[Wikidata-bugs] [Maniphest] [Commented On] T226794: 403: Forbidden query.wikidata

2019-06-27 Thread Smalyshev
Smalyshev added a comment. Please add more details - what exactly are you doing? What is the error you are getting (preferably full headers)? TASK DETAIL https://phabricator.wikimedia.org/T226794 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] [Edited] T223743: Add option for Munger to sanitize data to strictly match RDF standards

2019-06-27 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T223743 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Smalyshev, darthmon_wmde, Nandana, Lahi, Gq86, Lucas_Werkmeister_WMDE

[Wikidata-bugs] [Maniphest] [Updated] T223743: Add option for Munger to sanitize data to strictly match RDF standards

2019-06-27 Thread Smalyshev
Smalyshev removed a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T223743 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Smalyshev, darthmon_wmde, Nandana, Lahi, Gq86

[Wikidata-bugs] [Maniphest] [Closed] T226533: 403 errors on Wikidata SPARQL queries

2019-06-27 Thread Smalyshev
Smalyshev closed this task as "Resolved". Smalyshev claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T226533 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Smalyshev, Addshore, Aklapper, Richard-Degenne, dar

[Wikidata-bugs] [Maniphest] [Commented On] T226533: 403 errors on Wikidata SPARQL queries

2019-06-27 Thread Smalyshev
Smalyshev added a comment. Please see https://meta.wikimedia.org/wiki/User-Agent_policy and use descriptive user agent. We do not require too many details, i.e. you don't have to put contact email there if you don't want to (though for mass-querying bots it is probably a good idea in case

[Wikidata-bugs] [Maniphest] [Commented On] T175840: Using label service twice in one query results in obscure error message

2019-06-26 Thread Smalyshev
Smalyshev added a comment. Another broken one: SELECT ?compound ?compoundLabel ?prop ?id ?idLabel WHERE { VALUES ?compound {wd:Q27295794} VALUES ?prop { wdt:P231 wdt:P232 wdt:P267 wdt:P486 wdt:P592 wdt:P595 wdt:P652 wdt:P661 wdt:P662 wdt:P665 wdt:P683 wdt:P715

[Wikidata-bugs] [Maniphest] [Commented On] T175840: Using label service twice in one query results in obscure error message

2019-06-26 Thread Smalyshev
Smalyshev added a comment. If OPTIONAL is removed (i.e. its patten in made non-optional) then it works fine. So looks like something related to handling of optionals. TASK DETAIL https://phabricator.wikimedia.org/T175840 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel

[Wikidata-bugs] [Maniphest] [Commented On] T175840: Using label service twice in one query results in obscure error message

2019-06-26 Thread Smalyshev
Smalyshev added a comment. @Igorkim78 looks like the patch is buggy. This query: SELECT DISTINCT ?auth ?authItemLabel ?desc ?linkPattern ?countryLabel ?remoteID WHERE { ?authItem wdt:P31 ?authTypes; schema:description ?desc; wdt:P1630 ?linkPattern; wikibase:directClaim

[Wikidata-bugs] [Maniphest] [Updated] T226603: Blazegraph federation call does not properly work with URLs containing parameters

2019-06-26 Thread Smalyshev
Smalyshev added a project: Upstream. TASK DETAIL https://phabricator.wikimedia.org/T226603 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Smalyshev, Daryl-TTMG, RomaAmorRoma, 0010318400, E.S.A-Sheild, darthmon_wmde

[Wikidata-bugs] [Maniphest] [Closed] T222299: dumpRdf does not work with MediaInfo entities

2019-06-26 Thread Smalyshev
Smalyshev closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T99 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: WMDE-leszek, Jdforrester-WMF, matthiasmullie, Cparle, daniel, Lucas_Werkmeister

[Wikidata-bugs] [Maniphest] [Unblock] T221916: Create RDF export for structured data stored for files

2019-06-26 Thread Smalyshev
Smalyshev closed subtask T99: dumpRdf does not work with MediaInfo entities as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T221916 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: WMDE-leszek, Poyekhali, Steinsplitter

<    1   2   3   4   5   6   7   8   9   10   >