[Wikidata-bugs] [Maniphest] [Commented On] T199219: WDQS should use internal endpoint to communicate to Wikidata

2019-06-04 Thread Smalyshev
Smalyshev added a comment. But won't we lose use of the varnish cache if we use the internal endpoint? TASK DETAIL https://phabricator.wikimedia.org/T199219 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: akosiaris, BBlack, Aklapper

[Wikidata-bugs] [Maniphest] [Commented On] T223946: Wikidata wdtn:P214 values (VIAF) seem to be corrupt

2019-06-04 Thread Smalyshev
Smalyshev added a comment. @Jheald now they should all be fine. TASK DETAIL https://phabricator.wikimedia.org/T223946 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Igorkim78, Smalyshev, Esc3300, Jheald, Aklapper, Tagishsimon

[Wikidata-bugs] [Maniphest] [Commented On] T223946: Wikidata wdtn:P214 values (VIAF) seem to be corrupt

2019-06-04 Thread Smalyshev
Smalyshev added a comment. Doh, my fault, I forgot 0 is also a number. Will fix. TASK DETAIL https://phabricator.wikimedia.org/T223946 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Igorkim78, Smalyshev, Esc3300, Jheald, Aklapper

[Wikidata-bugs] [Maniphest] [Updated] T199219: WDQS should use internal endpoint to communicate to Wikidata

2019-06-04 Thread Smalyshev
Smalyshev added a comment. There's a change though that WDQS no longer uses `nocache` for cache-busting in most common cases (see T217897 <https://phabricator.wikimedia.org/T217897> for more details). So I am not sure using internal endpoint now makes sense. TASK DETAIL

[Wikidata-bugs] [Maniphest] [Updated] T196858: Allow parameters & wildcards in federation endpoint whitelists

2019-06-04 Thread Smalyshev
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T196858 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Esc3300, Smalyshev, darthmon_wmde, Premeditated, ET4Eva

[Wikidata-bugs] [Maniphest] [Updated] T201354: Migrate WDQS tools from JewelCli to actively supported command-line parsing library

2019-06-04 Thread Smalyshev
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T201354 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Gehel, Aklapper, Smalyshev, darthmon_wmde, Premeditated, Nandana

[Wikidata-bugs] [Maniphest] [Updated] T209034: Incomplete continuation in MWAPI

2019-06-04 Thread Smalyshev
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T209034 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: gerritbot, Aklapper, Smalyshev, Lucas_Werkmeister_WMDE, Nikki

[Wikidata-bugs] [Maniphest] [Closed] T212084: wikibase:mwapi query with additional conditions fails to apply these conditions

2019-06-04 Thread Smalyshev
Smalyshev closed this task as "Resolved". Smalyshev claimed this task. Smalyshev added a comment. The queries seem to work fine now. TASK DETAIL https://phabricator.wikimedia.org/T212084 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To:

[Wikidata-bugs] [Maniphest] [Updated] T194144: Find a solution for SpecialEntitiesWithoutPage (EntitiesWithoutTermFinder)

2019-06-04 Thread Smalyshev
Smalyshev removed a project: User-Smalyshev. TASK DETAIL https://phabricator.wikimedia.org/T194144 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Addshore, Aklapper, EBernhardson, Smalyshev, Lydia_Pintscher, hoo, darthmon_wmde

[Wikidata-bugs] [Maniphest] [Commented On] T206613: Search of wikidata string property values using haswbstatement is case sensitive

2019-06-04 Thread Smalyshev
Smalyshev added a comment. @dcausse agree but I think it still makes sense to make it case insensitive, since most data there are either case-insensitive or at least case there is rarely used to distinguish between things (i.e. having `pcbi.100123` in one item and `PCBI.100123` in another

[Wikidata-bugs] [Maniphest] [Updated] T206613: Search of wikidata string property values using haswbstatement is case sensitive

2019-06-04 Thread Smalyshev
Smalyshev moved this task from Wikidata Search to Current work on the Discovery-Search board. Smalyshev edited projects, added Discovery-Search (Current work); removed Discovery-Search. TASK DETAIL https://phabricator.wikimedia.org/T206613 WORKBOARD https://phabricator.wikimedia.org

[Wikidata-bugs] [Maniphest] [Updated] T209859: Wikidata autocomplete (wbsearchentities) results with score <= 0

2019-06-04 Thread Smalyshev
Smalyshev added a comment. Restricted Application added a subscriber: Liuxinyu970226. I suspect the fix for this will be T215615: Stop using negative scores for deboosting statements <https://phabricator.wikimedia.org/T215615>? TASK DETAIL https://phabricator.wikimedia.org/T209859

[Wikidata-bugs] [Maniphest] [Triaged] T224125: Wikibase and WikibaseLexeme Selenium tests fail when UseCirrus is true in WikibaseCirrusSearch

2019-06-04 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T224125 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, EBernhardson, Smalyshev, zeljkofilipin, Mholloway, darthmon_wmde

[Wikidata-bugs] [Maniphest] [Lowered Priority] T189744: Add hints parameter to wbsearchentities

2019-06-04 Thread Smalyshev
Smalyshev lowered the priority of this task from "Normal" to "Low". TASK DETAIL https://phabricator.wikimedia.org/T189744 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Nuria, Jonas, EBernhardson, gerritbot, Lyd

[Wikidata-bugs] [Maniphest] [Updated] T210044: Data corruption when loading RDF data into WDQS

2019-06-04 Thread Smalyshev
Smalyshev removed a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T210044 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Addshore, MichaelSchoenitzer, doctaxon, Nikki, Lydia_Pintscher, hoo, Multichill, KaMan

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T206613: Search of wikidata string property values using haswbstatement is case sensitive

2019-06-03 Thread Smalyshev
Smalyshev added a subscriber: EBernhardson. Smalyshev added a comment. Switching the statement data to `lowercase_keyword` would be easy, but that'd break all searches till full reindexing. Alternatively, we could add another field that would index as `lowercase_keyword` and once

[Wikidata-bugs] [Maniphest] [Closed] T223946: Wikidata wdtn:P214 values (VIAF) seem to be corrupt

2019-06-03 Thread Smalyshev
Smalyshev closed this task as "Resolved". Smalyshev added a comment. Should be fixed now. TASK DETAIL https://phabricator.wikimedia.org/T223946 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Igorkim78, Smalyshev, Esc33

[Wikidata-bugs] [Maniphest] [Claimed] T223946: Wikidata wdtn:P214 values (VIAF) seem to be corrupt

2019-06-03 Thread Smalyshev
Smalyshev claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T223946 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Igorkim78, Smalyshev, Esc3300, Jheald, Aklapper, Tagishsimon, darthmon_wmde, Premeditated, Nandana, Lahi

[Wikidata-bugs] [Maniphest] [Closed] T223711: Blazegraph explain does not produce anything useful for requests that time out

2019-06-03 Thread Smalyshev
Smalyshev closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T223711 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Multichill, Aklapper, Smalyshev, darthmon_wmde, Premeditated, Nandana,

[Wikidata-bugs] [Maniphest] [Claimed] T224024: Fatal Error on Commons from Special:EntityData with n3 format (Argument to addEntityRedirect must be EntityId, null given)

2019-05-30 Thread Smalyshev
Smalyshev claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T224024 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Smalyshev, 20038011003, MarkTraceur, Aklapper, Michael, darthmon_wmde, Premeditated, Edtadros, Nandana

[Wikidata-bugs] [Maniphest] [Commented On] T224024: Fatal Error on Commons from Special:EntityData with n3 format (Argument to addEntityRedirect must be EntityId, null given)

2019-05-30 Thread Smalyshev
Smalyshev added a comment. Ok, it's clear what is going on: if ( $this->rdfOutputRequested( $format ) && in_array( $entityId->getEntityType(), $this->entityTypesWithoutRdfOutput ) ) { throw new HttpError( 406, $output->msg( 'wik

[Wikidata-bugs] [Maniphest] [Commented On] T222306: RDF export generates wrong IDs for federated entities

2019-05-30 Thread Smalyshev
Smalyshev added a comment. According to T222995 <https://phabricator.wikimedia.org/T222995>, this is what we want to get: sdc:M10659 a wikibase:Mediainfo, wikibase:MediaInfo, schema:MediaObject ; schema:caption "(Mostly) empty roa

[Wikidata-bugs] [Maniphest] [Changed Status] T213191: Some queries causes wdqs-blazegraph on wdqs1006 to crash and restart

2019-05-30 Thread Smalyshev
Smalyshev changed the task status from "Open" to "Stalled". Smalyshev lowered the priority of this task from "Normal" to "Low". Restricted Application added a subscriber: Liuxinyu970226. TASK DETAIL https://phabricator.wikimedia.org/T213191 EMAIL PREFERE

[Wikidata-bugs] [Maniphest] [Updated] T213375: Inline value and reference URIs

2019-05-30 Thread Smalyshev
Smalyshev edited projects, added Discovery-Wikidata-Query-Service-Sprint; removed Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T213375 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Igorkim78, Smalyshev Cc: Igorkim78, Aklapper

[Wikidata-bugs] [Maniphest] [Closed] T222574: WDQS scripts assume JDK 8 and are not working on JDK 12

2019-05-30 Thread Smalyshev
Smalyshev closed this task as "Resolved". Smalyshev claimed this task. Smalyshev added a comment. Should be fixed now TASK DETAIL https://phabricator.wikimedia.org/T222574 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc:

[Wikidata-bugs] [Maniphest] [Updated] T223946: Wikidata wdtn:P214 values (VIAF) seem to be corrupt

2019-05-29 Thread Smalyshev
Smalyshev added a project: Upstream. Smalyshev added a subscriber: Igorkim78. Smalyshev added a comment. This looks like Blazegraph URI handler bug: when the number fits unsigned int but not signed int, InlineUnsignedIntegerURIHandler is erroneously storing it as small byte value, due

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T55652: Special:Search doesn't use labels and descriptions for suggestions but just the item ID

2019-05-29 Thread Smalyshev
Smalyshev added a subscriber: Lea_Lacroix_WMDE. Smalyshev added a comment. Deployed now. @Lea_Lacroix_WMDE you may want to add it to the weekly summaries. TASK DETAIL https://phabricator.wikimedia.org/T55652 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel

[Wikidata-bugs] [Maniphest] [Updated] T223711: Blazegraph explain does not produce anything useful for requests that time out

2019-05-28 Thread Smalyshev
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. Smalyshev added a comment. Needs new Blazegraph version release & new WDQS build to deploy. TASK DETAIL https://phabricator.wikimedia.org/T223711 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/p

[Wikidata-bugs] [Maniphest] [Changed Status] T179681: Add HDT dump of Wikidata

2019-05-28 Thread Smalyshev
Smalyshev changed the task status from "Open" to "Stalled". Smalyshev added a project: patch-welcome. TASK DETAIL https://phabricator.wikimedia.org/T179681 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: hoo,

[Wikidata-bugs] [Maniphest] [Blocker] T88991: improve Wikidata dumps [tracking]

2019-05-28 Thread Smalyshev
Smalyshev changed the status of subtask T179681: Add HDT dump of Wikidata from Open to Stalled. TASK DETAIL https://phabricator.wikimedia.org/T88991 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Lazhar, PokestarFan, Ricordisamoa

[Wikidata-bugs] [Maniphest] [Closed] T153353: Blazegraph not properly using labels from sub-queries for filtering (omitting rows), unless they're selected

2019-05-28 Thread Smalyshev
Smalyshev closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T153353 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Igorkim78, Aklapper, Smalyshev, hoo, darthmon_wmde, Premeditated, ET4Eva, Nan

[Wikidata-bugs] [Maniphest] [Updated] T221916: Create RDF export for structured data stored for files

2019-05-28 Thread Smalyshev
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T221916 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: WMDE-leszek, Poyekhali, Steinsplitter, Aklapper, Lydia_Pintscher

[Wikidata-bugs] [Maniphest] [Claimed] T153353: Blazegraph not properly using labels from sub-queries for filtering (omitting rows), unless they're selected

2019-05-28 Thread Smalyshev
Smalyshev claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T153353 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Igorkim78, Aklapper, Smalyshev, hoo, darthmon_wmde, Premeditated, ET4Eva, Nandana, Lahi, Gq86

[Wikidata-bugs] [Maniphest] [Assigned] T175840: Using label service twice in one query results in obscure error message

2019-05-28 Thread Smalyshev
Smalyshev assigned this task to Igorkim78. TASK DETAIL https://phabricator.wikimedia.org/T175840 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Igorkim78, Smalyshev Cc: Smalyshev, Lucas_Werkmeister_WMDE, Aklapper, darthmon_wmde, Premeditated

[Wikidata-bugs] [Maniphest] [Updated] T175840: Using label service twice in one query results in obscure error message

2019-05-28 Thread Smalyshev
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T175840 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Smalyshev, Lucas_Werkmeister_WMDE, Aklapper, darthmon_wmde

[Wikidata-bugs] [Maniphest] [Updated] T153353: Blazegraph not properly using labels from sub-queries for filtering (omitting rows), unless they're selected

2019-05-28 Thread Smalyshev
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T153353 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Igorkim78, Aklapper, Smalyshev, hoo, darthmon_wmde, Premeditated

[Wikidata-bugs] [Maniphest] [Updated] T212550: Implement support for ChronologyProtection in events sent when editing Mediawiki/Wikidata

2019-05-28 Thread Smalyshev
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T212550 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: elukey, Krinkle, Ottomata, Aklapper, Smalyshev, aaron, E.S.A

[Wikidata-bugs] [Maniphest] [Updated] T223946: Wikidata wdtn:P214 values (VIAF) seem to be corrupt

2019-05-28 Thread Smalyshev
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T223946 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Smalyshev, Esc3300, Jheald, matej_suchanek, Aklapper, Tagishsimon

[Wikidata-bugs] [Maniphest] [Updated] T224024: Fatal Error on Commons from Special:EntityData with n3 format (Argument to addEntityRedirect must be EntityId, null given)

2019-05-27 Thread Smalyshev
Smalyshev added a project: User-Smalyshev. TASK DETAIL https://phabricator.wikimedia.org/T224024 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Smalyshev, 20038011003, MarkTraceur, Aklapper, Michael, darthmon_wmde, Premeditated

[Wikidata-bugs] [Maniphest] [Triaged] T223946: Wikidata wdtn:P214 values (VIAF) seem to be corrupt

2019-05-25 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. Smalyshev added a comment. @Esc3300 adding more triples is possible, but should be discussed in a separate task. TASK DETAIL https://phabricator.wikimedia.org/T223946 EMAIL PREFERENCES https://phabricator.wikimedia.org/sett

[Wikidata-bugs] [Maniphest] [Commented On] T224024: Fatal Error on commons wiki from Special:EntityData with n3 format

2019-05-23 Thread Smalyshev
Smalyshev added a comment. I suspect there's some bug in format matching - .ttl, .nt, .rdf etc produce proper error message (since RDF export for MI entities is not enabled yet) but .n3 (which is supposed to be same as .nt) does not. TASK DETAIL https://phabricator.wikimedia.org/T224024

[Wikidata-bugs] [Maniphest] [Updated] T223946: Wikidata wdtn:P214 values (VIAF) seem to be corrupt

2019-05-22 Thread Smalyshev
Smalyshev added a project: User-Smalyshev. Smalyshev added a comment. I think I know what is the problem there... VIAF is stored as prefix+number, so there might be an overflow there. There's code that is supposed to deal with it, but maybe there's a bug in that code. TASK DETAIL https

[Wikidata-bugs] [Maniphest] [Commented On] T55652: Special:Search doesn't use labels and descriptions for suggestions but just the item ID

2019-05-19 Thread Smalyshev
Smalyshev added a comment. UI widget can display descriptions, but this is controlled by option `showDescriptions` which we do not enable. The setup is controlled by `SearchFormWidget` class which has it hardcoded. So we need to figure out how to toggle this option only on Wikidata. TASK

[Wikidata-bugs] [Maniphest] [Updated] T223811: Create a querybuilder based on Google Blocky

2019-05-19 Thread Smalyshev
Smalyshev edited projects, added Wikidata Query UI; removed Wikidata-Query-Service. TASK DETAIL https://phabricator.wikimedia.org/T223811 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: MichaelSchoenitzer_WMDE, Smalyshev Cc: Aklapper

[Wikidata-bugs] [Maniphest] [Commented On] T223773: MWAPI requests for external links return fewer than expected

2019-05-19 Thread Smalyshev
Smalyshev added a comment. As for the second one, it's unfortunately a limitation of the current API - only one result per page ( tag in generator) can be returned. In general, only one result per XPath match - i.e. if XPath matches more than one thing per page it won't work. TASK DETAIL

[Wikidata-bugs] [Maniphest] [Commented On] T223773: MWAPI requests for external links return fewer than expected

2019-05-19 Thread Smalyshev
Smalyshev added a comment. Second query returns 10 results for me. TASK DETAIL https://phabricator.wikimedia.org/T223773 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Smalyshev, Aklapper, MartinPoulter, darthmon_wmde, alaa_wmde

[Wikidata-bugs] [Maniphest] [Triaged] T222995: Decide which prefixes to use for MediaInfo RDF

2019-05-19 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T222995 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Denny, mkroetzsch, Mholloway, Cparle, daniel, Lucas_Werkmeister_WMDE, S

[Wikidata-bugs] [Maniphest] [Updated] T223736: Render images (and other non-text data) in the table view of query results

2019-05-19 Thread Smalyshev
Smalyshev edited projects, added Wikidata Query UI; removed Wikidata-Query-Service. TASK DETAIL https://phabricator.wikimedia.org/T223736 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Charlie_WMDE, Jakob_WMDE, waldyrious

[Wikidata-bugs] [Maniphest] [Closed] T222576: runBlazegraph.sh and .runUpsate.sh have a hardcoded log directory

2019-05-19 Thread Smalyshev
Smalyshev closed this task as "Invalid". Smalyshev added a comment. Log directory can be overridden by using LOG_DIR variable: LOG_DIR=${LOG_DIR:-"/var/log/wdqs"} TASK DETAIL https://phabricator.wikimedia.org/T222576 EMAIL PREFERENCES https://phabricator.wi

[Wikidata-bugs] [Maniphest] [Triaged] T222574: WDQS scripts assume JDK 8 and are not working on JDK 12

2019-05-19 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T222574 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Jakub.klimek, Aklapper, darthmon_wmde, alaa_wmde, Nandana,

[Wikidata-bugs] [Maniphest] [Commented On] T222995: Decide which prefixes to use for MediaInfo RDF

2019-05-19 Thread Smalyshev
Smalyshev added a comment. Looks like the preference is leaning towards `sdc:` - which is also my preference. TASK DETAIL https://phabricator.wikimedia.org/T222995 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Denny, mkroetzsch

[Wikidata-bugs] [Maniphest] [Commented On] T223743: Add option for Munger to sanitize IRIs

2019-05-19 Thread Smalyshev
Smalyshev added a comment. We may also want for it to sanitize non-standard dates and other things that third-party solutions may find wrong, so that we'd be able to generate RDF that is acceptable to any tool. TASK DETAIL https://phabricator.wikimedia.org/T223743 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] [Created] T223789: Add selenium tests to WikibaseCirrusSearch

2019-05-19 Thread Smalyshev
Smalyshev created this task. Smalyshev added projects: Discovery-Search, Wikidata, patch-welcome. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION Currently WikibaseCirrusSearch has zero browser tests. While it has unit tests for the most functionality, unit tests do

[Wikidata-bugs] [Maniphest] [Created] T223743: Add option for Munger to sanitize IRIs

2019-05-18 Thread Smalyshev
Smalyshev created this task. Smalyshev added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION Some URLs in RDF data from Wikidata contain invalid Unicode. This works with Blazegraph

[Wikidata-bugs] [Maniphest] [Triaged] T223711: Blazegraph explain does not produce anything useful for requests that time out

2019-05-18 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T223711 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Multichill, Aklapper, Smalyshev, E.S.A-Sheild, darthmon_wmde,

[Wikidata-bugs] [Maniphest] [Claimed] T223711: Blazegraph explain does not produce anything useful for requests that time out

2019-05-18 Thread Smalyshev
Smalyshev claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T223711 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Multichill, Aklapper, Smalyshev, E.S.A-Sheild, darthmon_wmde, alaa_wmde, joker88john, CucyNoiD, Nandana

[Wikidata-bugs] [Maniphest] [Created] T223711: Blazegraph explain does not produce anything useful for requests that time out

2019-05-18 Thread Smalyshev
Smalyshev created this task. Smalyshev added projects: Wikidata-Query-Service, Upstream. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION If I run the request that times out with `explain=details`, I do not get any useful

[Wikidata-bugs] [Maniphest] [Commented On] T219968: Enable the URLshortener for WDQS

2019-05-17 Thread Smalyshev
Smalyshev added a comment. We can, though it would be nicer if UrlSortener service added it. But it's possible to check and add it if the service doesn't. Probably makes sense to add separate task for it. TASK DETAIL https://phabricator.wikimedia.org/T219968 EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] [Commented On] T223314: Problem to select the right Wikidata Object

2019-05-17 Thread Smalyshev
Smalyshev added a comment. The only thing I can suggest is to search (fulltext) for `De Ruyter haswbstatement:P31=Q101352` which would produce the family name item, and then use it's Q-id. TASK DETAIL https://phabricator.wikimedia.org/T223314 EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] [Commented On] T221127: URL shortener widget is hard to copy

2019-05-17 Thread Smalyshev
Smalyshev added a comment. The code change that switched to new URL shortener handling is https://phabricator.wikimedia.org/rWDQGf5ed1c3dc1b99bef79d24585c8686a80d7f071e1 . The code uses clickover() but it for some reason works in query widget (top right) but not in the short result menu

[Wikidata-bugs] [Maniphest] [Commented On] T221774: Add Wikidata query service lag to Wikidata maxlag

2019-05-16 Thread Smalyshev
Smalyshev added a comment. Note that wdqs-test should not be included in maxlag at any case. These are test servers, which can be lagged significantly due to any number of reasons. Also, I'm not sure how easy it is to see if the server is in the pool, but it'd be nice if it was possible

[Wikidata-bugs] [Maniphest] [Commented On] T222497: dumpRDF for MediaInfo entities loads each page individually

2019-05-16 Thread Smalyshev
Smalyshev added a comment. I think we shouldn't wait for T208776 <https://phabricator.wikimedia.org/T208776> to fix this. Skipping the whole page props thing may work, though I am not sure how to implement the condition yet. Or maybe we need to change these APIs so they don't requir

[Wikidata-bugs] [Maniphest] [Updated] T216601: Allow download of Wikidata query results in GPS-friendly format(s)

2019-05-15 Thread Smalyshev
Smalyshev added a project: patch-welcome. TASK DETAIL https://phabricator.wikimedia.org/T216601 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Peb, Frettie, Geertivp, Salgo60, Pigsonthewing, Aklapper, darthmon_wmde, alaa_wmde

[Wikidata-bugs] [Maniphest] [Commented On] T211177: WDQ UI should support download of RDF formats

2019-05-15 Thread Smalyshev
Smalyshev added a comment. @Lucas_Werkmeister_WMDE this is true, though I think adding a button/link/some other UI to convert a query to result download wouldn't hurt either, with the understanding that this download makes a separate query (so it's distinct from downloading result

[Wikidata-bugs] [Maniphest] [Updated] T222306: RDF export generates wrong IDs for federated entities

2019-05-14 Thread Smalyshev
Smalyshev added a comment. Well, the real problem is not prefixes but that we're using here `wd:` for both M-entities and Q-entities, despite the former needing URIs starting with http://commons.wikimedia.org/entity and the latter http://www.wikidata.org/entity/. So the main problem

[Wikidata-bugs] [Maniphest] [Created] T222995: Decide which prefixes to use for MediaInfo RDF

2019-05-10 Thread Smalyshev
Smalyshev created this task. Smalyshev added projects: Wikidata, Commons, SDC General, Wikidata-Query-Service, WikibaseMediaInfo, User-Smalyshev. TASK DESCRIPTION Right now the code that generates RDF for wikibase uses hardcoded prefixes for entities and other nodes - `wdata:`, `wd:`, `wdt

[Wikidata-bugs] [Maniphest] [Commented On] T222861: Add the different constraint statuses in RDF

2019-05-10 Thread Smalyshev
Smalyshev added a comment. Where constraint type is specified? If it's a property of constraint itself, there should be a way to query it already. Or is it stored outside the constraint statement? I am not completely familiar with this part, would appreciate explanations or reference

[Wikidata-bugs] [Maniphest] [Triaged] T222861: Add the different constraint statuses in RDF

2019-05-10 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T222861 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Smalyshev, Harmonia_Amanda, Lucas_Werkmeister_WMDE, Aklapper, Lea_La

[Wikidata-bugs] [Maniphest] [Commented On] T222471: {"Accept": "application/ld+json"} causes 500 errors for LDF pages

2019-05-09 Thread Smalyshev
Smalyshev added a comment. The bug should be fixed now by reverting the upgrade. I'll see how to do the upgrade properly without breaking stuff. TASK DETAIL https://phabricator.wikimedia.org/T222471 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] [Closed] T222471: {"Accept": "application/ld+json"} causes 500 errors for LDF pages

2019-05-09 Thread Smalyshev
Smalyshev closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T222471 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Gehel, Krenair, Aklapper, Lexie_23Kr, darthmon_wmde, alaa_wmde, Nandana,

[Wikidata-bugs] [Maniphest] [Updated] T221127: URL shortener widget is hard to copy

2019-05-09 Thread Smalyshev
Smalyshev added a project: patch-welcome. TASK DETAIL https://phabricator.wikimedia.org/T221127 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Multichill, Pigsonthewing, Jheald, Smalyshev, Ladsgroup, Nemo_bis, Aklapper, darthmon_wmde

[Wikidata-bugs] [Maniphest] [Updated] T221127: URL shortener widget is hard to copy

2019-05-09 Thread Smalyshev
Smalyshev added a project: Wikimedia-Hackathon-2019. TASK DETAIL https://phabricator.wikimedia.org/T221127 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Multichill, Pigsonthewing, Jheald, Smalyshev, Ladsgroup, Nemo_bis, Aklapper

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T222471: {"Accept": "application/ld+json"} causes 500 errors for LDF pages

2019-05-08 Thread Smalyshev
Smalyshev added a subscriber: Gehel. Smalyshev added a comment. OK, this is a bit trickier than I thought... New LDF build depends on Jena 3.10.0. Which uses jsonld-java:jar:0.12.1. But Blazegraph depends on jsonld-java-sesame v 0.5.1 and in 0.12 version of jsonld there's no such thing

[Wikidata-bugs] [Maniphest] [Commented On] T222471: {"Accept": "application/ld+json"} causes 500 errors for LDF pages

2019-05-08 Thread Smalyshev
Smalyshev added a comment. Looks like com.github.jsonldjava.core.JsonLdApi.fromRDF is missing from the build. Probably something broken in the build that did not pick up new dependency. Will need to rebuild the package. TASK DETAIL https://phabricator.wikimedia.org/T222471 EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T221774: Add Wikidata query service lag to Wikidata maxlag

2019-05-08 Thread Smalyshev
Smalyshev added a comment. > do we need a whitelist/blacklist (or both) or some other mechanism to make sure we don't eg. take servers into account that are being maintained. Ideally, only servers in the public pool, or maybe public+internal pool, should be taken into acco

[Wikidata-bugs] [Maniphest] [Closed] T217897: Reduce / remove the aggessive cache busting behaviour of wdqs-updater

2019-05-07 Thread Smalyshev
Smalyshev closed this task as "Resolved". Smalyshev added a comment. Update now uses revision IDs everywhere for non-lagged fetches. TASK DETAIL https://phabricator.wikimedia.org/T217897 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To:

[Wikidata-bugs] [Maniphest] [Updated] T153353: Blazegraph not properly using labels from sub-queries for filtering (omitting rows), unless they're selected

2019-05-07 Thread Smalyshev
Smalyshev added a project: User-Smalyshev. TASK DETAIL https://phabricator.wikimedia.org/T153353 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Igorkim78, Aklapper, Smalyshev, hoo, darthmon_wmde, alaa_wmde, joker88john, ET4Eva

[Wikidata-bugs] [Maniphest] [Commented On] T153353: Blazegraph not properly using labels from sub-queries for filtering (omitting rows), unless they're selected

2019-05-07 Thread Smalyshev
Smalyshev added a comment. I am a bit cautions about adding stuff to annotations because there's some code that scans all the annotations and unexpected annotations may confuse it. That's why btw it is not possible to add reference to query base as annotation to child node (there's `parent

[Wikidata-bugs] [Maniphest] [Commented On] T221774: Add Wikidata query service lag to Wikidata maxlag

2019-05-07 Thread Smalyshev
Smalyshev added a comment. > Go through Prometheus or ask the instances individually or …? prometheus & icinga know what is the lag for each server, so I think it's better to ask them? I am not sure if we have good support for scheduled recurrent jobs on Wiki - if we do, we cou

[Wikidata-bugs] [Maniphest] [Commented On] T153353: Blazegraph not properly using labels from sub-queries for filtering (omitting rows), unless they're selected

2019-05-06 Thread Smalyshev
Smalyshev added a comment. OK, I checked and indeed Optimizer uses query root instead of encompassing QueryBase, which is wrong. However, the problem is that there seems to be no way to get from JoinGroup to encompassing QueryBase - parent for QueryBase is null even for subqueries. The code

[Wikidata-bugs] [Maniphest] [Commented On] T221146: WDQS confuses strings with and without U+00AD

2019-05-06 Thread Smalyshev
Smalyshev added a comment. @Bdijkstra we don't have generic solution for this yet, but if you provide a list of bad literals, it can be fixed. TASK DETAIL https://phabricator.wikimedia.org/T221146 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] [Updated] T222567: WDQS missing list of prerequisites for Chrome-based tests

2019-05-06 Thread Smalyshev
Smalyshev edited projects, added Wikidata Query UI; removed Wikidata-Query-Service. TASK DETAIL https://phabricator.wikimedia.org/T222567 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Jakub.klimek, alaa_wmde, Nandana, Lahi

[Wikidata-bugs] [Maniphest] [Updated] T222299: dumpRdf does not work with MediaInfo entities

2019-05-03 Thread Smalyshev
Smalyshev added a comment. I tried to generate dump with two patches above and it seems to work sanely except for two things: 1. Lot of complaints for non-existing entities (since not all NS_FILEs have mediainfo slots). Easy way to fix it is to shut up warnings. Harder but more correct

[Wikidata-bugs] [Maniphest] [Claimed] T222299: dumpRdf does not work with MediaInfo entities

2019-05-03 Thread Smalyshev
Smalyshev claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T99 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: WMDE-leszek, Jdforrester-WMF, matthiasmullie, Cparle, daniel, Lucas_Werkmeister_WMDE, Tpt, Addshore

[Wikidata-bugs] [Maniphest] [Triaged] T222497: dumpRDF for MediaInfo entities loads each page individually

2019-05-03 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T222497 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: daniel, Lucas_Werkmeister_WMDE, Addshore, Ramsey-WMF, Aklapper, W

[Wikidata-bugs] [Maniphest] [Created] T222497: dumpRDF for MediaInfo entities loads each page individually

2019-05-03 Thread Smalyshev
Smalyshev created this task. Smalyshev added projects: Wikidata, Commons, SDC General, Wikidata-Query-Service, WikibaseMediaInfo. TASK DESCRIPTION When dumping the entities to RDF, we try to load the data in batches, so that we do not call the database for each entity separately. However

[Wikidata-bugs] [Maniphest] [Lowered Priority] T53172: OpenSearch API for Wikidata returns no results

2019-05-03 Thread Smalyshev
Smalyshev lowered the priority of this task from "Low" to "Lowest". TASK DETAIL https://phabricator.wikimedia.org/T53172 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: debt, Ricordisamoa, Aklapper, Wikidata-bugs,

[Wikidata-bugs] [Maniphest] [Triaged] T222471: {"Accept": "application/ld+json"} causes 500 errors for LDF pages

2019-05-03 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T222471 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Krenair, Aklapper, Lexie_23Kr, alaa_wmde, Nandana,

[Wikidata-bugs] [Maniphest] [Updated] T55652: Special:Search doesn't use labels and descriptions for suggestions but just the item ID

2019-05-03 Thread Smalyshev
Smalyshev removed a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T55652 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: gerritbot, Smalyshev, Wikidata-bugs, Yair_rand, Lydia_Pintscher, daniel, alaa_wmde

[Wikidata-bugs] [Maniphest] [Commented On] T221146: WDQS confuses strings with and without U+00AD

2019-05-03 Thread Smalyshev
Smalyshev added a comment. There's no link, I just manually fixed the data for now. TASK DETAIL https://phabricator.wikimedia.org/T221146 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Smalyshev, Liridon, Bdijkstra, Aklapper

[Wikidata-bugs] [Maniphest] [Claimed] T222471: {"Accept": "application/ld+json"} causes 500 errors for LDF pages

2019-05-03 Thread Smalyshev
Smalyshev claimed this task. Smalyshev added projects: User-Smalyshev, Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T222471 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Krenair, Aklapper

[Wikidata-bugs] [Maniphest] [Updated] T222404: Tasks requiring Blazegraph reload

2019-05-03 Thread Smalyshev
Smalyshev added a comment. @Aklapper the idea is to track all the tasks that need full DB reload in one place. Since conceivably these tasks will be also popping up in the future, it will not be closed. If that's a problem, we could have separate task for each reload cycle, but we've been

[Wikidata-bugs] [Maniphest] [Lowered Priority] T222347: wbsearchentities now returns an error with type=lexeme

2019-05-03 Thread Smalyshev
Smalyshev lowered the priority of this task from "High" to "Normal". TASK DETAIL https://phabricator.wikimedia.org/T222347 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: alaa_wmde, Lucas_Werkmeister_WMDE, Jdforre

[Wikidata-bugs] [Maniphest] [Commented On] T222347: wbsearchentities now returns an error with type=lexeme

2019-05-03 Thread Smalyshev
Smalyshev added a comment. Seems to be working again now. Thanks for all who helped! TASK DETAIL https://phabricator.wikimedia.org/T222347 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: alaa_wmde, Lucas_Werkmeister_WMDE

[Wikidata-bugs] [Maniphest] [Commented On] T221504: investigate why content history dump of certain wikidata page ranges is so slow

2019-05-02 Thread Smalyshev
Smalyshev added a comment. I agree that probably more efficient format is needed, but unfortunately I don't have any immediate ideas - all dumps I've worked with were RDFs etc. and this is completely different one. In general, I'm not even sure Wikidata is a good fit for storing data

[Wikidata-bugs] [Maniphest] [Commented On] T222299: dumpRdf does not work with MediaInfo entities

2019-05-02 Thread Smalyshev
Smalyshev added a comment. With the patch above, it should be possible to use EntityByLinkedTitleLookup in the rdf loop and this should also produce mediainfo IDs. TASK DETAIL https://phabricator.wikimedia.org/T99 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel

[Wikidata-bugs] [Maniphest] [Commented On] T222299: dumpRdf does not work with MediaInfo entities

2019-05-02 Thread Smalyshev
Smalyshev added a comment. > Actually, the MediaInfoId can be generated from the Title object. It's based on the page ID. No access to the slot is needed. For generating ID, sure. But we don't know if the particular file page has the slot, and if it does not, we shouldn't gener

[Wikidata-bugs] [Maniphest] [Closed] T210738: schema:about URLs in Wikidata are encoded (mangled)

2019-05-02 Thread Smalyshev
Smalyshev closed this task as "Resolved". Smalyshev claimed this task. Smalyshev added a comment. Encoding is documented here: https://www.mediawiki.org/wiki/Wikibase/Indexing/RDF_Dump_Format#Sitelinks TASK DETAIL https://phabricator.wikimedia.org/T210738 EMAIL PREFERENC

[Wikidata-bugs] [Maniphest] [Updated] T194401: Investigate storing commons data in BlazeGraph

2019-05-02 Thread Smalyshev
Smalyshev closed this task as a duplicate of T221921: Provision search endpoint for SDC. Requirements from Product Team.. TASK DETAIL https://phabricator.wikimedia.org/T194401 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Cparle, Smalyshev Cc

[Wikidata-bugs] [Maniphest] [Merged] T221921: Provision search endpoint for SDC. Requirements from Product Team.

2019-05-02 Thread Smalyshev
Smalyshev merged a task: T194401: Investigate storing commons data in BlazeGraph. Smalyshev added subscribers: Lucas_Werkmeister_WMDE, Tpt. TASK DETAIL https://phabricator.wikimedia.org/T221921 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

<    1   2   3   4   5   6   7   8   9   10   >