dcausse added a comment.
In T336056#8910743 <https://phabricator.wikimedia.org/T336056#8910743>,
@dcausse wrote:
> @hoo I tested this but some work (hopefully trivial) is required before the
WDQS munger is able to interpret these URIs properly in the RDF output (created
a s
dcausse closed this task as "Declined".
dcausse added a comment.
It should support such URIs already, the warnings I saw were because I setup
the test improperly.
TASK DETAIL
https://phabricator.wikimedia.org/T338352
EMAIL PREFERENCES
https://phabricator.wikimedia.org/sett
dcausse changed the status of subtask T338352: Add support for EntitySchema
URIs in the WDQS munger from "Declined" to "Invalid".
TASK DETAIL
https://phabricator.wikimedia.org/T336056
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
dcausse changed the task status from "Declined" to "Invalid".
TASK DETAIL
https://phabricator.wikimedia.org/T338352
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc: KEMONO_PANTSU_KEMONO_PANTSU_KEMONO_PANTSU_KEM
dcausse closed subtask T338352: Add support for EntitySchema URIs in the WDQS
munger as "Declined".
TASK DETAIL
https://phabricator.wikimedia.org/T336056
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: hoo, dcausse
Cc: dcausse,
dcausse added a comment.
@hoo I tested this but some work (hopefully trivial) is required before the
WDQS munger is able to interpret these URIs properly in the RDF output (created
a subtask to track this work).
TASK DETAIL
https://phabricator.wikimedia.org/T336056
EMAIL PREFERENCES
dcausse created this task.
dcausse added projects: Wikidata, Wikidata-Query-Service.
TASK DESCRIPTION
The WDQS munger should support wikibase RDF output that has an entity schema
URI.
The current implementation does not recognize these objects and warns about
them with:
17:30
dcausse added a comment.
In T338255#8908886 <https://phabricator.wikimedia.org/T338255#8908886>,
@Nikki wrote:
> In T338255#8908771 <https://phabricator.wikimedia.org/T338255#8908771>,
@dcausse wrote:
>
>> Here is a list https://people.wikimedia.org/~dca
dcausse added a comment.
Here is a list https://people.wikimedia.org/~dcausse/T338255-lexemes.tsv
(they might not all be related to this problem but I suspect most of them are)
TASK DETAIL
https://phabricator.wikimedia.org/T338255
EMAIL PREFERENCES
https://phabricator.wikimedia.org
dcausse added a comment.
Thanks for looking into this! We found this problem by analyzing the
divergences between mysql and the elasticsearch index behind CirrusSearch, we
found 24000 Lexemes (very high compared to other content models) that are not
indexed, I can provide a list of page ids
dcausse created this task.
dcausse added projects: CirrusSearch, Wikidata.
Restricted Application added a subscriber: Aklapper.
Restricted Application added a project: Discovery-Search.
TASK DESCRIPTION
Building the CirrusSearch document do seem to trigger an exception: `Caught
exception of
dcausse updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T332953
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc: jnuche, isarantopoulos, BPirkle, Tgr, Eevans, Seddon, MSantos, kevinbazira,
odimitrijevic
dcausse removed EBernhardson as the assignee of this task.
dcausse added a subscriber: EBernhardson.
TASK DETAIL
https://phabricator.wikimedia.org/T336709
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc: EBernhardson, dcausse, Aklapper
dcausse created this task.
dcausse added a project: Wikidata-Query-Service.
Restricted Application added a subscriber: Aklapper.
TASK DESCRIPTION
Requested by Epìdosis via
https://www.wikidata.org/wiki/Wikidata:SPARQL_federation_input#BNCF
TASK DETAIL
https://phabricator.wikimedia.org
dcausse updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T336134
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: bking, dcausse
Cc: bking, Aklapper, Bugreporter, Themindcoder, Adamm71, Jersione, Hellket777,
LisafBia6531
dcausse lowered the priority of this task from "Unbreak Now!" to "High".
dcausse updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T336134
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: bking, dcausse
dcausse added a comment.
@ItamarWMDE the patch finally got deployed, the prometheus query should look
like:
`max(time() - label_replace(blazegraph_lastupdated, "host", "$1", "instance",
"^([^:]+):.*
dcausse created this task.
dcausse added a project: Wikidata-Query-Service.
Restricted Application added a subscriber: Aklapper.
TASK DESCRIPTION
Requested via
https://www.wikidata.org/wiki/Wikidata:Report_a_technical_problem/WDQS_and_Search#New_federated_query_service:
>> I want t
dcausse moved this task from In Progress to Needs Reporting on the
Discovery-Search (Current work) board.
dcausse added a comment.
the flink job is properly running from the k8s-dse cluster using the
flink-operator:
https://grafana.wikimedia.org/d/gCFgfpG7k/flink-cluster?orgId=1&
dcausse added a comment.
currently still stuck with
scala.MatchError: None (of class scala.None$)
at
org.wikidata.query.rdf.updater.SideOutputSerializationSchema.getRecordClock(SideOutputSerializationSchema.scala:31)
at
dcausse updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T73
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc: dcausse, Aklapper, AWesterinen, MPhamWMF, CBogen, Namenlos314, Gq86,
Lucas_Werkmeister_WMDE
dcausse created this task.
dcausse added a project: Wikidata-Query-Service.
Restricted Application added a subscriber: Aklapper.
TASK DESCRIPTION
The way we configure the kafka consumer assume that we pass the PLAINTEXT
port.
We should have a way to configure the security protocol to use
dcausse added a comment.
Restricted Application added a project: User-ItamarWMDE.
@ItamarWMDE once https://gerrit.wikimedia.org/r/900729 is deployed we should
be able to create a grafana query like the one suggested by Joe and adjust the
threshold to double check that the query does what we
dcausse closed this task as "Declined".
dcausse added a comment.
We might have to switch to KafkaSource and this might change the behavior of
flink during this kind of scenario.
TASK DETAIL
https://phabricator.wikimedia.org/T297870
EMAIL PREFERENCES
https://phabricator.wik
dcausse claimed this task.
dcausse moved this task from Incoming to To Be Deployed on the Discovery-Search
(Current work) board.
TASK DETAIL
https://phabricator.wikimedia.org/T331271
WORKBOARD
https://phabricator.wikimedia.org/project/board/1227/
EMAIL PREFERENCES
https
dcausse added a comment.
WDQS lag issues should be rare now, a node not serving traffic should (as of
today) be able to ingest ~8x the throughput that we usually see on wikidata so
we should not worry about them.
Using `blazegraph_queries_done_total` to identify nodes that should be part
dcausse closed this task as "Resolved".
dcausse assigned this task to fgiunchedi.
dcausse added a comment.
can confirm it's fixed by the above patch, saw multiple alerts of this kind
being fired during the k8s upgrade. Thanks!
TASK DETAIL
https://phabricator.wikimedia.org
dcausse added a comment.
In T331405#8672341 <https://phabricator.wikimedia.org/T331405#8672341>, @Joe
wrote:
> Updates shouldn't depend on where the discovery dns record points to, but
rather go to the local datacenter directly.
>
> I think the bug here is with
dcausse created this task.
dcausse added a project: Wikidata-Query-Service.
Restricted Application added a subscriber: Aklapper.
TASK DESCRIPTION
Requested via
https://www.wikidata.org/wiki/Wikidata:Report_a_technical_problem/WDQS_and_Search
<https://www.wikidata.org/w
dcausse added a parent task: T330521: Make WDQS update stream public.
TASK DETAIL
https://phabricator.wikimedia.org/T294133
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc: RBrounley_WMF, Harej, Ottomata, Aklapper, dcausse, Mohamed
dcausse added a subtask: T294133: Expose rdf-streaming-updater.mutation content
through EventStreams.
TASK DETAIL
https://phabricator.wikimedia.org/T330521
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc: Jheald, Gehel, KingsleyIdehen
dcausse updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T241128
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc: MPhamWMF, Gehel, Addshore, dcausse, Aklapper, Astuthiodit_1, AWesterinen,
BeautifulBold, Suran38
dcausse claimed this task.
dcausse moved this task from incoming to in progress on the Wikidata board.
TASK DETAIL
https://phabricator.wikimedia.org/T328675
WORKBOARD
https://phabricator.wikimedia.org/project/board/71/
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel
dcausse moved this task from Ready for Dev -- SRE/Ops to To Be Deployed on the
Discovery-Search (Current work) board.
dcausse claimed this task.
TASK DETAIL
https://phabricator.wikimedia.org/T328625
WORKBOARD
https://phabricator.wikimedia.org/project/board/1227/
EMAIL PREFERENCES
https
dcausse updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T328675
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc: pfischer, bking, dcausse, Aklapper, Themindcoder, Adamm71, Jersione,
Hellket777, LisafBia6531
dcausse moved this task from Needs review to Needs Reporting on the
Discovery-Search (Current work) board.
dcausse added a comment.
Q115608572 was restored after applying the fix, items that were not edited
after being undeleted will sadly remain absent from WDQS until an edit is made
or
dcausse added a comment.
The inconsistencies were properly detected by the updater:
select * from rdf_streaming_updater_state_inconsistency where year=2023 AND
month=01 AND day=12 AND meta.domain="www.wikidata.org" AND item="Q115608572"
AND datacenter="codfw&
dcausse claimed this task.
TASK DETAIL
https://phabricator.wikimedia.org/T329089
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc: Aklapper, dcausse, Themindcoder, Adamm71, Jersione, Hellket777,
LisafBia6531, Astuthiodit_1, AWesterinen
dcausse added a project: Discovery-Search (Current work).
TASK DETAIL
https://phabricator.wikimedia.org/T329089
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc: Aklapper, dcausse, Themindcoder, Adamm71, Jersione, Hellket777,
LisafBia6531
dcausse added a comment.
The reconcile batch job seems the one to blame, it reports:
`23/01/12 03:29:25 INFO ReconcileCollector: Collected 0 inconsistencies from
event.rdf_streaming_updater_state_inconsistency/datacenter=eqiad/year=2023/month=1/day=12/hour=0`
While clearly there was
dcausse updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T329089
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc: Aklapper, dcausse, AWesterinen, MPhamWMF, CBogen, Namenlos314, Gq86,
Lucas_Werkmeister_WMDE
dcausse created this task.
dcausse added a project: Wikidata-Query-Service.
Restricted Application added a subscriber: Aklapper.
TASK DESCRIPTION
Receiving a revision-create events after page-delete events should be dealt
as an inconsistency and be processed by the reconciliation job
dcausse added a comment.
In T293063#8582625 <https://phabricator.wikimedia.org/T293063#8582625>,
@JMeybohm wrote:
> Anyhow. AIUI this process will be more or less the same for flink
deployments managed by the flink operator. It would be nice if you could verify
this during y
dcausse added a comment.
In T293063#8582548 <https://phabricator.wikimedia.org/T293063#8582548>,
@JMeybohm wrote:
> Hey @dcausse, I'm reading this again because of the upcoming k8s 1.23
upgrade and was wondering:
> In "To restore:" section of "Alter
dcausse updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T293063
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc: akosiaris, RKemper, Gehel, bking, JMeybohm, Jelto, Aklapper, jijiki,
dcausse, Astuthiodit_1
dcausse updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T326409
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc: BTullis, JMeybohm, gmodena, Ottomata, bking, Aklapper, dcausse, Adamm71,
Jersione, Hellket777
dcausse updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T326409
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc: BTullis, JMeybohm, gmodena, Ottomata, bking, Aklapper, dcausse, Adamm71,
Jersione, Hellket777
dcausse added a parent task: T326409: Migrate the wdqs streaming updater flink
jobs to flink-k8s-operator deployment model.
TASK DETAIL
https://phabricator.wikimedia.org/T328675
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc: bking
dcausse added a subtask: T328675: Create a dse-k8s service demonstrating how to
run the rdf-streaming-updater using the flink-app chart.
TASK DETAIL
https://phabricator.wikimedia.org/T326409
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc
dcausse created this task.
dcausse added a project: Wikidata-Query-Service.
Restricted Application added a subscriber: Aklapper.
TASK DESCRIPTION
The flink-k8s-operator is not available on the dse-k8s cluster. We should
create a new helmfile using the `flink-app` chart to run an
dcausse moved this task from In Progress to Needs review on the
Discovery-Search (Current work) board.
dcausse added a comment.
The updater with flink 1.16 did run for about 3 days in yarn, notable change
is that it required 5g of mem to run without failure during backfills. Current
dcausse added a comment.
@Oravrattas thanks for the report, I've depooled these machines because these
are new hosts that are not ready to serve user traffic yet (they have an
empty/partially loaded database).
TASK DETAIL
https://phabricator.wikimedia.org/T322869
EMAIL PREFER
dcausse updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T326409
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc: JMeybohm, gmodena, Ottomata, bking, Aklapper, dcausse, Astuthiodit_1,
AWesterinen, karapayneWMDE
dcausse updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T326409
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc: JMeybohm, gmodena, Ottomata, bking, Aklapper, dcausse, Astuthiodit_1,
AWesterinen, karapayneWMDE
dcausse updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T241128
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc: MPhamWMF, Gehel, Addshore, dcausse, Aklapper, Astuthiodit_1, AWesterinen,
BeautifulBold, Suran38
dcausse updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T241128
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc: MPhamWMF, Gehel, Addshore, dcausse, Aklapper, Astuthiodit_1, AWesterinen,
BeautifulBold, Suran38
dcausse updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T241128
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc: MPhamWMF, Gehel, Addshore, dcausse, Aklapper, Astuthiodit_1, AWesterinen,
BeautifulBold, Suran38
dcausse closed this task as "Declined".
dcausse added a comment.
Everything looks fine from my end! closing :)
TASK DETAIL
https://phabricator.wikimedia.org/T325730
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc: bk
dcausse renamed this task from "Upgrade the WDQS streaming updater to latest
flink (1.15)" to "Upgrade the WDQS streaming updater to latest flink (1.16)".
TASK DETAIL
https://phabricator.wikimedia.org/T289836
EMAIL PREFERENCES
https://phabricator.wikimedi
dcausse created this task.
dcausse added a project: Wikidata-Query-Service.
Restricted Application added a subscriber: Aklapper.
TASK DESCRIPTION
FlinkKafkaConsumer
<https://nightlies.apache.org/flink/flink-docs-release-1.14/release-notes/flink-1.14/#deprecate-flinkkafkaconsumer>
dcausse moved this task from Waiting to In Progress on the Discovery-Search
(Current work) board.
dcausse claimed this task.
TASK DETAIL
https://phabricator.wikimedia.org/T289836
WORKBOARD
https://phabricator.wikimedia.org/project/board/1227/
EMAIL PREFERENCES
https
dcausse updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T326409
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc: bking, Aklapper, dcausse, Astuthiodit_1, AWesterinen, karapayneWMDE,
Invadibot, MPhamWMF
dcausse moved this task from Feature Requests to Wikibase Search on the
Discovery-Search board.
dcausse added a comment.
This ticket is I think about finishing the work regarding the integration of
WikibaseLexeme with CirrusSearch to index and query senses when performing a
fulltext search
dcausse updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T326535
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc: dcausse, Aklapper, AWesterinen, MPhamWMF, CBogen, Namenlos314, Gq86,
Lucas_Werkmeister_WMDE
dcausse created this task.
dcausse added a project: Wikidata-Query-Service.
Restricted Application added a subscriber: Aklapper.
TASK DESCRIPTION
The alert BlazegraphFreeAllocatorsDecreasingRapidly is fired when blazegraph
starts to consume its free allocators to quickly, this currently
dcausse added a parent task: T326409: Migrate the wdqs streaming updater flink
jobs to flink-k8s-operator deployment model.
TASK DETAIL
https://phabricator.wikimedia.org/T289836
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc: dcausse
dcausse added a subtask: T289836: Upgrade the WDQS streaming updater to latest
flink (1.15).
TASK DETAIL
https://phabricator.wikimedia.org/T326409
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc: Aklapper, dcausse, Astuthiodit_1
dcausse created this task.
dcausse added a project: Wikidata-Query-Service.
Restricted Application added a subscriber: Aklapper.
TASK DESCRIPTION
The WDQS streaming updater is using a session cluster mode but the work done
on T324576 <https://phabricator.wikimedia.org/T324576> should al
dcausse added a project: Wikidata-Query-Service.
TASK DETAIL
https://phabricator.wikimedia.org/T326305
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc: dcausse, MoritzMuehlenhoff, Aklapper, jbond, bking, RKemper, ayounsi,
AWesterinen
dcausse updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T326311
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc: dcausse, Nikki, Aklapper, AWesterinen, MPhamWMF, CBogen, Namenlos314, Gq86
dcausse created this task.
dcausse added a project: Wikidata-Query-Service.
Restricted Application added a subscriber: Aklapper.
TASK DESCRIPTION
In T302189 <https://phabricator.wikimedia.org/T302189> it was reported:
In T302189#8501314 <https://phabricator.wikimedia.org/T30218
dcausse added a comment.
In T302189#8501314 <https://phabricator.wikimedia.org/T302189#8501314>,
@Nikki wrote:
> This report of grammatical features
<https://www.wikidata.org/wiki/Wikidata:Lexicographical_data/Statistics/Count_of_forms_by_grammatical_feature>
is w
dcausse renamed this task from "Wikidata constraint check is getting throttled
from wdsq-internal more than usual" to "Wikidata constraint check is getting
throttled from wdqs-internal more than usual".
TASK DETAIL
https://phabricator.wikimedia.org/T325730
EMAIL
dcausse created this task.
dcausse added projects: Wikidata-Query-Service, Wikibase-Quality-Constraints.
Restricted Application added a subscriber: Aklapper.
TASK DESCRIPTION
Checking the telemetry metrics for jobrunner -> wdqs-internal we found weird
patterns
<https://grafana.wikimedia
dcausse moved this task from Operations/SRE to Current work on the
Wikidata-Query-Service board.
dcausse added a project: Discovery-Search (Current work).
TASK DETAIL
https://phabricator.wikimedia.org/T304914
WORKBOARD
https://phabricator.wikimedia.org/project/board/891/
EMAIL PREFERENCES
dcausse added a project: Discovery-Search (Current work).
dcausse moved this task from Scaling to Current work on the
Wikidata-Query-Service board.
TASK DETAIL
https://phabricator.wikimedia.org/T289836
WORKBOARD
https://phabricator.wikimedia.org/project/board/891/
EMAIL PREFERENCES
https
dcausse updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T244341
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc: ericP, JMinor, TomT0m, Gehel, Multichill, Pfps, Mmarx, Dipsacus_fullonum,
Luitzen
dcausse added a comment.
Let's keep the WDQS tag on this ticket because if you change how the RDF
output is generated we might have to re-import the data to WDQS to make sure
that all these dates get cleaned-up.
TASK DETAIL
https://phabricator.wikimedia.org/T324345
EMAIL PREFER
dcausse added a comment.
I believe this problem is similar to what was reported in
https://www.wikidata.org/wiki/Wikidata:Report_a_technical_problem/WDQS_and_Search#Updater_issue_?
My understanding of this problem is as follow:
The wikibase RDF for sitelinks uses the URL of the link
dcausse added a comment.
Recording few findings: checked 3 examples and they both relate to edits
happening around `2022-05-05T18:03:00`:
- https://www.wikidata.org/w/index.php?title=Q2053506&action=history (right
after revision 1579954206)
- https://www.wikidata.org/w/index.php?t
dcausse created this task.
dcausse added a project: Wikidata-Query-Service.
Restricted Application added a subscriber: Aklapper.
TASK DESCRIPTION
Reported by User:Oravrattas via
https://www.wikidata.org/wiki/Wikidata:Report_a_technical_problem/WDQS_and_Search#Fewer_results_from_wdqs20
dcausse closed this task as "Declined".
dcausse added a comment.
This sparql endpoints requires a `csrfmiddlewaretoken` parameter to work and
I don't think we can configure blazegraph to provide it (and I have no clue how
it is supposed to work nor from where it is obtained
dcausse added a comment.
@Nikki this sparql endpoint states:
> Notice: This SPARQL endpoint is maintained by NCBO for demo purposes. It
serves as playground to explore BioPortal's ontologies in RDF and we do not
recommend its use for production applications or heavy batch proces
dcausse lowered the priority of this task from "Unbreak Now!" to "High".
dcausse added a comment.
While fixing T238751 <https://phabricator.wikimedia.org/T238751> I think the
criteria to enable max lag did change from the median of all the servers to the
most lagg
dcausse added a comment.
@bking I did not spot any errors, the `not found, terminating` line is
expected I guess.
The reload cookbook seemed to have taken care of a bunch of the 3 first steps
you mention, I think the remaining steps are just to propagate the journal
using the data
dcausse added a comment.
@bking I see that the doc has been updated, can we move this ticket to the
Needs reporting column?
TASK DETAIL
https://phabricator.wikimedia.org/T316031
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: bking, dcausse
Cc
dcausse added a comment.
Note on CirrusSearch and the search indices: this should have no impact as
Properties are already part of `wgNamespacesToBeSearchedDefault` and thus
already considered "content" for CirrusSearch so moving this namespace (120) to
`wgContentNamespaces` will
dcausse reassigned this task from EBernhardson to bking.
dcausse added a comment.
@bking what is the status of this ticket?
TASK DETAIL
https://phabricator.wikimedia.org/T316236
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: bking, dcausse
Cc
dcausse removed a project: Discovery-Search (Current work).
TASK DETAIL
https://phabricator.wikimedia.org/T242453
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc: RKemper, bking, RLazarus, Legoktm, Gehel, William_Avery, CDanis, Addshore
dcausse removed a project: Discovery-Search (Current work).
TASK DETAIL
https://phabricator.wikimedia.org/T316005
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc: fgiunchedi, bking, dcausse, Aklapper, Astuthiodit_1, AWesterinen
dcausse added a comment.
the 2 flink jobs are running from k8s@codfw now (c.f.
https://grafana-rw.wikimedia.org/d/gCFgfpG7k/flink-session-cluster?orgId=1&var-datasource=codfw%20prometheus%2Fk8s&var-namespace=rdf-streaming-updater)
TASK DETAIL
https://phabricator.wikimedia.org
dcausse removed a project: Discovery-Search (Current work).
TASK DETAIL
https://phabricator.wikimedia.org/T317530
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc: EBernhardson, WMDE-leszek, bking, Aklapper, dcausse, Astuthiodit_1
dcausse added a comment.
The above patch adds quick alert on the space used by `auth_WDQS`, it does
not address all the ACs of this ticket but I think is the minimal requirement
to make sure we react quickly if similar problems occur in the future.
TASK DETAIL
https
dcausse claimed this task.
dcausse moved this task from Prioritized to In Progress on the Discovery-Search
(Current work) board.
TASK DETAIL
https://phabricator.wikimedia.org/T316028
WORKBOARD
https://phabricator.wikimedia.org/project/board/1227/
EMAIL PREFERENCES
https
dcausse closed this task as "Resolved".
dcausse claimed this task.
dcausse added a comment.
@BCornwall yes, this ticket can be closed, remaining work is tracked here:
- complete the cleanup: T316031 <https://phabricator.wikimedia.org/T316031>
- restore the job in k8s
dcausse triaged this task as "High" priority.
dcausse added a comment.
Tentatively setting to high as this will cause data consistency issues.
From the updater perspective we have to relax this component to allow such
data (it will just report a warning and monitor such issues) b
dcausse created this task.
dcausse added projects: SDC General, Commons, Structured-Data-Backlog.
Restricted Application added a subscriber: Aklapper.
TASK DESCRIPTION
See in:
- https://commons.wikimedia.org/wiki/Special:EntityData/M69231551.json
- https://commons.wikimedia.org/wiki
dcausse added a comment.
Discussed this with Joseph as we believe that having to configure the cleanup
job in another repo is not ideal.
It seems that the long term approach might be around using the data catalog
(https://datahub.wikimedia.org/) to store some retention metadata and have
dcausse added a comment.
Will be picked up once the cleanup is done (T316031
<https://phabricator.wikimedia.org/T316031>).
TASK DETAIL
https://phabricator.wikimedia.org/T316028
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc:
dcausse updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T316882
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse
Cc: dcausse, Aklapper, AWesterinen, MPhamWMF, CBogen, Namenlos314, Gq86,
Lucas_Werkmeister_WMDE
201 - 300 of 1088 matches
Mail list logo
