[Wikidata-bugs] [Maniphest] T347405: WikiCurricula, an interface to represent curricula data

2023-10-03 Thread ATEMK1NG 
ATEMK1NG added a comment.


  Hello , I am call Atemafac Kingsley, I am a data analyst. I got approved for 
the next step of Outreachy internship program and i will like to participate in 
this project. I find it very interesting. 
  Thanks.

TASK DETAIL
  https://phabricator.wikimedia.org/T347405

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Piracalamina, ATEMK1NG
Cc: ATEMK1NG, Jcxiang, Ndifon_Titiana, Afi570, Abbe98, Aklapper, Saileshpat, 
Piracalamina, SPatnaik, Danny_Benjafield_WMDE, Maryann-Onyinye, SaleSaLh, 
Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, Zblace, Raymond_Ndibe, 
ItamarWMDE, Karma2902, Sanyam.wikime, Akuckartz, Pavithraes, Arkadiy_Voronov, 
Nandana, Lahi, Himanshuc3, Gq86, contraexemplo, GoranSMilovanovic, 
Ivana_Isadora, QZanden, Xephyr826, Miriya52, merbst, LawExplorer, 
wassan.anmol117, _jensen, rosalieper, Scott_WUaS, Ixocactus, Wikidata-bugs, 
aude, He7d3r, Mbch331, Jay8g
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T328543: [QB] [WDQS-GUI] Move build scripts from CI to the repository

2023-10-03 Thread gerritbot 
gerritbot added a comment.


  Change 963196 had a related patch set uploaded (by WDQSGuiBuilder; author: 
WDQSGuiBuilder):
  
  [wikidata/query-builder/deploy@production] Merging from 
472864b6e92537d079ad719b070ba95f205a81f9
  
  https://gerrit.wikimedia.org/r/963196

TASK DETAIL
  https://phabricator.wikimedia.org/T328543

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: noarave, gerritbot
Cc: Lucas_Werkmeister_WMDE, noarave, hashar, ItamarWMDE, Aklapper, Michael, 
Danny_Benjafield_WMDE, Isabelladantes1983, Themindcoder, Adamm71, Jersione, 
Hellket777, LisafBia6531, Astuthiodit_1, AWesterinen, 786, Biggs657, 
karapayneWMDE, Invadibot, maantietaja, Juan90264, Peteosx1x, Alter-paule, 
Beast1978, Un1tY, Mgagat, Akuckartz, Totolinototo3, Hook696, PatsagornY, 
Kent7301, Zanziii, Sadisticturd, joker88john, CucyNoiD, Nandana, Namenlos314, 
jijiki, Klaas_Z4us_V, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, 
Bsandipan, GoranSMilovanovic, Mahir256, QZanden, EBjune, merbst, LawExplorer, 
Salgo60, Lewizho99, Maathavan, elukey, _jensen, rosalieper, Neuronton, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Lydia_Pintscher, Mbch331, Jay8g, ori
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T347070: Wikidata Mismatch Finder: Change target branch and commit directly

2023-10-03 Thread abi_ 
abi_ added a comment.


  In T347070#9216034 , 
@ItamarWMDE wrote:
  
  > @abi_, Apologies, translatewiki was not in the list of allowed 
contributors, but I now added it. Can you please try again?
  
  Still having the same issue:

TASK DETAIL
  https://phabricator.wikimedia.org/T347070

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: abi_
Cc: Aklapper, ItamarWMDE, Danny_Benjafield_WMDE, Isabelladantes1983, 
Themindcoder, Dominika_Naumiuk, Adamm71, Jersione, Hellket777, LisafBia6531, 
Wangombe, Astuthiodit_1, 786, MaryMunyoki, Biggs657, karapayneWMDE, Invadibot, 
ZealousBlaze, PallaviPatke, maantietaja, Mattia_Capozzi_WMDE, Juan90264, 
Alter-paule, Beast1978, Rileych, Un1tY, Akuckartz, Winston_Sung, 50019062, 
Hook696, abi_, Sms2sms, Kent7301, joker88john, CucyNoiD, Nandana, Gaboe420, 
Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, GoranSMilovanovic, 
JakeTheDeveloper, Devin-Henrickson, QZanden, srishakatux, LawExplorer, 
Lewizho99, Maathavan, _jensen, rosalieper, Soum213, Taiwania_Justo, Neuronton, 
shinjiman, Scott_WUaS, Wikidata-bugs, aude, jayvdb, Nikerabbit, Arrbee, 
santhosh, KartikMistry, Mbch331, Jay8g
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T347070: Wikidata Mismatch Finder: Change target branch and commit directly

2023-10-03 Thread gerritbot 
gerritbot added a comment.


  Change 963194 **merged** by jenkins-bot:
  
  [translatewiki@master] WikidataMismatchFinder: Create PR when exporting 
translation
  
  https://gerrit.wikimedia.org/r/963194

TASK DETAIL
  https://phabricator.wikimedia.org/T347070

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: abi_, gerritbot
Cc: Aklapper, ItamarWMDE, Danny_Benjafield_WMDE, Isabelladantes1983, 
Themindcoder, Dominika_Naumiuk, Adamm71, Jersione, Hellket777, LisafBia6531, 
Wangombe, Astuthiodit_1, 786, MaryMunyoki, Biggs657, karapayneWMDE, Invadibot, 
ZealousBlaze, PallaviPatke, maantietaja, Mattia_Capozzi_WMDE, Juan90264, 
Alter-paule, Beast1978, Rileych, Un1tY, Akuckartz, Winston_Sung, 50019062, 
Hook696, abi_, Sms2sms, Kent7301, joker88john, CucyNoiD, Nandana, Gaboe420, 
Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, GoranSMilovanovic, 
JakeTheDeveloper, Devin-Henrickson, QZanden, srishakatux, LawExplorer, 
Lewizho99, Maathavan, _jensen, rosalieper, Soum213, Taiwania_Justo, Neuronton, 
shinjiman, Scott_WUaS, Wikidata-bugs, aude, jayvdb, Nikerabbit, Arrbee, 
santhosh, KartikMistry, Mbch331, Jay8g
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T347070: Wikidata Mismatch Finder: Change target branch and commit directly

2023-10-03 Thread gerritbot 
gerritbot added a project: Patch-For-Review.

TASK DETAIL
  https://phabricator.wikimedia.org/T347070

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: abi_, gerritbot
Cc: Aklapper, ItamarWMDE, Danny_Benjafield_WMDE, Isabelladantes1983, 
Themindcoder, Dominika_Naumiuk, Adamm71, Jersione, Hellket777, LisafBia6531, 
Wangombe, Astuthiodit_1, 786, MaryMunyoki, Biggs657, karapayneWMDE, Invadibot, 
ZealousBlaze, PallaviPatke, maantietaja, Mattia_Capozzi_WMDE, Juan90264, 
Alter-paule, Beast1978, Rileych, Un1tY, Akuckartz, Winston_Sung, 50019062, 
Hook696, abi_, Sms2sms, Kent7301, joker88john, CucyNoiD, Nandana, Gaboe420, 
Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, GoranSMilovanovic, 
JakeTheDeveloper, Devin-Henrickson, QZanden, srishakatux, LawExplorer, 
Lewizho99, Maathavan, _jensen, rosalieper, Soum213, Taiwania_Justo, Neuronton, 
shinjiman, Scott_WUaS, Wikidata-bugs, aude, jayvdb, Nikerabbit, Arrbee, 
santhosh, KartikMistry, Mbch331, Jay8g
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T347070: Wikidata Mismatch Finder: Change target branch and commit directly

2023-10-03 Thread gerritbot 
gerritbot added a comment.


  Change 963194 had a related patch set uploaded (by Abijeet Patro; author: 
Abijeet Patro):
  
  [translatewiki@master] WikidataMismatchFinder: Create PR when exporting 
translation
  
  https://gerrit.wikimedia.org/r/963194

TASK DETAIL
  https://phabricator.wikimedia.org/T347070

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: abi_, gerritbot
Cc: Aklapper, ItamarWMDE, Danny_Benjafield_WMDE, Dominika_Naumiuk, Wangombe, 
Astuthiodit_1, MaryMunyoki, karapayneWMDE, Invadibot, ZealousBlaze, 
PallaviPatke, maantietaja, Mattia_Capozzi_WMDE, Rileych, Akuckartz, 
Winston_Sung, 50019062, abi_, Sms2sms, Nandana, Lahi, Gq86, GoranSMilovanovic, 
JakeTheDeveloper, Devin-Henrickson, QZanden, srishakatux, LawExplorer, _jensen, 
rosalieper, Soum213, Taiwania_Justo, shinjiman, Scott_WUaS, Wikidata-bugs, 
aude, jayvdb, Nikerabbit, Arrbee, santhosh, KartikMistry, Mbch331, Jay8g
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T347405: WikiCurricula, an interface to represent curricula data

2023-10-03 Thread Jcxiang 
Jcxiang added a comment.


  Hi, I got approved for the next step of Outreach and I am interested in this 
project, do I just go to the repo to work on it or do I need to get some 
permission to assign me to do it?

TASK DETAIL
  https://phabricator.wikimedia.org/T347405

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Piracalamina, Jcxiang
Cc: Jcxiang, Ndifon_Titiana, Afi570, Abbe98, Aklapper, Saileshpat, 
Piracalamina, SPatnaik, Danny_Benjafield_WMDE, Maryann-Onyinye, SaleSaLh, 
Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, Zblace, Raymond_Ndibe, 
ItamarWMDE, Karma2902, Sanyam.wikime, Akuckartz, Pavithraes, Arkadiy_Voronov, 
Nandana, Lahi, Himanshuc3, Gq86, contraexemplo, GoranSMilovanovic, 
Ivana_Isadora, QZanden, Xephyr826, Miriya52, merbst, LawExplorer, 
wassan.anmol117, _jensen, rosalieper, Scott_WUaS, Ixocactus, Wikidata-bugs, 
aude, He7d3r, Mbch331, Jay8g
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T348079: WMDE: Review code on mw object and mark (un)stable interfaces before 1.42.0

2023-10-03 Thread Maintenance_bot 
Maintenance_bot added a project: Wikidata.

TASK DETAIL
  https://phabricator.wikimedia.org/T348079

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Maintenance_bot
Cc: Aklapper, Jdlrobson, Danny_Benjafield_WMDE, Astuthiodit_1, karapayneWMDE, 
Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, Lea_WMDE, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331, Jay8g
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T341210: FlaggedRevs ReviewHandlerTest::testWithMinParams fails in EntitySchema CI

2023-10-03 Thread gerritbot 
gerritbot added a comment.


  Change 963168 had a related patch set uploaded (by Umherirrender; author: 
Thiemo Kreuz (WMDE)):
  
  [mediawiki/extensions/FlaggedRevs@REL1_39] Add flaggedrevs table to 
$tablesUsed in ReviewHandlerTest
  
  https://gerrit.wikimedia.org/r/963168

TASK DETAIL
  https://phabricator.wikimedia.org/T341210

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: thiemowmde, gerritbot
Cc: thiemowmde, awight, Lucas_Werkmeister_WMDE, Aklapper, 
Danny_Benjafield_WMDE, Isabelladantes1983, Themindcoder, Adamm71, Jersione, 
Hellket777, LisafBia6531, Astuthiodit_1, 786, Biggs657, karapayneWMDE, 
Invadibot, Asartea, maantietaja, Juan90264, Alter-paule, Beast1978, ItamarWMDE, 
Un1tY, Akuckartz, Dzaky17, Hook696, Kent7301, pdehaye, joker88john, DannyS712, 
CucyNoiD, Nandana, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, 
Bsandipan, tsca, Andrawaag, GoranSMilovanovic, QZanden, YULdigitalpreservation, 
LawExplorer, Salgo60, Lewizho99, Maathavan, _jensen, rosalieper, XanonymusX, 
Neuronton, Scott_WUaS, Cirdan, MisterSynergy, abian, Zache, Wikidata-bugs, 
aude, jeblad, Tacsipacsi, Lydia_Pintscher, Jdforrester-WMF, Ladsgroup, 
Jackmcbarn, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T341210: FlaggedRevs ReviewHandlerTest::testWithMinParams fails in EntitySchema CI

2023-10-03 Thread gerritbot 
gerritbot added a project: Patch-For-Review.

TASK DETAIL
  https://phabricator.wikimedia.org/T341210

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: thiemowmde, gerritbot
Cc: thiemowmde, awight, Lucas_Werkmeister_WMDE, Aklapper, 
Danny_Benjafield_WMDE, Isabelladantes1983, Themindcoder, Adamm71, Jersione, 
Hellket777, LisafBia6531, Astuthiodit_1, 786, Biggs657, karapayneWMDE, 
Invadibot, Asartea, maantietaja, Juan90264, Alter-paule, Beast1978, ItamarWMDE, 
Un1tY, Akuckartz, Dzaky17, Hook696, Kent7301, pdehaye, joker88john, DannyS712, 
CucyNoiD, Nandana, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, 
Bsandipan, tsca, Andrawaag, GoranSMilovanovic, QZanden, YULdigitalpreservation, 
LawExplorer, Salgo60, Lewizho99, Maathavan, _jensen, rosalieper, XanonymusX, 
Neuronton, Scott_WUaS, Cirdan, MisterSynergy, abian, Zache, Wikidata-bugs, 
aude, jeblad, Tacsipacsi, Lydia_Pintscher, Jdforrester-WMF, Ladsgroup, 
Jackmcbarn, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T341210: FlaggedRevs ReviewHandlerTest::testWithMinParams fails in EntitySchema CI

2023-10-03 Thread gerritbot 
gerritbot added a comment.


  Change 963045 had a related patch set uploaded (by Umherirrender; author: 
Thiemo Kreuz (WMDE)):
  
  [mediawiki/extensions/FlaggedRevs@REL1_40] Add flaggedrevs table to 
$tablesUsed in ReviewHandlerTest
  
  https://gerrit.wikimedia.org/r/963045

TASK DETAIL
  https://phabricator.wikimedia.org/T341210

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: thiemowmde, gerritbot
Cc: thiemowmde, awight, Lucas_Werkmeister_WMDE, Aklapper, 
Danny_Benjafield_WMDE, Astuthiodit_1, karapayneWMDE, Invadibot, Asartea, 
maantietaja, ItamarWMDE, Akuckartz, Dzaky17, pdehaye, DannyS712, Nandana, Lahi, 
Gq86, tsca, Andrawaag, GoranSMilovanovic, QZanden, YULdigitalpreservation, 
LawExplorer, Salgo60, _jensen, rosalieper, XanonymusX, Scott_WUaS, Cirdan, 
MisterSynergy, abian, Zache, Wikidata-bugs, aude, jeblad, Tacsipacsi, 
Lydia_Pintscher, Jdforrester-WMF, Ladsgroup, Jackmcbarn, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T348050: Create a HookRunner in EntitySchema to run the EditFilterMergedContent hook

2023-10-03 Thread Maintenance_bot 
Maintenance_bot added a project: Wikidata.

TASK DETAIL
  https://phabricator.wikimedia.org/T348050

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Maintenance_bot
Cc: Aklapper, Umherirrender, Danny_Benjafield_WMDE, Astuthiodit_1, 
karapayneWMDE, Invadibot, maantietaja, Naike, ItamarWMDE, Akuckartz, apaskulin, 
pdehaye, DannyS712, Nandana, Lahi, Gq86, Andrawaag, GoranSMilovanovic, QZanden, 
YULdigitalpreservation, LawExplorer, Salgo60, _jensen, rosalieper, Agabi10, 
Scott_WUaS, MisterSynergy, abian, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T347647: 2023-09-18 latest-all.ttl.gz WDQS dump `Fatal error munging RDF org.openrdf.rio.RDFParseException: Expected '.', found 'g'`

2023-10-03 Thread dr0ptp4kt 
dr0ptp4kt closed this task as "Resolved".
dr0ptp4kt added a comment.


  I'm going to close this for now given that the later dump munged okay and 
there seems to be an underlying issue somewhere probably related to file 
transfer. The ``-- --skolemize`` will be a thing to consider for any future 
run, nonetheless.

TASK DETAIL
  https://phabricator.wikimedia.org/T347647

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dr0ptp4kt
Cc: Aklapper, Stang, dr0ptp4kt, bking, Danny_Benjafield_WMDE, Mohamed-Awnallah, 
Astuthiodit_1, AWesterinen, lbowmaker, BTullis, karapayneWMDE, Invadibot, 
Ywats0ns, maantietaja, ItamarWMDE, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T347647: 2023-09-18 latest-all.ttl.gz WDQS dump `Fatal error munging RDF org.openrdf.rio.RDFParseException: Expected '.', found 'g'`

2023-10-03 Thread dr0ptp4kt 
dr0ptp4kt added a comment.


  I did manage to run a `sha1sum` on the older dump where the import had failed.
  
/mnt/w$ time sha1sum latest-all.ttl.gz
dedad5a589b3a3661a1f9ebb7f1a6bcbce1b4ef2  latest-all.ttl.gz

real28m47.000s
user3m21.104s
sys 0m46.825s

$ ls -al latest-all.ttl.gz
-rwxrwxrwx 1 adam adam 129294028486 Sep 27 05:35 latest-all.ttl.gz
  
  It seems like there was a data corruption somewhere in the transfer or 
persistence to disk or post-download. I don't see this `sha1sum` anywhere. It's 
conceivable something went wrong during the course of the `sha1sum`s 
themselves, but I'm not going to spend more time on this. Just wanted to 
document for future selves. Just a remark: normally, one would expect that the 
download would fail if it were in the transfer itself.

TASK DETAIL
  https://phabricator.wikimedia.org/T347647

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dr0ptp4kt
Cc: Aklapper, Stang, dr0ptp4kt, bking, Danny_Benjafield_WMDE, Mohamed-Awnallah, 
Astuthiodit_1, AWesterinen, lbowmaker, BTullis, karapayneWMDE, Invadibot, 
Ywats0ns, maantietaja, ItamarWMDE, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T347605: Document process for getting JNL files/consider automation

2023-10-03 Thread dr0ptp4kt 
dr0ptp4kt added a comment.


  Here's the `sha1sum` for the latest file I had downloaded:
  
/mnt/x$ time sha1sum wikidata.jnl.zst
62327feb2c6ad5b352b5abfe9f0a4d3ccbeebfab  wikidata.jnl.zst

real77m16.215s
user8m39.726s
sys 2m42.932s

TASK DETAIL
  https://phabricator.wikimedia.org/T347605

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dr0ptp4kt
Cc: Addshore, dr0ptp4kt, Aklapper, bking, Danny_Benjafield_WMDE, Astuthiodit_1, 
AWesterinen, BTullis, karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, 
Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T326914: Migrate the WDQS streaming updater from FlinkKafkaConsumer/Producer to KafkaSource/Sink

2023-10-03 Thread bking 
bking added a parent task: T340548: [EPIC] Deployment of the Search Update 
Pipeline on Flink / k8s.

TASK DETAIL
  https://phabricator.wikimedia.org/T326914

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, bking
Cc: dr0ptp4kt, bking, dcausse, Aklapper, Danny_Benjafield_WMDE, 
Isabelladantes1983, Themindcoder, Adamm71, Jersione, Hellket777, LisafBia6531, 
Astuthiodit_1, AWesterinen, 786, BTullis, Biggs657, karapayneWMDE, Invadibot, 
maantietaja, Juan90264, Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, 
Hook696, Kent7301, joker88john, CucyNoiD, Nandana, Namenlos314, Gaboe420, 
Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, 
_jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T326914: Migrate the WDQS streaming updater from FlinkKafkaConsumer/Producer to KafkaSource/Sink

2023-10-03 Thread bking 
bking added a parent task: T342149: Test common operations in the flink 
operator/k8s/Flink ZK environment.

TASK DETAIL
  https://phabricator.wikimedia.org/T326914

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, bking
Cc: dr0ptp4kt, bking, dcausse, Aklapper, Danny_Benjafield_WMDE, 
Isabelladantes1983, Themindcoder, Adamm71, Jersione, Hellket777, LisafBia6531, 
Astuthiodit_1, AWesterinen, 786, BTullis, Biggs657, karapayneWMDE, Invadibot, 
maantietaja, Juan90264, Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, 
Hook696, Kent7301, joker88john, CucyNoiD, Nandana, Namenlos314, Gaboe420, 
Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, 
_jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T270764: Wikidata Truthy dump is missing important metadata triples

2023-10-03 Thread VladimirAlexiev 
VladimirAlexiev added a comment.


  The full dump is 15B triples (you can see this here 
https://query.wikidata.org/bigdata/ldf).
  WDtruthy is 6.5B triples (we have it in GraphDB, continuously updating).
  Adding the counts will add 320M, or 5%.
  
  Actually I'm wrong about site links: they are present (or were added hence).
  This query times out on WD. It takes 5min on GraphDB
  
select ?type (count(*) as ?c) { 
?x schema:about ?y; a ?type
} group by ?type
  
  and returns:
  
  - schema:Dataset 29,045,390: that's only a third of what I expected
  - schema:Article 79,001,363 (site links): that's also a bit small.
- https://stats.wikimedia.org/#/all-wikipedia-projects says "198M pages to 
date"
  - but that probably includes non-content pages
  - on the other hand, there are many other sites, eg Commons categories...
- I tried to check with this query on WD but it also timed out:
  
select (sum(?links) as ?total) { 
  ?x wikibase:sitelinks ?links
}

TASK DETAIL
  https://phabricator.wikimedia.org/T270764

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: VladimirAlexiev
Cc: Lydia_Pintscher, mkroetzsch, Nicksinch, Aklapper, VladimirAlexiev, 
Danny_Benjafield_WMDE, Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, 
ItamarWMDE, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T346456: Improve concurrency limits configuration of the wdqs updater

2023-10-03 Thread gerritbot 
gerritbot added a comment.


  Change 963105 **merged** by Bking:
  
  [operations/deployment-charts@master] rdf-streaming-updater: simplify 
parallelism and use newer kafka APIs
  
  https://gerrit.wikimedia.org/r/963105

TASK DETAIL
  https://phabricator.wikimedia.org/T346456

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, gerritbot
Cc: Aklapper, bking, Clement_Goubert, dcausse, Danny_Benjafield_WMDE, 
Isabelladantes1983, Themindcoder, Kappakayala, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, AWesterinen, 786, Arnoldokoth, Biggs657, 
karapayneWMDE, Invadibot, maantietaja, Juan90264, wkandek, JMeybohm, 
Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, Namenlos314, jijiki, Gaboe420, Giuliamocci, 
Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, 
_jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T326914: Migrate the WDQS streaming updater from FlinkKafkaConsumer/Producer to KafkaSource/Sink

2023-10-03 Thread gerritbot 
gerritbot added a comment.


  Change 963105 **merged** by Bking:
  
  [operations/deployment-charts@master] rdf-streaming-updater: simplify 
parallelism and use newer kafka APIs
  
  https://gerrit.wikimedia.org/r/963105

TASK DETAIL
  https://phabricator.wikimedia.org/T326914

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, gerritbot
Cc: dr0ptp4kt, bking, dcausse, Aklapper, Danny_Benjafield_WMDE, 
Isabelladantes1983, Themindcoder, Adamm71, Jersione, Hellket777, LisafBia6531, 
Astuthiodit_1, AWesterinen, 786, BTullis, Biggs657, karapayneWMDE, Invadibot, 
maantietaja, Juan90264, Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, 
Hook696, Kent7301, joker88john, CucyNoiD, Nandana, Namenlos314, Gaboe420, 
Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, 
_jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T326914: Migrate the WDQS streaming updater from FlinkKafkaConsumer/Producer to KafkaSource/Sink

2023-10-03 Thread gerritbot 
gerritbot added a comment.


  Change 963105 had a related patch set uploaded (by DCausse; author: DCausse):
  
  [operations/deployment-charts@master] rdf-streaming-updater: simplify 
parallelism and use newer kafka APIs
  
  https://gerrit.wikimedia.org/r/963105

TASK DETAIL
  https://phabricator.wikimedia.org/T326914

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, gerritbot
Cc: dr0ptp4kt, bking, dcausse, Aklapper, Danny_Benjafield_WMDE, 
Isabelladantes1983, Themindcoder, Adamm71, Jersione, Hellket777, LisafBia6531, 
Astuthiodit_1, AWesterinen, 786, BTullis, Biggs657, karapayneWMDE, Invadibot, 
maantietaja, Juan90264, Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, 
Hook696, Kent7301, joker88john, CucyNoiD, Nandana, Namenlos314, Gaboe420, 
Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, 
_jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T346456: Improve concurrency limits configuration of the wdqs updater

2023-10-03 Thread gerritbot 
gerritbot added a comment.


  Change 963105 had a related patch set uploaded (by DCausse; author: DCausse):
  
  [operations/deployment-charts@master] rdf-streaming-updater: simplify 
parallelism and use newer kafka APIs
  
  https://gerrit.wikimedia.org/r/963105

TASK DETAIL
  https://phabricator.wikimedia.org/T346456

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, gerritbot
Cc: Aklapper, bking, Clement_Goubert, dcausse, Danny_Benjafield_WMDE, 
Isabelladantes1983, Themindcoder, Kappakayala, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, AWesterinen, 786, Arnoldokoth, Biggs657, 
karapayneWMDE, Invadibot, maantietaja, Juan90264, wkandek, JMeybohm, 
Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, Namenlos314, jijiki, Gaboe420, Giuliamocci, 
Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, 
_jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T342593: Five deleted Wikidata items pertaining to Wikimedia category pages still present in the Query Service

2023-10-03 Thread Ottomata 
Ottomata added a comment.


  > I agree with @Milimetric here and we need to get a better sense of the 
quality of the EventBus/EventGate system
  
  T345195: [SPIKE] Can we identify indicators to inform an SLO for event 
emission and intake? 

TASK DETAIL
  https://phabricator.wikimedia.org/T342593

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, Ottomata
Cc: Ottomata, EBernhardson, ArielGlenn, Milimetric, dcausse, Nikki, Aklapper, 
Mahir256, Danny_Benjafield_WMDE, Mohamed-Awnallah, Astuthiodit_1, AWesterinen, 
lbowmaker, BTullis, karapayneWMDE, Invadibot, Ywats0ns, maantietaja, 
ItamarWMDE, Akuckartz, holger.knust, Nandana, Namenlos314, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, GWicke, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T347989: Adapt rdf-spark-tools to split the wikidata graph based on a set of rules

2023-10-03 Thread dr0ptp4kt 
dr0ptp4kt claimed this task.

TASK DETAIL
  https://phabricator.wikimedia.org/T347989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dr0ptp4kt
Cc: dr0ptp4kt, dcausse, Aklapper, Danny_Benjafield_WMDE, Astuthiodit_1, 
AWesterinen, karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz, 
Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T347578: HTML tags in Entity diff title

2023-10-03 Thread Tacsipacsi 
Tacsipacsi reassigned this task from matmarex to Lucas_Werkmeister_WMDE.
Tacsipacsi added a comment.


  Thanks @Lucas_Werkmeister_WMDE and @matmarex for fixing it! Is it worth it 
creating a task to eliminate the difference between `diffonly=1` and 
`diffonly=0`?

TASK DETAIL
  https://phabricator.wikimedia.org/T347578

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE, Tacsipacsi
Cc: MilkyDefer, Aschroet, Mike_Peel, Raymond, Tacsipacsi, TheresNoTime, 
IKhitron, Wotheina, matmarex, Ammarpad, Lucas_Werkmeister_WMDE, Aklapper, 
Michael, Danny_Benjafield_WMDE, Astuthiodit_1, karapayneWMDE, Invadibot, 
maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, 
QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, 
Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T326914: Migrate the WDQS streaming updater from FlinkKafkaConsumer/Producer to KafkaSource/Sink

2023-10-03 Thread gerritbot 
gerritbot added a comment.


  Change 963057 **merged** by jenkins-bot:
  
  [operations/deployment-charts@master] rdf-streaming-updater: take a savepoint 
manually
  
  https://gerrit.wikimedia.org/r/963057

TASK DETAIL
  https://phabricator.wikimedia.org/T326914

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, gerritbot
Cc: dr0ptp4kt, bking, dcausse, Aklapper, Danny_Benjafield_WMDE, 
Isabelladantes1983, Themindcoder, Adamm71, Jersione, Hellket777, LisafBia6531, 
Astuthiodit_1, AWesterinen, 786, BTullis, Biggs657, karapayneWMDE, Invadibot, 
maantietaja, Juan90264, Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, 
Hook696, Kent7301, joker88john, CucyNoiD, Nandana, Namenlos314, Gaboe420, 
Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, 
_jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T326914: Migrate the WDQS streaming updater from FlinkKafkaConsumer/Producer to KafkaSource/Sink

2023-10-03 Thread gerritbot 
gerritbot added a comment.


  Change 963057 had a related patch set uploaded (by DCausse; author: DCausse):
  
  [operations/deployment-charts@master] rdf-streaming-updater: take a savepoint 
manually
  
  https://gerrit.wikimedia.org/r/963057

TASK DETAIL
  https://phabricator.wikimedia.org/T326914

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, gerritbot
Cc: dr0ptp4kt, bking, dcausse, Aklapper, Danny_Benjafield_WMDE, 
Isabelladantes1983, Themindcoder, Adamm71, Jersione, Hellket777, LisafBia6531, 
Astuthiodit_1, AWesterinen, 786, BTullis, Biggs657, karapayneWMDE, Invadibot, 
maantietaja, Juan90264, Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, 
Hook696, Kent7301, joker88john, CucyNoiD, Nandana, Namenlos314, Gaboe420, 
Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, 
_jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T347989: Adapt rdf-spark-tools to split the wikidata graph based on a set of rules

2023-10-03 Thread dcausse 
dcausse updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T347989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse
Cc: dcausse, Aklapper, Danny_Benjafield_WMDE, Astuthiodit_1, AWesterinen, 
karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T347989: Adapt rdf-spark-tools to split the wikidata graph based on a set of rules

2023-10-03 Thread dcausse 
dcausse created this task.
dcausse added projects: Wikidata, Wikidata-Query-Service.
Restricted Application added a subscriber: Aklapper.

TASK DESCRIPTION
  The rdf-spark-tools has a set of tools to import and munge a wikidata dump. 
This process makes the wikibase RDF graph available in hive as a simple table 
with four columns:
  
  - context: generally the entity URI allowing to rapidly group the triples 
belonging to an entity, minus Values and References which are grouped together
  - subject
  - predicate
  - object
  
  Splitting the graph might not be entirely trivial if applied directly on the 
dump files (given how values and references are managed) and thus applying a 
split process on top of the hive table mentioned mentioned above might be more 
appropriate.
  
  The object of this task is to write a new program in rdf-spark-tools that 
takes `wikibase_rdf` partition as an input and will output two partitions:
  
  - wikidata_main (name TBD)
  - scholarly_articles
  
  These two subgraphs must follow the same rules evaluated in T342111 
:
  
  - scholarly_articles: `direct instanceof Q13442814`
  - wikidata_main: the rest
  
  Special care must be taken to properly carry references and values which can 
be shared across subgraphs.
  Ideally the code must be flexible enough that the rules definition can 
slightly change without requiring to fully change the whole program.
  
  AC:
  
  - a new program to generate this split is available from rdf-spark-tools
  - a manual dag (or an automated one) is available in the search airflow 
instance

TASK DETAIL
  https://phabricator.wikimedia.org/T347989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse
Cc: dcausse, Aklapper, Danny_Benjafield_WMDE, Astuthiodit_1, AWesterinen, 
karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T347605: Document process for getting JNL files/consider automation

2023-10-03 Thread dr0ptp4kt 
dr0ptp4kt added a comment.


  For me the first 300 GB of the file went really, really fast. But `axel` was 
dropping connections, similar to when I had downloaded the large 1 TB file. So 
this download took about 5 hours. I'm pretty sure it could be done in 1-3 
hours, though, if everything were working well.
  
  Now, I encountered an error, and this was reproducible with two separate 
downloads. @bking does a test on the file yield the same corrupted block 
detected warning for you by any chance if you download the the zst? What about 
if you do it with your already existing copy?
  
/mnt/x $ time unzstd --output-dir-flat /mnt/y/ wikidata.jnl.zst
wikidata.jnl.zst : 649266 MB... wikidata.jnl.zst : Decoding error 
(36) : Corrupted block detected

real124m59.115s
user17m44.647s
sys 7m24.509s

/mnt/x $ ls -l wikidata.jnl.zst
-rwxrwxrwx 1 adam adam 342189138219 Oct  3 02:32 wikidata.jnl.zst
  
  I've kicked off a `sha1sum`, but this will take a while to run.
  
/mnt/x$ time sha1sum wikidata.jnl.zst

TASK DETAIL
  https://phabricator.wikimedia.org/T347605

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dr0ptp4kt
Cc: Addshore, dr0ptp4kt, Aklapper, bking, Danny_Benjafield_WMDE, Astuthiodit_1, 
AWesterinen, BTullis, karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, 
Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T347504: WDQS graph split: load data from dumps into new hosts

2023-10-03 Thread dcausse 
dcausse added a comment.


  @bking only one host has to be loaded with the full dataset.
  The loading process can be started as soon as possible but there are few 
constraints:
  
  - once we settle on a dump to import we will have to stick to it (if it fails 
we have to continue using this same dump unless we all agree to pick a new one)
  - to be aligned with the dumps that are imported into hdfs we must select a 
particular set of files, when selecting a "-all" file the preceding "lexemes" 
one must be taken, e.g. if `wikidata-20230925-all-BETA.ttl.bz2` is taken 
`wikidata-20230922-lexemes-BETA.ttl.bz2` must be taken.
  - the updater must never be started after the reload

TASK DETAIL
  https://phabricator.wikimedia.org/T347504

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse
Cc: RKemper, dcausse, Aklapper, bking, Danny_Benjafield_WMDE, Astuthiodit_1, 
AWesterinen, BTullis, karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, 
Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T347942: Add Wikidata support for fonwiki

2023-10-03 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".
Ladsgroup claimed this task.
Ladsgroup added a comment.


  It'll be available in two hours.

TASK DETAIL
  https://phabricator.wikimedia.org/T347942

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: Ladsgroup, Aklapper, Maintenance_bot, Danny_Benjafield_WMDE, Astuthiodit_1, 
karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T347515: The WDQS streaming updater should have a way to disable or tag side output events

2023-10-03 Thread gerritbot 
gerritbot added a comment.


  Change 962694 **merged** by jenkins-bot:
  
  [operations/deployment-charts@master] rdf-streaming-updater: bump image 
version to flink-1.16.1-rdf-0.3.133
  
  https://gerrit.wikimedia.org/r/962694

TASK DETAIL
  https://phabricator.wikimedia.org/T347515

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, gerritbot
Cc: bking, dcausse, Aklapper, Danny_Benjafield_WMDE, Isabelladantes1983, 
Themindcoder, Adamm71, Jersione, Hellket777, LisafBia6531, Astuthiodit_1, 
AWesterinen, 786, Biggs657, karapayneWMDE, Invadibot, maantietaja, Juan90264, 
Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, PatsagornY, 
Kent7301, joker88john, CucyNoiD, Nandana, Namenlos314, jijiki, Klaas_Z4us_V, 
Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, Lewizho99, Maathavan, elukey, _jensen, rosalieper, Neuronton, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331, Jay8g, ori
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T347515: The WDQS streaming updater should have a way to disable or tag side output events

2023-10-03 Thread dcausse 
dcausse set the point value for this task to "5".
dcausse claimed this task.
dcausse moved this task from Incoming to In Progress on the Discovery-Search 
(Current work) board.

TASK DETAIL
  https://phabricator.wikimedia.org/T347515

WORKBOARD
  https://phabricator.wikimedia.org/project/board/1227/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse
Cc: bking, dcausse, Aklapper, Danny_Benjafield_WMDE, Isabelladantes1983, 
Themindcoder, Adamm71, Jersione, Hellket777, LisafBia6531, Astuthiodit_1, 
AWesterinen, 786, Biggs657, karapayneWMDE, Invadibot, maantietaja, Juan90264, 
Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, PatsagornY, 
Kent7301, joker88john, CucyNoiD, Nandana, Namenlos314, jijiki, Klaas_Z4us_V, 
Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, Lewizho99, Maathavan, elukey, _jensen, rosalieper, Neuronton, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331, Jay8g, ori
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T347515: The WDQS streaming updater should have a way to disable or tag side output events

2023-10-03 Thread gerritbot 
gerritbot added a comment.


  Change 963006 had a related patch set uploaded (by DCausse; author: DCausse):
  
  [schemas/event/secondary@master] rdf_streaming_updater: add emitter_id to 
side outputs
  
  https://gerrit.wikimedia.org/r/963006

TASK DETAIL
  https://phabricator.wikimedia.org/T347515

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: bking, dcausse, Aklapper, Danny_Benjafield_WMDE, Isabelladantes1983, 
Themindcoder, Adamm71, Jersione, Hellket777, LisafBia6531, Astuthiodit_1, 
AWesterinen, 786, Biggs657, karapayneWMDE, Invadibot, maantietaja, Juan90264, 
Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, PatsagornY, 
Kent7301, joker88john, CucyNoiD, Nandana, Namenlos314, jijiki, Klaas_Z4us_V, 
Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, Lewizho99, Maathavan, elukey, _jensen, rosalieper, Neuronton, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331, Jay8g, ori
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T347942: Add Wikidata support for fonwiki

2023-10-03 Thread Maintenance_bot 
Maintenance_bot created this task.
Maintenance_bot added projects: Wikidata-Campsite, Wikidata.
Restricted Application added a subscriber: Aklapper.

TASK DESCRIPTION
  Per https://wikitech.wikimedia.org/wiki/Add_a_wiki once the wiki has been 
created

TASK DETAIL
  https://phabricator.wikimedia.org/T347942

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Maintenance_bot
Cc: Aklapper, Maintenance_bot, Danny_Benjafield_WMDE, Astuthiodit_1, 
karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org