[Wikidata-bugs] [Maniphest] T299460: Evaluate the Apache Jena Framework

2022-08-15 Thread Gehel 
Gehel closed this task as "Resolved".
Gehel claimed this task.
Gehel added a comment.


  Evaluation is documented in 
https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/WDQS_backend_update/WDQS_backend_alternatives

TASK DETAIL
  https://phabricator.wikimedia.org/T299460

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: EgonWillighagen, AWesterinen, Osmasuominen, dcausse, Smalyshev, Aklapper, 
Lucas_Werkmeister_WMDE, Gehel, Andrawaag, Addshore, Susannaanas, Akuckartz, 
TomT0m, Jecummings4, Krabina, So9q, Salgo60, WMDE-leszek, GreenReaper, 
Ostrzyciel, Samantha_Alipio_WMDE, Tagishsimon, Lydia_Pintscher, DanBri, 
Jneubert, Ivanhercaz, TheKtk, Jerven, Justin0x2004, Afandian, Sj, TallTed, Tpt, 
Thadguidry, Hjfocs, Mohammed_Sadat_WMDE, MarioGom, karapayneWMDE, 
Daniel_Mietchen, KingsleyIdehen, Izno, RShigapov, Hannah_Bast, Kjauslin, toan, 
Michael, DD063520, AndreasKuczera, Versant.2612, namedgraph, Iamamz3, 
YULdigitalpreservation, BenAtOlive, nguyenm9, Fnielsen, accounting_data_logger, 
JohannesKalmbach, Dr.uesenfieber, Bovlb, AndySeaborne, Astuthiodit_1, 
BeautifulBold, Suran38, Invadibot, MPhamWMF, Jtm-lis, maantietaja, Peteosx1x, 
NavinRizwi, CBogen, ItamarWMDE, Isaacandy, Demian, Olson.jared.m, Nandana, 
Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, QZanden, EBjune, 
merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Steko, 
Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Bawolff, Darenwelsh, Dinoguy1000, 
Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T299460: Evaluate the Apache Jena Framework

2022-03-29 Thread MPhamWMF 
MPhamWMF raised the priority of this task from "Medium" to "High".

TASK DETAIL
  https://phabricator.wikimedia.org/T299460

WORKBOARD
  https://phabricator.wikimedia.org/project/board/891/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: MPhamWMF
Cc: EgonWillighagen, AWesterinen, Osmasuominen, dcausse, Smalyshev, Aklapper, 
Lucas_Werkmeister_WMDE, Gehel, Andrawaag, Addshore, Susannaanas, Akuckartz, 
TomT0m, Jecummings4, Krabina, So9q, Salgo60, WMDE-leszek, GreenReaper, 
Ostrzyciel, Samantha_Alipio_WMDE, Tagishsimon, Lydia_Pintscher, DanBri, 
Jneubert, Ivanhercaz, TheKtk, Jerven, Justin0x2004, Afandian, Sj, TallTed, Tpt, 
Thadguidry, Hjfocs, Mohammed_Sadat_WMDE, MarioGom, karapayneWMDE, 
Daniel_Mietchen, KingsleyIdehen, Izno, RShigapov, Hannah_Bast, Kjauslin, toan, 
Michael, DD063520, AndreasKuczera, Versant.2612, namedgraph, Iamamz3, 
YULdigitalpreservation, BenAtOlive, nguyenm9, Fnielsen, accounting_data_logger, 
JohannesKalmbach, Dr.uesenfieber, Bovlb, AndySeaborne, Astuthiodit_1, 
BeautifulBold, Suran38, Invadibot, MPhamWMF, Jtm-lis, maantietaja, Peteosx1x, 
NavinRizwi, CBogen, ItamarWMDE, Isaacandy, Demian, Olson.jared.m, Nandana, 
Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, QZanden, EBjune, 
merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Steko, 
Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, Dinoguy1000, 
Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T299460: Evaluate the Apache Jena Framework

2022-03-21 Thread MPhamWMF 
MPhamWMF lowered the priority of this task from "High" to "Medium".

TASK DETAIL
  https://phabricator.wikimedia.org/T299460

WORKBOARD
  https://phabricator.wikimedia.org/project/board/891/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: MPhamWMF
Cc: EgonWillighagen, AWesterinen, Osmasuominen, dcausse, Smalyshev, Aklapper, 
Lucas_Werkmeister_WMDE, Gehel, Andrawaag, Addshore, Susannaanas, Akuckartz, 
TomT0m, Jecummings4, Krabina, So9q, Salgo60, WMDE-leszek, GreenReaper, 
Ostrzyciel, Samantha_Alipio_WMDE, Tagishsimon, Lydia_Pintscher, DanBri, 
Jneubert, Ivanhercaz, TheKtk, Jerven, Justin0x2004, Afandian, Sj, TallTed, Tpt, 
Thadguidry, danshick-wmde, Hjfocs, Mohammed_Sadat_WMDE, MarioGom, 
karapayneWMDE, Daniel_Mietchen, KingsleyIdehen, Izno, RShigapov, Hannah_Bast, 
Kjauslin, toan, Michael, DD063520, AndreasKuczera, Versant.2612, namedgraph, 
Iamamz3, YULdigitalpreservation, BenAtOlive, nguyenm9, Fnielsen, 
accounting_data_logger, JohannesKalmbach, Dr.uesenfieber, Bovlb, AndySeaborne, 
Astuthiodit_1, BeautifulBold, Suran38, Invadibot, MPhamWMF, Jtm-lis, 
maantietaja, Peteosx1x, NavinRizwi, CBogen, Isaacandy, Demian, Olson.jared.m, 
Nandana, Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
Steko, Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, Dinoguy1000, 
Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T299460: Evaluate the Apache Jena Framework

2022-03-21 Thread MPhamWMF 
MPhamWMF raised the priority of this task from "Medium" to "High".

TASK DETAIL
  https://phabricator.wikimedia.org/T299460

WORKBOARD
  https://phabricator.wikimedia.org/project/board/891/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: MPhamWMF
Cc: EgonWillighagen, AWesterinen, Osmasuominen, dcausse, Smalyshev, Aklapper, 
Lucas_Werkmeister_WMDE, Gehel, Andrawaag, Addshore, Susannaanas, Akuckartz, 
TomT0m, Jecummings4, Krabina, So9q, Salgo60, WMDE-leszek, GreenReaper, 
Ostrzyciel, Samantha_Alipio_WMDE, Tagishsimon, Lydia_Pintscher, DanBri, 
Jneubert, Ivanhercaz, TheKtk, Jerven, Justin0x2004, Afandian, Sj, TallTed, Tpt, 
Thadguidry, danshick-wmde, Hjfocs, Mohammed_Sadat_WMDE, MarioGom, 
karapayneWMDE, Daniel_Mietchen, KingsleyIdehen, Izno, RShigapov, Hannah_Bast, 
Kjauslin, toan, Michael, DD063520, AndreasKuczera, Versant.2612, namedgraph, 
Iamamz3, YULdigitalpreservation, BenAtOlive, nguyenm9, Fnielsen, 
accounting_data_logger, JohannesKalmbach, Dr.uesenfieber, Bovlb, AndySeaborne, 
Astuthiodit_1, BeautifulBold, Suran38, Invadibot, MPhamWMF, Jtm-lis, 
maantietaja, Peteosx1x, NavinRizwi, CBogen, Isaacandy, Demian, Olson.jared.m, 
Nandana, Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
Steko, Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, Dinoguy1000, 
Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T299460: Evaluate the Apache Jena Framework

2022-02-08 Thread AWesterinen 
AWesterinen added a comment.


  There are multiple aspects to a solution including making better use of 
federation. So, I would not rule out a single server but indeed, it is not 
feasible without making additional changes.  Please see Blazegraph Candidate 
Alternatives 

 for some (work-in-progress) thoughts.

TASK DETAIL
  https://phabricator.wikimedia.org/T299460

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: AWesterinen
Cc: EgonWillighagen, AWesterinen, Osmasuominen, dcausse, Smalyshev, Aklapper, 
Lucas_Werkmeister_WMDE, Gehel, Andrawaag, Addshore, Susannaanas, Akuckartz, 
TomT0m, Jecummings4, Krabina, So9q, Salgo60, WMDE-leszek, GreenReaper, 
Ostrzyciel, Samantha_Alipio_WMDE, Tagishsimon, Lydia_Pintscher, DanBri, 
Jneubert, Ivanhercaz, TheKtk, Jerven, Justin0x2004, Afandian, Sj, TallTed, Tpt, 
Thadguidry, danshick-wmde, Hjfocs, Mohammed_Sadat_WMDE, MarioGom, 
karapayneWMDE, Daniel_Mietchen, KingsleyIdehen, Izno, RShigapov, Hannah_Bast, 
Kjauslin, toan, Michael, DD063520, AndreasKuczera, Versant.2612, namedgraph, 
Iamamz3, YULdigitalpreservation, BenAtOlive, nguyenm9, Fnielsen, 
accounting_data_logger, JohannesKalmbach, Dr.uesenfieber, Bovlb, AndySeaborne, 
BeautifulBold, Suran38, Invadibot, MPhamWMF, Jtm-lis, maantietaja, Peteosx1x, 
NavinRizwi, CBogen, Isaacandy, Demian, Olson.jared.m, Nandana, Namenlos314, 
Lahi, Gq86, Bryandamon, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, 
PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, 
aude, Tobias1984, Darenwelsh, Dinoguy1000, Manybubbles, brion, Mbch331, 
MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T299460: Evaluate the Apache Jena Framework

2022-02-08 Thread So9q 
So9q added a subscriber: EgonWillighagen.
So9q added a comment.


  In T299460#7644901 , 
@DD063520 wrote:
  
  > @So9q : How would you like to serve everything from one place? It is normal 
to have replica of data. One of the big bottlenecks is IO. Or do I understand 
something wrong?
  
  I actually do not have a lot of experience with big data and IO bottlenecks, 
so you might be right.
  
  With RDF Delta and Jena it might be feasible to continue with a cluster of 
servers each getting RDF Delta updates and serving requests? But Wikidata is 
perhaps going to outgrow what a single server can handle within 5 years, so it 
might be worth now to test with 10x the current amount of triples/items so we 
make sure the next system can handle the sheer amount of data.
  
  We still have not modeled more than perhaps 5% the knowledge in Wikipedia. 
Wikidata can grow a lot when Abstract Wikipedia picks up momentum, when all 
science papers are imported (50M missing and a lot of citation triples missing, 
a lot of MeSH and similar classifications are missing), when all chemicals are 
imported (100M missing according to @EgonWillighagen), etc.

TASK DETAIL
  https://phabricator.wikimedia.org/T299460

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: So9q
Cc: EgonWillighagen, AWesterinen, Osmasuominen, dcausse, Smalyshev, Aklapper, 
Lucas_Werkmeister_WMDE, Gehel, Andrawaag, Addshore, Susannaanas, Akuckartz, 
TomT0m, Jecummings4, Krabina, So9q, Salgo60, WMDE-leszek, GreenReaper, 
Ostrzyciel, Samantha_Alipio_WMDE, Tagishsimon, Lydia_Pintscher, DanBri, 
Jneubert, Ivanhercaz, TheKtk, Jerven, Justin0x2004, Afandian, Sj, TallTed, Tpt, 
Thadguidry, danshick-wmde, Hjfocs, Mohammed_Sadat_WMDE, MarioGom, 
karapayneWMDE, Daniel_Mietchen, KingsleyIdehen, Izno, RShigapov, Hannah_Bast, 
Kjauslin, toan, Michael, DD063520, AndreasKuczera, Versant.2612, namedgraph, 
Iamamz3, YULdigitalpreservation, BenAtOlive, nguyenm9, Fnielsen, 
accounting_data_logger, JohannesKalmbach, Dr.uesenfieber, Bovlb, AndySeaborne, 
BeautifulBold, Suran38, Invadibot, MPhamWMF, Jtm-lis, maantietaja, Peteosx1x, 
NavinRizwi, CBogen, Isaacandy, Demian, Olson.jared.m, Nandana, Namenlos314, 
Lahi, Gq86, Bryandamon, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, 
PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, 
aude, Tobias1984, Darenwelsh, Dinoguy1000, Manybubbles, brion, Mbch331, 
MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T299460: Evaluate the Apache Jena Framework

2022-02-08 Thread So9q 
So9q added a comment.


  FYI: I added https://www.wikidata.org/wiki/Q110853896 RDF Delta and Andy to 
Wikidata.

TASK DETAIL
  https://phabricator.wikimedia.org/T299460

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: So9q
Cc: AWesterinen, Osmasuominen, dcausse, Smalyshev, Aklapper, 
Lucas_Werkmeister_WMDE, Gehel, Andrawaag, Addshore, Susannaanas, Akuckartz, 
TomT0m, Jecummings4, Krabina, So9q, Salgo60, WMDE-leszek, GreenReaper, 
Ostrzyciel, Samantha_Alipio_WMDE, Tagishsimon, Lydia_Pintscher, DanBri, 
Jneubert, Ivanhercaz, TheKtk, Jerven, Justin0x2004, Afandian, Sj, TallTed, Tpt, 
Thadguidry, danshick-wmde, Hjfocs, Mohammed_Sadat_WMDE, MarioGom, 
karapayneWMDE, Daniel_Mietchen, KingsleyIdehen, Izno, RShigapov, Hannah_Bast, 
Kjauslin, toan, Michael, DD063520, AndreasKuczera, Versant.2612, namedgraph, 
Iamamz3, YULdigitalpreservation, BenAtOlive, nguyenm9, Fnielsen, 
accounting_data_logger, JohannesKalmbach, Dr.uesenfieber, Bovlb, AndySeaborne, 
BeautifulBold, Suran38, Invadibot, MPhamWMF, Jtm-lis, maantietaja, Peteosx1x, 
NavinRizwi, CBogen, Isaacandy, Demian, Olson.jared.m, Nandana, Namenlos314, 
Lahi, Gq86, Bryandamon, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, 
PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, 
aude, Tobias1984, Darenwelsh, Dinoguy1000, Manybubbles, brion, Mbch331, 
MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T299460: Evaluate the Apache Jena Framework

2022-02-08 Thread So9q 
So9q renamed this task from "Evaluate Apache Jena" to "Evaluate the Apache Jena 
Framework".

TASK DETAIL
  https://phabricator.wikimedia.org/T299460

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: So9q
Cc: AWesterinen, Osmasuominen, dcausse, Smalyshev, Aklapper, 
Lucas_Werkmeister_WMDE, Gehel, Andrawaag, Addshore, Susannaanas, Akuckartz, 
TomT0m, Jecummings4, Krabina, So9q, Salgo60, WMDE-leszek, GreenReaper, 
Ostrzyciel, Samantha_Alipio_WMDE, Tagishsimon, Lydia_Pintscher, DanBri, 
Jneubert, Ivanhercaz, TheKtk, Jerven, Justin0x2004, Afandian, Sj, TallTed, Tpt, 
Thadguidry, danshick-wmde, Hjfocs, Mohammed_Sadat_WMDE, MarioGom, 
karapayneWMDE, Daniel_Mietchen, KingsleyIdehen, Izno, RShigapov, Hannah_Bast, 
Kjauslin, toan, Michael, DD063520, AndreasKuczera, Versant.2612, namedgraph, 
Iamamz3, YULdigitalpreservation, BenAtOlive, nguyenm9, Fnielsen, 
accounting_data_logger, JohannesKalmbach, Dr.uesenfieber, Bovlb, AndySeaborne, 
BeautifulBold, Suran38, Invadibot, MPhamWMF, Jtm-lis, maantietaja, Peteosx1x, 
NavinRizwi, CBogen, Isaacandy, Demian, Olson.jared.m, Nandana, Namenlos314, 
Lahi, Gq86, Bryandamon, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, 
PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, 
aude, Tobias1984, Darenwelsh, Dinoguy1000, Manybubbles, brion, Mbch331, 
MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org