[Wikidata-bugs] [Maniphest] T254232: New clusters for SPARQL Endpoint for Commons

2021-08-16 Thread Gehel 
Gehel closed this task as "Resolved".
Gehel claimed this task.
Gehel added a comment.


  Service implementation is tracked as part of T280001 


TASK DETAIL
  https://phabricator.wikimedia.org/T254232

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: So9q, EBernhardson, dcausse, RKemper, akosiaris, Addshore, Aklapper, Gehel, 
Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, 
Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T254232: New clusters for SPARQL Endpoint for Commons

2021-08-05 Thread Gehel 
Gehel added a project: Discovery-Search (Current work).

TASK DETAIL
  https://phabricator.wikimedia.org/T254232

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: EBernhardson, dcausse, RKemper, akosiaris, Addshore, Aklapper, Gehel, 
Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, 
Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T254232: New clusters for SPARQL Endpoint for Commons

2021-04-16 Thread Jclark-ctr 
Jclark-ctr closed subtask Unknown Object (Task) as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T254232

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Jclark-ctr
Cc: EBernhardson, dcausse, RKemper, akosiaris, Addshore, Aklapper, Gehel, 
Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, 
Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T254232: New clusters for SPARQL Endpoint for Commons

2021-03-22 Thread Papaul 
Papaul closed subtask Unknown Object (Task) as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T254232

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Papaul
Cc: EBernhardson, dcausse, RKemper, akosiaris, Addshore, Aklapper, Gehel, 
Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, 
Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T254232: New clusters for SPARQL Endpoint for Commons

2021-02-12 Thread Gehel 
Gehel added a subtask: Unknown Object (Task).

TASK DETAIL
  https://phabricator.wikimedia.org/T254232

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: EBernhardson, dcausse, RKemper, akosiaris, Addshore, Aklapper, Gehel, 
MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T254232: New clusters for SPARQL Endpoint for Commons

2021-02-11 Thread Gehel 
Gehel updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T254232

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: EBernhardson, dcausse, RKemper, akosiaris, Addshore, Aklapper, Gehel, 
MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T254232: New clusters for SPARQL Endpoint for Commons

2021-02-11 Thread Gehel 
Gehel updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T254232

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: EBernhardson, dcausse, RKemper, akosiaris, Addshore, Aklapper, Gehel, 
MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T254232: New clusters for SPARQL Endpoint for Commons

2021-02-11 Thread Gehel 
Gehel added a parent task: T260568: [EPIC] Productionize WCQS.

TASK DETAIL
  https://phabricator.wikimedia.org/T254232

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: EBernhardson, dcausse, RKemper, akosiaris, Addshore, Aklapper, Gehel, 
MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T254232: New clusters for SPARQL Endpoint for Commons

2021-02-10 Thread Gehel 
Gehel added a comment.


  A few notes from the current wcqs-beta:
  
  - CPU is mostly idle, but we have close to no user traffic and data import is 
only run weekly
  - of the 118G of RAM, 28G are used, the rest is cache (90G). That let me 
think that we should be OK with 64G, 128G is probably better to allow for some 
growth
  - The journal is currently 376G (with a recent data reload, so probably not 
that much space wasted. We should shoot for 50% disk utilization max, so that 
we have space for duplicating the journal. That means 800G to 1T
  
  With all of the above, using the same specs as WDQS (16C/32T @ 2.5GHz, 128G 
RAM, 6T SSD / 3T useable RAID1/10) seems reasonable, and would allow to switch 
servers between the clusters. This might be a bit wasteful on SSDs (and those 
are expensive).
  
  I don't have a good feel on what growth is going to look like. I could argue 
both ways: either with increased adoption we'll see growth on data size, edit 
rate and query rate, or we could plateau once the main body of media has SD 
added to them. My feeling is that using the same specs as WDQS should allow for 
enough growth (it would be unlikely that WCQS growth much larger than WDQS) and 
leave the door open to scaling horizontally.

TASK DETAIL
  https://phabricator.wikimedia.org/T254232

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: EBernhardson, dcausse, RKemper, akosiaris, Addshore, Aklapper, Gehel, 
MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T254232: New clusters for SPARQL Endpoint for Commons

2021-02-10 Thread Gehel 
Gehel added a subtask: Unknown Object (Task).

TASK DETAIL
  https://phabricator.wikimedia.org/T254232

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: EBernhardson, dcausse, RKemper, akosiaris, Addshore, Aklapper, Gehel, 
MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T254232: New clusters for SPARQL Endpoint for Commons

2020-09-08 Thread Gehel 
Gehel triaged this task as "High" priority.

TASK DETAIL
  https://phabricator.wikimedia.org/T254232

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: EBernhardson, dcausse, RKemper, akosiaris, Addshore, Aklapper, Gehel, 
CBogen, Akuckartz, darthmon_wmde, Nandana, Namenlos314, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs