KingsleyIdehen added a comment.

  In T206561#7304519 <https://phabricator.wikimedia.org/T206561#7304519>, @So9q 
wrote:
  
  > I took a glance at Virtuoso.
  >
  > I found nothing about scaling Virtuoso to a cluster (which is IMO what WMF 
needs because of growing amounts of data and reaching the limits of what 1 
machine can handle)
  >
  > A snippet from WP:
  > "Virtuoso is designed to take advantage of operating system threading 
support and multiple CPUs. It consists of a single process with an adjustable 
pool of threads shared between clients. Multiple threads may work on a single 
index tree with minimal interference with each other. One cache of database 
pages is shared among all threads and old dirty pages are written back to disk 
as a background process."
  >
  > Virtuoso IMO is not the way forward for WMF. We need a distributed 
graph/column database with SPARQL on top. See 
https://phabricator.wikimedia.org/T289561 for an application that has exactly 
that (but seems abandoned since dec 2020 unfortunately)
  
  Again, Virtuoso 7.x Open Source Edition scales up to 80 Billion Triples as 
demonstrated by Uniprots live instance.
  
  You don't need the Virtuoso Cluster Edition until the scalability of the 
single-server edition is exhausted. Wikidata is a long way from reaching 80 
Billion+ triples.
  
  Virtuoso has also hosted DBpedia for the last 14 years i.e., since its 
inception .
  
  I hope that helps.
  
  Kingsley

TASK DETAIL
  https://phabricator.wikimedia.org/T206561

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: KingsleyIdehen
Cc: KingsleyIdehen, So9q, TallTed, Sj, Jerven, Base, TomT0m, Akuckartz, 
GreenReaper, Addshore, Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, Invadibot, 
MPhamWMF, maantietaja, CBogen, Nandana, Namenlos314, Lahi, Gq86, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
_______________________________________________
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

Reply via email to