So9q added a comment.
In T206561#7309790 <https://phabricator.wikimedia.org/T206561#7309790>, @KingsleyIdehen wrote: > In T206561#7304519 <https://phabricator.wikimedia.org/T206561#7304519>, @So9q wrote: > >> I took a glance at Virtuoso. >> >> I found nothing about scaling Virtuoso to a cluster (which is IMO what WMF needs because of growing amounts of data and reaching the limits of what 1 machine can handle) >> >> A snippet from WP: >> "Virtuoso is designed to take advantage of operating system threading support and multiple CPUs. It consists of a single process with an adjustable pool of threads shared between clients. Multiple threads may work on a single index tree with minimal interference with each other. One cache of database pages is shared among all threads and old dirty pages are written back to disk as a background process." >> >> Virtuoso IMO is not the way forward for WMF. We need a distributed graph/column database with SPARQL on top. See https://phabricator.wikimedia.org/T289561 for an application that has exactly that (but seems abandoned since dec 2020 unfortunately) > > Again, Virtuoso 7.x Open Source Edition scales up to 80 Billion Triples as demonstrated by Uniprot's live instance. > > You don't need the Virtuoso Cluster Edition until the scalability of the single-server edition is exhausted. Wikidata is a long way from reaching 80 Billion+ triples. > > Key factor here is memory which you get via virtual machines, courtesy of cloud services these days. > > Virtuoso has also hosted DBpedia for the last 14 years i.e., since its inception . Growth hasn't been an issue, and won't be going forward. > > I hope that helps. > > Kingsley Are you https://www.wikidata.org/wiki/Q6413347 (CEO of OpenLink Software who makes Virtuoso)? In the case yes, I suggest you state your bias clearly when writing here. TASK DETAIL https://phabricator.wikimedia.org/T206561 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: So9q Cc: KingsleyIdehen, So9q, TallTed, Sj, Jerven, Base, TomT0m, Akuckartz, GreenReaper, Addshore, Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, Invadibot, MPhamWMF, maantietaja, CBogen, Nandana, Namenlos314, Lahi, Gq86, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
_______________________________________________ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
