So9q added a subscriber: EgonWillighagen. So9q added a comment.
In T299460#7644901 <https://phabricator.wikimedia.org/T299460#7644901>, @DD063520 wrote: > @So9q : How would you like to serve everything from one place? It is normal to have replica of data. One of the big bottlenecks is IO. Or do I understand something wrong? I actually do not have a lot of experience with big data and IO bottlenecks, so you might be right. With RDF Delta and Jena it might be feasible to continue with a cluster of servers each getting RDF Delta updates and serving requests? But Wikidata is perhaps going to outgrow what a single server can handle within 5 years, so it might be worth now to test with 10x the current amount of triples/items so we make sure the next system can handle the sheer amount of data. We still have not modeled more than perhaps 5% the knowledge in Wikipedia. Wikidata can grow a lot when Abstract Wikipedia picks up momentum, when all science papers are imported (50M missing and a lot of citation triples missing, a lot of MeSH and similar classifications are missing), when all chemicals are imported (100M missing according to @EgonWillighagen), etc. TASK DETAIL https://phabricator.wikimedia.org/T299460 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: So9q Cc: EgonWillighagen, AWesterinen, Osmasuominen, dcausse, Smalyshev, Aklapper, Lucas_Werkmeister_WMDE, Gehel, Andrawaag, Addshore, Susannaanas, Akuckartz, TomT0m, Jecummings4, Krabina, So9q, Salgo60, WMDE-leszek, GreenReaper, Ostrzyciel, Samantha_Alipio_WMDE, Tagishsimon, Lydia_Pintscher, DanBri, Jneubert, Ivanhercaz, TheKtk, Jerven, Justin0x2004, Afandian, Sj, TallTed, Tpt, Thadguidry, danshick-wmde, Hjfocs, Mohammed_Sadat_WMDE, MarioGom, karapayneWMDE, Daniel_Mietchen, KingsleyIdehen, Izno, RShigapov, Hannah_Bast, Kjauslin, toan, Michael, DD063520, AndreasKuczera, Versant.2612, namedgraph, Iamamz3, YULdigitalpreservation, BenAtOlive, nguyenm9, Fnielsen, accounting_data_logger, JohannesKalmbach, Dr.uesenfieber, Bovlb, AndySeaborne, BeautifulBold, Suran38, Invadibot, MPhamWMF, Jtm-lis, maantietaja, Peteosx1x, NavinRizwi, CBogen, Isaacandy, Demian, Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, Dinoguy1000, Manybubbles, brion, Mbch331, MarkAHershberger
_______________________________________________ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
