Hi Amirouche,
On 12.06.19 14:07, Amirouche Boubekki wrote:
> So there needs to be some smarter solution, one that we'd unlike to
develop inhouse
Big cat, small fish. As wikidata continue to grow, it will have
specific needs.
Needs that are unlikely to be solved by off-the-shelf solutions.
Are you suggesting to develop the database in-house? even MediaWiki uses
MySQL
> but one that has already been verified by industry experience and
other deployments.
FoundationDB and WiredTiger are respectively used at Apple (among
other companies)
and MongoDB since 3.2 all over-the-world. WiredTiger is also used at
Amazon.
Let`s not talk about MongoDB, it is irrelevant and very mixed. Some say
it is THE solution for scalability, others have said it was the biggest
disappointment.
Do FoundationDB and WiredTiger have any track record for hosting open
data projects or being chosen by open data projects? PostgreSQL and
MySQL are widely used, e.g. OpenStreetMaps. Virtuoso by DBpedia,
LODCloud cache and Uniprot.
I don know FoundationDB or WiredTiger, but in the past there were often
these OS projects published by large corporations that worked in-house,
but not the OS variant. Apache UIMA was one such example. Maybe
Blazegraph works much better if you move to Neptune, that could be a
sales hook.
Any open data projects that are running open databases with FoundationDB
and WiredTiger? Where can I query them?
> "Evaluation of Metadata Representations in RDF stores"
I don't understand how this is related to the scaling issues.
Not 100% pertinent, but do you have a better paper?
> [About proprietary version Virtuoso], I dare say [it must have] enormous advantage for us to
consider running it in production.
That will be vendor lock-in for wikidata and wikimedia along all the
poor souls that try to interop with it.
Actually Uniprot and Kingsley suggested to host the OS version. Sounded
like this will hold for 5 more years, which is probably the average
lifecycle. There is also SPARQL, which normally doesn`t do vendor
lock-ins. Maybe you mean that nobody can rent 15 servers and install the
same setup as WMF for Wikidata. That would be true. Switching always
seems possible though.
--
All the best,
Sebastian Hellmann
Director of Knowledge Integration and Linked Data Technologies (KILT)
Competence Center
at the Institute for Applied Informatics (InfAI) at Leipzig University
Executive Director of the DBpedia Association
Projects: http://dbpedia.org, http://nlp2rdf.org,
http://linguistics.okfn.org, https://www.w3.org/community/ld4lt
<http://www.w3.org/community/ld4lt>
Homepage: http://aksw.org/SebastianHellmann
Research Group: http://aksw.org
_______________________________________________
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata
