GWicke added a comment.

Aude's summary is spot on. Our current focus is on html and data-parsoid, but 
we plan to add more content types like wikitext as well. Serializations of 
MediaWiki ContentHandler content models would map to separate RESTBase content 
types. For wikidata this could be a specific JSON type like 
`application/json;profile=wikidata.org/specs/someschema/1.0`, or perhaps RDF.

> How fast is it (mean response time for the kind of request we will be doing)?


You can take a look at HTML revision request latencies here:

http://grafana.wikimedia.org/#/dashboard/db/restbase

Current mean response time is around 15ms, while the 99% is around 60ms.

> Does it support batch loading (to save network roundtrips)?


Yes, via SPDY. The provisioned cluster can handle around 10k req/s without 
Varnish caching, and we are expanding it.

> Can we be sure to get the latest revision of an entity all the time (for most 
> uses cases a small lag after an edit is ok, like what you would get from a 
> slave database)?


Currently you can either directly ask for the latest revision by oldid, or ask 
for the latest, which should not be more than a few seconds out of date. We 
might add an additional ability to ask RB to double-check for up-to-date-ness, 
possibly by setting a `no-cache` header, at the cost of latency.

> Is it fast if we just iterate over all pages or just if those are revisions 
> requested often?


Currently only recent revisions (current and some recent history) are stored 
for all pages. The longer-term goal is to store the entire revision history for 
each page. Since it is storage and not caching, rarely accessed content has 
roughly the same access latency as popular content.

> Does it have metadata available?


Which metadata are you looking for?


TASK DETAIL
  https://phabricator.wikimedia.org/T93913

REPLY HANDLER ACTIONS
  Reply to comment or attach files, or !close, !claim, !unsubscribe or !assign 
<username>.

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: GWicke
Cc: JanZerebecki, GWicke, hoo, Lydia_Pintscher, daniel, aude, Aklapper, 
Wikidata-bugs



_______________________________________________
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

Reply via email to