Addshore added a comment.

  In T208425#5054567 <https://phabricator.wikimedia.org/T208425#5054567>, 
@jcrespo wrote:
  
  > I see you are going to ask DBAs at T219145 
<https://phabricator.wikimedia.org/T219145>, that is great.
  >
  > As a heads up, because I saw there is a chance of starting using other data 
stores (which by itself is not an issue), instead of or in addition to MySQL to 
give a heads up to service operations SREs and probably search too- in the past 
there has been misunderstandings with sending important/data that has to be 
persisted to datastores that ops cannot guarantee persistance/are not properly 
replicated between dcs (e.g. redis). Please do not go beyond the research phase 
without taking SREs with your proposal to avoid future misunderstandings about 
storage requirements. CC @Joe @Gehel
  
  
  Yup, I have already spent some time talking to the search team, and need to 
write up a spec of exactly what we want, why, how we will use it etc.
  Persistence and freshness are things that would not be needed for the elastic 
search work mentioned in the task description, and the fallback would always be 
to sql, but looking up many entity  "terms" for many languages elastic is much 
faster than doing that directly in SQL, even if we then have to lookup any ones 
missing or out of date from elastic back in SQL.
  I should be writing this up this week

TASK DETAIL
  https://phabricator.wikimedia.org/T208425

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: jcrespo, Joe, Gehel, alaa_wmde, Marostegui, Jdforrester-WMF, Addshore, 
Aklapper, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, 
_jensen, rosalieper, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
_______________________________________________
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

Reply via email to