Marostegui added a comment.
In T246415#6493651 <https://phabricator.wikimedia.org/T246415#6493651>, @Ladsgroup wrote: > - Finding out how much of queries are coming from the API appservers (like ratio of open connections) can be done by DBAs I assume, I can't find any other way to find the API/non-API context for queries. This is not super easy to do though, some things can be tried, but it is not straightforward. Ie: we can remove the DBs that are serving API from the main traffic section and see how many QPS they do. > - There's a trade-off, if we want to achieve resiliency (e.g. by separating portions of queries to a dedicated node), it would decrease scalability and flexibility of the infra, I recommend getting DBAs opinion on the decision too. Agreed, we need to carefully think about the tradeoffs. These are some items that imply having a new group: - We need at least 2 hosts per DC (for HA) - We definitely cannot have different schema on those - We need to be able to serve their load with the rest of hosts (in case both hosts go down even, or in case we need to switch them around for maintenance). We cannot make them snowflakes > - Load should not be the only factor in building groups, the type of queries and tables it queries is important, for example, recentchanges is only 1% of the load (not number of queries, the total latency) on s8, it doesn't make sense to have a dedicated node (per DC) for it but having them localized to one node makes sense so the queries take advantage of MySQL caching (of course, the node should not be only handling rc queries otherwise it would be a huge waste of resource). +1 indeed! TASK DETAIL https://phabricator.wikimedia.org/T246415 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Marostegui Cc: Michael, Marostegui, Ladsgroup, WMDE-leszek, Aklapper, Addshore, Alter-paule, Beast1978, Un1tY, Akuckartz, Hook696, Iflorez, darthmon_wmde, Kent7301, alaa_wmde, joker88john, CucyNoiD, Nandana, jijiki, Klaas_Z4us_V, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Pablo-WMDE, GoranSMilovanovic, QZanden, LawExplorer, Lewizho99, Maathavan, elukey, _jensen, rosalieper, Scott_WUaS, Jonas, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331, Jay8g
_______________________________________________ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
