On 19/07/2022 13:24, tejaswini vadlamudi wrote:
@Ben: Makes a point, but getting Thanos or Cortex into the picture
could be a way forward after some time. For now, do you think it is
good enough to use remote-write instead of federation? From a
performance and resource consumption POV, do you see remote-write as
the way-forward?
With remote write you could use agent mode, so you don't have to have
local storage other than for the destination instance.
However again it depends what you are trying to achieve and why you have
suggested having four instances. Are you wanting to query all four
instances or only the "global" one? Are you wanting to copy all data to
the "global" instance or only some metrics? Every data point, or only at
a lower frequency?
If you are intending to copy all data (both metrics & data points) that
leans towards remote write as federation works differently. But in that
case there doesn't seem to be any advantage in having the extra three
instances at all (unless you are intending on doing local querying,
alerting or recording rules) - so I'd just have a single instance that
scrapes all namespaces.
Alternatively if you are needing to have separate instances with local
storage/querying then I'd probably not look to copy all the data to the
"global" instance (which just doubles storage and memory usage) and
either use remote write for a much smaller subset of metrics, federation
with a slower scrape rate/reduced set of metrics, or as Ben suggested
something like Thanos (other options exist as well) to do away with the
fourth instance entirely and distribute the queries to the individual
instances instead.
Maybe if you could explain a bit about what the design is hoping to
achieve it would help us advise better?
--
Stuart Clark
--
You received this message because you are subscribed to the Google Groups
"Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to prometheus-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/prometheus-users/a98eb9c0-21ce-ecac-7bb6-100b28d50986%40Jahingo.com.
