Hi,
please have a look at shard allocation, where you can define, that specific
indices should be put into your stronger or weaker boxes (or whatever
criteria you define). This might be sufficient for a first try
http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/index-modules-allocation.html#index-modules-allocation
If you need more sophisticated logic (based on CPU power or memory), you
could write your own decider, but I think you can go a mile with shard
allocation.
This also applies to your second question, where you could put the indices,
which are searched a lot, on the more powerful machines to make sure that
indexing and querying is as fast as possible.
Hope this helps...
--Alex
On Mon, Feb 3, 2014 at 8:44 AM, xzer LR xiao...@gmail.com wrote:
I am now evaluating elasticsearch as our text search solution. But the
problem is that we cannot guarantee that we can always allocate same
hardware for our cluster when new nodes are added, therefor we need a
solution to distribute the load in a smart way based on the machine power.
I read the document and source, I found there is a BalancedShardsAllocator
for balancing the shards between nodes with consideration of shards count.
But basically, the BalancedShardsAllocator still considers the nodes in the
cluster as homogeneous.
It seems that we can implement our own ShardsAllocator to distribute
shards by predefined machine factor(the simplest way maybe), I want to know
whether there is something I missed or there is already some built-in
function affording the ability we want?
And I also have the related second question, currently our search is not
IO-bound because we have big-enough memory on all of our machines but there
are different counts of cpu cores in every machine, I want the client
search can be distributed to nodes based on the count of cpu cores rather
than simple round-robin. Is there any way to do that?
--
You received this message because you are subscribed to the Google Groups
elasticsearch group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/35708394-19e7-4ab2-ab1a-f632039da26e%40googlegroups.com
.
For more options, visit https://groups.google.com/groups/opt_out.
--
You received this message because you are subscribed to the Google Groups
elasticsearch group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAGCwEM8oNLh3jVwDuTBaVnzgx-nJThWuEYjaQVr%2B%3DUpwb%3DiUGg%40mail.gmail.com.
For more options, visit https://groups.google.com/groups/opt_out.
