We have hundreds of shards on machines with two SSDs each. Some are large shards (20GB) but most are small (a couple MB). It works fine except for some trouble how Elasticsearch picks what shards go where (hint: it doesn't take shard size into account beyond not filling up the disks).
Nik On Tue, Oct 7, 2014 at 3:32 PM, joergpra...@gmail.com <joergpra...@gmail.com > wrote: > The number of shards is in not related to HDD or SSD. > > SSD reduces vastly the latency of I/O operations, ES must no longer wait > for I/O seeks, reads, or writes, so the overall throughput is significantly > faster, which is noticeable while indexing bulks of data. > > Jörg > > On Tue, Oct 7, 2014 at 9:07 PM, Kevin Burton <burtona...@gmail.com> wrote: > >> I'm curious how many shards would be too many shards per server... and >> wanted feedback based on community experience. >> >> On HDD you probably want to be a big conservative.... but on SSD I think >> you could probably get away with a higher number. >> >> 10 seems to be somewhat reasonable I imagine. Not perfect but not bad >> either. This way you could grow 10x... >> >> PS. Really a shame that ES can't do shard splitting yet. >> >> -- >> You received this message because you are subscribed to the Google Groups >> "elasticsearch" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to elasticsearch+unsubscr...@googlegroups.com. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/elasticsearch/8c22ef66-5794-4c74-9410-5d83d3a1ee5d%40googlegroups.com >> <https://groups.google.com/d/msgid/elasticsearch/8c22ef66-5794-4c74-9410-5d83d3a1ee5d%40googlegroups.com?utm_medium=email&utm_source=footer> >> . >> For more options, visit https://groups.google.com/d/optout. >> > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to elasticsearch+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/CAKdsXoGx9PW7yGfC6z2J074rzryVDmtLNgSRYPddJ1dS%2BEMmxg%40mail.gmail.com > <https://groups.google.com/d/msgid/elasticsearch/CAKdsXoGx9PW7yGfC6z2J074rzryVDmtLNgSRYPddJ1dS%2BEMmxg%40mail.gmail.com?utm_medium=email&utm_source=footer> > . > > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAPmjWd3AC8cXL3Uzc3AofO3sD%2BmUeyq%3DrTDjv_isNV6_tKwRKA%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
