I provisioned an IO 300 disk, no improvement at all. Logstash is running on the same instance as the master node.
On Friday, February 14, 2014 2:10:47 PM UTC-5, Bastien Chong wrote: > > I managed to split the shards by restarting ES on the master, then > retested. Throughput is the same. > > 4500/sec seems a bit low, each doc is just 8k. Network doesn't seems to be > the bottleneck. I check the IO on disk, and it's between 0 (probably when > it's buffering before flushing, and 50/70). Do you think I should get > Provisionned IO on my EC2 instance ? > > On Friday, February 14, 2014 12:53:11 PM UTC-5, Binh Ly wrote: >> >> Shards should distribute over the 2 nodes assuming they are part of a >> single cluster. Theoretically, yes more shards *distributed across multiple >> nodes* will increase indexing speed. But you can still be limited by other >> resources such as network, CPU, memory so it's hard to say how much exactly >> will your throughput be. >> > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/a56f8f9c-8b09-4980-9b84-210522fe7300%40googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.
