Re: Elastic search S3 backup speed

2015-03-19 Thread Alejandro Calderon
Thanks i tested the settings and the speed get better, I also found out ES 1.4.0 has a bug about the snapshot/restore, after upgrading to 1.4.4 my speed triplicated. On Monday, March 16, 2015 at 8:44:32 AM UTC-5, Alejandro Calderon wrote: > > Hello, > > I am using "elasticsearch-cloud-aws" to c

Re: Elastic search S3 backup speed

2015-03-18 Thread Mark Walkom
You can set max_snapshot_bytes_per_sec - http://www.elastic.co/guide/en/elasticsearch/reference/current/modules-snapshots.html#_common_repository_settings There is also a snapshot threadpool you can experiment with, but it's not recommended, I'm just making you aware of it - http://www.elastic.co/

Elastic search S3 backup speed

2015-03-16 Thread Alejandro Calderon
Hello, I am using "elasticsearch-cloud-aws" to create backups for my cluster in S3, but the backups are taking too long to finish, by using cloud watch i am seeing an average of of 760 MB/minute of network out in the machines, i used to have similar numbers while the index was balancing itself