Re: EC2 cluster storage question

Supposedly doing RAID0 EBS volumes helps to mitigate some I/O issues. You could go that route and avoid having to refresh, assuming the performance would be acceptable. On Tuesday, February 24, 2015 at 10:27:16 AM UTC-5, Paul Sanwald wrote: > > More detail below, but the the crux of my question

Re: EC2 cluster storage question

Yes, of course EBS all the time would help for storage, but it can't compete with local ssd in speed. On 25/02/2015 9:31 pm, "Mark Walkom" wrote: > Fair point. The rsync option could work, but then why not just use EBS and > then shut the nodes down to save the rsync work? > Tagging nodes probab

Re: EC2 cluster storage question

Thanks, the rsync to EBS is what I was rolling around in my head, but wasn't sure if it was a dumb idea. We used to use Elastic Block Store, but have gotten incredible performance gains from moving to SSD local storage. The ES team doesn't recommend any kind of NAS

Re: EC2 cluster storage question

The 'i' and 'h' series are attractive because of the disk performance. We considered using them but it was just not feasible given the volatility of ephemeral storage. On Wed, Feb 25, 2015 at 5:30 AM, Mark Walkom wrote: > Fair point. The rsync option could work, but then why not just use EBS and

Re: EC2 cluster storage question

Fair point. The rsync option could work, but then why not just use EBS and then shut the nodes down to save the rsync work? Tagging nodes probably won't help in this instance. Basically if you want to shut everything down you need to go through recovery, and depending on how long that takes it may

Re: EC2 cluster storage question

OP points out he is using ephemeral storage...hence shutdown will destroy the data...but it can be rsynced to EBS as part of the shutdown process...and then repeat in reverse when starting things up again... Though I guess you could let ES take care of it by tagging nodes accordingly and updating

Re: EC2 cluster storage question

Why not just shut the cluster down, disable allocation first and then just gracefully power things off? -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elastics

EC2 cluster storage question

More detail below, but the the crux of my question is: What's the best way to spin up/down "on demand" an ES cluster on EC2 that uses ephermal local storage? Essentially, I want to run the cluster during the week and spin down over the weekend. Other than brute force snapshot/restore, is there