Re: ES backups without using snapshots?

2014-11-20 Thread Ivan Brusic
I have never used plugins, but there is also Jorg's tool: https://github.com/jprante/elasticsearch-knapsack -- Ivan On Wed, Nov 19, 2014 at 11:27 PM, Mathew D mathew.degerh...@gmail.com wrote: Hi Ivan, Thanks for the quick response. We've got 5 shards per index, so with 2 replicas each

ES backups without using snapshots?

2014-11-19 Thread Mathew D
Hi there, Any suggestions as to how I can create full ES backups without using snapshot functionality? The reason I can't use snapshots is because they require a shared directory mounted on all nodes, but my 3-node cluster spans two data centres and I am not able to NFS mount over the WAN.

Re: ES backups without using snapshots?

2014-11-19 Thread Evan Tahler
Try https://github.com/taskrabbit/elasticsearch-dump. You can save your data ( mappings) to JSON. On Wednesday, November 19, 2014 5:32:14 PM UTC-8, Ivan Brusic wrote: How many shards for each index? I am assuming that each node does not have all the data. If you can stop indexing, you

Re: ES backups without using snapshots?

2014-11-19 Thread Mathew D
Hi Ivan, Thanks for the quick response. We've got 5 shards per index, so with 2 replicas each node should in theory have a full set of data. I was hoping that taking the node out of service by stopping it would avoid disruption as a result of pausing indexing, but I couldn't find any