On Tue, Feb 25, 2014 at 4:46 PM, ESUser <neerav...@gmail.com> wrote: > Hi All, > I am exploring elastic search to create one index per user instead of one > big index for all the users. Each index would be about 6G. > I am wondering if anyone has tried it and how would it scale? > > I couldn't find that elastic search has limit on maximum number of > indices. Is it safe/recommended to have say 20K indices for 20K users? > Would it architecture scale well? >
I'm running 1107 indexes right now. Some of the cluster actions are a bit slower then I'd like but I think that is better in 1.0. I don't think it'd work well an order of magnitude larger but I could be wrong. > Also, if start with say a 5 nodes cluster now, and add more nodes as I > need them, does ES redistributes its shards every time I add new nodes? How > newly added nodes are utilized in a cluster? > > It'll smooth the shards out across the new nodes. There is configuration for how many concurrent moves can take place and how much bandwidth is ok per move. The defaults are a bit slow especially if you have fast network and disks. Nik -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAPmjWd1Atp5piP5bOYqaxnMPw6iW7yKTY8%3DxQhmO56GCcUsa_A%40mail.gmail.com. For more options, visit https://groups.google.com/groups/opt_out.
