Re: Can i elastic search as my primary store?

2014-10-25 Thread shikhar
Depends on how valuable your data is. I wouldn't say Elasticsearch is quite there yet to be considered a reliable primary data store, even with 1.4. Lots of work to be done on hardening replication. On Sat, Oct 25, 2014 at 4:08 AM, Nikolas Everett wrote: > I'd wait for 1.4 before considering it

Re: High cpu load but low memory usage.

2014-10-25 Thread joergpra...@gmail.com
Please post the result of "hot threads" action on a gist/paste page so we can understand your problem better. http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/cluster-nodes-hot-threads.html Jörg On Fri, Oct 24, 2014 at 10:43 AM, Atrus wrote: > Hi Pros, > > I've used ES for

Re: Aggregation buckets, with an additional key:value inside.

2014-10-25 Thread Ivan Brusic
I maintain a mapping on the client side to due the lookups. Thankfully my taxonomy is static (but somewhat large). There is a PR to do server-side mappings, but I don't think it would apply to aggregations and is quite old. An alternative solution would be to create compound values such as "48885:

Re: High cpu load but low memory usage.

2014-10-25 Thread Mathieu Lecarme
Le vendredi 24 octobre 2014 10:43:21 UTC+2, Atrus a écrit : > > - There is 15 shards per index, is this too much or enough ? I've used the > default config. I know that this could be effect the load but dont know how > to figure out the exact number. > > It's a huge value. Shards can be split b

Re: Heavy load on a small Elasticsearch cluster

2014-10-25 Thread Mathieu Lecarme
What monitoring tool do you use? Try to reduce the frequency at least. >> >> The _nodes/stats?all url is VERY slow for an elasticsearch request, something like 1500 ms. Some tools like kopf poll it every 3 seconds. If your tool poll it too every minute, you can break something. The _nodes/stat

Sorting weirdness

2014-10-25 Thread Michael Irwin
I have a mapping like this: "venue": { "type": "nested", "include_in_parent": true, "properties": { "name": { "type": "string" } } If I'm sorting by 'venue.name' ascending, why would a name like 'Terminal 5' be

Aggregation on last element

2014-10-25 Thread Michaël Gallego
Hi, I have a type whose data looks like this: { "date": "2014-01-01" "element": "abc", "type": "A" }, { "date": "2014-01-02" "element": "abc", "type": "B" }, { "date": "2014-01-03" "element": "def", "type": "A" } I'd like to be able to group the data by elemen

Re: High cpu load but low memory usage.

2014-10-25 Thread Atrus
Thanks Mathieu for you response. I will try your suggestions. "It's a huge value. Shards can be split between nodes, do you target tu use 15 nodes?" Hi Mat, - For examples if I have just one node, shards = 5, replica = 0. Then I can easily backup the data by "cp /var/lib/elasticsearch/nodenam

Re: Heavy load on a small Elasticsearch cluster

2014-10-25 Thread Otis Gospodnetic
Hi, On Friday, October 24, 2014 3:30:01 PM UTC-4, Mathieu Lecarme wrote: > > > > Le vendredi 24 octobre 2014 19:59:01 UTC+2, Jörg Prante a écrit : >> >> You're doomed :) >> >> What monitoring tool do you use? Try to reduce the frequency at least. >> >> Jörg >> >> > New Relic monitor the OS but do