Re: Missing documents after a bulk index

I got into lost documents when trying to do Bulk requests on my local server. I was doing 1000 per request and I was loosing around 80% of the documents. Changing to 10 solved it. Any other solution to this? I have to load 11 million documents and even multi threading is kind of slow doing it

Re: possible problem in elasticsearch.yml parameter

How does your PUT request look like? You send a HTTP header with 4k, which is not usual. You can increase the length with the parameter http.max_initial_line_length The parameter http.max_content_length covers the total message length Jörg On Sat, Aug 9, 2014 at 1:42 AM, Sitka

Re: How to update/delete indexed documents from ES index using mysql jdbc river

Only a quick thought, it seems you have a large table in RDBMS, and there are selectors ('where' condition) that control the dissemanition, what rows of the table have to be selected for further processing. A first thought is to pull the whole database into ES and build filtered queries for the

Evalu ated

div style=visibility:hidden I suppose so said Hermione moving a great stack of parchment off a chair /divp/pacronym title=i've sent you a Offline messagei've sent you a Offline message/acronymp/pa

Re: Pushing bulk data to ES in a stream

Thanks for the reply. Cursors are the what we used for getting large data from Postgres. sequel_pg the ruby gem has also added streaming support for postgres having version greater than 9.2. The ruby code doesn't complain when we deal with limited data. But getting batches of 1000 rows from

Strange system load increase

Hello, Last year paramedic reported thousands o searches per second (whereas our regular load are in the hundreds range) this eventually led to an excessive cpu load across the cluster (4 machines). Not more than a month later the same thing happened. We updated to ES 0.90.12 at the time,

suggest without stemming

I am getting suggestions that look like they have gone through a stem filter - e.g., I get languag (stem of language), amaz (stem of amazing). How can I prevent this behaviour? Only suggesting full words would be desirable. My settings and mappings looks like this: 'mappings': { 'file': {

Re: suggest without stemming

Another indication that filters are in play with the suggestion is stop words are not included in the suggestions: when I search for text I know to be in the description field a set of printable crds I get suggestions including set printabl card - which seems to have stop words removed and has

Re: Custom Aggregations

Hi Alex, Is there an updates on this topic? I want to know how easy or how complex is it to write a custom aggregator. For example, I want to calculate all the n-th central moments, with n=2,3,4,..10. By the way, Elasticsearch already provides the 2nd central moment, i.e. square of the

Re: reduce-style aggregators

You will be able to do this soon. See: https://github.com/elasticsearch/elasticsearch/pull/7075 Thanks, Matt Weber On Aug 9, 2014 10:44 AM, James Cook djamesc...@gmail.com wrote: There seems to be some reluctance by ES team to provide scrip table aggregators, or perhaps it's on a roadmap and

Elasticsearch cluster leaving shards unassigned

We're running an elasticsearch cluster for logging, indexing logs from multiple locations using logstash. We recently added two additional nodes for additional capacity whilst we await further hardware for the cluster's expansion. Ultimately we aim to have 2 nodes for realtime data running on

Re: Strange system load increase

How are you measuring the searches/s metric? ES doesn't run searches within itself, they have to be initiated externally somehow. Also, you should really upgrade :) Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On

Re: Strange system load increase

At first I was using elaticsearch paramedic ( https://github.com/karmi/elasticsearch-paramedic) recently I used marvel. Marvel was reporting a 2000 searches/s mark while the cluster was acting up. After the restart, it now reports 600 searches/s. Looking at nginx logs I see no change in rate

[ANNOUNCE] kibana-rack

Hello all! I guess this will also be my first post here! Just wanted to share a small weekend project I just released, kibana-rack https://github.com/kibana-rack, and was referred over to here from IRC as the best place to announce it. It's a Ruby gem for embedding Kibana in a Rack/Rails

Re: [ANNOUNCE] kibana-rack

Apologies! Here is the correct URL: https://github.com/tabolario/kibana-rack Thanks @warkolm! On Saturday, August 9, 2014 11:01:46 PM UTC-4, Tony Burns wrote: Hello all! I guess this will also be my first post here! Just wanted to share a small weekend project I just released, kibana-rack

Re: [ANNOUNCE] kibana-rack

Hello Tony , The link you have given is unreachable - https://github.com/kibana-rack Thanks Vineeth On Sun, Aug 10, 2014 at 8:31 AM, Tony Burns tabola...@gmail.com wrote: Hello all! I guess this will also be my first post here! Just wanted to share a small weekend project I just

Re: [ANNOUNCE] kibana-rack

Hi Vineeth Sorry about that! The correct link is https://github.com/tabolario/kibana-rack Thanks! Tony On Aug 9, 2014, at 11:29 PM, vineeth mohan vm.vineethmo...@gmail.com wrote: Hello Tony , The link you have given is unreachable - https://github.com/kibana-rack Thanks