How to see all current parameters setting running?

2014-10-12 Thread leechuen
Hi, Is there any query that I can run to see all the parameters setting, other than referring to elasticsearch.yml, which might be overwritten via comman/API? for e.g.: action.destructive_requires_name discovery.zen.minimum_master_nodes I have tried to run curl -XGET

How can I get the selected filter from the Kibana?

2014-10-12 Thread Hilla Benita
Hi all, When the user select a filter on the Kibana, How can I get this selection from the Kibana/Elasticsearch? Is there a way to get my current or last filter? Thanks, Hilla -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe

Using Pig/Spark on ElasticSearch (as External Storage)

2014-10-12 Thread Sang Dang
Hi All, Currently I am using ElasticSearch for a logging system. My first solution is that every log will put on ES and index will rolling by date. To do real time stats, I will use Aggregation. To do statistic I will use Spark (or Hive, Shark whatever) on ES data (thanks to ElasticSearch-Hadoop

Re: Using Pig/Spark on ElasticSearch (as External Storage)

2014-10-12 Thread Costin Leau
It depends on various factors. Do you put all the data under one index or is it one index per day/month/hour? What type of script and performance degradation do you see? If it's easier feel free to reach out on irc. I'll be traveling this week but we'll be back the next one. Cheers On Oct 12,

Typeahead/Completion With Has_Child

2014-10-12 Thread Michael Delaney
Hi, I'm trying to create a typeahead where people get autocomplete using text from a child but returning a parent. The idea is that all the variations of parent are stored in child documents, but when a user searches we only show the parent. I have it working at the moment using a has_child

Re: Using Pig/Spark on ElasticSearch (as External Storage)

2014-10-12 Thread Sang Dang
Hi Costin Leau, Currently I just pull all data in one index (INDEX_NAME_DATE) In my benmark, I just do two function, count and count distinct field. P/S: Thanks for your fast response, I would really happy to see you at IRC (just give me the time). On Sunday, October 12, 2014 8:02:57 PM

The python client avoids the _parent field when it does reindex

2014-10-12 Thread Costya Regev
Hi, When we run the following code: from elasticsearch import Elasticsearch from elasticsearch.helpers import reindex if __name__ == __main__: es = Elasticsearch() reindex(es, source_index='2014_03', target_index='2014_03_new', chunk_size =500, scroll='5m') We get the 2014_03_new index

Easiest way to switch ES between multiple example directories?

2014-10-12 Thread Alexandre Rafalovitch
Hello, I am building a bunch of self-contained ES examples in different directories. I am trying to figure out the easiest way to point ES to various locations with minimum absolute paths hardcoded. Is there a way to point one variable to some sort of home for everything (elasticsearch.yml,

How to change max_file_descriptors for Windows platform

2014-10-12 Thread leechuen
Hi, My elasticsearch process is showing : max_file_descriptors: -1 open_file_descriptors: -1 What does -1 mean? How to change the file descriptors on Windows? Is this option available on Windows platform? Thanks. -- You received this message because you are subscribed to the

Re: Easiest way to switch ES between multiple example directories?

2014-10-12 Thread Mark Walkom
It's all absolute paths. You could just run multiple, contained instances rather than multiple data dirs. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 13 October 2014 03:03, Alexandre Rafalovitch

re-ranking results by a custom ranking function.

2014-10-12 Thread Kevin Burton
I have a background job which computes ranks that I want to load into ES.. So I will essentially have a precomputed rank function which is a global rank. Then I want to multiply that value by the score of the document and come up with the product. so it would look like myrank * score(

Re: How many shards is to many shards per server on SSD?

2014-10-12 Thread Kevin Burton
On Saturday, October 11, 2014 12:23:35 AM UTC-7, Jörg Prante wrote: RAM is cheap and the best method to achieve highest performance in ES. You know what's cheaper thank RAM? SSD :-P And if you have a modern SSD and a reasonable CPU with a moderate amount of RAM, you can easily saturate

Re: Easiest way to switch ES between multiple example directories?

2014-10-12 Thread Alexandre Rafalovitch
Thanks Mark, I am afraid I am not entirely sure what you mean by multiple, contained instances. Do you mean replicating the whole binary directory? Regards, Alex. Personal: http://www.outerthoughts.com/ and @arafalov Solr resources and newsletter: http://www.solr-start.com/ and @solrstart

Re: Easiest way to switch ES between multiple example directories?

2014-10-12 Thread Mark Walkom
You can use the same binaries, but if you setup multiple configs pointing to different data directories then you can leverage -Des.config pointing to each config and then run multiple instances. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web:

Re: Easiest way to switch ES between multiple example directories?

2014-10-12 Thread Alexandre Rafalovitch
But I think, that's what I am not seeing the exact clarity. -Des.config does not seem to affect the location of data and log directories. So, they have to be set individually in the elasticsearch.yml that the es.config points to. If I leave them as default, they are relative to the ES binary, that

Re: Cluster discovery on Amazon EC2 problem - need urgent help

2014-10-12 Thread Norberto Meijome
Inline below ... On Sun, Oct 12, 2014 at 5:28 AM, Zoran Jeremic zoran.jere...@gmail.com wrote: Hi Norberto, Thank you for your advices. This is really helpful, since I have never used elasticsearch in the cluster before, and never had went live with a number of users. My previous