Re: search includes closed index => ClusterBlockException

> Closed indexes are used if you still want the data but not taking up heap, > eg for long term archive still in the cluster. > That is still what I expected. A closed index remains on hard disk and cannot be queried. But I also expected such indices to be ignored by queries, even if they ar

Re: store location is not shared between node

Really? This should not happen I think. Could you reproduce it and open an issue with a scenario we can use to reproduce this? David > Le 4 févr. 2015 à 23:06, André Hänsel a écrit : > > That is indeed helpful. :) However, I just noticed that it's not even > necessary - the repository is stil

Re: NullPointerException when using script based sorting from Python client

Do you have a full stack trace in server logs? David > Le 5 févr. 2015 à 03:09, Masaru Hasegawa a écrit : > > Hi, > > Something like this should work: > -- > "doc['shot.org'] ? doc[’shot.org'].value : ’default_value'" > -- > > > Masaru > > >> On February 5, 2015 at 10:23:3

Re: term query sense?

And related question: how terms at both cases - that are cases with not analyzed field - are defined? Is it some standard way? -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, se

Re: Is there a UI (User Interface) web or desktop for Shield?

Currently everything needs to be done via the CLI. On 5 February 2015 at 14:27, Jaime Jr Jacinto wrote: > Dear Elasticsearch Community, > > > > All of Shield process, ie, creation of users, roles, mapping of roles to > user, are done manually (need to type in the console). > > > Is there a web p

Re: Range query on multi-value field?

yes, that's what I wanted. Thanks a lot! 2015-02-05 10:36 GMT+08:00 Jun Ohtani : > Hi Rural, > > Yes. An example is following > > POST /multi_valued/sample/1 > { > "prices" : [100,200,300,1000] > } > > POST /multi_valued/sample/2 > { > "prices" : [400,1000] > } > > GET /multi_valued/sample/_s

Is there a UI (User Interface) web or desktop for Shield?

Dear Elasticsearch Community, All of Shield process, ie, creation of users, roles, mapping of roles to user, are done manually (need to type in the console). Is there a web page or desktop application where to do those Shields processes/commands? We are looking to make this job easy.

Re: High CPU on some nodes in the cluster

Can you execute "top" on these instances and see whats pushing the CPU. Is it a rogue process or something else? Marvel will not be really helpful here, you need to look in to the instance. Please share the findings, this is really interesting. On Wednesday, 4 February 2015 05:58:53 UTC-8, Ant

Re: Range query on multi-value field?

Hi Rural, Yes. An example is following POST /multi_valued/sample/1 { "prices" : [100,200,300,1000] } POST /multi_valued/sample/2 { "prices" : [400,1000] } GET /multi_valued/sample/_search { "query": { "range": { "prices": { "gte”: 100, "lte": 300 } }

Re: NullPointerException when using script based sorting from Python client

Hi, Something like this should work: -- "doc['shot.org'] ? doc[’shot.org'].value : ’default_value'" -- Masaru On February 5, 2015 at 10:23:34, 'Selim Tuvi' via elasticsearch (elasticsearch@googlegroups.com) wrote: > Actually I am wrong. Looks like some documents did not get cr

Re: Grouping by keys that include nil values

Ideally, I'd like to see these records grouped under a nil key or something automatically. -- Mehul Kar @mehulkar On Wed, Feb 4, 2015 at 5:31 PM, Mehul Kar wrote: > Hello, > > I'm looking to query an index for groups by a specific key. There are > documents that have nil values in in these

Grouping by keys that include nil values

Hello, I'm looking to query an index for groups by a specific key. There are documents that have nil values in in these queries, and by default ES doesn't return these records in the aggregations key of the response. I've tried applying a `missing` filter, and it looks like the `hits` key in

Re: NullPointerException when using script based sorting from Python client

Actually I am wrong. Looks like some documents did not get created with the shot.org field. I am just surprised that the sort script syntax is more sensitive compared to the sort field syntax. Is there a way to handle this inside the groovy script? I tried checking for null inside the script and

Re: ES 1.2.1 difference in search result between Java clients and REST

Cannot reproduce. Apparently I cannot type either. Sorry about that. I don't see an edit button. On Wednesday, February 4, 2015 at 7:47:25 PM UTC-5, Josh Bonczkowski wrote: > > For my own sanity, I have started to build a sample project with minimal > dependencies to reproduce this behavior. So

Re: ES 1.2.1 difference in search result between Java clients and REST

For my own sanity, I have started to build a sample project with minimal dependencies to reproduce this behavior. So far, I can reproduce it. Of course, that is just as annoying :) -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscrib

Re: NullPointerException when using script based sorting from Python client

Actually I fixed my query in Sense, and now I am getting the same error: GET /igo/task/_search { "query": { "match_all": {} }, "sort" : [ {"_script": { "lang": "groovy", "script": "doc['shot.org'].value", "type": "string", "order":"asc" }} ] } Any i

NullPointerException when using script based sorting from Python client

Hi, I am trying to use the script based sorting in my queries. This works fine when using Marvel Sense to submit the query but with the ElasticSearch python client I am getting a NullPointerException. Here is the simplified query in Sense: GET /igo/task/_search { "query": { "match_all"

Re: store location is not shared between node

That is indeed helpful. :) However, I just noticed that it's not even necessary - the repository is still created, despite the error 500 returned. On Wednesday, February 4, 2015 at 8:11:12 AM UTC+1, David Pilato wrote: > > When we check the repository, we wait for the move to be done before > tr

Re: percolator filtering not working?

This issue is more about the fact that a filter associated with an alias aren't getting applied, which is different than the issue you're experiencing (your filter on the percolate request doesn't match with any percolator query). Can you try to run: GET /activities/.percolator/_search { "query"

Using cassandra-jdbc plugin to fetch data from cassandra

Hi I am trying to fetch data stored in a cassandra db into elasticsearch using cassandra jdbc. However I do not see any data pulled from from Cassandra. Commands used to fetch the data are curl -XPUT 'localhost:9200/_river/users/_meta' -d '{ "type" : "jdbc", "schedule" : "0 0-59 0-23 ? * *", "

elastic search scripting help..

Hi , I would like find the duration between current time and updatedAt time of document stored in ES .. I am trying to use scripting.. script should get 1) current time 2) _source.updatedAt 3) then find the difference in minutes 4) and then do some more calculations.. I tried with multiple ways

Re: ES 1.2.1 difference in search result between Java clients and REST

I noticed that we were using Spring Data Elastic Search (1.1.0) to create the node or transport objects for us. It allows us to build it with configuration instead of code. Just in case that was causing a problem, in my search code, I constructed a Transport object directly and use that instead

Re: Does wait_for_relocating_shards in the cluster health api return value if waiting?

sorry that curl paste has a typo.. should've been: curl -XGET ' http://localhost:9200/_cluster/health?wait_for_relocating_shards=0&timeout=50s

Does wait_for_relocating_shards in the cluster health api return value if waiting?

I'm writing a bash shell script to handle rolling restart for production cluster.. If the cluster is truly waiting on relocating shards, and I'm checking with curl -XGET 'http://localhost:9200/_cluster/health?wait_for_relocating_shards=yellow&timeout=50s' -- does it return a value or just pa

ES 1.2.1 difference in search result between Java clients and REST

I am updating a project to store metadata in ES for enhanced searching. The server is currently fixed to ES 1.2.1. Locally, I have a ES node with the Marvel plugin so I can access the sense editor to run queries. I have a unit test that is populating data into ES. The data is formatted such as

term query sense?

Is query/bool/must/term the same as filter/term? -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discus

Re: percolator filtering not working?

Ah! https://github.com/elasticsearch/elasticsearch/issues/6241, your very own bug submission, Martijn! I suspect this is the culprit - it's been an open issue for some time. At least I know it's not my fault... at the moment. :) James On Wednesday, February 4, 2015 at 9:19:11 AM UTC-8, James A

Re: percolator filtering not working?

Hi Martijn, Thanks for the reply - 'activities' is an alias to ' activities-20150107-162224', and as I mentioned, percolation without percolator filtering works fine - so this should mean that the percolator **is** in the index and is accessible via the alias. So again, I'm not sure why percola

Re: char_filter for German

Hello Jörg, could you maybe share the configuration for the german_normalize analyzer without stemming? I actually only need the umlaut expansion. And what do you mean by "at the right places in words" for snowball? Thanks! Andrej Am Sonntag, 30. November 2014 17:20:16 UTC+1 schrieb Jörg Prant

Re: Dealing with OS page cache evictions?

Sure, dedicated hardward is a solution but it's rather unreasonable in certain use cases especially when software solutions could exist. We already have a cluster with plenty of RAM and CPU to spare and the ES shards + routing ensure each request is handled by very few nodes. The setup of the clust

Re: Sizing master nodes

Yeah I have four boxes now. So I can at least put master nodes on same physical boxes in separate jam instances at least. So 4 data nodes and 3 master nodes. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and s

Re: High CPU on some nodes in the cluster

Hi Sarang, We are using 'General Purpose (SSD)' on all the systems on AWS. All the IOPs for the nodes in the cluster are about the same but only 1~2 nodes are having high CPU/Load. I do have Marvel installed, where should I be looking? Looking at all the details for the node nothing is really p

Re: Getting query count for individula fields in multi match query

Hi , There is a way to do it. You need to use the filter aggregation . Keep 2 filters one for match on subject field and other on message field. { "query": { "multi_ma

Getting query count for individula fields in multi match query

Hi all, Is it possible to get the query count per field, while querying via multi match query? { "multi_match" : { "query":"this is a test", "fields": [ "subject", "message" ] } } In above que

Re: Kibana4 Beta3: Battling with wildcard search on not_analyzed fields

Thank you. That is the same with regexp. I managed to get it working with using 4 backslashes. On Wednesday, 4 February 2015 00:20:10 UTC, Itamar Syn-Hershko wrote: > > Here's a working gist: > > https://gist.github.com/synhershko/3d915a7819145f2d7a1f > > You need to double escape the slashes -

Re: Dealing with OS page cache evictions?

Simple: never share an Elasticsearch data node with other intensive applications with intensive IO, CPU or memory consumption. Also, Elasticsearch's recommended configuration talks about setting a heap size of 50% of the available memory on the machine, and avoiding swappiness. So for most common

Re: Is there ever a reason to store _id?

Setting fields to "stored" in Elasticsearch in general is not required and a bad practice, since all fields are extracted from _soruce when they are required and _source benefits from block compression and more. There are only some very few edge cases where you want to not save the _source and ena

Re: Is there ever a reason to store _id?

I wanted to give this a friendly bump and follow up with my experience. After doing some light testing I can't see a reason to ever store _id. Doing so inflated the index size and response objects but offered no improvements on scanning. So, at least for my case it doesn't seem to make sense. p

Dealing with OS page cache evictions?

One of the biggest performance problems we have with ES is page cache evictions. Indexer warmers are great for getting the cache primed but it doesn't take much for the cache to be trashed. Some common causes for us are, logging, backups, and HDFS tasks. Relying completely on the OS page cache

Elasticsearch become slow

Hello Team, I am having elasticsearch cluster with 7 nodes and 10 indexes. Each node is having following configuration ... Node Config Info -16GB RAM -8Core -500GB Storage Custer configuration =1 - Front end + master node =1 - Front end =5 - Data node. Index Info Index1 - 9 are small, they ar

Range query on multi-value field?

I have a field with multi values like this: "100, 200, 300,1000". I need to get the docs which contains any value from 100 to 500 in this filed. Is it possible to run a range query against this multi-value field? -- You received this message because you are subscribed to the Google Groups "elast

multiple field_value_factors in function_score?

Hello, >From the docs it's not clear if and how I can have multiple field_value_factors inside a function_score. I would like to boost by ratingCount and by averageRating. I was expecting something like this: "query": { "function_score": { "query" : { [..

Some install bugs - probably there is solution, not yet found by me

Hi, I have tested instalation of elastic search on SLES 11SP3 x64 and also on DEBIAN 7.8 x64. But have some issues: *SLES 11SP3* 1. After installation ( from rpm or tgz ) the service/daemon is not created in correct folder, but in : /etc/init.d/init.d/ instead of /etc/init.d/ 2. I have copied/m

Re: search includes closed index => ClusterBlockException

Closed indexes are used if you still want the data but not taking up heap, eg for long term archive still in the cluster. On 4 February 2015 at 20:50, wrote: > Any idea how to handle closed indexes? My understanding of closing an > index is, to remove it from searching without physically deletin

Re: High CPU on some nodes in the cluster

Thanks for the reply! Cluster size is 9 nodes hosted on AWS using r3.2xlarge instance type (8 Core and 61gb of Memory) ES version is 1.3.7 Java version is "1.7.0_60" Looking at the logs for one of the nodes with high CPU load and nothing is jumping out at me. What should I be looking for? Also,

Re: partial update and nested type

Hi: Below nested update does not insert a new nested object in the array, Notice the added brackets [ ] curl -XPOST 'http://localhost:9200/v2/Test/cd196e01/_update' -d'{"script":"ctx._source.Code += Code", "params":{"Code":[{ "Family":"Family", "Code":"Ra

Re: Recommended setup for using TransportClient in Webapp

Thanks a lot for you quick help. Am Mittwoch, 4. Februar 2015 10:36:52 UTC+1 schrieb David Pilato: > > One single instance. > > -- > *David Pilato* | *Technical Advocate* | *Elasticsearch.com > * > @dadoonet | @elasticsearchfr >

Re: Kibana 3 histogram

Thanks for the tips :-) I prefer to change the configuration file because the file patternss grok-pattern can change with the RPM updates. I added this part mutate { convert => [ "bytes", "integer" ] } } Marcello Il giorno martedì 3 febbraio 2015 18:54:02 UTC+1, Marcin izo ha

Re: search includes closed index => ClusterBlockException

Any idea how to handle closed indexes? My understanding of closing an index is, to remove it from searching without physically deleting it. When working with aliases a closed index causes an cluster blocked exception. How can I avoid this? The IndicesOptions looks like that, but they do not wo

Re: Recommended setup for using TransportClient in Webapp

One single instance. -- David Pilato | Technical Advocate | Elasticsearch.com @dadoonet | @elasticsearchfr | @scrutmydocs > Le 4 févr. 2015 à 10:12, Abid Hussain a écrit : > > Hi all, >

Recommended setup for using TransportClient in Webapp

Hi all, I wonder what is the recommended setup for using TransportClient in a multi-threaded environment with parallel search requests (i.e. a webapp). Basically, I see two alternatives: 1. Using a single instance of TransportClient for all incoming search requests 2. Creating a new i

Re: Configuration advice with hard numbers ?

You can get poor performance with 1TB of data if: - Your queries are not right (e.g. not using right filters/using wrong ranges etc) - Inferior storage hardware - Insufficient memory (RAM) You can get really great performance on the same data set of 1TB - if you have SSDs - enough RAM to cache th

Re: what if there are too many types in an index

I don't think this should cause any issues. Types in elastic search is similar to "tables" in any relational data base. Your memory/performance will ultimately depend on - types of queries your use - amount of data you index - most important, kind of hardware you use to run elastic search On Su