Re: Wildcard search on raw not_analyzed field

2015-01-28 Thread Roman Drogolov
If you mean any character between Known and alue, you have to use dot instead of question mark. Known?alue means Know + (n or nothing) + alue. Known.alue means Known + any character + value. On Tuesday, January 27, 2015 at 1:04:44 AM UTC+2, BradVido wrote: I have a dynamic template that sets

scroll query concurrently

2015-01-28 Thread David Smith
Can I share a scroll id between multiple clients? If two clients ask the next batch of the scroll at the same time, will they get different results or is there a danger they will get duplicates? If there is no possibility of duplicates, I could share a scroll id across machines and process

Re: Massive perf difference with filter versus filtered query

2015-01-28 Thread Matías Waisgold
We had a similar issue, because we needed the filters to apply only on the result of the query we've made so we used filtered_querys and the performance boosted about 10X. On the other hand, in my experience fields like ProjectId should be in the query section, not as a filter (of course it

nodeclient connection problems

2015-01-28 Thread Marc
Hi there, I have a test server running that I can only access via ssh. Therefore, I tunneled the 9300 port to my localhost. The nodeClient in the JavaAPI somehow can find my masternode but not connect after timeout of 30s. Any ideas? Help! 2015-01-28T15:34:33.651+0100|Information:

Problem with context suggester when a document has more than 256 categories.

2015-01-28 Thread Mark Goldenstein
Hi, I use the context suggester, well, for suggestions and I have more than 256 different categories. When I try to index a document with 257 categories, I get the following error: { error:IllegalArgumentException[TokenStream expanded to 257 finite strings. Only = 256 finite strings are

Re: Wildcard search on raw not_analyzed field

2015-01-28 Thread BradVido
I am already doing a query text search. I'm expecting the ? to match a single character. It works on the regular, analyzed, field, just not the .raw not_analyzed version. That's why i'm confused -- You received this message because you are subscribed to the Google Groups elasticsearch group.

Re: ES 1.4.2 behind httpd 2.2 proxypass

2015-01-28 Thread Andrei Staicu
Thanks, It seems to work with ProxyPass/elasticsearch/ http://127.0.0.1:9200/ ProxyPassReverse /elasticsearch/ http://127.0.0.1:9200/ On Wednesday, January 28, 2015 at 2:34:58 PM UTC+2, Jörg Prante wrote: Take care of pruning the URI path '/elasticsearch/' and do not forget to add

Re: geo_shape and NullPointerException

2015-01-28 Thread drull
Yep, format is wrong. Wrap coordinates to one more array. Like this: { boundaries : { type : multipolygon, coordinates : [[[ [-74.01374, 40.728304],

Re: geo_shape and NullPointerException

2015-01-28 Thread Jilles van Gurp
Yeah, looks like that is the problem indeed. Probably, es needs a bit more friendly error here. This is a common mistake with geojson. Jilles On Wednesday, January 28, 2015 at 2:16:25 PM UTC+1, Roman Drogolov wrote: Yep, format is wrong. Wrap coordinates to one more array. Like this: {

Re: optimize elasticsearch / JVM

2015-01-28 Thread Jilles van Gurp
How much heap are you giving to ES? With this many requests, if your setup is not falling over it is probably not garbage collect related because that would result in very noticable delays/unavailability of es. 32GB should be a good value given how much memory you have. Also, you probably want

Kibana 4 beta3: How to apply filters (or multiple filters) when in Discover/Search tab (not visualize)

2015-01-28 Thread Ali Kheyrollahi
Hi, I am trying to filter based on _type in the search/discover tab. So I know that when I click on a field, I get to see values and can click on the + to filter but if item I am interested is not within the top top items, I have to go to visualize page by clicking the Visualize (see below)

Re: Exception when creating a _parent mapping in an index that exists, on a type that exists, with no existing _parent mapping.

2015-01-28 Thread David Pilato
Here is what I wrote about this on the issue: Indeed. I can reproduce your issue using REST. So it's not related to Java API. DELETE test PUT test PUT /test/_mapping/parent { properties: {} } PUT /test/_mapping/child { properties: {} } PUT /test/_mapping/child { _parent: { type:

Exception when creating a _parent mapping in an index that exists, on a type that exists, with no existing _parent mapping.

2015-01-28 Thread Ian Boston
Hi, I am trying to add _parent to a type in an index that already exists using. PutMappingResponse create = client.admin().indices().preparePutMapping(index).setType(type).setSource(_parent, type=+parentType).get(); The type exists, due to earlier indexing operations, but the

Re: I can't find anything after hypens or underscores

2015-01-28 Thread Alessandro Bonfanti
Il 26/01/2015 16:37, Alessandro Bonfanti ha scritto: Il 21/01/2015 11:43, Alessandro Bonfanti ha scritto: Il 02/12/2014 09:21, Alessandro Bonfanti ha scritto: Il

Re: What causes high CPU load on ES-Storage Nodes?

2015-01-28 Thread joergpra...@gmail.com
In most cases, it is a design mistake to place more than one node on a single machine in production. Elasticsearch was not designed for scale-up on big machines (it depends what you mean by big), but for scale-out, i.e. the more nodes you add, the better. While Elasticsearch can benefit from

Re: ES FILTERED QUERY filers first with terms (cheap) and then match(expensive), or otherwise?

2015-01-28 Thread Erwin Rijss
Yup On Wednesday, January 28, 2015 at 12:46:58 AM UTC+1, Gabriel Gavilan gavilán wrote: So I suppose that when I run a filtered query like this one, ES filters all the documents in the database, and then performs the match query only to the documents that fit the filter, right? I just want

Re: Elasricsearch Documentation on Functional Big O Notation

2015-01-28 Thread Junheng Gong
Are there any other best practices like use filter to reduce amount of document hit? 在 2015年1月28日星期三 UTC+8上午9:04:39,Mark Walkom写道: As with most performance related things in Elasticsearch context, it depends on too many factors to really provide set figures. On 28 January 2015 at 11:05,

Re: ES FILTERED QUERY filers first with terms (cheap) and then match(expensive), or otherwise?

2015-01-28 Thread Erwin Rijss
You're right. And there is also the post_filter (formerly known as filter) (http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/search-request-post-filter.html) which starts with the query and ends with the filtering. On Wednesday, January 28, 2015 at 12:46:58 AM UTC+1,

Re: Wildcard search on raw not_analyzed field

2015-01-28 Thread Roman Drogolov
First of all you have to use regexp filter or query, not match. If you mean any character between Known and alue, you have to use dot instead of question mark. Known?alue means Know + (n or nothing) + alue. Known.alue means Known + any character + alue. Like this: { query : { filtered :

optimize elasticsearch / JVM

2015-01-28 Thread Oto Iashvili
Hi I have a website for classified. For this I'm using elasticsearch, postgres and rails on a same ubuntu 14.04 dedicated server, with 256go of RAM and 20 cores, 40 threads . I have 10 indexes on elasticsearch, each have default numbers of shardes (5). They have between 1000 and 400 000

Re: Exception when creating a _parent mapping in an index that exists, on a type that exists, with no existing _parent mapping.

2015-01-28 Thread Ian Boston
On Wednesday, 28 January 2015 08:57:54 UTC, Ian Boston wrote: Hi, I am trying to add _parent to a type in an index that already exists using. PutMappingResponse create = client.admin().indices().preparePutMapping(index).setType(type).setSource(_parent,

Re: Wildcard search on raw not_analyzed field

2015-01-28 Thread Roman Drogolov
First of all you have to use regexp filter or query, not match. If you mean any character between Known and alue, you have to use dot instead of question mark. Known?alue means Know + (n or nothing) + alue. Known.alue means Known + any character + value. Like this: { query : { filtered

Re: Wildcard search on raw not_analyzed field

2015-01-28 Thread Roman Drogolov
First of all you have to use regexp filter or query, not match. If you mean any character between Known and alue, you have to use dot instead of question mark. Known?alue means Know + (n or nothing) + alue. Known.alue means Known + any character + alue. Like this: { query : { filtered :

Re: Exception when creating a _parent mapping in an index that exists, on a type that exists, with no existing _parent mapping.

2015-01-28 Thread Ian Boston
Hi, Perfect, thanks. Best Regards Ian On 28 January 2015 at 11:04, David Pilato da...@pilato.fr wrote: What you often do in this context is to use alias on top of your index. Then reindex everything in another index with new settings. And switch the alias. No downtime. HTH -- David Pilato

Re: Shield doesn't support third party plugins

2015-01-28 Thread Tim S
Thanks Uri, that helps, it makes a lot of sense. On Wednesday, January 28, 2015 at 10:50:17 AM UTC, uboness wrote: Tim, We're in the process of clarifying this in the docs (agreed that the current description is not really clear). Let me try to clarify it a bit here... When it comes to

ES 1.4.2 behind httpd 2.2 proxypass

2015-01-28 Thread Andrei Staicu
Hi, I'm trying to protect an ES 1.4.2 install. For this I have a httpd 2.2, which redirects everything to ssl, does ldap auth and has the following proxypass: ProxyPass /elasticsearch http://127.0.0.1:9200/ ProxyPassReverse /elasticsearch http://127.0.0.1:9200/ In this

Re: What causes high CPU load on ES-Storage Nodes?

2015-01-28 Thread horst knete
Hi, thanks for this excellent answer jörg, i really appreciate it. It is true that our concept of ES is not ideal or how the developer designed ES to be. Although i try to make the best out of the hardware that i have available, so im going to merge all the instances of ES that take care of

Re: Shield doesn't support third party plugins

2015-01-28 Thread Mark Walkom
You should contact Elasticsearch support regarding this. On 28 January 2015 at 20:27, Tim S timsti...@gmail.com wrote: http://www.elasticsearch.org/guide/en/shield/current/limitations.html says that Third-party plugins are not supported on clusters with the Shield security plugin installed.

Re: Shield doesn't support third party plugins

2015-01-28 Thread uboness
Tim, We're in the process of clarifying this in the docs (agreed that the current description is not really clear). Let me try to clarify it a bit here... When it comes to third party plugins, we have no control over the plugin code. The plugin infrastructure is extremely flexible in terms of

Re: Wildcard search on raw not_analyzed field

2015-01-28 Thread Roman Drogolov
First of all you have to use regexp filter or query, not match. If you mean any character between Known and alue, you have to use dot instead of question mark. Known?alue means Know + (n or nothing) + alue. Known.alue means Known + any character + alue. Like this: { query : { filtered :

Re: ES 1.4.2 behind httpd 2.2 proxypass

2015-01-28 Thread joergpra...@gmail.com
Take care of pruning the URI path '/elasticsearch/' and do not forget to add trailing slashes, so https://host/elasticsearch/_plugin/head/ is proxied to http://host:9200/_plugin/head/ Jörg On Wed, Jan 28, 2015 at 1:21 PM, Andrei Staicu andrei.sta...@gmail.com wrote: Hi, I'm trying to

Re: Wildcard search on raw not_analyzed field

2015-01-28 Thread Roman Drogolov
First of all you have to use regexp filter or query, not match. If you mean any character between Known and alue, you have to use dot instead of question mark. Known?alue means Know + (n or nothing) + alue. Known.alue means Known + any character + alue. Like this: { query : { filtered :

Re: Exception when creating a _parent mapping in an index that exists, on a type that exists, with no existing _parent mapping.

2015-01-28 Thread Ian Boston
Hi, Thanks for the clarification. How do others do DevOps style updates to Elastic Search based deployments, where the updates evolve the index ? Is the advice to avoid the _parent feature completely ? Are there other mappings that behave in the same way that I should be aware of ? The size

Re: Exception when creating a _parent mapping in an index that exists, on a type that exists, with no existing _parent mapping.

2015-01-28 Thread David Pilato
What you often do in this context is to use alias on top of your index. Then reindex everything in another index with new settings. And switch the alias. No downtime. HTH -- David Pilato | Technical Advocate | Elasticsearch.com @dadoonet https://twitter.com/dadoonet | @elasticsearchfr

Re: Shield doesn't support third party plugins

2015-01-28 Thread joergpra...@gmail.com
As a plugin author, is there any chance to use something like a suite of tests or a compatibility kit in order to validate a plugin for being compatible with Shield / a specific Shield version? Jörg On Wed, Jan 28, 2015 at 11:50 AM, uboness uri.bon...@elasticsearch.com wrote: Tim, We're in

Re: Elasticseach is not matching ”_id” between the clusters

2015-01-28 Thread Carlos Henrique de Oliveira
They are two Closters WS0001 and WS001 of one node each. In each server we have a node like this: WS001 = node.name: elasticsearch_node_ws001 WS002 = node.name: elasticsearch_node_ws002 Thanks. Em quarta-feira, 28 de janeiro de 2015 16:37:28 UTC+11, Mark Walkom escreveu: They are separate

Shield with Java Client

2015-01-28 Thread Jettro Coenradie
Hi, trying to get Shield working with a java client. When setting the header token on the client, there is no problem. But when I try to use the header of a request there is no succes. I am trying this code, which is almost a copy of the sample code in the documentation. It does not work, if I

Re: Upgrading ES 1.3.1 to 1.4.2 using rpm

2015-01-28 Thread Mark Walkom
It looks like it's trying to start up 1.4.1, not 1.4.2. Try disabling your plugins and see if that helps? On 29 January 2015 at 06:23, slavag slav...@gmail.com wrote: Hi, I tried to upgrade ES from version 1.3.1 to version 1.4.2 using RPM and upgrade wen smooth, but when I tried to run , it

Re: Upgrading ES 1.3.1 to 1.4.2 using rpm

2015-01-28 Thread slavag
Hi, The log is form 1.4.1, but I also tried 1.4.2. And clean install of 1.4.2 and 1.4.1 with those plugins are working fine. It's something related to upgrade, but can't find what is it. Thanks On Wednesday, January 28, 2015 at 11:04:28 PM UTC+2, Mark Walkom wrote: It looks like it's trying

Re: Kibana 4 behind reverse proxy. Is it possible?

2015-01-28 Thread Cijo Thomas
Its possible to use IIS with the following steps. 1) Disable Output cache for the website you are using as reverse proxy. 2) Run the website in a new apppool, which do not have any managed code. With the above two steps, kibana4 runs fine with IIS as reverse proxy. On Saturday, December 27,

Upgrade from 1.2.1 to 1.4.2 and indices/shards corrupted

2015-01-28 Thread Greg
Hello, We upgraded from 1.2.1 to 1.4.2 and after the restart, some shards were in UNASSIGNED state because they was corrupted. Here is a log: https://gist.github.com/anonymous/63a0e3f70a72bab37052 and Failed to start shard, message [IndexShardGatewayRecoveryException[[events_x][2] failed

Re: Bettermap query failure?

2015-01-28 Thread slee
Nevermind, I forgot to specify the coordinates field in the bettermap panel configuration -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Bettermap-query-failure-tp4069745p4069746.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. --

Re: how to see individual node stats on marvel?

2015-01-28 Thread Mark Walkom
You can click on a node name and it will take you to node level stats. You can also filter by name using the search box in the nodes panel. On 29 January 2015 at 05:23, Jinyuan Zhou zhou.jiny...@gmail.com wrote: Hi, I am playing with marvel. there is a node stats page. But it seems it only

Re: how to see individual node stats on marvel?

2015-01-28 Thread Jinyuan Zhou
Thanks, Jinyuan (Jack) Zhou On Wed, Jan 28, 2015 at 1:05 PM, Mark Walkom markwal...@gmail.com wrote: You can click on a node name and it will take you to node level stats. You can also filter by name using the search box in the nodes panel. On 29 January 2015 at 05:23, Jinyuan Zhou

Re: Can ElasticSearch support IBM JVM?

2015-01-28 Thread Mark Walkom
Take a look at the bottom of this page https://wiki.apache.org/lucene-java/JavaBugs On 29 January 2015 at 09:56, 'Cindy' via elasticsearch elasticsearch@googlegroups.com wrote: In setup guide, I read Only Oracle’s Java and the OpenJDK are supported. The same JVM version should be used on all

Re: Shield with Java Client

2015-01-28 Thread Jettro Coenradie
Never mind, misread the documentation. It seems a node info request is done first, therefore you need to provide the username password in the client. Than if you want to, you can change the username password for each request that you do. It works now. Op woensdag 28 januari 2015 22:12:31

Another missing data after restart topic...

2015-01-28 Thread David Reagan
I read through the past couple months worth of missing data topics on this list, and didn't really find anything to help. So, apologies if I missed something in them that is obvious. Yesterday evening I ran OS updates to fix the glibc vulnerability. That meant I restarted my 4 ES nodes. Today,

Re: Elasticseach is not matching ”_id” between the clusters

2015-01-28 Thread Mark Walkom
By default _id is auto generated by Elasticsearch - http://www.elasticsearch.org/guide/en/elasticsearch/guide/current/index-doc.html#_autogenerating_ids. It's done using a method similar to this http://www.boundary.com/blog/2012/01/flake-a-decentralized-k-ordered-unique-id-generator-in-erlang/

Can ElasticSearch support IBM JVM?

2015-01-28 Thread 'Cindy' via elasticsearch
In setup guide, I read Only Oracle’s Java and the OpenJDK are supported. The same JVM version should be used on all Elasticsearch nodes and clients. We recommend installing the *Java 8 update 20 or later*, or *Java 7 update 55 or later*. Previous versions of Java 7 are known to have bugs that

Re: optimize elasticsearch / JVM

2015-01-28 Thread Oto Iashvili
Hi, thanks a lot for answer, Ive tried several value for heap, between 26 and 32, but I didnt see any difference. I remove G1 and put back default parameter. But still same pb. I was saying around 500%, but it is just average, i goes sometimes up to 2000% I was also thinking to take several

Re: Building a Cluster / Adding a node.

2015-01-28 Thread GWired
On my initial host (host1) I changed my cluster.name to cluster.name: ESMyName Which in elasticsearchhead it is showing as the new name. I also uncommented:: discovery.zen.ping.multicast.enabled: false And added discovery.zen.ping.unicast.hosts: [host2.mydomain.com:9200] on the new node I

Re: optimize elasticsearch / JVM

2015-01-28 Thread Oto Iashvili
if it can help : _nodes/hot_threads?pretty=1 ::: [Sepulchre][tcr0m37nRAS9appE1pvWLA][sd-70975][inet[/x.x.x.x:9300]] 20.6% (102.7ms out of 500ms) cpu usage by thread 'elasticsearch[Sepulchre][search][T#78]' 8/10 snapshots sharing following 10 elements

how to measure the performance of ELK system?

2015-01-28 Thread Yiming Li
Dear all, I just started to learn and experiment with ELK in a logging related project at work. The answer I am looking for is that: say I am shipping tons of data into logstash, do some basic transformation, and feed the data into elasticsearch, finally view dashboard in Kibana. How long

Re: Can ElasticSearch support IBM JVM?

2015-01-28 Thread 'Cindy' via elasticsearch
I did read the page before. However, the section didn't mentioned any details of the issue, not trace either. I was hoping some one has experienced issues. Is just randomly happening or under certain conditions to trigger index corruption? On Wednesday, 28 January 2015 18:30:54 UTC-5, Mark

Re: Can ElasticSearch support IBM JVM?

2015-01-28 Thread Nikolas Everett
There are known big installations using OpenJDK and Oracle JDK. I don't know any using IBM. I imagine your more likely to find something on that JDK then others but you'll probably do ok. Certainly be sure to add the config parameter mentioned on that page and expect to have to fiddle with the

synonym dictionaries of person names

2015-01-28 Thread David Kemp
I am looking for synonym dictionaries of person names that I can use with the Elasticsearch synonym analyser. e.g. dictionaries that map Ted to Edward, and Bill to William. I am curious to know what others are using. So far I have found these two possible sources:

Re: logstash / kibana can't connect to instance

2015-01-28 Thread madhu
Hi, Can anyone please look into this. Many Thanks, Madhu On Wednesday, January 28, 2015 at 5:43:23 AM UTC-8, ma...@venusgeo.com wrote: Hi Team, I don't remember changing anything at all on my logstash server. As of just yesterday it was working fine! And I used it to run some queries.

pagination with range queries giving duplicate results

2015-01-28 Thread Amish Asthana
Hi Folks We are facing an issue intermittently of range queries with pagination missing some records or giving duplicate ids. Let me describe our system. Lets say we have certain number of records and during which queries are being made in ES, we can assume that no record is getting

Re: pagination with range queries giving duplicate results

2015-01-28 Thread David Pilato
Do you get duplicates within the same page or only in another page? To ensure consistent pagination, I would use scroll API. Could you try with it? -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 29 janv. 2015 à 08:06, Amish Asthana asthanaam...@gmail.com a écrit : Hi

rest-api-spec json format

2015-01-28 Thread ben
What format are the rest-api-spec documents in? https://github.com/elasticsearch/elasticsearch/blob/master/rest-api-spec/api/abort_benchmark.json I thought it was json-schema.org but I don't see methods in the documentation. Could someone kindly let me know what format these are in? Thanks!

ES 1.4.0 / Mapping is changed after first index

2015-01-28 Thread Aleks
Hello, I have some strange behavior here. I have an Index called webanalytics. There is one type called MesuresVisitoratHeure. Here is the mapping : { webanalytics: { mappings: { MesuresVisitoratHeure: { _ttl: { enabled: true, default:

Shield esusers is not using -Des.path.plugins

2015-01-28 Thread Jettro Coenradie
Hi, I am experimenting with Shield. I have a local setup where my plugins are not in the usual location. Using the ES_JAVA_OPTS with -Des.path.plugins does work when installing the plugin, but the esusers tool does not seem to use the path and comes with a message that it cannot find a certain

Mapping GeoJSON MultiPolygons

2015-01-28 Thread Martin Høgh
I've a this mapping for indexing GeoJSON MultiPolygons: { mappings: { my_type : { properties : { geometry: { type: object, properties: { coordinates: { type: geo_shape, tree: quadtree, precision: 1m

how to see individual node stats on marvel?

2015-01-28 Thread Jinyuan Zhou
Hi, I am playing with marvel. there is a node stats page. But it seems it only shows overall stats for cluster. What is fitler key I can use to see indvidual node? Thanks, -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from

Re: Bulk importing CSVs with different headers

2015-01-28 Thread . .
Not having a lot of luck here Installed the plugin based on Github, and tried the request. I'm getting a fail.. curl -XPUT 'localhost:9200/_river/my_csv_river/_meta' -d ' { type: jdbc, jdbc: { url: jdbc:xbib:csv:/home/user, sql: select * from garages, index: csv,

Upgrading ES 1.3.1 to 1.4.2 using rpm

2015-01-28 Thread slavag
Hi, I tried to upgrade ES from version 1.3.1 to version 1.4.2 using RPM and upgrade wen smooth, but when I tried to run , it crashes with this error: [2015-01-28 19:03:20,859][INFO ][node ] [Shathra] version[1.4.1], pid[1519], build[89d3241/2014-11-26T15:49:29Z] [2015-01-28

Bettermap query failure?

2015-01-28 Thread slee
Hello, I have an instance of ELK stood up but I've been running into an error. Whenever I try to use the bettermap widget, I get an error in the Elasticsearch logs. This only happens when I use bettermap, I am able to load tables and graphs just fine. The error message seems to be generic, can