java.lang.UnsupportedClassVersionError: org/elasticsearch/ElasticsearchException : Unsupported major.minor version 51.0

2015-03-26 Thread Vijayakumari B N
Hi, I have jdk1.7.0_75 in linux and elasticsearch server 1.4.1, but while starting my jboss server i am getting below exception. I am able to run elasticsearch server using same version. Any body knows what is java compatible version for elastic search 1.4.1. java.lang.UnsupportedClassVersionE

Re: n edge gram analyzer's behave not as expected

2015-03-26 Thread Narinder Kaur
thanks for reply. I will try it. On Friday, 27 March 2015 05:07:34 UTC+5:30, Masaru Hasegawa wrote: > > Hi, > > You'd need to specify token_chars when you configure edge ngram tokenizer( > http://www.elastic.co/guide/en/elasticsearch/reference/current/analysis-edgengram-tokenizer.html). > > Unle

Re: n edge gram analyzer's behave not as expected

2015-03-26 Thread Narinder Kaur
Thanks for your reply. It much better clear now how to On Friday, 27 March 2015 05:07:34 UTC+5:30, Masaru Hasegawa wrote: > > Hi, > > You'd need to specify token_chars when you configure edge ngram tokenizer( > http://www.elastic.co/guide/en/elasticsearch/reference/current/analysis-edgengram-toke

percolator query problem.

2015-03-26 Thread 박재혁
sorry, I can't write English. watch my source. curl -XPUT 'localhost:9200/filters/.percolator/6' -d '{ "query": { "bool": { "must": [ { "range": { "price": { "gte

My first corrupted index

2015-03-26 Thread mdd
I had a disk problem on my development laptop and my ES index is only barely working. Before restoring a [old] snapshot and just moving forward, I'd like to learn if this can be recovered. My first sign of trouble were query errors like this: { "error": "NoShardAvailableActionException[[tw

Re: How does Elasticsearch calculate the field-length norm?

2015-03-26 Thread Masaru Hasegawa
Hi, I believe it's because field norm is encoded in single byte. See  http://lucene.apache.org/core/4_10_2/core/org/apache/lucene/search/similarities/DefaultSimilarity.html Masaru On March 26, 2015 at 14:36:45, Xudong You (xudong@gmail.com) wrote: Per this post "theory behind relevance sc

Re: Elasticsearch shield and Kibana 3.x

2015-03-26 Thread Mark Walkom
Have you made config changes to KB to deal with the https, as per http://www.elastic.co/guide/en/shield/current/_shield_with_kibana_3.html On 27 March 2015 at 00:31, Marcello A wrote: > Hi All, > we have installed shield on Elasticsearch 1.5 in a test environment. We > have enabled the SSL on ht

Re: is there a way to define mapping in java with a simple string?

2015-03-26 Thread Masaru Hasegawa
You can use string. See PutMappingRequest#source(String). On March 26, 2015 at 05:30:58, Sai Asuka (asuka.s...@gmail.com) wrote: Is there a way to simply pass mapping information in a json formatted string "{... }" without having to create an object and do a bunch of .put on it within Java? --

Re: Unable to preserve special characters in search results of ElasticSearch.

2015-03-26 Thread Anusha
Hi Thanks, I resolved this issue, In order to preserve the special characters and to search the query term in multiple fields for exact match it is better to change the settings as shown below. Settings I updated: PUT /my_index/_settings?pretty=true { "settings" : { "analysis": { "ana

Re: Japanese Search Results with Kuromoji plugin

2015-03-26 Thread Masaru Hasegawa
Hi, The input text is already tokenized. As you can see, unlike normal Japanese text, terms are split by white spaces. I guess the input text is already preprocessed using Japanese analyzer. That's why you get hits even if you don't use Japanese tokenizer. (standard tokenizer splits tokens on w

Re: n edge gram analyzer's behave not as expected

2015-03-26 Thread Masaru Hasegawa
Hi, You'd need to specify token_chars when you configure edge ngram tokenizer(http://www.elastic.co/guide/en/elasticsearch/reference/current/analysis-edgengram-tokenizer.html). Unless, all characters are kept. Which means, words are not split on white spaces. You can see how the analyzer works

Elasticsearch with influxdb

2015-03-26 Thread Sandhya Varanasi
Hi I am working on a project and would like to know if influxDB can have elasticsearch as a tool to search data. Thanks Sandhya -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from i

Re: Custom cluster action

2015-03-26 Thread Paweł Róg
Hi Ali, I used ClusterAction for my case because I had to execute action on all nodes. I used something like this public class CustomAction extends ClusterAction{ ... implement all required methods (override newRequestBuilder and newResponse) ... public class CustomNodeResponse exte

EC2 client node cluster discovery

2015-03-26 Thread Jerry Pattenaude
I am running elasticsearch 1.4.4 and the aws plugin 2.4.1 I am trying to run multiple clusters on the same machine with the same es install. It's a small dataset and I'm running a qe, demo, and staging cluster. My java api client won't connect to a running es server after a tomcat restart, but

Re: How to setup a connection between VMs and ELK?

2015-03-26 Thread Mark Walkom
https://www.google.com.au/?gws_rd=ssl#q=elk+tutorial There's a whole bunch of links there to get you started. On 27 March 2015 at 00:10, kelnrluierhfeulne wrote: > Would you happen to know what the process is or know of any links that go > over the concept that allow you to do this? For example

Re: Custom cluster action

2015-03-26 Thread Ali Lotfdar
Hi Pawel, I am new in creating action plugin, and I found you have already work on it. Could you please let me know if there is any sample and explanation which can help me to start. I already reviewed cookbook ES, but I could not understand its explanation! Thank you. Regards, Ali On Thurs

How to treat sorting for string fields as not_analyzed

2015-03-26 Thread pulkitsinghal
Only when performing a sort operation, I would like to treat a string field like {name: "first last"} as not_analyzed ... is this possible? -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving ema

ActionRequest support for BulkProcessor in the Java API

2015-03-26 Thread Andre Encarnacao
Hi, I'm wondering why BulkProcessor (and BulkRequest) only supports IndexRequest, UpdateRequest, and DeleteRequests, and not SearchRequests? I'd like to be able to use Bulk Processor for processing multiple queries instead of having to use the MultiSearch API. Is this not possible? And if so,

How do you ship logs from Virtual Machines to Elasticsearch?

2015-03-26 Thread kelnrluierhfeulne
Beginner here and I am trying to ship logs from Virtual Machines to Elasticsearch. How would I do that so they can be displayed in Kibana (right now Kibana is blank)? -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this gr

Re: exists filter broken on 1.5.0 with restored index?

2015-03-26 Thread Mads Martin Jørgensen
Thanks for fixing! On Thursday, March 26, 2015 at 3:29:17 PM UTC+1, Igor Motov wrote: > > Thanks for checking. It's a bug, which should be fixed in 1.5.1 > https://github.com/elastic/elasticsearch/pull/10268 > > On Wednesday, 25 March 2015 13:43:28 UTC-4, Mads Martin Jørgensen wrote: >> >> They'r

What does it mean when refresh rate is high?

2015-03-26 Thread John Smith
Using 1.4.3 So I have a nice "beefy" cluster 4 nodes of 32 cores, 128GB RAM, 5TB RAID 0 (Using Sandisk 960GB Extreme Pro) for each machine. I am indexing about 4000 documents per second at an average of about 800 bytes per document. At the same time as indexing I'm running queries. Looking at

What does it meen when refresh rate is high?

2015-03-26 Thread John Smith
Using 1.4.3 So I have a nice "beefy" cluster 4 nodes of 32 cores, 128GB RAM, 5TB RAID 0 (Using Sandisk 960GB Extreme Pro) for each machine. I am indexing about 4000 documents per second at an average of about 800 bytes per document. At the same time as indexing I'm running queries. Looking at

ES Count Query Help

2015-03-26 Thread Sriram Kannan
Friends, I am trying to query ES *every minute* for count. I have the following code. I am having tough time adding the *time filter.* Looks like lot has changed since 1.1.0 java elasticsearch api. Can you point me to the right directions? Settings settings = ImmutableSettings.settingsBuild

Difference between _source and fields projections

2015-03-26 Thread Udi Ben Amitai
Hi, My question is about the performance (or other) impact of the difference between _source and fields projection. These 2 queries return (at least in my perspective) an equivalent result: {"_source":{"include":["name"]}} ==> {... "_source":{"name":"blah"}} and: {"fields":["name"]} ==>{... "fiel

Re: Disable re balancing if one node is down.

2015-03-26 Thread mjdude5
You can get a some reallocation control through cluster.routing.allocation.enable but getting the exact config you mention I don't think is possible. You could write a cluster-watching script that does what you describe though using these settings. One problem you will have is when node2 come

Re: ES&Lucene 32GB heap myth or fact?

2015-03-26 Thread joergpra...@gmail.com
I will not doubt your numbers. The difference may depend on the application workload, how many heap objects are created. ES is optimized to use very large heap objects to decrease GC overhead. So I agree the difference for ES may be closer to 0.5 GB / 1 GB and not 8 GB. Jörg On Thu, Mar 26, 201

Removing entry from the _suggest

2015-03-26 Thread Nikolay Chankov
Hi, I am experiencing problems to remove entry from elastic search. Here is the scenario I have venues. Each venue could have state "open" or "closed" (in Mysql). When the state is "open" the entry should be in the elastic search, so I can search for it and display it on the site. But when it'

Re: ES&Lucene 32GB heap myth or fact?

2015-03-26 Thread Paweł Róg
Hi, Thanks for your response Jörg. Maybe I was not precise enough in my last e-mail. What I wanted to point out is that IMHO in ES I can get something different than ~30G (OOPs) == ~40G (no OOPs). As I wrote in my analysis for 16G reachable objects (with Xmx 30G) from my calculations the overhe

Re: ES&Lucene 32GB heap myth or fact?

2015-03-26 Thread joergpra...@gmail.com
There is no "trouble" at all, only a surprise effect to those who do not understand the effect of compressed OOPs. Compressed OOPs solve a memory space efficiency problem but work silently. The challenge is, large object pointers waste some of the CPU memory bandwith when JVM must access objects o

Re: Which kind of query style is recommanded to use, JSON style or Query_string sytel? Performance differes?

2015-03-26 Thread Lincoln Xiong
Query_string is more straight forward, because most of time I use Kibana to test my query. But for the DSL, it's kind of hard to fully understand which query to use. And to test my query is also difficult because too many brackets... There is a high level Python API for DSL. I'm learning it. Tha

Control fuzziness in a bool query.

2015-03-26 Thread Kirill
Hi, I'm combining match query(boolean) and match query(prefix) into bool query. { "bool" : { "must" : [ { "match" : { "field" : { "query" : "query_1", "type" : "phrase_prefix" } } }, { "match" : { "field" : { "query"

Re: Problem reading from Elasticsearch using Spark SQL

2015-03-26 Thread Dmitriy Fingerman
I found that to solve this problem I need to use BUILD-SNAPSHOT version of elasticsearch-hadoop. After adding below entries to pom.xml it started to work. ... sonatype-oss http://oss.sonatype.org/content/repositories/snapshots true ... org.elasticsearch elasticsearch-hadoo

Re: exists filter broken on 1.5.0 with restored index?

2015-03-26 Thread Igor Motov
Thanks for checking. It's a bug, which should be fixed in 1.5.1 https://github.com/elastic/elasticsearch/pull/10268 On Wednesday, 25 March 2015 13:43:28 UTC-4, Mads Martin Jørgensen wrote: > > They're similar. The 1.5.0 cluster has "created" : "1000199", and the > 1.4.1 cluster also has "created

Problem reading from Elasticsearch using Spark SQL

2015-03-26 Thread Dmitriy Fingerman
Hi, I am trying to read from Elasticsearch using Spark SQL and getting the exception below. My environment is CDH 5.3 with Spark 1.2.0 and Elasticsearch 1.4.4. Since Spark SQL is not officially supported on CDH 5.3, I added the Hive Jars to Spark classpath in compute-classpath.sh. I also added e

Re: fielddata_breaker - too high tripped value

2015-03-26 Thread Vladi Feigin
Can someone bring some insight? On Wednesday, March 25, 2015 at 8:29:52 PM UTC+2, Vladi Feigin wrote: > > Hi , > > We're observing on the one of our servers the fielddata_breake.tripped > value much higher than on others > On this specific server we have tripped = ~9K but on all rest servers we

Problem reading from Elasticsearch using Sparl SQL

2015-03-26 Thread Dmitriy Fingerman
Hi, I am trying to read from Elasticsearch using Spark SQL and getting the exception below. My environment is CDH 5.3 with Spark 1.2.0 and Elasticsearch 1.4.4. Since Spark SQL is not officially supported on CDH 5.3, I added the Hive Jars to Spark classpath in compute-classpath.sh. I also added e

Elasticsearch shield and Kibana 3.x

2015-03-26 Thread Marcello A
Hi All, we have installed shield on Elasticsearch 1.5 in a test environment. We have enabled the SSL on http module and the authentication but we noticed issue on Kibana 3.1.2 version but it's not working. Did someone configure this plugin and Kibana 3 to works together? Thanks, Marcello -- Y

ES&Lucene 32GB heap myth or fact?

2015-03-26 Thread Paweł Róg
Hi everyone, Every time we touch the size of JVM heap for Elasticsearch we can meet indisputable statement "don't let the heap to be bigger than 32GB - this is a magical line". Of course making heap bigger than 32G means that we lose OOPs. There are tons of blogs posts and articles which shows how

Question about _score metrics

2015-03-26 Thread João Lima
Hi, I have a query like this: $params['body'] = array( 'query' => array( 'filtered' => array( 'query' => array( 'function_score' => array( 'script_score' => array( '

limit maven to put all index in a plugin

2015-03-26 Thread Ali Lotfdar
Hello All, I use maven for creation of rest plugin, but as I checked all the index included inside cluster are packaged. How could I limit it to index(s) relevant to my plugin. Thank you. Regards, Ali -- You received this message because you are subscribed to the Google Groups "elasticsearch

Re: How to setup a connection between VMs and ELK?

2015-03-26 Thread kelnrluierhfeulne
Would you happen to know what the process is or know of any links that go over the concept that allow you to do this? For example, is there a certain file to edit once you download logstash-forwarder? Thanks again On Wednesday, March 25, 2015 at 5:30:53 PM UTC-4, Mark Walkom wrote: > > There is

Need Help with Japanese analyzer - (Kuromoji)

2015-03-26 Thread Mangesh Ralegankar
Hi All, I need help how to specify analyzer in the search query (curl). { "from" : 0, "size" : 1000, "query" : { "match" : { "text" : { "query" : "somejapanesetext" "type" : "phrase", "analyzer" : "kuromoji" } } }, "explain" : true } How I

Re: Unable to preserve special characters in search results of ElasticSearch.

2015-03-26 Thread Muddadi Hemaanusha
Hi Thanks, I resolved this issue, In order to preserve the special characters and to search the query term in multiple fields for exact match it is better to change the settings as shown below. Settings I updated: PUT /my_index/_settings?pretty=true { "settings" : { "analysis": {

Re: Indexing large pdf document

2015-03-26 Thread Jakko Sikkar
Thank you very much for pointing that out, I read documentation but skipped that part somehow :) neljapäev, 26. märts 2015 12:51.50 UTC+2 kirjutas David Pilato: > > There is a limit of the number of extracted characters. > > See > https://github.com/elastic/elasticsearch-mapper-attachments#inde

Re: elastic.co blog RSS URL missing

2015-03-26 Thread Ivan Brusic
I noticed the same thing. The link is redirecting for me, but my reader (AOL Reader) appears not to handle redirects. Ivan On Mar 25, 2015 9:11 AM, "Magnus Bäck" wrote: > The not too widely announced move from elasticsearch.(com|org) to > elastic.co the other week seems to have broken the old El

Re: Indexing large pdf document

2015-03-26 Thread David Pilato
There is a limit of the number of extracted characters. See https://github.com/elastic/elasticsearch-mapper-attachments#indexed-characters -- David Pilato - Developer | Evangelist elastic.co @dadoonet

Re: encountered monitor.jvm warning

2015-03-26 Thread Abid Hussain
Maybe aggregations are a cause for memory problems. According to the docs, we set the fielddata cache property to indices.fielddata.cache.size: 40% ... hoping this will help to avoid this kind of issues. Regards, Abid Am Mittwoch, 25. März 2015 00:47:09 UTC+1 schrieb Jason Wee: > > Few filters

Indexing large pdf document

2015-03-26 Thread Jakko Sikkar
Hi, I'm trying to index big document with ES and Mapper Attachment plugin (https://github.com/elastic/elasticsearch-mapper-attachments). Document has 719 pages, but after indexing I can search phrases only up to page 33. When I index a document I'm base64 encoding the file contents and file get

Re: Cluster state storage question

2015-03-26 Thread Robert Gardam
All ok! Thanks for the explanation! I just found it odd that the same information was displayed twice, but if it's only sent one way that is good. Makes sense! Elasticsearch has already become incredibly more stable in the past 12 months! The future of ES is really exciting! Thanks again! R

Re: question for tokenizer and synonym

2015-03-26 Thread Masaru Hasegawa
Hi, I guess you are using query string query. If you use match query instead, it *should* work. Masaru On March 25, 2015 at 06:41:11, Prateek Asthana (pary...@gmail.com) wrote: I am having requirement similar to below: search for "chevy" should map to search for "chevrolet". I am using syno

Re: DocValues overhead in ES

2015-03-26 Thread Paweł Róg
Hi, Thank you for your response. Unfortunately I think we misunderstood. I was NOT asking if described case can happen because I see it can :-) I was rather asking about ES internals and if there is any way to optimize such a case (including source code modifications). -- Paweł Róg On Thursday

Re: Elasticsearch with JSON-array, causing serialize -error

2015-03-26 Thread Masaru Hasegawa
Hi, It looks like "random_point" is defined as object type but got array of numbers. There might be inconsistency in data or you didn't define mapping correctly. You may want to apply correct mapping, "float" or "double". Masaru On March 25, 2015 at 05:07:27, sebastian (sebastia...@gmail.com

Re: Elasticsearch using huge amount of processes

2015-03-26 Thread Yogesh
My one machine setup (50GB memory, 4 cores, RHEL) has 3 data indices (15 shards each) and a bunch of marvel indices (~20). I think the same issue is happening with my setup too. @David/ Oliver, Did you find the solution to this issue? Thanks Yogesh On Wednesday, September 11, 2013 at 9:21:19 P

how to create custom mapping for the same field

2015-03-26 Thread 任东宁
When I put the following JSON to elasticsearch. It get error about nested: NumberFormatException { "id":"eee", "crosstab":{ "dims":[ { "id":1 }, { "id":"asd" } ] } } I knew dims.id have different type, what should I do to avoid create index dim.id or create custom mapping. -- You receiv

Re: Elasticsearch 1.4.4 not getting stopped

2015-03-26 Thread David Pilato
You might have another node running? Or the service did not stop Elasticsearch? Did you run it with sudo? David > Le 26 mars 2015 à 08:20, Chetan Dev a écrit : > > hi, > > I am stopping the elasticsearch service but even after stopping > i am able to successfully execute the request "curl loc

Elasticsearch 1.4.4 not getting stopped

2015-03-26 Thread Chetan Dev
hi, I am stopping the elasticsearch service but even after stopping i am able to successfully execute the request "curl localhost:9200/" what can be the reason behind it ?? Thanks -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscri