Re: Sub-aggregations not working as expected

2014-04-07 Thread Paweł Młynarczyk
Hello Chris ElasticSearch does not recognize your 'recipe' list as a list of logically connected fields. So when your top level aggregation returns i.e. rock, your sub-aggregation does not count stats based on the rock material, but based on all the materials that are included in the documents

Re: Automatically build `input` for `completion` fields?

2014-04-07 Thread Alexander Reelsen
Hey, there is no automation for this. The main reason why your solution might work in your specific use-case is, that you do not have billions of documents. Otherwise there would be a lot of documents, which contain for example piece (pi suggestions) or winner (wi), and you would get a lot of

synonyms in a query

2014-04-07 Thread Alex K
Hello there, i have a query, example is this: { query: { bool: { should: [ { multi_match: { query: foo, fields: [ TITLE, SHORTDESC

Re: fielddata breaker question

2014-04-07 Thread Dunaeth
Hi Lee, This issue could exactly match what we're experiencing, we'll wait for the next revision then and see if it solves our problem. Thanks :) Le samedi 5 avril 2014 00:54:10 UTC+2, Lee Hinman a écrit : On 4/4/14, 8:51 AM, Dunaeth wrote: Hi, I stopped logstash to check whether the

Re: Copying fields to a geopoint type ?

2014-04-07 Thread Alexander Reelsen
Hey, I dont know about your stack, but maybe logstash would be a good idea to add it in there. It is more flexible than the csv river and features a CSV input as well. You can easily change the structure of the data you want to index. This is how the logstash config would look like if

Re: Nodes API incomplete

2014-04-07 Thread Alexander Reelsen
Hey, I just tested with one master only node and two data only nodes and did not have a problem. Can you recreate this issue and create a gist or a github issue how you managed to get into that state? Also what elasticsearch version is this? --Alex On Fri, Apr 4, 2014 at 8:22 PM, Andrew

Re: Querying with Completion Suggesters with Java API

2014-04-07 Thread Alexander Reelsen
Hey, looks ok. Minor note: Types are simply ignored for suggestions. What are you getting back? Nothing? Can you create a fully working gist, including creation of the mapping and indexing? Then debugging and finding your possible cause would be a lot easier. --Alex On Fri, Apr 4, 2014 at

Re: filtered query vs query performance

2014-04-07 Thread Paweł Młynarczyk
I've tried to query the children first and then do some ID filtering on parents but the scoring is then screwed and the performance is even worse (as expected). I still have not found any satisfying solution to this matter. W dniu czwartek, 3 kwietnia 2014 14:44:37 UTC+2 użytkownik Paweł

Re: Update synonyms dynamically.

2014-04-07 Thread Balaji Narain
I am sorry for the vague question; I should have phrased it better. Yes, I am aware of the fact that you could upload the synonyms from a file. But this does not work out in my scenario because, I would like the synonym to be updated by my application program. As I understand, it is not yet

Re: Querying with Completion Suggesters with Java API

2014-04-07 Thread Dan Tuffery
Use the SuggestRequestBuilder, i.e. CompletionSuggestionBuilder compBuilder = new CompletionSuggestionBuilder(complete); compBuilder.text(n); compBuilder.field(suggest); SuggestRequestBuilder suggestRequestBuilder = client.prepareSuggest(INDEX_NAME);

Re: java 8, elasticsearch, and MVEL

2014-04-07 Thread Paul Sanwald
Thanks, Shay. If there's anything I can do to help with the effort, please do let me know. On Sunday, April 6, 2014 7:12:39 PM UTC-4, kimchy wrote: We are planning to address this on Elasticsearch itself. The tricky bit is the fact that we want to have a highly optimized concurrent scripting

Re: Is this stacktrace a reason for cluster instability?

2014-04-07 Thread Jelle Smet
So i dont think this is the reason for your troubles. Nore that the message is with severity DEBUG , and not Error or CRIT True, this was indeed not the cause of the problems we ran into. Cheers, -- You received this message because you are subscribed to the Google Groups

Re: Nodes API incomplete

2014-04-07 Thread Andrew Mehler
This is version 1.1 I belive I found what is causing the error [2014-04-07 12:38:59,270][DEBUG][action.admin.cluster.node.info] [newspd4.aoa.twosigma.com-master-0] failed to execute on node [1OfLJ-r_RJinwXN2C0dqoQ] org.elasticsearch.transport.RemoteTransportException: Failed to deserialize

getting MasterNotDiscoveredException for ES node for client

2014-04-07 Thread Subhadip Bagui
Hi, I'm using the below code for indexing data from cloud. But getting the below exception while calling prepareIndex . Please let me know why the exception is coming. public static IndexResponse insertESDocument(String nodeName, String json) { Node node =

Re: Elasticsearch 1.1.0 - Optimize broken?

2014-04-07 Thread Elliott Bradshaw
Adrian, I ran the following command: curl -XPUT http://localhost:9200/_settings -d '{indices.store.throttle.max_bytes_per_sec : 10gb}' and received a { acknowledged : true } response. The logs showed cluster state updated. I did have to close my index prior to changing the setting and reopen

Query with boost by fields an term proximity (similar to EDISMAX in SOLR)

2014-04-07 Thread Niccolò Becchi
Is there anyway to configure a query in a similar way as edismax in SOLR that's taking care about term proximity and boosting by fields? I have spend days but actually I haven't found any good solution with elasticsearch That's an example of edismax in SOLR (

Applying updates to mappings using templates

2014-04-07 Thread Jed Glazner
Hey Guys, So I'm working on a project where we are planning on creating several indexes that all have several fields in common. We are not sure how many indexes we will need but they will always 'extend' this base schema/mapping. I thought we could use the template feature, but as I

Anyway to boost a query by fields an term proximity (similar to EDISMAX in SOLR)

2014-04-07 Thread Niccolò Becchi
Is there anyway to configure a query in a similar way as edismax in SOLR that's taking care about term proximity and boosting by fields? I have spend days but actually I haven't found any good solution with elasticsearch That's an example of edismax in SOLR (

Searching Multiple types within an Index not providing results as expected

2014-04-07 Thread Ramdev Wudali
Hi : I have two types (type1, and type2) within my index index1. When I perform a search I index two documents with the same id (the mappings are different but the two types are linked via an id field) in each of the types. The id field has the same value in the two types. curl -XPOST

Cross Fields w/ Fuzziness

2014-04-07 Thread Elliott Bradshaw
Hi Elasticsearch, I've been playing with the new cross_fields multi match type, and I've got to say that I love it. It's a great way to search complex data without doing a lot of memory killing denormalization. That said, is there any plan to implement a fuzziness option with this type?

Re: synonyms in a query

2014-04-07 Thread Alex K
Hello Luiz, thank you for your reply! As we use rivers, I was told to declare the analyzer there. It looks like this for me: { index : { analysis : { filter : { synonym_filter : { type : synonym, synonyms : [ foo,

Re: getting MasterNotDiscoveredException for ES node for client

2014-04-07 Thread Subhadip Bagui
Please suggest. I'm getting connection error in elasticsearch end even if the node is running. [2014-04-07 17:22:40,109][WARN ][transport.netty ] [node-master] exception caught on transport layer [[id: 0xd2 f92b59, 0.0.0.0/0.0.0.0:64313]], closing connection java.net.SocketException:

Re: Illegal unicode escape sequence error

2014-04-07 Thread InquiringMind
Preeti, I believe that your problem is in calling the *setScript* method. My Java code uses the *IndexRequestBuilder.setSource* method. Try that instead. (I have no idea what *setScript* does, or is for. The Javadocs need a lot more care and feeding.) Vai the HTTP interface, I verified that

Re: Relevancy sorting of result returned

2014-04-07 Thread chee hoo lum
Hi Ivan, Hmm... This seems like a viable workaround however just wanted to know is there any other ways to do it ? Because this doesn't seems like a unique problem i guess as most users will expect to get the similarity sorted (when performing search) based on the following order: 1.Happy 2.Be

Re: Nodes API incomplete

2014-04-07 Thread Alexander Reelsen
Hey, are you running the same elasticsearch and JVM versions everywhere? Just check and paste with the awesome cat Api... curl 'localhost:9200/_cat/nodes?vh=host,ip,jdk,version' --Alex On Mon, Apr 7, 2014 at 2:46 PM, Andrew Mehler meh...@gmail.com wrote: This is version 1.1 I belive I

Embedded Elasticsearch on shutdown: java.lang.IllegalArgumentException: Illegal shift value, must be 0..63

2014-04-07 Thread Doru Sular
Hello everybody, I am using elasticsearch embedded in my web application. I start the node via ContextListener method contextInitialized and I call node.stop() in contextDestroyed method of my ServletContextListener implementation. However, the following message appear in the logs: Apr 07,

Connecting Tribe node to EC2 cluster

2014-04-07 Thread Matt Dainty
Hi, I have a ES cluster built in EC2, using the cloud-aws plugin for discovery. The nodes are using their private IP addresses for communication and everything works ok. I want to run one or more tribe nodes remotely, so I point the tribe node to the public IP addresses of some of the nodes

Real time streaming dashboard using Kibana

2014-04-07 Thread Chris Holt
Hi, I'm trying to set up a real time streaming dashboard for logs, which would collect logs using fluentd or similar, and all I would want to do is extract running statistics from the data eg firewall denies / second. I don't want to keep the data for any time, I just want to get the stats, so

Re: path facets

2014-04-07 Thread Volker
yes... just two month :-) in the meantime I have solved the problem. not with an array, but with a map. It works and it is fast :-) Thanks. kind regards PS: and maybe till may in Hamburg Am Freitag, 4. April 2014 09:57:58 UTC+2 schrieb Alexander Reelsen: Hey, I remember barely, that was

Boosting by fields an Term proximity(similar to EDISMAX in SOLR) is possible with ES?

2014-04-07 Thread Niccolò Becchi
Is there anyway to configure a query in a similar way as edismax in SOLR that's taking care about term proximity and boosting by fields? I have spend days but actually I haven't found any good solution with elasticsearch That's an example of edismax in SOLR (

Re: Real time streaming dashboard using Kibana

2014-04-07 Thread Itamar Syn-Hershko
Kibana only knows to query Elasticsearch, so you essentially have to have ES running in the background. You can use a short TTL on messages so they expire automatically after a few sec/mins. But to me it seems using Kibana is going overboard if all you want to do is some graphics on top of some

Re: Analyzing data with Marvel

2014-04-07 Thread Mohit Anchlia
How can I add a new dashboard that I do in Kibana for data visulization? On Thu, Apr 3, 2014 at 2:32 PM, Mohit Anchlia mohitanch...@gmail.comwrote: How do I do that in Marvel? I didn't find any tutorial except the monitoring of system performance. On Thu, Apr 3, 2014 at 2:17 PM, Mark Walkom

Aggregations: filter by bucket values

2014-04-07 Thread David
Hello, I'm starting to use aggregations for some fairly advanced querying, and I'm finding it very simple so far. But there's one class of queries I'm struggling with. Given this simplified data model: Leads - opened_at - closed_at - value ($) I would like to show the number and value of

Query timings breakdown and performance issues

2014-04-07 Thread hazzadous
Having a few issues with search performance. I was hoping there would be some way to get a detailed output on what phases of the search took all my time. I'm planning on passing the slowlog along to Kibana to set some idea of what is going on on a shard level, but thought I'd put this out

Re: getting MasterNotDiscoveredException for ES node for client

2014-04-07 Thread Subhadip Bagui
Hi, If I remove client(true) from node initialization then I'm successfully indexing documents. But I want to create this node as client only without shards being allocated to them, as stated in http://www.elasticsearch.org/guide/en/elasticsearch/client/java-api/current/client.html Also I'm

Re: Embedded Elasticsearch on shutdown: java.lang.IllegalArgumentException: Illegal shift value, must be 0..63

2014-04-07 Thread joergpra...@gmail.com
It seems you are not using a client but a data node? You can not expect a data node in a web app context with an index works, because in this case for example, your Tomcat wants to use an index setting/mapping for an internal leakage check, which is doomed to fail. Jörg On Mon, Apr 7, 2014 at

Re: getting MasterNotDiscoveredException for ES node for client

2014-04-07 Thread David Pilato
Sounds like you have a network issue? java.net.SocketException: Network is unreachable: no further information May be multicast is disabled on your network so you'd better give a unicast list of nodes? -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 7 avr. 2014 à

Boosting both by FIELD names and TERM PROXIMITY is possible with ES (similar to EDISMAX in SOLR)?

2014-04-07 Thread Niccolò Becchi
Is there anyway to configure a query in a similar way as edismax in SOLR that's taking care about term proximity and boosting by fields? I have spend days but actually I haven't found any good solution with elasticsearch That's an example of edismax in SOLR (

Re: Elasticsearch won't start anymore

2014-04-07 Thread Danny Joris
Removing Marvel worked using plugin --remove Marvel Seems like Elasticsearch starts correctly again. Not sure why Marvel became a culprit here as I haven't used it since I first installed it when it came out. I also didn't update Elasticsearch or any of the other plugins since. Thanks for

Embedded Elasticsearch on shutdown: java.lang.IllegalArgumentException: Illegal shift value, must be 0..63

2014-04-07 Thread AlexR
I am not sure it can be done with context listeners particularity when shutting down tomcat. I do not believe it will wait for listeners to complete - they are fired asynchronously and tomcat exits without waiting but I am not positive of that. I was going to test it but have not had a chance

Shared facet filtration

2014-04-07 Thread Alex G
Hello, I’m implementing a faceted interface that requires that all the facets be filtered by a shared filter - below is roughly how the queries currently look, is there a more efficient/performant way to make this kind of query? Less fussed about actual query verbosity but if there some way

Re: getting MasterNotDiscoveredException for ES node for client

2014-04-07 Thread Subhadip Bagui
Hi David, If I restart ES the same is working. But gives me this issue if multiple call made after some time. My client and server are on the same system. I stopped the firewall also. Any suggestion how to make multicast working. Can I create and close client node for multiple times? -- You

Re: getting MasterNotDiscoveredException for ES node for client

2014-04-07 Thread David Pilato
You should share the same node and client across all threads. -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 8 avr. 2014 à 06:06, Subhadip Bagui i.ba...@gmail.com a écrit : Hi David, If I restart ES the same is working. But gives me this issue if multiple call made

Re: Relevancy sorting of result returned

2014-04-07 Thread Ivan Brusic
I do not think most users would expect the results in that order. The character length does not provide relevance for most cases. Why is a shorter word more relevant? I would say that most would rank Happy Together higher since word proximity is a helpful metric. Happy should rank first due to the

Re: Master High CPU

2014-04-07 Thread Ranjith
I was searching for some solution, i came across this one. https://github.com/netty/netty/issues/1873 Whether my issue is related to this one ? On Mon, Apr 7, 2014 at 12:44 PM, Ranjith Venkatesan ranjith.venkate...@gmail.com wrote: Hi, We are using Elasticsearch-0.90.5 in our search

Re: Master High CPU

2014-04-07 Thread Mark Walkom
Sounds like your cluster is reaching capacity. I'd try adding more data nodes, if you cannot upgrade java and ES. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 8 April 2014 15:18, Ranjith

configuring multi node ES setup in aws to withstand AZ going down

2014-04-07 Thread T Vinod Gupta
hi, how does ES ensure fail over scenario to work when the entire AZ goes down in AWS? Or is there something that I need to do to make it work? lets say i have a 4 node cluster with number of replicas set to 1 and i have 2 nodes in one AZ and remaining 2 in another AZ. what if 1st AZ goes down?

Re: Can't get second server to join cluster

2014-04-07 Thread Abhishek Tiwari
If I start my VM first and then try to have my laptop join the cluster it DOES NOT work. Dave, did you eventually figure out the cause for this? On Sunday, 3 March 2013 22:14:42 UTC+5:30, Dave O wrote: My host 192.168.1.11 is a virtual server running thru virtualbox on a windows

Use LSI with elasticsearch

2014-04-07 Thread Navneet Mathpal
Hi, i want to use LSI with elastic search, is there any tutorial for starting it ? how can i do this ? thanks, Navneet -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an

updating an existing object in nested type

2014-04-07 Thread Kalyan Srinivas
Hi all can somebody help me/guide me on how to update an existing nested type,i could get to add new object to the nested array of objects but not update an existing nested type example document from ES { code:1234 blogname:my first blog association:[{